Various-Attention-mechanisms

(โ˜… 128)

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

File Explorer

Download Latest Version (.zip)
  • 0.0- Hierarchical Attention.py
  • 0.1 -Hierarchical Attention.py
  • 0.2 Hierarchical Attention.py
  • 1.0- addictive attention.py
  • 2.0- Bahdanau_attention.py
  • 3.0- Soft_attention.py
  • 4.0 -Luong_attention.py
  • 5.0-recognizing_entailment.py
  • Keras_Multi-head_attention.py
  • Keras_Multihead_attention_1.py
  • Multi-Head_attention.py
  • Multiple_Multi_head_attention.py
  • README.md
  • scaled_dot_product_attention.py
  • Sentence_level_Hierarchical_Attention.py
  • simplest_self_attention.py
  • Word_level_Hierarchical_Attention.py

Today's picks

opencv โ˜… 90,538

Open Source Computer Vision Library

C++
LeetCodeAnimation โ˜… 76,695

Demonstrate all the questions on LeetCode in the form of animation.๏ผˆ็”จๅŠจ็”ป็š„ๅฝขๅผๅ‘ˆ็Žฐ่งฃLeetCode้ข˜็›ฎ็š„ๆ€่ทฏ

Java
unsloth โ˜… 74,217

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H

Python
moby โ˜… 71,991

The Moby Project - a collaborative project for the container ecosystem to assemble contain

Go
deer-flow โ˜… 80,475

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With t

Python
anime โ˜… 72,308

JavaScript animation engine

JavaScript
// repository documentation