gmongaras/Cosine_Attention_GPT_300M
Feature Extraction
•
Updated
•
11
Cosine Attention (Cottention)
Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747
-
-
gmongaras/Softmax_Attention_GPT_1.2B
Feature Extraction • Updated • 6 -
gmongaras/Softmax_Attention_GPT_300M
Feature Extraction • Updated • 6 -
gmongaras/Cosine_Attention_GPT_1.2B
Feature Extraction • Updated • 8 -
gmongaras/Cosine_Attention_BERT
Feature Extraction • Updated • 8 -
gmongaras/Softmax_Attention_BERT
Feature Extraction • Updated • 3