gmongaras/medium_8192sl_gpu_64bs__squared__sm_norm__A_mask_type_neg_softplus__in_conv_k_2__att2
3B • Updated • 3 • 1
Gabriel Mongaras
gmongaras
AI & ML interests
None yet
Recent Activity
updated a collection 2 days ago
Papers I'm going to read upvoted a paper 2 days ago
Rethinking the Role of Efficient Attention in Hybrid Architectures updated a collection 2 days ago
Papers I'm going to readOrganizations
gmongaras/medium_8192sl_gpu_64bs__softmax
0.7B • Updated • 3
gmongaras/medium_8192sl_gpu_64bs__mamba
0.7B • Updated • 1
gmongaras/datav3_attempt5_8GPU_SoftFlash_RoPE2d_2AccSteps_13batchsize_stage3
Updated
gmongaras/datav3_attempt5_8GPU_SoftFlash_RoPE2d_2AccSteps_40batchsize_stage2
Updated
gmongaras/t
Updated
gmongaras/datav3_attempt5_8GPU_SoftFlash_RoPE2d_2AccSteps_140batchsize_stage1
Updated
gmongaras/Llama3.1_8B_Instruct_GRPO_gsm8k
Updated
gmongaras/datav3_attempt4_8GPU_SoftFlash_RoPE2dV2_2AccSteps_stage2
Updated
gmongaras/datav3_attempt4_8GPU_SoftFlash_RoPE2dV2_2AccSteps
Updated
gmongaras/Latent_Diffusion_Model_Imagenet2012_Softmax_250000
Updated
gmongaras/Softmax_Attention_BERT
Feature Extraction • Updated • 4
gmongaras/Cosine_Attention_BERT
Feature Extraction • Updated • 7
gmongaras/Cosine_Attention_GPT_1.2B
Feature Extraction • Updated • 4
gmongaras/Cosine_Attention_GPT_300M
Feature Extraction • Updated • 8
gmongaras/Softmax_Attention_GPT_1.2B
Feature Extraction • Updated • 6
gmongaras/Softmax_Attention_GPT_300M
Feature Extraction • Updated • 5
gmongaras/Yann_UWU
Text Generation • 7B • Updated • 3
gmongaras/Meta-Llama-3.1-8B
Text Generation • 8B • Updated • 2
gmongaras/reddit_negative_v1_13B
Text Generation • Updated • 2 • 1
gmongaras/Wizard_7B_Squad_v2
Text Generation • Updated • 2 •
gmongaras/reddit_negative_v1_8B
Text Generation • Updated • 8 •
gmongaras/Wizard_7B_Reddit_Political_2019_13B
Text Generation • Updated • 9 •
gmongaras/Wizard_7B_Squad_8bit
Text Generation • Updated
gmongaras/Wizard_7B_Squad
Text Generation • Updated • 4 •
gmongaras/Wizard_7B_Reddit_Political_2019
Text Generation • Updated • 2 •
gmongaras/Wizard_7B_Reddit_Political_2019_8bit
Text Generation • 7B • Updated • 3
gmongaras/wizardLM-7B-HF-8bit
Text Generation • Updated • 4
gmongaras/gpt-anime-sub-1.3B
Text Generation • 1B • Updated • 509 • 6