The MHA2MLA-VLM model published in the paper "MHA2MLA-VLM: Enabling DeepSeek's Economical Multi-Head Latent Attention across Vision-Language Models"
Xiaoran Fan
cnxup
AI & ML interests
NLP, CV, LLM
Recent Activity
liked a dataset about 20 hours ago
sysuyy/ImgEdit liked a model 22 days ago
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_128 liked a model 22 days ago
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_32Organizations
None yet
models 9
cnxup/LLaVA-NeXT-8B-MLA-stage1-rope32
8B • Updated • 14 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_32
8B • Updated • 18 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_64
8B • Updated • 15 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_128
9B • Updated • 12 • 1
cnxup/SVD-Init
Updated • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_128
8B • Updated • 92 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_64
8B • Updated • 5 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_32
8B • Updated • 2 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage1-rope32
8B • Updated • 44 • 1