chatpdflocal/gemma-3-12b-it-gguf
12B • Updated • 1.05k • 3
AI & ML interests
Tiny LLMs which are capable for running on MacOS
Recent Activity
View all activity
Organization Card
We focus on the available and excellent tiny LLMs which can be easily runned for chatting PDFs on MacOS, balancing the LLM's effect and inference speed.
models 19
chatpdflocal/gemma-4-E2B-it-GGUF
5B • Updated • 152
chatpdflocal/gemma-4-E4B-it-GGUF
8B • Updated • 176
chatpdflocal/Qwen2.5.1-Coder-14B-Instruct-GGUF
15B • Updated • 413 • 2
chatpdflocal/llama3.1-8b-gguf
8B • Updated • 901 • 29
chatpdflocal/Marco-o1-GGUF
8B • Updated • 340 • 2
chatpdflocal/gemma2-instruct-gguf
3B • Updated • 275 • 7
chatpdflocal/MobileLLM-GGUF
0.1B • Updated • 217 • 1
chatpdflocal/gemma-3-27b-it-gguf
27B • Updated • 26 • 2
chatpdflocal/QwQ-32B-GGUF
33B • Updated • 65 • 2
datasets 0
None public yet