| Llama-3.2-1B-Instruct-4bit | draft | generation | llama-3-2-1b-instruct-4bit.py | llama-3-2-1b-instruct-4bit.md |
| Qwen2.5-Coder-1.5B-Instruct-4bit | coder | generation | qwen2-5-coder-1-5b-instruct-4bit.py | qwen2-5-coder-1-5b-instruct-4bit.md |
| Qwen3-0.6B-4bit-DWQ | draft | generation | qwen3-0-6b-4bit-dwq.py | qwen3-0-6b-4bit-dwq.md |
| Qwen3-1.7B-4bit-DWQ | chat | generation | qwen3-1-7b-4bit-dwq.py | qwen3-1-7b-4bit-dwq.md |
| Llama-3.2-3B-Instruct-4bit | chat | generation | llama-3-2-3b-instruct-4bit.py | llama-3-2-3b-instruct-4bit.md |
| Qwen3-4B-Instruct-2507-4bit-DWQ-2510 | chat | generation | qwen3-4b-instruct-2507-4bit-dwq-2510.py | qwen3-4b-instruct-2507-4bit-dwq-2510.md |
| SmolLM3-3B-4bit | chat | generation | smollm3-3b-4bit.py | smollm3-3b-4bit.md |
| Tucano2-qwen-3.7B-Instruct-MLX-4bit | multilingual | generation | tucano2-qwen-3-7b-instruct-mlx-4bit.py | tucano2-qwen-3-7b-instruct-mlx-4bit.md |
| Tucano2-qwen-3.7B-Think-MLX-4bit | multilingual | generation | tucano2-qwen-3-7b-think-mlx-4bit.py | tucano2-qwen-3-7b-think-mlx-4bit.md |
| Fin-R1-4bit | finance | generation | fin-r1-4bit.py | fin-r1-4bit.md |
| OmniSQL-7B-4bit-mlx | sql | generation | omnisql-7b-4bit-mlx.py | omnisql-7b-4bit-mlx.md |
| watt-tool-8B | tool-use | generation | watt-tool-8b.py | watt-tool-8b.md |
| DeepSeek-Coder-V2-Lite-Instruct-4bit-mlx | coder | generation | deepseek-coder-v2-lite-instruct-4bit-mlx.py | deepseek-coder-v2-lite-instruct-4bit-mlx.md |
| Qwen3-VL-30B-A3B-Instruct-4bit | vision | vision | qwen3-vl-30b-a3b-instruct-4bit.py | qwen3-vl-30b-a3b-instruct-4bit.md |
| Qwen2.5-VL-7B-Instruct-4bit | vision | vision | qwen2-5-vl-7b-instruct-4bit.py | qwen2-5-vl-7b-instruct-4bit.md |
| Qwen3-Coder-Next-MLX-4bit | coder | generation | qwen3-coder-next-mlx-4bit.py | qwen3-coder-next-mlx-4bit.md |
| OpenThinker3-7B-4bit | reasoning | generation | openthinker3-7b-4bit.py | openthinker3-7b-4bit.md |
| Qwen3.6-35B-A3B-4bit-DWQ | chat | generation | qwen3-6-35b-a3b-4bit-dwq.py | qwen3-6-35b-a3b-4bit-dwq.md |
| Seed-Coder-8B-Reasoning-DWQ | coder | generation | seed-coder-8b-reasoning-dwq.py | seed-coder-8b-reasoning-dwq.md |
| DeepSeek-R1-0528-Qwen3-8B-4bit-DWQ | reasoning | generation | deepseek-r1-0528-qwen3-8b-4bit-dwq.py | deepseek-r1-0528-qwen3-8b-4bit-dwq.md |
| EuroLLM-9B-Instruct-MLX-4bit | multilingual | generation | eurollm-9b-instruct-mlx-4bit.py | eurollm-9b-instruct-mlx-4bit.md |
| Qwen3-Next-80B-A3B-Thinking-4bit | reasoning | generation | qwen3-next-80b-a3b-thinking-4bit.py | qwen3-next-80b-a3b-thinking-4bit.md |
| Qwen2.5-Coder-14B-Instruct-4bit | coder | generation | qwen2-5-coder-14b-instruct-4bit.py | qwen2-5-coder-14b-instruct-4bit.md |
| OpenThinker3-7B-8bit | reasoning | generation | openthinker3-7b-8bit.py | openthinker3-7b-8bit.md |
| phi-4-4bit | chat | generation | phi-4-4bit.py | phi-4-4bit.md |
| OpenMath-Nemotron-14B-4bit | math | generation | openmath-nemotron-14b-4bit.py | openmath-nemotron-14b-4bit.md |
| AceReason-Nemotron-14B-4bit | reasoning | generation | acereason-nemotron-14b-4bit.py | acereason-nemotron-14b-4bit.md |
| Qwen2.5-Coder-32B-Instruct-4bit | coder | generation | qwen2-5-coder-32b-instruct-4bit.py | qwen2-5-coder-32b-instruct-4bit.md |
| SaulLM-54B-Instruct-mlx-4Bit | legal | generation | saullm-54b-instruct-mlx-4bit.py | saullm-54b-instruct-mlx-4bit.md |
| Mistral-Small-3.2-24B-Instruct-2506-4bit | chat | generation | mistral-small-3-2-24b-instruct-2506-4bit.py | mistral-small-3-2-24b-instruct-2506-4bit.md |
| medgemma-27b-text-it-4bit | medical | generation | medgemma-27b-text-it-4bit.py | medgemma-27b-text-it-4bit.md |
| Qwen3.5-27B-4bit-DWQ | chat | generation | qwen3-5-27b-4bit-dwq.py | qwen3-5-27b-4bit-dwq.md |
| KAT-Dev-MLX-4bit | coder | generation | kat-dev-mlx-4bit.py | kat-dev-mlx-4bit.md |
| MiniMax-M2-THRIFT-55-MLX-4bit | tool-use | generation | minimax-m2-thrift-55-mlx-4bit.py | minimax-m2-thrift-55-mlx-4bit.md |
| Qwen3-VL-32B-Instruct-4bit | vision | vision | qwen3-vl-32b-instruct-4bit.py | qwen3-vl-32b-instruct-4bit.md |
| Seed-OSS-36B-Instruct-4bit | chat | generation | seed-oss-36b-instruct-4bit.py | seed-oss-36b-instruct-4bit.md |
| AceReason-Nemotron-14B-8bit | reasoning | generation | acereason-nemotron-14b-8bit.py | acereason-nemotron-14b-8bit.md |
| Codestral-22B-v0.1-4bit | coder | generation | codestral-22b-v0-1-4bit.py | codestral-22b-v0-1-4bit.md |
| EuroLLM-22B-Instruct-2512-mlx-4bit | multilingual | generation | eurollm-22b-instruct-2512-mlx-4bit.py | eurollm-22b-instruct-2512-mlx-4bit.md |
| Qwen3-235B-A22B-Thinking-2507-3bit-DWQ | reasoning | generation | qwen3-235b-a22b-thinking-2507-3bit-dwq.py | qwen3-235b-a22b-thinking-2507-3bit-dwq.md |
| Qwen2.5-72B-Instruct-4bit | chat | generation | qwen2-5-72b-instruct-4bit.py | qwen2-5-72b-instruct-4bit.md |
| c4ai-command-r-08-2024-4bit | tool-use | generation | c4ai-command-r-08-2024-4bit.py | c4ai-command-r-08-2024-4bit.md |
| OlympicCoder-32B-4bit | coder | generation | olympiccoder-32b-4bit.py | olympiccoder-32b-4bit.md |
| OpenMath-Nemotron-32B-4bit | math | generation | openmath-nemotron-32b-4bit.py | openmath-nemotron-32b-4bit.md |
| Qwen-3-32B-Medical-Reasoning-4bit | medical | generation | qwen-3-32b-medical-reasoning-4bit.py | qwen-3-32b-medical-reasoning-4bit.md |
| DeepSeek-R1-Distill-Qwen-32B-4bit | reasoning | generation | deepseek-r1-distill-qwen-32b-4bit.py | deepseek-r1-distill-qwen-32b-4bit.md |
| Olmo-3.1-32B-Think-4bit | reasoning | generation | olmo-3-1-32b-think-4bit.py | olmo-3-1-32b-think-4bit.md |
| xLAM-2-32b-fc-r-mlx-8Bit | tool-use | generation | xlam-2-32b-fc-r-mlx-8bit.py | xlam-2-32b-fc-r-mlx-8bit.md |
| Goedel-Prover-V2-32B-8bit | math | generation | goedel-prover-v2-32b-8bit.py | goedel-prover-v2-32b-8bit.md |
| Llama-3-Groq-70B-Tool-Use-4bit | tool-use | generation | llama-3-groq-70b-tool-use-4bit.py | llama-3-groq-70b-tool-use-4bit.md |
| Qwen2.5-Math-72B-Instruct-4bit | math | generation | qwen2-5-math-72b-instruct-4bit.py | qwen2-5-math-72b-instruct-4bit.md |
| gte-Qwen2-7B-instruct-Q4-mlx | embedding | embedding | gte-qwen2-7b-instruct-q4-mlx.py | gte-qwen2-7b-instruct-q4-mlx.md |
| serafim-900m-portuguese-pt-sentence-encoder | embedding | embedding | serafim-900m-portuguese-pt-sentence-encoder.py | serafim-900m-portuguese-pt-sentence-encoder.md |
| Fin-R1 | finance | generation | fin-r1.py | fin-r1.md |
| Qwen3Guard-Gen-0.6B-mxfp4-mlx | guardrail | generation | qwen3guard-gen-0-6b-mxfp4-mlx.py | qwen3guard-gen-0-6b-mxfp4-mlx.md |
| Qwen3Guard-Gen-4B-mxfp4-mlx | guardrail | generation | qwen3guard-gen-4b-mxfp4-mlx.py | qwen3guard-gen-4b-mxfp4-mlx.md |
| gte-reranker-modernbert-base-mlx | reranker | reranker | gte-reranker-modernbert-base-mlx.py | gte-reranker-modernbert-base-mlx.md |
| ibm-granite-guardian-3.1-2b-4bit | guardrail | generation | ibm-granite-guardian-3-1-2b-4bit.py | ibm-granite-guardian-3-1-2b-4bit.md |
| jina-reranker-v3-mlx | reranker | reranker | jina-reranker-v3-mlx.py | jina-reranker-v3-mlx.md |
| Devstral-Small-2507-4bit-DWQ | coder | generation | devstral-small-2507-4bit-dwq.py | devstral-small-2507-4bit-dwq.md |
| GLM-4-32B-0414-4bit-DWQ | chat | generation | glm-4-32b-0414-4bit-dwq.py | glm-4-32b-0414-4bit-dwq.md |
| GLM-4.5-Air-6bit | chat | generation | glm-4-5-air-6bit.py | glm-4-5-air-6bit.md |
| InternVL3-78B-4bit | vision | vision | internvl3-78b-4bit.py | internvl3-78b-4bit.md |
| Kimi-Dev-72B-4bit-DWQ | coder | generation | kimi-dev-72b-4bit-dwq.py | kimi-dev-72b-4bit-dwq.md |
| Kokoro-82M-bf16 | tts | tts | kokoro-82m-bf16.py | kokoro-82m-bf16.md |
| Llama-3.3-70B-Instruct-4bit-DWQ | chat | generation | llama-3-3-70b-instruct-4bit-dwq.py | llama-3-3-70b-instruct-4bit-dwq.md |
| Magistral-Small-2506-4bit-DWQ | reasoning | generation | magistral-small-2506-4bit-dwq.py | magistral-small-2506-4bit-dwq.md |
| Mistral-Large-Instruct-2407-4bit | chat | generation | mistral-large-instruct-2407-4bit.py | mistral-large-instruct-2407-4bit.md |
| QwQ-32b-4bit-DWQ | reasoning | generation | qwq-32b-4bit-dwq.py | qwq-32b-4bit-dwq.md |
| Qwen2-Audio-7B-Instruct-4bit | audio | audio-understanding | qwen2-audio-7b-instruct-4bit.py | qwen2-audio-7b-instruct-4bit.md |
| Qwen2.5-Coder-0.5B-Instruct-4bit | draft | generation | qwen2-5-coder-0-5b-instruct-4bit.py | qwen2-5-coder-0-5b-instruct-4bit.md |
| Qwen2.5-Coder-1.5B-Instruct-8bit | coder | generation | qwen2-5-coder-1-5b-instruct-8bit.py | qwen2-5-coder-1-5b-instruct-8bit.md |
| Qwen2.5-Coder-7B-4bit | coder | generation | qwen2-5-coder-7b-4bit.py | qwen2-5-coder-7b-4bit.md |
| Qwen3-30B-A3B-Instruct-2507-4bit-DWQ | chat | generation | qwen3-30b-a3b-instruct-2507-4bit-dwq.py | qwen3-30b-a3b-instruct-2507-4bit-dwq.md |
| Qwen3-32B-4bit-DWQ | chat | generation | qwen3-32b-4bit-dwq.py | qwen3-32b-4bit-dwq.md |
| Qwen3-Coder-30B-A3B-Instruct-4bit-dwq-v2 | coder | generation | qwen3-coder-30b-a3b-instruct-4bit-dwq-v2.py | qwen3-coder-30b-a3b-instruct-4bit-dwq-v2.md |
| Qwen3-Embedding-4B-mxfp8 | embedding | embedding | qwen3-embedding-4b-mxfp8.py | qwen3-embedding-4b-mxfp8.md |
| Qwen3-Embedding-8B-4bit-DWQ | embedding | embedding | qwen3-embedding-8b-4bit-dwq.py | qwen3-embedding-8b-4bit-dwq.md |
| Qwen3-Reranker-4B-mxfp8 | reranker | reranker | qwen3-reranker-4b-mxfp8.py | qwen3-reranker-4b-mxfp8.md |
| SongGeneration-v2-large | music | music | songgeneration-v2-large.py | songgeneration-v2-large.md |
| XBai-o4-4bit-DWQ | reasoning | generation | xbai-o4-4bit-dwq.py | xbai-o4-4bit-dwq.md |
| bge-m3-mlx-8bit | embedding | embedding | bge-m3-mlx-8bit.py | bge-m3-mlx-8bit.md |
| csm-1b-fp16 | tts | tts | csm-1b-fp16.py | csm-1b-fp16.md |
| demucs-mlx | audio-fx | audio-fx | demucs-mlx.py | demucs-mlx.md |
| gemma-3-27b-it-4bit-DWQ | chat | generation | gemma-3-27b-it-4bit-dwq.py | gemma-3-27b-it-4bit-dwq.md |
| gpt-oss-120b-MXFP4-Q8 | reasoning | generation | gpt-oss-120b-mxfp4-q8.py | gpt-oss-120b-mxfp4-q8.md |
| gpt-oss-20b-MXFP4-Q8 | reasoning | generation | gpt-oss-20b-mxfp4-q8.py | gpt-oss-20b-mxfp4-q8.md |
| medgemma-1.5-4b-it-4bit | medical | vision | medgemma-1-5-4b-it-4bit.py | medgemma-1-5-4b-it-4bit.md |
| multilingual-e5-large-mlx | embedding | embedding | multilingual-e5-large-mlx.py | multilingual-e5-large-mlx.md |
| orpheus-3b-0.1-ft-4bit | tts | tts | orpheus-3b-0-1-ft-4bit.py | orpheus-3b-0-1-ft-4bit.md |
| parakeet-tdt-0.6b-v3 | stt | stt | parakeet-tdt-0-6b-v3.py | parakeet-tdt-0-6b-v3.md |
| snowflake-arctic-embed-l-v2.0-8bit | embedding | embedding | snowflake-arctic-embed-l-v2-0-8bit.py | snowflake-arctic-embed-l-v2-0-8bit.md |
| whisper-large-v3-turbo | stt | stt | whisper-large-v3-turbo.py | whisper-large-v3-turbo.md |
| LFM2.5-ColBERT-350M-mxfp4 | retrieval | retrieval | lfm2-5-colbert-350m-mxfp4.py | lfm2-5-colbert-350m-mxfp4.md |
| llama-guard-3-1b | guardrail | generation | llama-guard-3-1b.py | llama-guard-3-1b.md |
| GLM-4.6-REAP-218B-A32B-mlx-3Bit | reasoning | llm | glm-4-6-reap-218b-a32b-mlx-3bit.py | glm-4-6-reap-218b-a32b-mlx-3bit.md |
| MiniMax-M2.7-REAP-139B-A10B-MLX-4bit | agentico | llm | minimax-m2-7-reap-139b-a10b-mlx-4bit.py | minimax-m2-7-reap-139b-a10b-mlx-4bit.md |
| c4ai-command-a-03-2025-4bit | chat | llm | c4ai-command-a-03-2025-4bit.py | c4ai-command-a-03-2025-4bit.md |
| Athene-V2-Chat-8bit | chat | llm | athene-v2-chat-8bit.py | athene-v2-chat-8bit.md |