Hugging Face model directory

inference-optimization

Inference Optimization

508 public models. Explore architecture graphs, discover recent releases, and find your next model.

inference-optimization on Hugging Face ↗

Watch inference-optimization releases

Qwen3-30B-A3B-FP8
Unspecified task30.5B params

↓ 0 downloads♡ 0 likesCreated 2026-10-26
Qwen3.8-Flash-Next-1.9B-A1.8B-small
image-text-to-text1.9B params

↓ 53 downloads♡ 0 likesCreated 2026-10-20
GLM-5-2.9B-A2.8B-small
text-generation2.9B params

↓ 43 downloads♡ 0 likesCreated 2026-10-20
GLM-5.3-3.5B-A3.3B-small
text-generation3.5B params

↓ 43 downloads♡ 0 likesCreated 2026-10-20
Nemotron-3.5-Lightning-0.9B-A0.8B-small
text-generation866.6M params

↓ 34 downloads♡ 0 likesCreated 2026-10-20
Llama-4-Scout-3.5B-A2.7B-small
image-text-to-text3.6B params

↓ 27 downloads♡ 0 likesCreated 2026-10-20
Qwen3-VL-1.0B-A0.8B-small
image-text-to-text982.9M params

↓ 37 downloads♡ 0 likesCreated 2026-10-20
gemma-4-unified-1.5B-small
image-text-to-text1.5B params

↓ 39 downloads♡ 0 likesCreated 2026-10-20
GLM-5.2-3.5B-A3.3B-small
text-generation3.5B params

↓ 44 downloads♡ 0 likesCreated 2026-10-20
Qwen3-VL-Reranker-0.6B-small
image-text-to-text592.0M params

↓ 41 downloads♡ 0 likesCreated 2026-10-20
gemma-4-1.5B-A1.4B-small
image-text-to-text1.5B params

↓ 39 downloads♡ 0 likesCreated 2026-10-20
Kimi-K3-4.6B-A4.5B-small
feature-extraction4.6B params

↓ 42 downloads♡ 0 likesCreated 2026-10-20
gpt-oss-1.5B-A1.4B-small
text-generation1.5B params

↓ 40 downloads♡ 0 likesCreated 2026-10-20
GLM-5.3-Flash-2.6B-A2.3B-small
image-text-to-text2.6B params

↓ 40 downloads♡ 1 likeCreated 2026-10-20
granite-vision-4.1-0.6B-small
image-text-to-text565.3M params

↓ 50 downloads♡ 0 likesCreated 2026-10-20
Qwen3-0.9B-A0.8B-small
text-generation886.7M params

↓ 51 downloads♡ 0 likesCreated 2026-10-20
GLM-4.7-Flash-1.0B-A0.9B-small
text-generation1.0B params

↓ 39 downloads♡ 0 likesCreated 2026-10-20
Inkling-4.5B-A4.2B-small
image-text-to-text4.5B params

↓ 48 downloads♡ 0 likesCreated 2026-10-20
DeepSeek-V4-Flash-DSpark-2.1B-A1.9B-small
text-generation2.1B params

↓ 65 downloads♡ 0 likesCreated 2026-10-20
Llama-3.2-0.5B-Instruct-small
text-generation506.0M params

↓ 49 downloads♡ 0 likesCreated 2026-10-20
NemotronH-3.4B-A3.4B-small
text-generation3.4B params

↓ 39 downloads♡ 0 likesCreated 2026-10-20
DeepSeek-V3-3.4B-A3.0B-small
text-generation3.4B params

↓ 57 downloads♡ 0 likesCreated 2026-10-20
Qwen3.6-1.3B-A1.3B-small
image-text-to-text1.3B params

↓ 627 downloads♡ 0 likesCreated 2026-10-20
Phi-3.5-MoE-1.0B-A0.7B-small
text-generation975.8M params

↓ 50 downloads♡ 0 likesCreated 2026-10-20
Qwen3.8-6.2B-A6.0B-small
text-generation6.2B params

↓ 50 downloads♡ 0 likesCreated 2026-10-20
DeepSeek-V4-Pro-3.7B-A3.4B-small
text-generation3.7B params

↓ 53 downloads♡ 0 likesCreated 2026-10-20
Qwen3-1.6B-A0.9B-FP8-REAP-15-uniform
Unspecified task1.5B params

↓ 20 downloads♡ 0 likesCreated 2026-10-15
Qwen3-1.6B-A0.9B-FP8-REAP-15-nonuniform
Unspecified task1.5B params

↓ 24 downloads♡ 0 likesCreated 2026-10-15
Qwen3-30B-A3B-FP8-REAP-15-nonuniform
Unspecified task26.2B params

↓ 30 downloads♡ 0 likesCreated 2026-10-15
Qwen3-30B-A3B-FP8-REAP-15-uniform
Unspecified task26.2B params

↓ 31 downloads♡ 0 likesCreated 2026-10-15
dflash2-qwen38-27b-regen-test
Unspecified task

↓ 0 downloads♡ 0 likesCreated 2026-10-14
qwe3.8-27B-perfectblend_replace_25ksteps_ckpt0
Unspecified task

↓ 0 downloads♡ 0 likesCreated 2026-10-12
qwen3.8-27B-speculator.dflash2.updatedparams.epoch1_end
Unspecified task

↓ 0 downloads♡ 0 likesCreated 2026-10-09
Inkling-0.92B-MTP
image-text-to-text916.0M params

↓ 46 downloads♡ 0 likesCreated 2026-10-07
GLM-5-0.88B-MTP
text-generation881.0M params

↓ 25 downloads♡ 0 likesCreated 2026-10-07
DeepSeek-V3-0.86B-MTP
text-generation860.9M params

↓ 25 downloads♡ 0 likesCreated 2026-10-07
GLM-4.7-Flash-0.82B-MTP
text-generation821.3M params

↓ 26 downloads♡ 0 likesCreated 2026-10-07
gemma-4-31b-it-speculator.dflash.latestrecipe.ckpt2
Unspecified task2.5B params

↓ 44 downloads♡ 0 likesCreated 2026-10-06
qwen38-dspark-cooldown-fineweb
Unspecified task1.8B params

↓ 45 downloads♡ 0 likesCreated 2026-10-02
qwen38-dspark-pretrain-fineweb
Unspecified task1.8B params

↓ 60 downloads♡ 0 likesCreated 2026-10-01
Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform
text-generation23.3B params

↓ 192 downloads♡ 0 likesCreated 2026-09-29
Qwen3-30B-A3B-Thinking-2507-REAP-25-uniform
text-generation23.3B params

↓ 338 downloads♡ 1 likeCreated 2026-09-29
qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end
Unspecified task2.1B params

↓ 187 downloads♡ 0 likesCreated 2026-09-29
gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0
Unspecified task3.2B params

↓ 62 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4
text-generation2.0B params

↓ 157 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4
text-generation2.0B params

↓ 152 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4
text-generation2.0B params

↓ 148 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4
text-generation2.0B params

↓ 149 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4
text-generation2.0B params

↓ 302 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4
text-generation2.0B params

↓ 296 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8
text-generation2.0B params

↓ 114 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-Gauss-FP8-W8A8
text-generation2.0B params

↓ 116 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-FP8-DYNAMIC
text-generation2.0B params

↓ 133 downloads♡ 0 likesCreated 2026-09-28
Qwen3.8-27B-DSpark-FP8-BLOCK
text-generation2.0B params

↓ 115 downloads♡ 0 likesCreated 2026-09-28
qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_step107505
Unspecified task2.1B params

↓ 79 downloads♡ 0 likesCreated 2026-09-28
Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4
text-generation1.0B params

↓ 99 downloads♡ 0 likesCreated 2026-09-28
Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4
text-generation1.0B params

↓ 95 downloads♡ 0 likesCreated 2026-09-28
Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4
text-generation1.0B params

↓ 91 downloads♡ 0 likesCreated 2026-09-28
Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4
text-generation1.0B params

↓ 90 downloads♡ 0 likesCreated 2026-09-28
Qwen3-8B-DFlash-FP8-BLOCK
text-generation2.3B params

↓ 70 downloads♡ 0 likesCreated 2026-09-28

Models / 508

Qwen3-30B-A3B-FP8

Qwen3.8-Flash-Next-1.9B-A1.8B-small

GLM-5-2.9B-A2.8B-small

GLM-5.3-3.5B-A3.3B-small

Nemotron-3.5-Lightning-0.9B-A0.8B-small

Llama-4-Scout-3.5B-A2.7B-small

Qwen3-VL-1.0B-A0.8B-small

gemma-4-unified-1.5B-small

GLM-5.2-3.5B-A3.3B-small

Qwen3-VL-Reranker-0.6B-small

gemma-4-1.5B-A1.4B-small

Kimi-K3-4.6B-A4.5B-small

gpt-oss-1.5B-A1.4B-small

GLM-5.3-Flash-2.6B-A2.3B-small

granite-vision-4.1-0.6B-small

Qwen3-0.9B-A0.8B-small

GLM-4.7-Flash-1.0B-A0.9B-small

Inkling-4.5B-A4.2B-small

DeepSeek-V4-Flash-DSpark-2.1B-A1.9B-small

Llama-3.2-0.5B-Instruct-small

NemotronH-3.4B-A3.4B-small

DeepSeek-V3-3.4B-A3.0B-small

Qwen3.6-1.3B-A1.3B-small

Phi-3.5-MoE-1.0B-A0.7B-small

Qwen3.8-6.2B-A6.0B-small

DeepSeek-V4-Pro-3.7B-A3.4B-small

Qwen3-1.6B-A0.9B-FP8-REAP-15-uniform

Qwen3-1.6B-A0.9B-FP8-REAP-15-nonuniform

Qwen3-30B-A3B-FP8-REAP-15-nonuniform

Qwen3-30B-A3B-FP8-REAP-15-uniform

dflash2-qwen38-27b-regen-test

qwe3.8-27B-perfectblend_replace_25ksteps_ckpt0

qwen3.8-27B-speculator.dflash2.updatedparams.epoch1_end

Inkling-0.92B-MTP

GLM-5-0.88B-MTP

DeepSeek-V3-0.86B-MTP

GLM-4.7-Flash-0.82B-MTP

gemma-4-31b-it-speculator.dflash.latestrecipe.ckpt2

qwen38-dspark-cooldown-fineweb

qwen38-dspark-pretrain-fineweb

Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniform

Qwen3-30B-A3B-Thinking-2507-REAP-25-uniform

qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_end

gemma-4-31B-it-speculator.dflash.latestrecipe.bs8.ckp0

Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4

Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4

Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4

Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4

Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8

Qwen3.8-27B-DSpark-Gauss-FP8-W8A8

Qwen3.8-27B-DSpark-FP8-DYNAMIC

Qwen3.8-27B-DSpark-FP8-BLOCK

qwen3.8-27B-speculator.dflash2.comparisonrecipe.v2.epoch1_step107505

Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4

Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4

Qwen3-8B-DFlash-FP8-BLOCK