Hugging Face model directory
INC4AI
Intel Neural Compressor
71 public models. Explore architecture graphs, discover recent releases, and find your next model.
INC4AI on Hugging Face ↗
Watch INC4AI releases
-
UI-Mate-27B-AutoRound
↓ 6 downloads♡ 0 likes -
Qwen3-8B-fp-w8g128x128-for-ut
↓ 212 downloads♡ 0 likes -
Qwen3-30B-A3B-Instruct-2507-W2A16-G128-AutoRound-Testonly
↓ 8 downloads♡ 0 likes -
Qwen3-30B-A3B-Instruct-2507-Attn4bits-Mlp2bits-AutoRound-200iters-TestOnly
↓ 3 downloads♡ 0 likes -
Qwen3-8B-MXFP8-AR
↓ 363 downloads♡ 0 likes -
GELab-Zero-4B-preview-Sico-Evolution-AutoRound
↓ 6 downloads♡ 0 likes -
FastContext-1.0-4B-SFT-AutoRound
↓ 7 downloads♡ 1 like -
Qwen-Image-Bench-AutoRound
↓ 0 downloads♡ 0 likes -
Qwen-Image-AutoRound-W4A16
↓ 17 downloads♡ 0 likes -
MiMo-V2.5-Pro-int4-mixed
↓ 21 downloads♡ 1 like -
Qwen3-0.6B-autoround-W4A16
↓ 10 downloads♡ 0 likes -
LongCat-Next-int4-AutoRound
↓ 16 downloads♡ 2 likes -
GLM-5.1-int4-mixed-AutoRound
↓ 9 downloads♡ 7 likes -
Qwen3-8B-MXFP8A16-LLMC-TEST-ONLY
↓ 8 downloads♡ 0 likes -
Qwen3-8B-MXFP8-LLMC-TEST-ONLY
↓ 6 downloads♡ 0 likes -
MiroThinker-1.7-int4-AutoRound
↓ 13 downloads♡ 5 likes -
ds-r1-autoround-llmc-fp8
↓ 10 downloads♡ 0 likes -
Qwen3-30B-A3B-Instruct-2507-FP8-2Layers
↓ 23 downloads♡ 1 like -
DeepSeek-Math-V2-int4-AutoRound
↓ 23 downloads♡ 0 likes -
unsloth-DeepSeek-R1-BF16-4Layers-Test-Only
↓ 11 downloads♡ 0 likes -
Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only
↓ 28 downloads♡ 0 likes -
Youtu-LLM-2B-int4-AutoRound
↓ 15 downloads♡ 0 likes -
WeDLM-8B-Instruct-int4-AutoRound
↓ 16 downloads♡ 0 likes -
MiniMax-M2.1-int4-AutoRound
↓ 15 downloads♡ 1 like -
LongCat-Flash-Thinking-2601-int4-mixed-AutoRound
↓ 53 downloads♡ 4 likes -
Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only
↓ 13 downloads♡ 0 likes -
ds-v32-exp-w4a16-test-only
↓ 6 downloads♡ 0 likes -
DS-V3.2-fp8-w4a16-test-only
↓ 10 downloads♡ 0 likes -
DeepSeek-R1_mxfp8
↓ 0 downloads♡ 0 likes -
DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY
↓ 88 downloads♡ 0 likes -
DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only
↓ 23 downloads♡ 0 likes -
DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY
↓ 32 downloads♡ 0 likes -
Qwen3-8B-w2g64-AutoRound-test
↓ 9 downloads♡ 1 like -
Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY
↓ 5 downloads♡ 0 likes -
Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY
↓ 0 downloads♡ 0 likes -
Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY
↓ 0 downloads♡ 0 likes -
Ling-flash-2.0-gguf-q2ks-mixed-AutoRound
↓ 57 downloads♡ 9 likes -
GLM-4.6-gguf-q2ks-mixed-AutoRound
↓ 19 downloads♡ 6 likes -
DeepSeek-V3.1-Terminus-gguf-q2ks-mixed-AutoRound
↓ 27 downloads♡ 6 likes -
DeepSeek-V3.1-Terminus-int4-mixed-AutoRound
↓ 39 downloads♡ 4 likes -
Qwen3-Next-80B-A3B-Thinking-int4-AutoRound
↓ 25 downloads♡ 6 likes -
Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound
↓ 159 downloads♡ 33 likes -
gpt-oss-20b-int4-g64-AutoRound
↓ 13 downloads♡ 0 likes -
Seed-OSS-36B-Instruct-int4-AutoRound
↓ 147 downloads♡ 14 likes -
GLM-4.5V-int4-AutoRound
↓ 74 downloads♡ 14 likes -
Qwen2.5-VL-7B-Instruct-int4-mixed-AutoRound
↓ 131 downloads♡ 1 like -
Qwen3-Coder-480B-A35B-Instruct-gguf-q2ks-mixed-AutoRound
↓ 92 downloads♡ 14 likes -
Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound
↓ 68 downloads♡ 8 likes -
Qwen2-7B-int4-inc
↓ 21 downloads♡ 6 likes -
Qwen2-1.5B-Instuct-int4-inc
↓ 14 downloads♡ 3 likes -
Qwen2-0.5B-Instuct-int4-inc
↓ 22 downloads♡ 1 like -
Mistral-7B-v0.1-int4-inc-lmhead
↓ 11 downloads♡ 1 like -
falcon-7b-sq-int8-inc
↓ 56 downloads♡ 0 likes -
gemma-2b-int4-inc
↓ 27 downloads♡ 1 like -
falcon-7b-int4-inc
↓ 20 downloads♡ 0 likes -
phi-2-int4-inc
↓ 26 downloads♡ 4 likes -
neural-chat-7b-v3-3-int4-inc
↓ 36 downloads♡ 2 likes -
neural-chat-7b-v3-1-int4-inc
↓ 32 downloads♡ 2 likes -
gpt-j-6b-sparse
↓ 16 downloads♡ 1 like -
neural-chat-7b-v3
↓ 109 downloads♡ 67 likes
