@baekpica2
Sunghoon BaekDeveloper▲5
AI Engineer, Independent
4h ago · Link · Models · Seoul

Inkling-2-Small for Single DGX-Spark

Inkling 2 Small (594B total, 17B active, 384 experts × top-8, text + image in) with its 587B routed-expert weights vector-quantized to 12 bits per 8 weights by hVQ: 110.1 GiB of parts, sized to serve on one 128 GB DGX Spark (GB10) through ds4-dfm-rs with the vision tower and the MTP drafter.

huggingface.co logoRead the original article ↗huggingface.co · /Baekpica/Inkling-2-Small-VQ-GGUF

Comments

No comments yet
Start the conversation.
Log in to join the thread.