Launch HN: General Instinct (YC P26) – Frontier models on edge devices

guanming0717

author • 1 mention

Hacker News

source • 1 mention

Launch HN: General Instinct (YC P26) – Frontier models on edge devices.

Supported by 1 story

Hey HN, Guanming and Bill here from General Instinct (https://general-instinct.com/).After years of working in robotics, we kept running into the same problem: the best models never fit the hardware we actually had available.The models that performed best were usually designed around datacenter assumptions: large GPUs, lots of memory bandwidth, and reliable network access.

Supported by 1 story

But most physical systems have the opposite constraints.That led us down the path of figuring out how much of a frontier model could be preserved while still making it practical to run on edge hardware.As part of that work, we recently open sourced InstinctRazor (https://github.com/General-Instinct/InstinctRazor)One result we're excited about is compressing Qwen3.5-122B-A10B, a roughly 245 GB BF16 MoE model, into a 48 GiB GGUF.

Supported by 1 story

The resulting model is actually smaller than Gemma-4-26B-A4B while outperforming it on benchmarks like MMLU-Pro and GPQA-D etc.

Supported by 1 story

we preserve the parts that are always active (router, norms,...

Supported by 1 story