LLM
Continuous context. Linear compute.
Continuum1-9B is Innomium foundation model for extreme long-context reasoning.
The value stack
Architecture
Hybrid GLA + Gated DeltaNet with NOPE.
Training
Structural distillation + 2M-context expansion.
Inference Kernels
continuum-flash-linear-attention Triton kernels.
Applications
Reasoning, math, and long-document QA at 2M context.
Why Innomium LLM
2M native context
Linear compute at million-token scale.
Strong benchmarks
75% MMLU, 37% MATH-500.
Open weights
Continuum1-9B on Hugging Face.
Custom kernels
Innomium flash-linear-attention fork.
LLM products
Continuum1-9B
Fully linear foundation model for extreme long-context reasoning.
LLM updates
View all updatesllm
Introducing Continuum1-9B
A fully linear 8.6B foundation model with 2M native context — hybrid GLA + Gated DeltaNet, open weights, and production kernels on Hugging Face.
Innomium LLM Team · 3/1/2026
llm
Why Linear Attention for 2M Context
Quadratic attention does not scale to million-token workloads. Continuum's linear layers keep latency predictable for production pipelines.
Innomium LLM Team · 2/20/2026
Frequently Asked Questions
~8.6B params, 2M context, BF16 on Hugging Face.