AI and infrastructure news

All85

LLM inference Paper
10/07/2619 days ago arxiv.org
StreamDQ moves LLM dequantization into HBM memory
A paper published on July 13, 2026 presents an architecture that dequantizes LLM weights in real time on the HBM base die while preserving conventional GPU load semantics.
LLM inference Paper
10/07/2619 days ago arxiv.org
SVD-LLM proposes model compression with post-truncation updates
Published on September 26, 2026, the paper presents an SVD-based LLM compression method that updates compressed weights after truncating singular values.
LLM inference Paper
10/07/2619 days ago arxiv.org
Switch Attention dynamically combines full and windowed attention
A paper dated September 16, 2026 presents a dynamic, granular approach to combining full and sliding-window attention in hybrid transformers.
LLM inference Project
10/07/2619 days ago github.com
TinyRouter explores routing across open models
A publication dated July 4, 2026 describes a router with about 10,000 parameters and reports benchmark results, while noting that more experiments are needed.
LLM inference Project
10/07/2619 days ago github.com
Zlaya: Laya inference on CPU with Zig
Published on September 23, 2026, the GitHub repository presents Zlaya, a compact CPU inference engine for Laya, implemented in Zig.