AI and infrastructure news
Filter by type: Paper273
Autonomous science limited by physical validation: allocating agents and validation bottlenecks
An arXiv paper argues that autonomous science is limited by physical validation capacity and proposes markets and institutions to allocate that scarce work.
- 13 days ago
arxiv.orgQwenGyre: elastic RL for training long-horizon agents
Alibaba Qwen presented QwenGyre, an elastic RL framework that reallocates GPUs between rollout and training and groups branched agent runs into trajectory trees with shared prefixes, with a reported speedup of up to 1.85x over Colocate.
HERMES: component-level harness with a resident LLM per code module
An arXiv paper proposes HERMES, where each repository component has a resident LLM that knows its code, with reported gains in migration and on four software engineering benchmarks.
- 17 days ago arxiv.org
RoboJEPA: how scaling JEPA world models affects robotic planning
Meta presented RoboJEPA, a latent world model based on JEPA, scaled from 22M to 8B parameters and trained on data from 12 robotic embodiments. The paper tests whether latent prediction error predicts later planning performance.
- 18 days ago arxiv.org
Memory-Efficient Expert Routing for Distributed MoE Training
The arXiv paper proposes methods to reduce the memory peak in distributed Mixture-of-Experts training, where expert dispatch dominates memory use.
- 18 days ago arxiv.org
Adapting models to Q, a language used in finance
A technical report dated January 9, 2026 presents an open-source approach to adapting language models to Q, a programming language used in quantitative finance.
ADRS explores automated systems performance research
Published on December 24, 2025, the paper presents a framework that uses language models to generate, evaluate, and refine algorithms, tested on ten tasks across networks, databases, and distributed systems.
Agent-R1: modular training for multi-turn LLM agents
The paper presents a reinforcement-learning framework for training LLM agents in multi-turn interactions with tools and sequential environments.
- 18 days ago arxiv.org
Search agents can check evidence against noise
Published on October 28, 2025, the paper describes an agent that sets search goals and checks whether retrieved evidence meets them, aiming to resist misleading cues.
- 18 days ago arxiv.org
Anti-grokking: signs of generalization loss in model weights
A paper published on February 4, 2026 examines whether weight matrices can reveal late generalization collapse in two prolonged-training experiments.
- 18 days ago arxiv.org
Sparse attention in transformers after post-training
A paper published on December 8, 2025 reports that constrained-loss sparsity regularization retained the pretraining loss of models up to 7 billion parameters while using about 0.4% of attention connections.
- 18 days ago arxiv.org
Exclusive attention: an alternative for language models
An article published on March 12, 2026 presents an attention variant that reportedly outperforms standard attention in models of up to 2.7 billion parameters.
- 18 days ago arxiv.org
Self-distillation may support continual learning without rewards
A post published on February 16, 2026 describes a self-distillation technique for training models on new tasks without a reward function, with the aim of reducing catastrophic forgetting.
AutoSOTA automates iterative AI model improvement
Published on April 19, 2026, the post describes a system with eight specialized agents that reproduced and improved models, reporting 105 new state-of-the-art models across LLMs, computer vision, and time series.
- 18 days ago arxiv.org
BAPO aims to stabilize off-policy training for LLMs
Published on October 23, 2025, the paper presents BAPO, a method using balanced policy optimization and adaptive clipping for partial rollout and experience reuse scenarios.
- 18 days ago arxiv.org
BEAVER proposes probability bounds for LLM safety
Published on December 10, 2025, the paper presents a framework for calculating deterministic probability bounds on whether an LLM satisfies a safety property, contrasting them with sampling-based estimates.
- 18 days ago akkadia.org
Shared libraries: guiding their development
Published on February 16, 2026, Ulrich Drepper’s guide covers the design and implementation of shared libraries.
- 18 days ago arxiv.org
CE-GPPO aims to preserve gradients in LLM RL
Published on October 30, 2025, the paper presents CE-GPPO, a method addressing low-probability token gradients discarded by PPO clipping and coordinating policy entropy during training.
- 18 days ago arxiv.org
CliffordNet tests Clifford algebra in neural networks
A post published on April 20, 2026 describes an architecture using the geometric product, without attention or mixer layers, and reports 77.82% accuracy on CIFAR-100 with 1.4 million parameters.
- 18 days ago arxiv.org
CogRouter adjusts agent reasoning at each step
Published on February 16, 2026, the material describes four cognitive levels for LLM agents and reports 82.3% benchmark success for a 7B model.
- 18 days ago eprint.iacr.org
Evaluating constant-time tests for cryptographic libraries
An article published on March 28, 2026 compares DATA and Microwalk for detecting constant-time violations in cryptographic libraries.
- 18 days ago arxiv.org
Stabilizing reinforcement learning with LLMs
A Qwen team article published on December 16, 2025, examines instability in reinforcement learning for language models and highlights differences between training and inference, old and new policies, importance sampling, and routing replay.
Evolving coding-agent harnesses with evidence
A paper published on April 29, 2026 presents a framework for improving coding-agent harnesses. On Terminal-Bench 2, pass@1 rose from 69.7% to 77.0% over ten iterations.
Measuring performance when scaling agent systems
A December 11, 2025 article examines how coordination, model capability, and system and task factors influence agent performance.
- 18 days ago arxiv.org
How to validate questions about knowledge graphs
A post published on December 10, 2025 describes SEAL, a framework that extracts the minimum core of a question and uses an agent to validate it against a database.
- 18 days ago arxiv.org
KV cache compression could cut memory use by up to 50×
A publication dated June 12, 2026 describes an Attention Matching method for KV cache compression, reporting reductions of up to 50× on some datasets with minimal quality loss.
Float conversion: comparing algorithms
A March 10, 2026 paper compares floating-point conversion algorithms across architectures and datasets; Schubfach and Dragonbox reach up to ten times the speed of Dragon4.
- 18 days ago arxiv.org
CUDA-L2 automates HGEMM kernel tuning
An article published on December 15, 2025 presents an approach combining language models and reinforcement learning to optimize CUDA kernels for half-precision matrix multiplication.
- 18 days ago arxiv.org
DeepCrossAttention combines Transformer layers based on input
A description published on March 16, 2026 presents DeepCrossAttention, which uses learned, input-dependent weights to combine Transformer layer outputs.
Dual-play proposes training LLM reasoning with less supervision
Published on December 15, 2025, the paper presents dual-play: two models take specialized roles, one creating questions and the other solving them, to reduce reliance on external supervision.
- 18 days ago arxiv.org
EB-JEPA explores world models through embedding predictions
Published on February 4, 2026, the article presents EB-JEPA, an open-source modular library for learning representations and world models with architectures that predict in representation space rather than pixel space.
- 18 days ago arxiv.org
EditScore applies reward models to image editing
A post dated October 25, 2025 presents a family of reward models for evaluating and guiding complex image edits, with reported results on EditReward-Bench.
- 18 days ago gabi.xinuos.com
ELF on Linux: structuring binary analysis
Published on April 1, 2026, the publication about the ELF specification describes the format used for Linux executables, object files, shared libraries, and core dumps.
Controlled evolution for algorithmic code optimization
A January 14, 2026 article presents an iterative code evolution method evaluated on EffiBench-X, using diverse strategies, feedback-guided mutations, and experience across tasks.
- 18 days ago arxiv.org
Fluxion proposes hybrid sparse attention for long-context inference
Published on May 11, 2026, the article presents a hybrid sparse-attention system for long-context inference using CPU–GPU parallelism.
- 18 days ago refspecs.linuxfoundation.org
ELF format: organize binary analysis
Published on February 28, 2026, the specification documents the ELF format used for executables and object files. Companies can apply this knowledge to inventory binaries and improve analysis tools.
- 18 days ago arxiv.org
GATs weigh the importance of graph neighbors
The 2018 ICLR paper presents networks that assign weights to connected neighbors. The February 12, 2026 publication highlights the approach as an option to compare for graph-data tasks.
- 18 days ago arxiv.org
HybridGen proposes hybrid attention for long-context inference
A paper published on April 21, 2026 presents HybridGen, a framework coordinating attention between CPU and GPU with CXL memory for long-context language-model inference.
- 18 days ago arxiv.org
Instability in low-precision Flash Attention
Published on March 15, 2026, the paper examines catastrophic loss spikes in low-precision training with Flash Attention, linking them to similar internal attention data patterns and accumulating biased rounding errors.
- 18 days ago users.cs.utah.edu
Integer overflow in C and C++: controls to reduce risk
A 2012 University of Utah article discusses integer overflow in C and C++, a relevant risk when writing and reviewing code in these languages.
Let's assess your project
I reply with scope and a proposal.