AI and infrastructure news
- OCR and document AIProject
How to structure OCR testing for your business
In a post published on July 25, 2026, the author says Baidu Unlimited OCR was added to mlx-vlm and plans to evaluate it using an OCR benchmark.
- Reinforcement learningDemo
Explore reinforcement environments and run rollouts
An interactive Space published on September 29, 2026 lets engineers inspect reinforcement-learning environments and run rollouts. Its approach can inform internal evaluation and testing tools.
- Attention and model architecturePaper
How LLMs represent sums and arithmetic errors
An article published on June 28, 2026, analyzes internal representations during sums with multiple operands and proposes a geometric model to explain arithmetic errors.
- Reinforcement learningPost
How to measure RL gains on software engineering tasks
A post dated September 21, 2026 reports that MiMo Pro's DeepSWE score rose from 58.41 to 72.57 after reinforcement learning runs.
- Reinforcement learningPost
How RL Could Expand Skills Learned Through SFT
A post published on July 11, 2026, presents the hypothesis that RL can separate useful SFT components into reusable skills and routing rules.
- LLM inferencePost
How vLLM schedules requests and allocates the KV cache
The September 26, 2026 article traces a request through vLLM and explains per-iteration scheduling and KV cache block allocation.
- C and C++Paper
How to observe packet paths through the Linux kernel
Published on June 27, 2026, the publication covers the path a packet takes through the Linux kernel and how this knowledge can help engineers analyze Linux network behavior.
- C and C++Post
How to organize and evaluate compiler optimizations
A 1971 paper by Frances Allen catalogs compiler optimization transformations and serves as an introductory reference for engineers evaluating passes in their toolchains.
- C and C++Article
How static programs start on Linux and why it matters
In an article published on July 2, 2026, Eli Bendersky explains how statically linked programs start on Linux and why understanding the process helps engineers reason about Linux executables and linking.
- Attention and model architecturePaper
Reducing Cost and Latency in LLM Applications
A July 10, 2026 article explores alternatives to long reasoning chains to balance accuracy, context size, compute cost, and latency.
- Training and fine-tuningPaper
Reducing training–inference gaps in RL for LLMs
An article published on June 30, 2026 discusses inconsistent probabilities between training and inference engines and describes TIS and checkpoint rejection when rewards diverge.
- LLM inferenceProject
Reproducing multi-GPU serving and thermal profiling
A GitHub repository published on July 30, 2026 presents a reproducible GLM-5.2 EXL3 MTP3 serving configuration and thermal profile for four RTX PRO 6000 Blackwell GPUs.
- Training and fine-tuningArticle
Test training scale before expanding GPU capacity
In a report published on October 5, 2026, Aleph Alpha describes scaling a 30B-A3B MoE model from 16 to 512 B200 GPUs, reporting near-linear scalability and 35.3% MFU.
- Attention and model architecturePaper
How to test n-gram lookups in language models
A technical publication dated August 25, 2026 describes Engram, a module that retrieves n-gram embeddings and can move its lookup table to the CPU with little inference slowdown.
- Training and fine-tuningPost
Making model training more observable
On August 21, 2026, a publication about Marin described training data and metrics visualizations that can support model inspection.
- CUDA and GPU programmingArticle
How a memory read moves through the RTX 4090
An article dated August 13, 2026 traces an LDG.E SASS instruction through the RTX 4090’s hardware units and memory hierarchy, including details explored through reverse engineering.
- AI agentsPost
Validating results generated by research agents
An arXiv paper published on September 1, 2026, reports that checking manuscript claims against execution logs reduced the reported rate of serious errors to 4%.
- AI agentsPaper
How to verify rewards for coding agents
A paper published on July 11, 2026 examines four reward-verification designs and finds no single solution to the challenge of reliably evaluating coding agents.
- Attention and model architecturePaper
Sharing QKV projections in Transformers
A paper published on July 2, 2026 evaluates attention variants that share projections and reports that equating key and value was excessive for the author's small ternary LLMs.
- Training and fine-tuningPaper
Lightweight compression reduces vectors in ColBERT systems
Published on July 8, 2026, the paper describes pooling-aware fine-tuning with k-means to reduce token vectors per document in ColBERT models, with no loss of accuracy according to the publication.
- LLM inferenceProject
Model communication on Huawei Ascend NPUs
The publication, dated September 30, 2026, describes a high-performance communication library for machine learning training and inference on Huawei Ascend NPUs.
- LLM inferenceProject
Inference configuration across two DGX Sparks
A pull request dated July 31, 2026 updates the default checkpoint and installs the encoder on both ranks in a two-DGX-Spark configuration.
- HardwarePost
Crescent Island listed with 32 Xe3P cores and 480 GB LP5X
A publication dated August 24, 2026, lists Intel Crescent Island with 32 Xe3P cores, 480 GB of LP5X memory, and 350 W power consumption.
- LLM inferenceArticle
Crusoe reports inference results on 512 AMD MI355X GPUs
In a September 16, 2026 publication, Crusoe reports MLPerf Inference v6.1 results: 5.75 million tokens per second on gpt-oss-120b and linear scaling without InfiniBand.
- Attention and model architecturePaper
CTM-AI explores an AI architecture inspired by consciousness
Published on August 25, 2026, the article presents the early CTM-AI project, which applies the Conscious Turing Machine to AI architecture without reporting benchmark results.
- CUDA and GPU programmingPost
CUDA C++: GPU execution, memory and correctness
Published on September 19, 2026, NVIDIA's CUDA C++ programming guide covers kernels, threads, memory, synchronization, errors, and validating GPU results against the CPU.
- Training and fine-tuningProject
datatrove 0.10.0 runs pipelines on managed jobs
datatrove 0.10.0 adds pipeline execution on managed jobs, support for storage buckets as data folders, and preservation of reasoning outputs in inference results.
- HardwarePost
Dell Precision T7910: assessing a used multi-GPU platform
A publication dated July 17, 2026, lists the T7910 configuration and highlights PCIe slots, ECC memory, and power limits as factors in assessing multi-GPU computing.
- Attention and model architecturePaper
Depth-wise batching in recurrent models: how to assess it
A post published on September 2, 2026 describes how overlapping requests at different recurrent depths may improve utilization in models with adaptive compute.
- Attention and model architecturePaper
DepthBench proposes evaluating computational depth in Transformers
Presented on September 29, 2026, DepthBench compares information-flow approaches and examines whether they help deeper Transformers use their layers effectively.
- C and C++Project
Software debugging: a methodology beyond Unix and Python
The open book The Art of Debugging is available in PDF and EPUB, has five chapters, and covers Unix, Python, and PyTorch. Its author says the methodology chapter applies to software debugging in general.
- Training and fine-tuningPaper
Black-box LLM distillation with GAD
An article dated September 13, 2026 presents an on-policy method for distilling models using only the text outputs of a proprietary teacher.
- Attention and model architecturePaper
Distilling Transformers into Mamba models
A paper published September 29, 2026 studies transferring knowledge from pretrained Transformers to state space models such as Mamba.
- Training and fine-tuningPost
On-policy distillation combines specialist models
A post published on October 6, 2026 describes MOPD, a method that trains a student model on its own rollouts with token-level supervision from domain specialists.
- Training and fine-tuningPost
Token-level distillation blends teacher and model supervision
A post dated July 8, 2026, describes a paper on dual on-policy distillation, which dynamically selects a supervision source for each token.
- Speech: TTS and ASRPost
Speaker diarization: evaluating label correction
A Google article published on October 4, 2026 describes a 4-billion-parameter model fine-tuned to correct speaker labels and reduce word-level diarization errors across four benchmarks.
- Attention and model architecturePost
Diffusing Blame proposes training networks without backpropagation
A post published on July 17, 2026 describes an error-signal routing method and reports results in image recognition, locomotion, and Craftax.
- RAG and retrievalPaper
Diffusion-GR2 speeds up reasoning-based reranking
A post dated July 2, 2026 reports that Diffusion-GR2 achieves ranking accuracy close to an autoregressive model, with decoding 2.4–3.5 times faster.
- Attention and model architectureArticle
Diffusion loops: reusing Transformer blocks
An article published on October 3, 2026 describes a text-to-image model that reuses Transformer blocks during denoising and reports gains from adding loops.
- AI agentsPaper
DiscoBench tests search agents on ambiguous requests
Published on June 29, 2026, DiscoBench evaluates whether language-model search agents can handle vague, underspecified, or factually incorrect requests in multi-step retrieval and reasoning tasks.
arxiv.org
Let's assess your project
I reply with scope and a proposal.