AI and infrastructure news
Filter by type: Article292
- 18 days ago modal.com
Streaming audio transcription: Modal's example
On August 6, 2025, Modal presented an example deployment of a streaming speech recognition service using Kyutai STT.
Energy-based transformers refine token predictions
A paper published on September 27, 2025 reports that 44-million-parameter Energy-Based Transformers outperformed vanilla transformers on three of four benchmarks using RedPajama-Data-v2.
- 18 days ago wccftech.com
Four-GPU workstation offers 192 GB of VRAM
On October 4, 2025, Maxsun and Abee announced a workstation with four Intel Arc Pro B60 Dual 48G GPUs, totaling 192 GB of VRAM, for AI workloads.
- 18 days ago cnx-software.com
XIAOML Kit brings sensors and machine learning systems closer
Published on August 7, 2025, the post presents a kit with a camera, microphone, microSD storage, IMU, and display for hands-on embedded machine learning lessons.
Agents optimize GPU attention kernels
A September 28, 2026 NVIDIA post reports attention kernels up to 2.96 times faster than FlashKDA on B300, with one tenth the state error.
- 19 days ago openresearch.sh
Agents for reproducing research and provisioning GPUs
OpenResearch is described as a tool that uses agents to reproduce paper results and provision cloud GPUs. The author says it reproduced their paper end to end.
Algorithms in transformer weights: practical applications
Published on June 24, 2026, the article about The Transformer Cookbook describes encoding addition, search, and branching algorithms in transformer weights, following work on RASP.
- 19 days ago blog.quarkslab.com
Black-box analysis of Xiaomi’s MJA1 secure chip
On June 28, 2026, Quarkslab described an analysis of the MJA1 chip covering hardware, I2C traffic, flash extraction and firmware. The work mapped the command protocol and assessed security properties.
- 19 days ago essenceia.github.io
Building floating-point arithmetic from scratch
Published on July 6, 2026, the article explores building floating-point arithmetic from scratch as an advanced technical project for engineers.
- 19 days ago eli.thegreenplace.net
Multidimensional arrays: how access patterns affect performance
In an article published on July 11, 2026, Eli Bendersky compares the performance of different access patterns for multidimensional arrays using benchmarks.
On-Demand Attention aims to balance long context and speed
A publication dated September 20, 2026 describes On-Demand Attention, which uses a lightweight head to trigger full context when needed, aiming to speed decoding while recovering much of the performance lost with local attention.
- 19 days ago victorchen96.github.io
AutoResearch automates reinforcement learning experiments
A post published on June 18, 2026 describes an agent that planned and ran GPU-based reinforcement learning experiments, including code writing, debugging, and summarizing conclusions.
- 19 days ago vercel.com
Benchmark compares models for vulnerability discovery
Published on July 18, 2026, the DeepSec benchmark compares model recall, precision, and cost in an open-core application for security analysis.
- 19 days ago reddit.com
Benchmark compares seven self-hosted memory providers for Hermes Agent
Published on August 9, 2026, the community benchmark compares seven self-hosted memory providers for Hermes Agent, using 71,060 conversation turns and 3,750 questions about changing facts.
BF16 in FlashAttention: monitor gradient stability
On September 29, 2026, a technical work reported that BF16 rounding in FlashAttention can break a softmax gradient symmetry and cause explosions near the end of training. The authors propose GProj as a correction.
- 19 days ago tcgen05.mma
Blackwell Tensor Memory and matmul accumulation
The post describes how Blackwell's Tensor Memory, a separate 256 KB space per SM, stores Tensor Core results and reduces, according to the author, the issue of a matmul from 128 threads to one.
- 19 days ago lab.einsia.ai
BrowserBC turns human browsing into reusable agent skills
Published on July 7, 2026, the post describes BrowserBC, which turns human browsing traces into reusable skill cards. It reports gains in task success, retrieval, and generalization across sites.
- 19 days ago bschaatsbergen.com
TPM-protected TLS client keys in Go
An article dated September 7, 2026 explains how to use a client certificate in Go whose private key remains in a TPM, and discusses the per-handshake performance cost.
Classifying documents at scale with few examples
A post published on September 10, 2026 describes labeling 200 examples with an agent and classifying 191,724 documents for about US$0.70 in inference compute.
- 19 days ago sourceware.org
How to analyze malloc behavior in glibc
The glibc wiki covers malloc internals. Published on June 25, 2026, the page addresses how the memory allocator handles allocations.
- 19 days ago blog.mlc.ai
How to evaluate agent-driven GPU kernel optimization
TIRx Harness combines compiler analysis, a kernel catalog, hardware specifications and remote GPU evaluation to explore, debug and optimize kernels with agents.
How to assess LLM access to knowledge in its parameters
In a June 28, 2026 publication, the Google Research blog examines how reasoning may help language models access knowledge stored in their parameters. The question can inform internal tests of models and prompts.
- 19 days ago alphaxiv.org
How coding agents learn from software development experience
Published on August 9, 2026, the survey analyzes 108 systems that use development interactions to adapt memory, workflows, tools, or model parameters.
- 19 days ago arxivb.org
Directing RL compute toward harder problems
An article published on September 18, 2026, reports that the adaptive Never Give Up method samples until success to direct reinforcement-learning training compute toward harder problems in LLMs.
Structuring AI self-improvement cycles
An article published on September 13, 2026 presents a framework for AI systems to identify limitations, validate changes, and retain improvements through persistent cycles.
- 19 days ago eli.thegreenplace.net
How static programs start on Linux and why it matters
In an article published on July 2, 2026, Eli Bendersky explains how statically linked programs start on Linux and why understanding the process helps engineers reason about Linux executables and linking.
- 19 days ago aleph-alpha.com
Test training scale before expanding GPU capacity
In a report published on October 5, 2026, Aleph Alpha describes scaling a 30B-A3B MoE model from 16 to 512 B200 GPUs, reporting near-linear scalability and 35.3% MFU.
How a memory read moves through the RTX 4090
An article dated August 13, 2026 traces an LDG.E SASS instruction through the RTX 4090’s hardware units and memory hierarchy, including details explored through reverse engineering.
- 19 days ago crusoe.ai
Crusoe reports inference results on 512 AMD MI355X GPUs
In a September 16, 2026 publication, Crusoe reports MLPerf Inference v6.1 results: 5.75 million tokens per second on gpt-oss-120b and linear scaling without InfiniBand.
Diffusion loops: reusing Transformer blocks
An article published on October 3, 2026 describes a text-to-image model that reuses Transformer blocks during denoising and reports gains from adding loops.
- 19 days ago discourse.ubuntu.com
Local dictation on Ubuntu: assessing Project Myna
In a June 18, 2026 publication, Ubuntu describes Project Myna, a feature planned for Ubuntu 26.10 that aims to insert speech-to-text into the active application, with processing performed locally.
- 19 days ago fergusfinn.com
From nvcc to warps: how a CUDA kernel runs
Published on July 8, 2026, the article follows a vector-addition kernel from compilation with nvcc to execution by GPU warps.
- 19 days ago sploitfun.wordpress.com
glibc malloc: how to observe memory use
Published on June 25, 2026, the article covers how glibc malloc obtains memory from the kernel and manages the heap. This pauta proposes turning that knowledge into observability for memory-intensive services.
GRPO and OPD: practical paths for post-training
A publication dated August 26, 2026 presents two resources on post-training with reinforcement learning: one on scaling vanilla GRPO and another focused on OPD.
- 19 days ago
unsloth.aiGRPO for reasoning model training: Unsloth’s guide
Published on September 26, 2026, Unsloth’s guide covers reinforcement learning from beginner to advanced and presents the use of GRPO to train reasoning models.
A reinforcement learning guide for language models
Published on August 24, 2026, the guide connects reinforcement learning fundamentals to language-model training methods, including policy gradients, REINFORCE, and different ways to define states and rewards.
- 19 days ago lilianweng.github.io
Harness engineering and the limits of AI self-improvement
In an article published on July 7, 2026, Lilian Weng examines recursive self-improvement and identifies harness design and optimization as a practical starting point, while discussing evaluation, diversity, and security challenges.
- 19 days ago platform.claude.com
Inference hooks can block prompts before execution
Material dated August 11, 2026 describes hooks that send prompts to an organization’s safety server, which allows or denies them before inference.
HySparse2 proposes two-level KV sharing
Dated September 27, 2026, the paper presents a hybrid sparse-attention method intended to reduce prefill demands and compact KV cache storage for agents with long contexts.
Recurrent-depth AI: monitoring challenges
A September 2, 2026 publication says the Astra AI uses recurrent-depth reasoning, which may make monitoring harder, affect costs and performance, and complicate oversight.
Let's assess your project
I reply with scope and a proposal.