AI and infrastructure news
Filter by type: Article292
- 19 days ago wheels.astral.sh
GPU indexes expand PyTorch and Python support
An Astral post published on October 5, 2026, reports support for PyTorch 2.13 and 2.14 and Python 3.15, with GPU wheels for packages including FlashAttention and DeepSpeed.
- 19 days ago eeengineer.com
Authorized inspection of HTTPS traffic with TLS 1.3
An article published on August 29, 2026, explains how to record session secrets using SSLKEYLOGFILE and load them into Wireshark to inspect HTTP requests in captured HTTPS connections.
Jagged Flash Attention on NVIDIA Blackwell: lessons for kernel optimization
In an article published on October 1, 2026, the PyTorch blog describes an attention kernel developed with TLX for NVIDIA Blackwell. For the jagged shapes in Meta's Generative Ads Model, the article reports performance exceeding FlashAttention-4.
- 19 days ago arxivb.org
JAZ and evaluating recursive agent loops
Published on September 26, 2026, the post describes JAZ, a minimalist framework that uses a single recursive primitive for agent loops, and claims it may outperform Letta and ACE at lower cost.
Triton paged-attention kernel for technical evaluation
A July 10, 2026 post shares a Triton paged-attention kernel attributed to an AI model and a solution file hosted on KernelBench.
LiFT expands iterative inference with a shared DiT core
Published on October 6, 2026, the research reports that LiFT outperforms a dense DiT baseline on ImageNet 256×256 with about 60% fewer parameters.
- 19 days ago brendangregg.com
Linux perf: performance profiling and tracing
A post dated June 27, 2026 presents Linux perf (perf_events) examples for performance analysis and debugging, using tracepoints, kprobes/uprobes, PMCs, and software events.
- 19 days ago mlc.ai
CMU book covers GPU programming for ML systems
Published on June 23, 2026, the online book draws on a CMU ML Systems course mini-series and covers GPU programming techniques for ML systems.
LoopCD refines Transformer decoding without additional training
The paper, published on October 2, 2026, presents a technique that compares predictions from early and late recurrent states to refine decoding. It reports higher accuracy on AIME 2024 with Ouro-2.6B-Thinking.
Looped-DiT reuses blocks to reduce computation
A post published on October 1, 2026, says Looped-DiT outperformed a model 6.5 times larger on image-generation benchmarks while using 4.9 times less inference computation.
Matryoshka Attribution identifies weights linked to model behavior
In a post published on September 28, 2026, Matryoshka Attribution is presented as a technique for ranking neural representations and weight changes by their influence on behavior.
Shared memory reduces memory use in recurrent Transformers
An article published on October 5, 2026 reports a 76–79% reduction in context memory and improved quality in models with 150 million to 1 billion parameters.
- 19 days ago vxlang.org
Heterogeneous memory: compiler capacity checks
In a post published on September 28, 2026, Vx describes a machine model based on capacity, connections, and visibility, and reports two capacity errors found on a laptop without a GPU.
Token-indexed memory changes attention in Transformers
A post published on September 25, 2026 describes an architecture that sums contextual keys and token-indexed, layer-specific memory vectors, and allows the memory to reside in CPU memory.
Diffusion language models: techniques and applications
Published on July 8, 2026, the Kuleshov Group post presents diffusion language models and discusses masked diffusion, iterative refinement, post-training, and variable-length generation.
The role of chain of thought in serial tasks
An article dated October 1, 2026, examines whether chain of thought contributes computation in Transformers and reports reduced accuracy when it is removed from serial tasks.
- 19 days ago books.vizuara.ai
What pretraining a MoE model demands in practice
Published on August 20, 2026, the account documents an attempt to pretrain a 1.02-billion-parameter MoE model on an H200, covering its data pipeline, failures, and throughput tuning.
OPAL lowers attention costs in long contexts
A September 29, 2026 post describes OPAL, a method that trains linear attention models on their own outputs and reports full retrieval recovery and 83–93% of mathematical reasoning performance.
- 19 days ago esraasaleh.com
Contraction operators in RL: from concept to internal learning
Published on September 12, 2026, the article presents a visual, concise approach to explaining contraction operators, a fundamental concept in reinforcement learning.
Ornith-1.0: open models for coding agents
Announced on June 25, 2026, the Ornith-1.0 family spans models from 9B to 397B parameters, trained with reinforcement learning to optimize code and the scaffolds that guide agents.
Optimizing evaluable objectives without RL
A post dated August 27, 2026, opens a series on alternatives to reinforcement learning and introduces sampling methods for optimizing evaluable objectives.
PC-ALM trains residual MLPs up to 1,000 layers deep
Published on September 14, 2026, the paper presents PC-ALM, a local learning method for deep networks with performance described as nearly equivalent to backpropagation.
- 19 days ago hackers-arise.com
Research warns of cleartext traffic on GEO satellite links
Research published on June 18, 2026, reports that a significant portion of GEO satellite traffic is transmitted without encryption and could be intercepted using relatively accessible equipment.
- 19 days ago moondream.ai
Photon 2.1 expands streaming ASR for self-hosted deployments
Moondream says Photon 2.1 adds streaming speech recognition for three models and beats each model’s reference engine in all comparable tests.
- 19 days ago drive.google.com
Post compares OPD and RL efficiency in model training
Dated June 19, 2026, the post claims OPD can use compute and samples more efficiently than RL in finding high-reward reasoning traces.
- 19 days ago onejailbreak.com
Post reports decryption of protected iOS IPA without a physical iPhone
Published on September 27, 2026, the post claims that FairPlay-protected iOS IPAs can be decrypted without a physical iPhone or jailbreak. The report is relevant to app protection assessments.
PostTrainBench highlights model performance and reliability
On June 25, 2026, a post about PostTrainBench reported close ranking scores and zero failed runs in 84 attempts for GLM 5.2.
- 19 days ago leetgpu.com
CUDA practice with GPU challenges
In a post published on August 12, 2026, LeetGPU recommends a challenge-based CUDA practice path, from SIMD kernels to shared memory, tiling, and more advanced features.
- 19 days ago dstack.ai
dstack Presets proposes portable inference optimization
Published on August 20, 2026, dstack’s announcement presents an open-source toolkit that uses agents to simplify inference optimization and store results in a portable format.
- 19 days ago chipsandcheese.com
PRISM and binary translation on Windows on Arm
Published on September 10, 2026, the article examines PRISM, the binary translation system used by Windows on Arm, and its effects on code execution.
- 19 days ago alphaxiv.org
Projection Sampling adapts demonstrations for SFT
A paper published on October 4, 2026 presents a way to rewrite expert demonstrations as correct task trajectories that are more likely under the target model, then use them in standard supervised fine-tuning.
- 19 days ago jeffgeerling.com
QuadRF tracks drones and detects Wi-Fi with a phased-array radio
In a post published on July 10, 2026, Jeff Geerling describes QuadRF, a radio built with a Raspberry Pi 5 and an FPGA board that uses signal processing and beamforming to track drones and detect Wi-Fi through walls.
- 19 days ago doi.org
Physical neural network of metasurfaces trained without digital models
The Nature Communications paper describes a physical neural network built from four programmable metasurfaces that learns through electromagnetic interactions to focus waves, recognize objects and perform localization, without digital models.
Using C++26 Reflection to Print Class Members
On June 18, 2026, an article by Lieven de Cock demonstrates using C++26 reflection to inspect class members and print their information.
- 19 days ago godbolt.org
C++ reflection can modify private data
An example published by Compiler Explorer on July 23, 2026, uses reflection with an unchecked access context to increment every non-static data member of Foo, including its private field secret.
- 19 days ago fa.bianp.net
REINFORCE: policy gradients and variance
A post published on July 12, 2026 derives the REINFORCE estimator without differentiating through the environment and analyzes how variance depends on trajectory length.
- 19 days ago blog.google
Multimodal retrieval with embeddings in a shared space
In a post published on October 6, 2026, Google says EmbeddingGemma 2 represents text, code, images, video, and audio in a shared vector space and uses the Apache 2.0 license.
- 19 days ago riotgames.com
Riot announces on-demand Vanguard operation
In a post published on June 24, 2026, Riot announced that Vanguard can run only during gameplay when specified device security features are enabled.
- 19 days ago zhihu.com
Long-horizon RL may favor PPO
A Zhihu post published on June 24, 2026, argues that long, noisy agentic rollouts may make credit assignment harder for GRPO and make PPO's value model useful.
RL for beneficial behavior across domains
In a post published on June 18, 2026, OpenAI reports that behavior-focused reinforcement learning improved alignment across domains and resisted adversarial pressure.
Let's assess your project
I reply with scope and a proposal.