AI and infrastructure news
Filter by type: Post14
- 17 days ago x.com
From Numba to Triton: a practical path to GPU programming
Published on December 12, 2025, the publication presents a Jupyter notebook that teaches GPU programming with Numba and progresses to writing kernels with Triton.
- 17 days ago x.com
FlashAttention in CuPy/CUDA: implementation and performance
A project published on March 1, 2026 implements FlashAttention with tiling and online softmax, without materializing the NxN score matrix; it reports mathematical verification but no speedup over cuBLAS.
- 17 days ago x.com
Input padding to reuse variable-size CUDA graphs
In a post published on February 26, 2026, the author recommends padding inputs to nearby size ranges and creating a family of CUDA graphs to reduce recompilations in inference workloads with variable sequence lengths.
- 17 days ago x.com
CUDA kernel patterns for optimizing workloads
A February 25, 2026 post covers reduction, 1D convolution, histograms, and numerically stable softmax as core CUDA kernel patterns.
- 17 days ago x.com
64-bit pointers and bindless GPU access
A post published on April 6, 2026 compares buffer access models in GPU APIs and describes differences in their support.
- 17 days ago x.com
Scaling LLM training: parallelism choices
A playbook published on April 6, 2026 describes parallelism strategies for training LLMs on GPU clusters, drawing on 4,000 experiments with up to 512 GPUs.
- 17 days ago x.com
256-bit arithmetic in CUDA GPU kernels
A post dated September 22, 2025, presents 256-bit multiplication and addition on a GPU and covers multiword arithmetic in CUDA kernels.
- 17 days ago x.com
Developing high-performance CUDA matmul kernels
Published on September 29, 2025, the guide covers GPU memory hierarchy, CUDA programming, and PTX/SASS inspection to inform the development of matmul kernels.
- 18 days ago x.com
CUDA C++: GPU execution, memory and correctness
Published on September 19, 2026, NVIDIA's CUDA C++ programming guide covers kernels, threads, memory, synchronization, errors, and validating GPU results against the CPU.
- 18 days ago x.com
Fork Enables PCIe P2P on GeForce
A post published on August 27, 2026 reports a graphics-driver change enabling peer-to-peer PCIe transfers on GeForce cards while optimizing GPU serving.
- 18 days ago x.com
Two-core GPU on a $30 FPGA: what to assess
Published on July 9, 2026, the article describes a two-core GPU implemented on a $30 FPGA, running AI model inference at 81 MHz.
- 18 days ago x.com
GPU latency hiding: measure before optimizing
A chapter by Vasily Volkov of UC Berkeley, published July 4, 2026, on how GPUs hide latency and architecture concepts related to performance.
- 18 days ago x.com
What happens when a CUDA kernel is launched
A post published on July 11, 2026, about the CPU-to-GPU communication needed to launch a CUDA kernel and the work involved in that operation.
- 18 days ago x.com
PufferLib 4.0 reports multi-GPU scaling
Published on June 21, 2026, the report on PufferLib 4.0 describes 6.6× scaling across eight GPUs in a worst-case test and throughput above 100 million steps per second on eight RTX 5090 GPUs.
Let's assess your project
I reply with scope and a proposal.