AI and infrastructure news
- RAG and retrievalPost
Autoflow demonstrates Graph RAG with vector storage in TiDB
Published on November 22, 2024, the PingCAP repository describes Autoflow, a conversational Graph RAG knowledge base that uses TiDB Serverless for vector storage.
- AI agentsPost
AutoToS uses tests and breadth-first search to refine functions
On August 23, 2024, an article described how AutoToS refines successor and goal-test functions using unit-test feedback and breadth-first search.
- HardwareArticle
Evaluate the BPI-AIM7 module for edge AI
A post dated October 11, 2025 describes the BPI-AIM7 as a low-power AI module based on the RK3588 and compatible with the Jetson Nano ecosystem.
- Speech: TTS and ASRModel
Assess French speech synthesis for your business
A post by PHBJT, published on September 25, 2024, points to a French text-to-speech model and mentions other speech-generation options.
- RAG and retrievalPost
Local vector search with SQLite and sqlite-vec
A publication dated August 2, 2024 presents a dependency-free C extension that adds vector search to SQLite.
- Attention and model architecturePost
CCA: attention in a compressed latent space
A post dated October 7, 2025 describes an architecture that computes attention in a smaller latent space and reports lower memory, parameter, and operation counts in tests on H100.
- Attention and model architecturePost
Model circuits can help predict reasoning errors
A post published on October 13, 2025 describes a method using attribution graphs to identify incorrect reasoning on arithmetic tasks, with improved detection metrics.
- C and C++Project
ckit.h: reusable utilities for C projects
Published on October 2, 2025, the ckit.h repository describes itself as a small kit of essentials for C projects. This pauta outlines how a company could assess its suitability and integrate it into its codebase.
- Speech: TTS and ASRProject
Audio codec for Speech LLMs: parallel tokens and streaming
In a post published on October 17, 2025, Meituan presented an open-source audio codec optimized for Speech LLMs, with parallel semantic and acoustic tokens at 16.7 Hz and low-latency streaming decoding.
- HardwarePost
Evaluating accelerators for parallel workloads
In a post published on September 18, 2025, Graphcore describes the IPU architecture and its resources for graph-based computing and irregular, sparse workloads.
- AI agentsPost
How to evaluate AI agents on workplace tasks
TheAgentCompany covers software development, project management, administration, and data science tasks to evaluate AI agents.
- SecurityProject
How to assess tools that bypass network inspection
A publication dated August 30, 2024, cites three open-source tools for bypassing deep packet inspection and points to a practical use: assessing network filtering controls.
- Speech: TTS and ASRPost
Evaluating real-time speech inference
Published on September 18, 2024, the article presents Moshi, a 7.6-billion-parameter speech-to-speech model, and Mimi, a streaming audio codec.
- HardwareArticle
How to evaluate an open RISC-V FPGA platform
Published on July 10, 2024, the project proposes a 64-bit RISC-V computer on an FPGA that can run Linux and host its own development.
- Speech: TTS and ASRArticle
Comparing speech-to-text options by quality, speed and cost
On June 24, 2024, Artificial Analysis published a comparison of speech-to-text models by word error rate, speed and price, with a ranking intended to guide selection by use case.
- RAG and retrievalProject
How to build a RAG pipeline for PDFs
A notebook published on November 28, 2024 demonstrates a RAG recipe for PDFs with Docling and Weaviate, using document conversion to Markdown or JSON.
- CUDA and GPU programmingPost
Developing high-performance CUDA matmul kernels
Published on September 29, 2025, the guide covers GPU memory hierarchy, CUDA programming, and PTX/SASS inspection to inform the development of matmul kernels.
- Attention and model architecturePost
Balancing adaptation and memory in model training
A study published on October 5, 2025, reports that a model trained on 12,000 small tasks combined new ideas and notes distinct effects from structured and mixed lessons.
- Attention and model architecturePost
How to observe information flow in LLMs
Published on October 9, 2025, the publication proposes three stages for information flow in LLMs and links massive activations to attention sinks and compression valleys.
- HardwarePaper
Stream computing: Brook’s model for GPUs
The 2004 paper describes kernels processing stream elements as an alternative to graphics APIs and shaders, a model that can inform evaluations of GPU workloads.
- Attention and model architecturePaper
Continuous Thought Machines explore neuron-level dynamics
Published on October 6, 2025, the paper presents a model using neuron-level processing and synchronization as central representations, inspired by biological neural dynamics.
- AI agentsPost
Data curation and agent autonomy: what to test
A post published on September 23, 2025 describes LIMI: 78 selected demonstrations scored 73.5% on AgencyBench, outperforming models trained on 10,000 samples.
- Training and fine-tuningProject
DeepSpeed Domino and distributed LLM training
A November 26, 2024 post describes a tensor-parallelism mechanism designed to reduce communication overhead in LLM training.
- Training and fine-tuningArticle
Detecting basketball elements with computer vision
A September 24, 2025 publication describes fine-tuning a detection model to identify players, jersey numbers, referees, the ball, and the hoop in basketball footage.
- Attention and model architecturePost
Short reasoning hints for evaluating AI systems
A paper published on October 5, 2025 describes a hint generator and a solver trained with reinforcement learning. For mathematics, it reports 44% higher accuracy on AIME 2025 than RL with long chains.
- SecurityProject
DocEx tests defenses against document exfiltration
Published on April 20, 2025, the text describes DocEx, an APT emulation tool that simulates the exfiltration of DOCX, PPTX, XLSX, and PDF files to assess security defenses.
- Attention and model architecturePost
Dragon Hatchling explores local memory in language models
Published on October 3, 2025, the post describes an architecture with simple neurons and connections that store short-term memory through Hebbian learning.
- Attention and model architecturePost
Dragon Hatchling proposes an interpretable LLM architecture
Published on October 1, 2025, the post describes an LLM architecture based on locally interacting neural particles and says it rivals GPT-2 performance.
- HardwareArticle
Dream Router 7: Wi-Fi 7 and 10GbE in one gateway
On June 4, 2025, StorageReview published an analysis of the Dream Router 7 integrated gateway, featuring Wi-Fi 7, 10GbE, PoE, UniFi apps, and security tools for homes and small and medium-sized businesses.
- Training and fine-tuningDocs
Reflective prompt optimization with DSPy GEPA
A cookbook published on October 16, 2025 presents reflective prompt optimization with DSPy GEPA and reports an 11% accuracy gain on NuminaMath-1.5 for less than US$0.50 in total.
- Speech: TTS and ASRPost
E2-F5-TTS adds an interface for voice-model tuning
On October 21, 2024, the E2-F5-TTS repository presented a Gradio app for tuning the model with user-supplied audio and automatically transcribing clips.
- RAG and retrievalPaper
EfficientRAG reduces LLM calls for multi-hop questions
An article published on August 17, 2024 presents a retrieval method that generates queries iteratively without calling an LLM at every step.
- RAG and retrievalArticle
Generative embeddings and document search: themes to evaluate
The weekly research-paper selection, volume 124, was published on October 5, 2025. It highlights generative embeddings with test-time scaling and efficient retrieval systems for visual documents.
- Training and fine-tuningPaper
ESFT targets task-relevant experts in sparse LLMs
Published on July 5, 2024, the paper studies parameter-efficient fine-tuning for Mixture-of-Experts models and presents ESFT, which trains experts selected for their relevance to the task.
- Attention and model architecturePost
Study compares attention in 13 LLMs, with 17% performing best
Published on October 12, 2025, the study reports experiments training 13 LLMs with different proportions of conventional attention and DeltaNet linear attention. The configuration with 17% attention—two of 12 layers—achieved the best result.
- SecurityArticle
Defender evasion: assessing and improving detections
Published on April 19, 2025, the article describes a two-part series on Windows Defender evasion, including direct syscalls and XOR. Part one provides basic experimental code and points to defensive uses in evaluating antivirus defenses and improving detections.
- RAG and retrievalPost
Expanding queries with knowledge graphs
A publication dated November 13, 2024 describes a workflow combining entities extracted from queries, retrieved documents, and knowledge-graph relationships to generate contextual expansions.
- OCR and document AIPost
Extracting text from PDFs with olmOCR
In a post published on February 25, 2025, AllenAI introduced olmOCR, an open-source tool for extracting plain text from different types of PDFs that can run on a GPU.
- RAG and retrievalPaper
FACT proposes iterative rewriting to retrieve multiple facts
Published on October 30, 2024, the paper presents a context-rewriting approach for retrieving multiple facts and examines incomplete answers from lengthy contexts.
- Speech: TTS and ASRModel
Multilingual speech: evaluating FireRedTTS 2
Published on September 17, 2025, the article presents an open speech synthesis model supporting long-form conversation, multilingual voice cloning, and low-latency generation.
arxiv.org
Let's assess your project
I reply with scope and a proposal.