AI and infrastructure news
Filter by type: Post22
- 18 days ago x.com
Quantizing 10M EmbeddingGemma vectors to 1 bit with MRL cuts RAM from 30GB to 0.4GB
The author's post reports compressing 10 million EmbeddingGemma embeddings to 1 bit, with MRL reduction to 256 dimensions, dropping RAM from about 30GB to 0.4GB at a stated quality loss of about 5%.
- 18 days ago x.com
Benchmark tests retrieval in legal RAG systems
A paper published on March 7, 2026 presents a criminal-law retrieval benchmark with 4,876 passages and 100 complex questions written by legal experts.
- 18 days ago x.com
BM25: lexical search without embeddings
A post published on February 9, 2026 explains how BM25 scores documents using term rarity, diminishing returns for repetitions, and document-length normalization.
- 18 days ago x.com
Iceberg broadens vector search evaluation
On December 21, 2025, researchers from Alibaba and partners presented Iceberg, a suite with eight datasets that evaluates vector search through its effects on downstream tasks, beyond recall and latency.
- 18 days ago x.com
MTEB v2 expands embedding evaluation
On October 20, 2025, an MTEB team post introduced version 2 of its evaluation suite, with multimodal support, rerankers, and migration guidance.
- 18 days ago x.com
Post compares ColBERTv2 and Qwen3-Embed-8B for retrieval
Published on February 27, 2026, the post claims that 100-million-parameter ColBERTv2 surpasses Qwen3-Embed-8B and highlights BM25 with reranking as a relevant baseline.
- 18 days ago x.com
Binary quantization cuts embeddings from 4,096 to 128 bytes
A post published on March 19, 2026 describes a technique that represents each embedding dimension with one bit, reducing a 4,096-byte vector to 128 bytes.
- 18 days ago x.com
Sparse retrieval may reduce memory costs for long-context inference
A paper published on June 9, 2026 describes a technique that predicts which KV-cache chunks will be needed, keeping selected chunks on the GPU and offloading the rest.
- 18 days ago x.com
AssistRAG separates memory from answer generation
Published on November 30, 2024, the work on AssistRAG describes a way to manage memory and external knowledge without retraining the main generation model.
- 18 days ago x.com
Auto-RAG adapts iterative search to question difficulty
A post published on December 2, 2024 describes a method that plans searches and refines queries in multiple steps, adjusting the number of iterations to the difficulty of the question.
- 18 days ago x.com
Autoflow demonstrates Graph RAG with vector storage in TiDB
Published on November 22, 2024, the PingCAP repository describes Autoflow, a conversational Graph RAG knowledge base that uses TiDB Serverless for vector storage.
- 18 days ago x.com
Local vector search with SQLite and sqlite-vec
A publication dated August 2, 2024 presents a dependency-free C extension that adds vector search to SQLite.
- 18 days ago x.com
Expanding queries with knowledge graphs
A publication dated November 13, 2024 describes a workflow combining entities extracted from queries, retrieved documents, and knowledge-graph relationships to generate contextual expansions.
- 18 days ago x.com
Baidu framework makes RAG more traceable
A Baidu post published on July 30, 2024 describes a framework that evaluates retrieved documents, selects evidence, and analyzes reasoning paths before answering.
- 18 days ago x.com
Graphiti: temporal graphs for evolving data
Published on December 10, 2024, the Graphiti project describes dynamic knowledge graphs that represent relationships between entities over time and offer multiple search methods.
- 18 days ago x.com
HijackRAG highlights risks in RAG systems
Published on December 1, 2024, the post describes an attack that uses injected texts, attention diversion, and instructions to manipulate RAG system outputs.
- 18 days ago x.com
LazyGraphRAG combines vector and graph search
A post published on November 29, 2024 describes an approach combining vector RAG with breadth-first and best-first iterative search, without index summarization.
- 18 days ago x.com
Memory in AI agents: criteria for long-term projects
A survey published on August 11, 2025, by researchers at Renmin University of China and Huawei covers the design, evaluation, applications, limitations, and future directions of memory in LLM-based agents.
- 18 days ago x.com
Multi-hop RAG with a graph planned for each query
A post published on August 12, 2025 describes a method that plans dependencies among subproblems for each query and reports outperforming GraphRAG systems on three multi-hop question-answering datasets.
- 18 days ago x.com
RARe adapts retrieval models with retrieved examples
Published on December 1, 2024, the paper presents RARe, a method that uses BM25-retrieved query-document pairs as examples to guide retrieval models.
- 18 days ago x.com
REFRAG speeds up RAG with reusable embeddings
A paper published on September 15, 2025 presents REFRAG, a method that replaces most retrieved tokens with precomputed chunk embeddings. It reports 30× higher speed and support for 16× longer contexts without loss of accuracy.
- 18 days ago x.com
SimpleQA: measuring factual accuracy in AI responses
Published on October 30, 2024, the paper describes a benchmark of 4,000 factual questions and verified reference answers for evaluating models.
Let's assess your project

I reply with scope and a proposal.