Chunk Twice, Embed Once: A Systematic Study Of Segmentation And Representation Trade-offs In Chemistry-aware Retrieval-augmented Generation

Abstract

Retrieval-Augmented Generation (RAG) systems are increasingly vital for navigating the ever-expanding body of scientific literature, particularly in high-stakes domains such as chemistry. Despite the promise of RAG, foundational design choices -- such as how documents are segmented and represented -- remain underexplored in domain-specific contexts. This study presents the first large-scale, systematic evaluation of chunking strategies and embedding models tailored to chemistry-focused RAG systems. We investigate 25 chunking configurations across five method families and evaluate 48 embedding models on three chemistry-specific benchmarks, including the newly introduced QuestChemRetrieval dataset. Our results reveal that recursive token-based chunking (specifically R100-0) consistently outperforms other approaches, offering strong performance with minimal resource overhead. We also find that retrieval-optimized embeddings -- such as Nomic and Intfloat E5 variants -- substantially outper

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyamiri2025chunk

Related papers

• Graph-aware Late Chunking For Retrieval-augmented Generation In Biomedical Literature (2026)0.00
• Chembed: Enhancing Chemical Literature Search Through Domain-specific Text Embeddings (2025)0.00
• Beyond Chunk-then-embed: A Comprehensive Taxonomy And Evaluation Of Document Chunking Strategies For Information Retrieval (2026)0.00
• Optimizing Retrieval-augmented Generation: Analysis Of Hyperparameter Impact On Performance And Efficiency (2025)0.00
• Ragsmith: A Framework For Finding The Optimal Composition Of Retrieval-augmented Generation Methods Across Datasets (2025)0.00
• HASH-RAG: Bridging Deep Hashing With Retriever For Efficient, Fine Retrieval And Augmented Generation (2025)0.00
• Advancing Retrieval-augmented Generation For Structured Enterprise And Internal Data (2025)1.20
• Utilizing Metadata For Better Retrieval-augmented Generation (2026)0.00