Arctic-embed: Scalable, Efficient, And Accurate Text Embedding Models
2024 Β· Luke Merrick, Danmei Xu, Gaurav Nuti, et al.
Abstract
This report describes the training dataset creation and recipe behind the family of \texttt\{arctic-embed\} text embedding models (a set of five models ranging from 22 to 334 million parameters with weights open-sourced under an Apache-2 license). At the time of their release, each model achieved state-of-the-art retrieval accuracy for models of their size on the MTEB Retrieval leaderboard, with the largest model, arctic-embed-l outperforming closed source embedding models such as Cohere's embed-v3 and Open AI's text-embed-3-large. In addition to the details of our training recipe, we have provided several informative ablation studies, which we believe are the cause of our model performance.
Authors
(none)
Tags
Stats
Related papers
- Arctic-embed 2.0: Multilingual Retrieval Without Compromise (2024)0.00
- Optimized Text Embedding Models And Benchmarks For Amharic Passage Retrieval (2025)4.94
- Llama-embed-nemotron-8b: A Universal Text Embedding Model For Multilingual And Cross-lingual Tasks (2025)0.00
- Repurposing Language Models Into Embedding Models: Finding The Compute-optimal Recipe (2024)0.00
- Dewey Long Context Embedding Model: A Technical Report (2025)0.00
- Recipe1m+: A Dataset For Learning Cross-modal Embeddings For Cooking Recipes And Food Images (2018)17.24
- Evaluating Embedding Models And Pipeline Optimization For AI Search Quality (2025)0.00
- Improving Embedding With Contrastive Fine-tuning On Small Datasets With Expert-augmented Scores (2024)0.00