SmolTalk

SmolTalk Dataset description This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More details in our paper https://arxiv.org/abs/2502.02737 During the development of SmolLM2, we observed that models finetuned on pu

Papers using SmolTalk (2)

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model2025 · 10 citesFixing It in Post: A Comparative Study of LLM Post-Training Data Quality and Model Performance2025