CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages Paper • 2309.09400 • Published Sep 17, 2023 • 87
Tuning LLMs with Contrastive Alignment Instructions for Machine Translation in Unseen, Low-resource Languages Paper • 2401.05811 • Published Jan 11, 2024 • 9
Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis Paper • 2409.20059 • Published Sep 30, 2024 • 16
Are Character-level Translations Worth the Wait? Comparing Character- and Subword-level Models for Machine Translation Paper • 2302.14220 • Published Feb 28, 2023
How Do Multilingual Models Remember? Investigating Multilingual Factual Recall Mechanisms Paper • 2410.14387 • Published Oct 18, 2024 • 1
Babel: Open Multilingual Large Language Models Serving Over 90% of Global Speakers Paper • 2503.00865 • Published Mar 2, 2025 • 64
From Bytes to Ideas: Language Modeling with Autoregressive U-Nets Paper • 2506.14761 • Published Jun 17, 2025 • 17
When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMs Paper • 2506.20544 • Published Jun 25, 2025 • 10
SambaLingo: Teaching Large Language Models New Languages Paper • 2404.05829 • Published Apr 8, 2024 • 13
Cross-Tokenizer LLM Distillation through a Byte-Level Interface Paper • 2604.07466 • Published 6 days ago • 4