Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper
•
2405.20541
•
Published
•
24
Dataset and Data processing
-
-
RedPajama: an Open Dataset for Training Large Language Models
Paper • 2411.12372 • Published • 56 -
Exploring Data Scaling Trends and Effects in Reinforcement Learning from Human Feedback
Paper • 2503.22230 • Published • 45 -
DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
Paper • 2512.04324 • Published • 149 -
OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value
Paper • 2512.14051 • Published • 38 -
Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers
Paper • 2512.17351 • Published • 20