As part of our open reproduction of R1, we have roughly reproduced DeepSeek's MATH-500 eval numbers with Hugging Face's lighteval suite.
We had to improve our latex parser to get the last few %.
Edward Beeching
@edwardbeeching
Lyon, France
Joined July 2010
