modify _template_yaml dataset path with exact replicate

[stijn-zyphra]

We have created a drop-in replacement for the original dataset here: DigitalLearningGmbH/MATH-lighteval.

It contains appropriate builder configs s.t. it can be directly used with https://github.com/huggingface/lighteval/blob/main/examples/nanotron/custom_evaluation_tasks.py#L252 (you just need to adjust hf_repo="lighteval/MATH" to hf_repo="DigitalLearningGmbH/MATH-lighteval". Hope this helps someone.

Link

Would be great to make this eval work again!

[CLAassistant]

All committers have signed the CLA.

[stijn-zyphra]

Hi! The original dataset has been taken down by a DMCA notice (more info here) so we had to remove access to it from the hub - we're very sorry and hope this will be solved soon, it's super inconvenient for all of us.

Closing the issue in the meantime as there is nothing we can do on our side.

Closed after reading the DMCA notice.

[RobotSail]

Why was this closed?

[stijn-zyphra]

https://huggingface.co/datasets/hendrycks/competition_math/discussions/5