Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataset 'lighteval/MATH' doesn't exist on the Hub or cannot be accessed. #3358

Closed
XuGW-Kevin opened this issue Jan 22, 2025 · 2 comments · Fixed by #3563
Closed

Dataset 'lighteval/MATH' doesn't exist on the Hub or cannot be accessed. #3358

XuGW-Kevin opened this issue Jan 22, 2025 · 2 comments · Fixed by #3563

Comments

@XuGW-Kevin
Copy link

Hi, thanks for your wonderful work!

When I tried to use the following code, it throws error (datasets.exceptions.DatasetNotFoundError: Dataset 'lighteval/MATH' doesn't exist on the Hub or cannot be accessed):

from dspy.datasets import MATH
dataset = MATH(subset='algebra')

It seems that the download link is no longer valid and therefore a pontential fix is needed.
Thanks a lot!

@okhat
Copy link
Collaborator

okhat commented Jan 22, 2025

It seems like the dataset was actually taken down. It's not immediately clear to me what the context is.

We might actually have to do the tutorial with a different dataset...

@chenmoneygithub
Copy link
Collaborator

Found the context here: huggingface/lighteval#494 (comment). Seems like the original dataset violated some copyright restriction, and was taken done.

There is a replacement thought: https://huggingface.co/datasets/DigitalLearningGmbH/MATH-lighteval, let me make a PR to point to the replacement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants