New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Too much memory used #13

Open

davidgfnet opened this issue Jun 10, 2016 · 0 comments

davidgfnet commented Jun 10, 2016

Hey!
Update the download.py file to use less memory:

r = s.get(config['base_url'] + url, stream = True)

Setting stream = True makes it not allocate that much memory. Since we iterate it on 1024b blocks it's not necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment