Skip to content

Latest commit

 

History

History
7 lines (4 loc) · 347 Bytes

retry-failed-requests-in-scrapy.md

File metadata and controls

7 lines (4 loc) · 347 Bytes

How to retry failed requests in Scrapy

You can add one or more statuses in settings.py. Scrapy will process requests normally and when one of these statuses is encountered, it will retry that request.

You can modify RETRY_HTTP_CODES and add any number of statuses there.

You can also control how many times to try with RETRY_TIMES