-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Correct bookmarked date (#9) #11
Conversation
Hi @flpezet, thanks for your contribution! In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement. It's all electronic and will take just minutes. |
You did it @flpezet! Thank you for signing the Singer Contribution License Agreement. |
Andy Lu has started to give me feedback on the PR via Singer Slack. I'm waiting for the next iteration. |
Misbehavior
Say I set
incremental_range = 'daily'
.If the tap is run at 8:AM, all the answers and landings between midnight and 8:AM will be retrieved.
An attempt to get data after 8:AM will be made with obviously no returned data.
The next job will have its
date_to_resume
set to the next day at midnight. So the next jobs won't retrieve the data after 8:AM.The resulting problem can be seen in #9 .
This PR aims at preventing
date_to_resume
to be higher thanend_date
.