Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I think this resolves the issue without having to worry about continuation tokens/etags.
The Azure SDK seems to split it up into segmented queries when we call
.Execute()
in this class:I wasn't 100% confident on my navigation of the SDK source so I double checked by temporarily adding an integration test to insert 10,000 rows into a partition and confirm they had been deleted after calling the proposed new function. The test worked as expected (albeit slowly). I have not added this test to the main branch because it slowed down the integration tests but you can see the approach here: https://github.com/stewart-r/AzureStorageTypeProvider/tree/delete-partition
This blog seems to imply it is an inherently slow operation. I can switch to using the approach in the blog and test the batch-size to try to trim down the time if you think it would be worthwhile?
(sorry about that git spaghetti - I got rid of the erroneously included files in the end but at the expense of an armada of commits I am now scared to try to squash/rebase! :-) It only appears as a single commit in the main repo if the pull requested is accepted, right?).