Skip to content

Commit

Permalink
increase of batch
Browse files Browse the repository at this point in the history
  • Loading branch information
ivukotic committed Apr 19, 2024
1 parent 96faf64 commit 213efc4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/servicex_did_finder_lib/servicex_adaptor.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ def put_file_add(self, file_info):
self.logger.error(f'After {attempts} tries, failed to send ServiceX App a put_file '
f'message: {str(file_info)} - Ignoring error.')

def put_file_add_bulk(self, file_list, chunk_length=30):
def put_file_add_bulk(self, file_list, chunk_length=300):
# we first chunk up file_list as it can be very large in
# case there are a lot of replicas and a lot of files.
chunks = [file_list[i:i + chunk_length] for i in range(0, len(file_list), chunk_length)]
Expand Down

0 comments on commit 213efc4

Please sign in to comment.