Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto File upload #772

Open
2 tasks
dmpetrov opened this issue Jan 2, 2025 · 0 comments
Open
2 tasks

Auto File upload #772

dmpetrov opened this issue Jan 2, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@dmpetrov
Copy link
Member

dmpetrov commented Jan 2, 2025

Description

As the next step of file upload #771 and #758.

class FileBuffer(File):  # name suggestions are welcome
   pass

In user code:

def func(file: File) -> Iterator[FileBuffer]:
   ...
   for intervals in input_file:

       yield FileBuffer(data=interval_data, new_path)

As a result, DC should handle the uploads and do that async. We might need another settings like post_fetch for this.

  • Implement auto file upload - FileBuffer class
  • Implement async mode for FileBuffer
@dmpetrov dmpetrov added the enhancement New feature or request label Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant