Cache for HF file system is broken

[shcheklein]

Query to reproduce:

from datachain import DataChain, C

from datachain.lib.tar import process_tar

(
  DataChain.from_storage("hf://datasets/mozilla-foundation/common_voice_17_0")
    .settings(parallel=4, cache=True, prefetch=4)
  	.filter(C("file.path").glob("*/en/train/*.tar"))
  	.gen(file=process_tar)
    .save("common-voice-index")
)

[shcheklein]

#747

Related #746

[shcheklein]

@skshetry can this be closed?

[skshetry]

Cache is still broken. The above script might work because #730 stopped prefetching for HF.

[shcheklein]

@skshetry thanks! does require an upstream fix? could you please summarize (or copy from the previous tickets / discussion).