Skip to content

Disk Transferors

We provide a helper method to transfer disk data to an azure blob. 

def transfer_disk_to_blob(folders: list[Path],
                          index_folder: Path,
                          container: str = CONTAINER
                          ) -> None:
  • folders: the list pathlib Path specifying where the data to transfer from disk to the blob container are located. Remember to read the forge key page to learn how to properly... Well, forge a key 😊.
  • index_folder: where to store index files (in order not to re-transfer already successfully transferred files, and to store files for which transfer failed)
  • container (optional): the AWS container name to which to transfer. By default, the container environment variable is used.