foundry.https_download

module foundry.https_download

Methods to download files from a Globus endpoint


function recursive_ls

recursive_ls(tc: TransferClient, ep: str, path: str, max_depth: int = 3)

Find all files in a Globus directory recursively

Args:

  • tc: TransferClient authorized to access the directory

  • ep: Endpoint on which the files reside

  • path: Path to the files being downloaded

  • max_depth: Maximum recurse depth

Yields: Dictionaries describing the location of the files. Each includes at least

  • "name": Name of the file

  • "path": Absolute path to the file's location


function download_file

download_file(item, data_directory, https_config)

Download a file to disk

Args:

  • item: Dictionary defining the path to the file

  • https_config: Configuration defining the URL of the server and the name of the dataset


This file was automatically generated via lazydocs.