https://github.com/imagingdatacommons/tcia_download

Download TCIA collections to GCS (CORE REPO)
https://github.com/imagingdatacommons/tcia_download

core-repo

Last synced: about 1 year ago
JSON representation

Download TCIA collections to GCS (CORE REPO)

• Host: GitHub
• URL: https://github.com/imagingdatacommons/tcia_download
• Owner: ImagingDataCommons
• License: apache-2.0
• Archived: true
• Created: 2020-05-20T18:31:50.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2023-02-07T16:44:10.000Z (over 3 years ago)
• Last Synced: 2025-03-12T15:51:09.756Z (over 1 year ago)
• Topics: core-repo
• Language: Python
• Homepage:
• Size: 427 KB
• Stars: 2
• Watchers: 7
• Forks: 0
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

          
# tcia_download

Download TCIA collections to GCS

-Run 

-dsub_run.sh initiates dsub execution, driven by the tasks in task.tsv

-clone_collection.py does any cleanup necessary from previous runs, then calls helpers/cloner.py/copy_collection()

-copy_collection() is the main routine. It creates a pool of worker processes and then adds series UIDS into a queue

-Each worker process removes a series UID from the queue and calls copy series to perform the download and copy to GCS