{"id":21375509,"url":"https://github.com/lsst/testdata_ci_hsc","last_synced_at":"2025-10-09T14:06:43.733Z","repository":{"id":38429317,"uuid":"189469949","full_name":"lsst/testdata_ci_hsc","owner":"lsst","description":"Data used to run ci_hsc_gen(2/3)","archived":false,"fork":false,"pushed_at":"2025-04-15T00:22:01.000Z","size":2206,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":42,"default_branch":"main","last_synced_at":"2025-04-15T16:07:29.877Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lsst.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-05-30T19:21:49.000Z","updated_at":"2025-02-22T15:03:28.000Z","dependencies_parsed_at":"2023-11-07T23:05:03.603Z","dependency_job_id":"d5ac927b-91ff-4f9f-a612-5e4319e321ad","html_url":"https://github.com/lsst/testdata_ci_hsc","commit_stats":null,"previous_names":[],"tags_count":405,"template":false,"template_full_name":null,"purl":"pkg:github/lsst/testdata_ci_hsc","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsst%2Ftestdata_ci_hsc","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsst%2Ftestdata_ci_hsc/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsst%2Ftestdata_ci_hsc/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsst%2Ftestdata_ci_hsc/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lsst","download_url":"https://codeload.github.com/lsst/testdata_ci_hsc/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsst%2Ftestdata_ci_hsc/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279001530,"owners_count":26083117,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-09T02:00:07.460Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-22T09:11:17.843Z","updated_at":"2025-10-09T14:06:43.702Z","avatar_url":"https://github.com/lsst.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"###############\ntestdata_ci_hsc\n###############\n\n``testdata_ci_hsc`` provides a minimum amount of test data sufficient to run the LSST Science Pipelines `ci_hsc`_ tests from single frame processing through coaddition processing, based on engineering test data from Hyper Suprime-Cam.\n\n.. _ci_hsc: https://github.com/lsst/ci_hsc/\n\nContents of this package\n========================\n\nA clone of this package will take about 8GB of disk space: about 3.5GB of calibrations, 400MB of raw files, and their git LFS copies.\n\nraw files\n---------\n\nThe ``raw/`` directory contains 33 raw files, with these corresponding dataIds in the butler repo that is created during a run of `ci_hsc`_.\nRun this butler command on a successful `ci_hsc`_ run to get a similar table::\n\n    butler query-data-ids --collections HSC/runs/ci_hsc --datasets src DATA exposure detector\n\n\n.. _table-dataIds:\n\n.. table:: included dataIds\n\n+------+-----------------+----------------+-----------------+\n| band | physical_filter | exposure/visit | detectors       |\n+======+=================+================+=================+\n| r    | HSC-R           | 903334         | 16, 22, 23, 100 |\n+------+-----------------+----------------+-----------------+\n| r    | HSC-R           | 903336         | 17, 24          |\n+------+-----------------+----------------+-----------------+\n| r    | HSC-R           | 903338         | 18, 25          |\n+------+-----------------+----------------+-----------------+\n| r    | HSC-R           | 903342         | 4, 10, 100      |\n+------+-----------------+----------------+-----------------+\n| r    | HSC-R           | 903344         | 0, 5, 11        |\n+------+-----------------+----------------+-----------------+\n| r    | HSC-R           | 903346         | 1, 6, 12        |\n+------+-----------------+----------------+-----------------+\n| i    | HSC-I           | 903986         | 16, 22, 23, 100 |\n+------+-----------------+----------------+-----------------+\n| i    | HSC-I           | 903988         | 16, 17, 23, 24  |\n+------+-----------------+----------------+-----------------+\n| i    | HSC-I           | 903990         | 18, 25          |\n+------+-----------------+----------------+-----------------+\n| i    | HSC-I           | 904010         | 4, 10, 100      |\n+------+-----------------+----------------+-----------------+\n| i    | HSC-I           | 904014         | 1, 6, 12        |\n+------+-----------------+----------------+-----------------+\n\ncalibrations\n------------\n\nThe ``calib/`` directory contains files for brighter-fatter, bias, dark, flat, sky frame, and defect correction, plus a database defining their validity ranges.\n\nThe ``jointcal/`` directory contains jointcal output files from a full-focal plane run of jointcal astrometry and photometry.\nThese files are used to apply external jointcal calibrations during coadd processing, as there is not enough data in this package to reliably run jointcal on directly.\n\nReference catalog\n-----------------\n\nReference catalogs for astrometry and photometry are included in the ``gaia_dr2_20200414/``, ``gaia_dr3_20230707/`` (for astrometry) and ``ps1_pv3_3pi_20170110/`` (for photometry) directories.\nOnly the relevant HTM shards that apply to the above detector/visits are included.\nSee the ``README.txt`` files in those directories for details.\nThey are automatically loaded during the appropriate steps of ``ci_hsc``'s processing.\n\nRunning the tests\n=================\n\nSet up the package\n------------------\n\nThis package provides the test data for the `ci_hsc`_ package: both this and `ci_hsc`_ must be setup in eups in order to run the tests in `ci_hsc`_.\nOne way to accomplish this is as follows::\n\n  $ cd testdata_ci_hsc\n  $ setup -r .\n  $ cd PATH_TO_CI_HSC\n  $ setup -kr .\n\ngit lfs\n=======\n\nThe data used by ``ci_hsc`` is stored using `Git LFS`_; refer to the `relevant LSST documentation`_ for details on how to check out this repository.\n\n.. _Git LFS: https://git-lfs.github.com\n.. _relevant LSST documentation: http://developer.lsst.io/en/latest/tools/git_lfs.html\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flsst%2Ftestdata_ci_hsc","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flsst%2Ftestdata_ci_hsc","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flsst%2Ftestdata_ci_hsc/lists"}