{"id":19309928,"url":"https://github.com/cedadev/ceda-elasticsearch-tools","last_synced_at":"2025-07-12T06:33:28.435Z","repository":{"id":34385186,"uuid":"105533630","full_name":"cedadev/ceda-elasticsearch-tools","owner":"cedadev","description":null,"archived":false,"fork":false,"pushed_at":"2025-05-15T09:23:04.000Z","size":5678,"stargazers_count":1,"open_issues_count":4,"forks_count":0,"subscribers_count":9,"default_branch":"master","last_synced_at":"2025-05-15T10:29:04.716Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cedadev.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2017-10-02T12:50:27.000Z","updated_at":"2025-05-15T09:23:08.000Z","dependencies_parsed_at":"2024-10-28T09:24:50.931Z","dependency_job_id":"c6deab2e-12cb-42ff-a03e-c5171e67e695","html_url":"https://github.com/cedadev/ceda-elasticsearch-tools","commit_stats":null,"previous_names":[],"tags_count":11,"template":false,"template_full_name":null,"purl":"pkg:github/cedadev/ceda-elasticsearch-tools","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cedadev%2Fceda-elasticsearch-tools","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cedadev%2Fceda-elasticsearch-tools/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cedadev%2Fceda-elasticsearch-tools/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cedadev%2Fceda-elasticsearch-tools/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cedadev","download_url":"https://codeload.github.com/cedadev/ceda-elasticsearch-tools/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cedadev%2Fceda-elasticsearch-tools/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264951610,"owners_count":23687974,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-10T00:21:49.086Z","updated_at":"2025-07-12T06:33:27.769Z","avatar_url":"https://github.com/cedadev.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ceda-elasticsearch-tools\n\nGeneral elasticsearch tools for use by CEDA in the many applications which will eventually talk with elasticsearch.\nCentral repository for update and search tools which make use of the bulk APIs such as msearch and bulk in order to increase\nspeed and limit API calls.\n\n## Installation\n\n    pip install git+https://github.com/cedadev/ceda-elasticsearch-tools.git\n\n## Command Line Tools\n\n### update_md5.py\nUse spot log files as source of md5 checksums across the whole archive. Designed as a one-shot to be performed when\ncreating a new ceda archive level index. Maintenance to be performed by reading the deposit logs.\n\n#### Usage\n    update_md5.py -i INDEX -o LOG_DIR [-h HOST] [-p PORT ]\n    \n    options:\n        --help              Display help\n        --version           Show Version\n        -i  --index         Elasticsearch index to test\n        -o                  Logging output directory.\n        -h  --hostname      Elasticsearch host to query [default: jasmin-es1.ceda.ac.uk]\n        -p  --port          Elasticsearch read/write port [default: 9200]\n        \n`HOST` and `PORT` default to `jasmin-es1.ceda.ac.uk` and `9200`\n\n### file_on_tape.py\nSets the location of all items which are currently on tape as defined by the NLA (near-line archive). Updates the\ntarget index to be correct with NLA.\nDesigned as a one shot script to be used when creating a new ceda archive level index. Maintenance to be performed by\nthe NLA itself.\n\n#### Usage\n\n    file_on_tape.py \u003cindex\u003e [--host HOST] [--port PORT]\n    \n    Options:\n    -h --help   Show this screen.\n    --version   Show version.\n    --host      Elasticsearch host to target.\n    --port      Elasticsearch port to target.\n    \n`HOST` and `PORT` default to `jasmin-es1.ceda.ac.uk` and `9200`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcedadev%2Fceda-elasticsearch-tools","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcedadev%2Fceda-elasticsearch-tools","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcedadev%2Fceda-elasticsearch-tools/lists"}