{"id":42925106,"url":"https://github.com/tulibraries/harvest_csv","last_synced_at":"2026-01-30T18:07:48.701Z","repository":{"id":56009256,"uuid":"82330527","full_name":"tulibraries/harvest_csv","owner":"tulibraries","description":"Harvests CSV files to Solr and creates Blacklight catalog controller code snippets.","archived":false,"fork":false,"pushed_at":"2024-03-12T13:59:35.000Z","size":50,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":7,"default_branch":"main","last_synced_at":"2024-03-12T15:04:31.486Z","etag":null,"topics":["gencon50"],"latest_commit_sha":null,"homepage":"","language":"Ruby","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tulibraries.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2017-02-17T19:24:57.000Z","updated_at":"2022-07-25T20:06:07.000Z","dependencies_parsed_at":"2024-03-12T15:01:09.648Z","dependency_job_id":null,"html_url":"https://github.com/tulibraries/harvest_csv","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/tulibraries/harvest_csv","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tulibraries%2Fharvest_csv","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tulibraries%2Fharvest_csv/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tulibraries%2Fharvest_csv/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tulibraries%2Fharvest_csv/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tulibraries","download_url":"https://codeload.github.com/tulibraries/harvest_csv/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tulibraries%2Fharvest_csv/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28917034,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-30T16:37:38.804Z","status":"ssl_error","status_checked_at":"2026-01-30T16:37:37.878Z","response_time":66,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gencon50"],"created_at":"2026-01-30T18:07:48.027Z","updated_at":"2026-01-30T18:07:48.687Z","avatar_url":"https://github.com/tulibraries.png","language":"Ruby","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Harvest CSV\n\nRake file to ingest CSV file data into Solr. Presumes the CSV file has unique headers\n\n## Ingest CSV file into Solr\n\n1. Generate initial map file, `solr_map.yml` that maps the CSV columns to one or more Solr fields\n\n```sh\nrake makemap\n```\n\n2. Edit `solr_map.yml`\n\nAdd or modify solr fields in this file. One column *must* be designated an ID field with unique values.\n\nThe file will look like this:\n\n```yaml\n  playerID:\n    - id\n    - playerID_display\n    - title_display\n  name:\n    - name_display\n    - name_t\n  team:\n    - team_display\n    - team_facet\n  biography:\n    - text\n```\n\n3. Customize the Solr schema. For Blacklight applications, this file will be `solr/conf/schema.xml`.\n\n    1. Optional: Add the new fields to the `\u003cfield\u003e`block with the desired attributes. Those attributes are documented in the `schema.xml` comments.\n    2. Add the fields to be searched to...\n    3. Add the fields to be shown in the search results index page to...\n\n4. Customize the Solr configuration. For Blacklight applications, this file will be `solr/conf/solrconfig.xml`.\n\n5. Generate blacklight add field snippets\n\n```sh\nrake blacklight\n```\n\n6. Paste these into the Blacklight catalog controller\n\n7. Ingest CSV into Blacklight:\n\n```sh\nrake\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftulibraries%2Fharvest_csv","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftulibraries%2Fharvest_csv","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftulibraries%2Fharvest_csv/lists"}