{"id":15724499,"url":"https://github.com/jshrake/lacity-council-crawl","last_synced_at":"2025-09-09T12:38:27.619Z","repository":{"id":34997967,"uuid":"39086785","full_name":"jshrake/lacity-council-crawl","owner":"jshrake","description":"A crawler and scraper for LA city council voting data","archived":false,"fork":false,"pushed_at":"2015-07-18T16:58:36.000Z","size":136,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-31T01:14:42.530Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Clojure","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jshrake.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-07-14T16:30:16.000Z","updated_at":"2015-07-14T16:30:45.000Z","dependencies_parsed_at":"2022-09-01T03:12:05.267Z","dependency_job_id":null,"html_url":"https://github.com/jshrake/lacity-council-crawl","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/jshrake/lacity-council-crawl","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jshrake%2Flacity-council-crawl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jshrake%2Flacity-council-crawl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jshrake%2Flacity-council-crawl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jshrake%2Flacity-council-crawl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jshrake","download_url":"https://codeload.github.com/jshrake/lacity-council-crawl/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jshrake%2Flacity-council-crawl/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":274296496,"owners_count":25258854,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-09T02:00:10.223Z","response_time":80,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-03T22:16:52.464Z","updated_at":"2025-09-09T12:38:27.591Z","avatar_url":"https://github.com/jshrake.png","language":"Clojure","funding_links":[],"categories":[],"sub_categories":[],"readme":"# lacity-council-crawl\n\nA crawler and scraper for [LA city council voting data](http://citycouncil.lacity.org/cvvs/search/search.cfm) built with Clojure\n\n## Usage\n\nThis service crawls votes [10 seconds at a time](http://lacity.org/robots.txt). As of this commit, there are roughly ~80,000 votes in the system.\nOnce this service has crawled all existing votes, it will attempt to retrieve newly added votes indefintely.\n\n### Dev\n\nStores the data in an SQLite database under `db`:\n\n```bash\nmkdir db\nlein run\n```\n\n### Production\n\nCreate a production configuration file at `resources/production_config.edn` that specifies the database information. You can model it after [resources/dev_config.edn](resources/dev_config.edn).\n\n```bash\nlein with-profile production run\n```\n\n## Deploy\n\nAs this is a service that should run indefinitely, it may be desriable to deploy it to the great big cloud in the sky. I've chosen to deploy to a free instance of Amazon's [Elastic Beanstalk](https://aws.amazon.com/elasticbeanstalk/):\n\n0. Create a production configuration file\n1. Install the Amazon EB CLI `brew install awsebcli`\n2. `eb init`\n3. `eb create`\n4. `eb deploy`\n\n## License\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjshrake%2Flacity-council-crawl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjshrake%2Flacity-council-crawl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjshrake%2Flacity-council-crawl/lists"}