{"id":19784047,"url":"https://github.com/openeventdata/stanford_pipeline","last_synced_at":"2025-10-14T17:44:40.470Z","repository":{"id":17872839,"uuid":"20810750","full_name":"openeventdata/stanford_pipeline","owner":"openeventdata","description":"Program to run scraped news stories through CoreNLP.","archived":false,"fork":false,"pushed_at":"2017-05-06T15:26:55.000Z","size":17,"stargazers_count":10,"open_issues_count":1,"forks_count":13,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-04-30T22:39:00.002Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/openeventdata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-06-13T16:39:15.000Z","updated_at":"2022-07-05T00:17:39.000Z","dependencies_parsed_at":"2022-08-04T21:15:49.242Z","dependency_job_id":null,"html_url":"https://github.com/openeventdata/stanford_pipeline","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/openeventdata/stanford_pipeline","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openeventdata%2Fstanford_pipeline","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openeventdata%2Fstanford_pipeline/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openeventdata%2Fstanford_pipeline/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openeventdata%2Fstanford_pipeline/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/openeventdata","download_url":"https://codeload.github.com/openeventdata/stanford_pipeline/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openeventdata%2Fstanford_pipeline/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279020044,"owners_count":26086806,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-14T02:00:06.444Z","response_time":60,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-12T06:10:07.162Z","updated_at":"2025-10-14T17:44:40.436Z","avatar_url":"https://github.com/openeventdata.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"stanford_pipeline\n=================\n\nProgram to run scraped news stories through Stanford's CoreNLP program.\n\nThe program pulls stories added to the database within the past day and that\naren't currently parsed using CoreNLP. Once parsed, the parsetrees are placed\nback into the database. The program is currently set to proccess the first six\nsentences of a story.\n\nThis program makes extensive use of Brendan O'Connor's\n[wrapper](https://github.com/brendano/stanford-corepywrapper) for CoreNLP. The\ncurrent install comes from my (John Beieler)\n[fork](https://github.com/johnb30/stanford-corepywrapper). The config file for\nCoreNLP makes use of the shift-reduce parser introduced in CoreNLP 3.4.\n\nCoreNLP Setup\n--------\n\nThis pipeline depends on having CoreNLP 3.4 with the shift-reduce parser.\nDownload the models like this:\n\n```\nwget http://nlp.stanford.edu/software/stanford-corenlp-full-2014-06-16.zip\nunzip stanford-corenlp-full-2014-06-16.zip\nmv stanford-corenlp-full-2014-06-16 stanford-corenlp\ncd stanford-corenlp\nwget http://nlp.stanford.edu/software/stanford-srparser-2014-07-01-models.jar\n```\n\nIf errors persist, try changing the path in `default_config.ini` from the\nrelative path `~/stanford-corenlp` to the full path (e.g.)\n`/home/ahalterman/stanford-corenlp`.\n\nConfiguration\n-----------\n\nThe `default_config.ini` file has several options that can be changed,\nincluding the MongoDB database and collection of stories to process and whether\nall unparsed stories should be processed or just the stories added in the last\nday.\n\nUsage\n-----\n\n`python process.py`\n\nUp to a minute of `[Errno 111] Connection refused` messages are normal during\nstartup.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopeneventdata%2Fstanford_pipeline","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopeneventdata%2Fstanford_pipeline","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopeneventdata%2Fstanford_pipeline/lists"}