{"id":17100759,"url":"https://github.com/frosenberg/elasticsearch-nvd-river","last_synced_at":"2025-10-15T03:28:41.077Z","repository":{"id":19288324,"uuid":"22525369","full_name":"frosenberg/elasticsearch-nvd-river","owner":"frosenberg","description":"River plugin for Elasticsearch for fetching the NIST National Vulnerability Database entires. ","archived":false,"fork":false,"pushed_at":"2014-08-01T20:44:59.000Z","size":6276,"stargazers_count":5,"open_issues_count":1,"forks_count":4,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-12T23:54:22.464Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/frosenberg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-08-01T19:40:50.000Z","updated_at":"2022-09-22T12:19:44.000Z","dependencies_parsed_at":"2022-08-26T13:23:29.998Z","dependency_job_id":null,"html_url":"https://github.com/frosenberg/elasticsearch-nvd-river","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/frosenberg/elasticsearch-nvd-river","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frosenberg%2Felasticsearch-nvd-river","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frosenberg%2Felasticsearch-nvd-river/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frosenberg%2Felasticsearch-nvd-river/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frosenberg%2Felasticsearch-nvd-river/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/frosenberg","download_url":"https://codeload.github.com/frosenberg/elasticsearch-nvd-river/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/frosenberg%2Felasticsearch-nvd-river/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279042806,"owners_count":26091323,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-15T02:00:07.814Z","response_time":56,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-14T15:14:36.315Z","updated_at":"2025-10-15T03:28:41.057Z","avatar_url":"https://github.com/frosenberg.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NVD River for ElasticSearch\n\nWelcome to the NVD River Plugin for [Elasticsearch](http://www.elasticsearch.org/). The purpose of\nthis plugin is to read the CVE vulnerability XML feeds of the National Vulnerability Database and push \nit into ElasticSearch. Another purpose was to learn ElasticSearch and get some hands on experience.\n\n\n## Versions\n\n* For 1.3.x elasticsearch versions, look at [master branch](https://github.com/frosenberg/elasticsearch-nvd-river/tree/master).\n\nThe plugin code is considered highly experimental and was only tested with Java 7.\n\n## Installing \n\n  1. `~/code$ git clone https://github.com/frosenberg/elasticsearch-nvd-river`\n  2. `~/code$ cd elasticsearch-nvd-river`\n  3. `~/code/elasticsearch-nvd-river$ mvn clean package` (will take a while b/c of some long running tests)\n  4. Copy the package from `~/code/elasticsearch-nvd-river/target/release/nvdriver-1.0.0-SNAPSHOT.zip` to your ElasticSearch instance\n  5. `bin/plugin --url file:///path/to/nvdriver-1.0.0-SNAPSHOT.zip --install nvdriver`\n\n\n## Usage \n\nYou just need to execute a few simple cURL command to feed the data from the NIST NVD database.\n\n### Create an index\n\n    curl -XPUT 'http://localhost:9200/nvd/' -d '{}'\n\n\n### Create a mapping\n\nMappings are not needed and currently not supported. I did not see the need in my use case. ElasticSearch has pretty good \ndynamic mapping generation that was sufficient. If you feel the need to customize the mapping \nplease open an issue or contribute.\n\n### Create the river\n\nThis will create a river and will push in the following XML feed. You can of course add more \nif needed, or remove some. Keep in mind this may take some time until all of the are processed.\n\n  \tcurl -XPUT 'localhost:9200/_river/nvd/_meta' -d '{\n  \t  \"type\": \"nvd\",\n  \t  \"nvd\": {\n  \t    \"streams\" : [\n  \t      {\n  \t        \"name\": \"cve-modified\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-modified.xml\"\n  \t      },\n  \t      {\n  \t        \"name\": \"cve-2014\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2014.xml\"\n  \t      },\n  \t      {\n  \t        \"name\": \"cve-2013\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2013.xml\"\n  \t      },\n  \t      {\n  \t        \"name\": \"cve-2012\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2012.xml\"\n  \t      },\n  \t      {\n  \t        \"name\": \"cve-2011\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2011.xml\"\n  \t      },\n  \t      {\n  \t        \"name\": \"cve-2010\",\n  \t        \"url\": \"http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2010.xml\"\n  \t      }\n  \t    ]\n  \t  }\n  \t}'\n\n\n### Test the river plugin\n\n    curl -XGET 'http://localhost:9200/nvd/_search?q=oracle'\n\n## Developer Notes\n\nThe code contains a lot of generated classes that were generated from the CVE XML schema 2.0\nlocated at [http://nvd.nist.gov/schema/nvd-cve-feed_2.0.xsd]\n\n### Compiling the NVD XML schema files:\n\nThe following command will compile the schema into Java JAXB version 2.1 data bindings.  \n\n    ~/code/elasticsearch-nvd-river$ xjc -d src/main/java/ -target 2.1 http://nvd.nist.gov/schema/nvd-cve-feed_2.0.xsd\n\nWe do not use a specific namespace to Java package customization because this will only complicate matters.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffrosenberg%2Felasticsearch-nvd-river","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffrosenberg%2Felasticsearch-nvd-river","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffrosenberg%2Felasticsearch-nvd-river/lists"}