{"id":21672526,"url":"https://github.com/redis-developer/rediner","last_synced_at":"2026-05-10T19:56:16.313Z","repository":{"id":104843641,"uuid":"305470457","full_name":"redis-developer/rediner","owner":"redis-developer","description":"Named Entity Recognition for Redis","archived":false,"fork":false,"pushed_at":"2020-10-29T19:33:06.000Z","size":122,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-20T08:35:03.736Z","etag":null,"topics":["flask","graph","named-entity-recognition","nlp","property-graph","redis","redisgraph","serverless","spacy-nlp"],"latest_commit_sha":null,"homepage":"https://redis-developer.github.io/rediner/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/redis-developer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-10-19T17:59:28.000Z","updated_at":"2023-11-18T16:24:13.000Z","dependencies_parsed_at":null,"dependency_job_id":"f5db64bb-b011-46b8-ba4d-3a53e3b64d1f","html_url":"https://github.com/redis-developer/rediner","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/redis-developer/rediner","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redis-developer%2Frediner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redis-developer%2Frediner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redis-developer%2Frediner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redis-developer%2Frediner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/redis-developer","download_url":"https://codeload.github.com/redis-developer/rediner/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redis-developer%2Frediner/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32869721,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-10T13:40:02.631Z","status":"ssl_error","status_checked_at":"2026-05-10T13:40:02.145Z","response_time":54,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["flask","graph","named-entity-recognition","nlp","property-graph","redis","redisgraph","serverless","spacy-nlp"],"created_at":"2024-11-25T13:29:51.643Z","updated_at":"2026-05-10T19:56:16.296Z","avatar_url":"https://github.com/redis-developer.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# rediner\n\n[Named Entity Recognition](https://en.wikipedia.org/wiki/Named-entity_recognition) (NER) analysis in RedisGraph.\n\n# Overview\n\nThis project contains an example of using the [SpaCy](https://spacy.io)\nNER model to harvest\nnamed entities from blog posts or other web pages. The crawler program\nproduces graph structures that can be loaded into RedisGraph for analysis\nvia Cypher Queries.\n\n# Demo\n\nA demo is available [online](http://rediner.milowski.io). Please be kind!\n\n# A Quick Start\n\n1. Create an environment an load the requirements:\n\n   ```\n   pip install -r requirements.txt\n   python -m spacy download en_core_web_sm\n   ```\n\n1. Collect some entries:\n\n   ```\n   mkdir out\n   python -m rediner.blog  --same --store --dir out --verbose https://www.milowski.com/\n   ```\n\n1. Run the SpaCy model:\n\n   ```\n   python -m rediner --yaml -r ner out \u003e milowski-com-terms.yaml\n   ```\n\n1. Start RedisGraph:\n\n   ```\n   docker run -p 6379:6379 redislabs/redisgraph:latest\n   ```\n\n1. Setup the indexes:\n\n   ```\n   python demo/setupdb.py milowski.com\n   ```\n\n1. Ingest the data:\n\n   ```\n   python -m rediner load -r --graph milowski.com out\n   python -m rediner load -r --graph milowski.com milowski-com-terms.yaml\n   ```\n\n1. Run the demo application:\n\n   ```\n   cd demo\n   python view.py\n   ```\n\n1. View the application locally at http://localhost:5000/\n\nOnce the application is running, you can examine the dataset in various ways. For starters, try loading the graphs with the defaults by clicking on the 'Load'\nbutton. This will load the entities that match the minimum counts and show a\ngraph of cooccurrences.\n\nYou can:\n\n * use the \"same\" checkbox to enable entities that co-occur on the same article.\n * use the \"multiple\" checkbox to enable entities that co-occur on more than one article.\n * use search to access the full text search. This will display a subgraph of\n   entities from the search results.\n * clicking on a node in the graph will show the articles which contain the\n   entities with a link back to the original resource.\n\n# Next steps\n\nYou can view more extensive document on the [website](https://redis-developer.github.io/rediner/).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredis-developer%2Frediner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fredis-developer%2Frediner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredis-developer%2Frediner/lists"}