Projects in Awesome Lists tagged with entity-resolution

https://github.com/dedupeio/dedupe

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

clustering datamade de-duplicating dedupe dedupe-library entity-resolution python python-library record-linkage

Last synced: 30 Sep 2024

https://github.com/moj-analytical-services/splink

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

data-matching data-science deduplicate-data deduplication duckdb em-algorithm entity-resolution fuzzy-matching record-linkage spark uk-gov-data-science

Last synced: 28 Sep 2024

https://github.com/J535D165/recordlinkage

A powerful and modular toolkit for record linkage and duplicate detection in Python

data-matching dedupe deduplication entity-resolution machine-learning privacy python python-library record-linkage similarity string-distance utrecht-university

Last synced: 31 Jul 2024

https://github.com/zinggai/zingg

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

analytics analytics-engineering data-science data-transformation data-transformations dataengineering datalake dataquality dedupe deduplication entity-resolution etl fuzzy-matching fuzzymatch identity identity-resolution masterdata ml modern-data-stack spark

Last synced: 28 Sep 2024

https://github.com/johnsnowlabs/nlu

1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.

bert-embedding dependency-parsing entity-resolution language-detection lemmatizer named-entity-recognition natural-language-understanding nlu pandas sentence-embeddings sentiment-analysis sentiment-classifier seq2seq spell-checker streamlit t5 text-classification text-summarization text-translation transformers

Last synced: 26 Sep 2024

https://github.com/JohnSnowLabs/nlu

1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.

bert-embedding dependency-parsing entity-resolution language-detection lemmatizer named-entity-recognition natural-language-understanding nlu pandas sentence-embeddings sentiment-analysis sentiment-classifier seq2seq spell-checker streamlit t5 text-classification text-summarization text-translation transformers

Last synced: 05 Aug 2024

https://github.com/Picovoice/rhino

On-device Speech-to-Intent engine powered by deep learning

entity-resolution intent-inference natural-language-understanding nlu on-device slot-filling slu speech-recognition spoken-language-understanding voice-assistant voice-command voice-command-control voice-commands voice-control voice-recognition voice-ui voice-user-interface vui

Last synced: 31 Jul 2024

https://github.com/dedupeio/csvdedupe

:id: Command line tool for deduplicating CSV files

cli csv-files dedupe entity-resolution record-linkage

Last synced: 03 Aug 2024

https://github.com/izuna385/entity-linking-recent-trends

Recent trends of Entity Linking, Disambiguation, and Representation.

bert entity-disambiguation entity-language-model entity-linking entity-representation entity-resolution natural-language-processing nlp

Last synced: 01 Oct 2024

https://github.com/scify/JedAIToolkit

An open source, high scalability toolkit in Java for Entity Resolution.

blocking entity-matching entity-resolution scalability

Last synced: 03 Aug 2024

https://github.com/maxharlow/csvmatch

🔎 Finds fuzzy matches between CSV files

csv data-matching entity-resolution fuzzy-matching record-linkage

Last synced: 01 Aug 2024

https://github.com/codeforkjeff/conciliator

OpenRefine reconciliation services for VIAF, ORCID, and Open Library + framework for creating more.

entity-resolution openlibrary openrefine orcid reconciliation-service solr viaf

Last synced: 01 Aug 2024

https://github.com/Wikidata/soweego

Link Wikidata items to large catalogs

data-matching entity-linking entity-resolution identifiers knowledge-graph record-linkage wikidata wikimedia

Last synced: 01 Aug 2024

https://github.com/gaglia88/sparker

SparkER: an Entity Resolution framework for Apache Spark

apache apache-spark entity entity-resolution meta-blocking python python-library python27 python3 resolution scala spark

Last synced: 01 Oct 2024

https://github.com/entrepreneur-interet-general/Merge-Machine

Merge Dirty Data with Clean Reference Tables

elasticsearch entity-resolution entrepreneur-interet-general python record-linkage

Last synced: 01 Aug 2024

https://github.com/dobraczka/kiez

🏘️ Hubness reduced nearest neighbor search for entity alignment with knowledge graph embeddings

approximate-nearest-neighbor-search embedding entity-alignment entity-resolution hubness knowledge-graph knowledge-graph-embedding nearest-neighbors

Last synced: 03 Aug 2024

https://github.com/neo4j-graph-examples/entity-resolution

Entity resolution, also known as Data Matching or Record linkage is the task of finding a data set that refer to the same or similar real entity across different digital entities present on same or different data sets. Record linking is necessary when joining different entities which are similar and may or may not share some common identifiers. Neo4j offers various advantages to perform entity resolution / record linking. This repository covers such a use case of linking similar user accounts for analytics and providing better recommendations.

entity-resolution graph-datatabase neo4j neo4j-approved

Last synced: 26 Sep 2024

https://github.com/snipsco/snips-nlu-parsers

Rust crate for entity parsing

entity-recognition entity-resolution nlp nlu rust

Last synced: 01 Aug 2024

https://github.com/tilotech/langchain-tilores

This repository provides the building blocks for integrating LangChain, LangGraph, and the Tilores entity resolution system.

agentic-rag entity-resolution langchain

Last synced: 01 Oct 2024