{"id":28366986,"url":"https://github.com/infuseai/dimon","last_synced_at":"2026-02-28T22:01:09.151Z","repository":{"id":245771523,"uuid":"817252036","full_name":"InfuseAI/dimon","owner":"InfuseAI","description":null,"archived":false,"fork":false,"pushed_at":"2024-07-10T08:32:57.000Z","size":298,"stargazers_count":15,"open_issues_count":0,"forks_count":0,"subscribers_count":5,"default_branch":"main","last_synced_at":"2026-02-17T00:00:14.344Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/InfuseAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-19T10:20:35.000Z","updated_at":"2025-10-06T09:28:06.000Z","dependencies_parsed_at":"2024-06-24T03:26:40.819Z","dependency_job_id":"ea00276d-fe84-4404-9c17-63d88ef26013","html_url":"https://github.com/InfuseAI/dimon","commit_stats":null,"previous_names":["infuseai/dimon"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/InfuseAI/dimon","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2Fdimon","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2Fdimon/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2Fdimon/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2Fdimon/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/InfuseAI","download_url":"https://codeload.github.com/InfuseAI/dimon/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InfuseAI%2Fdimon/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29953212,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-28T18:42:55.706Z","status":"ssl_error","status_checked_at":"2026-02-28T18:42:48.811Z","response_time":90,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-29T00:13:48.541Z","updated_at":"2026-02-28T22:01:09.142Z","avatar_url":"https://github.com/InfuseAI.png","language":"Python","readme":"# dimon: Your Canonical Answer Management Tool\ndimon is a command-line interface (CLI) tool for evaluating and managing golden dataset for evaluation your retrival mechnism.\n\n## Installation\nYou can install dimon directly from PyPI:\n\n```\npip install dimon-cli\n```\n\n## Prepare env file\n\nCreate a file named `.env`, or copy it from `.env.example`.\nThis file should contain the default configuration values for dimon. Here is an example of what the `.env` file might look like:\n\n```\nDATABASE_URL=http://localhost:9200\nDATABASE_INDEX=your_index\nUSERNAME=elastic\nPASSWORD=your_password_here\nDATASET_PATH=/path/to/your/dataset\n```\n\nReplace the values with the actual ones.\n\nNote: Currently, the script only supports ElasticSearch as the vector database. Ensure that your ElasticSearch instance is correctly set up and accessible via the URL provided in the DATABASE_URL parameter. The DATABASE_INDEX should point to the specific index within ElasticSearch that you want to use for storing and querying vectors.\n\n\n## The CLI tool provides three main commands:\n\n### evaluate\nThis command evaluates a specified model on a given dataset. It computes embeddings for each document in the corpus, retrieves the top-k most similar documents for each query, and calculates the Mean Reciprocal Rank (MRR) for evaluation.\n\n```\ndimon evaluate --database_url 'http://localhost:9200' --dataset 'golden_dataset.csv'\n```\n\n### diff\nThis command reads a report file, filters out entries with MRR below a certain threshold\n\n```\ndimon diff --file_name 'mrr_report.csv' --threshold 0.2\n```\n\n### merge\nThis command reads a report file, filters out entries marked as 'Accept', and simulates a merging process.\n\n```\ndimon merge --report_name 'to_confirmed_change.csv'\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finfuseai%2Fdimon","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finfuseai%2Fdimon","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finfuseai%2Fdimon/lists"}