{"id":37080272,"url":"https://github.com/chigwell/model-compare","last_synced_at":"2026-01-14T09:44:34.433Z","repository":{"id":329912409,"uuid":"1120973573","full_name":"chigwell/model-compare","owner":"chigwell","description":"model-compare evaluates AI models side‑by‑side based on user tasks, rating accuracy, creativity, and efficiency to guide model choice.","archived":false,"fork":false,"pushed_at":"2025-12-22T08:34:39.000Z","size":4,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-12-23T19:53:29.036Z","etag":null,"topics":["accuracy","ai-language-models","capabilities-analysis","creativity","efficiency","informed-decision-making","model-comparison","model-selection","objective-evaluation","performance-evaluation","scenario-based-comparison","side-by-side-evaluation","structured-comparison","task-specific-analysis","text-input"],"latest_commit_sha":null,"homepage":"https://pypi.org/project/model-compare/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chigwell.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-12-22T08:34:19.000Z","updated_at":"2025-12-22T08:34:55.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/chigwell/model-compare","commit_stats":null,"previous_names":["chigwell/model-compare"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/chigwell/model-compare","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chigwell%2Fmodel-compare","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chigwell%2Fmodel-compare/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chigwell%2Fmodel-compare/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chigwell%2Fmodel-compare/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chigwell","download_url":"https://codeload.github.com/chigwell/model-compare/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chigwell%2Fmodel-compare/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28416120,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T08:38:59.149Z","status":"ssl_error","status_checked_at":"2026-01-14T08:38:43.588Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["accuracy","ai-language-models","capabilities-analysis","creativity","efficiency","informed-decision-making","model-comparison","model-selection","objective-evaluation","performance-evaluation","scenario-based-comparison","side-by-side-evaluation","structured-comparison","task-specific-analysis","text-input"],"created_at":"2026-01-14T09:44:33.662Z","updated_at":"2026-01-14T09:44:34.426Z","avatar_url":"https://github.com/chigwell.png","language":"Python","readme":"# Model Compare Package\n[![PyPI version](https://badge.fury.io/py/model-compare.svg)](https://badge.fury.io/py/model-compare)\n[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](https://opensource.org/licenses/MIT)\n[![Downloads](https://static.pepy.tech/badge/model-compare)](https://pepy.tech/project/model-compare)\n[![LinkedIn](https://img.shields.io/badge/LinkedIn-blue)](https://www.linkedin.com/in/eugene-evstafev-716669181/)\n\n\nA new package that helps users compare and evaluate different AI language models by analyzing their performance and capabilities.\n\n## Overview\n\nThis package takes user-provided text input describing specific tasks or scenarios and returns a structured comparison of how different models, like Gemini 3 Flash and Claude Code, would handle those tasks. It focuses on providing objective, side-by-side evaluations based on criteria such as accuracy, creativity, and efficiency, helping users make informed decisions about which model to use for their specific needs.\n\n## Installation\n\n```bash\npip install model_compare\n```\n\n## Usage\n\n```python\nfrom model_compare import model_compare\n\nresponse = model_compare(\n    user_input=\"Compare Gemini 3 Flash and Claude Code on a text-to-image generation task\",\n    api_key=\"your_llm7_api_key\",\n    llm=None  # optional, defaults to ChatLLM7\n)\n```\n\nYou can also pass your own `BaseChatModel` instance, e.g., to use a different LLM like OpenAI:\n\n```python\nfrom langchain_openai import ChatOpenAI\nfrom model_compare import model_compare\n\nllm = ChatOpenAI()\nresponse = model_compare(\n    user_input=\"Compare Gemini 3 Flash and Claude Code on a text-to-image generation task\",\n    llm=llm\n)\n```\n\nOr to use Anthropic:\n\n```python\nfrom langchain_anthropic import ChatAnthropic\nfrom model_compare import model_compare\n\nllm = ChatAnthropic()\nresponse = model_compare(\n    user_input=\"Compare Gemini 3 Flash and Claude Code on a text-to-image generation task\",\n    llm=llm\n)\n```\n\nOr to use Google Generative AI:\n\n```python\nfrom langchain_google_genai import ChatGoogleGenerativeAI\nfrom model_compare import model_compare\n\nllm = ChatGoogleGenerativeAI()\nresponse = model_compare(\n    user_input=\"Compare Gemini 3 Flash and Claude Code on a text-to-image generation task\",\n    llm=llm\n)\n```\n\nYou can also pass your own API key via the environment variable `LLM7_API_KEY` or directly as an argument.\n\n## Rate Limits\n\nThe default rate limits for LLM7 free tier are sufficient for most use cases of this package. If you need higher rate limits, you can pass your own API key via environment variable `LLM7_API_KEY` or directly as an argument.\n\n## Getting Started\n\nYou can get a free API key by registering at https://token.llm7.io/\n\n## Contributing\n\nPlease submit issues and pull requests to https://github.com/chigwell/model-compare\n\n## Author\n\nEugene Evstafev (eugene.evstafev-plus@email.com)\n\n## License\n\nThis package is licensed under the MIT License.","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchigwell%2Fmodel-compare","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchigwell%2Fmodel-compare","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchigwell%2Fmodel-compare/lists"}