{"id":16562813,"url":"https://github.com/charmve/gpt-eyes","last_synced_at":"2025-10-14T10:33:57.212Z","repository":{"id":190101393,"uuid":"657859836","full_name":"Charmve/gpt-eyes","owner":"Charmve","description":" I GAVE GPT-4 EYES!","archived":false,"fork":false,"pushed_at":"2024-01-24T05:40:33.000Z","size":14490,"stargazers_count":14,"open_issues_count":0,"forks_count":5,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-09-29T06:26:40.797Z","etag":null,"topics":["agent","gpt-4","gpt-4o","gpt-4omni","gpt4","gpt4v","llm","llm-inference","world-model","world-models","worldmodel"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Charmve.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null},"funding":{"github":"Charmve"}},"created_at":"2023-06-24T03:27:52.000Z","updated_at":"2024-12-12T17:04:55.000Z","dependencies_parsed_at":"2023-08-23T07:54:18.330Z","dependency_job_id":"5a14c538-34d4-4c04-9b51-ba96334b6e74","html_url":"https://github.com/Charmve/gpt-eyes","commit_stats":{"total_commits":21,"total_committers":2,"mean_commits":10.5,"dds":"0.38095238095238093","last_synced_commit":"7794fd073c548165ae29cb6731a6517f29b19300"},"previous_names":["charmve/gpt-eyes"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Charmve/gpt-eyes","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Charmve%2Fgpt-eyes","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Charmve%2Fgpt-eyes/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Charmve%2Fgpt-eyes/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Charmve%2Fgpt-eyes/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Charmve","download_url":"https://codeload.github.com/Charmve/gpt-eyes/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Charmve%2Fgpt-eyes/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279018779,"owners_count":26086452,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-14T02:00:06.444Z","response_time":60,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent","gpt-4","gpt-4o","gpt-4omni","gpt4","gpt4v","llm","llm-inference","world-model","world-models","worldmodel"],"created_at":"2024-10-11T20:37:16.951Z","updated_at":"2025-10-14T10:33:57.182Z","avatar_url":"https://github.com/Charmve.png","language":"JavaScript","funding_links":["https://github.com/sponsors/Charmve","https://github.com/sponsors/Charmve?frequency=one-time\u0026sponsor=Charmve"],"categories":[],"sub_categories":[],"readme":"# GPT Eyes\n\nI gave GPT-4 eyes. \"眼观六路，耳听八方\"\n\n\u003cvideo src=\"https://github.com/Charmve/gpt-eyes/raw/main/src/ssstwitter.com_1693805997510.mp4\" controls=\"controls\" style=\"max-width: 730px;\"\u003e\u003c/video\u003e\n\nHere’s what I did:\n- added some data to a vision model\n- gave the AI camera access\n- asked it questions about the scene\n- it identified objects\n- it searched web for info\n- used that info to accurately answer\n\nWatch it get 3 questions 100% correct!\n\n- Twitter https://twitter.com/mckaywrigley/status/1651291367224807424?s=20\n- YouTube https://www.youtube.com/watch?v=w-wxguIs-0I\n\n## This Package Is Sponsorware 💰💰💰\n\n[![](https://img.shields.io/static/v1?label=Sponsor\u0026message=%E2%9D%A4\u0026logo=GitHub\u0026color=%23fe8e86)](https://github.com/sponsors/Charmve?frequency=one-time\u0026sponsor=Charmve) https://github.com/sponsors/Charmve?frequency=one-time\u0026sponsor=Charmve\n\nThis repo was only available to my sponsors on GitHub Sponsors until I reached 15 sponsors.\n\nLearn more about **Sponsorware** at [github.com/sponsorware/docs](https://github.com/sponsorware/docs) 💰.\n\n## Technologies Used\n\n- Frontend: React\n- Image Analysis API: TensorFlow Models - MobileNet\n- Text Generation API: GPT API\n\n## Installation\n\n1. Clone the repository: `git clone https://github.com/Charmve/gpt-eyes.git`\n2. Navigate to the project directory: `cd gpt-eyes`\n3. Install dependencies: `npm install`\n\n## Configuration\n\n1. Create an account and obtain API keys for TensorFlow Models - MobileNet and GPT API.\n2. Update the configuration file with your API keys:\n   - TensorFlow Models - MobileNet: `/path/to/config.js`\n   - GPT API: `/path/to/config.js`\n\n## Usage\n\n1. Start the development server: `npm start`\n2. Open your browser and visit: `http://localhost:3000`\n\n## How it Works\n\n1. Device camera analyses an image.\n2. The application uses TensorFlow Models - MobileNet API to analyze the image and extract object information.\n3. The application sends the analyzed object information to the GPT API.\n4. The GPT API generates text describing the analyzed object.\n5. The application displays the analyzed image and the generated text.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharmve%2Fgpt-eyes","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcharmve%2Fgpt-eyes","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcharmve%2Fgpt-eyes/lists"}