{"id":27701641,"url":"https://github.com/different-ai/irs-agent","last_synced_at":"2025-07-12T21:34:35.796Z","repository":{"id":278958758,"uuid":"937273320","full_name":"different-ai/irs-agent","owner":"different-ai","description":"An obtrusive AI agent that watches your screen and makes sure you fill out your taxes correctly","archived":false,"fork":false,"pushed_at":"2025-02-24T04:39:42.000Z","size":2692,"stargazers_count":5,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-25T20:11:54.369Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/different-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-22T18:38:28.000Z","updated_at":"2025-03-27T22:21:31.000Z","dependencies_parsed_at":"2025-02-24T00:26:56.117Z","dependency_job_id":null,"html_url":"https://github.com/different-ai/irs-agent","commit_stats":null,"previous_names":["different-ai/lofi-ui","different-ai/irs-agent"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/different-ai/irs-agent","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/different-ai%2Firs-agent","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/different-ai%2Firs-agent/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/different-ai%2Firs-agent/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/different-ai%2Firs-agent/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/different-ai","download_url":"https://codeload.github.com/different-ai/irs-agent/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/different-ai%2Firs-agent/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265059509,"owners_count":23705221,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-04-25T20:11:34.723Z","updated_at":"2025-07-12T21:34:35.769Z","avatar_url":"https://github.com/different-ai.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# irs agent\n\n\u003e your least favorite agent now powered by ai\n\nirs agent is an ai-powered agent that never takes a break. it constantly watches your screen to capture receipts, invoices, and all your tax documents as soon as they appear. by combining cutting-edge ocr, audio transcription, and ui event detection, this agent extracts key details like amounts, currencies, names, and timestamps, creating a complete record of your financial interactions.\n\n\u003cimg width=\"1840\" alt=\"Screenshot 2025-02-23 at 16 37 53\" src=\"https://github.com/user-attachments/assets/00e41c9f-ac98-4ba6-99b2-dc4e735f3a14\" /\u003e\n\n## current capabilities\n\n- [x] Watches every single transaction you make and stores it in local db\n- [x] Local-first\n- [ ] Actually does your taxes\n\n\n## overview\n\nirs agent silently observes your screen, capturing both visual and audio cues in real time using [Screenpipe](https://docs.screenpi.pe) - an open-source screen and audio capture framework. Screenpipe provides 24/7 local media capture capabilities, ensuring all data stays private and secure on your machine. whether you're checking emails, browsing invoices, or finalizing a payment, it identifies and logs financial activities automatically. designed to be obtrusive, it ensures no tax document slips through unnoticed.\n\n## how it works\n![image](https://github.com/user-attachments/assets/6b39b487-76f0-44c9-a40f-a4a4c9d6aa26)\n\n## requirements\n\n- screenpipe\n- ollama + phi4\n\n\n\n## core features\n\n- real-time monitoring that continuously grabs ocr, audio, and ui events\n- an automated detector powered by openai models that extracts essential details from your financial documents\n- comprehensive logging of every captured event in a secure local database for later review\n- fully customizable settings, letting you adjust your openai api key and tailor prompt templates to your specific workflow\n\n\n1. **installation:**  \n   clone the repository and install the dependencies with your preferred package manager. make sure to configure your openai api key and other environment variables as needed.\n2. **running the project:**  \n   start the next.js development server, and irs agent will immediately begin monitoring your screen and logging tax documents in real time.\n3. **reviewing logs:**  \n   visit the financial activity tab to view detailed logs of every detected event and review the extracted financial details.\n\n## contributing\n\ncontributions are welcome. if you have ideas to enhance irs agent's capabilities or performance, please open an issue or submit a pull request. make sure your code follows the project's style guidelines and includes the necessary tests.\n\n## license\n\nthis project is open source.\n\nenjoy the seamless experience of managing your tax documents with irs agent, the ai watchdog that makes sure every receipt and invoice is captured.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdifferent-ai%2Firs-agent","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdifferent-ai%2Firs-agent","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdifferent-ai%2Firs-agent/lists"}