{"id":26775022,"url":"https://github.com/browser-use/macOS-use","last_synced_at":"2025-03-29T03:01:25.380Z","repository":{"id":274540471,"uuid":"920894482","full_name":"browser-use/macOS-use","owner":"browser-use","description":"Make Mac apps accessible for AI agents","archived":false,"fork":false,"pushed_at":"2025-03-05T19:13:33.000Z","size":43889,"stargazers_count":835,"open_issues_count":13,"forks_count":86,"subscribers_count":21,"default_branch":"main","last_synced_at":"2025-03-27T03:01:31.247Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/browser-use.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-23T00:35:15.000Z","updated_at":"2025-03-27T01:34:35.000Z","dependencies_parsed_at":"2025-02-26T08:01:21.474Z","dependency_job_id":"e1fc3310-c28a-45e6-ae16-67e31348dd04","html_url":"https://github.com/browser-use/macOS-use","commit_stats":null,"previous_names":["browser-use/macos-use"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browser-use%2FmacOS-use","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browser-use%2FmacOS-use/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browser-use%2FmacOS-use/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/browser-use%2FmacOS-use/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/browser-use","download_url":"https://codeload.github.com/browser-use/macOS-use/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246131300,"owners_count":20728301,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-29T03:01:03.972Z","updated_at":"2025-03-29T03:01:25.291Z","avatar_url":"https://github.com/browser-use.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"\u003cpicture\u003e\n  \u003cimg alt=\"Shows a black Browser Use Logo in light color mode and a white one in dark color mode.\" src=\"./static/macos-use.png\"  width=\"full\"\u003e\n\u003c/picture\u003e\n\n\u003cbr/\u003e\n\n[![GitHub stars](https://img.shields.io/github/stars/browser-use/macOS-use?style=social)](https://github.com/browser-use/macOS-use/stargazers)\n[![Discord](https://img.shields.io/discord/1303749220842340412?color=7289DA\u0026label=Discord\u0026logo=discord\u0026logoColor=white)](https://link.browser-use.com/discord)\n[![Twitter Follow](https://img.shields.io/twitter/follow/OfirOzeri?style=social)](https://x.com/OfirOzeri)\n[![Twitter Follow](https://img.shields.io/twitter/follow/Gregor?style=social)](https://x.com/gregpr07)\n[![Twitter Follow](https://img.shields.io/twitter/follow/Magnus?style=social)](https://x.com/mamagnus00)\n\n\u003cdiv align=\"center\"\u003e\n  \u003ch2\u003eTell your MacBook what to do, and it's done—across ANY app.\u003c/h2\u003e\n  Created by \u003ca href=\"https://x.com/OfirOzeri\"\u003eOfir Ozeri \u003c/a\u003e♥️ migrated in collaboration with \u003ca href=\"https://x.com/mamagnus00\"\u003eMagnus\u003c/a\u003e and \u003ca href=\"https://x.com/gregpr07\"\u003eGregor\u003c/a\u003e\u003cbr\u003e \n\u003c/div\u003e\n\u003cbr\u003e\n\nmacOS-use enables AI agents to interact with your Macbook [see it in action!](#demos)\n\n# Quick start\n\n⚠️ Important: Review the [Warning](#warning) section before proceeding. \u003cbr\u003e\n\n### With pip:\n\n```bash\npip install mlx-use\n```\n\n### From github\n\nClone first\n\u003cbr\u003e\n\n```bash\ngit clone https://github.com/browser-use/macOS-use.git \u0026\u0026 cd macOS-use\n```\n\nDon't forget API key \u003cbr\u003eSupported providers: [OAI](https://platform.openai.com/docs/quickstart), [Anthropic](https://docs.anthropic.com/en/api/admin-api/apikeys/get-api-key) or [Gemini](https://ai.google.dev/gemini-api/docs/api-key) (deepseek R1 coming soon!)\n\n\u003cbr\u003e At the moment, macOS-use works best with OAI or Anthropic API, although Gemini is free. While Gemini works great too, it is not as reliable.\n\u003cbr\u003e\n\n```bash\ncp .env.example .env\n```\n\n```bash\nopen ./.env\n```\n\nWe recommend using macOS-use with uv environment\n\u003cbr\u003e\n\n```bash\nbrew install uv \u0026\u0026 uv venv \u0026\u0026 source .venv/bin/activate\n```\n\nInstall locally and you're good to go! try the first exmaple!\n\u003cbr\u003e\n\n```bash\nuv pip install --editable . \u0026\u0026 python examples/try.py\n\n```\n\nTry prompting it with\n\n```bash\nopen the calculator app\n```\n\n# Demos\n\n\u003ch3\u003e Click the GIF for the full video! \u003c/h3\u003e\n\n[prompt](https://github.com/browser-use/macOS-use/blob/main/examples/calculate.py): Calculate how much is 5 X 4 and return the result, then call done.\n\n```bash\npython examples/calculate.py\n\n```\n\n\u003cbr\u003e\n\n[![calc-5-times-4](https://github.com/browser-use/macOS-use/blob/main/static/calc-5-X-4.gif \"Click the GIF for full video!\")](https://x.com/OfirOzeri/status/1883110905665433681)\n\n\u003cbr/\u003e\n\n[prompt](https://github.com/browser-use/macOS-use/blob/main/examples/login_to_auth0.py): Go to auth0.com, sign in with google auth, choose ofiroz91 gmail account, login to the website and call done when you finish.\n\n```bash\npython examples/login_to_auth0.py\n```\n\n \u003cbr\u003e\n\n[![login-to-auth0](https://github.com/browser-use/macOS-use/blob/main/static/login-to-auth0.gif \"Click for full video\")](https://x.com/OfirOzeri/status/1883455599423434966)\n\n\u003cbr/\u003e\n\n[prompt](https://github.com/browser-use/macOS-use/blob/main/examples/check_time_online.py): Can you check what hour is Shabbat in israel today? call done when you finish.\n\n```bash\npython examples/check_time_online.py\n```\n\n\u003cbr\u003e\n\n[![check-time-online](https://github.com/browser-use/macOS-use/blob/main/static/check-time-online.gif \"Click for full video\")](https://x.com/OfirOzeri/status/1883109604416278552)\n\n\u003cbr\u003e\n\n# Our Vision:\n\nTLDR: Tell every Apple device what to do, and see it done. on EVERY APP.\n\u003cbr\u003e\u003cbr\u003e\nThis project aimes to build the AI agent for the MLX by Apple framework that would allow the agent to perform any action on any Apple device. Our final goal is a open source that anyone can clone, powered by the [mlx](https://github.com/ml-explore/mlx) and [mlx-vlm](https://github.com/Blaizzy/mlx-vlm) to run local private infrence at zero cost.\n\n## Roadmap goals:\n\n1. Support MacBooks at SOTA reliability\n\n- [ ] Refine the Agent prompting.\n- [ ] Release the first working version to pypi.\n- [ ] Improve self-correction.\n- [x] Adding ability to check which apps the machine has installed.\n- [x] Add feature to allow the agent to check existing apps if failing, e.g. calendar app actual name is iCal.\n- [ ] Add action for the agent to ask input from the user.\n- [ ] Test Test Test! and let us know what and how to improve!\n- [ ] Make task cheaper and more efficient.\n\n2. Support local inference with small fine tuned model.\n\n- [ ] Add support for inference with local models using mlx and mlx-vlm.\n- [ ] Fine tune a small model that every device can run inference with.\n- [ ] SOTA reliability.\n\n3. Support iPhone/iPad\n\n\u003cbr\u003e\n\n# WARNING\n\nThis project is still under development and user discretion is advised!\nmacOS-use can and will use your do [login](#demos), use private credentials, [auth services](https://github.com/browser-use/macOS-use/blob/main/examples/login_to_auth0.py) or stored passwords to complete its task, launch and interact WITH EVERY APP and UI component in your MacBook and restrictions to the model are still under active development! It is not recommended to operate it unsupervised YET\nmacOS-use WILL NOT STOP at captcha or any other forms of bot identifications, so once again, user discretion is advised.\n\n## Disclaimer:\n\nAs this is an early stage release, You might experience varying success rates depending on task prompt, we're actively working on improvements. \u003cbr\u003e talk me on [X/Twitter](https://x.com/OfirOzeri) or contact me on [Discord](https://link.browser-use.com/discord), your input is crucial and highly valuable!\u003cbr\u003e\n\n# Contributing\n\nWe are a new project and would love contributors! Feel free to PR, open issues for bugs or feature requests.\n\n# Thanks\n\nI would like to extend my heartfelt thanks to [![Twitter Follow](https://img.shields.io/twitter/follow/Gregor?style=social)](https://x.com/gregpr07) and [![Twitter Follow](https://img.shields.io/twitter/follow/Magnus?style=social)](https://x.com/mamagnus00) for their incredible work in developing Browser Use. Their dedication and expertise have been invaluable, especially in helping with the migration process and I couldn't have done it without them!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrowser-use%2FmacOS-use","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrowser-use%2FmacOS-use","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrowser-use%2FmacOS-use/lists"}