{"id":20501968,"url":"https://github.com/philfung/computer-use","last_synced_at":"2025-09-25T07:31:23.862Z","repository":{"id":261703289,"uuid":"881159467","full_name":"philfung/computer-use","owner":"philfung","description":"try Computer Use on your Mac with a few clicks","archived":false,"fork":false,"pushed_at":"2024-11-24T22:11:13.000Z","size":108,"stargazers_count":16,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-11-24T23:21:13.784Z","etag":null,"topics":["anthropic","claude","computer-use","large-language-models","llms","macos","multimodal-large-language-models"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/philfung.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-31T02:17:46.000Z","updated_at":"2024-11-24T22:11:17.000Z","dependencies_parsed_at":"2024-11-24T23:30:04.222Z","dependency_job_id":null,"html_url":"https://github.com/philfung/computer-use","commit_stats":null,"previous_names":["philfung/open-computer-use","philfung/computer-use"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philfung%2Fcomputer-use","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philfung%2Fcomputer-use/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philfung%2Fcomputer-use/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philfung%2Fcomputer-use/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/philfung","download_url":"https://codeload.github.com/philfung/computer-use/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234163888,"owners_count":18789409,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anthropic","claude","computer-use","large-language-models","llms","macos","multimodal-large-language-models"],"created_at":"2024-11-15T19:18:25.446Z","updated_at":"2025-09-25T07:31:18.526Z","avatar_url":"https://github.com/philfung.png","language":"Python","readme":"# Computer Use for MacOS 💻 \u003cimg height=\"100\" alt=\"Frame 1\" src=\"https://github.com/user-attachments/assets/098bda06-9040-404e-a6da-71cb4e1bebcd\"\u003e\nA macOS app (forked from [Anthropic's computer use demo for Ubuntu](https://github.com/anthropics/anthropic-quickstarts/tree/main/computer-use-demo)) demonstrating LLM-based computer use on your laptop.  \n\n\u003cimg height=\"400\" alt=\"Frame 1\" src=\"https://github.com/user-attachments/assets/d1a4e615-ef1c-4045-a3d3-a4b38b636994\"\u003e\u003c/br\u003e\n\n# Caution ⚠️\nComputer use is a [beta feature from Anthropic](https://docs.anthropic.com/en/docs/build-with-claude/computer-use) that has direct access to the internet and **sends screenshots of your desktop to Anthropic**. \n\u003c/br\u003e\u003c/br\u003e\n\n# Running the App\n### 1. Ensure you have the latest [Python 3](https://www.python.org/downloads/) (\u003e= 3.11) and [Chrome](https://www.google.com/chrome/dr/download/) installed, and an [Anthropic API key](https://console.anthropic.com/settings/keys).\u003c/br\u003e\n### 2. Enable *Screen Recording* permissions so that this application can take screenshots of the desktop.\n* Open the *Settings* app → click on *Privacy and Security* → click on *Screen and System Recording*.\u003c/br\u003e\u003c/br\u003e\n\u0026nbsp;\u0026nbsp;\u003cimg width=\"75\" alt=\"Screenshot 2024-11-06 at 3 48 30 PM\" src=\"https://github.com/user-attachments/assets/67de19cc-cf7b-448c-a02c-52304e8d43f3\"\u003e\n→\u0026nbsp;\u003cimg height=\"100\" alt=\"Screenshot 2024-11-06 at 3 44 47 PM\" src=\"https://github.com/user-attachments/assets/59c325d7-4e43-4272-8ac0-76323cd9dba7\"\u003e\n→\u0026nbsp;\u003cimg height=\"100\" alt=\"Screenshot 2024-11-07 at 6 28 23 PM\" src=\"https://github.com/user-attachments/assets/1ff6c92d-3399-446a-bdb4-13236971b620\"\u003e\n* Click the little *+* on the lower-left and add the *Terminal* application, and click on the toggle next to the app so it turns blue.\u003c/br\u003e\u003c/br\u003e\n\u0026nbsp;\u0026nbsp;\u003cimg width=\"66\" alt=\"Screenshot 2024-11-06 at 3 46 28 PM\" src=\"https://github.com/user-attachments/assets/87a10818-7f7d-4130-8e21-688815a21124\"\u003e\n→\u0026nbsp;\u0026nbsp;\u003cimg width=\"476\" alt=\"Screenshot 2024-11-06 at 3 47 23 PM\" src=\"https://github.com/user-attachments/assets/67e1a154-38bb-4c1b-9692-ccd382f4d470\"\u003e\u003c/br\u003e\n### 3. Enable *Accessibility* permissions so that this application can control your mouse and keyboard.  \n* Open the *Settings* app-\u003eclick on *Privacy and Security*-\u003eclick on *Accessibility*.\u003c/br\u003e\u003c/br\u003e\n\u0026nbsp;\u0026nbsp;\u003cimg width=\"75\" alt=\"Screenshot 2024-11-06 at 3 48 30 PM\" src=\"https://github.com/user-attachments/assets/67de19cc-cf7b-448c-a02c-52304e8d43f3\"\u003e\n→\u0026nbsp;\u003cimg height=\"100\" alt=\"Screenshot 2024-11-06 at 3 44 47 PM\" src=\"https://github.com/user-attachments/assets/59c325d7-4e43-4272-8ac0-76323cd9dba7\"\u003e\n→\u0026nbsp;\u003cimg width=\"286\" alt=\"Screenshot 2024-11-07 at 6 29 40 PM\" src=\"https://github.com/user-attachments/assets/52f471ae-b16c-4d2d-bcaf-dfe225e6987e\"\u003e\n* Click the little *+* on the lower-left and add the *Terminal* application, and click on the toggle next to the app so it turns blue.\u003c/br\u003e\u003c/br\u003e\n\u0026nbsp;\u0026nbsp;\u003cimg width=\"66\" alt=\"Screenshot 2024-11-06 at 3 46 28 PM\" src=\"https://github.com/user-attachments/assets/87a10818-7f7d-4130-8e21-688815a21124\"\u003e\n→\u0026nbsp;\u0026nbsp;\u003cimg width=\"476\" alt=\"Screenshot 2024-11-06 at 3 47 23 PM\" src=\"https://github.com/user-attachments/assets/67e1a154-38bb-4c1b-9692-ccd382f4d470\"\u003e\u003c/br\u003e\n### 4. Open the *Terminal* app and run the script.\u003c/br\u003e\u003c/br\u003e\n```bash\n# Do this in Terminal App\ngit clone https://github.com/philfung/computer-use.git\ncd computer-use\nchmod u+x install_and_run.sh\n./install_and_run.sh\n```\n\u0026nbsp;\u0026nbsp;The Computer Use app should automatically open in the Chrome browser.\n\n\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u003cimg height=\"350\" alt=\"Frame 1\" src=\"https://github.com/user-attachments/assets/d1a4e615-ef1c-4045-a3d3-a4b38b636994\"\u003e\u003c/br\u003e\n\n### 5. Enter your [Anthropic API Key](https://console.anthropic.com/settings/keys) in the left panel of the Chrome application.\n\n\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp;\u003cimg height=\"200\" alt=\"Screenshot 2024-11-06 at 3 55 11 PM\" src=\"https://github.com/user-attachments/assets/9fb5ebbb-577e-4c1d-ab85-8fd876cfb2b8\"\u003e\u003c/br\u003e\n\n### 6. Try Computer Use by entering commands!\nFor example:\n```bash\n\"Open cnn.com and click on the latest article\"\n\n\n\"Open the Settings app and change to Dark mode\"\n```\n\n# Talks\n* [LLMs as Computer Users: An Overview](https://www.figma.com/deck/rsWK4sRl0dOahG59bfMhql)\n\n# Resources\nFor more information, check out my [recommended reading list on computer use](https://github.com/philfung/awesome-computer-use).\n\n \n\n\n","funding_links":[],"categories":["Demos"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilfung%2Fcomputer-use","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fphilfung%2Fcomputer-use","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilfung%2Fcomputer-use/lists"}