{"id":15890619,"url":"https://github.com/dimfeld/perceive","last_synced_at":"2025-03-20T11:36:37.700Z","repository":{"id":80575500,"uuid":"581671650","full_name":"dimfeld/perceive","owner":"dimfeld","description":"Semantic search for your life","archived":false,"fork":false,"pushed_at":"2023-05-21T01:51:34.000Z","size":1087,"stargazers_count":5,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-01T00:11:39.415Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dimfeld.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-12-23T22:43:52.000Z","updated_at":"2023-06-29T07:32:03.000Z","dependencies_parsed_at":null,"dependency_job_id":"7f191117-70bb-4fb9-b5f9-662b9c8244bd","html_url":"https://github.com/dimfeld/perceive","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimfeld%2Fperceive","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimfeld%2Fperceive/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimfeld%2Fperceive/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dimfeld%2Fperceive/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dimfeld","download_url":"https://codeload.github.com/dimfeld/perceive/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244069017,"owners_count":20392942,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-06T07:07:09.473Z","updated_at":"2025-03-20T11:36:37.691Z","avatar_url":"https://github.com/dimfeld.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# perceive\nSemantic search for your life\n\nPerceive is a side project which I started to become more familiar with ML embeddings and semantic search. It has the ability to import\nbrowser history and filesystem sources, and index them for searching.\n\nThis project was a nice proof of concept, but is on hold indefinitely. Much of the work involved here will be reused for my new [mAIven](https://github.com/dimfeld/maiven) project.\n\n\n![Screenshot](./perceive-screenshot-small.jpeg)\n\n## Features\n\n- Read browser history and fetch the content\n- Import bookmarks from Chrome\n- Scan the local filesystem and index text files\n- Supports multiple sources at once\n- All indexing happens locally -- no need to send your data to someone else's server\n\n## Adding Sources\n\nThe browser history and bookmark source types use the Chromium browser directory as the location. For Brave Browser on\nmacOS this is ` ~/Library/Application\\ Support/BraveSoftware/Brave-Browser/Default`. Other Chromium-based browsers will\nhave similar locations.\n\n## Future Features\n\n- Bookmark management\n- More UI work\n- Better article content extraction\n- Browser extension for better page capture\n\n## Installation\n\nAs of now there is no prepackaged binary with everything included.\n\nFirst, you'll want to run `just install-models`, using [just](https://github.com/casey/just). This will download the \nmodel from Huggingface and convert it to the format used by Rust's version of Torch.\n\n### Building on macOS\n\nYou'll need to have libtorch installed. You can use `pip3` or `homebrew` to install `pytorch`, and then\nset the LIBTORCH environment variable to the path where libtorch is installed.\n\nFor example, when installed via homebrew you would add `export LIBTORCH=/opt/homebrew/opt/pytorch` to your `~/.zshrc` or\n`~/.zprofile`.\n\nAt some point I'll try to add some better way of installing a local copy too, to make it easier to match the version of\nlibtorch with the version expected by the bindings.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdimfeld%2Fperceive","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdimfeld%2Fperceive","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdimfeld%2Fperceive/lists"}