Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/a5huynh/spyglass
A personal search engine: Create a searchable library from your personal documents, interests, and more!
https://github.com/a5huynh/spyglass
cross-platform rust rust-lang search-engine tantivy tauri-app
Last synced: 3 months ago
JSON representation
A personal search engine: Create a searchable library from your personal documents, interests, and more!
- Host: GitHub
- URL: https://github.com/a5huynh/spyglass
- Owner: spyglass-search
- License: agpl-3.0
- Created: 2021-11-17T21:18:56.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2024-03-12T03:11:17.000Z (8 months ago)
- Last Synced: 2024-05-19T05:03:31.592Z (6 months ago)
- Topics: cross-platform, rust, rust-lang, search-engine, tantivy, tauri-app
- Language: Rust
- Homepage: https://docs.spyglass.fyi
- Size: 46.4 MB
- Stars: 2,465
- Watchers: 15
- Forks: 55
- Open Issues: 36
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-tauri - Spyglass - Personal search engine that indexes your files/folders, cloud accounts, and whatever interests you on the internet. (Applications / Search)
README
Spyglass
A personal search engine that indexes what you want, exposing it to you in a simple & fast interface
Download now:
macOS (Intel/ARM)
|
Windows
|
Linux (AppImage)
Documentation
|
Using Spyglass
|
Lenses
---
## Create your library from:
- [x] Local documents/folders
- [x] Different internet topics (https://lenses.spyglass.fyi).
- Lots of developer docs (Rustlang, Go, etc.)
- Wikpedia, game wikis, etc.
- [x] Google Calendar events.
- [x] Google Drive docs.
- [x] GitHub repos, starred repos, & issues.
- [x] Reddit saved/upvoted posts.
- [ ] Gmail
- [ ] YouTube playlists & favorited.
## Introduction
Spyglass lives on your device crawling & indexing websites __you__ want with a basic
set of rules.
Web pages when condensed down to text are surprisingly small. With todays' incredibly
fast CPUs and ample amounts of of disk space, you can easily create a personal library of
wikis, blog posts, etc. that can be referenced instantly. Cut through the SEO spam of
the internet by building your own index.
For users who have been frustrated with the current state of search and the internet,
Spyglass offers a powerful solution to find _exactly_ what you want.
> See [Launching & Using Spyglass](https://docs.spyglass.fyi/usage/index.html) to get started.
## Traditional web search sucks
> The short answer is that Google search results are clearly dying. The long answer
> is that most of the web has become too inauthentic to trust.
>
> - https://dkb.io/post/google-search-is-dying
Spyglass is a solution to the following common issues when searching the web:
- Do you add terms such as `reddit` or `wiki` to your searches to narrow it down?
- Do you get frustrated with overzealous autocorrect on your search terms?
- Do you get frustrated with the terrible search some wikis/sites offer?
- Do you scroll past dozens of SEO spam pages to find the recipe/review/blog post you were looking for?
- Do you skip over a full-page of ads before getting to your actual search results?
- Do you have private websites / data / documents that you'd like to search through?
## How does it know what to crawl?
Spyglass expands on the ideas outlined in [this paper][googles-paper] by the
Brave Search Team. There are currently a simple set of rules that will point Spyglass
at a website and crawl only what you want. When available, crawling is
bootstrapped w/ data from the Internet Archive to not overwhelm smaller websites.
**For community lenses, we precrawl & preprocess these lenses so that you can get started
searching through those topics immediately.**
Not all websites & not all data can be crawled by Spyglass. If you have something
that you'd like to index and would like some help, feel free to ping me on
our [Discord server](https://discord.gg/663wPVBSTB)!
> See [Community Lenses](https://docs.spyglass.fyi/usage/lenses/community.html) to install
> lenses others in the community have built.
> See [Building your own lens](https://docs.spyglass.fyi/usage/lenses/build.html) to see
> how easy it is to build your own lens. Please share w/ the community when you're done!
[googles-paper]: https://brave.com/static-assets/files/goggles.pdf
## Developer Guide
If you'd like to help, reach out on our [Discord server](https://discord.gg/663wPVBSTB)
to see what is currently being developed and how you can help usher in a new,
better search.
> See [Building from source](https://docs.spyglass.fyi/build.html) to get started
> building & contributing to Spyglass.
TL;DR: If you want to build and run Spyglass from source, you can simply run this command:
```
cargo make run
```