{"id":28965950,"url":"https://github.com/devflowinc/hn-search-rag","last_synced_at":"2025-06-24T07:10:40.283Z","repository":{"id":224663217,"uuid":"763863408","full_name":"devflowinc/hn-search-RAG","owner":"devflowinc","description":"Hacker News Search and RAG built using Rust actix-web, minijinja, SolidJS, Vite, and Redis queue's","archived":false,"fork":false,"pushed_at":"2024-12-11T00:14:23.000Z","size":1906,"stargazers_count":27,"open_issues_count":6,"forks_count":3,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-06-22T05:17:05.386Z","etag":null,"topics":["hackernews","hackernews-api","jinja","jinja2","minijinja","rag","rust","search","search-engines","solidjs"],"latest_commit_sha":null,"homepage":"https://hn.trieve.ai","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/devflowinc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-27T03:42:26.000Z","updated_at":"2025-04-16T09:26:56.000Z","dependencies_parsed_at":"2024-11-08T11:01:33.153Z","dependency_job_id":null,"html_url":"https://github.com/devflowinc/hn-search-RAG","commit_stats":null,"previous_names":["devflowinc/hn_frontend","devflowinc/trieve-hn-discovery","devflowinc/hn-search-rag"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/devflowinc/hn-search-RAG","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devflowinc%2Fhn-search-RAG","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devflowinc%2Fhn-search-RAG/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devflowinc%2Fhn-search-RAG/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devflowinc%2Fhn-search-RAG/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/devflowinc","download_url":"https://codeload.github.com/devflowinc/hn-search-RAG/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/devflowinc%2Fhn-search-RAG/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":261624969,"owners_count":23186121,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hackernews","hackernews-api","jinja","jinja2","minijinja","rag","rust","search","search-engines","solidjs"],"created_at":"2025-06-24T07:10:39.621Z","updated_at":"2025-06-24T07:10:40.267Z","avatar_url":"https://github.com/devflowinc.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003cimg height=\"100\" src=\"https://cdn.trieve.ai/trieve-logo-copy.png\" alt=\"Trieve Logo\"\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n\u003cstrong\u003e\u003ca href=\"https://dashboard.trieve.ai\"\u003eSign Up (1k chunks free)\u003c/a\u003e | \u003ca href=\"https://hn.trieve.ai\"\u003eHN Search and RAG\u003c/a\u003e |\u003ca href=\"https://docs.trieve.ai\"\u003eDocumentation\u003c/a\u003e | \u003ca href=\"https://cal.com/nick.k/meet\"\u003eMeeting Link\u003c/a\u003e | \u003ca href=\"https://discord.gg/eBJXXZDB8z\"\u003eDiscord\u003c/a\u003e | \u003ca href=\"https://matrix.to/#/#trieve-general:trieve.ai\"\u003eMatrix\u003c/a\u003e\n\u003c/strong\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://github.com/devflowinc/trieve/stargazers\"\u003e\n        \u003cimg src=\"https://img.shields.io/github/stars/devflowinc/trieve.svg?style=flat\u0026color=yellow\" alt=\"Github stars\"/\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://github.com/devflowinc/trieve/issues\"\u003e\n        \u003cimg src=\"https://img.shields.io/github/issues/devflowinc/trieve.svg?style=flat\u0026color=success\" alt=\"GitHub issues\"/\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://discord.gg/CuJVfgZf54\"\u003e\n        \u003cimg src=\"https://img.shields.io/discord/1130153053056684123.svg?label=Discord\u0026logo=Discord\u0026colorB=7289da\u0026style=flat\" alt=\"Join Discord\"/\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://matrix.to/#/#trieve-general:trieve.ai\"\u003e\n        \u003cimg src=\"https://img.shields.io/badge/matrix-join-purple?style=flat\u0026logo=matrix\u0026logocolor=white\" alt=\"Join Matrix\"/\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\n\u003ch2 align=\"center\"\u003e\n    \u003cb\u003eTrieve HN Discovery is Home to All Code for Hacker News Search and RAG\u003c/b\u003e\n\u003c/h2\u003e\n\n![Trieve OG tag](https://cdn.trieve.ai/blog/trieve-hn-discovery/trieve-hn-discovery-preview-opengraph.webp)\n\n## About\n\nThis repository contains the code for an engine which provides sub-100ms vector search (SPLADE, dense vector,  cross-encoder re-rank'ed hybrid), recommendations, RAG, and analytics for Hacker News. \n\n## Quick Links\n\n- [Launching Trieve HN Discovery - A Discovery Focused Search Engine for Hacker News](https://trieve.ai/launching-trieve-hn-discovery/)\n\n## Contributing \n\nIssues and contributions are welcome! There are three main folders for this project and they contain the code for their respective components of the application. \n\n- `actix-frontend` for the nojs version at [hnnojs.trieve.ai](https://hnnojs.trieve.ai) built using Rust actix-web and Minijinja \n- `solidjs-spa` for the power tool JS version at [hn.trieve.ai](https://hn.trieve.ai)\n- `ingest` for the various scripts relying on Redis queue's for pulling all of the data from the API and indexing it into a Trieve instance for search and RAG\n\n## Why Make This?\n\n1. Dense vector semantic search, re-rankers, SPLADE, and other techniques have gotten a lot of hype recently, but it's hard to figure out where each technique is best applied. We're hackers and built hacker'y features into Trieve to make it easier to test and experiment with this new tech, and needed a dataset us and our friends would have knowledge of to mess with. We're hoping to build lots of cool shareable projects on top of this demo to learn and collect feedback with.\n\n2. Make HN search more explorable with recommendations plus RAG and more open with public analytics. We added a feedback button under the search bar and are collecting CTR data such that we can continously fine-tune our models to improve the search experience. If you have some time, try out our blind comparison at hn-comparison.trieve.ai to help us collect higher quality training data.\n\n3. Open up a more fully-featured discovery API for others who want to build on top of HN data. The firebase HN API is great, but storing all the data yourself is expensive and time-consuming. We are hoping to lower that barrier in the old Octopart HNSearch spirit.\n\n4. Show what's possible with Trieve, work out scaling/stability bugs, and pressure test.\n\n5. HN is a cool place where we like to spend time and showing what we are working on to this community we feel apart is something we're excited about!","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevflowinc%2Fhn-search-rag","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdevflowinc%2Fhn-search-rag","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevflowinc%2Fhn-search-rag/lists"}