https://github.com/georg-jung/hyde-with-phi3-talk

https://github.com/georg-jung/hyde-with-phi3-talk

bert bert-embeddings blazor csharp gen-ai generative-ai hyde onnx onnxruntime phi-3 phi-3-5

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/georg-jung/hyde-with-phi3-talk
• Owner: georg-jung
• License: mit
• Created: 2024-10-16T23:20:13.000Z (3 months ago)
• Default Branch: master
• Last Pushed: 2024-10-17T13:16:42.000Z (3 months ago)
• Last Synced: 2024-12-12T20:49:42.904Z (about 1 month ago)
• Topics: bert, bert-embeddings, blazor, csharp, gen-ai, generative-ai, hyde, onnx, onnxruntime, phi-3, phi-3-5
• Language: C#
• Homepage:
• Size: 700 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# PoC Demo HyDE with Phi-3 in C#

> The code in this repository is not production ready but demonstrates the concepts.

This repository contains a simple semantic search Blazor application leveraging [Hypothetical Document Embeddings](https://arxiv.org/abs/2212.10496). Slides (german) [are available too](slides.pdf).

![Screenshot](screenshot.png)

* Assumes a working CUDA/cuDNN installation

* Assumes models can be downloaded to `D:\hf` and below (subfolders will be created)

* Assumes corpus embedding vectors can be saved to files inside `D:\docs`

* Assumes some repos to be available:

  *  at `D:\docs\dotnet-docs`

  *  at `D:\docs\aspnetcore`

  *  at `D:\docs\ef`

  *  at `D:\docs\npgsql`

* `CorpusEmbedder`'s progress reporting is partly broken but that does not affect it's main purpose