https://github.com/shimizukawa/huggingface-document-search

BASED UPON https://huggingface.co/spaces/terapyon/gh-issue-search
https://github.com/shimizukawa/huggingface-document-search

Last synced: about 15 hours ago
JSON representation

BASED UPON https://huggingface.co/spaces/terapyon/gh-issue-search

• Host: GitHub
• URL: https://github.com/shimizukawa/huggingface-document-search
• Owner: shimizukawa
• Created: 2023-09-21T02:27:34.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-03T21:46:56.000Z (9 months ago)
• Last Synced: 2024-05-01T23:57:14.757Z (5 months ago)
• Language: Python
• Homepage:
• Size: 33.2 KB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
---

title: Document Search

emoji: 🐠

colorFrom: green

colorTo: purple

sdk: streamlit

sdk_version: 1.25.0

app_file: app.py

pinned: false

license: mit

---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

# Required Environment variables

- `INDEX_NAMES`: comma separated index names

- `QDRANT_URL`: Qdrant API endpoint

- `QDRANT_API_KEY`: Qdrant API Key

- `OPENAI_API_KEY`: OpenAI API Key

# import GitHub issues

## export from github

first, generate token on: https://github.com/settings/tokens

```

$ git clone https://github.com/kazamori/github-api-tools 

$ pip install -e ./github-api-tools 

$ export GITHUB_API_TOKEN="********"

$ gh-cli-issues --repository 

$ ls -issues.json

```

## import from json

```

$ python store.py -l github_issue  ../-issues.json 

```

# import Wiki Pages

## export from somewhere

create `pages.json` like:

```json

{"id": , "title": , "content": , "ctime": ..., "user": , "url": "https:..."}

{"title": ...}

```

## import from json

```

$ python store.py -l wikipage  ../pages.json 

```