https://github.com/jideguru/embeddings_scrapper

https://github.com/jideguru/embeddings_scrapper

Last synced: 25 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/jideguru/embeddings_scrapper
• Owner: JideGuru
• License: mit
• Created: 2023-06-03T15:05:23.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-06-05T12:58:47.000Z (over 1 year ago)
• Last Synced: 2024-10-08T22:02:22.050Z (about 1 month ago)
• Language: Dart
• Size: 8.79 KB
• Stars: 7
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

README

        
This is a simple dart cli script i wrote to help create embedding json files.

It works in this steps:

1. It scrapes for phrases/recipes 

2. it runs the phrases through OpenAI's API to get the 1538-dimensions embeddings of the phrase

3. it then creates a json file with the phrase and embeddings

The json should look like {"text": "phrase", "embedding": [0.0, 0.1,..etc]}

Just run the `dart run` command to see it at work.