https://github.com/waikato-llm/adams-llm

ADAMS workflows for dealing with LLM datasets etc.
https://github.com/waikato-llm/adams-llm

adams llm workflows

Last synced: about 1 month ago
JSON representation

ADAMS workflows for dealing with LLM datasets etc.

• Host: GitHub
• URL: https://github.com/waikato-llm/adams-llm
• Owner: waikato-llm
• License: gpl-3.0
• Created: 2023-12-11T22:21:34.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-08-08T23:59:38.000Z (5 months ago)
• Last Synced: 2024-08-10T01:43:07.785Z (5 months ago)
• Topics: adams, llm, workflows
• Homepage: https://adams.cms.waikato.ac.nz/
• Size: 21.5 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# adams-llm

[ADAMS](https://adams.cms.waikato.ac.nz) workflows for dealing with LLM datasets etc.

## Workflows

* [compare-translated-alpaca.flow](compare-translated-alpaca.flow) - allows comparing

  original and translated records (Alpaca JSON format) and whether to keep or discard

  them (i.e., cleaning up a dataset).

* [kb_json_to_csv.flow](kb_json_to_csv.flow) - converts the JSON files generated from

  a `kb-eval` script into a CSV file for analysis ([example docker image](https://github.com/waikato-llm/huggingface_transformers/tree/main/4.43.1_cuda12.1_langchain)).

* [kb_eval.flow](kb_eval.flow) - generates statistics from outputs generated by the `kb_eval` script

* [whisper_edit_distance.flow](whisper_edit_distance.flow) - computes the edit distance between ground truth and whisper output