https://github.com/night-chen/ToolQA

ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.
https://github.com/night-chen/ToolQA

large-language-models natural-language-understanding natural-lauguage-processing question-answering tools

Last synced: 3 days ago
JSON representation

ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.

• Host: GitHub
• URL: https://github.com/night-chen/ToolQA
• Owner: night-chen
• License: apache-2.0
• Created: 2023-06-06T07:09:04.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-08-19T02:34:22.000Z (over 1 year ago)
• Last Synced: 2023-11-07T16:16:56.028Z (about 1 year ago)
• Topics: large-language-models, natural-language-understanding, natural-lauguage-processing, question-answering, tools
• Language: Jupyter Notebook
• Homepage: https://arxiv.org/pdf/2306.13304.pdf
• Size: 304 KB
• Stars: 158
• Watchers: 6
• Forks: 5
• Open Issues: 1

Awesome Lists containing this project

• awesome_ai_agents - Toolqa - ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels … (Building / Tools)
• awesome_ai_agents - Toolqa - ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels … (Building / Tools)