https://github.com/nl4dv/nl4dv-llm-supplemental-material

https://github.com/nl4dv/nl4dv-llm-supplemental-material

Last synced: 15 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/nl4dv/nl4dv-llm-supplemental-material
• Owner: nl4dv
• Created: 2024-08-23T21:03:47.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-08-23T21:35:35.000Z (5 months ago)
• Last Synced: 2024-11-07T00:47:30.155Z (2 months ago)
• Size: 6.87 MB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Generating Analytic Specifications for Data Visualization from Natural Language Queries using Large Language Models

## Table of Contents

- [Initial-Prompts](#Initial-Prompts)

- [Final-Prompt](#Final-Prompt)

- [Preliminary-Evaluation](#Preliminary-Evaluation)

- [Example-Gallery](#Example-Gallery)

## Initial-Prompts

This folder contains the initial set of prompts used for generating analytic specifications from natural language queries. It includes various example queries and their corresponding outputs. [Initial-Prompts Folder](./Initial-Prompts)

## Final-Prompt

This folder contains the refined and final version of the prompts that was developed after iterating on the initial prompts. [Final-Prompts Folder](./Final-Prompt)

`Note:`This prompt was created at the time of [NLVIZ](https://www.nl-vizworkshop.com/) submission and may have undergone revisions in recent versions of [NL4DV](https://nl4dv.github.io/nl4dv/).

## Preliminary-Evaluation

To evaluate the performance of our NL4DV-LLM prompt in generating analytic specifications and visualizations, we conducted a preliminary evaluation using the NLVCorpus dataset (https://nlvcorpus.github.io/). This folder contains:

- The nl4dv-llm-evaluation file which contains the preliminary evaluation of the prompt with the NLVCorpus dataset. This file contains the final results indicating whether the visualizations generated by NL4DV-LLM were accurate or not. [nl4dv-llm-evaluation](./Preliminary-Evaluation/nl4dv-llm-evaluation.xlsx)

## Example-Gallery

The example gallery folder contains the visualizations generated by NL4DV-LLM for various natural language queries selected from a subset of the NLVCorpus dataset.[Sample-queries+Vis](./Example-Gallery/sample-queries+vis.xlsx)