https://github.com/danielrosehill/llm-output-storage-formats

Modelling vavarious ways in which LLM prompts and outputs can be saved in digiital systems
https://github.com/danielrosehill/llm-output-storage-formats

Last synced: 6 days ago
JSON representation

Modelling vavarious ways in which LLM prompts and outputs can be saved in digiital systems

• Host: GitHub
• URL: https://github.com/danielrosehill/llm-output-storage-formats
• Owner: danielrosehill
• Created: 2024-10-28T13:36:38.000Z (21 days ago)
• Default Branch: main
• Last Pushed: 2024-10-28T13:50:50.000Z (21 days ago)
• Last Synced: 2024-10-28T17:05:39.684Z (21 days ago)
• Size: 5.86 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# LLM Output Storage Formats

## Purpose Statement

Exploring various ways in which interactions with large language models (LLMs) can be stored in flat files (for intake to databases, data anaytics and visualisation programs, etc).

---

## Format Ideas

# Storage Formats for LLM Prompts and Outputs

## 1. Graph-Centric Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .gml         | Graph Modeling Language            |

| .graphml     | Graph Markup Language              |

| .dot / .gv   | Graphviz                           |

| .xgmml       | eXtensible Graph Markup Language   |

| .gexf        | Graph Exchange XML Format          |

## 2. Data Serialization Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .json        | JavaScript Object Notation         |

| .yaml        | YAML Ain't Markup Language         |

| .xml         | eXtensible Markup Language         |

| .jsonld      | JSON for Linked Data               |

| .rdf         | Resource Description Framework     |

## 3. Tabular Data Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .csv / .tsv  | Comma/Tab-Separated Values         |

| .parquet     | Parquet Columnar Storage Format    |

## 4. Plain Text Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .txt         | Plain Text File                    |

| .md          | Markdown                           |

| .rtf         | Rich Text Format                   |

| .csv         | Comma-Separated Values             |

## 5. Document and Publishing Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .pdf         | Portable Document Format           |

| .docx        | Word Document                      |

| .epub        | eBook Format                       |

| .odt         | OpenDocument Text                  |

| .tex / .latex| LaTeX                              |

## 6. Code-Based Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .py          | Python Script                      |

| .js / .ts    | JavaScript/TypeScript              |

| .html        | Hypertext Markup Language          |

| .css         | Cascading Style Sheets             |

## 7. Audio and Multimedia Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .mp3 / .wav  | Audio File                         |

| .mp4 / .webm | Video File                         |

| .srt         | Subtitle File                      |

## 8. Hierarchical and Multi-Dimensional Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .hdf5        | Hierarchical Data Format           |

| .sqlite      | SQLite Database File               |

| .sql         | Structured Query Language File     |

## 9. Notebook-Style Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .ipynb       | Jupyter Notebook                   |

| .rmd         | R Markdown                         |

## 10. Archive Formats

| Extension(s) | Formal Name                         |

|--------------|------------------------------------|

| .tar.gz / .zip | Archive File                     |

| .tar.xz      | Compressed Archive File            |

---

## Author

Daniel Rosehill  

(public at danielrosehill dot com)

## Licensing

This repository is licensed under CC-BY-4.0 (Attribution 4.0 International) 

[License](https://creativecommons.org/licenses/by/4.0/)

### Summary of the License

The Creative Commons Attribution 4.0 International (CC BY 4.0) license allows others to:

- **Share**: Copy and redistribute the material in any medium or format.

- **Adapt**: Remix, transform, and build upon the material for any purpose, even commercially.

The licensor cannot revoke these freedoms as long as you follow the license terms.

#### License Terms

- **Attribution**: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

- **No additional restrictions**: You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

For the full legal code, please visit the [Creative Commons website](https://creativecommons.org/licenses/by/4.0/legalcode).