https://github.com/do-me/mlx_parallm_document_summarizer

A long document summarizing heuristic for LLMs with short context.
https://github.com/do-me/mlx_parallm_document_summarizer

Last synced: 2 months ago
JSON representation

A long document summarizing heuristic for LLMs with short context.

• Host: GitHub
• URL: https://github.com/do-me/mlx_parallm_document_summarizer
• Owner: do-me
• License: mit
• Created: 2024-07-15T15:50:15.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-07-15T16:08:38.000Z (10 months ago)
• Last Synced: 2025-01-16T03:43:52.362Z (4 months ago)
• Language: Python
• Size: 22.5 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# MLX ParaLLM Document Summarizer

An experimental proof-of-concept long document summarizing heuristic for LLMs with short context.

![image](https://github.com/user-attachments/assets/bf34926e-2a43-4c62-9118-af4f61b64d86)

### To Do 

- Fix streaming to UI

- Identify better default settings

- Add iterative logic when there are too many summaries, to add an arbitrary level of depth. Leading to the summary of summaries of summaries and so on. Will become useless at some point and is more of a PoC.