https://github.com/cloneofsimo/auto_llm_codebase_analysis
https://github.com/cloneofsimo/auto_llm_codebase_analysis
Last synced: about 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/cloneofsimo/auto_llm_codebase_analysis
- Owner: cloneofsimo
- Created: 2024-03-10T10:53:11.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2024-03-14T05:54:43.000Z (over 2 years ago)
- Last Synced: 2024-03-14T06:33:14.390Z (over 2 years ago)
- Language: Python
- Size: 2.58 MB
- Stars: 11
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Automate Massive Codebase Analysis with Language Model
Ever had to go over all the codebase and analyze everything one-by-one? Ever wanted to "read over all of it really fast" and get "high level picture" per folder? This short tiny codebase does exactly that, hope to make your codebase-analysis time shorter.
This will recursively generate...
* High-level summary of the codebase
* Highlights of the codebase
* Pythonic Pseudocode
* Import Relationships
# Installation & Use
Install sglang and run server.
```bash
pip install sglang
python -m sglang.launch_server --model-path "Qwen/Qwen1.5-72B-Chat" --tp 4 --port 8080
```
Run it via
```bash
convert.py CODEBASE_DIR OUTPUT_DIR --port 8080
```
# Example Output:
The [following](https://github.com/cloneofsimo/reverse_eng_deepspeed_study/tree/main/decomposed) is example output from analysis of DeepSpeed codebase.