Ecosyste.ms: Awesome

https://github.com/modelscope/ms-swift

Use PEFT or Full-parameter to finetune 350+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

agent deploy dpo internvl liger llama llama3 llava llm lora megatron minicpm-v modelscope multimodal peft pre-training qwen2 qwen2-vl reflection sft

Last synced: 24 Dec 2024

https://github.com/eyaadh/megadlbot_oss

Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community - @Baivaru until it retired.

aiofiles aiohttp bot ffmpeg ffprobe google-python-api megadlbot megatron mongodb pymongo pyrogram seedr telegram tgcrypto youtube-dl

Last synced: 25 Dec 2024

https://github.com/xrsrke/pipegoose

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

3d-parallelism data-parallelism distributed-optimizers huggingface-transformers large-scale-language-modeling megatron megatron-lm mixture-of-experts model-parallelism moe pipeline-parallelism sequence-parallelism tensor-parallelism transformers zero-1

Last synced: 20 Nov 2024

https://github.com/mofheka/llama-megatron

A LLaMA1/LLaMA12 Megatron implement.

llama llama2 llm llm-training megatron megatron-lm pytorch

Last synced: 29 Nov 2024

https://github.com/mihirkudale/megatron-nlp-project

megatron natural-language-processing

Last synced: 26 Nov 2024