Projects in Awesome Lists tagged with trainium
A curated list of projects in awesome lists tagged with trainium .
https://github.com/vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda deepseek gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch qwen rocm tpu trainium transformer xpu
Last synced: 29 Jan 2026
https://github.com/aws-samples/foundation-model-benchmarking-tool
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
bedrock benchmark benchmarking deepseek deepseek-r1 evaluation-metrics foundation-models g5 g6 g6e generative-ai inferentia llama2 llama3 p4d p5 sagemaker trainium
Last synced: 15 May 2025
https://github.com/vllm-project/vllm-neuron
Community maintained hardware plugin for vLLM on AWS Neuron
aws aws-neuron inferentia trainium
Last synced: 26 Feb 2026