https://github.com/1lmao/queuing-theory

Modeling and simulating various queuing models such as: M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1 for Large Language Model (LLM) inference systems. These simlulations bridge the gap between theoretical frameworks and practical simulations, this provides valuable insights for developing scalable, energy-efficient AI infrastructures.
https://github.com/1lmao/queuing-theory

gg1 gm1 jupyter-notebook mm1 mmk python queuing-models queuing-simulator queuing-system queuing-theory simpy simpy-library

Last synced: 3 days ago
JSON representation

Modeling and simulating various queuing models such as: M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1 for Large Language Model (LLM) inference systems. These simlulations bridge the gap between theoretical frameworks and practical simulations, this provides valuable insights for developing scalable, energy-efficient AI infrastructures.

• Host: GitHub
• URL: https://github.com/1lmao/queuing-theory
• Owner: 1lmao
• Created: 2025-01-05T19:06:25.000Z (19 days ago)
• Default Branch: main
• Last Pushed: 2025-01-05T19:55:27.000Z (19 days ago)
• Last Synced: 2025-01-21T02:12:52.819Z (3 days ago)
• Topics: gg1, gm1, jupyter-notebook, mm1, mmk, python, queuing-models, queuing-simulator, queuing-system, queuing-theory, simpy, simpy-library
• Language: Jupyter Notebook
• Homepage:
• Size: 6.56 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Queuing-Theory

Modeling and simulating various queuing models for Large Language Model (LLM) inference systems such as- 

M/M/1, M/M/k, G/G/1, G/M/1, and M/G/1:

![Queuing Theory Models](https://github.com/1lmao/Queuing-Theory/raw/main/queuingmodels.gif)