Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

"paged-attention" Awesome Lists

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

awesome-llm deepseek flash-attention flash-attention-2 flash-attention-3 llm llm-inference llms open-sora paged-attention

2,738 stars
185 forks
289 projects

Last updated: 30 Oct 2024

Search
Keywords
awesome-list 3,312 awesome 2,979 machine-learning 397 list 368 deep-learning 346 awesome-lists 331 resources 286 hacktoberfest 237 python 192 lists 189 javascript 173 programming 150 security 143 ai 135 computer-vision 133 blockchain 125 artificial-intelligence 123 llm 103 data-science 101 nlp 99 open-source 96 tools 96 react 94 chatgpt 87 natural-language-processing 81 android 80 linux 78 large-language-models 78 awesome-readme 74 learning 73 ios 70 curated-list 70 ethereum 69 css 68 papers 67 devops 65 awesome-resources 64 playground 60 nodejs 60 computer-science 59 courses 59 free-resources 58 getvm 57 macos 57 game-development 57 kubernetes 56 reinforcement-learning 56 cybersecurity 52 golang 51 robotics 51 privacy 51 java 49 tutorial 49 rust 49 design 48 bitcoin 47 collection 47 hands-on 47 frontend 47 labex 47 web 46 education 46 paper 46 hacking 45 go 45 swift 43 books 43 openai 43 cryptocurrency 43 cloud 42 dataset 41 web3 41 datasets 41 php 40 development 40 deep-neural-networks 40 exercises 40 free 40 html 39 gpt 38 data 38 security-tools 38 tutorials 37 survey 36 vue 36 gamedev 36 docker 36 opensource 35 database 33 research 33 data-visualization 33 paper-list 32 typescript 32 github 32 developer-tools 31 reactjs 31 iot 31 neural-network 30 community 30 framework 30 hardware 29 ruby 29 software 29 collections 29 aws 29 game 28 video 28 llms 28 documentation 28 tensorflow 27 architecture 27 smart-contracts 27 libraries 27 flutter 27 graph-neural-networks 26 git 26 transformer 26 automation 26 bioinformatics 26 gpt-4 26 cpp 26 csharp 25 algorithms 25 links 25 music 25 crypto 25 generative-ai 25 windows 25 games 25 testing 25 solidity 25 web-development 25 angular 24 react-native 24 defi 24 software-engineering 24 dotnet 24 pytorch 24 gpt-3 23 computer-graphics 23 unity 23 django 23 api 23 library 23 diffusion-models 22 ml 22 audio 22 r 22 self-supervised-learning 22 embedded 22 science 22 best-practices 22 projects 22 cryptography 22 infosec 22 penetration-testing 22 microsoft 22 awsome-list 21 markdown 21 apple 21 data-analysis 21 object-detection 21 self-hosted 21 youtube 21 kotlin 21 pentesting 21 opendata 20 serverless 20 productivity 20 startups 20 visualization 20 osint 20 segmentation 20 awesomeness 20 c 20 programming-language 19 sql 19 awsome 19 data-mining 19 jobs 19 ui 19 hacktoberfest-accepted 19 chinese 19 mathematics 19 neural-networks 19 cloud-computing 19 game-engine 18 raspberry-pi 18 roadmap 18 federated-learning 18 guidelines 18 stable-diffusion 18 engineering 18 website 18 azure 18 llama 17 coding 17 knowledge-graph 17 time-series 17 interview 17 saas 17 containers 17 cli 17 graph 17 statistics 17 startup 17 image-processing 17 knowledge 17 mobile 17 deeplearning 17 apps 17 multimodal 17 python3 17 algorithm 17 graphql 17 bugbounty 17 autonomous-driving 17 chatbot 16 learning-resources 16 webgl 16 bash 16 optimization 16 code 16 marketing 16 blog 16 microservices 16 articles 16 front-end 16 blogs 16 curated 16 decentralized 16 slam 16 cheatsheet 16 networking 16 language 16 mlops 16 mac 15 mysql 15 prompt-engineering 15 aigc 15 bert 15 pentest 15 generative-art 15 cloud-native 15 autonomous-vehicles 15 analytics 15 technology 15 machinelearning 15 representation-learning 15 big-data 15 reverse-engineering 15 software-development 15 graphics 15 resource 15 ros 14 prompt 14 data-engineering 14 vuejs 14 selfhosted 14 devsecops 14 recommender-system 14 foundation-models 14 nerf 14 data-structures 14 transformers 14 distributed-systems 14 detection 14 terminal 14 nextjs 14 deep-reinforcement-learning 13 backend 13 microservice 13 finance 13 dart 13 remote-sensing 13 multimodal-deep-learning 13 3d 13 readme 13 cms 13 laravel 13 agent 13 dotnet-core 13 speech-recognition 13 foss 13 open-data 13 webassembly 13 icons 13 generative-adversarial-network 13 telegram 13 performance 13 unicorns 13 monitoring 12 guide 12 haskell 12 seo 12 image 12 rails 12 objective-c 12 oss 12 pwa 12 svelte 12 animation 12 graphics-programming 12 font 12 gan 12 command-line 12 plugins 12 swiftui 12 ansible 12 android-development 12 p2p 12 gis 12 wordpress 12 ecommerce 12 android-library 12 art 12 podcast 12 discord 12 creative-coding 11 unity3d 11 js 11 free-software 11 pose-estimation 11 databases 11 hacktoberfest2020 11 static-analysis 11 elasticsearch 11 vscode 11 vision-and-language 11 automl 11 malware-analysis 11 wasm 11 react-components 11 cvpr 11 ui-design 11 question-answering 11 node 11 postgresql 11 dapp 11 language-model 11 front-end-development 11 storage 11 sysadmin 11 frameworks 11 videos 11 course 11 hosting 11 gaming 11 transfer-learning 11 design-systems 10 beginner-friendly 10 ctf 10 guides 10 search 10 docs 10 multimodal-learning 10 golang-library 10 interpretability 10 gpu 10 text-mining 10 diffusion 10 bookmarks 10 operating-system 10 text-to-image 10 gpts 10 hacktoberfest2021 10 arduino 10 network 10 point-cloud 10 3d-graphics 10 model-compression 10 programming-languages 10 speech-processing 10 fuzzing 10 climate-change 10 rest-api 10 interview-questions 10 cv 10 evm 10 chatgpt-api 10 search-engine 10 movies 10 indonesia 10 webpack 10 yolo 10 vr 10 planning 10 writing 9 podcasts 9 system-design 9 ux 9 quantization 9 semantic-web 9 google 9 unsupervised-learning 9 cicd 9 k8s 9 microservices-architecture 9 unix 9 erlang 9 quantum-computing 9 generative-model 9 datascience 9 fairness 9 medical-imaging 9 webcomponents 9 reading-list 9 android-application 9 android-app 9 sre 9 book 9 cuda 9 augmented-reality 9 leetcode 9 simulation 9 application 9 in-context-learning 9 flask 9 reddit 9 sustainability 9 swift-library 9 cross-platform 9 npm 9 article 9 json 9 classification 9 hacking-tools 9 fpga 9 conference 9 benchmark 9 sentiment-analysis 9 social-network 9 ionic 9 applications 9 management 9 image-generation 9 ide 9 privacy-tools 9 time-series-analysis 9 jupyter-notebook 9 code-generation 9 authentication 9 anomaly-detection 9 students 9 trading 9 malware 9 edge-computing 9 explainable-ai 9 reference 9 open-science 9 large-language-model 9 developer 9 machine-learning-algorithms 9 infrastructure-as-code 8 earth-observation 8 korean 8 conferences 8 ui-components 8 leadership 8 linux-desktop 8 spring-boot 8 flutter-examples 8 knowledge-base 8 shell 8 curated-lists 8 swift-language 8 functional-programming 8 flutter-apps 8 adversarial-attacks 8 ubuntu 8 exploit 8 adversarial-machine-learning 8 lua 8 redux 8 cncf 8 paperlist 8 ruby-on-rails 8 chinese-translation 8 twitter 8 spark 8 virtual-reality 8 electronics 8 bots 8 3d-reconstruction 8 xai 8 es6 8 static-site-generator 8 geospatial 8 tracking 8 unreal-engine 8 bug-bounty 8 prometheus 8 incident-response 8 fonts 8 xcode 8 fintech 8 notes 8 websites 8 software-architecture 8 email 8