C++ 4 Python 3 JavaScript 1

Efficient Architectures for On-Device LLMs 13 Model Reference 11 Hardware Acceleration and Deployment Strategies 10 Foundations and Preliminaries 10 Model Compression and Optimization Techniques for On-Device LLMs 8 Tutorials and Learning Resources 7 Applications 5

Hardware Acceleration 25 Popular On-Device LLMs Framework 8 The Performance Indicator of On-Device LLMs 6 Evolution of On-Device LLMs 5 Quantization 4 Mixture-of-Experts (MoE) Architectures 3 Limitations of Cloud-Based LLM Inference and Advantages of On-Device Inference 2 General Efficiency and Performance Improvements 2 Low-Rank Factorization 2 Pruning 1 Knowledge Distillation 1 Hybrid Architectures 1 Collaborative and Hierarchical Model Approaches 1 Memory and Computational Efficiency 1 LLM Architecture Foundations 1 Model Compression and Parameter Sharing 1

deep-learning 4 machine-learning 4 llama 3 llm 3 large-language-models 2 inference 2 hpu 1 inferentia 1 llm-serving 1 llmops 1 mlops 1 model-serving 1 pytorch 1 qwen 1 rocm 1 tpu 1 trainium 1 transformer 1 xpu 1 android 1 gpt 1 deepseek 1 cuda 1 amd 1 tvm 1 machine-learning-compilation 1 language-model 1 winograd-algorithm 1 vulkan 1 mnn 1 ml 1 embedded-devices 1 deep-neural-networks 1 convolution 1 local-inference 1 embedded 1 gpu 1 mobile 1 neural-network 1 tensor 1 multimodal 1 artificial-intelligence 1 cloud-ml 1 computer-systems 1 courseware 1 edge-machine-learning 1 embedded-ml 1 machine-learning-systems 1 mobile-ml 1 textbook 1