C++ 5 Python 3

Efficient Architectures for On-Device LLMs 13 Hardware Acceleration and Deployment Strategies 11 Model Reference 11 Foundations and Preliminaries 10 Model Compression and Optimization Techniques for On-Device LLMs 8 Applications 5 Tutorials and Learning Resources 5

Hardware Acceleration 23 Popular On-Device LLMs Framework 9 The Performance Indicator of On-Device LLMs 6 Evolution of On-Device LLMs 5 Quantization 4 Mixture-of-Experts (MoE) Architectures 3 Limitations of Cloud-Based LLM Inference and Advantages of On-Device Inference 2 General Efficiency and Performance Improvements 2 Low-Rank Factorization 2 Pruning 1 Knowledge Distillation 1 Hybrid Architectures 1 Collaborative and Hierarchical Model Approaches 1 Memory and Computational Efficiency 1 LLM Architecture Foundations 1 Model Compression and Parameter Sharing 1

llama 4 deep-learning 3 llm 3 machine-learning 3 inference 2 large-language-models 2 local-inference 1 embedded 1 gpu 1 mobile 1 neural-network 1 tensor 1 android 1 audio-processing 1 c-plus-plus 1 calculator 1 computer-vision 1 framework 1 llm-inference 1 falcon 1 bamboo-7b 1 winograd-algorithm 1 vulkan 1 mnn 1 ml 1 embedded-devices 1 deep-neural-networks 1 convolution 1 arm 1 ggml 1 multimodal 1 xpu 1 transformer 1 trainium 1 tpu 1 rocm 1 qwen 1 pytorch 1 model-serving 1 mlops 1 llmops 1 llm-serving 1 inferentia 1 hpu 1 gpt 1 deepseek 1 cuda 1 amd 1 tvm 1 machine-learning-compilation 1