paper
arXiv cs.CL
November 9th, 2026 at 5:00 AM

Large Language Model Deployment on Resource-Constrained Edge Devices: A Practitioners Survey

arXiv:2611.09075v1 Announce Type: cross Abstract: Large Language Models (LLMs) have transformed many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. Although LLMs have demonstrated impressive capabilities in various applications, the next challenge is deploying these models on resource-limited edge devices. Recent innovations in software optimizations and specialized hardware have made it feasible to deploy LLMs on edge devices. Edge deployment offers benefits including local data processing, cost savings, reduced latency, and personalized responses. This paper reviews the latest techniques that make the deployment of LLMs on edge devices feasible.

#ai
#llm
#research

Get stories like this every Monday

The week's most important AI news in one email. Free, unsubscribe anytime.

Score: 2.88

Engagement proxy: 0

Canonical link: https://arxiv.org/abs/2611.09075