← ALB News · curated headline

Towards Sustainable Large Language Model Inference: A Systematic Literature Review

arXiv Software Engineering · WORLD · Compilers · 11/17/2026, 12:00:00 AM

arXiv:2611.18570v1 Announce Type: new Abstract: Large language model (LLM) inference is becoming a significant contributor to both operational cost and environmental impact in modern AI deployments. Energy consumption during inference depends on multiple factors across the pipeline, including input and output length, model design, system-level decisions, and hardware characteristics. This paper presents a systematic literature review (SLR) of energy-efficient and sustainable LLM inference. We analyze selected primary studies to identify techniques proposed to reduce energy consumption across different levels of the inference pipeline, including input, model, system, and hardware. We further examine the trade-offs between energy consumption, latency, and accuracy, highlighting inconsistencies in how these relationships are evaluated. In addition, we review the tools, datasets, and metrics used for energy measurement, covering both software-based and hardware-based approaches. This survey provides a comprehensive synthesis of existing literature, offering insights into the effectiveness of different techniques in terms of energy savings and their associated impact on accuracy. It highlights the trade-offs between energy efficiency and performance and identifies limitations in current evaluation practices. Overall, this work aims to support future research toward more efficient and environmentally responsible deployment of LLMs. Our repository of relevant references is maintained on GitHub.

Continue to arXiv Software Engineering →

You are being forwarded in 6s — stay on this page