Search

Saved articles

You have not yet added any article to your bookmarks!

Browse articles
About Us

Artificial intelligence in Sustainable Model No.4 Model Compensation

Bhubaneswar(23/06/2026): Model compression is a set of techniques used to reduce the size, memory footprint, and computational complexity of machine learning models.
These methods enable AI systems to run faster and on resource-constrained hardware (like mobile devices or edge servers) while maintaining high accuracy. Model compression in AI enables complex models to run efficiently on resource-constrained edge devices and lowers the high operational costs of cloud-based AI serving.
Core Compression Techniques: 1.Quantization.. How it works: Converts the weights and activations of a model from high-precision formats (like 32-bit floating-point) to lower-precision formats (like 16-bit, 8-bit, or even 4-bit integers). Benefits: Drastically reduces memory usage and speeds up computation, as lower-precision math requires less processing power.
2.Pruning.. How it works: Removes redundant, less important, or non-contributing parameters (weights or neurons) from the neural network entirely. Benefits: Creates a sparser network, requiring fewer calculations and less storage space without significantly degrading model performance.
3.Knowledge Distillation.. How it works: A large, highly accurate "teacher" model trains a smaller, more compact "student" model.
The student learns to imitate the teacher’s behavior rather than learning from scratch.
Benefits: Allows the smaller model to capture the generalization capabilities of the larger one, yielding better performance than a standalone small model.
4.Low-Rank Factorization.. How it works: Uses techniques like Singular Value Decomposition (SVD) to break down large, multi-dimensional weight matrices into smaller, simpler matrices. Benefits: Eliminates redundant calculations within layers, saving both computational time and storage space. Courtesy: B-School Forum SDAR IIT-BHUBANESWAR RESEARCH AND ENTREPRENEURSHIP PARK www.unimindinfotech.com. By Frts.Gautam Mohanty Management Analyst and Author, Bhubaneswar.

Visit Our Odia News Site

Odia News Logo