Study on the Implementation of AI Inference Services in a Business Environment

Abstract

[Abstract] Diffusion-based generative models, such as Stable Diffusion, have revolutionized the generation of images from textual descriptions. However, their high computational cost represents an obstacle in production environments. This work analyzes strategies for their efficient and reproducible deployment in scalable clusters, with the technical support and resources provided by the company. The study is conducted in a real corporate context, where these models are already being used to accelerate design processes and optimize key stages of the value chain. To achieve this, different inference service strategies are compared in terms of latency, GPU utilization, and integration capabilities.