Meryem Arik shares best practices for self-hosting LLMs in corporate environments, highlighting the importance of cost efficiency and performance optimization. She details quantized models, batching, and workload optimizations to improve LLM serving. Insights cover model selection and infrastructure consolidation, emphasizing the differences between enterprise and large-scale AI lab deployments.
By Meryem Arik