Skip to main content
Infinetix
Book a demo
All news & events
InsightAI & data

llm-d 1.0 targets production-scale LLM inference

The llm-d project released version 1.0, an open-source system intended to improve the efficiency and scalability of large language model inference. The project is governed by the Cloud Native Computing Foundation and backed by infrastructure and technology companies including Red Hat, IBM, Google Cloud, CoreWeave, and NVIDIA.

IBM NewsroomRead at source ↗

Comments

Anonymous

Comments are reviewed before they appear.

Related