InsightAI & data
llm-d 1.0 targets production-scale LLM inference
The llm-d project released version 1.0, an open-source system intended to improve the efficiency and scalability of large language model inference. The project is governed by the Cloud Native Computing Foundation and backed by infrastructure and technology companies including Red Hat, IBM, Google Cloud, CoreWeave, and NVIDIA.
IBM NewsroomRead at source ↗