Darius Baruo
Apr 09, 2025 07:18
NVIDIA and Rafay are collaborating to reinforce AI workloads with superior accelerated computing options, specializing in enterprise AI infrastructure and self-service platforms.
The worldwide demand for generative AI has considerably elevated the necessity for accelerated computing {hardware}, prompting enterprises to deploy superior non-public cloud infrastructure. This surge has led to the emergence of GPU cloud suppliers or AI clouds, which provide accelerated compute capability for AI workloads, based on NVIDIA.
Self-Service AI Infrastructure
Builders and information scientists now demand seamless, self-service entry to compute sources, avoiding delays from conventional programs. Cloud suppliers are thus prioritizing self-service workflows to optimize GPU infrastructure utilization. NVIDIA AI Enterprise accelerates AI workloads by offering safe microservices for mannequin deployment in self-service environments.
Challenges in GPU PaaS Improvement
Constructing a production-ready GPU PaaS platform includes steady growth, help, and safety upkeep. Infrastructure software program distributors like Rafay supply essential help by offering ready-to-deploy PaaS options for GPU-powered environments, facilitating innovation in enterprise non-public clouds and cloud suppliers.
Rafay’s Position in AI Infrastructure
The Rafay Platform permits enterprises to ship a self-service PaaS for AI infrastructure with enterprise-grade controls. Designed for NVIDIA accelerated computing, it helps NVIDIA AI Enterprise and varied AI fashions and frameworks, offering a complete platform for AI growth and mannequin coaching.
Integration with NVIDIA AI Enterprise
Rafay facilitates instruments for constructing AI brokers, akin to NVIDIA NIM and NeMo, as a part of NVIDIA AI Enterprise’s production-ready deployments. The platform additionally permits cloud suppliers to supply extra AI companies by its Surroundings Administration layer.
Enterprises can leverage Rafay to handle infrastructure, supply compute companies, and deploy AI instruments in a self-service method. The platform’s options embody SKU automation, self-service portals, enterprise-grade consumer administration, and Kubernetes cluster lifecycle administration.
Regional Implementation and Influence
Regional cloud suppliers like Lintasarta in Indonesia plan to make use of the Rafay Platform to supply PaaS capabilities for AI inferencing and coaching workloads. Vikram Sinha, CEO of Indosat Ooredoo Hutchinson, emphasised their collaboration with NVIDIA and Rafay in defining PaaS necessities for AI functions.
Total, the Rafay Platform addresses the calls for of AI workloads by providing a production-ready PaaS answer, combining NVIDIA’s accelerated computing infrastructure with its platform capabilities to cut back time-to-market for AI initiatives.
For extra data, go to the NVIDIA weblog.
Picture supply: Shutterstock
