Cloudera, a leading data company for trusted enterprise AI, has announced its expanded collaboration with NVIDIA. The partnership aims to integrate enterprise-grade NVIDIA NIM microservices into Cloudera Machine Learning, a Cloudera Data Platform service for AI/ML workflows. The integration will deliver fast, secure, and simplified end-to-end generative AI workflows in production.
Empowering Generative AI Workflows
The collaboration between Cloudera and NVIDIA will leverage NVIDIA NIM and NeMo Retriever microservices. These microservices enable developers to link AI models to business data, such as text, images, and visualizations, for generating highly accurate, contextually relevant responses. By integrating NVIDIA microservices, Cloudera Machine Learning aims to empower customers to unleash the value of their enterprise data by bringing high-performance AI workflows and accelerated computing to their data, wherever it resides.
Enhanced Model Inference Performance
Cloudera Machine Learning will integrate model and application serving powered by NVIDIA microservices to boost model inference performance across all workloads. With this new AI model-serving functionality, customers can achieve fault-tolerance, low-latency serving, and auto-scaling for models deployed anywhere, from both public and private clouds.
Simplified Connection of Custom LLMs to Enterprise Data
Additionally, Cloudera Machine Learning will offer integrated NVIDIA NeMo Retriever microservices to simplify the connection of custom Large Language Models (LLMs) to enterprise data. This capability will enable users to build retrieval-augmented generation (RAG)-based applications for production use.
Priyank Patel, Vice President of AI/ML Products at Cloudera:
“Cloudera is integrating NVIDIA NIM and CUDA-X microservices to power Cloudera Machine Learning, helping customers turn AI hype into business reality. In addition to delivering powerful generative AI capabilities and performance to customers, the results of this integration will empower enterprises to make more accurate and timely decisions while also mitigating inaccuracies, hallucinations, and errors in predictions — all critical factors for navigating today’s data landscape.”
Justin Boitano, Vice President of Enterprise Products at NVIDIA:
“Enterprises are eager to leverage their massive volumes of data for generative AI to build custom copilots and productivity tools. The integration of NVIDIA NIM microservices into the Cloudera Data Platform offers developers a way to more easily and flexibly deploy LLMs to drive business transformation.”
Conclusion
The collaboration between Cloudera and NVIDIA aims to enable organizations to more quickly and intuitively build, customize, and deploy LLMs for transformative generative AI applications. These innovations are set to maximize time-to-business value by making data and advanced AI processes easier and faster across the enterprise.