Red Hat powers enterprise AI in hybrid cloud with Red Hat AI

Red Hat has just released new updates to Red Hat AI, its portfolio of products and services designed to accelerate the development and deployment of AI solutions in the hybrid cloud.Red Hat AI provides an enterprise AI platform for model training and inference, providing more experience, flexibility, and a streamlined experience for deploying systems anywhere in the hybrid cloud.

In the quest to reduce the costs of implementing large language models (LLMS) to meet an increasing number of use cases, companies still face the challenge of integrating these systems with their proprietary data and accessing them from anywhere: whether in a datacenter, in the public cloud or even at the edge.

Integrating both Red Hat OpenShift AI and Red Hat Enterprise Linux AI (RHEL AI), Red Hat AI addresses these concerns by providing an enterprise AI platform that enables you to adopt more efficient and optimized models, tuned with business-specific data, with the possibility of being deployed in the hybrid cloud to train models across a wide range of computing architectures.

For Joe Fernandes, vice president and general manager of the Red Hat AI Business Unit, the update enables organizations to be accurate and cost-effective in their AI journeys. “ Red Hat knows that companies will need ways to manage the rising cost of their generative AI deployments as they bring more use cases to production and operate at scale. Red Hat AI helps organizations address these challenges by enabling them to have more efficient, purpose-built models trained with their data and enabling flexible inference in on-premises, cloud and edge environments.”.

Red Hat OpenShift AI

Red Hat OpenShift AI provides a complete AI platform to manage the life cycles of predictive and generative AI (gen AI) in the hybrid cloud, including machine learning operations (MLOps) and Large Language Model Operations (LLMOps) capabilities. The platform provides functionality to build predictive models and fine-tune gen AI models, along with tools to simplify the management of AI models, from data science pipelines and models to model monitoring, governance, and more.  

The latest version of the platform, Red Hat OpenShift AI 2.18, adds new updates and capabilities to support Red Hat AI's goal of bringing more optimized and efficient AI models to the hybrid cloud

'''      Distributed service: available through the vLLM inference server, the distributed service allows IT teams to split the model service between multiple graphics processing units (GPUs). This helps lighten the load on a single server, speeds up training and fine-tuning, and promotes more efficient use of compute resources, while helping to distribute services between nodes for AI models.

'''      Experience of end-to-end model adjustment: using InstructLab and Red Hat OpenShift AI data science pipelines, this new feature helps simplify fine-tuning LLMs, making them more scalable, efficient, and auditable in large production environments, while delivering management through the Red Hat OpenShift AI control panel.

'''      AI Guardrails: Red Hat OpenShift AI 2.18 helps improve the accuracy, performance, latency, and transparency of LLMs through a preview of AI Guardrails technology, which monitors and protects user input interactions and model outputs. AI Guardrails provides additional detection capabilities to help IT teams identify and mitigate potentially hateful, abusive, or profane speech, personally identifiable information, competitor data, or other corporate policy constrained speech.

'''      Model assessment: using the language model assessment component (lm-eval) to provide important information about the overall quality of the model, model assessment allows data scientists to compare the performance of their LLMs across a range of tasks, from logical and mathematical reasoning to adversarial natural language, helping to create more effective, responsive and tailored AI models.

RHEL

Part of the Red Hat AI portfolio, RHEL AI is a fundamental model platform for developing, testing, and running LLMs more consistently, with the goal of driving enterprise applications.RHEL AI offers Granite LLM models and InstructLab model alignment tools, which are packages in a Red Hat Enterprise Linux bootable image and can be deployed in the hybrid cloud.

Released in February 2025, RHEL 1.4 brought several improvements, including:

'''      Support model Granite 3.1 8B as the latest addition to the open source Granite model family, the model adds multilingual support for taxonomy/knowledge inference and customization (preview for developers), plus a 128k context window to improve the adoption of summarization results and Retrieval-Augmented Generation (RAG) tasks

'''      New graphical user interface to contribute previous skills and knowledgeavailable in developer preview format, with the goal of simplifying data consumption and fragmentation, as well as allowing users to add their own skills and contributions to AI models.

'''      Document Knowledge-bench (DK-bench) to facilitate comparisons between adjusted AI models with relevant private data with the performance of the same unadjusted base models.

Red Hat AI InstructLab on IBM Cloud

Increasingly, businesses are looking for AI solutions that prioritize the accuracy and security of their data while keeping costs and complexity as low as possible. Red Hat AI InstructLab, available as a service on IBM Cloud, is designed to simplify, scale, and help improve security in training and deploying AI systems. By simplifying the tuning of InstructLab models, organizations can build more efficient platforms tailored to their unique needs while maintaining control of their sensitive information. 

Free training on the Fundamentals of AI

AI is a transformative opportunity that is redefining how companies operate and compete. To support organizations in this dynamic landscape, Red Hat offers free online training on AI Fundamentals.The company is offering two AI learning certificates, aimed at both experienced senior leaders and beginners, helping educate users at all levels on how AI can help transform business operations, streamline decision making, and drive innovation.

Availability

Red Hat OpenShift AI 2.18 and Red Hat Enterprise Linux AI 1.4 are now available. More information on additional features, improvements, bug fixes, and how to update your version of Red Hat OpenShift AI to the latest can be found here, and the latest version of RHEL AI can be found here.

Red Hat AI InstructLab on IBM Cloud will be available soon. Red Hat AI Fundamentals training is now available to customers.