Red Hat has just released new updates on Red Hat AI, its portfolio of products and services designed to speed up the development and deployment of AI solutions in the hybrid cloud. Red Hat AI offers a business AI platform for model training and inference, providing more experience, flexibility and a simplified experience to deploy systems anywhere in the hybrid cloud.
In the quest to reduce the costs of implementing large language models (LLMS) to meet an increasing number of use cases, companies still face the challenge of integrating these systems with their proprietary data and accessing them from anywhere: whether in a datacenter, in the public cloud or even in the Edge.
Integrating both Red Hat OpenShift AI and Red Hat Enterprise Linux AI (RHEL AI), Red Hat AI responds to these concerns by providing a business AI platform that allows adopting more efficient and optimized models, adjusted with specific data from the business, with the possibility of being deployed in the hybrid cloud to train models in a wide range of computing architectures.
For Joe Fernandes, vice president and general manager of the AI Business Unit of Red Hat, the update makes it possible for organizations to be precise and economical in their AI journeys. “Red Hat knows that companies will need ways to manage the increasing cost of their generative AI deployments as they bring more use cases to production and operate at scale. They have more efficient models, developed for a purpose, trained with their data and that enable flexible inference in on-premises, cloud and Edge environments.”
red hat openshift there
Red Hat OpenShift AI offers a complete AI platform to manage predictive and generative AI lifecycles (Gen AI) in the hybrid cloud, including machine learning operations (mlops) and large language model capabilities. operations (llmops). The platform provides features to build predictive models and adjust Gen AI models, along with tools to simplify AI model management, from data science and model pipelines to model monitoring, governance and more.
Latest version of the platform, Red Hat OpenShift AI 2.18 adds new updates and capabilities to support Red Hat AI’s goal of bringing more optimized and efficient AI models to the hybrid cloud. The main features include:
● distributed service: Available through the VLLM inference server, the distributed service allows IT teams to divide the model service across multiple graphics processing units (GPUs). This helps relieve load on a single server, speeds up training and fine-tuning and promotes more efficient use of computing resources while helping to distribute services across nodes to AI models.
● End-to-end model fitting experience: Using the InstructLab and Red Hat OpenShift AI data science pipelines, this new feature helps simplify the fine tuning of the LLMs, making them more scalable, efficient and auditable in large production environments, while delivering Management through the Red Hat OpenShift AI control panel.
● oh guardrails: Red Hat OpenShift AI 2.18 helps to improve the accuracy, performance, latency and transparency of LLMs through a preview of AI Guardrails technology, which monitors and protects user input interactions and outputs of the model. AI Guardrails provides additional detection resources to help IT teams identify and mitigate potentially hateful, abusive or profane speeches, identifiable personal information, competitor data, or other corporate policies restricted.
● Model Evaluation: Using the Language Model Evaluation Component (LM-Eval) to provide important information about the overall quality of the model, the model evaluation allows data scientists to compare the performance of their LLMs in various tasks, from logical and mathematical reasoning to the natural adversarial language, Helping to create more effective, responsive and adapted AI models.
rhel there
Part of the Red Hat AI portfolio, RHEL AI is a platform of fundamental models for developing, testing and running LLMs more consistently, with the aim of boosting business applications. RHEL AI offers Granite LLMS models and InstructLab model alignment tools, which are packages in a Red Hat Enterprise Linux bootable image and can be deployed to the hybrid cloud.
Launched in February 2025, RHEL 1.4 brought several improvements, including:
● Granite 3.1 8B model support as the latest addition to the family of Granite models with an open source license. The model adds multilingual support for taxonomy/knowledge inference and customization (preview for developers), as well as a 128K context window to improve the adoption of summarization results and retrieval-augmented tasks Generation (Rag)
● new graphical user interface to contribute with Abilities and prior knowledge, available in the preview format for developers, with the aim of simplifying data consumption and fragmentation, as well as allowing users to add their own skills and contributions to AI models.
● Document Knowledge-Bench (DK-Bench) To facilitate comparisons between AI models adjusted with relevant private data with the performance of the same non-adjusted base models.
Red Hat AI InstructLab on IBM Cloud
Increasingly, companies are looking for AI solutions that prioritize the accuracy and security of their data, while keeping costs and complexity as low as possible. Red Hat AI InstructLab, available as a service on IBM Cloud, is designed to simplify, scale, and help improve security in training and deploying AI systems. By simplifying the tuning of InstructLab models, organizations can build more efficient platforms, tailored to their unique needs while maintaining control of their confidential information..
Free training on the fundamentals of AI
AI is a transformative opportunity that is redefining how companies operate and compete. To support organizations in this dynamic scenario, Red Hat offers free online training on AI fundamentals. The company is offering two AI learning certificates, aimed at both senior leaders and beginners, helping to educate users at all levels on how AI can help transform business operations, streamline decision-making and drive innovation.
Availability
Red Hat OpenShift AI 2.18 and Red Hat Enterprise Linux AI 1.4 are now available. More information about additional features, improvements, bug fixes and how to upgrade your version of Red Hat OpenShift AI to the latest can be found here, e the latest version of RHEL AI can be found here.
Red Hat AI InstructLab on IBM Cloud will be available soon. Red Hat’s AI fundamentals training is now available to customers.
