Red Hat has just released new updates in Red Hat AI, your portfolio of products and services designed to accelerate the development and deployment of AI solutions in the hybrid cloud. Red Hat AI offers an enterprise AI platform for model training and inference, providing more experience, flexibility and a simplified experience to deploy systems anywhere in the hybrid cloud
In the quest to reduce the implementation costs of large language models (LLMs) to meet a growing number of use cases, companies still face the challenge of integrating these systems with their proprietary data and accessing it from anywhere: whether in a datacenter, in the public cloud or even at the edge
Integrating both Red Hat OpenShift AI and Red Hat Enterprise Linux AI (RHEL AI), Red Hat AI addresses these concerns by providing an enterprise AI platform that enables the adoption of more efficient and optimized models, adjusted with the specific business data, with the possibility of being deployed in a hybrid cloud to train models across a wide range of computing architectures
For Joe Fernandes, vice president and general manager of the AI Business Unit at Red Hat, the update enables organizations to be precise and economical in their AI journeys. "Red Hat knows that companies will need ways to manage the rising cost of their generative AI deployments", as they bring more use cases for production and operate at scale.. Red Hat AI helps organizations address these challenges, allowing them to have more efficient models, developed for a purpose, trained with your data and that enable flexible inference in on-premises environments, of cloud and at the edge.”
Red Hat OpenShift AI
Red Hat OpenShift AI offers a comprehensive AI platform to manage the life cycles of predictive and generative AI (gen AI) in the hybrid cloud, including machine learning operations (MLOps) and Large Language Model Operations (LLMOps) capabilities. The platform provides features to build predictive models and adjust gen AI models, together with tools to simplify the management of AI models, from data science pipelines and models to model monitoring, governance and much more.
Latest version of the platform, Red Hat OpenShift AI 2.18, adds new updates and capabilities to support Red Hat AI's goal of bringing more optimized and efficient AI models to the hybrid cloud. The main features include
● Distributed serviceavailable through the vLLM inference server, the distributed service allows IT teams to split the model service across multiple graphics processing units (GPUs). This helps to relieve the load on a single server, accelerates training and fine-tuning and promotes more efficient use of computing resources, while helping to distribute the services among the nodes for AI models
● End-to-end model tuning experienceusing InstructLab and the data science pipelines of Red Hat OpenShift AI, this new feature helps to simplify the fine-tuning of LLMs, making them more scalable, efficient and auditable in large production environments, while providing management through the Red Hat OpenShift AI control panel
● AI GuardrailsRed Hat OpenShift AI 2.18 helps improve accuracy, the performance, the latency and transparency of LLMs through a preview of the AI Guardrails technology, that monitors and protects user input interactions and model outputs. AI Guardrails offers additional detection features to help IT teams identify and mitigate potentially hateful speech, abusive or profane, personally identifiable information, competitor data or others restricted by corporate policies
● Model evaluationusing the language model evaluation component (lm-eval) to provide important information about the overall quality of the model, model evaluation allows data scientists to compare the performance of their LLMs on various tasks, from logical and mathematical reasoning to adversarial natural language, helping to create more effective AI models, responsive and adapted
RHEL AI
Part of the Red Hat AI portfolio, RHEL AI is a foundational model platform for development, test and execute LLMs more consistently, with the aim of boosting business applications. The RHEL AI offers Granite LLM models and InstructLab model alignment tools, what are packages in a bootable image of Red Hat Enterprise Linux and can be deployed in the hybrid cloud
Released in February 2025, the RHEL 1.4 brought several improvements, including
● Support for the Granite 3 model.1 8Bas the latest addition to the Granite model family with open source license. O modelo adiciona suporte multilíngue para inferência e personalização de taxonomia/conhecimento (pré-visualização para desenvolvedores), in addition to a context window of 128k to improve the adoption of summarization results and Retrieval-Augmented Generation (RAG) tasks
● New graphical user interface to contribute with skills and prior knowledge, available in preview format for developers, with the aim of simplifying data consumption and fragmentation, as well as allowing users to add their own skills and contributions to AI models
● Document Knowledge-bench (DK-bench)to facilitate comparisons between AI models fine-tuned with relevant private data and the performance of the same base models that are not fine-tuned
Red Hat AI InstructLab on IBM Cloud
More and more, companies are seeking AI solutions that prioritize the accuracy and security of their data, while keeping costs and complexity as low as possible. The Red Hat AI InstructLab, available as a service on IBM Cloud, was designed to simplify, scale and help improve security in the training and deployment of AI systems. By simplifying the adjustment of models from InstructLab, organizations can build more efficient platforms, adapted to your unique needs, keeping control of your confidential information.
Free training on the Fundamentals of AI
AI is a transformative opportunity that is redefining how companies operate and compete. To support organizations in this dynamic scenario, Red Hat offers free online training on AI Fundamentals. The company is offering two learning certificates in AI, aimed at both experienced senior leaders and beginners, helping to educate users of all levels on how AI can help transform business operations, streamline decision-making and drive innovation
Availability
Red Hat OpenShift AI 2.18 and the Red Hat Enterprise Linux AI 1.4 are already available. More information about additional resources, improvements, bug fixes and how to update your version of Red Hat OpenShift AI to the latest can be foundhere,and the latest version of RHEL AI can be foundhere.
The Red Hat AI InstructLab on IBM Cloud will be available soon. The training on Red Hat's AI Fundamentals is now available for customers
