Red Hat has announced the latest updates to Red Hat AI, its enterprise AI platform designed to accelerate AI model development and deployment across the hybrid cloud. Red Hat OpenShift AI 2.18 and Red Hat Enterprise Linux AI 1.4 are now generally available, introducing new capabilities to enhance AI efficiency, security, and model management. Additionally, Red Hat AI InstructLab on IBM Cloud will soon be available, and Red Hat is offering no-cost AI Foundations training courses.

Key Updates in Red Hat OpenShift AI 2.18:

• Distributed serving: Enabled through the vLLM inference server, this feature allows IT teams to split model serving across multiple GPUs, optimizing compute resources and improving model performance.
• End-to-end model tuning experience: Utilizing InstructLab and OpenShift AI data science pipelines, this enhancement simplifies large-scale fine-tuning and management of LLMs.
• AI Guardrails (Technology Preview): Provides safeguards to monitor model interactions and mitigate harmful or restricted content in AI outputs.
• Model evaluation: Uses the lm-eval component to benchmark AI model performance across logical reasoning, adversarial language tasks, and more.

Enhancements in Red Hat Enterprise Linux AI 1.4:

• • Granite 3.1 8B model support: Offers multilingual support, taxonomy customization, and a 128k context window for improved AI performance.
  • New graphical user interface: Enables easier data ingestion, skill contributions, and model interaction.
  • Document Knowledge-bench (DK-bench): Allows enterprises to compare fine-tuned AI models against base models for performance analysis.

Red Hat AI InstructLab on IBM Cloud: This service provides enterprises with a streamlined, scalable AI model tuning experience while prioritizing security and data control. Organizations can build efficient AI models tailored to their specific needs with reduced cost and complexity.

No-Cost AI Foundations Training: To support enterprises in adopting AI, Red Hat is offering free AI Foundations training courses. These courses provide AI education for all experience levels, from senior leaders to AI novices, helping organizations understand how AI can optimize business operations and drive innovation.

Red Hat OpenShift AI 2.18 and Red Hat Enterprise Linux AI 1.4 are now generally available. More information on additional features, improvements, bug fixes and how to upgrade to the latest version of Red Hat OpenShift AI can be found here and the latest version of RHEL AI can be found here.