Nutanix has launched the Nutanix GPT-in-a-Box solution for customers looking to jump-start their AI/ML innovation, while maintaining control over their data. The new offering is a full-stack software-defined AI-ready platform, along with services to help organizations size and configure hardware and software infrastructure suitable to deploy a curated set of large language models (LLMs) using the leading open source AI and MLOps frameworks on the Nutanix Cloud Platform.

It allows customers to easily procure AI-ready infrastructure to fine-tune and run generative pre-trained transformers (GPT), including LLMs at the edge or in their datacenter.

“Helping customers tackle the biggest challenges they face in IT is at the core of what we do, from managing increasing multicloud complexity, to data protection challenges, and now adoption of generative AI solutions while keeping control over data privacy and compliance,” said Thomas Cornely, SVP, Product Management at Nutanix. “Nutanix GPT-in-a-Box is an opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption and help jump-start AI innovation.”

The Nutanix GPT-in-a-Box solution delivers ready-to-use customer-controlled AI infrastructure for the edge or the core data center and allows customers to run and fine-tune AI and GPT models while maintaining control over their data. Nutanix provides a full complement of security and data protection offerings ideal for AI data protection.

This new solution includes:

• The Nutanix Cloud Infrastructure platform, with the Nutanix Files Storage and Objects Storage solutions, the Nutanix AHV hypervisor and Kubernetes, along with NVIDIA GPU acceleration, which can be sized for large to small scale.
• Nutanix services to help customers size their cluster and deploy an opinionated stack with the leading open source deep learning and MLOps frameworks, inference server, and a curated set of large language models such as Llama2, Falcon and MPT.
• Ability for data scientists and ML administrators to immediately consume these models with their choice of applications, enhanced terminal UI, or standard CLI.
• The platform can also be leveraged to run other GPT models, as well as fine tune these models leveraging internal data, hosted on included Nutanix Files or Objects Storage services.

The Nutanix GPT-in-a-Box solution is now available.