Zetaris, a provider of AI-powered Lakehouse solutions, recently announced the Zetaris Lightning Catalog, an open-source product poised to redefine the landscape of data management and analytics on the Apache Spark ecosystem. The release is available globally and in Australia and underlines efforts to drive forward the Apache Spark ecosystem. Zetaris Lightning Catalog is a significant addition to Apache Spark, promising enhanced usability and transformative capabilities for enterprise data projects.

Vinay Samuel, CEO of Zetaris, said, “Zetaris, in collaboration with NVIDIA, is proud to contribute Zetaris Lightning to the Apache Spark ecosystem, enhancing its usability for enterprise data projects. This launch underscores Zetaris’ commitment to driving innovation and fostering collaboration within the open-source community.”

Benefits include:

• Lightning catalog: Engineered as a fast, lightweight, and intuitive Spark-based data catalog, Lightning Catalog simplifies data preparation for ad-hoc analytics, data warehousing, lake-house, and machine learning (ML) endeavours. Its seamless navigation and query capabilities enable users to effortlessly explore their data landscape, extracting valuable insights with ease. This pre-built Spark “add-on” significantly reduces the need for complex data management and access coding, benefiting Spark developers and data engineers alike.
• Data migration and federation: Zetaris Lightning facilitates seamless data access by empowering users to connect to data sources and query them in-place, regardless of their location. Moreover, it streamlines data migration tasks while ensuring business continuity through a combination of migration and federation strategies. Offering robust capabilities, Zetaris Lightning enables organisations to execute data migration tasks efficiently while preserving data integrity and reliability.
• Unified semantic model: By offering a comprehensive view of all data assets transformed into a standardized business language, Zetaris Lightning eliminates data silos and inconsistencies. This holistic understanding of data empowers organisations to make well-informed decisions based on accurate insights.
• Efficiency for machine learning engineers: Lightning Catalog reduces the data preparation workload for machine learning engineers, allowing them to focus on model building and refinement. Automation of mundane tasks and streamlined workflows accelerate the development and deployment of machine learning solutions.
• Simplified data engineering lifecycle: Zetaris Lightning simplifies the entire data engineering pipeline lifecycle, leveraging innovative Data Flow Table technology. Organisations can streamline processes and drive efficiency across all stages of the data lifecycle, from ingestion to consumption.

Zetaris Lightning is now available for download from the Zetaris website, providing organisations in Australia with a powerful platform to harness the full power of their data.