StarTree, the cloud-based real-time analytics company, provides a unique combination of executing extremely low latency and high throughput analytical queries on data. The company has just announced multiple new features geared toward bolstering observability and anomaly detection capabilities. In this episode, Chinmay Soman, Head of Product at StarTree, discusses the company’s latest announcements and how they are helping to address some of the challenges around real-time analytics. He says, “Observability, in recent times, has become increasingly more complex and critical for most businesses. So there’s a huge amount of data generated in terms of the metrics, logs and traces that you need to analyze in real-time and then pinpoint issues.”

Real-time analytics platform for businesses, focusing on observability and anomaly detection

• There is a growing need for companies to provide real-time insights to customers and internal users. StarTree is a cloud-native real-time analytics platform that provides low latency and high throughput analytical queries on data.
• Soman discusses StarTree’s announcement of their new capabilities around observability and anomaly detection. He highlights its relevance for businesses due to the increasing complexity of data analysis.
• Soman explains how StarTree, which is built on top of Apache Pinot, can store vast amounts of data in a cost-effective way while integration with different visualization tools helps provide a comprehensive solution.
• The company has just announced the GA of StarTree ThirdEye, a new anomaly detection and root cause analysis tool, which uses statistical algorithms to accurately identify outliers and automate root cause analysis.
• Soman discusses two new features that have been announced: adding vector index support to Apache Pinot and introducing a new Write API to simplify data ingestion.

Challenges with existing observability and analytics tools, StarTree’s solution addresses pain points with scalability, cost, and flexibility

• Soman lays out some of the challenges organizations are facing with observability or analytics tools, citing data lock-in, network transfer costs, and scalability limitations.
• StarTree is solving these fundamental problems by providing a disaggregated platform where data can come from any source and integrating with various visualization tools to give users flexibility.
• Soman discusses StarTree’s unique deployment model, BYOC (Bring Your Own Cloud), which deploys software in the customer’s cloud account to reduce network transfer costs.
• Soman highlights StarTree’s cloud-tiered storage model which allows historical data to be stored in a cheaper object store like S3, while only fresh data is saved in StarTree. He explains how this enables seamless querying of all data without the need for external systems.

StarTree for real-time data processing and analysis

• Soman discusses how Third Eye aims to make anomaly detection less complex for users, highlighting its ability to automate anomaly detection and root cause analysis for time-series data in seconds, without needing a large team of data scientists.
• Soman explains how StarTree’s Cloud Write API helps simplify data integration and processing for users by eliminating the need for intermediate systems like Apache Kafka or S3.
• StarTree is committed to the open source community, prioritizing community benefits. Soman highlights examples such as adding native join capabilities to Apache Pinot and contributing vector index support for similarity search.

Guest: Chinmay Soman (LinkedIn)
Company: StarTree (Twitter)
Show: Let’s Talk

This summary was written by Emily Nicholls.