AI/MLCloud Native ComputingDevelopersDevOpsFeaturedLet's TalkOpen SourceVideo

Memphis.dev Cloud Aims To Help Developers Reach Day-2 Operations Quicker

0

Guest: Yaniv Ben Hemo (LinkedIn)
Company: Memphis.dev (Twitter)
Show: Let’s Talk

Memphis is an open source project, conceived by Memphis.dev that aims to solve some of the biggest challenges in the data streaming space today. The company has also announced a new product, Memphis.dev Cloud, that helps developers get to Day-2 operations quicker and more effectively. 

In this episode of TFiR: Let’s Talk, Swapnil Bhartiya sits down with Yaniv Ben Hemo, Co-Founder and CEO at Memphis.dev, to talk about their new open-source project. He goes on to talk about some of the key trends they are seeing with data streaming and the challenges that Memphis.dev is working to solve. 

  • Ben Hemo explains that data streaming is a complicated domain, with the message broker being a key component in the data engineering landscape. He talks about how it is the backbone behind real-time data streaming nowadays; yet current technologies in the market come with numerous challenges, which Memphis.dev aims to solve. 
  • Many of the use cases that utilized batch methodologies are now moving toward streaming methodologies due to the growth of data as well as use cases that comprise event-driven architecture. Ben Hemo goes on to discuss the impact of wanting to have faster responses and for ML to learn faster is having the need for real-time data. 
  • Memphis.dev prides itself on being an open-source-first company and has come from contributing to different open-source projects to now opening their own core product up to the community. Ben Hemo talks about this decision and the benefits of being able to grow out of the community. 
  • Memphis.dev released their GA version of the open-source project in April 2023 and already it has achieved over 80 contributors over 5,000 deployments and has 2.7k stars on GitHub. Ben Hemo shares their most critical KPI – that the community can go from deployment to data ingestion on average in five minutes. 
  • Ben Hemo takes us through the role they are playing in supporting the project. He talks about how with Day-1 operations everything comes out of the box, but with Day-2 operations all the features you need to build streaming pipelines and real-time features are embedded within the platform itself. 
  • Memphis.dev has also announced Memphis.dev Cloud which aims to help developers reach Day-2 operations quickly and reliably. Ben Hemo discusses how their products can enhance existing event streaming platforms by taking the Day-2 operations out of Memphis and putting them on top of existing technologies. 
  • Ben Hemo goes through some of the core features of Memphis.dev Cloud, saying it supports all the SaaS platforms and architectures for a true multi-tenant environment. He discusses how a multi-cloud approach is one of the biggest challenges in data streaming and data at a massive scale and how Memphis is enabling this with its cloud. 
  • Data management and data governance has experienced a significant boom in the past couple of years as we move further into a data-driven world. Ben Hemo talks about how the advancements in the data domain are enabling what we are seeing in AI and machine learning functions and implementations. 
  • Ben Hemo shares what to expect from Memphis.dev in the future, saying they will be bringing out a game-changing feature into string processing that will combine AI into it. He discusses the benefits it will bring to further reducing the time from deployment to success or data ingestion.  

This summary was written by Emily Nicholls.