Redpanda acquires Benthos to expand its end-to-end streaming data platform

Comment
Redpanda, the well-funded Kafka-compatible streaming data platform that competes with the likes of Confluent, on Thursday announced that it has acquired open source stream-processing platform Benthos.
The two companies did not disclose the purchase price, but it’s worth noting that Redpanda raised a $100 million Series C round a year ago that now allows it to make these kinds of moves. This marks Redpanda’s second acquisition after acquiring CloudHut, which built a web-based user interface for streaming data platforms, in 2022.
Benthos helps enterprises with common data engineering tasks like setting up pipelines to connect over 200 data sources and services and transform and filter their data streams in the process to enable real-time applications. One of the company’s most recent launches is Benthos Studio, a low-code interface for building data pipelines and transformations.
Redpanda CEO Alexander Gallego told me that this acquisition now completes Redpanda’s platform. “What Benthos does for us is that it creates the most complete end-to-end streaming platform for data-intensive applications,” he said. “Benthos and Redpanda is the only product at a technical level that can be deployed from edge devices […] all the way to the largest cloud workloads.” That’s because Benthos is delivered as a single binary that can run on low-powered devices with just a few megabytes of memory and on the most powerful servers. “It is the same software stack end-to-end, regardless of how you choose to use it.”
Gallego noted that close to a third of Redpanda users were already Benthos users, and he said he has known Benthos founder Ashley Jeffs for about five years now. The fact that Benthos is written in Go, just like parts of the Redpanda platform, also helped seal the deal, given that it makes integrating the service quite a bit easier. He also stressed that trying to build a product like Benthos from scratch would be a heavy lift for any company; thanks to its most recent funding round, Redpanda decided to acquire Benthos.
Indeed, Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service. Redpanda Connect will feature 220 pre-built connectors to help engineers quickly build their streaming in data transformation pipelines. Redpanda Connect — just like Benthos — is open source and available from the Redpanda GitHub repo (with the exception of the two previously mentioned connectors).
One of Redpanda’s reference customers for the new service is Zafin, which helps banks modernize their data platforms. “At the heart of Zafin IO is a Streaming ETL capability based on Redpanda,” said Zafin CTO Shahir Daya. “With Redpanda’s acquisition of Benthos, Redpanda Connect will enable Zafin IO to ingest data from a broad variety of systems efficiently without any unnecessary hops, process it in real time and deliver it to the target system, be it the Zafin platform or other modernized system.”
It’s also worth noting that now, more than in recent years, enterprises are trying to consolidate where they spend their money, so being able to offer an end-to-end platform is an advantage in today’s market where point solutions often struggle to gain traction.
Existing Benthos users and customers won’t see any immediate changes to their existing workflows, but Gallego did stress that Redpanda is making the previously open source Snowflake and Splunk API integrations a paid service (the existing open source integrations will continue to work, but they won’t get updates from Redpanda going forward). “All the users that are using those services are used to paying for the integration with those services,” Gallego told me. “So those are the only two that we are launching with as enterprise-only.”
There is an AI piece to all of this, too. Gallego explained that a lot of Redpanda customers have struggled because AI APIs are expensive. But going forward, Redpanda will offer a service that can buffer events to meter the usage of external APIs. “We’re going to be building a portfolio of connectivity for the most popular AI API platforms in a way that doesn’t allow you to incur overages. That kind of logic tends to be very tedious and very specific to every API,” he said.
Every weekday and Sunday, you can get the best of TechCrunch’s coverage.
Startups are the core of TechCrunch, so get our best coverage delivered weekly.
The latest Fintech news and analysis, delivered every Tuesday.
TechCrunch Mobility is your destination for transportation news and insight.
By submitting your email, you agree to our Terms and Privacy Notice.
SpaceX’s massive Starship rocket could take to the skies for the fourth time on June 5, with the primary objective of evaluating the second stage’s reusable heat shield as the…
Eric Lefkofsky knows the public listing rodeo well and is about to enter it for a fourth time. The serial entrepreneur, whose net worth is estimated at nearly $4 billion,…
TechCrunch Disrupt showcases cutting-edge technology and innovation, and this year’s edition will not disappoint. Among thousands of insightful breakout session submissions for this year’s Audience Choice program, five breakout sessions…
Check Point is the latest security vendor to fix a vulnerability in its technology, which it sells to companies to protect their networks.
Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.
The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.
Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…
In a series of posts on X on Thursday, Paul Graham, the co-founder of startup accelerator Y Combinator, brushed off claims that OpenAI CEO Sam Altman was pressured to resign…
In its three-year history, EthonAI has amassed some fairly high-profile customers including Siemens and chocolate-maker Lindt.
Don’t miss out: TechCrunch Disrupt early-bird pricing ends in 48 hours! The countdown is on! With only 48 hours left, the early-bird pricing for TechCrunch Disrupt 2024 will end on…
Biotech startup Valar Labs has built a tool that accurately predicts certain treatment outcomes, potentially saving precious time for patients.
Archer Aviation is partnering with ride-hailing and parking company Kakao Mobility to bring electric air taxi flights to South Korea starting in 2026, if the company can get its aircraft…
Space startup Basalt Technologies started in a shed behind a Los Angeles dentist’s office, but things have escalated quickly: Soon it will try to “hack” a derelict satellite and install…
As a teen model, Katrin Kaurov became financially independent at a young age. Aleksandra Medina, whom she met at NYU Abu Dhabi, also learned to manage money early on. The…
Can AI help you tell your story? That’s the idea behind a startup called Autobiographer, which leverages AI technology to engage users in meaningful conversations about the events in their…
AI-powered summaries of web pages are a feature that you will find in many AI-centric tools these days. The next step for some of these tools is to prepare detailed…
ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…
Battery recycling startups have emerged in Europe in a bid to tap into the next big opportunity in the EV market: battery waste.  Among them is Cylib, a German-based startup…
Amazon has received approval from the U.S. Federal Aviation Administration (FAA) to fly its delivery drones longer distances, the company announced on Thursday. Amazon says it can now expand its…
With Plannin, creators can tell their audience about their latest trip, which hotels they liked and post photos of their travels.
Amazon is rolling out its AI voice search feature to Alexa, which lets it answer open-ended questions about content.
Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service.
It’s a lofty goal to take on legacy payments infrastructure, however, Forward’s model has an advantage by shifting the economics back to SaaS companies.
Fertility remains a pressing concern around the world — birthrates are down in many countries, and infertility rates (that is, the inability to conceive) are up. Rhea, a Singapore- and…
Microsoft, Meta, Intel, AMD and others have formed a new group to design next-gen interconnects for AI accelerator hardware.
With JioFinance, the Indian tycoon Mukesh Ambani is making his boldest consumer-facing move yet into financial services.
Salespeople live and die by commissions. It’s no surprise, then, that Salesforce paid a premium to buy a platform that simplifies managing commissions.
YoLa Fresh works with over a thousand retailers across Morocco and records up to $1 million in gross merchandise volume.
Instagram is expanding the scope of its “Limits” tool specifically for teenagers that would let them restrict unwanted interactions with people.
Agritech company Iyris helps growers across eleven countries globally increase crop yields, reduce input costs, and extend growing seasons.
Powered by WordPress VIP

source
Sponsor:News technical sponsor
Sponsor:News AI sponsor
Sponsor: AI sponsor
Sponsor: AI sponsor