Redpanda talk at Performance Summit

A new storage engine built from the ground up for Kafka-API compatibility with Kernel bypass technologies for 10x lower tail latencies.

By
on
January 8, 2021

On Dec 1st, I gave a talk at Performance Summit titled "Redpanda: A new storage engine built from the ground up for Kafka-API compatibility with Kernel bypass technologies for 10x lower tail latencies."

The talk covers how we built a new storage engine from scratch using a thread per core architecture for predictable tail latencies. We dive deep into the challenges of adapting a well known protocol (Kafka-API) on top of this new storage engine and the performance gains of optimizing for modern hardware.

Here for your viewing pleasure is the video of that talk:

Sign up for our Community Slack (here!) and engage with us on Twitter via @redpandadata or personally at @emaxerrno

Graphic for downloading streaming data report
“Always-on” production memory profiling in just 5 instructions
Stephan Dollberg
&
&
&
August 27, 2024
Text Link
Data plane atomicity and the vision of a simpler cloud
Alexander Gallego
&
Camilo Aguilar
&
&
August 21, 2024
Text Link
Write caching: drive your workloads up to 90% faster
Matt Schumpert
&
Brandon Allard
&
Bharath Vissapragada
&
Nicolae Vartolomei
July 16, 2024
Text Link