Photo

Maximizing Scalability with Go and Redis: A Telemetry Processing Journey

Andrii Raikov

from Delivery Hero SE (Berlin, Germany)

About speaker

Principal Software Engineer at Delivery Hero SE

Andrii has a total of 17 years of software engineering experience and has been very passionate about Go for the past 6 years.

About speakers company

.

Abstracts

broad

At Delivery Hero, we process a staggering 10,000 requests per second globally, particularly in our critical TIER1 flow, where we handle telemetry data primarily from riders' phones. In this session, we'll delve into how we harnessed the power of Go and Redis to handle this high-load, mission-critical system at an incredibly low cost.

Key Points:

Go and Redis as the Perfect Pair: Discover how Go and Redis form the backbone of our telemetry processing infrastructure. Go's concurrency model and performance complement Redis's high availability and resilience, enabling seamless handling of our demanding operations.

Efficient Data Management with Redis: Explore how Redis's versatile features, including sorted lists and key expiration (TTL), enable efficient telemetry data storage, event queue management, and fraud prevention. Learn how Go's native support for Redis interactions streamlines integration and enhances overall system performance.

Scalability Made Simple: Dive into how Go and Redis effortlessly scale to handle our high-volume telemetry flow. With Go's lightweight footprint and Redis's scalability features, such as automatic sharding and replication, we ensure our system remains responsive and reliable, even under peak loads.

Cost-Effectiveness and Resource Optimization: Learn how we achieved cost-effectiveness by leveraging the smallest Redis instances available, strategically deployed across multiple regions. Explore how Go's efficient resource utilization and Redis's pay-as-you-go pricing model contribute to significant cost savings without compromising performance.

Customized Data Flows and Experimentation: Our implementation with Redis has opened doors for various experiments, including different location frequency updates, giving us the flexibility to optimise and innovate based on unique service needs.testing different telemetry processing strategies, empowering continuous optimization and innovation.

The Program Committee has not yet taken a decision on this talk

other talks of this topic

Photo
Cloud Costs with ClickHouse and OpenCost

Denys Kondratenko

Altinity

specific
Photo
REST or gRPC: Best practices for modern architectures

Kristina Kraljić

PIS d.o.o.

specific
Photo
The Art of Decision Making: Balancing Trade-Offs in Software Architecture

Florian Lenz

neocentric GmbH - Azure Cloud Developer / Architect

broad
Photo
Mastering Software Design: Best Practices for Building Robust Applications

Ambesh Singh

Visionet Systems Deutschland

broad
Photo
Mindset by Design: Transforming How You Build Software

Mihaela-Roxana Ghidersa

Signant Health

broad
Photo
Federate it! Limits of GraphQL-based architectures.

Alexander Gilevich

EPAM

specific
Photo
Blending Product Thinking with Architecture

Joel Tosi

Dojo and Co

broad
Photo
Architectures that we can use with .NET

Alexej Sommer

Capgemini

broad
Photo
Open Source Ecosystem for ClickHouse on Kubernetes

Denys Kondratenko

Altinity

specific
Photo
Using Heterogeneous Computing in Databases

Aleksandr Borgardt

OtterStax

specific
Photo
Writing a TSDB from Scratch: Performance Optimization

Roman Khavronenko

VictoriaMetrics

specific
Photo
Serverless First Mindset: seize opportunities, know your limits and experience real success stories

Florian Lenz

neocentric GmbH - Azure Cloud Developer / Architect

specific
Photo
Dismantling Big Data with DuckDB

Yoav Nordmann

Tikal Knowledge

specific
Photo
The simplest way to build resilient applications

Francesco Guardiani

Restate Gmbh

broad
Photo
ML/AI in the cloud - State of the Art in 2025

Federico Fregosi

OpsGuru

broad
Photo
Achieving True Layered Separation with Hexagonal Architecture in Spring Boot

Adrian Kodja

softgarden e-recruiting GmbH

specific
Photo
Azure cloud architecture for high availability and low latency

Florian Lenz

neocentric GmbH - Azure Cloud Developer / Architect

specific
Photo
Exploring the Tradeoffs of Event-Driven Architecture in Microservices

Florian Lenz

neocentric GmbH - Azure Cloud Developer / Architect

specific
Photo
The Anatomy of a Distributed JavaScript Runtime

Peter van Vliet

Masking Technology

broad
Photo
Organizational Sustainability with Platform Engineering

Lesley Cordero

The New York Times

specific
Photo
Just Use Postgres for Everything

Giorgi Dalakishvili

Space International

specific
Photo
Beyond Caching: Valkey's Advanced Data Structures in Action

Viktor Vedmich

Amazon Web Services

specific