At trivago we rely heavily on the ELK stack for our log processing. We stream our webserver access logs, error logs, performance benchmarks and all kind of diagnostic data into Kafka and process it from there into Elasticsearch using Logstash. Our preferred encoding within this pipeline is Google's Protocol Buffers, short protobuf. In this blog post, we will explain with an example how to read protobuf encoded messages from Kafka using Logstash.
trivago tech newsletter
trivago's latest tech articles and regular tech tips straight to your inbox!
Popular tagsSee all ›
3 Things We Learned When Switching to TypeScript· 6 min read
Being on-call as a software engineer - a challenging and fast learning experience· 9 min read
Java Reactive Programming - Effective Usage in a Real World Application· 15 min read
Automation-First Approach Using the Karate API Testing Framework· 6 min read
Learn Redis the hard way (in production)· 18 min read
Tackling hard problems is like going on an adventure. Solving a technical challenge feels like finding a hidden treasure. Want to go treasure hunting with us?View all job openings
Follow us on