Open Source at trivago

Insights, experiences and learnings from trivago's tech teams.

Read A New Functional Approach to Complex Types in Apache Hive

A New Functional Approach to Complex Types in Apache Hive

When faced with the challenge to store, retrieve and process small or large amounts of data, structured query languages are typically not far away. These languages serve as a nice abstraction between the goal that is to be achieved and how it is actually done. The list of successful applications of this extra layer is long. MySQL users could switch from MyISAM to InnoDB or use new algorithms like Multi-Range-Read without a change to their application. We, as Hive users, can effortlessly switch our complete processing from MapReduce to, say, Tez or Spark. All this is possible because of SQL serving as an abstraction layer in between. However, in this article, I will outline the effects when SQL - specifically hiveQL - misbehaves and which steps we are taking to recover.

Read the whole article ›
Read Interview with the Winners of trivago's New York Hackathon

Interview with the Winners of trivago's New York Hackathon

On 11th of November 2017 trivago hosted a Hackathon at NASDAQ's MarketSite in New York. The winners were awarded with a trip through Europe to visit trivago's offices as well as conference tickets for [The Next Web, Amsterdam](https://thenextweb.com/event/tnw-conference/). We invited the winners to our office, where we got to the chance to interview them about their Hackathon experience.

Read the whole article ›