This is a guest post by Eunice Do, Data Engineer at TripleLift, a technology company leading the next generation of programmatic advertising.

What is the name of your system and where can we find out more about it?

The system is the data pipeline at TripleLift. TripleLift is an adtech company, and like most companies in this industry, we deal with high volumes of data on a daily basis. Over the last 3 years, the TripleLift data pipeline scaled from processing millions of events per day to processing billions. This processing can be summed up as the continuous aggregation and delivery of reporting data to users in a cost efficient manner. In this article, we'll mostly be focusing on the current state of this multi-billion event pipeline.

To follow the 5 year journey leading up to the current state, check out this talk on the evolution of the TripleLift pipeline by our VP of Engineering.

Why did you decide to build this system?

Read more - Original news link
Be the first person like this
Be the first person to like this.
Be the first person like this
Similar news
Hey, it's HighScalability time!   LOL. Who knew a birthday service could lead t...
14 May, 16:03
This is the second part of my interview with Alex DeBrie on his new insta-class...
04 May, 16:05
Who's Hiring?  InterviewCamp.io has hours of system design content. They also d...
12 May, 15:23
Hey, it's HighScalability time!   Line noise? Perl? Still uncertain? It's how yo...
26 June, 16:04
If you’re hosting your databases in the cloud, choosing the right cloud servi...
12 May, 06:09
Hey, it's HighScalability time!   Serverless is really complex. Or is it? @paulb...
31 July, 16:25
Who's Hiring?  InterviewCamp.io has hours of system design content. They also d...
08 July, 22:22
Who's Hiring?  InterviewCamp.io has hours of system design content. They also d...
11 June, 19:30