Many of our data pipelines interact with external services. The availability of an external service can adversly affect the health our pipelines. This is how we handle it using AWS Step Functions

Many of our data pipelines interact with external services. The availability of an external service can adversly affect the health our pipelines. This is how we handle it using AWS Step Functions
We built a reactive pipeline to move almost a quarter billion database records to AWS and to build a reactive and serverless pipeline. This is the story of the lessons we learned along the way working with Kinesis and Lambdas
Follow us on