We’ve had a couple of overnight ETL jobs run with errors similar to the following, after the EMR job has run: Excon::Errors::ServiceUnavailable (Expected(200) <=> Actual(503 Service Unavailable) excon.error.response :body => "<Error><Code>SlowDown</Code><Message>Please reduce your reques…

EMR ETL Runner job failing due to S3 errors

vceron May 4, 2017, 5:03pm 4

Our issue was linked to a DNS server list issue.
This allowed us of to improve some EmrEtlRunner steps performance, you can read more here --> Performance managing S3 buckets

Topic		Replies	Views
EMR ETL Runner Fails but EMR Succeeds Troubleshooting	1	1127	October 23, 2018
EMR jobflow failing on Hadoop Enrich step after a few seconds AWS batch pipeline (Legacy)	5	2435	April 29, 2016
Access Denied Exception while running EMR step 2 For engineers	0	3768	April 4, 2017
Snowplow etl emr issue	0	1002	September 25, 2019
Service: Amazon S3; Status Code: 503; Error Code: 503 Slow Down issues AWS batch pipeline (Legacy)	2	6651	November 13, 2017

EMR ETL Runner job failing due to S3 errors

Related topics