We wanted to share a quick python script we use to format the “bad” event json to back to a format that the EmrEtlRunner can run. We use this in place of Hadoop-Bad-Rows when we are testing or just feel like using a “drag and drop” vs. booting an Emr job. #!/usr/bin/python import sys` import tempf…

Python script to reprocess "bad" rows

alex May 10, 2016, 10:40pm 2

Thanks for sharing this @digitaltouch! Could you maybe share with the community some of the common scenarios where you want to extract and re-process bad rows?

Unable to recover bad events due to a missing schema

Topic		Replies	Views
Reprocessing bad rows from the Clojure Collector Enrichment	3	1736	May 10, 2016
EmrEtlRunner skip issues configuration Enrichment	10	3390	July 31, 2016
Second job for importing bad rows Troubleshooting	1	1466	June 9, 2016
Reprocessing Bad Events, EmrEtlRunner Error Troubleshooting	7	2004	August 23, 2017
Process bad rows from Elasticsearch and form them into good rows Troubleshooting	5	3227	May 16, 2017

Python script to reprocess "bad" rows

Related topics