When running our data through the EmrEtlRunner we are losing some of the data fields. Some of the fields that we are missing are unstructured, and base64 encoded. We are also missing geo data. Is there a way to enable EmREtlRunner to handle decoding? Ive surprisingly found nothing about this issue, so I presume it might just be a simple oversight on my part.
Do you have some examples of where this is happening?
What version of the pipeline/components are you running? Are you missing data in the enriched events and/or in the Redshift tables?