EmrEtlRunner Config / environment variables not recognized

[anton]

Hi @dadasami,

It seems to be similar to @mgloel’s issue:

R35 Shredder - no shredding_complete.json file created

Hi, we managed to setup the shredder. The EMR job has been completed but we cannot find a shredding_complete.json file in the top folder of the run. It seems that this file is required to trigger the RDB Loader via the SQS queue, right? This is the content of the shredded bucket: s3://our-shredded-bucket/good/run=2021-02-25-17-39-49/ ├── _SUCCESS ├── vendor=com.myapp │ ├── name=generic_tracking_event │ │ └── format=json │ │ └── model=1 │ │ ├── part-00000-2171e936-54…

Can you check that your SQS queue is FIFO? Also is there anything in the SQS queue?