We are still using EmrEtlRunner for the Shredder and Loader steps. This morning I dealt with “just one of those AWS things”, where the RDB Loader step failed, but then completed OK when I reran it with “-f rdb_load”. Something like this happens every couple of months with EmrEtlRunner.
It would be better if you can follow the upgrade guides starting from the version you are currently using.
We are also upgrading from pre-R35 and are considering going straight to 3.0.0 rather than upgrading to each intermediate version. Is there any reason we cannot do this?
@dwahl Recommended way is following the guide in order to not miss any required step. We don’t have separate guide for migrating from specific old version to latest version.