Hi @pt-mike,
I hope you don’t mind, in my reply I am going to call it the “transformer” instead of the “shredder”. We recently rebranded it for reasons described over here and I’m trying to be consistent from now on to avoid confusing people further!
Are you using the streaming transformer (as opposed to the batch transformer, which runs on EMR). I know there were problems with older versions of the streaming transformer, where it would sometimes create an empty batch even if there were no events to process.
I believe though that the problem is fixed in the newest versions of RDB Loader. The newest docker images are:
# The streaming transformer:
docker pull snowplow/transformer-kinesis:4.1.0
# The redshift loader:
docker pull snowplow/rdb-loader-redshift:4.1.0
Unfortunately the config files for RDB Loader have changed quite a bit since version 1.2.3 (we think for the better!) You will need to check the RDB Loader docs site for the latest setup guide. There’s also some helpful information about upgrading in the release announcements for version 2.0.0 and version 3.0.0