Version 1.6.8 of Snowplow’s BigQuery loader has now been released.
In a few different places, we are sending messages to Pubsub topics in the BQ Loader. Starting from this version, the size of the message will be checked before sending it to topic. If its size exceeds maximum allowed size limit, loader will create SizeViolation bad row that inludes trimmed version of the original message and send it to bad row topic.
Also, this version includes a few dependency bumps for potential security vulnerabilities.
Upgrading to version 1.6.8
Upgrading to version 1.6.8 is simple as pulling the newest docker images:
docker pull snowplow/snowplow-bigquery-streamloader:1.6.8
docker pull snowplow/snowplow-bigquery-mutator:1.6.8
docker pull snowplow/snowplow-bigquery-repeater:1.6.8
Check out our docs site for full instructions on how to run and configure the BigQuery loader.