Version 1.6.4 of Snowplow’s BigQuery loader has now been released.
This is a patch release to address performance issues found with the previous release, version 1.6.3.
The performance issues have been discussed a bit over in this thread. Anyone using the 1.6.3 version may see these kinds of problems with their loader:
- High number of undelivered pubsub messages
- Low rate of events getting loaded into BigQuery
- High CPU usage and memory usage by the loader
Upgrading your loader to version 1.6.4 should fix these problems immediately. Upgrading is as simple as pulling the latest docker images:
docker pull snowplow/snowplow-bigquery-streamloader:1.6.4
docker pull snowplow/snowplow-bigquery-mutator:1.6.4
docker pull snowplow/snowplow-bigquery-repeater:1.6.4