BigQuery loader 1.6.4 released

Version 1.6.4 of Snowplow’s BigQuery loader has now been released.

This is a patch release to address performance issues found with the previous release, version 1.6.3.

The performance issues have been discussed a bit over in this thread. Anyone using the 1.6.3 version may see these kinds of problems with their loader:

  • High number of undelivered pubsub messages
  • Low rate of events getting loaded into BigQuery
  • High CPU usage and memory usage by the loader

Upgrading your loader to version 1.6.4 should fix these problems immediately. Upgrading is as simple as pulling the latest docker images:

docker pull snowplow/snowplow-bigquery-streamloader:1.6.4
docker pull snowplow/snowplow-bigquery-mutator:1.6.4
docker pull snowplow/snowplow-bigquery-repeater:1.6.4