We are pleased to announce version 1.4.0 of Snowplow’s BigQuery loader
The biggest new feature is to accept configuration file paths passed on the command line. Previously, the BigQuery loader could only be configured by passing long base64-encoded configuration strings. We listened to the opinions of users who found this inconvenient, e.g. this thread .
In the new release you instead you can pass a file path for each of the --config and --resolver arguments. Here is an example of a docker command, in which the config files are mounted into the container:
docker run \
-v /path/to/configs:/snowplow \
snowplow/snowplow-bigquery-streamloader:1.4.0 \
--config=/snowplow/config.hocon \
--resolver=/snowplow/resolver.json
Anything else?
We also bumped the cats effect library from version 2 to version 3. This is a real under-the-hood type change, but it’s a big step up onto a newer major version of our main runtime library.