New documentation highlights April 2016

For engineers
1

For the last couple of months we’ve been working on updating and extending our wiki documentation. Below are just a few recently added articles you might find useful to gain a better understanding how the Snowplow pipeline works.

  • Collector Logging Format - What do the log files (raw events) produced by all of our collectors look like?

  • The Enrichment Process - Get a deeper understanding what is going on during the enrichment process.

  • The StorageLoader - An insight into the StorageLoader role in the ETL process. How do we manage to load the data related to user specific events and contexts into Redshift?

  • Batch Pipeline Steps - How to resume the failed job the right way?

Let us know if there’s any (other) topic you would like us to cover in the wiki.

1 Like