Snowplow Collector sending data to kafka

For engineers Kafka real-time pipeline
1

Can snowplow collector on-premise sends the data to kafka/Mysql without using the Google PubSub and AWS kinesis.

Any other suggestions would be highly appreciated .

Thanks

2

There isn’t strictly an on-premise version of the collector (though it can be run on-prem as it is just a Docker container) but you can send data to Kafka by configuring the collector to send to Kafka. There is an example configuration file for doing that here.

At the moment we don’t support sending data to MySQL as it is an OLTP database rather than a data warehouse.