Kinesis S3 Snowplow - Fetch Specific Data

For engineers
1

Can I select specific data that I want to fetch from Kinesis Data stream and push to S3?
For now, all the data in the Kinesis stream is being sent to S3.

Also, Is there a way I don’t specify the output stream?

2

you could try sticking a Lambda function on the enriched stream and parsing out the data you want and writing that to s3

2 Likes
3

Can I set some field in Snowplow itself?

Or do you have a solution what you’re suggesting? @13scoobie

Also, with logstash filtering works fine, but we are facing json delimiter issue.