Hi there, I have deployed Snowplow pipline on aws for quite some now (since January this year). i didn’t enabled s3 raw events but i needed them now. so i redeployed the terraform modules today after enabling the s3_raw_enabled = true and i can see all the aws services related to raw events being created (raw loader server, raw streams, instance profiles, dynamodb etc ). but i can not see a /raw directory in my bucket along with bad, enriched and transformed
upon checking snowplow-s3-loader-raw-server logs in cloudwatch i can see that the connection to aws kinesis is not being established and it is timing out. i haven’t changed any configurations related to the networking. while all other ec2 machines are working fine, I don’t know why raw loader isn’t connecting to kinesis. any help with this would be great. thank you
for reference here is the error log
Exception in thread “main” com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to kinesis.ap-southeast-1.amazonaws.com:443 [kinesis.ap-southeast-1.amazonaws.com/10.0.29.160, kinesis.ap-southeast-1.amazonaws.com/10.0.44.2] failed: connect timed out
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to kinesis.ap-southeast-1.amazonaws.com:443 [kinesis.ap-southeast-1.amazonaws.com/10.0.29.160, kinesis.ap-southeast-1.amazonaws.com/10.0.44.2] failed: connect timed out