I am doing some event load testing and I seem to be very bottle necked getting the data out of the enricher good kinesis data stream into s3 using the S3 loader. Are there any suggestions on the buffer settings for the S3 loader to optimize writing this amount of data into S3?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Kinesis-S3 is taking too much time to store events into S3 buckets | 5 | 1685 | October 6, 2017 | |
Speeding up Stream Enricher | 12 | 3351 | August 3, 2018 | |
Optimizing AWS Stack for Medium Load Site | 4 | 1797 | January 31, 2017 | |
Scaling kinesis enricher for high loads | 11 | 2329 | December 11, 2018 | |
Delay in s3 loader | 5 | 1003 | October 30, 2022 |