We are seeing around 24 hours of lag in the elasticsearch whereas the data processed to redshift is fine. This issue is in prod environment only. In all other environments it is working fine. I am also getting the error in enrichment logs as below:
ERROR com.snowplowanalytics.snowplow.enrich.kinesis.sinks.KinesisSink - 250 records failed with error code ProvisionedThroughputExceededException. Example error message: Rate exceeded for shard shardId-000000000002 in stream prod_enriched under account XXXXXXXXX.
I am suspecting that this is due to large data volume in Prod environment. Please help on this.