Making the Stream Enricher Highly Available (autoscaling group)

[mike]

Essentially yes, but the benefit of scaling the stream enricher is going to depend on the sharding of your stream.

There’s a little bit of detail that Alex has posted before about this here.

@alex

Pretty much this - though substitute “workers” for “servers.” You have one KCL instance (i.e. one Stream Enrich or similar) per server, but you may have more than one worker inside each KCL. You can have more workers than shards, but no more than one worker working on one shard at a time.

You won’t get duplicate records for this reason - only one worker can work on one shard.