Scala Stream Enricher Health Check Endpoint?

For engineers Enrichment
1

Hi,

I was wondering whether something like /health exists on the Scala Stream Enricher, s.t. an Autoscaling Group would be able to automatically bounce instances. I’m aware it publishes to CloudWatch, but it seems to be a bigger pain to do so than to have a simple health endpoint.

Many thanks,
Victor

2

Hi @vivricanopy,

Yes, the scala stream collector provides a healthcheck URL at /health and sends a 200, text/plain => OK

3

Hi @christoph-buente, I meant the enricher, not the collector. I provided /health as an example that I know is already in the collector :slight_smile:

4

Oh, now is see it :slight_smile:

The stream enricher does not listen to HTTP requests, and thus does not provide a healthcheck URL.

5

Yes @christoph-buente is right - Stream Enrich doesn’t provide a healthcheck mechanism currently, whether HTTP, gRPC or Serf-based…

6

Ok thanks guys!

7

I just wanted to add it’d be hella-useful

8

There’s a ticket here @vivricanopy, I just renamed it:

https://github.com/snowplow/snowplow/issues/1912

9

That’d be sweet! Any idea on ETA?

10

No ETA yet I’m afraid @vivricanopy!

11

Hey Alex, Any news on this one?

12

Not yet @ShlomiZ!

13

Would you accept a PR that handles this?

14

Of course!

15

Any update on this? As I see issues is still in open state.

16

The issue is still opened on github, any news on this topic?

17

I think it might take some thinking about what the design looks like. Exposing a HTTP health check endpoint is possible in some circumstances, but difficult / impossible to do for Beam Enrich as sending health metrics out is far easier.