Multiple enrichment using helm charts

For engineers Enrichment
1

Hi guys, I am trying different enrichment(ua_parser,custom_api_enrichment etc) in our pipeline using helm charts. When using only one enrichment the enrichment happens but on adding multiple enrichments one below the other in values.yaml, other enrichments are not populating the desired fields. Can someone help

2

The easiest way for us was not to add it to the values but as external files so that you have a folder structure like

enrichments/
    enricher1/
        some_enrichment.json
        some_other_enrichment.json

that you can then include in a configmap as in the documentation: Helm | Accessing Files Inside Templates

Hope this helps :slight_smile:

Best, Christoph

3

Hey @Sn123 which helm chart are you using? Have you verified the target volume has all of the files for each individual enrichment?

4

@josh out curiosity: do you already provide helm charts for the services? I saw that in the devops group there are first repos but I was not quite sure how mature they are (e.g. is there already one for the collectors, enrichers and loaders)?

Thanks :slight_smile:

5

Hey @capchriscap not yet but I hope to at some point this year! We have developed some service agnostic charts so far which we will use as the basis for our applications but my hope is to deliver each app as a standalone chart + umbrella charts with some basic pipeline reference topologies built in.

1 Like