Stream enrichment start issue

For engineers Enrichment
1

Exploring snowplow(Beginner).

Enrich-version: 1.1.0

Action: After enabling the http_header_extractor_config.json enrichment, enricher throwing the following error. After disabling it still throwing the same error.

Hours of google no luck :slight_smile:

java[3854]: An error occured: NonEmptyList({“error”:“ValidationError”,“dataReports”:[{“message”:"[12].schema: is missing but it is required","path":"[12]",“keyword”:“required”,“targets”:[“schema”]},{“message”:"[12].data: is missing but it is required","path":"[12]",“keyword”:“required”,“targets”:[“data”]},{“message”:"[12].email: is not defined in the schema and the schema does not allow additional properties","path":"[12]",“keyword”:“additionalProperties”,“targets”:[“email”]},{“message”:"[12].unknown: is not defined in the schema and the schema does not allow additional properties","path":"[12]",“keyword”:“additionalProperties”,“targets”:[“unknown”]},{“message”:"[12].social: is not defined in the schema and the schema does not allow additional properties","path":"[12]",“keyword”:“additionalProperties”,“targets”:[“social”]},{“message”:"[12].paid: is not defined in the schema and the schema does not allow additional properties","path":"[12]",“keyword”:“additionalProperties”,“targets”:[“paid”]},{“message”:"[12].search: is not defined in the schema and the schema does not allow additional properties","path":"[12]",“keyword”:“additionalProperties”,“targets”:[“search”]}]})

Thanks in advanced for any kind of help. Thanks

1 Like
2

@Mohit_Singh, it sounds like this error is related to a different enrichment - referer parser enrichment. This is the enrichment that adds categories like “social”, “paid”, “search”, “email” as can be seen from referers.yml and are mentioned in the error.

1 Like
3

Thanks @ihor for reaching out :slight_smile:

I have test with disabling the referer_parser.json enrichment, still getting the same error.

4

Hi @ihor

Thanks for pointing the right direction, problem is solved. So basically problem was if you enable or disable enrichment and restart the enricher, it takes existing referer-parser.json previously downloaded file which is not making sense as the new enrichment configuration. Solution is whenever you play with any enrichment json configuration make sure delete the referer-parser.json file before restart.

Would like to add something in above finding ?

Once again thanks a lot :slight_smile:

5

@Mohit_Singh, glad it worked out for you. Each enrichment configuration file has data.enabled property. When you need to turn it on/off you can set the value to true/false (provided the config itself is in valid format of cause). You do have to restart the enrichment component to clear cache afterwards.

6

Thanks @Mohit_Singh

You saved my day!!