Issue when updating to snowplow-enrich-kinesis-4.0.0.jar

For engineers Enrichment
1

We are facing the below error while updating the Jar version to 4.0.0.Jar, The Previously actively working jar was snowplow-enrich-kinesis-3.9.0.jar. The same hocon file worked for the previous jar version.

Error:

[io-compute-1] ERROR com.snowplowanalytics.snowplow.enrich.common.fs2.Run - CLI arguments are valid but some of the configuration is not correct. Error: Cannot parse file enricher.config.hocon: application.conf @ jar:file:/usr/app/snowplow-enrich-kinesis-4.0.0.jar!/application.conf: 107: Document has trailing tokens after first object or array: '{'

enricher.config.hocon

{
  "license": {
    "accept": true
  }

  "input": {
    "type": "Kinesis"

    "appName":  "collector-good-event-table"

    "streamName": "collected-good-events-stream"

    "region": "us-east-1"

    "initialPosition": {
      "type": "TRIM_HORIZON"
    }

    "retrievalMode": {
      "type": "Polling"
      "maxRecords": 5000
    }

    "bufferSize": 3

    "checkpointBackoff": {
      "minBackoff": 100 milliseconds
      "maxBackoff": 10 seconds
      "maxRetries": 10
    }
  }

  "output": {
    "good": {

      "type": "Kinesis"

      "streamName": "enriched-good-events-stream"

      "region": "us-east-1"

      "partitionKey": "event_id"

      "backoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
        "maxRetries": 10
      }

      "throttledBackoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
      }

      "recordLimit": 10

      "byteLimit": 1000000000

    }
    "bad": {

      "type": "Kinesis"

      "streamName": "enriched-bad-events-stream"

      "region": "us-east-1"

      "backoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
        "maxRetries": 10
      }

      "throttledBackoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 1 second
      }

      "recordLimit": 10

      "byteLimit": 1000000000
    }
  }
}
2

Hi @Vishal_Periyasamy ,

May I ask why you are using the jar instead of the Docker image ?

We’re considering publishing only the Docker images in next releases.

3

Hi @BenB thanks for your reply,

I was not aware of this snowplow docker image,
Can you share the necessary documentation so I can check on it?

4

You can find all the info about running the Docker image on this page :

1 Like