Enrichments not working with image: snowplow/snowplow-enrich-kinesis:latest

For engineers Enrichment
1

Hello,

I am struggling to get enrichments working. Currently, it seems like they are just being ignored by the process. Its been broken for a while - but it was working when I first set this up. I dont see anything strange in the logs. Any help gratefully received.

I have a feeling its all the enrichments not working. Not just this one.

Thanks,

Andrew

root@enrich-server-899fb7548-r6jjh:/snowplow/enrichments# cat /snowplow/enrichments/snowplow_enrichment_geo 
{
  "schema": "iglu:com.snowplowanalytics.snowplow/ip_lookups/jsonschema/2-0-0",
  "data": {
    "name": "ip_lookups",
    "vendor": "com.snowplowanalytics.snowplow",
    "enabled": true,
    "parameters": {
      "geo": {
        "database": "GeoLite2-City.mmdb",
        "uri": "http://snowplow-hosted-assets.s3.amazonaws.com/third-party/maxmind"
      }
    }
  }
}

root@enrich-server-899fb7548-r6jjh:/snowplow/enrichments# cat /snowplow/config/enrich.hocon 
{
  "input": {
    "type": "Kinesis"
    "appName": "snowplow-prod-enrich-kinesis"
    "streamName": "snowplow-prod-raw-stream"
    "region": eu-west-1
    "initialPosition": {
      "type": "TRIM_HORIZON"
    }
    "retrievalMode": {
      "type": "Polling"
      "maxRecords": 10000
    }
    "bufferSize": 3
    "checkpointBackoff": {
      "minBackoff": 100 milliseconds
      "maxBackoff": 10 seconds
      "maxRetries": 10
    }
  }
  
  "output": {
    "good": {
      "type": "Kinesis"
      "streamName": "snowplow-prod-enriched-stream"
      "region": eu-west-1
      "backoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 10 seconds
        "maxRetries": 10
      }
      "throttledBackoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 1 second
      }
      "recordLimit": 500
      "byteLimit": 5242880
    }
    
    "bad": {
      "type": "Kinesis"
      "streamName": "snowplow-prod-bad-1-stream"
      "region": eu-west-1
      "backoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 10 seconds
        "maxRetries": 10
      }
      "throttledBackoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 1 second
      }
      "recordLimit": 500
      "byteLimit": 5242880
    }
  }
  "telemetry": {
    "disable": true
  }
  "monitoring": {
    "cloudwatch": false
  }
}

production>>>andrew@ROG:~$ kubectl logs enrich-server-899fb7548-r6jjh -n snowplow-prod 
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.io.FileSystem - Files found in /snowplow/enrichments: 
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.config.ParsedConfigs - Parsed config file: ConfigFile(Kinesis(snowplow-prod-enrich-kinesis,snowplow-prod-raw-stream,Some(eu-west-1),TrimHorizon,Polling(10000),3,BackoffPolicy(100 milliseconds,10 seconds,Some(10)),None,None,None),Outputs(Kinesis(snowplow-prod-enriched-stream,Some(eu-west-1),None,BackoffPolicy(100 milliseconds,10 seconds,Some(10)),BackoffPolicy(100 milliseconds,1 second,None),500,5242880,None),None,Kinesis(snowplow-prod-bad-1-stream,Some(eu-west-1),None,BackoffPolicy(100 milliseconds,10 seconds,Some(10)),BackoffPolicy(100 milliseconds,1 second,None),500,5242880,None)),Concurrency(256,1),None,RemoteAdapterConfigs(10 seconds,45 seconds,10,List()),Monitoring(None,MetricsReporters(None,None,true)),Telemetry(true,15 minutes,POST,collector-g.snowplowanalytics.com,443,true,None,None,None,None,None),FeatureFlags(false,false,false),None)
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.config.ParsedConfigs - Parsed Iglu Client with following registries: Iglu Central
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.config.ParsedConfigs - Parsed following enrichments: 
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.Run - Initialising resources for snowplow-enrich-kinesis 3.8.0
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.Environment - Running Enrich
[pool-1-thread-1] INFO com.snowplowanalytics.snowplow.enrich.common.fs2.Assets - Initializing (downloading) enrichments assets
[pool-1-thread-1] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseCoordinator - With failover time 10000 ms and epsilon 25 ms, LeaseCoordinator will renew leases every 3308 ms, takeleases every 20050 ms, process maximum of 2147483647 leases and steal 1 lease(s) at a time.
[pool-1-thread-1] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseCoordinator - With failover time 10000 ms and epsilon 25 ms, LeaseCoordinator will renew leases every 3308 ms, takeleases every 20050 ms, process maximum of 2147483647 leases and steal 1 lease(s) at a time.
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Initialization attempt 1
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Initializing LeaseCoordinator
[cats-effect-blocker-0] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Starting lease cleanup thread.
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Starting LeaseCoordinator
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Scheduling periodicShardSync
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Initialization complete. Starting worker loop.
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DeterministicShuffleShardSyncLeaderDecider - Elected leaders: enrich-server-899fb7548-tjccw:43a00eba-aacf-44a9-9c16-6ba217bfbeeb
[LeaseCoordinator-0000] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseTaker - Worker enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 needed 2 leases but none were expired, so it will steal lease shardId-000000000002 from enrich-server-899fb7548-tjccw:43a00eba-aacf-44a9-9c16-6ba217bfbeeb
[LeaseCoordinator-0000] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseTaker - Worker enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 saw 4 total leases, 0 available leases, 2 workers. Target is 2 leases, I have 0 leases, I will take 1 leases
[LeaseCoordinator-0000] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseTaker - Worker enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 successfully took 1 leases: shardId-000000000002
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Created new shardConsumer for : ShardInfo(streamIdentifierSerOpt=Optional.empty, shardId=shardId-000000000002, concurrencyToken=fd16cff0-8f50-4ba0-9cfc-de1bb93d08ea, parentShardIds=[], checkpoint={SequenceNumber: 49638344096864091378147350375438462427874226596766285858,SubsequenceNumber: 0})
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.lifecycle.BlockOnParentShardTask - No need to block on parents [] of shard shardId-000000000002
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.retrieval.polling.PrefetchRecordsPublisher - snowplow-prod-raw-stream:shardId-000000000002 : Starting Prefetching thread and initializing publisher session.
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.retrieval.polling.KinesisDataFetcher - Initializing shard snowplow-prod-raw-stream:shardId-000000000002 with 49638344096864091378147350375438462427874226596766285858
[ShardRecordProcessor-0001] INFO software.amazon.kinesis.leases.KinesisShardDetector - Stream snowplow-prod-raw-stream: listing shards with list shards request ListShardsRequest(StreamName=snowplow-prod-raw-stream)
[LeaseCoordinator-0000] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseTaker - Worker enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 saw 4 total leases, 3 available leases, 1 workers. Target is 4 leases, I have 1 leases, I will take 3 leases
[LeaseCoordinator-0000] INFO software.amazon.kinesis.leases.dynamodb.DynamoDBLeaseTaker - Worker enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 successfully took 3 leases: shardId-000000000003, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Created new shardConsumer for : ShardInfo(streamIdentifierSerOpt=Optional.empty, shardId=shardId-000000000003, concurrencyToken=5311b162-24fa-4569-9831-cbbe3f71c24d, parentShardIds=[], checkpoint={SequenceNumber: 49638344096886392123345881002331294964411069562263437362,SubsequenceNumber: 0})
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.lifecycle.BlockOnParentShardTask - No need to block on parents [] of shard shardId-000000000003
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Created new shardConsumer for : ShardInfo(streamIdentifierSerOpt=Optional.empty, shardId=shardId-000000000001, concurrencyToken=4f911f94-3052-4a2c-bf35-0c75cad3d0fa, parentShardIds=[], checkpoint={SequenceNumber: 49638344096841790632948819756647850734394628978625216530,SubsequenceNumber: 0})
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Created new shardConsumer for : ShardInfo(streamIdentifierSerOpt=Optional.empty, shardId=shardId-000000000000, concurrencyToken=de8c519d-9da8-4358-ad90-12963c3a215f, parentShardIds=[], checkpoint={SequenceNumber: 49638344102528480658574128657990915464399804099708583938,SubsequenceNumber: 0})
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.lifecycle.BlockOnParentShardTask - No need to block on parents [] of shard shardId-000000000001
[ShardRecordProcessor-0001] INFO software.amazon.kinesis.lifecycle.BlockOnParentShardTask - No need to block on parents [] of shard shardId-000000000000
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.retrieval.polling.PrefetchRecordsPublisher - snowplow-prod-raw-stream:shardId-000000000001 : Starting Prefetching thread and initializing publisher session.
[ShardRecordProcessor-0000] INFO software.amazon.kinesis.retrieval.polling.KinesisDataFetcher - Initializing shard snowplow-prod-raw-stream:shardId-000000000001 with 49638344096841790632948819756647850734394628978625216530
[ShardRecordProcessor-0001] INFO software.amazon.kinesis.retrieval.polling.PrefetchRecordsPublisher - snowplow-prod-raw-stream:shardId-000000000003 : Starting Prefetching thread and initializing publisher session.
[ShardRecordProcessor-0001] INFO software.amazon.kinesis.retrieval.polling.KinesisDataFetcher - Initializing shard snowplow-prod-raw-stream:shardId-000000000003 with 49638344096886392123345881002331294964411069562263437362
[ShardRecordProcessor-0002] INFO software.amazon.kinesis.retrieval.polling.PrefetchRecordsPublisher - snowplow-prod-raw-stream:shardId-000000000000 : Starting Prefetching thread and initializing publisher session.
[ShardRecordProcessor-0002] INFO software.amazon.kinesis.retrieval.polling.KinesisDataFetcher - Initializing shard snowplow-prod-raw-stream:shardId-000000000000 with 49638344102528480658574128657990915464399804099708583938
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[pool-16-thread-1] INFO software.amazon.kinesis.coordinator.DeterministicShuffleShardSyncLeaderDecider - Elected leaders: enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[pool-17-thread-1] INFO software.amazon.kinesis.coordinator.PeriodicShardSyncManager - WorkerId enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 is leader, running the periodic shard sync task
[pool-17-thread-1] INFO software.amazon.kinesis.coordinator.PeriodicShardSyncManager - Skipping shard sync for snowplow-prod-raw-stream due to the reason - Hash Ranges are complete for snowplow-prod-raw-stream
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[pool-17-thread-1] INFO software.amazon.kinesis.coordinator.PeriodicShardSyncManager - WorkerId enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0 is leader, running the periodic shard sync task
[pool-17-thread-1] INFO software.amazon.kinesis.coordinator.PeriodicShardSyncManager - Skipping shard sync for snowplow-prod-raw-stream due to the reason - Hash Ranges are complete for snowplow-prod-raw-stream
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
[pool-18-thread-1] INFO software.amazon.kinesis.leases.LeaseCleanupManager - Number of pending leases to clean before the scan : 0
[pool-16-thread-1] INFO software.amazon.kinesis.coordinator.DeterministicShuffleShardSyncLeaderDecider - Elected leaders: enrich-server-899fb7548-r6jjh:c0f81ecc-4331-493e-974f-5738fd36bee0
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Current stream shard assignments: shardId-000000000003, shardId-000000000002, shardId-000000000001, shardId-000000000000
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.Scheduler - Sleeping ...
[cats-effect-blocker-0] INFO software.amazon.kinesis.coordinator.DiagnosticEventLogger - Current thread pool executor state: ExecutorStateEvent(executorName=SchedulerThreadPoolExecutor, currentQueueSize=0, activeThreads=0, coreThreads=0, leasesOwned=4, largestPoolSize=5, maximumPoolSize=2147483647)
2

Hi @Andrew_Holway could you share how the enrich process is launched with any CLI arguments you have provided?

3

Hello,

this is from ps -aux in the docker container:

/opt/java/openjdk/bin/java -Dnashorn.args=--language=es6 -cp /home/snowplow/lib/com.snowplowanalytics.snowplow-enrich-kinesis-3.8.0.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-enrich-common-fs2-3.8.0.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-common-enrich-3.8.0.jar:/home/snowplow/lib/org.scala-lang.scala-library-2.12.15.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-dynamodb-1.12.129.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-kinesis-1.12.129.jar:/home/snowplow/lib/com.github.fs2-blobstore.s3_2.12-0.8.6.jar:/home/snowplow/lib/io.laserdisc.fs2-aws_2.12-3.1.1.jar:/home/snowplow/lib/software.amazon.awssdk.kinesis-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.dynamodb-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.s3-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.cloudwatch-2.18.7.jar:/home/snowplow/lib/software.amazon.kinesis.amazon-kinesis-client-2.4.3.jar:/home/snowplow/lib/software.amazon.awssdk.sts-2.18.7.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-sts-1.12.129.jar:/home/snowplow/lib/com.monovore.decline_2.12-1.0.0.jar:/home/snowplow/lib/io.circe.circe-generic-extras_2.12-0.14.1.jar:/home/snowplow/lib/io.circe.circe-literal_2.12-0.14.1.jar:/home/snowplow/lib/io.circe.circe-config_2.12-0.7.0.jar:/home/snowplow/lib/org.typelevel.cats-effect_2.12-2.5.4.jar:/home/snowplow/lib/co.fs2.fs2-core_2.12-2.5.10.jar:/home/snowplow/lib/co.fs2.fs2-io_2.12-2.5.10.jar:/home/snowplow/lib/org.slf4j.slf4j-simple-2.0.3.jar:/home/snowplow/lib/io.sentry.sentry-1.7.30.jar:/home/snowplow/lib/org.typelevel.log4cats-slf4j_2.12-1.3.0.jar:/home/snowplow/lib/com.github.cb372.cats-retry_2.12-2.1.0.jar:/home/snowplow/lib/com.snowplowanalytics.iglu-scala-client_2.12-1.4.0.jar:/home/snowplow/lib/com.snowplowanalytics.iglu-scala-client-http4s_2.12-1.4.0.jar:/home/snowplow/lib/org.http4s.http4s-blaze-client_2.12-0.21.34.jar:/home/snowplow/lib/org.http4s.http4s-circe_2.12-0.21.34.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-scala-tracker-core_2.12-1.0.0.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-scala-tracker-emitter-http4s_2.12-1.0.0.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-s3-1.12.129.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-core-1.12.129.jar:/home/snowplow/lib/com.amazonaws.jmespath-java-1.12.129.jar:/home/snowplow/lib/com.github.fs2-blobstore.core_2.12-0.8.6.jar:/home/snowplow/lib/co.fs2.fs2-reactive-streams_2.12-2.5.10.jar:/home/snowplow/lib/io.laserdisc.fs2-aws-core_2.12-3.1.1.jar:/home/snowplow/lib/io.laserdisc.pure-cloudwatch-tagless_2.12-3.1.1.jar:/home/snowplow/lib/io.laserdisc.pure-dynamodb-tagless_2.12-3.1.1.jar:/home/snowplow/lib/io.laserdisc.pure-kinesis-tagless_2.12-3.1.1.jar:/home/snowplow/lib/eu.timepit.refined_2.12-0.9.24.jar:/home/snowplow/lib/org.scala-lang.modules.scala-collection-compat_2.12-2.6.0.jar:/home/snowplow/lib/software.amazon.awssdk.aws-cbor-protocol-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.aws-json-protocol-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.protocol-core-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.profiles-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.sdk-core-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.auth-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.http-client-spi-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.regions-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.annotations-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.utils-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.aws-core-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.metrics-spi-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.apache-client-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.netty-nio-client-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.aws-xml-protocol-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.arns-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.json-utils-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.endpoints-spi-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.aws-query-protocol-2.18.7.jar:/home/snowplow/lib/com.google.guava.guava-31.1-jre.jar:/home/snowplow/lib/com.google.protobuf.protobuf-java-3.21.9.jar:/home/snowplow/lib/org.apache.commons.commons-lang3-3.12.0.jar:/home/snowplow/lib/org.slf4j.slf4j-api-2.0.3.jar:/home/snowplow/lib/io.reactivex.rxjava3.rxjava-3.1.5.jar:/home/snowplow/lib/joda-time.joda-time-2.10.10.jar:/home/snowplow/lib/commons-codec.commons-codec-1.15.jar:/home/snowplow/lib/org.apache.commons.commons-text-1.10.0.jar:/home/snowplow/lib/eu.bitwalker.UserAgentUtils-1.21.jar:/home/snowplow/lib/com.fasterxml.jackson.core.jackson-databind-2.13.4.2.jar:/home/snowplow/lib/com.github.ua-parser.uap-java-1.4.3.jar:/home/snowplow/lib/org.yaml.snakeyaml-1.31.jar:/home/snowplow/lib/org.postgresql.postgresql-42.5.2.jar:/home/snowplow/lib/mysql.mysql-connector-java-8.0.29.jar:/home/snowplow/lib/com.zaxxer.HikariCP-5.0.1.jar:/home/snowplow/lib/com.jayway.jsonpath.json-path-2.7.0.jar:/home/snowplow/lib/net.minidev.json-smart-2.4.10.jar:/home/snowplow/lib/com.snowplowanalytics.iab-spiders-and-robots-client-0.2.0.jar:/home/snowplow/lib/nl.basjes.parse.useragent.yauaa-7.11.0.jar:/home/snowplow/lib/org.apache.logging.log4j.log4j-to-slf4j-2.18.0.jar:/home/snowplow/lib/io.circe.circe-optics_2.12-0.14.1.jar:/home/snowplow/lib/io.circe.circe-jackson210_2.12-0.14.0.jar:/home/snowplow/lib/com.snowplowanalytics.scala-referer-parser_2.12-1.1.0.jar:/home/snowplow/lib/com.snowplowanalytics.scala-maxmind-iplookups_2.12-0.7.1.jar:/home/snowplow/lib/io.lemonlabs.scala-uri_2.12-1.5.1.jar:/home/snowplow/lib/com.snowplowanalytics.scala-forex_2.12-1.0.0.jar:/home/snowplow/lib/com.snowplowanalytics.scala-weather_2.12-1.0.0.jar:/home/snowplow/lib/io.gatling.jsonpath_2.12-0.6.14.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-badrows_2.12-2.1.2.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-thrift-raw-event-0.1.0.jar:/home/snowplow/lib/com.snowplowanalytics.collector-payload-1-0.0.0.jar:/home/snowplow/lib/com.snowplowanalytics.schema-sniffer-1-0.0.0.jar:/home/snowplow/lib/org.apache.thrift.libthrift-0.15.0.jar:/home/snowplow/lib/io.spray.spray-json_2.12-1.3.6.jar:/home/snowplow/lib/io.netty.netty-all-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-4.1.87.Final.jar:/home/snowplow/lib/org.typelevel.cats-core_2.12-2.7.0.jar:/home/snowplow/lib/io.circe.circe-generic_2.12-0.14.1.jar:/home/snowplow/lib/io.circe.circe-core_2.12-0.14.1.jar:/home/snowplow/lib/com.typesafe.config-1.3.4.jar:/home/snowplow/lib/io.circe.circe-parser_2.12-0.14.1.jar:/home/snowplow/lib/org.scodec.scodec-bits_2.12-1.1.28.jar:/home/snowplow/lib/com.fasterxml.jackson.core.jackson-core-2.13.4.jar:/home/snowplow/lib/org.typelevel.log4cats-core_2.12-1.3.0.jar:/home/snowplow/lib/com.networknt.json-schema-validator-1.0.70.jar:/home/snowplow/lib/com.snowplowanalytics.iglu-core_2.12-1.0.0.jar:/home/snowplow/lib/com.snowplowanalytics.iglu-core-circe_2.12-1.0.0.jar:/home/snowplow/lib/com.snowplowanalytics.scala-lru-map_2.12-0.5.0.jar:/home/snowplow/lib/org.scalaj.scalaj-http_2.12-2.4.2.jar:/home/snowplow/lib/org.http4s.http4s-client_2.12-0.21.34.jar:/home/snowplow/lib/org.http4s.http4s-blaze-core_2.12-0.21.34.jar:/home/snowplow/lib/org.http4s.http4s-core_2.12-0.21.34.jar:/home/snowplow/lib/org.http4s.http4s-jawn_2.12-0.21.34.jar:/home/snowplow/lib/io.circe.circe-jawn_2.12-0.14.1.jar:/home/snowplow/lib/com.amazonaws.aws-java-sdk-kms-1.12.129.jar:/home/snowplow/lib/commons-logging.commons-logging-1.2.jar:/home/snowplow/lib/org.apache.httpcomponents.httpclient-4.5.13.jar:/home/snowplow/lib/software.amazon.ion.ion-java-1.0.2.jar:/home/snowplow/lib/com.fasterxml.jackson.dataformat.jackson-dataformat-cbor-2.12.3.jar:/home/snowplow/lib/com.github.fs2-blobstore.url_2.12-0.8.6.jar:/home/snowplow/lib/org.reactivestreams.reactive-streams-1.0.4.jar:/home/snowplow/lib/org.scala-lang.scala-compiler-2.12.15.jar:/home/snowplow/lib/org.scala-lang.scala-reflect-2.12.15.jar:/home/snowplow/lib/org.scala-lang.modules.scala-xml_2.12-1.3.0.jar:/home/snowplow/lib/com.chuusai.shapeless_2.12-2.3.7.jar:/home/snowplow/lib/software.amazon.awssdk.third-party-jackson-dataformat-cbor-2.18.7.jar:/home/snowplow/lib/software.amazon.awssdk.third-party-jackson-core-2.18.7.jar:/home/snowplow/lib/software.amazon.eventstream.eventstream-1.0.1.jar:/home/snowplow/lib/org.apache.httpcomponents.httpcore-4.4.13.jar:/home/snowplow/lib/io.netty.netty-codec-http-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-http2-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-common-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-buffer-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-handler-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-classes-epoll-4.1.87.Final.jar:/home/snowplow/lib/com.google.guava.failureaccess-1.0.1.jar:/home/snowplow/lib/com.google.guava.listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/snowplow/lib/com.google.code.findbugs.jsr305-3.0.2.jar:/home/snowplow/lib/org.checkerframework.checker-qual-3.27.0.jar:/home/snowplow/lib/com.google.errorprone.error_prone_annotations-2.16.jar:/home/snowplow/lib/com.google.j2objc.j2objc-annotations-1.3.jar:/home/snowplow/lib/com.fasterxml.jackson.core.jackson-annotations-2.13.4.jar:/home/snowplow/lib/org.apache.commons.commons-collections4-4.4.jar:/home/snowplow/lib/net.minidev.accessors-smart-2.4.9.jar:/home/snowplow/lib/org.apache.commons.commons-csv-1.4.jar:/home/snowplow/lib/commons-io.commons-io-2.5.jar:/home/snowplow/lib/com.github.seancfoley.ipaddress-5.3.1.jar:/home/snowplow/lib/org.apache.httpcomponents.client5.httpclient5-5.2.1.jar:/home/snowplow/lib/com.github.ben-manes.caffeine.caffeine-3.1.2.jar:/home/snowplow/lib/nl.basjes.collections.prefixmap-2.0.jar:/home/snowplow/lib/org.apache.logging.log4j.log4j-api-2.18.0.jar:/home/snowplow/lib/com.github.julien-truffaut.monocle-core_2.12-2.1.0.jar:/home/snowplow/lib/org.typelevel.discipline-munit_2.12-1.0.9.jar:/home/snowplow/lib/com.maxmind.geoip2.geoip2-2.13.1.jar:/home/snowplow/lib/org.parboiled.parboiled_2.12-2.1.7.jar:/home/snowplow/lib/com.github.mpilquist.simulacrum_2.12-0.19.0.jar:/home/snowplow/lib/org.joda.joda-convert-2.2.0.jar:/home/snowplow/lib/org.joda.joda-money-1.0.1.jar:/home/snowplow/lib/org.scala-lang.modules.scala-parser-combinators_2.12-1.1.1.jar:/home/snowplow/lib/com.snowplowanalytics.snowplow-scala-analytics-sdk_2.12-2.1.0.jar:/home/snowplow/lib/javax.annotation.javax.annotation-api-1.3.2.jar:/home/snowplow/lib/io.netty.netty-codec-dns-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-haproxy-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-memcache-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-mqtt-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-redis-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-smtp-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-socks-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-stomp-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-codec-xml-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-native-unix-common-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-handler-proxy-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-handler-ssl-ocsp-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-resolver-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-resolver-dns-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-rxtx-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-sctp-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-udt-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-classes-kqueue-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-resolver-dns-classes-macos-4.1.87.Final.jar:/home/snowplow/lib/io.netty.netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/home/snowplow/lib/io.netty.netty-transport-native-epoll-4.1.87.Final-linux-aarch_64.jar:/home/snowplow/lib/io.netty.netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/home/snowplow/lib/io.netty.netty-transport-native-kqueue-4.1.87.Final-osx-aarch_64.jar:/home/snowplow/lib/io.netty.netty-resolver-dns-native-macos-4.1.87.Final-osx-x86_64.jar:/home/snowplow/lib/io.netty.netty-resolver-dns-native-macos-4.1.87.Final-osx-aarch_64.jar:/home/snowplow/lib/org.typelevel.cats-kernel_2.12-2.7.0.jar:/home/snowplow/lib/org.typelevel.simulacrum-scalafix-annotations_2.12-0.5.4.jar:/home/snowplow/lib/io.circe.circe-numbers_2.12-0.14.1.jar:/home/snowplow/lib/com.ethlo.time.itu-1.5.1.jar:/home/snowplow/lib/com.github.cb372.scalacache-guava_2.12-0.28.0.jar:/home/snowplow/lib/com.github.cb372.scalacache-cats-effect_2.12-0.28.0.jar:/home/snowplow/lib/org.http4s.blaze-http_2.12-0.14.18.jar:/home/snowplow/lib/org.log4s.log4s_2.12-1.10.0.jar:/home/snowplow/lib/org.http4s.parboiled_2.12-2.0.1.jar:/home/snowplow/lib/io.chrisdavenport.vault_2.12-2.0.0.jar:/home/snowplow/lib/org.http4s.jawn-fs2_2.12-1.0.0.jar:/home/snowplow/lib/org.typelevel.jawn-parser_2.12-1.1.2.jar:/home/snowplow/lib/org.ow2.asm.asm-9.3.jar:/home/snowplow/lib/org.apache.httpcomponents.core5.httpcore5-5.2.jar:/home/snowplow/lib/org.apache.httpcomponents.core5.httpcore5-h2-5.2.jar:/home/snowplow/lib/org.typelevel.cats-free_2.12-2.1.1.jar:/home/snowplow/lib/org.scalameta.munit_2.12-0.7.26.jar:/home/snowplow/lib/org.scalameta.munit-scalacheck_2.12-0.7.26.jar:/home/snowplow/lib/org.typelevel.discipline-core_2.12-1.1.5.jar:/home/snowplow/lib/com.maxmind.db.maxmind-db-1.3.1.jar:/home/snowplow/lib/com.github.cb372.scalacache-core_2.12-0.28.0.jar:/home/snowplow/lib/org.http4s.blaze-core_2.12-0.14.18.jar:/home/snowplow/lib/com.twitter.hpack-1.0.2.jar:/home/snowplow/lib/io.chrisdavenport.unique_2.12-2.0.0.jar:/home/snowplow/lib/org.typelevel.cats-macros_2.12-2.1.1.jar:/home/snowplow/lib/org.scalameta.junit-interface-0.7.26.jar:/home/snowplow/lib/junit.junit-4.13.2.jar:/home/snowplow/lib/org.scalacheck.scalacheck_2.12-1.15.4.jar:/home/snowplow/lib/org.scala-sbt.test-interface-1.0.jar:/home/snowplow/lib/org.hamcrest.hamcrest-core-1.3.jar com.snowplowanalytics.snowplow.enrich.kinesis.Main --config /snowplow/config/enrich.hocon --iglu-config /snowplow/resolver/resolver.json --enrichments /snowplow/enrichments

4

My enrichment files were missing the .json extension. I added .json to all the files and it worked.

1 Like