MalformedURLException in logs

For engineers Troubleshooting
1

Hi,

I’ve completed the AWS quick-start example but am not seeing any events in the PostgreSQL atomic tables (the table exists, just no records). I can see that data is being written to S3 and the only error I can find in the logs is on the sp-postgres-loader-enriched-server instance. I’m not sure what this means or what I should do to resolve this?

[cats-effect-blocker-2] INFO  s.a.k.c.DeterministicShuffleShardSyncLeaderDecider - Successfully stopped leader election on the worker
[cats-effect-blocker-2] INFO  s.a.k.c.PeriodicShardSyncManager - Shutting down periodic shard sync task scheduler on worker ip-10-2-131-240.af-south-1.compute.internal:1e38fd0f-7e95-4b79-9a0a-bbb32d8e753b
[prefetch-cache-shardId-000000000000-0000] INFO  s.a.k.r.p.PrefetchRecordsPublisher - sp-enriched-stream:shardId-000000000000 :  Thread was interrupted, indicating shutdown was called on the cache.
Halting the source
java.net.MalformedURLException: no protocol: sp-iglu-lb-343644341.af-south-1.elb.amazonaws.com/api/schemas/com.snowplowanalytics.snowplow/web_page/jsonschema/1
	at java.base/java.net.URL.<init>(Unknown Source)
	at java.base/java.net.URL.<init>(Unknown Source)
	at java.base/java.net.URL.<init>(Unknown Source)
	at scalaj.http.HttpRequest.exec(Http.scala:343)
	at scalaj.http.HttpRequest.asString(Http.scala:492)
	at com.snowplowanalytics.iglu.client.resolver.registries.Utils$.$anonfun$getFromUri$1(Utils.scala:60)
	at map @ com.snowplowanalytics.iglu.client.resolver.registries.Utils$.getFromUri(Utils.scala:61)
	at traverse$extension @ com.snowplowanalytics.iglu.client.resolver.registries.RegistryLookup$.httpList(RegistryLookup.scala:235)
	at map @ com.snowplowanalytics.iglu.client.resolver.registries.RegistryLookup$.httpList(RegistryLookup.scala:236)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.traverseRepos(Resolver.scala:175)
	at map @ com.snowplowanalytics.iglu.client.resolver.Resolver$.$anonfun$traverseRepos$1(Resolver.scala:180)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.$anonfun$traverseRepos$1(Resolver.scala:180)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.traverseRepos(Resolver.scala:175)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.ResolverCache$.getItem(ResolverCache.scala:127)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver.listSchemas(Resolver.scala:98)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver.listSchemas(Resolver.scala:106)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at flatMap @ com.snowplowanalytics.snowplow.postgres.config.Cli$.fromRawConfig(Cli.scala:81)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at subflatMap @ com.snowplowanalytics.snowplow.postgres.shredding.transform$.shredJson(transform.scala:89)
	at parTraverse$extension @ com.snowplowanalytics.snowplow.postgres.shredding.transform$.shredEvent(transform.scala:48)
[ioapp-compute-0] INFO  c.z.h.HikariDataSource - HikariPool-1 - Shutdown initiated...
[ioapp-compute-0] INFO  c.z.h.HikariDataSource - HikariPool-1 - Shutdown completed.
java.net.MalformedURLException: no protocol: sp-iglu-lb-343644341.af-south-1.elb.amazonaws.com/api/schemas/com.snowplowanalytics.snowplow/web_page/jsonschema/1
	at java.base/java.net.URL.<init>(Unknown Source)
	at java.base/java.net.URL.<init>(Unknown Source)
	at java.base/java.net.URL.<init>(Unknown Source)
	at scalaj.http.HttpRequest.exec(Http.scala:343)
	at scalaj.http.HttpRequest.asString(Http.scala:492)
	at com.snowplowanalytics.iglu.client.resolver.registries.Utils$.$anonfun$getFromUri$1(Utils.scala:60)
	at map @ com.snowplowanalytics.iglu.client.resolver.registries.Utils$.getFromUri(Utils.scala:61)
	at traverse$extension @ com.snowplowanalytics.iglu.client.resolver.registries.RegistryLookup$.httpList(RegistryLookup.scala:235)
	at map @ com.snowplowanalytics.iglu.client.resolver.registries.RegistryLookup$.httpList(RegistryLookup.scala:236)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.traverseRepos(Resolver.scala:175)
	at map @ com.snowplowanalytics.iglu.client.resolver.Resolver$.$anonfun$traverseRepos$1(Resolver.scala:180)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.$anonfun$traverseRepos$1(Resolver.scala:180)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver$.traverseRepos(Resolver.scala:175)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.ResolverCache$.getItem(ResolverCache.scala:127)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver.listSchemas(Resolver.scala:98)
	at flatMap @ com.snowplowanalytics.iglu.client.resolver.Resolver.listSchemas(Resolver.scala:106)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at flatMap @ com.snowplowanalytics.snowplow.postgres.config.Cli$.fromRawConfig(Cli.scala:81)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at map @ com.snowplowanalytics.iglu.client.Client$.parseDefault(Client.scala:58)
	at subflatMap @ com.snowplowanalytics.snowplow.postgres.shredding.transform$.shredJson(transform.scala:89)
	at parTraverse$extension @ com.snowplowanalytics.snowplow.postgres.shredding.transform$.shredEvent(transform.scala:48)
[ioapp-compute-0] INFO  c.z.h.HikariDataSource - HikariPool-1 - Starting...
[ioapp-compute-0] INFO  c.z.h.HikariDataSource - HikariPool-1 - Start completed.
[ioapp-compute-1] INFO  c.s.s.p.s.utils - atomic.events table already exists
2

Hi @Laichzeit0,

Are you by any chance missing http:// in the iglu_server_dns_name Terraform variable (in the pipeline)?

2 Likes
3

Ah thank you that was the issue. Sorry I missed that.