Schema not found in iglu server

[kim]

Background: Using opensource version - self hosted on my GCP VPC
Testing snowplow tracking locally. I was able to send pageview and structured events to my GCP warehouse, however, unable to send a self-describing custom event locally. Anyone else run into this issue? How did you resolve it?

Successful in uploading and updating schema with no errors (used lint method to validate).

Snowplow debugger tool shows schema not found

Snowplow tool shows valid schema

Schema: {
“description” : “Schema for Striim Developer sign up click event”,
“properties” : {
“name” : {
“description” : “”,
“type” : [
“string”,
“null”
],
“maxLength” : 128
},
“email” : {
“description” : “”,
“type” : [
“string”,
“null”
],
“maxLength” : 128
},
“source_adapter” : {
“description” : “”,
“type” : [
“string”,
“null”
],
“maxLength” : 128
},
“target_adapter” : {
“description” : “”,
“type” : [
“string”,
“null”
],
“maxLength” : 128
}
},
“additionalProperties” : false,
“type” : “object”,
“self” : {
“vendor” : “com.striim”,
“name” : “developer-signup”,
“format” : “jsonschema”,
“version” : “1-0-0”
},
“$schema” : “http://iglucentral.com/schemas/com.snowplowanalytics.self-desc/schema/jsonschema/1-0-0#”
}

[mike]

@kim

Snowplow debugger tool

Hi Kim - can you link which tool you are using for this screenshot?

[kim]

Hi mike - I’m using Snowplow Analytics Debugger - Chrome Web Store

[kfitzpatrick]

Did you restart the enricher to cache the new schema?

[mike]

You may be best off emailing the developer as we don’t officially support that extension. Our official one is here.

[kim]

If we ignore the extension - Is there another way to debug the schema? Do you notice anything wrong with the schema/iglu server provided?

[kim]

I’m using the open source version. Is enricher something in BDP?

[mike]

Looks good to me - that seems like it would validate. The enrichment process is open source.

[kim]

Yes i restarted the enricher. still wasn’t able to see any data in my warehouse

[kim]

Mike - i’m using GCP. Is it necessary to have an ssl certificate to be able to send events to my GCP bigquery warehouse?

[mike]

You will need (ideally) a SSL cert on your load balancer where you are sending data but BigQuery doesn’t need anything.

[kim]

This is how i’m calling the method trackSelfDescribingEvent. Before this, I invoke the newTracker method with my collector url. Does this look correct?

[kfitzpatrick]

Kim - What about your IGLU resolver? Have you configured this?

[Moritz_Bauer]

The iglu server url seems to be wrong?

It has an url to iglucentral.com which is not under your control, it should be the url of your iglu server I think?!

[mike]

Good spot - the resolver is trying to resolve your custom schema against Iglu rather than your Iglu repository which should use the same hostname as you are uploading your schema too.

[kim]

what is the hostname? Is that the same as the collector_url? Which part of the code needs to change?

[mike]

The hostname should be the hostname for your Iglu server - that is wherever you pushed your schema to in the first image.

Your tracking code won’t need to change but your resolver config (as part of your enrichment configuration) should point to this Iglu Server as well to ensure it can find the schemas you are hosting.

[kdrabh]

Hi! I’m working with Kim on this, and specifically trying to the SSL certificate side of it to work. When it comes to the Iglu resolver, to our knowledge, that was set up by Terraform right? We followed the quick start guide to get our iglu server and iglu pipeline running (the quick start guide for the community edition using GCP), so we were aware that the resolver is not something we have to set up manually - is this not the case?

[josh]

Hi @kdrabh as long you have set these values correctly to your Iglu Server and have uploaded your schemas into that Iglu Server then the resolver should be correct for your deployment.

[ridham]

Hey Kim,

I am also trying to push the custom json schema to iglu server but I am not able to figure it out because when we used the api request to generate the keygen for the create and delete for the iglu server we got the error says {“message”:“Not sufficient privileges to create keys”}.

When we are using the igluctl it the error is “JSON schema in [./myschema.json] does not correspond to its metadata [iglu:com.acme/test_schema/jsonschema/1-0-0]
Cannot read [./myschema.json]: no valid JSON Schemas”

Just want to know how did you push your schema to the Iglu Server?