Snowflake Loader Issues

[Nick_Latocha]

I’m having issues running the snowflake loader and getting the following error message:

Caused by: shadeaws.services.dynamodbv2.model.AmazonDynamoDBException: One or more parameter values were invalid: Missing the key RunId in the item (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException;

I can see there are items in the dynamo table and they all have RunId field so not sure what is causing this issue.

Nick

[egor]

Hi @Nick_Latocha,

• Is this the first run of the app? what version of the app you are using?
• At which step does the failure take place - transformation or loading?
• How the DynamoDB table has been created?
• Have you performed a back-population of the table? (https://github.com/snowplow-incubator/snowplow-snowflake-loader/wiki/Setup-Guide#back-populating-run-manifest)

[Nick_Latocha]

I found the issue. The playbook config I got from the documentation was referencing v4 of the Snowflake loader but all of the other config was for v5. Updated the playbook to use the latest version.

[Nick_Latocha]

Anyone know if I can contribute and update the wiki/docs?

[Ryan_Newsome]

Hi @Nick_Latocha. Was updating references to versions of Snowflake loader the only change you did to get it working?

I ask as I’m getting the same error message (Missing the key RunId). I’m using V0.60 and and all the correct config to my understanding. I double checked the DynamoDB table setup and RunId is correctly set as the partition key.

The only thing I can think of is I have the “id” value wrong in the event-manifest.json file (I’m using the DynamoDB tableid value for this)

Ryan

edit: managed to figure what the issue is… highlighted here : Snowflake loader - cross-batch deduplication configuration issues