Not enough space to cache xxx - shredding failing

For engineers AWS batch pipeline (Legacy)
4

Hey @mjensen, you might want to have a look at R89 Spark job underutilizing cluster where we’ve been brainstorming why the Spark cluster is not fully used.