Elastic Loader Setup Problem Version

For engineers AWS real-time pipeline
1

As 1 look into 0.10.0 document it said,

Getting started

First off, install and set up Elasticsearch version 5.x or 2.x.x. For more information check out the installation guide.

I used elasticsearch 5.6.3 but when I execute the option to create index at elasticsearch (snowplow index) it show an error message.

{
   "error": {
      "root_cause": [
         {
            "type": "mapper_parsing_exception",
            "reason": "Failed to parse mapping [enriched]: [_ttl] is removed in 5.0. As a replacement, you should use time based indexes or cron a delete-by-query with a range query on a timestamp field."
         }
      ],
      "type": "mapper_parsing_exception",
      "reason": "Failed to parse mapping [enriched]: [_ttl] is removed in 5.0. As a replacement, you should use time based indexes or cron a delete-by-query with a range query on a timestamp field.",
      "caused_by": {
         "type": "illegal_argument_exception",
         "reason": "[_ttl] is removed in 5.0. As a replacement, you should use time based indexes or cron a delete-by-query with a range query on a timestamp field."
      }
   },
   "status": 400
}

Which version that we better use for current elasticsearch storage?

Thank you

2

Elasticsearch deprecated TTL starting with version 5.x and they said it’s not coming back probably ever :slight_smile: It was replaced with delete-by-query plugin which was later integrated into delete-by-query API in version 6.

1 Like