5.2 - How to migrate Identity Cache

Mappings has been changed for the index aspire-identitycache in version 5.2. The action you must take depends on the need to preserve existing data:

No need to preserve existing data
Convert existing data

In all code blocks below Kibana is expected to be used for sending requests to Elasticsearch.

No need to preserve existing data

In that case simply delete existing index after stopping Aspire. When you start Aspire 5.2 version the index will be automatically created with the new mapping.

DELETE aspire-identitycache

Convert existing data

Stop Aspire
Create new index aspire-identitycache_new with new 5.2 mapping
Run reindex script to convert data from the old index aspire-identitycache to the new one aspire-identitycache_new
Delete old index aspire-identitycache
Create alias aspire-identitycache and assign it to the new index aspire-identitycache_new
Start Aspire 5.2

Create new index aspire-identitycache_new with new 5.2 mapping

Warning

If you want to preserve settings related to the number of shards or replicas, you must also include the 'settings' part.

PUT aspire-identitycache_new
    "mappings": {
      "properties": {
        "identity": {
          "properties": {
            "seedId": {
              "type": "keyword"
            },
            "timestamp": {
              "type": "keyword"
            }
          }
        }
      },
      "dynamic_templates": [
        {
          "all_as_keyword": {
            "path_match": "identity.attributes.*",
            "mapping": {
              "type": "keyword"
            }
          }
        },
        {
          "date_to_string": {
            "match_mapping_type": "date",
            "mapping": {
              "type": "text"
            }
          }
        },
        {
          "boolean_to_string": {
            "match_mapping_type": "boolean",
            "mapping": {
              "type": "text"
            }
          }
        },
        {
          "long_to_string": {
            "match_mapping_type": "long",
            "mapping": {
              "type": "text"
            }
          }
        },
        {
          "double_to_string": {
            "match_mapping_type": "double",
            "mapping": {
              "type": "text"
            }
          }
        },
        {
          "binary_to_string": {
            "match_mapping_type": "binary",
            "mapping": {
              "type": "text"
            }
          }
        }
      ]
    }

Run reindex script

POST _reindex
{
  "source": {
    "index": "aspire-identitycache"
  },
  "dest": {
    "index": "aspire-identitycache_new"
  },
  "script": {
    "lang": "painless",
    "source": """
    String seedHash = null;
    Map seedHashObject = null;
    
    def identity = ctx._source.identity;
    if (identity != null) {
      for (def entry : identity.entrySet()) {
        def val = entry.getValue();
        if (val instanceof Map && val.containsKey('attributes')) {
          seedHash = entry.getKey();
          seedHashObject = val;
        }
      }
    }
    
    if(seedHash != null){
          Map attributes =  seedHashObject.get('attributes');
      identity.remove(seedHash);
      identity.put('attributes', attributes);
    }

      """
  }
}

Delete old index

DELETE aspire-identitycache

Create new alias

POST _aliases
{
  "actions": [
    {
      "add": {
        "index": "aspire-identitycache_new",
        "alias": "aspire-identitycache"
      }
    }
  ]
}

Page tree