OOM Data Migration to Casablanca

Owned by Amit Sinha
Last updated: Apr 03, 2019
3 min read

Data Migration from Amsterdam to Casablanca

  • AAI

  • SO

  • SDC

  • SDNC


Data Migration

Steps for Data Migration

Data Migration

Steps for Data Migration







AAI



Amsterdam Prod environment

Step 1: Extract Data from A&AI HBase DB

  • Connect to A&AI Environment

  • Go inside aai-resources Pod

  • Change user to aaiadmin & Go to /opt/app/aai-resources directory

  • Execute the below command :

aaiadmin@aai-resources-7bc44cb67f-ls4nt:/opt/app/aai-resources$ sh bin/dataSnapshot.sh



Step 2: Copy the Snapshot

From Amsterdam aai-resources Pod to Casablanca aai-graphadmin Pod on location (/opt/app/aai-graphadmin/logs/data/dataSnapshots/)

Casablanca Prod environment

Step 3: Import snapshot to Casablanca Cassandra DB

  • Connect to A&AI Casablanca Environment

  • Go inside aai-graphadmin pod 

  • Change user to aaiadmin & Go to /opt/app/aai-graphadmin/bin directory

  • Import snapshot data to Cassandra DB using below command:

aaiadmin@aai-graphadmin:/opt/app/aai-graphadmin/bin$ ./dataRestoreFromSnapshot.sh <Datasnapshot-FileName> <Datasnapshot-FileName>: File copied in Step 2 from Amsterdam to Casablanca aai-graphadmin Pod (Only name required, full path is not required)



Step 4: Migrate Database Schema

Migrate Schema using below command on same location (/opt/app/aai-graphadmin/bin directory):

aaiadmin@aai-graphadmin:/opt/app/aai-graphadmin/bin$ ./run_Migrations.sh -e UpdateAaiUriIndexMigration --commit --skipPreMigrationSnapShot --runDisabled RebuildAllEdges



Step 5: Migration Verification

Verify there are no errors using below command on same location (/opt/app/aai-graphadmin/bin directory):



Step 6: Restart aai-resources pod









SO



SO database will be migrated from Amsterdam to Casablanca during installation/startup.

Step 1: New Prod environment (Casablanca):

To allow SO mariadb container to run the migrations following overrides must be provided as override file or command-line:

Step 2. Install SO (Casablanca) using OOM

Step 3. Verify Migration steps using logs

select * from requestdb.schema_version where success =0
select * from catalogdb.schema_version where success =0

The above two queries should return no record







SDC

Step 1:

Execute nodetool flush utility on the Amsterdam’s Cassandra instance to flush the memtables to disk

  • Connect to SDC Amsterdam Environment

  • Go inside sdc-cs pod

  • Execute command: nodetool flush

Step 2:

Copy the Cassandra data from Amsterdam to Casablanca:

  1. Source: /dockerdata-nfs/<namespace>/sdc/sdc-cs/CS/data

  2. Destination: /dockerdata-nfs/<Release name>-sdc/sdc/sdc-cs/CS/ (This directory has to be created breforehand).

    Note: replace /dockerdata-nfs with real nfs mount path.

Step 3:

Following overrides must be provided either via overrides file or via command line:


Step 4: Install SDC (Casablanca) using OOM

Step 5: Verify the migration job (with name containing <migrate-cassandra>) is executed successfully (check for this pod's log using the kubectl logs command) after all the SDC pods are up and running.

Step 6: Redistribute the migrated services

Step 7: After completion of migration, set the "migration: false" in the override file for future upgrades







SDNC



Step 1 : MD-SAL Data backup from Amsterdam Prod env

  1. Export Amsterdam data to a file using OpenDaylight API. This will create backup file with given name (file-path in request body) on Amsterdam ODL pod – can be identified by name sdnc-<UUID>
    Request details to export data:



  2. Take the backup file out of the Amsterdam sdnc pod



3. Transfer the backup file to Casablanca ODL instance before startup.

Target directory: /dockerdata-nfs/<namespace>/sdnc/migration.

This directory is mapped to /opt/opendaylight/clustered-datastore-restore on Casablanca sdnc pod.

Note1: /dockerdata-nfs/<namespace>/sdnc/migration must be created manually.

Note2: Replace /dockerdata-nfs with actual nfs mount path.

Step 2 : Overrides for MySql Data Migration

  1. Following overrides must be provided either via overrides file or via command line:

Step 3: Install SDNC (Casablanca) using OOM

Step 4: After completion of migration, set the "migration: enabled: false" in the override file for future upgrades