Best practices to move Spectrum to a new system
search cancel

Best practices to move Spectrum to a new system

book

Article ID: 128599

calendar_today

Updated On: 09-11-2024

Products

Spectrum Network Observability

Issue/Introduction

This document outlines the steps needed to migrate or move your Spectrum installation from one system to another.

A common example of this is when the environment requires OS upgrades. These will often entail standing up new physical or virtual systems with new resources to support the OS upgrade.

How to migrate SpectroSERVER servers when the OS is upgraded?

How to migrate the OneClick servers when the OS is upgraded?

Environment

All supported DX NetOps Spectrum releases

Cause

Environmental requirements for OS upgrades on a regular basis.

Resolution

This covers a scenario where we are tied to OS upgrades requiring new systems. OS in-place upgrades are not possible in this scenario.

  • Migrating to new servers without upgrading the NetOps software version
  • Involves a DSS Spectrum environment with:
    • 1 or more SpectroSERVERs in a Primary/Secondary Fault-Tolerant Pair
    • 1 or more OneClick servers

NOTES:

  • Source system refers to the original existing system.
  • Destination system refers to the new system being built.
  • SS and OC systems can be moved in parallel to save time.
  • When installing Spectrum on the destination systems ensure the matching landscape type is set. If source is using huge or legacy, ensure the destination is installed using the same configuration.

Complete these steps.

  1. Prepare the new servers with the new OS as required by the environment.
  2. Ensure the new servers meet all System Requirements and Prerequisites
  3. Integrated with DX NetOps Portal?
    1. Recommended that the integration be disabled during the migration process.
    2. Enable it again when the migration is completed.
    3. To Enable/Disable the Spectrum Data Source:
      1. Log into the Portal UI.
      2. Go to Administration->Data Sources->Data Sources.
      3. Choose the Spectrum Data Source and set it to the Enabled or Disabled state as needed.
  4. Migrate the Primary SS
    1. Backup all necessary data from the Primary SS source system and shut down the server.
      • The Secondary FT SS should take over.
    2. New servers will be set to use the same name and IP as the old hosts? Before installing Spectrum:
      • Ensure the source system is shut down.
      • Change host name and IP on destination system to use the name and IP the source system used.
      • Validate DNS and IP resolution works properly before continuing.
    3. Install Spectrum on the Primary destination SS system. After installing Spectrum ensure the services are shut down and:
      1. If .hostrc file changes are required in the source system reproduce them in the destination system.
      2. Load the SSdb and Archive Manager DB.
        1. Load the SSdb with the SSdbload command.
          1. As the spectrum user
          2. Uncompress the backup if compressed (.gz, gzip -d <backupName>.SSdb.gz)
          3. Go to the $SPECROOT/SS/ directory and run:
            • ../SS-Tools/SSdbload -il <path_to_backup>.SSdb 
        2. Load the ArchMgr DB with the ddm_load command
          1. As the spectrum user
          2. Uncompress the backup if compressed
          3. Go to the $SPECROOT/SS/DDM directory and run:
            • ./ddm_load.pl -f <filename.mbi>
      3. Start the SSdb.
  5. Migrate the Secondary SS.
    1. Backup the source Secondary and shut it down.
      • Confirm new Primary SS takes over.
    2. New servers will be set to use the same name and IP as the old hosts? Before installing Spectrum:
      • Ensure the source system is shut down.
      • Change host name and IP on destination system to use the name and IP the source system used.
      • Validate DNS and IP resolution works properly before continuing.
    3. Install Spectrum on the Secondary destination SS system. After installing Spectrum ensure the services are shut down and:
      1. If .hostrc file changes are required in the source system reproduce them in the destination system.
      2. Run OLB to get SSdb from new Primary backed up and loaded on new destination Secondary.
      3. Start the SSdb.
      4. If a DDMDB was migrated on the Primary load it on the Secondary.
        1. Ensure processd, the SS and other related services are up.
        2. Ensure Archive Manager is down. It must be down, with MySql running, when the DDMDB is loaded.
        3. Load the ArchMgr DB with the ddm_load command
          1. As the spectrum user
          2. Uncompress the backup if compressed
          3. Go to the $SPECROOT/SS/DDM directory and run:
            • ./ddm_load.pl -f <filename.mbi>
        4. Start the Archive Manager.
    4. Validate Secondary shows properly in the OneClick Administration site Landscapes page.
  6. Migrate the OneClick server
    • Backup OC system and shut it down.
    • Change host name and IP on OC destination system.
      • Validate DNS and IP resolution works properly before continuing.
    • Install Spectrum OC on destination system.
      • Shut down tomcat and webtomcat services.
      • Confirm they are down.
      • Restore the backed up files from source to destination
      • Start the tomcat and webtomcat services.

 

Backup steps for SS

    1. SS Database (SSdb) backup
      1. Create a current backup using SSdbsave or the OLB backup in OC.
      2. Transfer the $SPECROOT/SS-DB-Backup folder to the destination system.
    2. Archive Manager DDMDB backup.
      • Generate the backup using:
        1. cd $SPECROOT/SS/DDM/
        2. ./ddm_save.pl -f ddmdb_date
    3. Alarm Notifier applications running on the SS?
      • Copy and move the Alarm Notifier folders/files from source to destination system
      • Ensure any required customized $SPECROOT/lib/SDPM/partslist/*.idb files are copied from source to destination system.
    4. Custom folder:
      1. cd $SPECROOT/
      2. tar -cvf custom.tar custom
      3. Transfer the custom.tar to the destination system and extract it post install.

Backup steps for OC

    1. Custom Folder:
      1. cd $SPECROOT/
      2. tar -cvf custom.tar custom
    2. OneClick Config + LDAP config if integrated.
      • $SPECROOT/tomcat/webapps/spectrum/META-INF/context.xml
    3. OneClick MySql database backups.
      • If your OneClick host serves as an SRM host, or as a NetOps Portal integration host, backup their databases.
        • For SRM be sure to backup the DB named reporting.
        • For the NetOps Portal integration be sure to backup the DB named netqos_integration.
        • This documentation covers how to back up those two databases.
      • If you have custom MIBs imported to the OC database follow the steps in the following KB article to backup and transfer it.
      • Load a MySQL database into the new OC host, shown using the netqos_integ database as an example.
        1. Move a copy of the backed up netqos_integ_backup.sql to the destination OC system.
        2. Change directories:
          • cd $SPECROOT/mysql/bin/
        3. Run:
          • ./mysql --defaults-file=../my-spectrum.cnf -uroot -p<password> netqos_integ < /<PathToFile>/netqos_integ_backup.sql
            • Replace <password> with the correct MySql DB password.
        4. NOTE: The same steps can be used for the reporting DB, just replace the DB name and files in the commands.
    4. Tomcat files:
      • The $SPECROOT/tomcat/conf/server.xml file.
      • The $SPECROOT/tomcat/bin/catalina.sh file to reset the -Xmx memory allocation settings.
    5. WebTomcat files:
      • The $SPECROOT/webtomcat/conf/server.xml file.
      • The following webswing files:
        • $SPECROOT/webtomcat/bin/webswing-admin.properties
        • $SPECROOT/webtomcat/bin/webswing.properties
        • $SPECROOT/webtomcat/webswing/webswing.config

Backup steps for the SpectrumDataPublisher

        • Backup and transfer the following files to the destination system.
          • <SDP_DIR>/config/ConnectorConfig.xml
          • Security file: <SDP_DIR>/secure.properties
          • Keystore for OneClick and OI certs: <SDP_DIR>/Security/

             

Additional Information

  • Multiple SS systems in your DSS?
    • Migrate the MLS SS first.
    • Continue with Primary, then Secondary pairs, one Fault-Tolerant pair at a time until completed.
  • Multiple OC systems in your environment?
    • Migrate at least one of the OC servers before the first Secondary SS is migrated.
    • After this migrate the remaining Primary/Secondary SS pairs.
    • Once all remaining Primary/Secondary SS pairs are migrated, migrate the remaining OC servers.