SpectrumDataPublisher Group Filter Not Working As Expected

Products

• DX NetOps

Issue/Introduction

We are only seeing a fraction of the devices expected in DXOI from Spectrum. The SpectrumDataPublisher (SDP) was configured to only publish
   devices contained within a Global Collection into DXOI. We are only seeing a fraction of the number of devices published though.


ConnectorConfig.xml
        <GroupFilterConfiguration>
            <!-- One or more group names as text or a single regular expression to filter the inventory from Spectrum -->
            <!-- <GroupFilterValue>GC1,GC2,GC3</GroupFilterValue> -->
            <!-- <GroupFilterValue>^GC.*</GroupFilterValue>  -->
            <GroupFilterValue>zDXOI</GroupFilterValue>
            <FilterTypeRegEx>false</FilterTypeRegEx>
            <!--true or false , if true GroupFiltered models will send delete request to TAS -->
            <DeleteFilteredItems>true</DeleteFilteredItems>
        </GroupFilterConfiguration>

Environment

Spectrum
DXOI (DX02)

Cause

The CollectionsModelNameString/0x12adb attribute on the devices did not have the correct name. As it turns out the Global Collection was
    renamed and the CollectionsModelNameString was not updated with the new name and as a result most models were excluded from
    being published in DXOI.


{"@id":"0x129fa","$":"0x60481eb"},{"@id":"0x10000","$":"GnSNMPDev"},{"@id":"0x1006e","$":"DEVICENAMEA"},{"@id":"0x11ee8","$":"4"},{"@id":"0x12d7f","$":"###.###.###.###"},{"@id":"0x1000a","$":"2"},{"@id":"0x12adb","$":"aDXOI:Tier 1 Devices"},{"@id":"0x129e7","$":"Universe:NorthEast:NewYork:Melville"},{"@id":"0x13214","$":"0"},{"@id":"0x110df","$":"##:##:##:##:##:##"},{"@id":"0x11d42","$":"xxxxxxxxxxx"}],"interfaces":[{"attributes":[

The attribute reflected the original Global Collection name 'aDXOI' instead of 'zDXOI' which would match the specified GroupFilter.

Resolution

Deleted and recreated the Global Collection

• deleted the Global Collection
  
  
• waited 30mins to allow for enough time for cleanup and to play it safe
  
  
• recreated the Global Collection with the desired name that matches the GroupFilter config
  
  
• restarted the SpectrumDataPublisher
  
  
  

After a short period of the SDP being restarted, all expected devices were published to and seen in DXOI (DX02)

Additional Information

How to enable Topology Debug

1. stop the data publisher
   
      ./run.sh stop
   
   
2. rename the topology.log file
      cd <SDPRootDir>/logs/
      mv topology.log topology.log.old
   
   
3. enable topology logging to trace
   
     cd <SDPRootDir>/config/
     vi log4j2.properties
   
   Set topoLogger to trace
     logger.topoLogger.level = trace
   
   
   
   
   
   
4.   Start SDP
   
     cd <SDPRootDir>/
     ./run.sh start
   
   
   

    This will log to <SDPRootDir>/logs/topology.log