NetWorker nsrTools - Part 3
nsrTools is an interactive command-line utility created by the DELL EMC Field support which bundles different support tools to have one tool in one place. The tool can be downloaded from the EMC FTP link - ftp://nwc:nwc@ftp.emc.com/nsrTools/nsrTools.zip.
Compatibility :
This tool supports NetWorker version 18 and newer releases.Operating systems:
- Windows 2012 64bit or newer
- Linuxt 64bit distributions:
- CentOS / RHEL 6.x, 7.x, 8.x
- SUSE SLES 11.x, 12.x or newer
There is no installation required and nsr tools is read-only so no configuration change will be done to your system so this is pretty safe to tinker around with.
There are a lot of tools packed into this one package and covering all of it in one article is going to make it a lot lengthier than I want. Thus this is going to be a multipart article. n this part of the video we will logging we will look at
- Data Domain mtree explorer
- JobsDB Processes Activity
- Daemon Log common errors
- Data Domain Device integrity check
- Advanced Volume info list
Lets go ahead and launch the nsrTools.
nsrTools, on launch you will be greeted with the information about your current NetWorker server.
Data Domain mtree explorer
The Data Domain mtree explorer feature emulates something like ‘sfs_dump’. For those of you are not aware what a sfs_dump is - sfs-dump is a se command on the Data Domain used to get the list of files on the Data Domain or just within a specific MTree or directory. This is usually done by going into the SE mode on the Data Domain but here nsrtools uses the ddboost API to access the mtree and get similar information from the Data Domain. The information is dumped into a .csv file and provides the following attributes:- Long SSID
- Shot SSID
- Timestamp
- Capacity
- Amount of backup files in save set
- Is SSID Valid (if xx >= files, then SSID is valid
- Full Mtree Path
ddr mtree explorer. Follow the prompts to select the appropriate Data Domain and MTree
ddr mtree explorer
[nsrTools CLI]» ddr mtree explorer
2020/08/12 06:31:06 DBG: The task selection received an argument: 'ddr mtree explorer'. Processing with it ...
2020/08/12 06:31:06 === Starting Mtree Explorer Engine ===
2020/08/12 06:31:06 INFO: Start to collect information from NetWorker server host: nsr-server.crazyrov.com
2020/08/12 06:31:06 INFO: Pre check start. The DDBoost mtree explorer require check for ddboost library ...
2020/08/12 06:31:06 INFO: Pre check successfuly finished. All good. Processing ...
name: mydd.crazyrov.com;
username: boost;
2020/08/12 06:31:06 INFO: Found Data Domain Host: boost@mydd.crazyrov.com Adding to the list.
1). DDR Host: boost@mydd.crazyrov.com
2). DDR Host: Other DDR host then above
QUESTION: What Data Domain system 1-2 require DDBoost precert logging enabled? Please specify? 1
2020/08/12 06:31:07 INFO: The choice was set to 1
QUESTION: Please specify password for Data Domain system boost@mydd.crazyrov.com? 'XXXXXXX'
2020/08/12 06:31:13 INFO: The Data Domain system boost@mydd.crazyrov.com was set with password: 'XXXXXXX'
QUESTION: If informations are correct please confirm with Yes? Yes
2020/08/12 06:31:16 INFO: Connection established between DDR: mydd.crazyrov.com and localhost: 192.168.75.20:49510 with time out of 2 seconds.
2020/08/12 06:31:16 INFO: Remote Address : 192.168.75.30:22
2020/08/12 06:31:16 INFO: Local Address : 192.168.75.20:49510
2020/08/12 06:31:16 INFO: Connecting to DDR host: boost@mydd.crazyrov.com and suls
2020/08/12 06:31:16 INFO: Required nsrddsh command output: suls
.
2020/08/12 06:31:17 INFO: The data domain task: suls finished.
1). Mtree Name: nsr-server
QUESTION: What Data Domain mtree [1-1] to scann Please specify an integer? 1
2020/08/12 06:31:22 INFO: The choice was set to mtree 1
2020/08/12 06:31:22 INFO: The meta data collcation is going to happened with Mtree: nsr-server
2020/08/12 06:31:22 INFO: Spawning child process to gather raw meta data. This can take some time depend on DDR capacity
2020/08/12 06:31:22 INFO: Connecting to DDR host: boost@mydd.crazyrov.com and file_list nsr-server
2020/08/12 06:31:22 INFO: Required nsrddsh command output: file_list nsr-server
.
2020/08/12 06:31:23 INFO: The data domain task: file_list nsr-server finished.
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Mtree List '/nsr-server/' (just first couple of records). ┃
┣━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ ┃ SSID ┃ SHORT SSID ┃ TIMESTAMP ┃ CAPACITY ┃ FILES ┃ FULL MTREE PATH ┃
┣━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━╋━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ 1 ┃ b979434e-00000006-f82bcdca-5f2bcdca-00090c00-463a8829 ┃ 4163620298 ┃ 1596706250 ┃ 980 ┃ 2 ┃ /nsr-server/prod/03/11/b979434e-00000006-f82bcdca-5f2bcdca-00090c00-463a8829 ┃
┃ 2 ┃ b5edfe6a-00000006-f92bc110-5f2bc110-00080c00-463a8829 ┃ 4180394256 ┃ 1596702992 ┃ 980 ┃ 2 ┃ /nsr-server/prod/26/20/b5edfe6a-00000006-f92bc110-5f2bc110-00080c00-463a8829 ┃
┃ 3 ┃ 3faff759-00000006-f42bea30-5f2bea30-000d0c00-463a8829 ┃ 4096518704 ┃ 1596713520 ┃ 980 ┃ 2 ┃ /nsr-server/prod/40/60/3faff759-00000006-f42bea30-5f2bea30-000d0c00-463a8829 ┃
┃ 4 ┃ e9048004-00000006-fe331c07-5f331c07-00030c00-bde2cb29 ┃ 4264762375 ┃ 1597185031 ┃ 9896 ┃ 2 ┃ /nsr-server/prod/62/51/e9048004-00000006-fe331c07-5f331c07-00030c00-bde2cb29 ┃
┃ 5 ┃ 2f309ab3-00000006-f62bd263-5f2bd263-000b0c00-463a8829 ┃ 4130067043 ┃ 1596707427 ┃ 25896 ┃ 2 ┃ /nsr-server/prod/68/93/2f309ab3-00000006-f62bd263-5f2bd263-000b0c00-463a8829 ┃
┃ 6 ┃ eefceba3-00000006-fe2e2a75-5f2e2a75-00030c00-463a8829 ┃ 4264438389 ┃ 1596861045 ┃ 980 ┃ 2 ┃ /nsr-server/prod/83/77/eefceba3-00000006-fe2e2a75-5f2e2a75-00030c00-463a8829 ┃
┃ 7 ┃ 96137a27-00000006-f32bf878-5f2bf878-000e0c00-463a8829 ┃ 4079745144 ┃ 1596717176 ┃ 980 ┃ 2 ┃ /nsr-server/prod/15/96/96137a27-00000006-f32bf878-5f2bf878-000e0c00-463a8829 ┃
┃ 8 ┃ ff553e53-00000006-fd332a2b-5f332a2b-00040c00-bde2cb29 ┃ 4247988779 ┃ 1597188651 ┃ 9896 ┃ 2 ┃ /nsr-server/prod/25/26/ff553e53-00000006-fd332a2b-5f332a2b-00040c00-bde2cb29 ┃
┃ 9 ┃ 9e89d0ca-00000006-ff2bb73a-5f2bb73a-00020c00-463a8829 ┃ 4281055034 ┃ 1596700474 ┃ 25968324 ┃ 2 ┃ /nsr-server/prod/68/73/9e89d0ca-00000006-ff2bb73a-5f2bb73a-00020c00-463a8829 ┃
┃ 10 ┃ 1c96a044-00000006-ff330df7-5f330df7-00020c00-bde2cb29 ┃ 4281535991 ┃ 1597181431 ┃ 9896 ┃ 2 ┃ /nsr-server/prod/69/29/1c96a044-00000006-ff330df7-5f330df7-00020c00-bde2cb29 ┃
┗━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━┻━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
2020/08/12 06:31:23 INFO: Starting to create CSV file. File path location: /home/rovin/data/mtree_nsr-server.csv
2020/08/12 06:31:23 INFO: The CSV file successfully done. Path: /home/rovin/data/mtree_nsr-server.csv
2020/08/12 06:31:23 INFO: We are done with Mtree Explorer Engine, all good. Going back to main nsrTools meny.
JobsDB Processes Activity
This feature collects data from the jobsdb and counts how many processes were done in the last 72hrs. To use this feature run the commandjobsdb activity on the nsrtools.
The jobs that are tracked by this command include workflow, savefs, save, clone, recover, bootstrap and vProxy.
jobsdb activity
[nsrTools CLI]» jobsdb activity 2020/08/12 06:35:41 === Starting JobsDB Activity Engine for NWS: nsr-server.crazyrov.com === 2020/08/12 06:35:41 INFO: Starting to collect inforation for Save Jobs from NetWorker JobsDB: show job state; p type: save job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Clone Jobs from NetWorker JobsDB: show job state; p type: clone job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Workflow Jobs from NetWorker JobsDB: show job state; p type: workflow job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Bootstr Jobs from NetWorker JobsDB: show job state; p type: bootstrap save job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Recover Jobs from NetWorker JobsDB: show job state; p type: recover job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for VProxy Jobs from NetWorker JobsDB: show job state; p type: vproxysave job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Savefs Jobs from NetWorker JobsDB: show job state; p type: savefs job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. 2020/08/12 06:35:41 INFO: Starting to collect inforation for Savefs Jobs from NetWorker JobsDB: show job state; p type: savefs job 2020/08/12 06:35:41 INFO: Spawning child process to jobquery, NetWorker server: nsr-server.crazyrov.com. ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ ┃ NSR JobsDB activity overview of last 72 hrs ┃ ┣━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━┫ ┃ ┃ JOB NAME ┃ COMPLETED ┃ ACTIVE ┃ SESSION ACTIVE ┃ QUEUED ┃ ┣━━━╋━━━━━━━━━━━╋━━━━━━━━━━━╋━━━━━━━━╋━━━━━━━━━━━━━━━━╋━━━━━━━━┫ ┃ 1 ┃ WORKFLOW ┃ 17 ┃ 0 ┃ -- ┃ -- ┃ ┃ 2 ┃ SAVEFS ┃ 11 ┃ 0 ┃ -- ┃ -- ┃ ┃ 3 ┃ SAVE ┃ 27 ┃ 0 ┃ 0 ┃ 0 ┃ ┃ 4 ┃ CLONE ┃ 0 ┃ 0 ┃ 0 ┃ -- ┃ ┃ 5 ┃ RECOVER ┃ 0 ┃ 0 ┃ 0 ┃ -- ┃ ┃ 6 ┃ BOOTSTRAP ┃ 0 ┃ 0 ┃ -- ┃ -- ┃ ┃ 7 ┃ VPROXY ┃ 1 ┃ 0 ┃ 0 ┃ -- ┃ ┗━━━┻━━━━━━━━━━━┻━━━━━━━━━━━┻━━━━━━━━┻━━━━━━━━━━━━━━━━┻━━━━━━━━┛ NOTE: This is current meta data snapshot from JobsDB.
Daemon Log common errors
This feature is used to search for most common error codes in NetWorker’s daemon.raw log. The errors are being updated with every release. To use this feature run the commandlog common errors. The out table contains all the errors that it can find in the daemon.raw, this is yet another
handy tool in case you find it hard to look at the log file to find the errors during troubleshooting.
log common errors
nsrTools CLI]» log common errors 2020/05/22 02:04:47 === Starting Daemon Log Common Errors Engine === QUESTION: Do you want to check daemon.raw on current NetWorker server nws01fss.lsc.local? (yes / no) no QUESTION: Please specify full path to the daemon.raw file? daemon2.raw QUESTION: By default nsrTools check last 24 hrs of log. If required more/less than 24hrs please splecifiy: 4, 8,12, 36, 48, 96 ... or just hit enter? 48 2020/05/22 02:04:59 INFO: The daemon log check for most common erros set to: 48 hrs. (DEBUG: 172800) 2020/05/22 02:04:59 21 41 usgsodd001dr.jba.net_GSO_FSH_Prod_CL_Full 71193 1587396692 0 0 0 21044 21864 0 usgbaxpnnw01p.jba.net nsrd NSR info 9 %s %s: %s 3 11 21 2944:Write completion 11 12 19362:Notice 49 67 67896 30 Writing to volume %s completed 1 22 19 SUSVMProdBKDiff.001 2020/05/22 02:04:59 INFO: The last epoch time stam in daemon log is: 1587396692 which is: 2020-04-20 17:31:32 +0200 CEST. Going back from that time stamp. ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ ┃ Most common errors found in daemon.raw from: 2020-04-20 17:31:32 +0200 CEST to: 2020-04-18 17:31:32 +0200 CEST. [48 hrs]. ┃ ┣━━━┳━━━━━━━━━━┳━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫ ┃ ┃ ERR.CODE ┃ SEV ┃ PROCESS ┃ ERR.FOUND ┃ KBA ┃ ERROR CODE ┃ ┣━━━╋━━━━━━━━━━╋━━━━━╋━━━━━━━━━━╋━━━━━━━━━━━╋━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫ ┃ 1 ┃ 106320 ┃ 5 ┃ nsrexecd ┃ 10 ┃ KB #┃ nsrexecd SSL critical Unable to complete SSL handshake with nsrexecd on host ┃ ┃ 2 ┃ 172089 ┃ 3 ┃ nsrexecd ┃ 14 ┃ KB # ┃ nsrmmd RPC error Unable to create the connection with 'client' ┃ ┃ 3 ┃ 97259 ┃ 4 ┃ nsrexecd ┃ 1 ┃ KB # ┃ nsrexecd RPC severe Unable to communicate with the nsrd process running on the host ┃ ┃ 4 ┃ 144502 ┃ 5 ┃ nsrd ┃ 19621 ┃ KB # ┃ nsrd AUTHC critical Unable to set user privileges based on user token for SYSTEM ┃ ┃ 5 ┃ 89879 ┃ 5 ┃ nsrexecd ┃ 6 ┃ KB # ┃ nsrexecd GSS critical An authentication request from 'XYZ'. The 'NSR peer information' provided did not match ┃ ┃ 6 ┃ 173680 ┃ 3 ┃ nsrmmd ┃ 179 ┃ KB # ┃ nsrmmd RPC error RPC client handle: No connection could be made because the target machine actively refused it ┃ ┃ 7 ┃ 173677 ┃ 5 ┃ nsrmmd ┃ 181 ┃ KB # ┃ nsrmmd RPC critical Check whether the client services are running on the host ┃ ┃ 8 ┃ 88876 ┃ 5 ┃ nsrd ┃ 3 ┃ KB # ┃ nsrd NSR critical Unable to handle volume for save ┃ ┃ 9 ┃ 172999 ┃ 5 ┃ nsrmmd ┃ 4 ┃ KB # ┃ nsrmmd RPC critical Clone operation failed: Can't push RPC module ┃ ┗━━━┻━━━━━━━━━━┻━━━━━┻━━━━━━━━━━┻━━━━━━━━━━━┻━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛ INFO: Please check environment for mentioned Severity 5 errors 2020/05/22 02:05:06 INFO: We are done with Daemon Log Common Errors Engine section. Going back to Main Meny ...
Data Domain Device integrity check
This is a neat feature as well, so this feature is used to check the integrity of the Data domain device by cross checking the particular DD device/volume metadata with the media database meta data content. This is done using the scanner command. To use this feature run the commandintegrity ddboost check from the nsrtools prompt.
In case there is a mismatch in the information between the media database and the DD device, the details of the missing saveset will be displayed in the table as shown
below/on the screen.
integrity ddboost check
[nsrTools CLI]» integrity ddboost check
2020/05/12 23:49:33 Starting to check RPC activity against NetWorker processes.
2020/05/12 23:49:33 The NetWorker NSRD process is running. Processing...
2020/05/12 23:49:33 The NetWorker NSRMMDBD process is running. Processing...
2020/05/12 23:49:33 The NetWorker NSREXECD process is running. Processing...
2020/05/12 23:49:33 NetWorker devices overview based on 'nsrmm' output:
2020/05/12 23:49:33 The temporary query file name: nsrdbDevices for nsradmin created successfuly.
FINAL: nwNSRDBDevices [ddve621.lsc.local_bootStratp|bootstrap.001|"ddve621.lsc.local:/mylinuxbox001/bootStratp"|disk|Data Domain|Yes|NSR device|ddboost ddve621.lsc.local_fileSystemBackup|fileSystemBackup.001|"ddve621.lsc.local:/mylinuxbox001/fileSystemBackup"|disk|Data Domain|Yes|NSR device|ddboost foobar|foobarPool.001|"ddve621.lsc.local:/mylinuxbox001/foobar"|disk|Data Domain|Yes|NSR device|ddboost aftd01|mylinuxbox0001.local.blah.001|/aftd01|disk|adv_file|Yes|NSR device|]
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ NSR Devices Information. ┃
┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┫
┃ ┃ NAME ┃ VOLUME NAME ┃ DEVICE ACCESS INFORMATION ┃ MEDIA TYPE ┃ MEDIA FAMILY ┃ ENABLED ┃ RESOURCE TYPE ┃ REMOTE USER ┃
┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━━━╋━━━━━━━━━╋━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━┫
┃ 1 ┃ ddve621.lsc.local_bootStratp ┃ bootstrap.001 ┃ "ddve621.lsc.local:/mylinuxbox001/bootStratp" ┃ disk ┃ Data Domain ┃ Yes ┃ NSR device ┃ ddboost ┃
┃ 2 ┃ ddve621.lsc.local_fileSystemBackup ┃ fileSystemBackup.001 ┃ "ddve621.lsc.local:/mylinuxbox001/fileSystemBackup" ┃ disk ┃ Data Domain ┃ Yes ┃ NSR device ┃ ddboost ┃
┃ 3 ┃ foobar ┃ foobarPool.001 ┃ "ddve621.lsc.local:/mylinuxbox001/foobar" ┃ disk ┃ Data Domain ┃ Yes ┃ NSR device ┃ ddboost ┃
┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━━━┻━━━━━━━━━┻━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━┛
QUESTION: What device needs to be cross checked? Provide device row ID# [1-3]: 1
2020/05/12 23:49:37 Gathering NW MMDB information for Device: ddve621.lsc.local_bootStratp, Volume: bootstrap.001, Type: disk, => File: /root/nsrTools/tmp/mminfo.bootstrap.001.dat
2020/05/12 23:49:37 INFO: Starting two sub processes (mminfo and scanner) to collect meta data.
2020/05/12 23:49:37 INFO: The mminfo output file: /root/nsrTools/tmp/mminfo.bootstrap.001.dat
2020/05/12 23:49:37 INFO: The scanner outpput file: /root/nsrTools/tmp/scanner.bootstrap.001.sh.dat
2020/05/12 23:49:38 DONE: ===>
2020/05/12 23:49:43 INFO: Collection information from MMDB ongoing ... Still waiting for 'mminfo' to finish.
DEBUG: scanner **************** WARN: Could NOT match SSID: 7cd2e86f-00000006-c7b3c005-5eb3c005-003a0c00-4ca5e029 with NW MMDB.
Missing SCANNER SRC --> MMDB DST: map[dd057378-00000006-ceb30da3-5eb30da3-00330c00-4ca5e029:true]
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Missing Data Domain records ┃
┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ ┃ LONG SSID ┃ SHORT SSID ┃ CLONE ID ┃ SAVE TIME / BACKUP TIME ┃
┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ 1 ┃ dd057378-00000006-ceb30da3-5eb30da3-00330c00-4ca5e029 ┃ 3467840931 ┃ 1588792739 ┃ 2020-05-06 21:18:59 +0200 CEST ┃
┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
INFO: Those records exist in NW's MMDB but not on Data Domain
Missing MMDB SRC --> SCANNER DST: map[7cd2e86f-00000006-c7b3c005-5eb3c005-003a0c00-4ca5e029:true]
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Missing NetWorker Media DB records ┃
┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ ┃ LONG SSID ┃ SHORT SSID ┃ CLONE ID ┃ SAVE TIME / BACKUP TIME ┃
┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫
┃ 1 ┃ 7cd2e86f-00000006-c7b3c005-5eb3c005-003a0c00-4ca5e029 ┃ 3350446085 ┃ 1588838405 ┃ 2020-05-07 10:00:05 +0200 CEST ┃
┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
INFO: Those records exist on Data Domain but not in NW's MMDB
META DATA: /mylinuxbox001/bootStratp/82/92/notes/7cd2e86f-00000006-c7b3c005-5eb3c005-003a0c00-4ca5e029 /mylinuxbox001/bootStratp/82/92/7cd2e86f-00000006-c7b3c005-5eb3c005-003a0c00-4ca5e029
==>> /nsr/nmc/nmcdb_stage 3350446085 uk0lpvbsinf0 /nsr/nmc/nmcdb_stage 5/07/20 10:00 f 47631840 1286 3350446085 E 0 0
DONE SO FAR ... mminfo file size: 24021
Cloud Boost Device integrity check
This is similar to the feature mentioned above with the only difference is that feature is used to check the integrity of the cloudboost device. The command to use this feature isintegrity cb check.
File details here
[nsrTools CLI]» integrity cb check 2020/05/21 17:00:32 === Starting Cloud Boost Device Integrity check Engine for binky === 2020/05/21 17:00:32 Starting to check RPC activity against NetWorker processes. 2020/05/21 17:00:32 The NetWorker NSRD process is running. Processing... 2020/05/21 17:00:32 The NetWorker NSRMMDBD process is running. Processing... 2020/05/21 17:00:32 The NetWorker NSREXECD process is running. Processing... 2020/05/21 17:00:32 INFO: The temporary query file name 'C:\Users\Administrator\Desktop\shared\tmp\nsrdbDevices.query' for nsradmin created successfuly. 2020/05/21 17:00:35 INFO: The nsradmin returned output file 'C:\Users\Administrator\Desktop\shared\tmp\nsrdbDevices.query.output.dat'. Prsing NSR Attributes ... ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ ┃ NSR Cloud BoostDevices Information. ┃ ┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┫ ┃ ┃ NAME ┃ VOLUME NAME ┃ DEVICE ACCESS INFORMATION ┃ MEDIA TYPE ┃ MEDIA FAMILY ┃ ENABLED ┃ RESOURCE TYPE ┃ REMOTE USER ┃ ┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━╋━━━━━━━━━━━━━━╋━━━━━━━━━╋━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━┫ ┃ 1 ┃ rd=dmcboost.plsupport.lab.emc.com:base/17073638-CB-CLONE ┃ binky.isus.emc.com.006 ┃ "dmcboost.plsupport.lab.emc.com:base/17073638-CB-CLONE" ┃ Cloud Boost ┃ disk ┃ Yes ┃ NSR device ┃ remotebackup ┃ ┃ 2 ┃ rd=realpage-test.support.lab:base/17073638-clone1 ┃ 17073638clone.003 ┃ "realpage-test.support.lab:base/17073638-clone1" ┃ Cloud Boost ┃ disk ┃ Yes ┃ NSR device ┃ remotebackup ┃ ┃ 3 ┃ rd=realpage-test.support.lab:base/17073638-clone2 ┃ 17073638clone.002 ┃ "realpage-test.support.lab:base/17073638-clone2" ┃ Cloud Boost ┃ disk ┃ Yes ┃ NSR device ┃ remotebackup ┃ ┃ 4 ┃ rd=realpage-test.support.lab:base/17073638-clone3 ┃ 17073638clone.004 ┃ "realpage-test.support.lab:base/17073638-clone3" ┃ Cloud Boost ┃ disk ┃ Yes ┃ NSR device ┃ remotebackup ┃ ┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━┻━━━━━━━━━━━━━━┻━━━━━━━━━┻━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━┛ NOTE: The Cloud Boost devices only. QUESTION: What Cloud Boostdevice needs to be cross checked? Provide device row ID# [1-4] 1 INFO: The Device Integrity Check is going to cross check 'rd=dmcboost.plsupport.lab.emc.com:base/17073638-CB-CLONE'. 2020/05/21 17:01:10 INFO: Gathering NW MMDB information for Device: rd=dmcboost.plsupport.lab.emc.com:base/17073638-CB-CLONE, Volume: binky.isus.emc.com.006, Type: Cloud Boost, => File: C:\Users\Administrator\Desktop\shared\tmp\mmi 2020/05/21 17:01:10 INFO: Starting two sub processes (mminfo and scanner) to collect meta data for cross check process. 2020/05/21 17:01:10 INFO: The mminfo output file: C:\Users\Administrator\Desktop\shared\tmp\mminfo.binky.isus.emc.com.006.dat 2020/05/21 17:01:10 INFO: The scanner outpput file: C:\Users\Administrator\Desktop\shared\tmp\scanner.binky.isus.emc.com.006.sh.dat 2020/05/21 17:02:29 INFO: Collection information from MMDB ongoing ... Still waiting for 'mminfo' to finish. DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 4421fba3-00000006-acc66d6e-5ec66d6e-0655acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 312cdc5b-00000006-a3c66d7b-5ec66d7b-065eacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 83c36283-00000006-a0c66db7-5ec66db7-0661acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 9ec17d2d-00000006-d1c5a463-5ec5a463-0630acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: d251dccf-00000006-d3c5a462-5ec5a462-062eacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 14e2815f-00000006-d4c5a461-5ec5a461-062dacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 7b9ef0c5-00000006-aac66d70-5ec66d70-0657acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 9ff7026e-00000006-d5c5a460-5ec5a460-062cacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 300c259f-00000006-ccc5a467-5ec5a467-0635acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: acd6b705-00000006-d7c5a1ab-5ec5a1ab-062aacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: f338fe1f-00000006-a6c66d75-5ec66d75-065bacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: e8d5d268-00000006-d9c5a05a-5ec5a05a-0628acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: bb19a6ae-00000006-cdc5a466-5ec5a466-0634acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: ff996281-00000006-9bc66dba-5ec66dba-0666acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 05c8fe88-00000006-cec5a466-5ec5a466-0633acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: ef6fdcc7-00000006-c7c5a4a3-5ec5a4a3-063aacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: d7be58b1-00000006-a8c66d72-5ec66d72-0659acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: c7e666c2-00000006-a5c66d77-5ec66d77-065cacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 0af2cdfa-00000006-a2c66db0-5ec66db0-065facb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: d6a41b7b-00000006-a9c66d71-5ec66d71-0658acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 5ef3a086-00000006-d8c5a1aa-5ec5a1aa-0629acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 1c50888e-00000006-c9c5a4a1-5ec5a4a1-0638acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 293ad3ac-00000006-9ac66dbc-5ec66dbc-0667acb8-6673396f DEBUG: scanner **************** WARN: Could NOT match SSID: 293ad3ac-00000006-9ac66dbc-5ec66dbc-0667acb8-6673396f with NW MMDB. DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 392a3f11-00000006-9cc66db9-5ec66db9-0665acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: f4327713-00000006-d6c5a319-5ec5a319-062bacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 782d7d2e-00000006-a7c66d74-5ec66d74-065aacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 84003812-00000006-99c66dbd-5ec66dbd-0668acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 82d92149-00000006-a1c66db4-5ec66db4-0660acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: feab034c-00000006-c6c5a4a4-5ec5a4a4-063bacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 04d2bd42-00000006-cfc5a465-5ec5a465-0632acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 7558d286-00000006-9dc66db9-5ec66db9-0664acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 1d4acb44-00000006-c8c5a4a2-5ec5a4a2-0639acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 409c0991-00000006-9fc66db8-5ec66db8-0662acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: fd188ea7-00000006-cbc5a4a0-5ec5a4a0-0636acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 8f05a2a6-00000006-d0c5a464-5ec5a464-0631acb8-6673396f DEBUG: scanner **************** WARN: Could NOT match SSID: 8f05a2a6-00000006-d0c5a464-5ec5a464-0631acb8-6673396f with NW MMDB. DEBUG: openScannFileCloudBoost() => scanner found CB SSID: fa0c7c98-00000006-c4c5a4a9-5ec5a4a9-063dacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 089d66c8-00000006-abc66d6f-5ec66d6f-0656acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 760d0d96-00000006-cac5a4a1-5ec5a4a1-0637acb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: ea1c9025-00000006-c2c5a4ac-5ec5a4ac-063facb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 71d78f55-00000006-c3c5a4a9-5ec5a4a9-063eacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 30f8ef6d-00000006-a4c66d79-5ec66d79-065dacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: ca759b91-00000006-c5c5a4a6-5ec5a4a6-063cacb8-6673396f DEBUG: openScannFileCloudBoost() => scanner found CB SSID: 0ceee406-00000006-9ec66db8-5ec66db8-0663acb8-6673396f ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ ┃ Missing Cloud Boost records ┃ ┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫ ┃ ┃ LONG SSID ┃ SHORT SSID ┃ CLONE ID ┃ SAVE TIME / BACKUP TIME ┃ HINT: RUN MMINFO SYNTAX ┃ ┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫ ┃ 1 ┃ 0b6e2a33-00000006-c1c5a4ad-5ec5a4ad-0640acb8-6673396f ┃ 3250955437 ┃ 1590011053 ┃ 2020-05-20 14:44:13 -0700 PDT ┃ mminfo -av -q ssid=3250955437 ┃ ┃ 2 ┃ 851a7bd8-00000006-98c66dbe-5ec66dbe-0669acb8-6673396f ┃ 2563141054 ┃ 1590062526 ┃ 2020-05-21 05:02:06 -0700 PDT ┃ mminfo -av -q ssid=2563141054 ┃ ┃ 3 ┃ 59445ffe-00000006-d2c5a463-5ec5a463-062facb8-6673396f ┃ 3536168035 ┃ 1590010979 ┃ 2020-05-20 14:42:59 -0700 PDT ┃ mminfo -av -q ssid=3536168035 ┃ ┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛ INFO: Those records exist in NW's MMDB but cound not match on Cloud Boost. ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ┃ Missing NetWorker Media DB records ┣━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ┃ ┃ LONG SSID ┃ SHORT SSID ┃ CLONE ID ┃ SAVE TIME ┃ FULL PATH ┃ UNSORTED MISC. INFO ┣━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╋━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ┃ 1 ┃ 293ad3ac-00000006-9ac66dbc-5ec66dbc-0667acb8-6673396f ┃ 2596695484 ┃ 1590062524 ┃ 2020-05-21 ┃ base/17073638-CB-CLONE/34/15/notes/293ad3ac-00000006-9ac66dbc-5ec66dbc-0667acb8-6673396f ┃ 8792:scanner: done with ssid 2596695484 ┃ 2 ┃ 8f05a2a6-00000006-d0c5a464-5ec5a464-0631acb8-6673396f ┃ 3502613604 ┃ 1590010980 ┃ 2020-05-20 ┃ base/17073638-CB-CLONE/10/51/notes/8f05a2a6-00000006-d0c5a464-5ec5a464-0631acb8-6673396f ┃ 8792:scanner: done with ssid 3502613604 ┗━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┻━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ INFO: Those records exist on Cloud Boost but cound not match with NW's MMDB 2020/05/21 17:02:39 INFO: The output to a CSV file feature in development stage ... 2020/05/21 17:02:39 INFO: Done with Device Integrity check Engine for binky. Going back to main meny.
Thank you for visting www.crazyrov.com, you can also check out my YouTube channel - crazyRov Studios for Data protection and cloud related technical videos.
