Nutanix.dev

Search

rca.py

Collect Cluster Information for Support

Publication date:

September 16, 2020

Author:

Mehul Ashara

Intended Audience Level:

Beginner/Intro

Code Sample Type:

Snippet

Nutanix Technology or Product:

nCLI

Minimum Product Version:

n/A

Script/Code Language:

Python

API Code Sample (yes/no):

No

REST API Version:

N/A

Version Release Status:

Not Specified

REST API or SDK:

Not Specified

Code Sample Details

#########################################################################
#  Manage RCA Script                                                    #
#  Filename: rca.py                                                     #
#  Script Version: 1.0.0                                                #
#########################################################################
#  Prerequisites:                                                       #
#  1. Access to CVM shell with nutanix user                             #
#  2. Python 2.7                                                        #
#########################################################################
#  Synopsis                                                             #
#  This script is intended to collect cluster information on cases      #
#  involving RCA running AHV or vMware as hypervisor   		        #
#  Usage 								#
# python rca.py >> /home/nutanix/tmp/rca_"$(date +"%Y-%m-%d_%H-%M").log"#
#########################################################################
# Disclaimer                                                            #
# This code is intended as a standalone example. Subject to licensing   #
# restrictions defined on nutanix.dev, this can be downloaded, copied   #
# and/or modified in any way you see fit.                               #
# Please be aware that all public code samples provided by Nutanix are  #
# unofficial in nature, are provided as examples only, are unsupported  #
# and will need to be heavily scrutinized and potentially modified      #
# before they can be used in a production environment. All such code    #
# samples are provided on an as-is basis, and Nutanix expressly         #
# disclaims all warranties, express or implied.                         #
# All code samples are © Nutanix, Inc., and are provided as-is under    #
# the MIT license. (https://opensource.org/licenses/MIT)                #
#########################################################################
#!/usr/bin/python
import subprocess
import sys

def find_hypervisor():
	hypervisor=""
	try:
		hyper =subprocess.Popen("ncli ms ls | grep -i hypervisor | awk {'print $4'} | head -n 1", shell=True, stdout=subprocess.PIPE).stdout.read()
		hypervisor="".join((str(e) for e in hyper))
		print "--------------- Hypervisor detected",hypervisor[:-1],"---------------"

		if hypervisor[:-1].lower() == "vmware":
			hypervisor="vmware"
		elif hypervisor[:-1].lower() == "ahv":
			hypervisor="acropolis"
		elif hypervisor[:-1].lower() == "hyperv":
			hypervisor="hyperv"
	except:
		print "-----------------Unknown Hypervisor ! AHV ! ESXi ! Hyper-V -------------"
		sys.exit()
	return hypervisor	

def rca_out(hypervisor):
	try: 
		if hypervisor == "vmware":
                        print "--------------- Running RCA script ---------------"
                        print "!!!!!!!!!! hostssh '/ipmitool sel time get' !!!!!!!!!!"
                        print subprocess.Popen("hostssh '/ipmitool sel time get'", shell=True, stdout=subprocess.PIPE).stdout.read()
                elif hypervisor == "acropolis":
                        print ("--------------- Running RCA script ---------------")
                        print ("!!!!!!!!!! hostssh 'ipmitool sel time get' !!!!!!!!!!")
                        print subprocess.Popen("hostssh 'ipmitool sel time get'", shell=True, stdout=subprocess.PIPE).stdout.read()
                elif hypervisor == "hyperv":
                        print ("--------------- Running RCA script ---------------")
                        print ("!!!!!!!!!! Please run command manually on hyperv host: hostssh systeminfo | findstr Time !!!!!!!!!!")
#                       print subprocess.Popen("hostssh 'winsh systeminfo | findstr time'", shell=True, stdout=subprocess.PIPE).stdout.read()

		cvms=subprocess.Popen("svmips", shell=True, stdout=subprocess.PIPE).stdout.read()
		cvmx="".join((str(e) for e in cvms))
		cvms=cvmx.split(' ')
		print "!!!!!!!!!!!!!!!!!!!!! allssh 'uptime -p ; date' !!!!!!!!!!!!!!!!"
		for i in range(len(cvms)):
        		HOST=cvms[i]
        	COMMAND="uptime -p; date;"
        	ssh = subprocess.Popen(["ssh", "%s" % HOST, COMMAND],shell=False,stdout=subprocess.PIPE,stderr=subprocess.PIPE)
        	result = ssh.stdout.readlines()
        	if result == []:
                	error = ssh.stderr.readlines()
                	print >>sys.stderr, "ERROR: %s" % error
        	else:
                	print cvms[i]
                	for i in range(len(result)):
				print result[i]

		print "!!!!!!!!!! hostssh 'uptime -p; date' !!!!!!!!!!!!"
		print subprocess.Popen("hostssh 'uptime -p; date'", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!! ncli alert history duration=1 !!!!!!!!!!"
		print subprocess.Popen("ncli alert history duration=1", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!! ncli alert ls max-alerts=20 !!!!!!!!!!!!"
		print subprocess.Popen("ncli alert ls max-alerts=20", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!! allssh 'ls -lrth ~/data/logs/*FATAL'; date !!!!!!!!!"
		for i in range(len(cvms)):
        		HOST=cvms[i]
        		COMMAND="ls -lrth ~/data/logs/*FATAL;date"
        		ssh = subprocess.Popen(["ssh", "%s" % HOST, COMMAND],shell=False,stdout=subprocess.PIPE,stderr=subprocess.PIPE)
        		result = ssh.stdout.readlines()
        		if result == []:
                		error = ssh.stderr.readlines()
                		print >>sys.stderr, "ERROR: %s" % error
        		else:
                		print "................................... CVM "+ cvms[i] +" ..............................."
                		for i in range(len(result)):
                        		print result[i]

		print "-------------------------- Cluster details, status and FT status ----------------------------"

		print "!!!!!!!!!!!!!!! CVM IPs: svmips !!!!!!!!!!!!!!!!!!!!!!"
		print subprocess.Popen("svmips", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!! Host IPs: hostips !!!!!!!!!!!!!!!!!!!!"
		print subprocess.Popen("hostips", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!! Cluster Info: ncli cluster info !!!!!!!!!!!!!!!"
		print subprocess.Popen("ncli cluster info", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!! Host Info: ncli host ls !!!!!!!!!!!!!!!!!!!"
		print subprocess.Popen("ncli host ls", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!! NCLI MS LS: ncli ms ls !!!!!!!!!!!!!!!!!!!"
		print subprocess.Popen("ncli ms ls", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!! NCC version: ncc --version !!!!!!!!!!!!!!!"
		print subprocess.Popen("ncc --version", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!! Cluster status: cluster status | grep -v UP !!!!!!!!!!!!!!!!"
		print subprocess.Popen("cluster status | grep -v UP", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!!! Cluster metadata: nodetool -h 0 ring !!!!!!!!!!!!!!!!!!!!!!!!"
		print subprocess.Popen("nodetool -h 0 ring", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!!!!!!!! Cluster data resiliency: ncli cluster get-domain-fault-tolerance-status type=node !!!!!!!!!!!!!!!!!"
		print subprocess.Popen("ncli cluster get-domain-fault-tolerance-status type=node", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!! Curator Jobs History: links http://0:2010 -dump !!!!!!!!!!!!"
		print subprocess.Popen("links http://0:2010 -dump", shell=True, stdout=subprocess.PIPE).stdout.read()

		print "!!!!!!!!!! NCC health check: ncc health_checks run_all !!!!!!!!!!"
		print subprocess.Popen("ncc health_checks run_all", shell=True, stdout=subprocess.PIPE).stdout.read()

	except:
		print "-------------------- Uhh! Something went wrong , are you sure you are running this from CVM? ---------------"
		sys.exit()

def main():
	hypervisor = find_hypervisor()
	rca_out(hypervisor)

if __name__ == "__main__":
	main()
Go To Code Sample

License

©2025 Nutanix, Inc. All rights reserved. Nutanix, the Nutanix logo and all Nutanix product and service names mentioned herein are registered trademarks or trademarks of Nutanix, Inc. in the United States and other countries. All other brand names mentioned herein are for identification purposes only and may be the trademarks of their respective holder(s).

Our decision to link to or reference an external site should not be considered an endorsement of any content on such a site. Certain information contained in this post may relate to, or be based on, studies, publications, surveys and other data obtained from third-party sources and our own internal estimates and research. While we believe these third-party studies, publications, surveys and other data are reliable as of the date of this paper, they have not independently verified unless specifically stated, and we make no representation as to the adequacy, fairness, accuracy, or completeness of any information obtained from a third-party.

All code samples are unofficial, are unsupported and will require extensive modification before use in a production environment. This content may reflect an experiment in a test environment. Results, benefits, savings, or other outcomes described depend on a variety of factors including use case, individual requirements, and operating environments, and this publication should not be construed as a promise or obligation to deliver specific outcomes.

This content may reflect an experiment in a test environment. Results, benefits, savings, or other outcomes described depend on a variety of factors including use case, individual requirements, and operating environments, and this publication should not be construed as a promise or obligation to deliver specific outcomes.