Spotlight On Unix Getting Started
Spotlight On Unix Getting Started
2009 Quest Software, Inc.
ALL RIGHTS RESERVED.
This guide contains proprietary information protected by copyright. The software described in this guide is
furnished under a software license or nondisclosure agreement. This software may be used or copied only in
accordance with the terms of the applicable agreement. No part of this guide may be reproduced or
transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for
any purpose other than the purchaser's personal use without the written permission of Quest Software, Inc.
If you have any questions regarding your potential use of this material, please contact:
Quest Software World Headquarters
LEGAL Dept
5 Polaris Way
Aliso Viejo, CA 92656
www.quest.com
email: [email protected]
Refer to our Web site for regional and international office information.
Trademarks: Quest, Quest Software, the Quest Software logo, and Spotlight, are trademarks and
registered trademarks of Quest Software, Inc in the United States of America and other countries. Other
trademarks and registered trademarks used in this guide are property of their respective owners.
Disclaimer: The information in this document is provided in connection with Quest products. No license,
express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or
in connection with the sale of Quest products. EXCEPT AS SET FORTH IN QUEST'S TERMS AND
CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, QUEST ASSUMES
NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY
WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT. IN NO EVENT SHALL QUEST BE LIABLE FOR ANY DIRECT, INDIRECT,
CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT
LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF
INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF
QUEST HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Quest makes no
representations or warranties with respect to the accuracy or completeness of the contents of this document
and reserves the right to make changes to specifications and product descriptions at any time without notice.
Quest does not make any commitment to update the information contained in this document.
Spotlight on Unix
Getting Started Guide
Updated September 2009
Table of Contents
Introduction ......................................................................................................................................................... 5
Welcome to Spotlight on Unix ........................................................................................................................... 7
An overview of Spotlight on Unix ............................................................................................................................. 7
Features of Spotlight ................................................................................................................................................ 9
Troubleshooting ................................................................................................................................................ 31
Use tracing to add details to support bundle .......................................................................................................... 31
Product authorization errors ................................................................................................................................... 32
Connection problems ............................................................................................................................................. 32
iostat not installed on Linux system ...................................................................................................................... 33
Drilldown problems ................................................................................................................................................. 33
High Spotlight load on database server ................................................................................................................. 34
Spotlight on Unix
Getting Started Guide
Contacting Spotlight support .................................................................................................................................. 37
Contacting Quest Software ..................................................................................................................................... 38
About Quest Software, Inc ...................................................................................................................................... 38
Index ................................................................................................................................................................... 39
Introduction
ThisguideprovidesthebasicinformationyouneedtostartusingSpotlightonUnix
todiagnosetheperformanceofyourUnixhosts.Youwillreadabout:
HowSpotlightdisplaysinformationaboutyourUnixsystems.
HowtoinstallandstartSpotlightonUnix.
HowtomakeaSpotlightonUnixconnectiontoahost.
HowtousethatSpotlightconnection.
HowtoresolvesomecommonSpotlightproblems.
HowtocontactQuestSoftwareforfurtherassistance.
Home page
TheSpotlightonUnixhomepageprovidesanoverviewofthehost'sUnix
environment.
Thehomepagehelpsyoulocatesystembottlenecksquickly.Relatedoperating
systemstatisticsaregroupedtogetheronpanelsthatareconnectedbyaseriesof
graphicalflowsandicons.Spotlightupdatestheseflowsinrealtimesothatyoucan
seehowquicklydataismovingthroughthesystem.Theiconschangecoloras
Spotlightalarmsareraised,upgraded,downgradedandcanceled.
TheSpotlightonUnixhomepagebelowhassixmainpanels.
Thepanelsare:
TheSystempanel.
TheNetworkpanel.
Spotlight on Unix
Getting Started Guide
TheCPUpanel.
TheMemorypanel.
TheSwapSpacepanel.
TheDiskActivitypanel.
FormoreinformationonthepanelsintheSpotlighthomepage,andonusingthem
todiagnoseaspecifiedUnixsystem,seePanelsonpage20.
Alarms
MoredetailedinformationonsituationswherethediagnosedUnixsystemexceeds
acceptableperformancethresholdscanbeviewedinthealarmsthatSpotlight
raises.
FormoreinformationonSpotlightalarms,seeSpotlightonUnixalarmsonpage25.
Chapter 2
Welcome to Spotlight on Unix
Drilldowns
MoredetailedinformationontheperformanceoftheUnixsystemisavailablein
thechartsandtablesofthevariousdrilldownpagesthatcanbeaccessedfromthe
Spotlighthomepage.
FormoreinformationonSpotlightdrilldowns,andonusingthemtoviewthe
detailedperformanceofaspecifiedUnixsystem,seeSpotlightonUnixdrilldowns
onpage26.
Features of Spotlight
Spotlightisdesignedforeaseofinstallationanduse,andoffersarangeoftoolsfor
problemdiagnosis.
Easyinstallation.
Thedisplayofrealtimedata.
Comprehensiveinformationinchartsandtables.
Visible,audibleandconfigurablealarms.
Contextsensitivehelp.
Calibration.
Recordingandplaybackofhistoricaldata.
FordetailedinformationonSpotlightfeatures,seetheSpotlightonlinehelpunder
ConceptsandFeatures.
Installing Spotlight
ToinstallSpotlightonUnix,completethefollowingsteps.Closeallother
applicationsbeforeloadingtheCDintoyourPCor(ifyouhavedownloaded
SpotlightfromtheQuestWebsite)executingthedownloadedQuestinstaller.
YoucancanceltheinstallationatanytimebypressingtheEsckeyorbyclickingthe
Cancelbutton.
12
Spotlight on Unix
Getting Started Guide
Note:
The Spotlight application can be installed only on a supported Windows system where
the current user has Administrator privileges.
At installation
Duringinstallation,Spotlightrequireswriteaccesstothefollowingfolders:
TheSpotlightinstallationfolder(bydefault,ProgramFiles\Quest
Software\Spotlight)
ProgramFiles\CommonFiles\QuestShared
DocumentsandSettings\AllUsers\ApplicationData\Quest
Software\Spotlight
DocumentsandSettings\<currentuser>\ApplicationData\Quest
Software\Spotlight
andtothefollowingWindowsregistrykeysandsubkeys:
HKEY_LOCAL_MACHINE\SOFTWARE\QuestSoftware\Products
HKEY_LOCAL_MACHINE\SOFTWARE\QuestSoftware\Spotlight
HKEY_CLASSES_ROOT
Inmanycases,theSpotlightinstallerwillrunatelevatedprivilegesinorderto
performtherequiredactions.Theseprivilegescanspecificallybeallowedor
disallowedbysystemadministratorsbymeansofstandardMicrosoftInstaller(MSI)
policysettings.
Chapter 3
Getting Started with Spotlight on Unix
13
C:\ProgramFiles\QuestSoftware\Spotlight
14
Spotlight on Unix
Getting Started Guide
2 SelectView/ChangeProductLicenseundertheSpotlightonUnixentryin
thelistofinstalledproducts.
Formoreinformation,seeProductAuthorizationErrorsonpage32.
Note:
Spotlight on Unix may be installed automatically during the installation of other Spotlight
products such as Spotlight on Oracle (Professional Edition), Spotlight on Sybase, or
Spotlight on DB2. In these cases, Spotlight on Unix shares the authorization of those
products.
Starting Spotlight
InordertosuccessfullyconnecttoaUnixsystem,thefollowingstepsmustbe
completed:
1 StarttheSpotlightapplication.
2 CreateaUnixconnectionforSpotlight.
3 ConnecttotheUnixsystem.
Chapter 3
Getting Started with Spotlight on Unix
15
SelectSpotlightonUnix.
NewConnectionname
Enterthenamefortheconnection.
4 ClickOKtoopenaPropertieswindowforthenewconnection.TheDetails
pageofthePropertieswindowforthenewconnectionhasthesesections:
Serverconnectiondetails.
SSHKeyAuthentication.
5 EnterthefollowinginformationintheDetailspageoftheProperties
window:
Address
Entertheconnectionstring(hostnameorIP
address)usedtolinktothetargetUnix
machine.
User
Entertheusernameyouusewhenlogging
ontotheUnixmachine.(Therootuser
nameisnotpermitted.)
Password
Enterthepasswordyouusewhenlogging
ontotheUnixmachine.(Notusedwhen
youchoosetheSSHPublic/PrivateKeys
option.SeeStep6below.)
16
Spotlight on Unix
Getting Started Guide
ConnectionType
ChoosethetypeofSpotlightconnectionto
maketothemachineREXECorSSH.(First
makesurethattherelevantSSHorREXEC
daemonisrunningontheUnixmachine,
andisconfiguredtoreceiveremote
connections.)IfyouchooseSSH,Spotlight
displaysthePortNumberboxandtheUse
SSHPublic/PrivateKeysoption.
PortNumber
EntertheportnumberthatSpotlightwill
useforitsSSH(secureshell)connectionto
theUnixmachine.Thedefaultvalueis22.
Note:
On Linux systems, Spotlight on Unix works with full functionality only when the iostat
command is installed on the Unix machine under diagnosis. For more information, see
iostat not installed on page 33.
6 WhenyouconnectviaSSH,selectUseSSHPublic/PrivateKeystoconnectto
theUnixhostviaaPublic/Privatekey[SSH2only].Ifyouchoosetodoso,
enterthefollowing:
SSHKeyType
Choosethetypeofkeytousewhenmaking
theSpotlightconnection.
Public-key encryption is supported under SSH2
only The current options are RSA and DSA. For
more information, see Public/Private keypairs in
the online help.
SSHPrivateKeyFilename
Typethelocationofthefilethatcontains
theprivatekeyfortheSpotlightconnection,
orclickthe"..."buttontolocateit.
SSHPassphrase
Typethepassphraseusedtodecryptthe
privatekey.
7 ClicktheSavepasswordboxtosaveallthepassworddetailsthathavebeen
entered.
8 ClickOKtofinish.Aconnectioniconwiththenameyouspecifiediscreated.
Chapter 3
Getting Started with Spotlight on Unix
17
If you encounter problems when connecting, see Connection problems on page 32 for
more information.
4
Using Spotlight on Unix
WhenyouuseSpotlightonUnixtodiagnoseaUnixoperatingsystem,youcan:
Viewthestatusoftheconnectedsysteminthepanelsanddataflowsofthe
Spotlighthomepage.
ViewthealarmsthatSpotlighthasraisedfortheconnectedsystem.
ViewthedetailedperformanceoftheconnectedUnixsysteminthevarious
Spotlightdrilldowns.
20
Spotlight on Unix
Getting Started Guide
Panels
Apanelisavisualfeaturethatgroupsrelatedinformationandcomponentsonthe
Spotlighthomepage.Componentschangecolorasalarmsareraisedforthemetrics
theycontain.
TherearesixmainpanelsonthehomepageforSpotlightonUnix.Theyare:
TheSystempanel,whichshowsoperatingsysteminformation(forexample,
uptimeandOSversion)forthemachinethatyouareconnectedto.
TheNetworkpanel,whichshowsinformationonthelogins,connections
andthemovementofdataonthesystem.
TheCPUpanel,whichshowsprocessorandloadinformationforthehost
machine.
TheMemorypanel,whichshowsdetailedinformationaboutthephysical
andvirtualmemoryontheUnixsystem.
Chapter 4
Using Spotlight on Unix
21
TheSwapSpacepanel,whichshowsthetotalandusedamountof
configuredswapspaceontheUnixsystem.
TheDiskActivitypanel,whichshowsinformationondiskusageonthe
system.
Thepanels,andtheinformationtheydisplay,aredescribedinmoredetailbelow.
Forafulldiscussionofthepanels,seetheSpotlightonlinehelp.
Note:
To view a tool tip for a specific component in a panel, hover the mouse pointer over the
component.
System panel
TheSystempanelindicatesthestatusoftheoperating
systemofthemachineyouareconnectedto.Information
displayedhereincludes:
Theoperatingsystemonwhichthemachineisrunning.
Howlongthemachinehasbeenrunningsinceitwaslast
booted.
Thesystemdateofthelatestdatacollection.
Thesystemtimeofthelatestdatacollection.
22
Spotlight on Unix
Getting Started Guide
Network panel
TheNetworkpanelshowsinformationonthelogins,
connectionsandthemovementofdataontheUnixsystem,
suchas:
Thenumberofuserscurrentlyloggedontothemachine
youarediagnosing.
Thenumberofexternalprogramswithwhichthe
machineiscurrentlycommunicating.Thethreetypesof
connectionsshownareEstablished,Time_Wait,and
Close_Wait.
HowfastdataismovingthroughtheNICs(network
interfacecards)onthismachine.Themetricsshown
refertotherateatwhichnetworkpacketsanderrors
arebeingreceivedandsentthroughtheNICs.
TheflowsbetweentheNetworkpanelandtheCPUpanelto
itsrightrepresenttherateofdatatransferbetweentheUnix
hostandtheconnectednetwork.Formoreinformation,see
CPUPanel.
Chapter 4
Using Spotlight on Unix
23
CPU panel
TheCPUpanelshowsinformationabouttheprocessorsin,
andloadon,theUnixsystem.Itdisplaysinformationsuchas:
ThenumberofCPUsinthemachineyouarediagnosing.
TheCPUload(asapercentage)acrossallCPUsonthe
machine.
ThepercentageoftimetheCPUisintheUserstate,
acrossallCPUs.
ThepercentageoftimetheCPUisintheSystemstate,
acrossallCPUs.
ThepercentageoftimetheCPUisintheWaitstate,
acrossallCPUs.Waitiswherethemachinecanonly
waitforI/O,orsomethingsimilar,tocomplete.
Thelengthoftherunqueueinwhichprocessesare
waitingtobeexecuted.Processesinthisqueuewillbe
runwhentheCPUbecomesavailable.
Thetotalnumberofprocessesthatarerunningonthe
machineyouarediagnosing.
Thenumberof"zombie"processes:childprocesses
whoseterminationhasnotbeenacknowledgedbytheir
parentprocess.
Thenumberofprocesseswaitingforsomeeventor
conditionbeforetheycancontinueexecution.
TheflowsbetweentheCPUpanelandtheNetworkpaneltoitsleftrepresentthe
rateofdatatransferbetweentheUnixhostandtheconnectednetwork.
TheflowsincludetheincomingandoutgoingratesofdatatoandfromtheUnix
host,andtheratesatwhichbadpacketsarereceivedfrom,orsentto,thenetwork.
TheflowsbetweentheCPUpanelandtheMemorypaneltoitsrightrepresent
paginginformationbetweentheCPUandmemoryontheUnixhost.Theflows
includethenumberofmemorypageswrittenouttomemorypersecond,andthe
numberofmemorypagesreadinpersecond.
24
Spotlight on Unix
Getting Started Guide
Memory panel
TheMemorypaneldisplaysdetailedinformationaboutthe
memoryontheUnixsystem.Itshowsstatisticssuchas:
ThetotalamountofphysicalmemoryinRAM.
Theamountofphysicalmemorythatisfree.
Thetotalamountofvirtualmemoryforthesystem.
Theamountofvirtualmemorythatisfreeorunused.
Theamountofvirtualmemoryconsumed,expressedas
apercentageofitsmaximumsize.
Whereapplicable,thenumberofprocesseswhose
pageshaveallbeenmovedintoswapspace.
TheflowsbetweentheMemorypanelandtheCPUpanelto
itsleftrepresentpaginginformationbetweentheCPUand
memoryontheUnixhost.Formoreinformation,seeCPU
Panel.
TheflowsbetweentheMemorypanelandtheSwapSpace
paneltoitsrightrepresenttherateatwhichprocessesare
beingswappedouttodisk,andtherateatwhichprocesses
arebeingswappedinfromdisk.
Thetotalamountofconfiguredswapspaceonthe
machineyouarediagnosing.
Theamountofswapspacecurrentlyinuse.
TheassociateddataflowsbetweentheSwapSpaceandthe
Memorypaneltoitsleftrepresentthe"swapout"and
"swapin"ratesfortheUnixsystem.Formoreinformation,
seeMemorypanel.
Chapter 4
Using Spotlight on Unix
25
26
Spotlight on Unix
Getting Started Guide
ViewdetailsofthealarmitselfintheAlarmLogdrilldown.
Changetheactionsthatfollowtheraisingofalarms.
Enable,disable,orsnoozealarms.
Filteralarms.
Changethethresholdsandseveritiesthatdefinealarms.
Changealarmnotifications.
Savealarmdetails.
Note:
Detailed information on all these actions can be found in the Spotlight online help.
Thefollowingarebriefdescriptionsofthealarmsspecificallyassociatedwith
SpotlightonUnix.Forpossiblesolutionsfortheproblemsindicatedbythesealarms,
orforinformationonhowtodiagnoseproblemsfurther,seeSpotlightonUnix
alarmsintheonlinehelp.
Page In alarm
Alargenumberofpageinsmaybeasymptomofalargenumberofrecentpage
outs(seePageOutalarmbelow).Tofindoutwhatprocessisreadingthesepages
in,checktheresidentsizeoftheprocessesyouarerunning,andseewhichonesare
increasinginsize.Alternatively,alargenumberofpageinsmayoccurwhenalarge
processhasjuststopped,andthekerneldecidestofillthatspacewithmemory
Chapter 4
Using Spotlight on Unix
27
pagesownedbyotherprocesses.Checkifanimportantprocesshasended
unexpectedly.
28
Spotlight on Unix
Getting Started Guide
Drilldown
Description
Processesand
Services
ThepagesintheProcessesandServicesdrilldownlist
alltheprocessesrunningontheUnixmachine
(including"zombie"processes),andalltheservices
foundinthe/etc/servicesfile(runningornot).Useful
Chapter 4
Using Spotlight on Unix
Drilldown
29
Description
featuresinthisdrilldowninclude:
Processespage:Useashortcut(rightclick)menu
optiontoviewtheprocessesinastandardtable,or
inatreestructurewheresecondaryprocessesare
shownas"children"oftheprocessesthatrunthem.
Zombiespage:Viewchildprocesseswhose
terminationhasnotbeenacknowledgedbytheir
parentprocess.
Servicespage:Useashortcutmenuoptiontotest
whetheraspecifiedserviceisavailable.
ActivitySummary
ThepagesintheActivitySummarydrilldown
Activity,Disk,Memory,CPU,Network,andLogins
showdetailsofthedifferenttypesofactivityonthe
targetUnixmachine.
Filesystems
TheFilesystemsdrilldowndisplaysdetailedinformation
aboutthefilesystemsonaUnixsystem.Useashortcut
(rightclick)menuoptiontoviewthisinformationin
chartortableform.
AlarmLog
TheAlarmLogdrilldowndisplaysinformationonthe
alarmsassociatedwiththecurrentSpotlight
connection.
5
Troubleshooting
ThischaptersuggestssolutionstoproblemsthatmayoccuronopeningSpotlight
andmakingaconnection.
32
Spotlight on Unix
Getting Started Guide
MakesurethatyouentertheauthorizationkeyexactlyasstatedonyourProduct
AuthorizationsheetorasprovidedbyyourQuestSoftwaredistributor.
Connection problems
Thefollowingareproblemsthatmaybeencounteredonconnection.Followthe
indicatedsolutionstoresolvethoseproblems.
Chapter 5
Troubleshooting
33
Drilldown problems
Thefollowingareproblemsthatmaybeencountered.Followtheindicated
solutionstoresolvethoseproblems.
34
Spotlight on Unix
Getting Started Guide
Chapter 5
Troubleshooting
7 OpentheSpotlightconnection.
TheprocedureforadjustingtheSpotlightloadiscoveredinmoredetailinthe
onlinehelp.
35
APPENDIX
InasubfolderundertheDocumentsandSettingsfolder.
Vista
InasubfolderundertheUsersfolder.
38
Spotlight on Unix
Getting Started Guide
ThisfilecontainsasnapshotofyourSpotlightinstallation.Sendthisfileandyour
requestforassistancetoQuestSoftware([email protected]).
Notes:
y Support bundles contain information for the active instance only. If you are using Spotlight to
diagnose multiple instances ensure that the correct instance is displayed before creating the
support bundle.
y Support bundles cannot be created when the History Browser is open. For further information
on the History Browser, see the Spotlight online help under Concepts and Features.
QuestSoftware,Inc.
WorldHeadquarters
5PolarisWay
AlisoViejo,CA92656
USA
Website
www.quest.com
RefertoourWebsiteforregionalandinternationalofficeinformation.
INDEX
Index
A
ActivitySummarydrilldown........................29
AlarmLogdrilldown....................................29
Alarms.....................................................8,25
BlockedProcesses...................................26
InputErrorPacketsFlow.........................26
OutputErrorPacketsFlow......................26
PageIn....................................................26
PageOut.................................................27
PercentageBusy.....................................27
SwapInFlow...........................................27
SwapOutFlow........................................27
SwapSpace.............................................27
UsedPercentage.....................................27
ZombieProcesses...................................28
Authentication............................................33
B
Benefits.........................................................7
BlockedProcessesalarm............................26
C
Cannotconnect...........................................32
Charts............................................................9
Clientpermissions......................................11
Connecting
toaUnixsystem.....................................17
troubleshooting......................................32
Connectionproblems
loginasroot............................................33
passwordauthentication........................33
remotecommands..................................33
REXEC......................................................33
SSH..........................................................33
Connections..........................................15,17
CPUpanel....................................................23
CreatingaUnixconnection.........................15
D
DiskActivitypanel.......................................25
Drilldownproblems.....................................34
Drilldowns...............................................9,28
ActivitySummary....................................29
AlarmLog................................................29
Filesystems..............................................29
ProcessesandServices............................28
Services...................................................28
troubleshooting.......................................34
E
Errors
operatingsystemdrilldown....................34
F
Features........................................................7
SpotlightonUnix.......................................9
Filesystemsdrilldown..................................29
H
History...........................................................9
Homepage..............................................7,19
40
Spotlight on Unix
Getting Started Guide
I
InputErrorPacketsFlowalarm..................26
Install..........................................................11
InstallingSpotlight......................................11
iostat...........................................................33
Q
QuestSoftware
about.......................................................38
contacting...............................................38
contactingSupport..................................37
L
Load............................................................34
Loginasroot...............................................33
R
Remotecommands.....................................33
REXECprotocol............................................33
M
MainSpotlightwindow...........................7,19
Memorypanel............................................24
Multipleinstallations..................................13
S
Serverload..................................................34
Servicesdrilldown.......................................28
Spotlight
alarms..................................................8,25
connections.......................................15,17
drilldowns............................................9,28
homepage..........................................7,19
installing..................................................11
starting....................................................14
SpotlightonUnix
Multipleinstallations..............................13
using........................................................19
SSHprotocol................................................33
Starting........................................................11
StartingSpotlight........................................14
supportbundle............................................31
Supportbundle...........................................31
SupportBundle...........................................37
SwapInFlowalarm.....................................27
SwapOutFlowalarm..................................27
SwapSpacealarm.......................................27
SwapSpacepanel........................................24
sysstat.........................................................33
Systempanel...............................................21
N
Networkpanel............................................22
O
OperatingSystemdrilldown
errors......................................................34
OutputErrorPacketsFlowalarm...............26
P
PageInalarm..............................................26
PageOutalarm...........................................27
Panels
CPU.........................................................23
DiskActivity............................................25
Memory..................................................24
Network..................................................22
overview.................................................20
SwapSpace.............................................24
System....................................................21
Passwordauthentication............................33
PercentageBusyalarm...............................27
Permissions.................................................11
Problems
authorization..........................................32
ProcessesandServicesdrilldown...............28
T
Tables............................................................9
Tracing.........................................................31
Troubleshooting..........................................31
connectionproblems..............................32
41
Index
drilldownproblems.................................34
serverload..............................................34
U
Unix
Z
ZombieProcessesalarm.............................28
cannotconnect.......................................32
UsedPercentagealarm...............................27