Veritas Cluster Interview Questions - System Admin Stuff PDF
Veritas Cluster Interview Questions - System Admin Stuff PDF
(https://www.facebook.com/TheFactFactory/) (https://twitter.com/NANDLAL57)
(https://plus.google.com/u/0/+LiveStreamnow) (https://www.linkedin.com/in/nandlalyadav/)
(https://www.youtube.com/channel/UCyZzCLJZwmHpKVrisL9jLSg)
(http://feeds.feedburner.com/SystemAdminShare)
Please go through questions and answers. Let me know if you have any doubt by leaving
comment.
Adding and removing cluster node
Q-1 How to add a node in an existing cluster?
Ans: Adding a node into an existing cluster is a multi steps process.
6: Run the GAB configuration command on each node to verify that port a and port h
include the new node in the membership.
# /sbin/gabconfig -a
3: Switch service group which is online on the node leaving the cluster
# hagrp –switch to
3: Delete the leaving node from the service group’s SystemList attribute.
# hagrp –modify SystemList –delete
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 2/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
3: Rename the startup files to prevent LLT, GAB and VCS from
starting up in future.
# mv /etc/rc2.d/S70llt /etc/rc2.d/s70llt
# mv /etc/rc2.d/S92gab /etc/rc2.d/s92gab
# mv /etc/rc3.d/S99vcs /etc/rc3.d/s99vcs
4: Remove VCS package from the node
2) Either Switchover or failover all the service group which are online on shutting down node
to remaining node
# hagrp –switch -to
3) Freeze all the service group which are online in the cluster.
# hagrp –freeze -persistent
4) Stop the cluster on the node that is going to be down.
# hastop –local –force
Once the system will come up after reboot, Follow the below given instructions.
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 3/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Q-3 Which is the main config file for VCS and where it is located?
Ans: main.cf is the main configuration file for VCS and it is located in
/etc/VRTSvcs/conf/config.
Q-4 Which command you will use to check the syntax of the main.cf?
Ans: hacf -verify /etc/VRTSvcs/conf/config
Q-5 How will you check the status of individual resource of VCS cluster?
Ans: hares –state
Ans: VCS cluster management console can be accessed by the below given URLs:
http://Servername:8181/cmc/
or
https://Servername:8443/cmc
packets per second per interface. Heartbeat is used by GAB to determine cluster membership.
Q-22 How do you shutdown a Veritas Cluster Server, leaving the applications running from the
command line?
Ans: # hastop -all -forceQ-23 What is coordinator disk?
Ans: Coordinator disks are three standard disks or LUNs set aside for I/O fencing during cluster
reconfiguration. Coordinator disks do not serve any other storage purpose in the VCS
configuration. These disks provide a lock mechanism to determine which nodes get to fence off
data drives from other nodes. A node must eject a peer from the coordinator disks before it can
fence the peer from the data drives. This concept of racing for control of the coordinator disks to
gain the ability to fence data disks is key to understanding prevention of split brain through
fencing.
Q-24 What is IO fencing and how to configure IO fencing?
Ans: IO fencing is a feature that prevents data corruption in the event of a communication
breakdown in a cluster. IO fencing is used to remove the risk associated with split brain
condition. I/O fencing allows write access for members of the active cluster and blocks access to
storage from non-members; even a node that is alive is unable to cause damage.
Move all service groups from this node to another node and freeze this node:
# hasys –freeze –persistent –evacuate
Unconfigure LLT
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 6/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
# lltconfig –U
3. Which command you will use to check the syntax of the main.cf ?
Ans: hacf -verify /etc/VRTSvcs/conf/con g
4. How will you check the status of individual resources of VCS cluster?
Ans: hares –state
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 7/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 8/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
# haconf -dump -makero (Dumps in memory configuration to main.cf and makes it read-only)
# hamsg engine_A
# hastatus -sum
# hastop -all
3. Edit the con guration le after taking the backup and do the changes :
# cp -p /etc/VRTSvcs/conf/config/main.cf /etc/VRTSvcs/conf/config/main.cf_17march
# vi /etc/VRTSvcs/conf/config/main.cf
# hastart
o --> VCSMM driver (kernel module needed for Oracle and VCS interface)
How to check the status of various GAB ports on the cluster nodes
To check the status of GAB ports on various nodes :
# gabconfig -a
Whats the maximum number of LLT links (including high and low priority) can a
cluster have ?
A cluster can have a maximum of 8 LLT links including high and low priority LLT links.
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 10/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
# lltstat -nvv
What are the various LLT configuration files and their function ?
LLT uses /etc/llttab to set the con guration of the LLT interconnects.
# cat /etc/llttab
set-node node01
set-cluster 02
Here, set-cluster -> unique cluster number assigned to the entire cluster [ can have a value ranging between 0 to (64k - 1) ].
It should be unique across the organization.
set-node -> a unique number assigned to each node in the cluster. Here the name node01 has a corresponding unique
node number in the le /etc/llthosts. It can range from 0 to 31.
Another con guration le used by LLT is – /etc/llthosts. It has the cluster-wide unique node number and nodename as
follows:
# cat /etc/llthosts
0 node01
1 node02
LLT has an another optional con guration le : /etc/VRTSvcs/conf/sysname. It contains short names for VCS to refer. It
can be used by VCS to remove the dependency on OS hostnames.
# cat /etc/gabtab
/sbin/gabconfig -c -n 4
here -n 4 –> number of nodes that must be communicating in order to start VCS.
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 11/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
# gabconfig -c -x
# hastart
# hastop -local
# hastop -all
-local -> Stops service groups and VCS engine [HAD] on the node where it is red
-local -evacuate -> migrates Service groups on the node where it is red and stops HAD on the same node only
-local -force -> Stops HAD leaving services running on the node where it is red
-all -force -> Stops HAD on all the nodes of cluster leaving the services running
-all -> Stops HAD on all nodes in cluster and takes service groups o ine
Resource Operations
How to list all the resource dependencies
To list the resource dependencies :
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 12/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
# hares -dep
haconf –makerw
hagrp –add SG
# hagrp -display SG
The -any option when used instead of the node name, brings the SG online/o ine based on SG’s failover policy.
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 13/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
(http://thegeekdiary.com/wp-content/uploads/2013/10/io-fencing-in-vcs-.png)
In case of a possible split brain
As show in the gure above assume that node01 has key “A” and node02 has key “B”.
1. Both nodes think that the other node has failed and start racing to write their keys to the coordinator disks.
2. node01 manages to write the key to majority of disks i.e. 2 disks
3. node02 panics
4. node01 now has a perfect membership and hence Service groups from node02 can be started on node01
Troubleshooting
How to flush a service group and when its required ?
Flushing of a service group is required when, agents for the resources in the service group seems suspended waiting for
resources to be taken online/o ine. Flushing a service group clears any internal wait states and stops VCS from
attempting to bring resources online.
To ush the service group SG on the cluster node, node01 :
Advanced Operations
How to add/remove a node from an active VCS cluster online
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 15/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
We can use service group dependencies to specify most application relationships according to these four
criteria:
– Category: Online or offline
– Location: Local, remote, or global
– Startup behavior: Parent or child
– Failover behavior: Soft, firm, or hard
We can specify combinations of these characteristics to determine how dependencies affect service group
behavior.
Q: – Define the Resources in veritas cluster ?
Resources are VCS objects that correspond to the hardware or software components of an application service.
Each resource must have a unique name throughout the cluster. Choosing names that reflect the service
group name makes it easy to identify all the resources in that group, for example, WebIP in the WebSG
group.
Resources are always contained within service groups.
Resource categories include: Persistent & Nonpersistent
Q: – What are On-Off & Persistent Resources ?
On-Off:- VCS starts and stops On-Off resources as required. For example, VCS imports a disk group when
required, and deports it when it is no longer needed.
Persistent:- These resources cannot be brought online or taken offline. For example, a network interface card
cannot be started or stopped, but it is required to configure an IP address. A Persistent resource has an
operation value of none. VCS monitors Persistent resources to ensure their status and operation. Failure of a
Persistent resource triggers a service group failover.
Q: – What are Agents in Veritas cluster or VCS cluster ?
Agents are multi-threaded processes that provide the logic to manage resources. VCS has one agent per
resource type. The agent monitors all resources of that type; for example, a single IP agent manages all IP
resources. When the agent is started, it obtains the necessary configuration information from VCS. It then
periodically monitors the resources, and updates VCS with the resource status. An agent typically brigs
resources online, take resources offlineand monitors resources to determine their state.
Q: – How VCS Controls Resources ?
Each resource type has a corresponding agent process that manages all resources of that type.
Agents have one or more entry points that perform a set of actions on resources.
Each system runs one agentfor each active resource type
Q: – What are the main functions of LLT,GAB & HAD in veritas cluster ?
Low-Latency Transport(LLT) :-
Is responsible for sending heartbeat messages
Transports cluster communication traffic to every active system
Balances traffic load across multiple network links
Maintains the communication link state
Is a nonroutable protocol
Runs on an Ethernet network
Group Membership Services/Atomic Broadcast (GAB)
Performs two functions:
– Manages cluster membership; referred to as GAB membership.
– Sends and receives atomic broadcasts of configuration information
Is a proprietary broadcast protocol
Uses LLT as its transport mechanism
The High Availability Daemon (HAD)
The VCS engine, the high availability daemon:
– Runs on each system in the cluster
– Maintains configuration and state information for all cluster resources
– Manages all agents
The hashadow daemon monitors HAD.
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 17/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Solaris:
Q: Are you working cluster environment ?
A:Yes.I am working Veritas cluster .Its a zone failover model cluster.
(:- Here interviewers will try to screw you by asking the cluster setup.The next question will be …
This kind of cluster setup is very less compare to the traditional & complex start/stop scripts for
application.
There are three article in Unixarena to get the setup to be done on
VMWARE workstation to practice yourself.
1.How to install and configure two node VCS cluster (http://www.unixarena.com/2012/08/how-
to-configure-two-node-vcs-cluster.html).
Redhat Linux:
The same trick you can follow on the Linux interview as well. Redhat Cluster as well supports the
virtual machine failover. If the interviewer ask about the redhat cluster, you simply say that ” I
am working two node redhat cluster – virtual machine failover setup”.
Here is the overview of the virtual machine failover setup using redhat cluster.
Redhat cluster has been installed on both the cluster nodes and configured as two node
cluster.We have KVM packages installed and configured with the virtual guests on both the
nodes.Those virtual guests aka virtual servers have added in to the redhat cluster as resource and
if there is any issues with one server, all the virtual machine will be halted/killed and those will
be booted on the second cluster node.
The beauty of redhat cluster + KVM is that virtual machines can be failover to other node
without hating/rebooting it .
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 18/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
The below articles will be help you to setup the environment redhat cluster environment.
1.Configure the redhat cluster with virtual machine (http://www.unixarena.com/2013/10/how-
to-add-kvm-guest-on-redhat-cluster.html).
Hope now you can able to manage the cluster related questions in interview.
I am sure that if you explain these setup with confidence, definitely interviewer will not ask
further question on this.
Q: – What is clusterring and why we use clustering ?
The concept of a cluster is that the cluster itself appears on the outside as a single system. A cluster consists
of two or more Real Computers referred to as nodes or members of a cluster. The components of a cluster are
commonly, but not always, connected to each other through fast Local Area Networks.
Clusters are usually deployed to improve performance and/or availability over that provided by a single
computer, while typically being much more cost-effective than single computers of comparable speed or
availability. Clustering is all about the back-end operations being performed by the nodes or members which
appear to the outside world as a single computational entity.
Q: – What are the different type of clusters ?
1. High Performance Clusters
2. High Availability Clusters
3. Load Balancing clusters
4. Storage Clusters
Q: – What is High Performance Clusters ?
In High Performance Clusters Multiple nodes in cluster perform concurrent calculations. There are two key
benefits of High Performance (or grid) computing :
Resilience –> As long as even a single member of a cluster is running, services continue to be provided by
the cluster
Increased Capacity –> The more nodes added to the cluster, the more computing horsepower is available and
therefore very powerful computers can be built using
commodity hardware
Q: – What is High Availabilty Clusters (HA) ?
High-availability clusters provide continuous availability of services by eliminating single points of failure
and by failing over services from one cluster node to another in case a node becomes inoperative.High-
availability clusters are sometimes referred to as failover clusters. Red Hat Cluster Suite provides high-
availability clustering through its High-availability Service Management component.
Q: – What is Load Balancing Clusters ?
Load Balancing Clusters operate by having all workload come through one or more load balancing front-
ends, which then distribute it to a collection of back end servers. If a node in a load-balancing cluster
becomes inoperative, the load-balancing software detects the failure and redirects requests to other cluster
nodes. Red Hat Cluster Suite provides load- balancing through LVS (Linux Virtual Server).
Q: – What is Storage Clusters ?
Storage clusters provide a consistent file system image across servers in a cluster, allowing the servers to
simultaneously read and write to a single shared file system.With a cluster-wide file system, a storage cluster
eliminates the need for redundantcopies of application data and simplifies backup and disaster recovery. Red
Hat Cluster Suite provides storage clustering through Red Hat GFS.
Q: – What is Active Passive and Active Active Terminology in HA Clusters ?
Active/Passive Terminology generally refers to failover clusters running only one service.
Active/Active Terminology can be used to refer to :
Failover clusters with multiple servers such that all cluster members are hosting at least one service
Failsafe Clusters
Q: – What is Fencing in Clustering ?
Fencing is used to avoid data inconsistencies in shared storage by fencing or cutting off a failed
member.When the cluster manager detects a member failure, it immediately cuts off the failed member from
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 19/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Related Posts:
Veritas cluster Interview Questions (https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html)
v\:* {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape
{behavior:url(#default#VML);} Normal 0 false false false false EN-US… Read More
(https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html)
How to increase the size of vxdisk,volume, and lesystem following lun addition or expansion
(https://ny57.blogspot.com/2016/09/steps-to-be-followed-while-extending-fs.html)
Case 1: Storage Engineer adds new Lun Once you get LUN id's from Storage team, gather below info: Server Pseudo
name ID Size Disk name server 1 emcpower62 15F9 … Read More (https://ny57.blogspot.com/2016/09/steps-to-be-
followed-while-extending-fs.html)
1 comment:
Nice and good blog.I have suggested to my friends to go through this blog. Thanks for sharing this useful
information. If you want to learn Linux course in online, please visit below site.
Linux Online Training (http://iteducationalexperts.com/linux-online-training/)
linux online course (http://iteducationalexperts.com/linux-online-training/)
Linux Online Training in Hyderabad (http://iteducationalexperts.com/linux-online-training/)
Linux Online Training in Bangalore (http://iteducationalexperts.com/linux-online-training/)
Reply
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 21/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
(https://www.blogger.com/comment-iframe.g?
blogID=5756420136120713146&postID=7962762102649938861&blogspotRpcToken=8702800)
12
Donate Author?
(https://v1.addthis.com/live/redirect/?url=https%3A%2F%2Ffanyv88.com%3A443%2Fhttps%2Fwww.paypal.me%2Fny57&uid=5e534e5539659b12&pub=ra-
59ee07f827a78d69&rev=v8.28.3-wp&per=unde ned&pco=tjin-1.0)
Subscribe to: Post Comments (Atom) (https://ny57.blogspot.com/feeds/7962762102649938861/comments/default)
Home (https://ny57.blogspot.com/)
Facts (https://www.facebook.com/TheFactFactory)
System Admin Share (https://ny55.blogspot.com)
Short News Web (https://shortnewsweb.blogspot.com)
Blog Archive
November (16)
Pune- WNS (Phursingi) was immidiately shut after symptoms of Corona virus on oor
(http://feedproxy.google.com/~r/ShortNewsWeb/~3/4sLfHZr27AM/pune-wns-phursingi-was-immidiately-shut.html)
Scientists calculate the speed of death in cells, and it's surprisingly slow
(http://feedproxy.google.com/~r/ShortNewsWeb/~3/9Dtzuzgo-qk/scientists-calculate-speed-of-death-in.html)
Categories
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 22/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Newsletter
(http://www.Amazon.in/exec/obidos/redirect-home?tag=nandlalyadav5-
21&placement=home_multi.gif&site=amazon)
Recent Comments
Popular Posts
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 23/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Search
Shop Now
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 24/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
(http://www.Amazon.in/exec/obidos/redirect-home?tag=nandlalyadav5-
21&placement=home_multi.gif&site=amazon)
Translate
Select Language ▼
Popular
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 25/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
(http://www.Amazon.in/exec/obidos/redirect-home?tag=nandlalyadav5-
21&placement=home_multi.gif&site=amazon)
Shop Now
Total Pageviews
3 3 8 3 6
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 26/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Make your
email
standout.
AWS: How to Mount S3 Bucket on EC2 Linux Instance Using IAM Role (https://ny55.blogspot.com/2019/12/aws-how-to-
mount-s3-bucket-on-ec2-linux.html)
(http://www.Amazon.in/exec/obidos/redirect-home?tag=nandlalyadav5-
21&placement=home_multi.gif&site=amazon)
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 27/29
3/16/2020 Veritas cluster Interview Questions ~ System Admin Stuff
Make your
email
standout.
Follow by Email
Email address... Submit
2Fnsclient
value.html
1.0%26at_
o%3Dsmlr
39659b12
5e534e55
27a78d69
nde
wp&per=u
1.addthis.
3A%2F%2
m%2F201
si%3D5e6
26at_tot%
&rev=v8.2
com/live/
Fny57.blo
6at_ab%3
os%3D1%
2%26at_p
3D8&uid=
redirect/?
6%2F10%
%23at_pc
f35ae94e
59ee07f8
url=http%
pco=smlr
(https://v
3d693%2
&pub=ra-
gspot.co
failed-to-
get-pdh-
ebv-1.0)
-error-
Dper-
ebv-
8.3-
ned&
NSClient - ERROR: Failed to get PDH value. (https://v1.addthis.com/live/redirect/?
url=https%3A%2F%2Ffanyv88.com%3A443%2Fhttp%2Fny57.blogspot.com%2F2016%2F10%2Fnsclient-error-failed-to-get-pdh-
ny57.blogspot.com
1.0%26at_
Dsmlrebv-
39659b12
5e534e55
27a78d69
nde
wp&per=u
1.addthis.
3A%2F%2
m%2F201
2Fintervie
questions
si%3D5e6
26at_tot%
&rev=v8.2
com/live/
Fny57.blo
at_pco%3
6at_ab%3
os%3D3%
2%26at_p
3D8&uid=
redirect/?
6%2F10%
f35ae94e
59ee07f8
url=http%
pco=smlr
(https://v
.html%23
3d693%2
&pub=ra-
gspot.co
ebv-1.0)
Dper-
8.3-
w-
ned&
Multiple Choice Interview questions (https://v1.addthis.com/live/redirect/?
url=https%3A%2F%2Ffanyv88.com%3A443%2Fhttp%2Fny57.blogspot.com%2F2016%2F10%2Finterview-questions.html%23at_pco%3Dsmlrebv-
ny57.blogspot.com
AddThis (https://www.addthis.com/website-tools/overview?
utm_source=AddThis%20Tools&utm_medium=image&utm_campaign=Recommended%20content%20logo)
https://ny57.blogspot.com/2016/11/veritas-cluster-interview-questions.html 29/29