ENB Health Check

Download as pdf or txt
Download as pdf or txt
You are on page 1of 16

ENB Health Check

Table of Contents
 Description
 Actions
 Software, Configuration Version and Upgrade Package status
 HW: antennas, ports, RUs, etc
 Licenses and Feature activation
 Node health check action
 Node Attributes
 EnodeBFunction settings
 Availability of devices, cells and interfaces
 Verify IP transport
 Disabled and degraded MOs
 Neighboring cells, HO and ANR
 EUtranCellXDD settings
 Node sync status
 Compare eNB parameters with working eNB
 Node Performance
 Trace and Error
 Logfiles
 Hanging UE Context
 References

Description
eNodeB health checks are divided into categories and are split into various check points that are
autonomous to each other yet a part of a complete eNB health check. By executing these health check
items, a fault point can be located in the eNB and re-directed to the correct systems care taker. Most of the
health checks in this document are read-only and do not impact performance of the node, with the
exception of eNB restart which requires permission from node owners, managers etc. The page covers
health checks regarding eNB H/W, S/W, features, power related parameters, transport network (MMS, SGW)
connectivity, IP interface states, degraded managed objects, EUTRANCELL settings, EUTRANRelation
settings, comparing parameters, node performance stats and synch status.

Actions
Software, Configuration Version and Upgrade Package
status:

Check upgrade package:


 eNb> pr upgrade
Check SW and CV:
 eNb> cvcu
Check status of all loaded modules (LM) on MP:
 eNb> lh mp sma -all

HW: antennas, ports, RUs, etc:

Print RF (Antenna) ports configuration and status:


 eNb> st rfport
Print RI (CPRI) ports configuration and status:
 eNb> st riport
Print Antenna configuration:
 eNb> lpr antennaunitgroup
Print all installed RU and configuration and status:
 eNb> cabx
 eNb> lst ru
Check TX Power:
 eNb> get . power
$ lh ru fui get vswr

$ shell -f /d/usr/lhCmd32403

=======================================================================
======================

$ lhsh BXP_0_1 fui get vswr

BXP_0_1: vswr: 23.3[dB]

=======================================================================
======================

$ lhsh BXP_1_1 fui get vswr

BXP_1_1: vswr: 23.4[dB]

=======================================================================
======================

$ lhsh BXP_2_1 fui get vswr

BXP_2_1: vswr: 24.8[dB]

=======================================================================
======================

$ lhsh BXP_3_1 fui get vswr

BXP_3_1: vswr: 24.6[dB]

=======================================================================
======================

$ lhsh BXP_4_1 fui get vswr

BXP_4_1: vswr: 23.7[dB]

=======================================================================
======================

$ lhsh BXP_5_1 fui get vswr

BXP_5_1: vswr: 26.4[dB]


$

Check following eNB power parameters:


 partOfRadioPower
 confOutputPower
 maximumTransmissionPower
Check the VSWR values:
 eNb> lh ru fui get vswr

Licenses and Feature activation:

Print an inventory of the node, including a summary of licenses installed:


 eNb> inv
Show capacity and features:
 eNb> license key

Node health check action:

Run the action startHealthCheck on MO ManagedElement


Using MoShell:
 eNb> acc 0 startHealthCheck
 eNb> get 0 healthCheckResult
Alarms will be generated if a fault is found, see the alarms in CPI:
 File System Diagnostic Error
 Configuration Version Corrupt
 Upgrade Package Corrupt
healthCheckResult Struct{3}

>>> 1.healthCheckResultCode = (99:INITIAL_VALUE, 0:OK, 1:NOT_OK,


2:ABORTED, 3:ABORTED_NOT_OK, 4:HEALTH_CHECK_ONGOING)

>>> 2.message =

>>> 3.startTime =

Description on alarms can be found in the Fault Management documents in the CPI store.

Node Attributes:

Node specific settings on attributes can be found in the Site Engineering document in CPI store.

EnodeBFunction settings:
 eNb> get enodebfunction
Check towards Site Engineering doc:

eNBId <value>

eNodeBPlmnId

>>> 1.mcc = <value>


>>> 2.mnc = <value>

>>> 3.mncLength = <value>

Availability of devices, cells and interfaces:


 eNb> st ru|dev|eutrancell|sector|termPointToMme|termPointToEnb
Operational cells should be UNLOCKED and ENABLED.
Operational S1 (termPointToMme) connections should be UNLOCKED and ENABLED.
Operational X2 (termPointToEnb) connections should be UNLOCKED and ENABLED.

Example:
lienb0679> st dev|eutrancell|sector|termPointToMme|termPointToEnb

100810-19:14:12 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
============

Proxy Adm State Op. State MO

=======================================================================
============

77 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=bb-1

78 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=bb-
1,CellDeviceSet=1

83 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,DeviceGroup=dul

100 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=du-1

101 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=du-
1,RicmDeviceSet=1

...

135 1 (ENABLED)
Equipment=1,RbsSubrack=1,RbsSlot=1,AuxPlugInUnit=rul,DeviceGroup=ru

139 1 (ENABLED)
Equipment=1,RbsSubrack=1,RbsSlot=1,AuxPlugInUnit=rul,DeviceGroup=ru,TrD
eviceSet=tr

146 1 (ENABLED)
Equipment=1,RbsSubrack=1,RbsSlot=2,AuxPlugInUnit=rul,DeviceGroup=ru
150 1 (ENABLED)
Equipment=1,RbsSubrack=1,RbsSlot=2,AuxPlugInUnit=rul,DeviceGroup=ru,TrD
eviceSet=tr

...

520 0 (LOCKED) 0 (DISABLED) ENodeBFunction=1,EUtranCellFDD=3

525 1 (UNLOCKED) 1 (ENABLED) ENodeBFunction=1,EUtranCellFDD=1

534 0 (LOCKED) 0 (DISABLED)


ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE
NB=678

539 1 (UNLOCKED) 1 (ENABLED)


ENodeBFunction=1,TermPointToMme=MME010064193079

...

556 1 (UNLOCKED) 1 (ENABLED) SectorEquipmentFunction=1

557 0 (LOCKED) 0 (DISABLED) SectorEquipmentFunction=3

Print cell status

cell list - Prints all created cell(s) and


its celldata.

cell data -cellId [cellId] - Prints all available data about a


specific cell.

See Cell for more info about command.

Verify IP transport:

Find IP address of MME

 eNb> st termpointtomme
 eNb> get <MO proxy #>
Example:
lienb0679> st termpointtomme

100810-19:32:52 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
============

Proxy Adm State Op. State MO

=======================================================================
============
539 1 (UNLOCKED) 1 (ENABLED)
ENodeBFunction=1,TermPointToMme=MME010064193079

=======================================================================
============

Total: 1 MOs

lienb0679> get 539

100810-19:32:57 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
==========================================

539
ENodeBFunction=1,TermPointToMme=MME010064193079

=======================================================================
==========================================

...

>>> Struct[5] has 3 members:

>>> 1.mcc = 0

>>> 2.mnc = 0

>>> 3.mncLength = 0

usedIpAddress 10.64.193.80

=======================================================================
==========================================

Total: 1 MOs

Ping MME or SGW


 eNb> acc IpAccessHostEt ping
Parameter 1 of 1, host (string): <ip address of MME or SGW>

Find eNB IP configuration

S1/X2 IP Address

Example:
lienb0679> get ipaccesshostet
100810-19:45:18 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE
stopfile=/tmp/6051

=======================================================================
==========================================

495 IpSystem=1,IpAccessHostEt=1

=======================================================================
==========================================

IpAccessHostEtId 1

administrativeState 1 (UNLOCKED)

availabilityStatus 0 (NO_STATUS)

ipAddress 10.75.16.161

ipDefaultTtl 64

ipInterfaceMoRef
Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2

ntpDscp 46

ntpServerMode 0 (DISABLED)

operationalState 1 (ENABLED)

reservedBy [1] =

>>> reservedBy = IpSystem=1,IpAccessSctp=1

userLabel

=======================================================================
==========================================

Total: 1 MOs

IP Interface configuration (IP address, Subnet, VLAN, QOS, etc) towards Customer
Site Router

 eNb> get interface


 eNb> get interface
mtu|ownIpAddressActive|subnet|trafficType|vid|defaultRouter0
 eNb> st interface
Example:
lienb0679> get interface
mtu|ownIpAddressActive|subnet|trafficType|vid|defaultRouter0
100810-20:19:19 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE
stopfile=/tmp/6051

=======================================================================
==========================================

MO Attribute
Value

=======================================================================
==========================================

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 defaultRouter0 10.75.0.1

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 defaultRouter0State 1 (ENABLED)

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 mtu 1500

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 ownIpAddressActive 10.75.0.179

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 subnet 10.75.0.0

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 trafficType 8 (OPERATION_AND_MAINTENENCE)

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=1 vid 2001

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 defaultRouter0 10.75.16.1

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 defaultRouter0State 1 (ENABLED)

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 mtu 1500

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 ownIpAddressActive 10.75.16.161

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 subnet 10.75.16.0

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 trafficType 7
(SIGNALING_AND_PAYLOAD_AND_SYNCHRONIZATION)

Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe-
1,IpInterface=2 vid 2005

=======================================================================
==========================================
lienb0679> st interface

100810-20:17:52 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
============

Proxy Adm State Op. State MO

=======================================================================
============

63 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitE
thernet=gbe-1,IpInterface=1

64 1 (ENABLED)
Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitE
thernet=gbe-1,IpInterface=2

=======================================================================
============

Check connectivity towards Customer Site Router


 eNb> ping <defaultRouter0>

Find Target eNB IP address

 eNb> st termPointToEnb
 eNb> get <proxy #>
Example:
lienb0679> st termPointToEnb

100810-19:49:55 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
============

Proxy Adm State Op. State MO

=======================================================================
============

534 0 (LOCKED) 0 (DISABLED)


ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE
NB=678
=======================================================================
============

Total: 1 MOs

lienb0679> get 534

100810-19:50:01 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
==========================================

534
ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE
NB=678

=======================================================================
==========================================

TermPointToENBId 678

administrativeState 0 (LOCKED)

anrCreated false

availabilityStatus 0 (NO_STATUS)

ctrlMode 0 (MANUAL)

domainName

ipAddress 10.75.16.163

operationalState 0 (DISABLED)

timeOfAnrCreation

timeOfAnrModification

=======================================================================
==========================================

Total: 1 MOs

Ping eNB
 eNb> acc IpAccessHostEt ping
Parameter 1 of 1, host (string): <ip address of eNB>

View SCTP Configuration and Status


Lists SCTP association or endpoint info
 eNb> sctphost -assoc -all
Print some SCTP configuration data, statistical information and lists association or endpoint info
 eNb> sctphost -all

Disabled and degraded MOs

To view all disabled MOs in Moshell:


 eNb> st all dis
All MOs that are have a degraded operational state:
 eNb> get . availability 64
All MOs that are have a FAILED operational state:
 eNb> get . availability 2
Use the MOM to determine the availabilityStatus values:
 eNb> mom AvailabilityStatus
Print locked or disabled MOs
 eNb> inv . L|0

Neighboring cells, HO and ANR

List all relations to neighboring cells


 eNb> pr relat
Check if HO feature is activated
 eNb> get intralte
Example:
lienb0679> get intralte

100810-19:43:36 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
==========================================

22
SystemFunctions=1,Licensing=1,OptionalFeatures=1,IntraLTEHandover=1

=======================================================================
==========================================

IntraLTEHandoverId 1

featureStateIntraLTEHandover 1 (ACTIVATED)

...

EUtranCellXDD settings:

Check towards Site Engineering doc:


 eNb> get eutrancell
tac <value>
Optional:
ulChannelBandwidth <value>
dlChannelBandwidth <value>

Check Physical Cell ID (PCI)

Example:
get utrancellfdd=dfwe0600037 cellid

100727-16:52:40 10.26.4.174 8.0d ERBS_NODE_MODEL_A_9_2


stopfile=/tmp/18164

=======================================================================
==========================================

MO Attribute
Value

=======================================================================
==========================================

EUtranCellFDD=DFWe06000372 cellId
2

EUtranCellFDD=DFWe06000372
physicalLayerCellIdGroup 145

EUtranCellFDD=DFWe06000372
physicalLayerSubCellId 2

EUtranCellFDD=DFWe06000373 cellId
3

EUtranCellFDD=DFWe06000373
physicalLayerCellIdGroup 148

EUtranCellFDD=DFWe06000373
physicalLayerSubCellId 1

EUtranCellFDD=DFWe06000371 cellId
1

EUtranCellFDD=DFWe06000371
physicalLayerCellIdGroup 143

EUtranCellFDD=DFWe06000371
physicalLayerSubCellId 0

=======================================================================
==========================================

Calculate PCI:
PCI sector 2 = 145*3 + 2 = 437
Node sync status:
 eNb> get sync
 eNb> get Sync administrativeState|operationalState
Status should be UNLOCKED and ENABLED.
Example:
lienb0679> get Sync administrativeState|operationalState

100810-20:52:42 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE


stopfile=/tmp/6051

=======================================================================
==========================================

MO Attribute
Value

=======================================================================
==========================================

IpAccessHostEt=1,IpSyncRef=1
administrativeState 1 (UNLOCKED)

IpAccessHostEt=1,IpSyncRef=1
operationalState 1 (ENABLED)

=======================================================================
==========================================

Check for degradation fault on the choosen synchronization reference

Compare eNB parameters with working eNB:

dump the kget file from eNB:


 eNb> l+ <filename>
 eNb> kget all
 eNb> l-
Kget file will be stored in the location of current directory.
Compare two eNB parameters
Take kget dump from eNB1, call it “kget_eNB1.log”
Moshell into eNB2
 eNb> diff . Kget_eNB1.log

Node Performance:

COLI command getstat to provide dynamic internal peg counter information. Indications on counters related
to ERAB setup, RRCConnectionSetup S1InitialContextSetup etc.
 eNb> getstat
A higher portion of RRCConnSetupAttemt vs low values on S1InitialContextSetupRequest,
S1InitialContextSetupResponse and S1InitialUeMessage can indicate problem on the S1 interface towards
the MME.
Refer to GETSTAT

Trace and Error

List all non-default trace conditions in all boards of the node


 eNb> lh all fte s
Refer to Trace and Error and HiCap.

Logfiles:

Refer to Logs for more information about different logs.

Alarms

To check for active alarms, run:


 eNb> al
For a history of alarms, run:
 eNb> lga
Refer to COLI Quick Reference for more options.

Collection of logfiles

Fetch data for TRs/CSRs, according to the Data Collection Guidelines we use the DCG command.
Check LTE Data Collection Guideline for more information.

Hanging UE Context:

Check number of UE Contexts and bearers in the RAC:


$ ue print -admitted

CellId #UE:s #Bearers

4 3 5

First column gives cellid. Second column shows number of UEs in the cell. Third column shows number of
DRBs in the cell. You should expect to see between DRBs between 2-4 DRBs for each UE.
Check number of UE Contexts in the BB:
moshell> mtd debug -ta bbUeMeBl -fun BBUEME_DEBUG_admittedUesInBBM()
-dest RTS_WAIT

Ok SessId[23]

[0x9C1A714] BBUEME_DEBUG_cellContextS
[0x9C1A714] U32 cellId1 = 3

[0x9C1A718] S16 noOfUesInCell1 = 5

[0x9C1A71A] S16 noOfRadioBearersInCell1 = 25

[0x9C1A71C] U32 cellId2 = 2

[0x9C1A720] S16 noOfUesInCell2 = 3

[0x9C1A722] S16 noOfRadioBearersInCell2 = 14

[0x9C1A724] U32 cellId3 = 1

[0x9C1A728] S16 noOfUesInCell3 = 6

[0x9C1A72A] S16 noOfRadioBearersInCell3 = 25

[0x9C1A72C] S16 noOfUesInBBM = 14

[0x9C1A72E] S16 noOfRadioBearersInBBM = 64

Unlike number of RBs in RAC printout, noOfRadioBearersInCell1 printouts includes SRB0 and SRB1 + DRBs
for each UE.
If you have very large number of UEs that are not being released or a very big discrepancy between number
of UEs and DRBs then you should suspect hanging UE Context in either RAC or BB.
$ ue print -ue -allcell

CellId RacUeRef BbUeRef


{traceRef,interfaces,traceDepth,ipAddress}
TypeOfActiveTrace SetByColi CTSess

4 33556488 67109120 X
CRUT false 2

4 33556489 67109152 X
CRUT false 3

4 33556490 67109184 X
CRUT false 4

$ ue print -bearer

CellId RacUeRef BbUeRef E-RAB S-RAB ARP QCI


ServiceType GbrDl GbrUl ROHCenabled

4 33556488 67109120 5 X 10 9
0 0 0 0

4 33556488 67109120 6 X 5 6
0 0 0 0
4 33556488 67109120 X 1 X X
X X X X

4 33556488 67109120 X 2 X X
X X X X

4 33556489 67109152 5 X 10 9
0 0 0 0

4 33556489 67109152 6 X 7 8
0 0 0 0

4 33556489 67109152 X 1 X X
X X X X

4 33556489 67109152 X 2 X X
X X X X

4 33556490 67109184 5 X 10 9
0 0 0 0

4 33556490 67109184 X 1 X X
X X X X

4 33556490 67109184 X 2 X X
X X X X

You might also like