Professional Documents
Culture Documents
Replacing Multicontroller RNC Hardware Units
Replacing Multicontroller RNC Hardware Units
Replacing Multicontroller RNC Hardware Units
Hardware Units
Nokia is committed to diversity and inclusion. We are continuously reviewing our customer
documentation and consulting with standards bodies to ensure that terminology is inclusive
and aligned with the industry. Our future customer documentation will be updated
accordingly.
This document is intended for use by Nokia's customers (“You”) only, and it may not be used
except for the purposes dened in the agreement between You and Nokia (“Agreement”)
under which this document is distributed. No part of this document may be used, copied,
reproduced, modied or transmitted in any form or means without the prior written
permission of Nokia. If You have not entered into an Agreement applicable to the Product,
or if that Agreement has expired or has been terminated, You may not use this document in
any manner and You are obliged to return it to Nokia and destroy or delete any copies
thereof.
The document has been prepared to be used by professional and properly trained
personnel, and You assume full responsibility when using it. Nokia welcomes your comments
as part of the process of continuous development and improvement of the documentation.
This document and its contents are provided as a convenience to You. Any information or
statements concerning the suitability, capacity, tness for purpose or performance of the
Product are given solely on an “as is” and “as available” basis in this document, and Nokia
reserves the right to change any such information and statements without notice. Nokia has
made all reasonable efforts to ensure that the content of this document is adequate and
free of material errors and omissions, and Nokia will correct errors that You identify in this
document. Nokia's total liability for any errors in the document is strictly limited to the
correction of such error(s). Nokia does not warrant that the use of the software in the
Product will be uninterrupted or error-free.
NO WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO
ANY WARRANTY OF AVAILABILITY, ACCURACY, RELIABILITY, TITLE, NON-INFRINGEMENT,
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, IS MADE IN RELATION TO THE
CONTENT OF THIS DOCUMENT. IN NO EVENT WILL NOKIA BE LIABLE FOR ANY DAMAGES,
INCLUDING BUT NOT LIMITED TO SPECIAL, DIRECT, INDIRECT, INCIDENTAL OR
CONSEQUENTIAL OR ANY LOSSES, SUCH AS BUT NOT LIMITED TO LOSS OF PROFIT,
REVENUE, BUSINESS INTERRUPTION, BUSINESS OPPORTUNITY OR DATA THAT MAY ARISE
FROM THE USE OF THIS DOCUMENT OR THE INFORMATION IN IT, EVEN IN THE CASE OF
This document is Nokia proprietary and condential information, which may not be
distributed or disclosed to any third parties without the prior written consent of Nokia.
This product may present safety risks due to laser, electricity, heat, and other
sources of danger.
Only trained and qualied personnel may install, operate, maintain or otherwise
handle this product and only after having carefully read the safety information
applicable to this product.
The safety information is provided in the Safety Information section in the “Legal,
Safety and Environmental Information” part of this document or documentation
set.
Nokia is continually striving to reduce the adverse environmental effects of its products and
services. We would like to encourage you as our customers and users to join us in working
towards a cleaner, safer environment. Please recycle product packaging and follow the
recommendations for power use and proper disposal of our products and their components.
If you should have questions regarding our Environmental Policy or any of the environmental
services we offer, please contact us at Nokia for any additional information.
4
No further reproduction or networking is permitted. Distributed by Nokia.
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
Replacing Multicontroller RNC Hardware Units
Table of Contents
List of Figures
Figure 1 BCN module 1 in S3-B2 ............................................................................................... 29
Figure 2 BCN module 2 in S3-B2 ............................................................................................... 32
Figure 3 BCN module 3 in S3-B2 ............................................................................................... 35
Figure 4 BCN module 4 in S3-B2 ............................................................................................... 38
Figure 5 BCN module 1 in S7-B2 ............................................................................................... 41
Figure 6 BCN module 2 in S7-B2 ............................................................................................... 44
Figure 7 BCN module 3 in S7-B2 ............................................................................................... 48
Figure 8 BCN module 4 in S7-B2 ............................................................................................... 52
Figure 9 BCN module 5 in S7-B2 ............................................................................................... 56
Figure 10 BCN module 6 in S7-B2 ............................................................................................. 60
Figure 11 BCN module 7 in S7-B2 ............................................................................................. 64
Figure 12 BCN module 8 in S7-B2 ............................................................................................. 68
Figure 13 Removing the BCN module top cover ..................................................................... 79
Figure 14 BCN module add-in card screws .............................................................................. 79
Figure 15 Pulling an add-in card out from the BCN module ................................................. 79
Figure 16 Inserting an add-in card into the BCN module ...................................................... 80
Figure 17 BCN add-in card screws ............................................................................................ 80
Figure 18 Installing BCN top cover ............................................................................................ 81
Figure 19 Removing the BCN module top cover ..................................................................... 93
Figure 20 BCN module add-in card screws .............................................................................. 93
Figure 21 Pulling an add-in card out from the BCN module ................................................. 93
Figure 22 Pulling an add-in card out from the BCN module ................................................. 94
Figure 23 SO-DIMM memory module ....................................................................................... 94
Figure 24 Removing SO-DIMM memory module ..................................................................... 96
Figure 25 SO-DIMM sprung up ................................................................................................... 96
Figure 26 Pulling out the SO-DIMM memory module ............................................................. 98
Figure 27 SO-DIMM memory module removed ....................................................................... 99
Figure 28 Installing a new SO-DIMM memory module ......................................................... 100
Figure 29 Installing a new SO-DIMM memory module in socket ........................................ 102
Figure 30 Locking the new SO-DIMM memory module ....................................................... 103
Figure 31 Inserting an add-in card into the BCN module .................................................... 104
Figure 32 Inserting an add-in card into the BCN module .................................................... 104
Figure 33 BCN add-in card screws .......................................................................................... 105
Figure 34 Installing BCN module top cover ........................................................................... 105
Figure 35 The SAS/SATA switch in the HDSAM-A ................................................................. 110
Figure 36 Pulling the hot swap handle of an AMC ................................................................ 111
Figure 37 Removing an AMC from the BCN module ............................................................. 111
Figure 38 HDD on HDSAM-A .................................................................................................... 112
Figure 39 Installing the HDD on HDSAM-A ............................................................................ 113
Figure 40 Inserting an AMC into the BCN module ................................................................ 114
List of Tables
Table 1 SO-DIMM memory module identification details ...................................................... 87
Table 2 List of available DIMI tests ......................................................................................... 150
Table 3 List of available group DIMI tests .............................................................................. 151
Table 4 Parameters of the command for getting the available diagnostic tests ............ 152
Table 5 Parameters of the command for starting a diagnostic test ................................. 155
Table 6 Parameters of the command for viewing the status of a diagnostic test
......................................................................................................................................... 160
Table 7 Parameters of the command for viewing the test reports ................................... 162
Summary of changes
A list of changes between document issues. You can navigate through the
respective changed topics.
Updated the description and example in the step - Shut down the BCN module using the
zchassis_ex script.
Updated the example for the step - Shut down BCN module using the zchassis_ex script
and the related steps.
Updated the steps for running the zchassis_ex script and the related steps.
Updated the description and example in the step - Shut down the mcRNC module using
the zchassis_ex script.
Added a step instructing to bring down the interface while preparing the replacement
mcRNC module.
12
No further reproduction or networking is permitted. Distributed by Nokia.
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
Replacing Multicontroller RNC Hardware Units
Purpose
In a multi-chassis environment (two or more BCN modules), if the existing BCN module is
faulty, it needs to be removed and replaced with a new BCN module.
Note:
This chapter provides the steps to remove the BCN module from the system.
Procedure
1 Identify the BCN module to be replaced in the running system.
Note:
In this procedure, the BCN module that is identified to be replaced is BCN
module-2.
3 Check which of the nodes running in the BCN module are to be replaced.
/cabinet-1/chassis-1/piu-1/addin-1/CPU-1/core-0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27
/cabinet-1/chassis-2/piu-1/addin-1/CPU-1/core-0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27
/cabinet-1/chassis-1/piu-1/addin-3/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-1/piu-1/addin-4/CPU-1/core-16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31
/cabinet-1/chassis-1/piu-1/addin-6/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-1/piu-1/addin-7/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-1/piu-1/addin-8/CPU-1/core-16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31
/cabinet-1/chassis-2/piu-1/addin-3/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-2/piu-1/addin-4/CPU-1/core-16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31
/cabinet-1/chassis-2/piu-1/addin-6/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-2/piu-1/addin-7/CPU-1/core-10,11,12,13,14,15,16,17,18,19,20,21,22,23,28,29,30,31
/cabinet-1/chassis-2/piu-1/addin-8/CPU-1/core-16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31
The output provides that the following nodes are to be replaced in the BCN module:
CFPU-1
CSPU-1
USPU-1
EIPU-1
CSPU-3
USPU-3
USPU-5
EIPU-3
USSR-1
CSUP-1
USUP-1
EITP-1
CSUP-3
USUP-3
USUP-5
EITP-3
If the BCN module to be replaced is module-1 or module-2, find out with the following
SCLI command the CFPU node, in which the active instance of the FSSSHServer
recovery unit is located:
Step result
The role field displays whether the recovery unit is in active or standby mode. If the
FSSSHServer recovery unit is active in the BCN module to be replaced, execute a
switchover of the SSH recovery group by entering the following SCLI command:
Step example
[root@CFPU-0(RNC-1001) /root]
# zchassis_ex
2 - Start Up Chassis
0 - Exit
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
(Default is yes):
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
<<<INFO>>> Shutdown nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
<<<INFO>>> Power off nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
To disconnect the cables connected to the chassis to be replaced, refer the following
steps:
1. Switch off the circuit breaker on the power distribution unit (PDU) for the BCN
module in question.
2. Disconnect the power feed cables.
3. Disconnect all the cables from the transceivers on the front side of the chassis.
4. Disconnect the mcRNC grounding cable.
5. Keep the network cables attached to the front cable tray of the chassis.
6. Uninstall the cable tray with attached network cables from the BCN module. The
cable tray is uninstalled by unscrewing the two thumbscrews fixing the cable tray
to the BCN module. If the screws are too tight to be opened by hand, loosening the
screws that fix the BCN module mounting flanges to the cabinet might help. For
more information about detaching the cable tray, see Installing BCN Hardware to
CAB216SET-B.
7. Move the cable tray with attached network cables under the module, so the module
can be easily pulled out from the rack.
9 If there is a hard disk drive (HDD) in the AMC bay, remove it.
If the BCN module has an AMC slot, remove the HDD AMC.
This chapter provides the steps in replacing an BCN module. The mcRNC
configuration and the BCN module to be replaced need to be taken into account.
Procedure
1 Insert the new BCN module in the rack.
Note:
For detailed cabling information and instructions, see WCDMA RAN Operating
Documentation ► Install ► RNC ► Multicontroller RNC Hardware
Installation Quick Guide.
2.1 Install the cable tray with the attached network cables back to the
BCN module.
For more information about the cable tray installation procedure, see Installing
BCN Hardware to CAB216SET-D.
2.2 Connect the BCN module grounding cable.
2.3 Reconnect the network cables to the transceivers on the front side of
the module.
2.5 Switch on the circuit breaker on the PDU for the BCN module in
question.
Login to LMP and check the eSW version using the following command:
sw_fw_versioninfo
The command lists the software version of the LMP and all the add-in cards in the BCN
module. If the versions are compatible with the eSW delivered with mcRNC software
that you are currently using in the mcRNC, upgrading eSW in this step is not required.
You can upgrade eSW using the SCLI commands in a later stage. The operator must
familiarize with minimum required eSW versions described in software release notes.
If the eSW is on supported level on both active and backup bank, continue to step 4.
Otherwise, upgrade the eSW by performing the procedures described in Appendix 2:
Upgrading embedded software of Commissioning Multicontroller RNC HW Rel.2.
The sub-steps provide instructions for configuring the new BCN module so that it is
Note:
After the reboot in sub-step b, the interface comes up automatically.
ifup eth0.800
Note:
The following examples show the default MGT eth0 IP addresses used in
the new module:
root@LMP-1-2-1:/opt/bcntools#
./nokia_set_factory_default.sh
3. Restart the box controller node (BCN) module to activate the configuration
using the following:
4. Check the module configuration using the serial connection. Verify the
following values for ensuring that the factory settings was restored
successfully:
a. Check the IP address of the eth0 of the module (IP address of the module
must be 10.10.10.10):
# mch_cli GetRackNumber
After restarting the BCN module and returning the session back to CFPU node
as the last steps of the pre-configuration procedure, continue to step d.
4.4 Wait for 10 minutes until the new BCN module has started up.
4.5 When connecting from the CFPU-X to the new BCN, Secure Shell (SSH)
keys need to be updated.
1. Delete the file /root/.ssh/known_hosts from both CFPU nodes with the
following command:
rm /root/.ssh/known_hosts
2. When logging in to the LMP of the new BCN module, ensure that the new
LMP prompt is in the following format:root@LMP-1-X-1
If not, delete the file /opt/dhcp_random from the LMP with the following
command:
rm /opt/dhcp_random
After the deletion, the dhcp_hook script runs automatically within ten
minutes and sets the LMP prompt.
3. Verify that the eSW matches the baseline version on the active and the
backup banks.
4. If needed, upgrade the eSW by performing the procedures described in
Appendix B: Upgrading embedded software of Commissioning Multicontroller
RNC HW Rel.2.
cat /proc/drbd
If replacement BCN module contains an HDD in the AMC bay, DRBD synchronization is
required. Do not restart the node during the DRBD synchronization. The initialization
process of the new disk is not ready until the synchronization has successfully
completed. Wait until the synchronization is complete.
Step example
srcversion: 35B9BF7C501212268498452
ns:512081 nr:0 dw:635 dr:512860 al:4 bm:32 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:104849 nr:0 dw:31303 dr:106531 al:6 bm:7 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:204756 nr:0 dw:36 dr:205264 al:3 bm:13 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:2890764 nr:0 dw:46448 dr:2882497 al:32 bm:190 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:12469416 [==>.................] sync'ed:
18.9% (12176/14996)M
ns:16024 nr:0 dw:78448 dr:174701 al:489 bm:200 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:3062668
ns:533 nr:0 dw:4921 dr:4830 al:13 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:102360
ns:0 nr:0 dw:349 dr:1461 al:2 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:8152
7: cs:PausedSyncS ro:Primary/Secondary ds:UpToDate/Inconsistent C rap-- ns:0 nr:0 dw:12 dr:675 al:2 bm:0 lo:0 pe:0 ua:0 ap:0
ns:133 nr:0 dw:1894 dr:759 al:5 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:511948
ns:0 nr:0 dw:116 dr:4461 al:7 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:2916224
ns:0 nr:0 dw:1500 dr:956 al:3 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:102360
The example shows that the first blocks are already synchronized. The out-of-synch
(oos) value is zero. For block 3, the synchronization is in process and progress is
displayed. Once synchronization is complete, the oos value for all blocks will be 0.
Note:
Since the zchassis_ex operation takes more than 30 minutes, the SSH
might disconnect automatically which breaks the zchassis_ex operation.
Hence, when starting the zchassis_ex script a screen command (a
terminal emulator) is used that multiplexes a physical terminal among
several simultaneous processes. The tool prevents SSH downtime and the
running process continues independently of the SSH connection availability.
For more information, see Appendix: Screen command.
Note:
Disk synchronization is applicable only for BCN modules 1 and 2. It is not
relevant for BCN modules 3 to 8.
Note:
Mirroring is ready when all partitions are Primary/Secondary
ds:UpToDate/UpToDate.
The mirroring takes about 30 to 40 minutes.
Step example
[root@CFPU-0(RNC-1001) /root]
# zchassis_ex
2 - Start Up Chassis
0 - Exit
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
(Default is yes):
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
<<<INFO>>> Wait for synchronizing the disk drive for the node
<<<INFO>>> Wait for CFPU-1 to restart and synchronize the disk drive. This will take a few minutes.
<<<INFO>>> Power on nodes: CFPU-1 EIPU-3 USPU-5 USPU-3 CSPU-3 EIPU-1 USPU-1 CSPU-1 Done!
<<<INFO>>> Unlock nodes: CFPU-1 EIPU-3 USPU-5 USPU-3 CSPU-3 EIPU-1 USPU-1 CSPU-1 Done!
[root@CFPU-0(RNC-1001) /root]
This section provides steps to prepare LMP in a specific BCN module and
configuration.
Purpose
Procedure
1 Log in to the CFPU through a normal O&M connection.
In this case, CFPU- 1 because BCN module 1 which contains CFPU-0 is being replaced.
2 Switch to root account.
set user
Note:
Log in with the root user password.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-3-1:/opt/bcntools
4 Log in to LMP-1-3-1.
ssh root@lmp-1-3-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
cd /opt/bcntools
scp root@10.10.10.13:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
script.
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
Purpose
Procedure
1 Log in to the CFPU through a normal O&M connection.
In this case, CFPU-0 because BCN module 2 which contains CFPU-1 is being replaced.
2 Switch to root account.
set user
Note:
Log in with the root user password.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-4-1:/opt/bcntools
4 Log in to LMP-1-4-1.
ssh root@lmp-1-4-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to the /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.14:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
Purpose
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-1-1:/opt/bcntools
4 Log in to LMP-1-1-1.
ssh root@lmp-1-1-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.11:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
script.
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-1-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
Purpose
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-2-1:/opt/bcntools
4 Log in to LMP-1-2-1.
ssh root@lmp-1-2-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.12:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
script.
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-2-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
Purpose
2. Follow the steps in Installing the new BCN module from step 1 (inserting the new BCN
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
In this case, CFPU- 1 because BCN module 1 which contains CFPU-0 is being replaced.
2 Switch to root account.
set user
Note:
Log in with the root user password.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-5-1:/opt/bcntools
4 Log in to LMP-1-5-1.
ssh root@lmp-1-5-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.15:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
Purpose
Figure 6: BCN module 2 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
In this case, CFPU-0 because BCN module 2 which contains CFPU-1 is being replaced.
2 Switch to root account.
set user
Note:
Log in with the root user password.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-6-1:/opt/bcntools
4 Log in to LMP-1-6-1.
ssh root@lmp-1-6-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.16:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
Purpose
Figure 7: BCN module 3 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
4 Log in to LMP-1-7-1.
ssh root@lmp-1-7-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.17:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-7-1 to the bash shell (root) in the CFPU node that hosts the
Purpose
Figure 8: BCN module 4 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
4 Log in to LMP-1-8-1.
ssh root@lmp-1-8-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.18:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-8-1 to the bash shell (root) in the CFPU node that hosts the
Purpose
Figure 9: BCN module 5 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-1-1:/opt/bcntools
4 Log in to LMP-1-1-1.
ssh root@lmp-1-1-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.11:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-1-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
Purpose
Figure 10: BCN module 6 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-2-1:/opt/bcntools
4 Log in to LMP-1-2-1.
ssh root@lmp-1-2-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.12:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-2-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
Purpose
Figure 11: BCN module 7 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-3-1:/opt/bcntools
4 Log in to LMP-1-3-1.
ssh root@lmp-1-3-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.13:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-3-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
Purpose
Figure 12: BCN module 8 in S7-B2
module in the rack) to step 4 (preparing the replacement BCN module), upto running
the nokia_set_factory_default.sh script and restarting the box controller node
(BCN) module.
Procedure
1 Log in to the CFPU through a normal O&M connection.
Login takes place in the CFPU node that hosts the active SSH server.
set user
Note:
Log in with the root user password.
3 Copy the bcninit directory content to the LMP on the logged in CFPU node.
scp /opt/nokiasiemens/SS_QNTools/bcninit/bcninit.*
root@lmp-1-4-1:/opt/bcntools
4 Log in to LMP-1-4-1.
ssh root@lmp-1-4-1
mch_cli GetNetworkElementId
7 Take the SSH connection from the LMP to the new BCN module LMP.
ssh root@10.10.10.10
8 Go to /opt/bcntools directory.
cd /opt/bcntools
scp root@10.10.10.14:/opt/bcntools/bcninit.* ./
cd /opt/bcntools/bcninit
Note:
SSH connection to BCN module under preparation is broken after giving this
command because MGT port IP address changes to a proper one and it is no
longer 10.10.10.10.
15 Exit from LMP-1-4-1 to the bash shell (root) in the CFPU node that hosts the
active SSH server.
1. Identify the BCN module in which the add-in card to be replaced is located.
2. Perform a graceful shutdown of the BCN module.
3. Uninstall the BCN module.
4. Uninstall the add-in card.
5. Remove the DIMM memories from the add-in card.
6. Insert the DIMM memories to the new add-in card.
7. Install the new add-in card to the BCN module.
8. Install the BCN module.
9. Activate the BCN module.
Note:
A faulty add-in card has been discovered. DIMM memories are not included when
ordering add-in cards from Nokia. The DIMM memories would need to be removed
from the faulty add-in card and installed in the new add-in card.
Generally, an add-in card memory diagnostic test (HW-DDR2) cannot locate the
failure of one or multiple DIMMs. The test only knows the memory address where
the read value is not same as the write value. The failure can be either in the
add-in card address or in the memory buses. Replace the add-in card and all of its
DIMMs.
For more information on DIMM memory, see BCN Hardware Jumper Settings and
DIMM Configurations.
CAUTION!
Procedure
1 Identify the BCN module in which the add-in card to be replaced is located.
If the add-in card to be replaced is located in module-1 or module-2, find out with the
following SCLI command the CFPU node, in which the active instance of the
FSSSHServer recovery unit is located:
Step result
The role field displays whether the recovery unit is in active or standby mode. If the
FSSSHServer recovery unit is active in the BCN module that contains the add-in card
to be replaced, execute a switchover of the SSH recovery group by entering the
following SCLI command:
Step example
[root@CFPU-0(RNC-1001) /root]
# zchassis_ex
2 - Start Up Chassis
0 - Exit
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
(Default is yes):
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
<<<INFO>>> Shutdown nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
<<<INFO>>> Power off nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
6 Disconnect all the cables connected to the chassis, executing the following
steps:
1. Switch off the circuit breaker on the PDU for the BCN module in question.
2. Disconnect the power feed cables.
3. Disconnect all the cables from the transceivers on the front side of the chassis.
4. Disconnect the mcRNC grounding cable.
5. Keep the network cables attached to the front cable tray of the chassis.
6. Uninstall the cable tray with attached network cables from the BCN module. The
cable tray is uninstalled by unscrewing the two thumbscrews fixing the cable tray
to the BCN module. If the screws are too tight to be opened by hand, loosening the
screws that fix the BCN module mounting flanges to the cabinet should help. For
more information about detaching the cable tray, refer to the document Installing
BCN Hardware to CAB216SET-B.
7. Move the cable tray with attached network cables under the module, so the module
can be easily pulled out from the rack.
Option Description
Then 1. Pull the module out of the cabinet, until it locks into the outmost
position.
2. If there is another BCN module installed immediately above the module
in question, unscrew the two screws attaching the cable tray to the BCN
module immediately above and lift the cable tray upwards. This creates
enough space for the removal of the lower module's top cover.
7 Loosen the thumbscrews of the top cover. Slide the top cover of module
towards the rear side until it stops. Then, lift the top cover upwards.
8 Unscrew the two thumbscrews securing the add-in card to the rails inside
the BCN module.
9 Slide the add-in card upwards to remove it from the BCN module.
Figure 15: Pulling an add-in card out from the BCN module
DIMM Configurations.
Procedure
1 Install DIMM memories, if necessary.
2 Slide the add-in card into the rails inside the BCN module until the pins of
the card fall into connectors of the main board.
3 Secure the add-in card to the rails with the built-in thumbscrews.
The Phillips screws are built into the add-in card and can be tightened either by hand
or with a screwdriver.
4 Place the BCN module cover on the top of the module, leaving small gap
between the top cover and the front edge of the module.
5 Slide the top cover to the front side of the module, until it locks into place.
7 Connect all the cables to the BCN module, by executing the following steps:
1. Install the cable tray with attached network cables back to the BCN module.
For more information about the cable tray installation, see Installing BCN Modules
to the IR206 Cabinet.
2. Connect the BCN module grounding cable.
3. Connect the network cables back to the transceivers on the front side of the
module.
4. Connect the power feed cables.
5. Switch on the circuit breaker on the PDU for the BCNmodule.
6. Wait until all LEDs are red or green.
Note:
Since the zchassis_ex operation takes more than 30 minutes to complete,
the SSH could disconnect automatically which breaks the zchassis_ex
operation. Hence, when starting the zchassis_ex script a screen command
(a terminal emulator) is used that multiplexes a physical terminal among
several simultaneous processes. The tool makes the SSH downtime-proof,
thus, more stable because the running process continues independently of
the SSH connection availability.
For more information, see Appendix: Screen command.
Note:
Disk synchronization is applicable only for BCN modules 1 and 2. It is not
relevant for BCN modules 3 to 8.
Note:
Mirroring is ready when all partitions are Primary/Secondary
ds:UpToDate/UpToDate.
The mirroring takes about 30 to 40 minutes.
Step example
[root@CFPU-0(RNC-1001) /root]
# zchassis_ex
2 - Start Up Chassis
0 - Exit
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
(Default is yes):
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
<<<INFO>>> Wait for synchronizing the disk drive for the node
<<<INFO>>> Wait for CFPU-1 to restart and synchronize the disk drive. This will take a few minutes.
<<<INFO>>> Power on nodes: CFPU-1 EIPU-3 USPU-5 USPU-3 CSPU-3 EIPU-1 USPU-1 CSPU-1 Done!
<<<INFO>>> Unlock nodes: CFPU-1 EIPU-3 USPU-5 USPU-3 CSPU-3 EIPU-1 USPU-1 CSPU-1 Done!
[root@CFPU-0(RNC-1001) /root]
9 Check hat the eSW of the replaced add-in card is on supported level.
Log in to LMP and check the eSW version info using the following command:
sw_fw_versioninfo
If active bank eSW is on the supported level, continue to the next step. Only active
banks are displayed. To also show backup banks, run the following SCLI command:
If the active bank eSW is not on the supported level, update by performing the
following SCLI command:
!
This needs to be performed twice because of the backup bank.
If the command is not successful then use the offline Upgrade with FEWS described in
Appendix 2: Upgrading embedded software of Commissioning Multicontroller RNC HW
Rel.2.
Note:
In case of eSW upgrade issues, the replacement unit can be faulty.
Therefore, it is highly recommended that two add-in cards are available when
add-in card replacement procedure is conducted.
It is important to keep the spare add-in cards in a storage with a new enough
eSW version, to avoid eSW incompatibility issues when the add-in card is
considered to use.
Note:
Locking the external interface processing unit (EIPU) node can lead to a restart
of this node (due to internal reasons, which is a normal behavior), failure in the
non-intrusive subtest during node start-up, and three to five minutes waiting
time for diagnostics to be ready.
11 Start hardware diagnostic test for the replacement add-in card group test
group-all.
+++++++++++++++++++++++++++++++++++++++++++++++++++
If Failed in the test execution phase message is received, see Failure in the
test execution phase. For all other errors, contact Nokia Technical Support.
12 Take the add-in card into use by removing it from the test-state, and then
unlock the add-in card back to operational.
Note:
After software upgrade, do not run the intrusive diagnostics for either of the
CFPU nodes before the new software has been accepted (that is, before the
normalization has been conducted). This is to avoid triggering auto-return
because of the excessive number of node restarts, which the diagnostics might
invoke.
1. Identify in which BCN module the SO-DIMM memory module to be replaced is located.
2. Perform a graceful shutdown of the BCN module.
3. Uninstall the BCN module.
4. Uninstall the add-in cards from slots 7 and 8.
5. Remove the SO-DIMM memory module to be replaced from the motherboard.
6. Insert the new SO-DIMM memory module on to the motherboard.
7. Install the removed add-in cards back to their original location to the slots 7 and 8 in
the BCN module.
8. Install the BCN module.
9. Activate the BCN module.
Note:
The DIMM memory needs to be replaced when a faulty SO-DIMM memory module
has been discovered.
The following table lists the Identification details of the SO-DIMM memory module:
CAUTION!
WARNING!
Only one BCN module is allowed to be pulled out from the cabinet at one time.
Procedure
1 Identify which BCN module needs the replacement SO-DIMM.
If the SO-DIMM to be replaced is located in module-1 or module-2, find out with the
following SCLI command the CFPU node, in which the active instance of the
FSSSHServer recovery unit is located:
Step result
The role field displays whether the recovery unit is in active or standby mode. If the
FSSSHServer recovery unit is active in the BCN module that contains the SO-DIMM to
be replaced, execute a switchover of the SSH recovery group by entering the
following SCLI command:
Step example
[root@CFPU-0(RNC-1001) /root]
# zchassis_ex
2 - Start Up Chassis
0 - Exit
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
(Default is yes):
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
<<<INFO>>> Shutdown nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
<<<INFO>>> Power off nodes:CSPU-1 USPU-1 EIPU-1 CSPU-3 USPU-3 USPU-5 EIPU-3 CFPU-1
1. Switch off the circuit breaker on the PDU for the BCN module.
2. Disconnect the power feed cables.
3. Disconnect all the cables from the transceivers on the front side of the chassis.
4. Disconnect the BCN grounding cable.
5. Keep the network cables attached to the front cable tray of the chassis.
6. Uninstall the cable tray with attached network cables from the BCN module.
Note:
The cable tray is uninstalled by unscrewing the two thumbscrews fixing the
cable tray to the BCN module. If the screws are too tight to be opened by
hand, loosening the screws that fix the BCN module mounting flanges to the
cabinet could help. For more information about detaching the cable tray,
refer to the document Installing BCN Hardware to CAB216SET-B.
7. Move the cable tray with attached network cables under the module, so the module
can be easily pulled out from the rack.
Option Description
Then 1. Pull the module out of the cabinet, until it locks into the outmost
position.
2. If there is another BCN module installed immediately above the module
in question, unscrew the two screws attaching the cable tray to the BCN
module immediately above and lift the cable tray upwards. This creates
enough space for the removal of the lower module's top cover.
7 Loosen the thumbscrews of the top cover. Slide the top cover of module
towards the rear side until it stops. Then, lift the top cover upwards.
8 Unscrew the two thumbscrews securing the add-in card in slot 7 and 8 to
the rails inside the BCN module.
9 Slide the add-in card in slot 8 upwards to remove it from the BCN module.
Figure 21: Pulling an add-in card out from the BCN module
10 Slide the add-in card in slot 7 upwards to remove it from the BCN module.
Figure 22: Pulling an add-in card out from the BCN module
Procedure
1 Locate the SO-DIMM memory module on the motherboard of the BNC
module.
2 Bend the locking springs on both sides of the SO-DIMM outwards so that the
SO-DIMM springs up.
97
Remove the SO-DIMM by pulling it out from the socket.
3
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
No further reproduction or networking is permitted. Distributed by Nokia.
98
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
No further reproduction or networking is permitted. Distributed by Nokia.
99
© 2021 Nokia.Nokia confidential
Figure 27: SO-DIMM memory module removed
Replacing Multicontroller RNC Hardware Units
No further reproduction or networking is permitted. Distributed by Nokia.
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
Replacing Multicontroller RNC Hardware Units
Procedure
1 Install the new SO-DIMM to its socket in about 30 degrees angle to the
motherboard.
101
© 2021 Nokia.Nokia confidential
Replacing Multicontroller RNC Hardware Units
No further reproduction or networking is permitted. Distributed by Nokia.
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
Replacing Multicontroller RNC Hardware Units
2 Push SO-DIMM down from the upper corner until it locks from both sides in
horizontal position.
103
© 2021 Nokia.Nokia confidential
Figure 30: Locking the new SO-DIMM memory module
Replacing Multicontroller RNC Hardware Units
No further reproduction or networking is permitted. Distributed by Nokia.
Copyrighted material licensed to carlos.paredes@nokia.com on 08-08-2022.
Replacing Multicontroller RNC Hardware Units
This chapter provides the steps to install removed add-in cards back to slots 7
and 8.
Procedure
1 Slide the add-in card to the slot 7 into the rails inside the BCN module until
the pins of the card fall into connectors of the main board.
2 Slide the add-in card to the slot 8 into the rails inside the BCN module until
the pins of the card fall into connectors of the main board.
3 Secure the add-in cards in slots 7 and 8 to the rails with the built-in
thumbscrews.
The Phillips screws are built into the add-in card and can be tightened either by hand
or with a screwdriver.
4 Place the BCN module’s cover on the top of the module, leaving small gap
between the top cover and the front edge of the module.
4 Slide the top cover to the front side of the module, until it locks into place.
4 Connect all the cables to the BCN module, by executing the following steps:
1. Install the cable tray with attached network cables back to the BCN module.
Note:
For more information about the cable tray installation, check the document
Installing BCN Modules to the IR206 Cabinet.
module.
4. Connect the power feed cables.
5. Switch on the circuit breaker on the PDU for the BCN module.
6. Wait until all LEDs are red or green.
Note:
Since the zchassis_ex operation takes more than 30 minutes to complete,
the SSH could disconnect automatically which breaks the zchassis_ex
operation. Hence, when starting the zchassis_ex script a screen command
(a terminal emulator) is used that multiplexes a physical terminal among
several simultaneous processes. The tool makes the SSH downtime-proof,
thus, more stable because the running process continues independently of
the SSH connection availability.
For more information, see Appendix: Screen command.
Note:
Disk synchronization is applicable only for BCN modules 1 and 2. It is not
relevant for BCN modules 3 to 8.
Note:
Mirroring is ready when all partitions are Primary/Secondary
ds:UpToDate/UpToDate.
The mirroring takes about 30 to 40 minutes.
Step example
# zchassis_ex
0 - Exit
Please enter your choice:2
---------------------------------------------------------------
-----------------
Enter the chassis number[1-6] to startup.
(press <ENTER> to return to main menu):2
<<<INFO>>> Waiting for getting hardware information...
---------------------------------------------------------------
-----------------
Do you need to synchronize the hard disk of the new
chassis?[y/n]
(Default is yes):y
---------------------------------------------------------------
-----------------
Startup Operation Summary
Startup chassis : chassis-2
Synchronize hard disk of the new chassis: Yes
---------------------------------------------------------------
-----------------
Are you sure to proceed[y/n]y
<<<INFO>>> Wait for synchronizing the disk drive for the node
<<<INFO>>> Power off node CFPU-1
<<<INFO>>> Power on node CFPU-1
<<<INFO>>> Reset node CFPU-1
<<<INFO>>> Wait to enter into initializing state
<<<INFO>>> Disable Watch dog
<<<INFO>>> Initialise hardware
1. # cat /proc/drbd
2. show has summary
3. show alarm active-summary
4. show has functional-unit unit-info show-mode verbose
5. show cmf status node-name /CFPU-0
6. show cmf status node-name /CFPU-1
7. show radio-network wcelstatus blocked
The procedures are outlined for replacing the system hard disk. If there are two
disks in the BCN module, it is necessary to determine first that the faulty HDD is
the system disk.
Purpose
The main steps to replace the HDD are the following:
1. Identify in which BCN module the HDD to be replaced is located.
2. If there are two disks in the BCN module, identify first if the system disk is faulty by
using the following command:
The output of the command lists the active alarms related to the disk in addition to its
physical location. To ensure that the system disk is faulty and is in need of
replacement, see the documentation of the alarms listed in the command output. For
example, the new alarms 70454 IMPENDING HARD DISK FAILURE and 70455 HDD
TEMPERATURE EXCEEDED introduced in BCN lead to disk replacement.
Note:
There are two disks in the BCN module if a disaster recovery disk is in use in the
mcRNC. To check if the DRD is faulty, follow the steps in Replacing the disaster
recovery hard disk.
3. Shut down the CFPU node in the BCN module where the HDD to be replaced is located.
4. Remove the AMC from the AMC bay.
5. Uninstall the faulty HDD.
6. Install the new HDD.
7. Insert the AMC to the AMC bay.
8. Activate the CFPU with the new HDD.
CAUTION!
The HDSAM-A supports both SAS and serial advanced technology attachment (SATA) HDDs
and includes a SAS or SATA switch for selecting the disk type. BCN platform supports only
SAS HDDs, thus, always check that the switch is set to SAS before starting the
replacement procedure.
This chapter provides the steps in removing the AMC from BCN module.
Procedure
1 Identify in which BCN module the HDD to be replaced is located.
2 Log into the CFPU node where the HDD is NOT faulty.
5 Gently pull the hot swap handle on the front panel of the AMC.
Do not pull the handle out all the way yet. Pulling the handle notifies the hardware
management system that you are going to remove the AMC and tells it to finish all
processes.
6 Wait until the hot swap LED turns into a solid blue.
7 Pull the hot swap handle again more firmly and slide the AMC out of the bay.
8 If you are not installing another AMC immediately, install an AMC filler into
the empty AMC bay.
This is to ensure adequate cooling and a proper EMC shield in the module.
This chapter provides the steps to remove the faulty HDD from AMC.
Procedure
1 Place the AMC so that the faulty HDD side is facing down. Unscrew the four
screws on the metal bracket of the AMC module, then turn the module over
carefully while holding the HDD.
Detach the faulty HDD from the connector by pulling it gently (from right to left as
shown in the following figure).
This chapter provides the steps to install the new HDD on AMC.
Procedure
1 Connect the new HDD to the SAS connector of HDSAM-A.
Connect the new HDD to the SAS connector in the HDSAM-A by pushing it gently (from
left to right as shown in the following figure).
2 Turn the AMC over and attach the new HDD to the AMC with four screws.
Tighten the screws so that their heads are in line with the metal bracket.
This chapter provides the steps to install the AMC back to BCN module.
Procedure
1 Check that the EMC gasket is correctly in place and that its contacts are
clean.
2 Insert the AMC into the bay, sliding it along the guide rails.
Ensure that the AMC is firmly seated in the connectors of the module.
Wait until the blue hot swap LED turns off and the power LED turns solid green.
Procedure
1 Enable the network boot for the CFPU node with the new HDD, by executing
the following steps:
Note:
The CFPU node takes some time to reboot and the availability can be checked
by logging through the SSH.
Step example
2 Enable INERT mode for the CFPU node, by executing the following command:
Step example
3 Initialize the new HDD from the other CFPU node where the HDD is not
faulty.
initialise hw
Note:
To run the initialization script and display the console output, the space bar
must be pressed several times after entering the command. The initialization of
the new HDD might take an hour.
4 Disable INERT mode for the CFPU node by executing the following command:
Step example
5 Reboot the CFPU node with the new HDD from the local HDD.
The node restarts and synchronizes the DRBD. Enter watch -n 10 cat
/proc/drbd to see how the synchronization is progressing. However, if watch -n
10 cat /proc/drbd fails, cat /proc/drbd must be executed.
Note:
Set user username root command tag first before execution of following
command:
Do not restart the node during the DRBD synchronization. The initialization process of
the new disk is not ready until the synchronization is successfully completed.
Step example
The following example shows that the first blocks are already synchronized. The oos
value is zero. For block 3, the synchronization is in process and the progress is
displayed. Once the synchronization is complete, the oos value for all blocks will be 0.
srcversion: 35B9BF7C501212268498452
ns:512081 nr:0 dw:635 dr:512860 al:4 bm:32 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:104849 nr:0 dw:31303 dr:106531 al:6 bm:7 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:204756 nr:0 dw:36 dr:205264 al:3 bm:13 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
ns:2890764 nr:0 dw:46448 dr:2882497 al:32 bm:190 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:12469416
ns:16024 nr:0 dw:78448 dr:174701 al:489 bm:200 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:3062668
ns:533 nr:0 dw:4921 dr:4830 al:13 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:102360
ns:0 nr:0 dw:349 dr:1461 al:2 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:8152
ns:0 nr:0 dw:12 dr:675 al:2 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:8152
ns:133 nr:0 dw:1894 dr:759 al:5 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:511948
ns:0 nr:0 dw:116 dr:4461 al:7 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:2916224
ns:0 nr:0 dw:1500 dr:956 al:3 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:102360
6 Check that the serving and backup Cluster Management Functionality (CMF)
are working normally.
Compare the blocks. The blocks should match for both managed objects.
Step example
7 Unlock the node with the new HDD, by executing the following command:
Step example
The procedures are outlined for replacing the disaster recovery hard disk. If
there are two disks in the BCN module, it is necessary to determine first that
the faulty HDD is the DRD.
Purpose
When there are two disks in the BCN module, the following are the possible scenarios:
1. If one system disk becomes faulty, this system disk is changed and initialized following
the instructions in Replacing the system hard disk.
2. If both system disks become faulty simultaneously, the DRDs are physically switched
with the system disks. For detailed instructions, see the Manual switching of system
disk and recovery disk at the site section of RAN3368: mcRNC Disaster Recovery Using
Redundant Hard Disks.
3. If one DRD becomes faulty, this DRD is replaced with a new one after which a DRD
backup is created in total mode. In this case, the CFPU node does not need to be locked
and powered off (the DRD can be hot-plugged).
a. Identify first if the DRD is faulty by using the following command:
The output of the command lists the active alarms related to the disk in addition to
its physical location. To ensure that the DRD is faulty and is in need of replacement,
see the documentation of the alarms listed in the command output. For example, the
new alarms 70454 IMPENDING HARD DISK FAILURE and 70455 HDD
TEMPERATURE EXCEEDED introduced in mcRNC lead to disk replacement.
b. Follow the subsequent steps outlined in replacing the DRD.
4. If both DRDs become faulty simultaneously, both DRDs are replaced with new ones
after which a DRD backup is created in total mode. In this case, the CFPU nodes do not
need to be locked and powered off (the DRDs can be hot-plugged).
a. Identify first if the DRD is faulty by using the following command:
The output of the command lists the active alarms related to the disk in addition to
its physical location. To ensure that the DRD is faulty and is in need of replacement,
see the documentation of the alarms listed in the command output.
b. Follow the subsequent steps outlined in replacing the DRD.
CAUTION!
The HDSAM-A supports both SAS and serial advanced technology attachment (SATA) HDDs
and includes a SAS or SATA switch for selecting the disk type. BCN platform supports only
SAS HDDs, thus, always check that the switch is set to SAS before starting the
replacement procedure.
This chapter provides the steps to remove the AMC from the BCN module.
Procedure
1 Gently pull the hot swap handle on the front panel of the AMC.
Do not pull the handle out all the way yet. Pulling the handle notifies the hardware
management system that you are going to remove the AMC and tells it to finish all
processes.
2 Wait until the hot swap LED turns into a solid blue.
3 Pull the hot swap handle again more firmly and slide the AMC out of the bay.
4 If you are not installing another AMC immediately, install an AMC filler into
the empty AMC bay.
This is to ensure adequate cooling and proper EMC shield in the module.
This chapter provides the steps to remove the faulty HDD from AMC.
Procedure
1 Place the AMC so that the faulty HDD side is facing down. Unscrew the four
screws on the metal bracket of the AMC module, then turn the module over
carefully while holding the HDD.
Detach the faulty HDD from the connector by pulling it gently (from right to left as
shown in the following figure).
This chapter provides the steps to install the new HDD on AMC.
Procedure
1 Connect the new HDD to the SAS connector of HDSAM-A by pushing it gently
(from left to right as shown in the following figure).
2 Turn the AMC over and attach the new HDD to the AMC with four screws.
Tighten the screws so that their heads are in line with the metal bracket.
This chapter provides the steps to install the AMC back to BCN module.
Procedure
1 Check that the EMC gasket is correctly in place and that its contacts are
clean.
2 Insert the AMC into the bay, sliding it along the guide rails.
Ensure that the AMC is firmly seated in the connectors of the module.
Wait until the blue hot swap LED turns off and the power LED turns solid green.
Postrequisites
At this point, the AMC that contains the new HDD (DRD) is in its place in the BCN module.
When there is no faulty DRD in the mcRNC, the backup can be created on the recovery
disk (in total mode) by using the following SCLI command:
This section describes replacing the failed HDDs on both CFPU nodes.
When delivered with the HDD, the hard disk drive carrier AMC (HDSAM-A) is
already in place. For more information, see Performing quarterly maintenance
routines in Preventive Maintenance in Multicontroller RNC.
If the HDDs are faulty or in need of upgrade or service, they might need to be
replaced. If both disks become faulty simultaneously, the mcRNC will be out of
order. In this case, replace both disks according to the prerequisites and steps
(from 4.1 to 4.4) in Replacing the system hard disk. Afterwards, perform a full
system restore. For more information, see Clean installation in Commissioning
Multicontroller RNC HW Rel.2.
This section describes steps to replace the power distribution unit (PDU) if
found faulty.
Purpose
If the PDU is faulty, it must be replaced with a new PDU.
WARNING!
WARNING!
WARNING!
Procedure
1 Ensure that the redundant PDU is functional.
2 Switch off the circuit breakers on the PDU you are going to remove.
3 Check the PDU input feeds with a digital multimeter to ensure there are no
voltages in the cables.
!
For the correct location in disconnecting cables from the PDU, see the location
where the digital multimeter should be placed.
5 Unscrew the four fixing screws attaching the PDU to the cabinet.
Procedure
1 Insert the PDU into the cabinet and align the holes of its mounting ear with
the cabinet mounting rail.
4 Check the PDU input feeds with a digital multimeter to ensure there is no
voltage in the cables.
5 Connect the site power supply cables to the PDU (for DC power supply only).
1. Remove the nuts from the power terminals with a 10mm socket wrench.Connect
the feeder cable with lug to terminal connector marked -48/-60 VDC IN, and the
return cable with lug to terminal connector marked RTN.
2.
Figure 54: Connecting site power supply cables to the PDU
This section describes the steps to replace the power supply unit.
CAUTION!
Procedure
1 Switch off the circuit breaker on the PDU of the power supply unit to be
replaced.
3 Unscrew the two thumbscrews attaching the power supply unit to the BCN.
The Phillips screws are built into the power supply unit and can be loosened either by
hand or with a screwdriver.
4 Pull out the power supply unit from the BCN module.
Procedure
1 Insert the power supply unit into the power supply slot at the rear side of
the BCN module so the screws built into the unit are on the right-hand side.
The Phillips screws are built into the power supply unit and can be tightened either by
hand or with a screwdriver.
5 Switch on the circuit breaker on the PDU for the power supply unit which
was replaced.
This section describes the steps to replace fan module while the BCN runs.
The fan modules are located at the rear of the BCN module.
The following is an alarm example where Fan 4 speed is zero (0.000) and needs
a replacement:
CAUTION!
Tip:
Prepare the spare fan unit for replacement beforehand. After removing a fan from
the BCN module, the system starts to heat up very quickly. Proceed immediately
with the new fan installation. The procedure in replacing the fan applies to all three
fan modules of the BCN module.
Procedure
1 Unscrew the two thumbscrews attaching the fan module to the BCN.
The Phillips screws are built into the fan module and can be loosened either by hand
or with a screwdriver.
This chapter provides the steps to install a fan module in the BCN module.
Procedure
1 Insert the fan module to the fan module slot at the rear side of the BCN
module.
The Phillips screws are built into the fan module and can be tightened either by hand
or with a screwdriver.
Purpose
To prevent dust from accumulating inside the equipment, the filter element must be
replaced twice a year.
Procedure
1 Unscrew the two thumbscrews attaching the air filter cover to the BCN
module.
2 Open the air filter cover and pull out the air filter.
Figure 60: Opening the air filter cover and pulling out the air filter
3 Push the new air filter into the guide rails on both sides of the air filter
cover.
4 Push the air filter cover back and fasten the two thumbscrews.
This section describes the steps to replace the BCN installation support kit
BSK216-A.
CAUTION!
This chapter describes how to remove the BSK216-A from the cabinet.
This chapter describes how to install the new BCN slide rail BSR216-A.
Remove BSR216-A transportation screw and ETSI rear bracket. Screw four M6 screws
and washers to cabinet frame. Screw four M6 screws and washers to cabinet ETSI
flange.
This section describes the steps to replace the BCN installation kit BSK216-A.
CAUTION!
This chapter describes how to remove the BCN module from the cabinet.
Procedure
1 Remove the BCN module from the support brackets and slide it out from the
cabinet.
Figure 63: Sliding the BCN module out from the cabinet
Remove the cable tray from the brackets by unscrewing two M3x0.5 panel screws.
Figure 64: Removing the cable tray from the BCN module
3 Remove the BCN module side brackets (with handle) from the side of the
BCN module.
Unscrew seven Torx M4 screws for each bracket as shown in the figure below.
Procedure
1 Fix the BCN module side brackets (with handle) to the side of the BCN
module.
Use six Torx M4 screws for each bracket as shown in the figure below.
Fix the cable tray to the brackets with two M3x0.5 panel screws.
3 Place the BCN module on the BCN shelf and slide it into the cabinet.
Before installation, remove the M6 transportation screw and washer from the BCN
shelf. Then, fix the BCN module onto the BCN shelf with two M4x8 torx screws.
Note:
The BSIK216-A installation kit can be used in CAB216SET-B and CAB216SET-D
cabinet sets.
Hardware diagnostics include the non-intrusive test that is run even when the Field
Replaceable Unit (FRU) is working in normal state, and the intrusive test that is run when
the FRU is offline.
The user can run diagnostic tests on FRU to detect potentially faulty components. It also
allows the user to view all the available tests for a particular FRU and to manage the test
reports.
The hardware diagnostic test can be run from an SCLI session in a blocking or non-
blocking mode. Multiple diagnostic test cases can be executed simultaneously on different
FRUs.
The hardware diagnostic is used to check and verify the hardware modules of a specific
add-in card.
Hardware diagnostic is usually started for installing a new chassis, add-in card, or checking
hardware module related problems.
Tip:
If HDSAM-A with HDD (mcRNC AMC) has any HW diagnostic alarm or has a negative
HDD smart health test status, the AMC is faulty. The system does not set any alarm
if the HDD smart health test status is negative, thus, running an AMC HW diagnostic
is recommended.
The HDD smartctl shows SMART Health Status: OK (no active alarm), which
is checked through HW diagnostic.
This section describes the process of viewing the hardware diagnostic tests. The
hardware diagnostic tool is used to view the diagnostic tests available for an
FRU.
Hardware diagnostic tests can be categorized in two:
detailed test (which is a prefixed subtest such as subtest-cpu-io)
group tests (such as group-all, group-cpu, group-mmc, group-storage, and
group-all-non-intrusive)
The following example shows how to check the mapping relation between fru-
location and node by command:
After mcRNC4.0 for hardware type BMPP2-B add-in card, DIMI tests are
available.
Tests Description
subtest-cpu-io-non- This is the same as test CPU offline diagnostic but non-
intrusive intrusive.
subtest-edac-test This is used to check for bit errors reported by the Error
Detection And Correction (EDAC) system.
subtest-hdd-info This is used to display detected hard discs and their properties.
subtest-post-test This is used to check power-on self-test (POST) result code from
bootloader.
subtest-sensor-health This is used to check for any asserted threshold based sensor.
subtest-tlv-eeprom This is used to check the Type Length Value EEPROM (TLV
EEPROM) for consistency by verifying the checksums.
group-cpu-non- This includes non-intrusive diagnostic group for CPU and its
intrusive IO interface.
Purpose
Available tests that can be run on a particular FRU are viewed.
Procedure
1 View hardware diagnostic tests.
To view the available diagnostic tests for an FRU (including add-in cards), enter the
following command:
Alternatively for add-in cards, the available diagnostic tests for an FRU can be viewed
using the node parameter. Enter the following command:
Note:
The fru-location can only be used for HDD (AMC-1) or motherboard.
Otherwise, both fru-location and node are allowed.
Alternatively for add-in cards, you can use the node parameter. Enter the following
command:
Note:
The fru-location can only be used for HDD (AMC-1) or motherboard.
Otherwise, both fru-location and node are allowed.
Table 4: Parameters of the command for getting the available diagnostic tests
Parameters Description
Step example
To view all the hardware diagnostic tests for /chassis-1/slot-3, enter the
following command:
To view the details of the subtest-cpu-io hardware diagnostic test, enter the
following command:
To check if a test can be run on a particular FRU, enter the following command:
Step example
The diagnostic process is robust enough, but there might be some exceptional
cases. If the hardware diagnostic is interrupted for any reason and the add-in
card might not be powered on, the add-in card needs to be manually reset with
the following SCLI command:
Purpose
A hardware diagnostic test is started.
Procedure
1 Set the add-in card of the corresponding testing FRU.
2 The hardware diagnostics uses the console port and hence the console
monitoring cannot run in parallel on the same port. Lock ConsoleMonitor
recovery group (RG) by executing the following command:
Step example
To start a hardware diagnostic test (including add-in cards), enter the following
command:
Alternatively for add-in cards, the available diagnostic tests for an FRU can be started
using the node parameter. Enter the following command:
Note:
The fru-location can only be used for HDD (AMC-1) or motherboard.
Otherwise, both fru-location and node are allowed.
Furthermore, you can start a diagnostic test using the scope parameter by entering
the following command:
Parameters Description
false
Blocking mode
To start the CPU hardware diagnostic test in blocking mode, enter the following
command:
start hardware diagnostics fru-location /chassis-1/slot-3
test subtest-cpu-io report-name USPU0-010112-01 blocking true
Note:
When multiple diagnostic tests are started on a target FRU or node and the
state of the hardware changes because of current or previous test execution,
the diagnostic framework does not execute the queued tests on the target FRU
and the tests are canceled by displaying the following message in the report:
FRU at location <...> is not found.
Test details:
Test ID : group-all
===================================================
Test summary:
Diagnostics test failure reason : Failed to initiate the test as the target FRU is not available.
4 Set recovery state of the add-in card after complete HW diagnostic, by using
the following command:
Step example
This section describes the process involved in failure in the test execution
phase.
There are times when the diagnostic test is started in the node start-up phase when the
HW diagnostic services of the node are not fully ready. This case is normal when the node
has reset. In this situation, the diagnostic subtest in the diagnostic report gives a Failed
in the test execution phase message:
Note:
Locking the external interface processing unit (EIPU) node might lead to a restart
(due to internal reasons, which is a normal behavior), failure in the non-intrusive
subtest during node start-up, and three to five minutes waiting time for diagnostics
to be ready.
This process describes viewing the status of a hardware diagnostic test. The
hardware diagnostic tool is used to view the status of a hardware diagnostic
test for an FRU.
Purpose
The status of a hardware diagnostic test is viewed.
Alternatively for add-in cards, the available diagnostic tests for an FRU can be viewed
using the node and report-name parameters. Enter the following commands:
show hardware diagnostics report-status node <node name> test
<test name>
show hardware diagnostics report-status report-name <report
name>
Note:
The fru-location can only be used for HDD (AMC-1) or motherboard.
Otherwise, the three parameters (fru-location, node, and report-name )
are allowed.
Table 6: Parameters of the command for viewing the status of a diagnostic test
Parameters Description
Step example
To view the status of subtest-cpu-io hardware diagnostic test, enter the following
command:
The hardware diagnostic tool is used to manage all reports of tests run on an
FRU.
If subtest-cpu-io item has passed, Diagnostics test result : PASSED is
displayed. The test result also displays the printout subtest-cpu-io: OK.
Purpose
Result of hardware diagnostic test is shown and its reports are managed.
To view the hardware diagnostic test reports (including add-in cards), enter the
following commands:
show hardware diagnostics report-details report-name <report
name>
show hardware diagnostics report-list fru-location <fru
location> filter-by [test <test name>]
Alternatively, for add-in cards the available diagnostic tests for an FRU can be started
using the node parameter. Enter the following command:
Note:
The fru-location can only be used for HDD (AMC-1) or motherboard.
Otherwise, both fru-location and node are allowed.
Parameters Description
Step example
To view the CPU hardware diagnostic test reports, enter the following command:
To view the list of available reports for the subtest-cpu-io hardware diagnostic
test, enter the following command:
This appendix describes the screen command which is a terminal emulator that
multiplexes a physical terminal among several simultaneous processes. It makes
remote zchassis_ex management downtime-proof, thus, more stable because
the running process continues independently of the SSH connection availability.
Purpose
Using the tool secures time-consuming and critical processes such as zchassis_ex,
restore, incremental software deliveries installation, or major software upgrade from
network issues.
Procedure
1 Run the screen tool, by executing the following command:
where [screenName] is the name given to the current terminal to facilitate terminals
management in the future.
screen -ls
Step example
Step result
The expected outcome is that the SSH connection does not break. The process ends
successfully.
The unexpected outcome is that the SSH connection gets lost even before the process
ends successfully. If this happens, reattach the existing session using the following
command:
screen –r [screenName]
exit
Note:
Exit all inactive terminals. The list of all running terminals can be retrieved by
entering the screen -ls command. To reattach the running terminal, execute
the screen –r [screenName] command.
Step result