Semi
Semi
Semi
Give Feedback...
Copyright (c) 2018, Oracle. All rights reserved. Oracle Confidential.
How to Replace an Oracle Database Appliance X5-2 Motherboard and Oracle Database Appliance X6-2HA To Bottom
Motherboard (Doc ID 2001252.1)
SOLUTION
Related Products
CAP PROBLEM OVERVIEW: MOTHERBOARD ASSEMBLY REPLACEMENT Oracle Database Appliance X5-
2
Oracle Database Appliance X6-
DISPATCH INSTRUCTIONS 2 HA Hardware
Oracle Database Appliance X6-
WHAT SKILLS DOES THE ENGINEER NEED: 2 S/M/L Hardware
Oracle Database Appliance X5-2/X6-2HA training.
Information Centers
Note: The removal/insertion CPU tool is new for the Sandy Bridge M3 product lines. If you have not used this new tool before
please make yourself familiar before attempting to use on-site. The tool is not intuitive so reference the service manual before Information Center: Oracle
attempting this service action. Database Appliance
[1417713.2]
If the system is still up and functioning, customer should perform an orderly and graceful shutdown of applications and OS. Recently Viewed
Then power off the server and remove the AC power cords from the system.
How to Replace an Oracle
Before shutting down, to obtain a backup of the bios configuration, issue this command: /usr/sbin/ubiosconfig export all -f Database Appliance X5-2
--expert -x /tmp/bios.xml Motherboard and Oracle
Database Appliance X6-2HA
Motherboard [2001252.1]
If running Virtualized platform, run the ubiosconfig command from DOM0.
Oracle Solaris 11.3 Support
***This is especially important if the customer has limited the amount of cores licensed. *** Repository Updates (SRU)
Index [2045311.1]
Also before shutting down, obtain a backup of the ilom configuration. Important Oracle Solaris
11.3 SRU Issues
Assuming the ILOM is not the reason for the replacement of the system MB, then take a current backup of the ILOM SP [2076753.1]
configuration using a browser under “ILOM Administration → Configuration Management” tab on the left menu list. Mpathadm Show Lu Error:
Unable to get configuration
information - Logical-unit is
This can also be done from the ILOM CLI as follows:
not found. [2170304.1]
PSH Procedural Article for
ILOM-Based Diagnosis
[1155200.1]
cd /SP/config
set passphrase=welcome1 Show More
set dump_uri=scp://root:password@laptop_IP/var/tmp/SP.config
Reference Doc:
Oracle Server X5-2 Remove the Motherboard:
http://docs.oracle.com/cd/E41059_01/html/E48312/napsm.z40017961418774.html#scrolltoc
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 1/8
12/28/2018 Document 2001252.1
Oracle Server X6-2 Remove the Motherboard:
http://docs.oracle.com/cd/E62159_01/html/E62171/z40011771418436.html
1. Log into the ILOM check the fruid container values and sync them if needed.
a. To avoid mismatched fruid values causing a failure after a motherboard replacement the fruid data should be confirmed
to have matching data in at least the Primary (DBP) and Backup2 (PS0) containers so that the motheraboard will have it's
container updated automatically after replacement. Go into restricted mode and use the showpsnc command to check
this.
b. The above example shows a system with all three containers properly in sync. If the output from the system does not
show all of the containers with matching values then you should reset the SP and then re-check the values again. An
ILOM reset will attempt to auto-populate the matching values if one container is out of sync.
-> reset /SP
Are you sure you want to reset /SP (y/n)? y
Performing reset on /SP
c. After an ILOM reset if the Primary and Backup2 containers match then proceed with the following steps to replace the
motherboard. If these two containers do not match then DO NOT proceed with the replacement yet.
d. If the containers do not match you will need to use the copypsnc command from service or escalation mode to copy the
data from the good container so that the Primary and Backup2 containers match (Backup1 is the MB and we are about to
replace this so it is not as important at this step). If you are unfamiliar with this process and require assistance please
reference the steps for using copypsnc to fix the serial number detailed in the "How to update product serial number on
systems which implement TLI functionality (Doc ID 1280913.1)" and contact the TSC if needed. How to access service
mode and escalation mode on ILOM 3.x and later platforms (Doc ID 1019946.1)
e. After the fruid data in the Primary and Backup2 containers have been confirmed to match proceed with the following
steps.
a. Power off the server and disconnect the power cords from the power supplies.
b. Extend the server to the maintenance position in the rack.
c. Attach an anti-static wrist strap.
a. If the cable management arm (CMA) is installed, disconnect both CMA left-side connectors and move the CMA out of the
way.
Caution - When disconnecting the CMA left-side connectors, use something to support
the CMA so that it does not hang down under its own weight and stress the right-side
connectors; otherwise, the CMA might be damaged. You must continue to support the CMA
until you have reconnected both of the left-side connectors.
b. Grasp the power supply handle and push the power supply latch to the left.
c. Pull the power supply out of the chassis. Repeat steps b-c for the second power supply.
Caution - When removing the power supplies it is important to label power supplies
with the slot numbers from which they were removed (PS0, PS1). This is required because
the power supplies must be reinstalled into the slots from which they were removed;
otherwise, the server key identity properties (KIP) data might be lost.
a. To disconnect the disk backplane power cable from the motherboard, press in on the connector latch and pull the
connector out.
b. To eject the disk backplane auxiliary power and signal cable connector, open both side latches.
c. To eject the FIM cable connector, open both side latches.
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 2/8
12/28/2018 Document 2001252.1
d. If the server has a DVD drive, do the following:
1. Disconnect the DVD drive cable from the motherboard.
2. To remove the DVD drive cable off of the motherboard, carefully guide it through the chassis mid-wall and place it
on top of the disk cage so that it is away from the motherboard. You do not need to disconnect the DVD drive
cable from the DVD drive.
e. To remove the SAS cables and the super capacitor cable that were connected to the HBA card, carefully lift them out of
the chassis and place them on top of the disk cage so that they are away from the motherboard.
f. To remove the cables that were connected to the switch card, carefully guide them through the chassis mid-wall and put
them aside.
a. Using a screwdriver (No. 2 Phillips or flathead), loosen the four green captive screws that secure the mid-wall to the
server chassis.
b. Lift up the mid-wall slightly to disengage it from the raised mushroom-shaped standoffs that are located on the server
chassis sidewall (one on each end of the mid-wall), then lift it out of the server and set it aside.
a. Remove the air baffle from the motherboard and set it aside.
b. Remove the internal USB flash drives from the motherboard making note of the original port locations.
c. Remove the DIMMs from the motherboard.
d. Remove the processors from the failed motherboard.
1. Gently press down on the top of the heatsink to counteract the pressure of the captive spring-loaded screws that
secure the heatsink to the motherboard and loosen the four Phillips captive screws in the heatsink for the failed
processor.
2. Using a No. 2 Phillips screwdriver, turn the screws counterclockwise alternately one and one half turns until they
are fully removed.
3. To separate the heatsink from the top of the processor, gently twist the heatsink left and right, while pulling
upward, and then lift off the heatsink and place it upside down on a flat surface. A thin layer of thermal grease
separates the heatsink and the processor. This grease acts as an adhesive.
4. Use an alcohol pad to clean the thermal grease from the underside of the heatsink. Be very careful not to get the
thermal grease on your fingers.
5. Disengage the processor release lever on the right side of the processor socket (viewing the server from the front)
by pushing down on the lever and moving it to the side away from the processor, and then rotating the lever
upward.
6. Disengage the processor release lever on the left side of the processor socket (viewing the server from the front)
by pushing down on the lever and moving it to the side away from the processor, and then rotating the lever
upward.
7. To lift the ILM assembly load plate off of the processor socket, rotate the processor release lever on the right side
of the processor toward the closed position (the ILM assembly load plate is lifted up as the release lever is lowered
toward the closed position) and carefully swing the ILM load plate to the fully open position.
8. To remove the processor from the processor socket, acquire the processor removal and replacement tool and
perform the following steps:
a. Identify the correct processor removal and replacement tool based on the size of the processor. The
processors with 10 or fewer cores are smaller than the processors with 12 or more cores. You can
determine the size of the processor that you are going to remove and replace in either of two ways, via
ILOM, or visually.
b. After the heatsink has been removed you can determine if the larger processors are installed looking at the
right and left edges of the processor. If they extend beyond the boundaries of the processor alignment
brackets they are the larger processors. If they are withing the alignment brackets they are the smaller
processors.
c. The processor removal and replacement tool is color coded:
1. Green, color-coded removal and replacement tool for the smaller processors-models (10 cores or
less).
2. Pink, color-coded removal and replacement tool for the larger processor-models (12 cores or more).
9. Locate the button in the center of the top of the processor removal and replacement tool and press it to the down
position.
10. Properly position the tool over the processor socket and lower it into place over the processor socket. To properly
position the tool over the processor socket, rotate the tool until the colored triangle on the side of the tool is facing
the front of the server and it is over the left side of the processor socket when viewing the server from the front.
11. Press the release lever on the tool to release the center button and engage the processor. An audible click
indicates that the processor is engaged.
12. Grasp the tool by the sides and remove it from the server.
13. Turn the tool upside down and verify that it contains the processor.
14. While holding the processor tool up side down, press the center button on the tool to release the processor.
15. Carefully grasp the processor by the front and back edges, lift it out of the tool and place it with the circuit side
down (the installed orientation) onto the antistatic mat.
16. Carefully clean the thermal grease off the top of the processor.
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 3/8
12/28/2018 Document 2001252.1
lever upward.
3. To lift the processor ILM assembly load plate off of the processor socket, rotate the ILM assembly hinge lever on
the right side of the processor toward the closed position (the load plate is lifted up as the hinge lever is lowered)
and carefully swing the load plate to the fully open position.
4. Grasp the top and underside of the processor socket cover with one hand (place your thumb against the underside
of the cover), place your other thumb against the underside of the cover, and carefully push the cover out of the
processor ILM assembly load plate. Be careful not to allow the processor socket cover to fall into the processor
socket as this could result in damage to the socket.
5. Repeat steps 1-4 above to remove the second processor socket cover from the replacement motherboard.
b. Install the socket covers on the bad motherboard processor sockets to protect the sockets during transport.
1. Open one of the processor ILM assemblies on the failed motherboard.
2. Hold the processor ILM assembly load plate open with one hand and position the processor socket cover over the
top of the ILM assembly load plate so that 1) the arrow on the processor socket cover is aligned with the arrow on
the top left bottom of the load plate and 2) the fasteners on one side of the cover (the fasteners are located on
the underside of the cover) are inside the load plate (it does not matter which side), and use your thumb to press
the other side of the processor socket cover into the load plate. You will hear a clicking sound when the processor
socket cover snaps into place.
3. Close the processor ILM assembly load plate.
4. Repeat Step 1 through Step 3 above to install the second processor socket cover on the failed motherboard.
c. Install the processors on the replacement motherboard.
1. Ensure that the two processor ILM assembly levers and the ILM assembly load plate are in the fully open position.
2. To install the replacement processor into the socket, acquire the processor removal and replacement tool and
perform the following steps:
a. Press the button in the center of the tool to the down position.
b. Turn the tool upside down, grasp the processor by its front an back edges and position the processor
(circuit side up) in the tool so that the triangle on the corner of the processor aligns with the triangle on the
side of the processor removal and replacement tool.
c. Lower the processor into the tool and press the tool release lever to release the center button and engage
the processor. An audible click indicates that the processor is locked in place.
d. Properly position the tool over the processor socket and lower it into place. To properly position the tool in
the processor socket, rotate the tool until the colored triangle on the side of the tool is facing the front of
the server and it is over the left side of the processor socket (when viewing the server from the front) and
lower the tool into the processor socket.
e. Press the center button in the tool down to release the processor so that it is placed in the socket.
f. Remove the processor removal and replacement tool.
3. Visually check the alignment of the processor in the socket. When properly aligned, the processor sits flat in the
processor socket.
Caution - Do not press down on the processor. Irreparable damage to the processor
or motherboard might occur from excessive downward pressure. Do not forcibly seat
the processor into the socket. Excessive downward pressure might damage the socket
pins.
4. Swing the processor ILM assembly load plate into the closed position. Ensure that the load plate sits flat around
the periphery of the processor.
5. Engage the socket release lever on the left side of the socket (viewing the server from the front) by rotating it
downward and slipping it under the catch.
6. Engage the socket release lever on the right side of the socket (viewing the server from the front) by rotating it
downward and slipping it under the catch.
7. Use the syringe (supplied with the replacement motherboard) to apply approximately 0.1 ml of thermal grease to
the center of the top of the processor. To measure 0.1 ml of thermal grease, use the graduated scale on the
thermal grease syringe.
Note - Do not distribute the grease; the pressure of the heatsink will do so for
you when you install the heatsink.
8. Inspect the heatsink for dust and lint. Clean the heatsink if necessary.
9. Orient the heatsink so that the screws line up with the mounting studs.
10. Carefully position the heatsink on the processor, aligning it with the mounting posts to reduce movement after it
makes initial contact with the layer of thermal grease.
Caution - Avoid moving the heatsink after it has contacted the top of the
processor. Too much movement could disturb the layer of thermal grease, causing
voids, and leading to ineffective heat dissipation and component damage.
11. Tighten the Phillips screws with a No. 2 Phillips screwdriver alternately one-half turn until fully seated.
12. Repeat steps 1 through 11 above to install the second processor on the replacement motherboard.
d. Install the DIMMs onto the replacement motherboard in the corresponding DIMM sockets on the replacement
motherboard. Install the DIMMs only in the sockets (connectors) that correspond to the sockets from which they were
removed. Performing a one-to-one replacement of the DIMMs significantly reduces the possibility that the DIMMs will be
installed in the wrong slots.
e. Install the internal USB flash drives onto the replacement motherboard. Ensure to place in the original USB port
locations.
f. Install the air baffle on the replacement motherboard.
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 4/8
12/28/2018 Document 2001252.1
15. Reinstall the power supplies.
a. Align the replacement power supply with the empty power supply slot.
Caution - When reinstalling power supplies, it is important to reinstall them into the
slots from which they were removed during the motherboard removal procedure; otherwise,
the server key identity properties (KIP) data might be lost. When a server requires
service, the KIP is used by Oracle to verify that the warranty on the server has not
expired.
b. Slide the power supply into the bay until it is fully seated. You will hear an audible click when the power supply fully
seats. Repeat steps a-b for the second power supply.
c. If you disconnected the two CMA left-side connectors, reconnect the connectors.
16. Reinstall all of the Fan Modules and the top cover.
a. The motherbaord is not the primary fruid container in this server so when it is replaced you should not normally need to
fix the serial number information.
b. login to the ILOM as root and then enter the restricted shell to check the fruid values. Follow the example below to enter
restricted shell and use the showpsnc command
-> set SESSION mode=restricted
** REFER TO DOC ID 1280913.1 for the procedure on how to update the TLI serial number fields **
f. At this point if all of the fruid containers match and have the correct serial number data this step is done. If more than
one of the fruid containers had non-valid entries then the copypsnc command should be used to copy over the valid data
to the other container that is not valid. (ie. "copypsnc Primary Backup2" to copy primary to backup2) After confirming all
fruid data is correct reset the ILOM to confirm that the fruid data persists through a reboot and remove the escalation
user if needed.
-> reset /SP
Are you sure you want to reset /SP (y/n)? y
Performing reset on /SP
..........
***login as the root user again and check the fruid data***
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 5/8
12/28/2018 Document 2001252.1
[(restricted_shell) x5-2]# exit
-> cd /SP/users
/SP/users
-> delete escuser
Are you sure you want to delete /SP/users/escuser (y/n)? y
Deleted /SP/users/escuser
g. If trouble is encountered during any of the steps of accessing escalation mode and fixing the fruid containers please
contact the TSC for assistance.
Sample
/SYS/MB
Targets:
BIOS
CPLD
FM0
FM1
FM2
FM3
NET0
NET1
NET2
NET3
P0
P1
RISER1
RISER2
RISER3
T_CORE_NET01
T_CORE_NET23
T_IN_PS
T_IN_SLOT1
T_IN_SLOT2
T_IN_SLOT3
T_OUT_SLOT1
T_OUT_SLOT2
T_OUT_SLOT3
Properties:
type = Motherboard
ipmi_name = MB
fru_description = ASM,MOTHERBOARD,1U
fru_manufacturer = MiTAC International Corporation
fru_part_number = 7098505
fru_rev_level = 06
fru_serial_number = 489089M+14364B00M8
fault_state = OK
clear_fault_action = (none)
Commands:
cd
set
show
->
WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:
19. Edit the following files in the /etc/sysconfig/network-scripts directory to change the MAC address to the new MAC address.
* If the system is running the Virtualized OS, then this is done in DOM0 *
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 6/8
12/28/2018 Document 2001252.1
If the server node has an IB card installed in slot 1:
There are 2 ways to get the MAC address, from ipmitool or from the ILOM commandline.
From ipmitool:
# ipmitool sunoem cli "show /SYS/MB/NET0 fru_macaddress" << do this for NET1,NET2,NET3
-> show /System/Networking/Ethernet_NICs/Ethernet_NIC_0 mac_addresses << do this for NIC_1, NIC_2, NIC_3
20. Check if ILOM firmware is running at the correct level for the ODA software release:
# /usr/sbin/ubiosconfig import config -f --expert -y -x /tmp/bios.xml <<<< this will work if the /tm/bios.xml file was created
before the motherboard replacement, as in example at beginning of this doc.
Use the web browser under Maintenance Tab or from ILOM cli:
cd /SP/config
set passphrase=welcome1
set dump_uri=scp://root:password@laptop_IP/var/tmp/SP.config
To update the ILOM version on systems running 12.1.2.5.0 and below, use the following command:
# oakcli update --patch 12.1.2.2.0 --infra <<<<<<<<<<<<<<< make sure you use the correct version, this is just an
example for 12.1.2.2.0
To update the ILOM version on systems running 12.1.2.6.0, do not use oakcli, instead use the ilom web gui. Follow
instructions in the ILOM Administrator's Guide for Configuration and Maintenance Guide.
To update the ILOM version on systems running 12.1.2.7.0 and above, use the following command:
# oakcli update -patch 12.1.2.7.0 --local --server <<<<<<<<<<<<<<< make sure you use the correct version, this is just
an example for 12.1.2.7.0
*the oakcli update commands above will reboot the node that needs the ILOM/BIOS updated
REFERENCE INFORMATION:
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 7/8
12/28/2018 Document 2001252.1
Oracle Database Appliance Documentation
http://docs.oracle.com/cd/E88491_01/doc.121/e86800/toc.htm
REFERENCES
NOTE:2105219.1 - After Motherboard Replacement, Issues With The NICs showing __tmpXXX
Didn't find what you are looking for? Ask in Community...
Related
Products
Sun Microsystems > Specialized Systems > Database Systems > Oracle Database Appliance X5-2
Sun Microsystems > Specialized Systems > Database Systems > Oracle Database Appliance X6-2 HA Hardware
Sun Microsystems > Specialized Systems > Database Systems > Oracle Database Appliance X6-2 S/M/L Hardware
Keywords
CANNED ACTION PLAN; CPU; HEATSINK; INSTALL
Back to Top
Copyright (c) 2018, Oracle. All rights reserved. Legal Notices and Terms of Use Privacy Statement
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=522053187761627&id=2001252.1&_afrWindowMode=0&_adf.ctrl-state=1cnnph2… 8/8