Saturday 17 June 2017

IBM Server x3650 M3 Fan Mod

I recently acquired an IBM x3650 M3 server pretty cheaply, but it's loud. Obviously these aren't designed to be in someones house, so I needed to do a few mods.
The x3650 M3, or at least the one I've got, has 3 fan modules each with 2 couter-rotating fans. I removed those, put some regular heatsinks on the Xeon CPUs.
I used Intel STS200C heatsink/fan units - these are designed for socket 2011 so I had to modify them... the mounting dimenions are basically the same BUT the screws are thicker and thus don't screw into the M3 mounting points.

This was probably the worst part of the mod - I had to remove the OEM CPU heatsink retainers from the server, remove the screws, remove the screws from the STS200C, drill out the STS200C holes to fit the bigger pins from the OEM mounts and then attach the OEM mounts to the STS200C.

Once that was done, I wired the fans up to existing fan headers. Here's the pinout (I couldn't find this anywhere on the net - I hope it helps someone)
To get rid of the IMM fan faults I discovered that I needed the tach wires connected to tach A and B for fan headers 1,2,4,5,6.
Looking at the front on the server it goes:
Right to left
Zone 1, fan header 1 then 2
Zone 2, fan header 3 then 4
Zone 3, fan header 5 then 6 


Next problem was an over temp on IOH - the I/O Hub which is behind the CPU in Zone 1. Obviously the OEM fan unit cools this better.
To solve this problem I removed the heatsink, put some thermal paste and zip tied a fan to it, connected with PWM to one of the fan headers. Maybe I'll come back and fix this up a bit later but it seems to work OK.

The overall result - the server is WAY quieter. Before mods I could put it in a room, close the door and still hear it. Now it sounds pretty much like a normal PC. I've got 2 SAS 10k drives in there and the seeking noise they make is louder than the fans ....

As for temperatures, who knows, the IMM doesn't give CPU/IOH temps, so until some over temp warnings show up or my CPUs are fried, life is good :-)

 Before:

After:











Tuesday 15 April 2014

HP Microserver Gen8 - Boot from 5th SATA ODD Port using USB + GRUB


I discovered that my HP Microserver Gen8 does not boot from the 5th SATA port (the Optical Bay) when the controller is in AHCI mode. The server does boot from this drive if the controller is set to SATA Legacy mode (by changing the controller boot order for #2 to be first in sequence, ODD bays 1-4 are on controller #1, ODD port is on controller #2). I believe it can also boot from this port using the B120i RAID but regardless, I wanted to use AHCI mode.

This solution is not ideal, but it's a decent workaround. I wanted to boot Linux (Debian 7.4 with OpenMediaVault installed). I use a permanently connected USB with grub installed to boot the operating system installed on a 500gb 2.5" drive I installed in the top drive bay.

Remove all drives in the 4 main bays
Install Linux, then from inside the new Linux installation:
 1. Zero the USB
   dd if=/dev/zero of=/dev/sdd

2. Create a 128 mb partion at the start of the USB
   fdisk /dev/sdd
   ... use 'n' to create a partition
   mkfs -t ext2 /dev/sdd1
   mkdir /tmp/myusb
   mount /dev/sdd1 /tmp/myusb
   mkdir /tmp/myusb/boot

3. Install grub to the USB, making sure the boot directory is on the USB drive:
   grub-install --boot-directory=/tmp/myusb/boot /dev/sdd

3. Update the grub config, outputting to the USB.
   update-grub --output=/tmp/myusb/boot/grub/grub.cfg

4. Reboot the system and it should now boot grub from the usb (make sure the BIOS is configured for USB boot). The drives can now be reinstalled in to the main drive bays.