In that case it's most definitely a hardware problem. It won't be the storage drives because they're not being used by Ubuntu running off a USB drive. It's most likely to be the RAM and you do have a shed-load of RAM there! What do you need 128GB of RAM for? I would remove one stick and run Ubuntu off the stick again. Swap RAM sticks until you either find the flaky one or it works with every RAM stick removed.