To me the whole thing sounds like a hardware issue. Considering you already swapped the PSU, that leaves mainboard, GPU and drives - and technically also CPU, but that's unlikely the culprit.
I'd start checking all cables, unplug and replug everything, including the case front panel headers...