So.. I've finally diagnosed what's going on with the one server which went down somewhere around two weeks ago.
Either one of the 3.3v rails in the power supply decided to go, taking ONLY the LSI 9260-16i #RAID card with it, or the RAID card decided to go and took that 3.3v rail with it. Either way, I need a new power supply. Luckily, I've got a spare 750W supply lying around, which is about 250W smaller than I need for this machine, but it'll work for me for long enough to boot off USB and copy the data off the drives...
...once the frelling consistency check completes, that is.
This is one of the only #PITA things I dislike about LSI/Avago/Broadcom cards, but I'm also thankful for.
If you import a foreign config into a new card (in this case, a 9260CV-4i - don't worry, I've got an Intel RESv240 (or something like that) expander card it's going into) which uses the same chipset, the new card requires a consistency check on the drives, and it will lock access to the drives from the user until that consistency check is completed. This makes sense, because the card wants to know if there's anything wonky with the data/format before it allows access...
I know it's for "data safety", but I don't plan on leaving these drives in use in that machine... I'm going to yank them to put in the new fileserver and reinstall some old 1TB SATA drives (which I'll set up in RAID 5, with a couple of hotspares)..
Since I shot my wad on the case for the new fileserver, I'm going to have to wait to get the new PS... but that's OK, too.
It can wait, as long as I can get the data off these two arrays.
If I can't, I haven't lost anything life-ending, but it'll mean I have to cleanse another proxmox cluster of keys and whatnot from a node which is neither accessible nor present. Not a fun task - mostly tedious - but we're hoping that consistency check does its thing.
An hour and a half in, and it's just hit 20%. I may be able to get started booting the thing tomorrow morning... because I'm NOT staying up all night to wait for it...
20 years ago I would have.. but 20 years ago I still thought I was a teenager... even though I was far past that stage in my life.. Today, I know I'm not a teenager... I'm not even in my 20s.. so staying up - nah.. I enjoy my sleep too much, and without it, my Autistic ass is crankier than a 4 month old who hasn't been fed in an hour and has a dirty diaper/nappy.
So.. yeah.. I guess, wish me #luck on the #recovery of my #data. Please?