Infact, it's not a service, it's a kernel driver : C:\WINDOWS\system32\drivers\HWiNFO32.SYS and so can't be stopped anyway.
I've done a clean uninstall/install but with still the same result so I guess you're right : there's some problem with storing/accessing preferences that also messes up...