I still have not found what is cause of this problem.
But I've found something else. If I power off my PC for few hours/over night on next start up this problem will start almost within 1 minute after booting up. But if I restart/power off->power on then I do not have this problem any more. This is so strange, as if any program is causing this problem, then it would do same thing after reboot. But that is not happening. Does this help?