If you couple this approach with the use of blinks or other proxies for button presses, you may remove the need for a mouse and keyboard (or gamepad) all together
Honestly, have you ever heard anyone complain about buttons? Why are we trying to replace probably the simplest and most well understood method of input? PUSH BUTTON, SHIT HAPPENS.
"Look at object, then blink twice quickly" is not going to make things any easier to get to grips with. Not to mention it has to figure out the difference between "Blink to do something" and "Blink because this is a natural function you do thousands of times each day."