Well not unless you really have to. I can see some clever uses for augmented reality with some simple caveats. As little as possible and with the least amount of distraction. Unless you're one of those people who really needs another screen between you and reality.
Oh you can't hear me?
Well why not take that bluetooth earpiece out and I'll repeat it for you.
Via Ed.