This was found to be one of the early challenges of self driving: reading traffic signal gestures of traffic agents. It does it. But the jury is out if it does it well.
It also needs to be able to ensure the signals are coming from a human that actually has authority to command it. Don't really want it taking hand signals from anyone.
Why do people keep saying this whole "it's hard for humans, too" thing in every damn self driving car thread? Is it some kind of excuse to let the self driving car be shit at it? I don't care if people are shit at it, isn't the whole point that these cars will be safer than people?
Yeah we know people suck at driving. What situation is there that people don't suck at? People suck at 4 way stops. People suck at merging onto the freeway. People can't even exit the freeway without causing a mess. People can't even drive in a straight goddamn line without varying speed by 10mph and weaving all over the road. What exactly are we trying to say here?