If their voices sounded shrill/unnaturally amplified/too loud, definitely. Listening to an annoying conversation on speakerphone is 10x more annoying than when it's face-to-face.