This is definitely a disadvantage of audiobooks, although I’ve found having access to a `skip backwards 15 seconds` button can help a lot.
(There was one point during Riyria Revelations where a character was explaining how Elven succession works. After repeating the sequence a bunch of times, I finally had to get out my laptop and take notes.)