Could you build this on top of Agora ? That would make it much nicer from an open-source perspective. It's one of the only services that can carry the backend audio scalably.

The product side is far more interesting...than the carrier api. Not worth spending time over that.

Other alternatives are Twilio, Daily.co, etc