CUDA hardware is specially designed against C++ memory model.

It wasn't initially, and then NVIDIA went through a multi-year effort to redesign the hardware.

If you're curious, there are two CppCon talks on the matter.