If you use bazel to compile rust, it doesn't suffer from this problem. In fact you can get distributed caching as well.