Ended up doing the same, no brew, no docker

System-wide dependencies installed via home manager, and project-related installed via nix flakes which is created on project basis

I can spin up a new identical environment on new macos in 15 mins