If you're up for it and are familiar with NixOS's packaging system, you could make new packages for your distro to build everything from source. That's what I did for Arch Linux because it fit Arch's packaging standards.
I don't know how NixOS does their packaging, but here's the Arch
metapackage that links to others for building GCC, etc. if you need a starting point for the build commands. Select "View PKGBUILD" on each package's page to see them.