Yeah, its not a good idea to package random compiler versions, they may not be compatible with the system libraries and includes on the user system that have been compiled with the system compiler.
Frankly C/C++ developers on Linux are probably the least likely to need packaged compilers.