The arm_neon.h header that gcc installs for aarch64 is not included in the rpm. Yet more special-casing needed in the %files section of the spec.
Should be fixed in gcc-4.8.1-9.{fc21,el7}.