I'm basing this bug on the assumption that the kernel RPM's were designed so that any number of them could be installed to allow switching to old kernels. When I tried to install 2.2.10-4, it said /sbin/ksymoops conflicted with 2.2.10-3. Unfortunately I don't have a good idea for a fix.
ksymoops was separated into a kernel-utils package as of 2.2.11-5 and later