Fedora used to ship ipvlan.ko at one point, and even though we set CONFIG_IPVLAN=m it somehow that disappeared. Seems like config-generic doesn't set NET_L3_MASTER_DEV=y which is now required for ipvlan due to 4fbae7d83. That previously wasn't the case, so it probably just got missed.
(though that brings up the question, do we have any kind of automated QA like rpmdiff that warns when a module goes away unexpectedly?)
I set the option back on, should be in tomorrow's rawhide build.
We don't have any sort of automated QA. There are some checks to verify that kernel config options match to a degree but this is a particular case that isn't caught.