It seems all GNOME applications have support for the mouse wheel for scrolling, with the notable exception to the gnome-help-browser. Having to click on the scroll bar seems so primitive now that I have been using a scroll wheel for so long. :)
The gnome-help-browser is deprecated, and is unlikely to be used after this next release.