The linux-atm package (or at least libatm from it) is required for PPP over ATM support.
On closer inspection, it seems that the pppoatm plugin doesn't actually use much from the ATM libraries at all -- just a couple of routines for parsing addresses. So I imported that into the PPP package directly instead of depending on all of linux-atm.