When I try to remove *only* the top panel, the bottom one is also removed.
This is bug 382471. See that one for more info.
Basically it's an upstream bug, and fixed in the 4.4.2 release that we should be
pushing out to updates in the next few days.
Thanks for the report!
*** This bug has been marked as a duplicate of 382471 ***