The Xclients file should include a test to exec the appropriate session manager under ssh-agent, if ssh-agent is present. This would make the use of ssh (with passphrases remembered for each session) easier. (Note: I'm posting a similar enhancement request for switchdesk, as its Xclients files should also be modified, for consistency's sake...)
This is already discussed under Bug 18069
*** This bug has been marked as a duplicate of 18069 ***