Gnome keyring will never accept my passphrase, but it seems to get passwords out of it anyway. It will prompt over and over, but if I say deny, it'll get it anyway and things like NetworkManager will connect.
Removing existing keyrings and creating a new one seems to have solved the issue.