Apr. 29, 2008
One of the first things I noticed in Ubuntu Hardy Heron was that the key agent failed to load any other keys than the first one id_rsa. Having quite a few keys with more or less complex password this was not a pleasant surprise. Somebody obviously found this out before me, however a fix never made it into the main release. BUT there is a workaround documented in launchpad;
https://bugs.launchpad.net/ubuntu/+source/gnome-keyring/+bug/195908
Basically it tells you to run the following commands. I have tested it and it works great.
mkdir ~/.gnome2/keystore; for i in ~/.ssh/*pub; do key=$(basename $i .pub); echo -e "[default]\npurposes=ssh-authentication" > ~/.gnome2/keystore/${key}.keystore; ln -s ~/.ssh/$key ~/.gnome2/keystore/; done