To fix this error, you need to add the IdentitiesOnly with a value of yes, which instructs ssh to only use the authentication identity files specified on the command line or the configured in the ssh_config file(s), even if ssh-agent offers additional identities.
For example:
$ ssh -o IdentitiesOnly=yes vps2More info in this article
On a side note, if FileZilla shoots an error at connecting, run the following command from the terminal:
$ SSH_AUTH_SOCK=null filezilla &