Tried using an empty file for known_hosts as well as just
deleting the file entirely, no difference.

I also tried creating a different user and trying to log in from
there, thinking a new user couldn't have the wrong key. I was
wrong.