I'm fairly sure the PC sends out a short query messsage shortly after power-on, to which it expects to get a reply. When it doesn't see the reply, that's when the PC complains that it can't find the keyboard.
Here's a useful article about the physical and logical aspects of the PC-AT keyboard (and mouse) connections and protocol.
http://www.burtonsys.com/ps2_chapweske.htm