Pressing delete in the console (or in a telnet session to somewhere else)
produces ^[[3~ instead of ^?
This is almost certainly a configuration issue (it's not happening here).
Make sure you don't have an old .inputrc or .termcap file floating around in
your homedirectory. Also, check your /etc/inputrc file.