It’s a thorn, a letter making a th sound. Still in use in Icelandic, I think. In English, it’s archaic at best.

Fun fact, when it fell out of use, the letter Y was used to replace it for a while. So when you see something saying “ye olde”, verbally it’s still “the old”.