Formerly known as public houses, pubs have been around for centuries. Their earliest customers tended to be illiterate. It is for this reason that places such as pubs would be identified with pictures instead of with words.
This also explains the origin of the word pub, as it had been once referred to as a public house.