Before color blindness test, how did people know about color blindness?

Before all the color blindness tests were invented, how did people know who was color blind or not? It's not like the colorblind people know of their disorder. You can't go in another person's body and see that his vision is messed up, so how did people know who was color blind?