Viewers don't recognize the font that something's in. At most, they might recognize the feeling that the font gives them, but that's probably a subconscious reaction as well. Consider the situation in which someone sends an important and serious email, but uses Comic Sans for the text. The same font would work for a birthday party invitation, but since the font doesn't support the context of the communication it comes across as foolish.