Inability to Tell Time

Listen here, friend. The joke is funny because the person being asked the time has no way of knowing what time it is. You wouldn't get it; you are probably as useless as that person!