四 is the picture of opened nostrils, its original meaning is gasp or exhalation, but such meaning has been replaced by 呬.
When someone exhale from his nostrils, the air will spread everywhere, ancient Chinese divide the two-dimensional world into four directions, so 四 means four.