The reason a granite block is mostly empty space is because the atoms in the granite are:
Held together by electrical forces
Invisible
Mostly empty space themselves
Not as close together as they could be