Permanent hardness of water is caused by the presence of dissolved chlorides and sulfates of calcium and magnesium, which cannot be removed by simple boiling. Boiling only removes temporary hardness caused by bicarbonates. Methods like distillation, adding washing soda, or caustic soda treatment are required for permanent hardness.