A qualm is a feeling of doubt or uneasiness, particularly about whether something is right. 'Misgiving' perfectly captures this sense of uneasy doubt. Irritation and insulting suggest different emotional reactions that don't align with the nuanced meaning of qualm.