To fret is to be constantly or visibly worried or anxious. Vex is a synonym that means to make someone feel annoyed, frustrated, or worried. While whine and whimper are sounds made when distressed, they are not direct synonyms for the state of fretting.