'Look at' is the correct phrasal verb for directing gaze toward someone or something. When someone talks to you, it's polite to direct your attention toward them. 'Look to' means expect/rely on, 'look on' means watch, 'look by' isn't a standard phrasal verb.