The correct phrase is 'ask for' when requesting to speak to someone or requesting something. 'Ask for the manager' means you want to speak with the manager. 'Ask to' would be followed by a verb (ask to speak), while 'ask of' and 'ask from' are not correct in this context.