'Whose' is the correct relative possessive pronoun to use when referring to people and showing possession or association. The clause 'whose mother tongue is not English' correctly modifies 'students'. 'Of whom' is awkward and formal, 'his' is singular (doesn't match plural 'students'), and 'their' as a relative pronoun is grammatically incorrect in this context.