Phonemes are the smallest distinct units of sound in speech that can distinguish meaning between words. Morphemes are the smallest meaningful units of language (could be whole words or parts like prefixes). Syllables are units of pronunciation, while syntax refers to sentence structure rules.