The Chi Square test is a statistical test used to determine whether there is a significant difference between observed and expected frequencies in categorical data. It tests for independence or goodness of fit, primarily examining differences in proportions. Tests for averages use t-tests, and F-tests compare variances.