The blue color of an LPG stove flame indicates complete combustion of the fuel, where LPG burns fully to produce carbon dioxide and water vapor. Blue flames are produced when combustion is efficient with minimal soot or unburnt carbon particles, while yellow flames indicate incomplete combustion.