According to Article 94 of the Constitution, the Lok Sabha Speaker can be removed only by a resolution passed by a majority of all then-members of the Lok Sabha. The Prime Minister, President, and Rajya Sabha do not have the power to remove the Speaker.