'By rickshaw' is the correct preposition when indicating mode of transportation. 'By' is used with various means of transport (by bus, by train, by car, by rickshaw). 'In rickshaw', 'on rickshaw', 'at rickshaw', and 'off rickshaw' are not standard expressions for describing travel using this transport.