When an order is back ordered, you need to increase the 'on hand' quantity to make stock available for fulfillment. A backorder occurs when inventory is insufficient, so adding stock resolves the backorder status. Cancelling or decreasing quantity would worsen the situation.