Do I have to have my old passport in possession in order to renew it by mail?

Yes. You have to provide the last passport in order to renew it by mail. The department will in general cancel the old passport when issuing you a new one unless you are using a valid passport book to obtain a passport card or vice-versa with a written letter requesting the original document to be returned without cancellation.