Be sure to withdraw any kept funds before closure your bank account