No. For your next visit to Japan, you can still use your PASMO again. You can also remove unnecessary PASMO from Wallet, it is automatically saved in the server linked with your iCloud account, and re-add it to Wallet at any time.