Never tried, but read here:
https://www.japan-guide.com/e/e2208.html
Your card should be listed on one of those networks in the above to be able to use the ATMs. I try not to add more things to do when I'm traveling so I would just exchange everything in advance.