I would have thought that you would need a local ISP account to do this. The best way might be to use an Internet Café or similar. I assume these are available in Japan. It depends how long you intend to stay.
Maybe someone who travels to Japan might know more.