This is the first-ever visit of a Japanese Prime Minister to Iran since the 1979 Islamic Revolution.
PM Abe is expected to hold talks with Iranian officials on ways to ease tensions between Tehran and Washington.
Abe had a meeting with Rouhani on Wednesday afternoon and will hold talks with the Leader of the Islamic Revolution Ayatollah Seyyed Ali Khamenei on Thursday.