Yoshiro Mori, president of the Tokyo 2020 Olympics organizing committee, is set to step down over sexist remarks he made that women talked too much, according to multiple major Japanese media outlets. 

Mori, 83, has come under increasing pressure after he said last week that women "have difficulty" speaking concisely, setting off a firestorm at home and abroad and could become the latest obstacle to the 2020 Summer Games, already postponed for a year due to the coronavirus pandemic. 

Mori is likely to express his intention to step down on Friday when organizers of the Tokyo Olympics will hold a gathering of executive board members, the Mainichi daily newspaper reported. The meeting was organized over Mori's remark. 

It is reported that Tokyo Olympics Athletes Village Mayor Saburo Kawabuchi will succeed Mori. 

Mori has apologized for the remarks, but declined to resign earlier. 

As a former prime minister whose tenure was marred by gaffes and blunders, Mori's comments drew sharp criticisms on social media and in parliament, with opposition lawmakers demanding his resignation. 

The International Olympic Committee said they considered the matter closed, but then said the remarks were "completely inappropriate" as the backlash grew.  

(With input from agencies)