This was stated by CAF President Patrice Motsepe during a meeting in Cape Verde attended by member countries, according to the Danish news agency Ritzau.
Infantino has been heavily criticized recently, including after a failed proposal to sell shares in the men's World Cup to generate additional revenue for football.
Calls for Infantino to resign have been made repeatedly, not least by the European football association Uefa.
The continental associations in Asia, North and Central America, and the Caribbean also want to see new leadership.
The next presidential election will be held in March next year. There is still no official opponent to Infantino, who has been president since 2016.
