AI Development Is Slowing Down: Facebook Head
Thu, April 22, 2021

AI Development Is Slowing Down: Facebook Head

AI and machine learning development is about to “hit the wall" / Photo Credits: Shutterstock

 

Majority of reports about artificial intelligence show how it is rapidly improving, driving more and more industries to success. AI has increased the sales and revenues of companies. It has brought new tools to help us with our daily lives. However, not all reports show that AI is getting more and more successful.

Jerome Pesenti, Facebook's head of AI, believes that AI development is starting to slow down as it reaches its maximum capacity. Last December, he stated that the development of both AI and machine learning is about to “hit the wall” because the current deep learning mechanisms are pushing the technologies against their limitations. A 2019 study conducted by OpenAI, an AI research company, revealed that the amount of computer used in AI training has doubled every 3.4 months.

OpenAI believes that AI has required a 300,000-times increase in computing power since 2012 due to the speed of advancement. This goes against Moore’s Law, a concept that says computing power doubles every two years. Unfortunately, this trend is not sustainable. According to Mic.com, a privately held, venture-backed, for-profit media company headquartered in New York on a mission to reveal and amplify stories that reshape the world, the slow progress in AI and machine learning is attributed to the limitations on the development of processing power. 

Aside from the inability to keep up with the exponentially increasing demand for computing power that AI requires, there are also limitations on how AI is trained in the first place. Pesenti also stated that this situation has become cost-prohibitive and large-scale projects impossible to conduct. "The rate of progress is not sustainable. If you look at top experiments, each year the cost is going up 10-fold. Right now, an experiment might be in seven figures, but it’s not going to go to nine or 10 figures, it’s not possible, nobody can afford that,” he explained.