{"id":73051,"date":"2023-01-25T15:28:15","date_gmt":"2023-01-25T13:28:15","guid":{"rendered":"https:\/\/forklog.com\/en\/?p=73051"},"modified":"2025-09-09T11:58:07","modified_gmt":"2025-09-09T08:58:07","slug":"yann-lecun-chatgpt-is-not-particularly-innovative-but-well-put-together","status":"publish","type":"post","link":"https:\/\/u1f987.com\/en\/yann-lecun-chatgpt-is-not-particularly-innovative-but-well-put-together\/","title":{"rendered":"Yann LeCun: ChatGPT is not particularly innovative, but well put together"},"content":{"rendered":"

From the standpoint of the underlying methods behind OpenAI’s ChatGPT chatbot, it is not ‘particularly innovative’ and there is ‘nothing revolutionary’ about it, said Meta vice-president and leading AI scientist Yann LeCun during a Zoom press briefing, according to ZDNet<\/a>.<\/p>\n

\\n\\n<\/p>\n

\n

“It’s simply well put together, nicely made,” the researcher said.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

According to LeCun, the notion that OpenAI is ‘unique in its line of work’ is incorrect. The AI lab ‘is not particularly advanced’ compared with other companies, he added.<\/p>\n

\\n\\n<\/p>\n

\n

“It’s not just Google or Meta, but half a dozen startups with similar systems,” the scientist noted.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

LeCun pointed out that ChatGPT and the language model on which it is based, GPT-3, include several technologies developed by external developers.<\/p>\n

\\n\\n<\/p>\n

The chatbot is based on pre-trained self-supervised transformers<\/a>, which were first described by Google Brain engineers in 2017. These neural networks underlie a number of language systems.<\/p>\n

\\n\\n<\/p>\n

\n

“Self-supervised learning is a topic I have spoken about for a long time, even before OpenAI existed,” LeCun said.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

He added that the first large language model appeared about 20 years ago. It was created by Yoshua Bengio, head of Montreal’s MILA.<\/p>\n

\\n\\n<\/p>\n

The OpenAI developers also used reinforcement learning, which was first applied by researchers at Google DeepMind.<\/p>\n

\\n\\n<\/p>\n

\n

“It [ChatGPT] has a whole history; it did not emerge from nothing,” LeCun said.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

According to the Meta executive, the OpenAI chatbot is not so much a scientific breakthrough as a ‘worthy engineering approach’.<\/p>\n

\\n\\n<\/p>\n

\n

“And I am not going to criticise them for that,” he noted.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

When asked by a reporter from The New York Times whether society would ever identify Meta’s FAIR AI team with breakthroughs like OpenAI, LeCun replied “yes”.<\/p>\n

\\n\\n<\/p>\n

\n

“Not only in terms of text generation, but also creativity,” the scientist added.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

The researcher was also asked about the reasons for the absence of such ChatGPT-like technologies from Google and Meta.<\/p>\n

\\n\\n<\/p>\n

\n

“They [the tech giants] may lose a lot by releasing algorithms capable of conjuring something,” he replied.<\/p>\n<\/blockquote>\n

\\n\\n<\/p>\n

In October 2022, Yann LeCun proposed endowing AI systems with ‘common sense’<\/a>.<\/p>\n

\\n\\n<\/p>\n

In February, OpenAI co-founder Ilya Sutskever suggested the possibility of consciousness in artificial intelligence<\/a>. Yann LeCun strongly criticised his statement.<\/p>\n

\\n\\n<\/p>\n

Subscribe to ForkLog news on Telegram: ForkLog AI<\/a> \u2014 all the news from the world of AI!<\/p>\n","protected":false},"excerpt":{"rendered":"

From the standpoint of the underlying methods of OpenAI’s ChatGPT, it is not ‘particularly innovative’ and there is ‘nothing revolutionary’ about it.<\/p>\n","protected":false},"author":1,"featured_media":73052,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"select":"1","news_style_id":"1","cryptorium_level":"","_short_excerpt_text":"","creation_source":"","_metatest_mainpost_news_update":false,"footnotes":""},"categories":[3],"tags":[438,1201,1293,1138],"class_list":["post-73051","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-and-analysis","tag-artificial-intelligence","tag-chatbots","tag-meta","tag-opinions"],"aioseo_notices":[],"amp_enabled":true,"views":"22","promo_type":"1","layout_type":"1","short_excerpt":"","is_update":"","_links":{"self":[{"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/posts\/73051","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/comments?post=73051"}],"version-history":[{"count":1,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/posts\/73051\/revisions"}],"predecessor-version":[{"id":73053,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/posts\/73051\/revisions\/73053"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/media\/73052"}],"wp:attachment":[{"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/media?parent=73051"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/categories?post=73051"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/u1f987.com\/en\/wp-json\/wp\/v2\/tags?post=73051"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}