Articles

ChatGPT: What Technologies Lie Behind the AI Sensation?

ChatGPT has become the face ofartificial intelligence for the general public. The text-generation tool has been widely known and used for the past few weeks. The occasional server overload is proof of this. This enthusiasm and popularity are the result of a smart strategy by the developer, OpenAI, which opened up free access to all internet users, allowing everyone to “play” with the fascinating chatbot. The “Generative Pretrained Transformer” language model is an impressive technology due to its relevance and speed. How does it work? What sets it apart? Is it a competitor to Google Search?

HOW CHATGPT WORKS

The language model used by the intelligent chatbot is called the “Generative Pretrained Transformer.” It belongs to the family of pre-trained models, meaning it is trained on a large dataset to generate relevant content using machine learning. It also uses RLHF (Reinforcement Learning from Human Feedback), which enhances the learning process through human input to make it more conversational. An expert provides the AI with a response to a specific question. The AI then generates several responses. The human intervention involves ranking these different responses before reintegrating them into the system.

GPT-3consists of a neural network architecture ( with 175 billion parameters) that uses pre-trained language models, derived from massive databases, to generate text that mimics human language in multiple languages.

The model is built on a database of information derived from words and the contexts in which they appear.

Generative AI is a technology that isn’t limited to text; one example is Dall-E, which creates unique (photorealistic) images based on text prompts.

Before ChatGPT, other tools had attempted to make a breakthrough: Microsoft’s Tay and Beta’s Blenderbot. They were taken down due to discriminatory behavior, as they were capable of providing biased, one-sided, or offensive responses. The issue was their inability to recognize questions with malicious intent.

To address this issue, OpenAI uses the Moderation API, a system that helps developers identify content that violates content policies (such as illegal information, defamatory statements, or dangerous content).

GPT-4 is expected to feature neural networks with a higher number of parameters, which would enable it to perform much more complex tasks and provide responses of even higher quality.

aivancity

Master ChatGPT and
Generative AI

Demystify generative AI tools and harness their potential in your job. A 100% hands-on approach, with no technical prerequisites.

2-day course All professional profiles CPF-eligible — €1,250 excl. VAT Paris-Villejuif & Nice
Explore the course → RS6787 certification
ChatGPT & Generative AI

The capabilities of ChatGPT, version 3

ChatGPT and DALL-E 2 use GPT-3, the third version of generative AI. It is a natural language processing system capable of writing, reasoning, and coding at near-instantaneous speeds. The conversational format allows users to:

  • Answer a wide variety of questions on all kinds of topics
  • Summarize texts or concepts
  • Admit your mistakes and correct them
  • Produce written work that is free of errors (spelling, verb conjugation, grammar, and syntax)
  • Challenge false claims and reject inappropriate or leading questions
  • Simplifying difficult texts

Generative AI makes it possible to communicate with robots in a dialogue that closely resembles natural language.

Among ChatGPT’s surprising capabilities is its ability to write a rap song about the tool’s own virtual depression

A masterpiece available in several versions, inspired by the style of rappers Jul and Nekfeu, in response to various requests from the user, @raplume.

“Other fascinating artificial intelligence tools”

  • Beatoven creates unique, royalty-free music.
  • Cleanvoice removes background noise, stuttering, and mouth noises when recording podcasts.
  • Vidyo offers short video clips for social media adapted from longer productions.
    https://vidyo.ai/
  • Flair produces product photo shoots.
    https://flair.ai/
  • Illustroke creates vector images based on simple requests.
  • Patterned generates royalty-free patterns (for textiles, for example).
  • Copy provides content when you’re stuck for ideas.
  • Ocoya helps with the creation, distribution, and scheduling of content on social media.
  • Unbounce lets you create landing pages and write emails.
IS CHATGPT ABOUT TO KNOCK GOOGLE OFF ITS PEDESTAL?

It’s worth remembering that a chatbot is a virtual assistant, not a search engine. This means it isn’t connected to the internet, even though it uses it.

ChatGPT cannot display multiple sources the way Google Search does. Furthermore, it was “trained” on data up through 2021.

That said, it still overshadows the search engine. Asking the virtual assistant means you don’t have to sift through various articles and sponsored ads, as is the case with search engines.

More users on ChatGPT means less visibility for Google ads.

The “G” in GAFA is preparing its counterattack: LaMDA is in the works and continues to undergo testing so it can launch fully operational. So far, there’s been no incentive to launch it, since it wouldn’t generate any revenue. Indeed, it’s hard to imagine advertising on a chatbot. If ChatGPT becomes a paid service in future versions, Google will certainly enter the competition.

Generative AI is a major innovation that has the advantage of introducing artificial intelligence to a wide audience. Regardless of its trajectory and evolution, there is no doubt that the star of AI, ChatGPT, is ushering in a new digital era, offering us, along the way, powerful emotions that are anything but virtual.

MSc Generative and Agentic AI aivancity
aivancity

MSc Generative AI
and Agentic AI

Become an expert in generative and agentic AI: LLMs, transformers, enterprise deployment. Silicon Valley learning trip included. RNCP Level 7 certification (Bac+6).

12 months — Bac+6 Bac+5 with experience Part-time — Fridays & Saturdays Paris-Villejuif campus
Explore the program → RNCP Level 7 certification

Don’t miss our upcoming articles!

Get the latest articles written by aivancity experts and professors delivered straight to your inbox.

We don’t send spam! Please see our privacy policy for more information.

Don’t miss our upcoming articles!

Get the latest articles written by aivancity experts and professors delivered straight to your inbox.

We don’t send spam! Please see our privacy policy for more information.

Related posts
Articles

Educational Prompts and Generative AI: What Does a Prompt Actually Do Pedagogically?

By Dr. Antoun YAACOUB Associate Professor at aivancity Director of the MSc Intelligences Artificielles Génératives & Agentiques Zainab Assaghir Full Professor Faculty of Sciences, Lebanese University Libraries of educational prompts are multiplying, but they describe…
Articles

AI education’s blind spot: data management

By Dr. Guendalina CALDARINI, Program Director, MSc Data Management | Professor at aivancity | AI education today faces a paradox. Schools and bootcamps are turning out graduates who can fine-tune language models, deploy retrieval-augmented generation…
Articles

ACT 3: After Mistral: who will be sovereign in the new global AI order?

THE MISTRAL PARADOX: 3 ACTS TO RETHINK SOVEREIGNTY IN THE AGE OF AI By Dr. Tawhid CHTIOUI, Founding Presidentof aivancity School of AI & Data for Business & Society; selected by Keyrus as one of…
This site is registered on wpml.org as a development site. Switch to a production site key to remove this banner.