Editing Artificial intelligence (section)

===GPT===
[[Generative pre-trained transformer]]s (GPT) are [[large language model]]s (LLMs) that generate text based on the semantic relationships between words in sentences. Text-based GPT models are pre-trained on a large [[corpus of text]] that can be from the Internet. The pretraining consists of predicting the next [[Lexical analysis|token]] (a token being usually a word, subword, or punctuation). Throughout this pretraining, GPT models accumulate knowledge about the world and can then generate human-like text by repeatedly predicting the next token. Typically, a subsequent training phase makes the model more truthful, useful, and harmless, usually with a technique called [[reinforcement learning from human feedback]] (RLHF). Current GPT models are prone to generating falsehoods called "[[Hallucination (artificial intelligence)|hallucinations]]". These can be reduced with RLHF and quality data, but the problem has been getting worse for reasoning systems.<ref>{{Cite news |last1=Metz |first1=Cade |last2=Weise |first2=Karen |date=2025-05-05 |title=A.I. Hallucinations Are Getting Worse, Even as New Systems Become More Powerful |url=https://www.nytimes.com/2025/05/05/technology/ai-hallucinations-chatgpt-google.html |access-date=2025-05-06 |work=The New York Times |language=en-US |issn=0362-4331}}</ref> Such systems are used in [[chatbot]]s, which allow people to ask a question or request a task in simple text.{{Sfnp|Smith|2023}}<ref>{{Cite web |date=9 November 2023 |title=Explained: Generative AI |url=https://news.mit.edu/2023/explained-generative-ai-1109}}</ref>

Current models and services include [[Gemini (chatbot)|Gemini]] (formerly Bard), [[ChatGPT]], [[Grok (chatbot)|Grok]], [[Anthropic#Claude|Claude]], [[Microsoft Copilot|Copilot]], and [[LLaMA]].<ref>{{Cite web |title=AI Writing and Content Creation Tools |url=https://mitsloanedtech.mit.edu/ai/tools/writing |access-date=25 December 2023 |publisher=MIT Sloan Teaching & Learning Technologies |archive-date=25 December 2023 |archive-url=https://web.archive.org/web/20231225232503/https://mitsloanedtech.mit.edu/ai/tools/writing/ |url-status=live }}</ref> [[Multimodal learning|Multimodal]] GPT models can process different types of data ([[Modality (human–computer interaction)|modalities]]) such as images, videos, sound, and text.{{Sfnp|Marmouyet|2023}}