Editing Chatbot (section)

=== Modern chatbots based on large language models ===
Modern chatbots like [[ChatGPT]] are often based on [[large language model]]s called [[generative pre-trained transformer]]s (GPT). They are based on a [[deep learning]] architecture called the [[Transformer (deep learning architecture)|transformer]], which contains [[artificial neural networks]]. They learn how to generate text by being trained on a large [[text corpus]], which provides a solid foundation for the model to perform well on downstream tasks with limited amounts of task-specific data. Despite criticism of its accuracy and tendency to "hallucinate"—that is, to confidently output false information and even cite non-existent sources—ChatGPT has gained attention for its detailed responses and historical knowledge. Another example is BioGPT, developed by [[Microsoft]], which focuses on answering [[biomedical]] questions.<ref>{{cite journal |last1=Luo |first1=Renqian |last2=Sun |first2=Liai |last3=Xia |first3=Yingce |last4=Qin |first4=Tao |last5=Zhang |first5=Sheng |last6=Poon |first6=Hoifung |last7=Liu |first7=Tie-Yan |display-authors=etal |year=2022 |title=BioGPT: generative pre-trained transformer for biomedical text generation and mining |journal=Brief Bioinform |volume=23 |issue=6 |pages= |arxiv=2210.10341 |doi=10.1093/bib/bbac409 |pmid=36156661}}</ref><ref>{{cite web |author=Bastian, Matthias |date=29 January 2023 |title=BioGPT is a Microsoft language model trained for biomedical tasks |url=https://the-decoder.com/biogpt-is-a-microsoft-language-model-trained-for-biomedical-tasks/ |url-status=live |archive-url=https://web.archive.org/web/20230207174627/https://the-decoder.com/biogpt-is-a-microsoft-language-model-trained-for-biomedical-tasks/ |archive-date=7 February 2023 |access-date=7 February 2023 |website=The Decoder}}</ref> In November 2023, Amazon announced a new chatbot, called Q, for people to use at work.<ref>{{Cite web |last=Novet |first=Jordan |date=28 November 2023 |title=Amazon announces Q, an AI chatbot for businesses |url=https://www.cnbc.com/2023/11/28/amazon-announces-q-an-ai-chatbot-for-businesses.html |access-date=28 November 2023 |website=CNBC |language=en}}</ref>