Editing Loebner Prize (section)

==Contests==

===2003===

In 2003, the contest was organised by Professor [[Richard H. R. Harper]] and Dr. Lynne Hamill from the Digital World Research Centre at the [[University of Surrey]].<ref>{{Cite web|url=http://news.bbc.co.uk/1/hi/technology/3206876.stm|work=BBC News|title=German chatbot is 'most human'}} Retrieved 2024-12-27</ref>

Although no bot passed the Turing test, the winner was Jabberwock, created by [[Juergen Pirner]]. Second was Elbot (Fred Roberts, [[Artificial Solutions]]). Third was [[Jabberwacky]], ([[Rollo Carpenter]]).

===2006===
In 2006, the contest was organised by [[Tim Child]] (CEO of Televirtual) and Huma Shah.<ref name="auto"/><ref>{{Cite web|url=http://humashah.blogspot.com/2006_09_01_archive.html|title=Conversation, Deception and Intelligence|website=humashah.blogspot.com}}</ref> On August 30, the four finalists were announced:
* Rollo Carpenter
* Richard Churchill and Marie-Claire Jenkins
* Noah Duncan
* Robert Medeksza

The contest was held on 17 September in the VR theatre, Torrington Place campus of [[University College London]]. The judges included the University of Reading's [[cybernetics]] professor, [[Kevin Warwick]], a professor of artificial intelligence, John Barnden (specialist in metaphor research at the [[University of Birmingham]]), a barrister, Victoria Butler-Cole and a journalist, Graham Duncan-Rowe. The latter's experience of the event can be found in an article in ''[[Technology Review]]''.<ref>[http://www.technologyreview.com/read_article.aspx?id=17518&ch=in How To Be Human], ''Technology Review'', 20 September 2006</ref><ref>[https://web.archive.org/web/20170914152327/http://www.loebner.net/Prizef/loebner-prize.html Loebner Prize ], loebner.net</ref> The winner was 'Joan', based on Jabberwacky, both created by Rollo Carpenter.

===2007===
The 2007 competition was held on October 21 in New York City. The judges were: [[computer science]] professor Russ Abbott, philosophy professor [[Hartry Field]], psychology assistant professor Clayton Curtis and English lecturer [[Scott Hutchins]].<ref>[https://web.archive.org/web/20170902152757/http://loebner.net/Prizef/2007_Contest/loebner-prize-2007.html 17th Annual Loebner Prize for Artificial Intelligence], loebner.net</ref>

No bot passed the Turing test, but the judges ranked the three contestants as follows:
* 1st: Robert Medeksza, creator of Ultra Hal
* 2nd: Noah Duncan, a private entry, creator of Cletus
* 3rd: Rollo Carpenter from Icogno, creator of Jabberwacky

The winner received $2,250 and the annual medal. The runners-up received $250 each.

===2008===
The 2008 competition was organised by professor Kevin Warwick, coordinated by Huma Shah and held on October 12 at the University of Reading, [[United Kingdom|UK]].<ref>{{Cite web|url=http://loebner.net/Prizef/2008_Contest/loebner-prize-2008.html|title=Loebner is under construction}}</ref> After testing by over one hundred judges during the preliminary phase, in June and July 2008, six finalists were selected from thirteen original entrant artificial conversational entities (ACEs). Five of those invited competed in the finals:
*Brother Jerome, Peter Cole and Benji Adams
*[[Elbot]], Fred Roberts / [[Artificial Solutions]]
*[[Eugene Goostman]], Vladimir Veselov, Eugene Demchenko and Sergey Ulasen
*Jabberwacky, Rollo Carpenter
*Ultra Hal, Robert Medeksza

In the finals, each of the judges was given five minutes to conduct simultaneous, split-screen conversations with two hidden entities. Elbot<ref>{{Cite web |archiveurl=https://web.archive.org/web/20150104065625/http://www.elbot.com/chatterbot-elbot/|archivedate=2015-01-04|title=Elbot the Robot|url=http://www.elbot.com/defaultsite |access-date=2023-02-12 |website=www.elbot.com}}</ref> of Artificial Solutions<ref>{{Cite web|url=https://www.teneo.ai?utm_source=as-redirect&utm_medium=referral&url=|title=Teneo.ai &#124; Contact Center AI Redefined|website=Teneo.Ai – Transforming every phone call to a love story with your brand}}</ref> won the 2008 Loebner Prize bronze award, for ''most human-like'' artificial conversational entity, through fooling three of the twelve judges who interrogated it (in the human-parallel comparisons) into believing it was human. This is coming very close to the 30% traditionally required to consider that a program has actually passed the Turing test. Eugene Goostman<ref>{{Cite web |url=http://www.princetonai.com/bot/botProcess.jsp |title=Eugene Goostman |access-date=2008-10-21 |archive-url=https://web.archive.org/web/20170617145147/http://www.princetonai.com/bot/botProcess.jsp |archive-date=2017-06-17 |url-status=dead }}</ref> and Ultra Hal<ref>{{Cite web|url=https://www.zabaware.com/ultrahal/|title=Zabaware – Ultra Hal 7.0|website=www.zabaware.com}}</ref> both deceived one judge each that it was the human.

Will Pavia, a journalist for [[The Times]], has written about his experience; a Loebner finals' judge, he was deceived by Elbot and Eugene.<ref>{{Cite web|url=https://www.thetimes.com/article/machine-takes-on-man-at-mass-turing-test-90rv9gmpn2l|title=Machine takes on man at mass Turing Test|first=Will|last=Pavia|date=13 October 2008|website=www.thetimes.com}}</ref> Kevin Warwick and Huma Shah have reported on the parallel-paired Turing tests.<ref>{{Cite web|url=http://www.rdg.ac.uk/research/Highlights-News/featuresnews/res-featureloebner.asp|title=parallel-paired Turing tests}}</ref>

=== 2009 ===

The 2009 Loebner Prize Competition was held September 6, 2009, at the [[Brighton Centre]], [[Brighton]] UK in conjunction with the Interspeech 2009 conference. The prize amount for 2009 was $3,000.

Entrants were [[David Levy (chess player)|David Levy]], Rollo Carpenter, and Mohan Embar, who finished in that order.

The writer [[Brian Christian]] participated in the 2009 Loebner Prize Competition as a human confederate, and described his experiences at the competition in his book ''The Most Human Human''.

=== 2010 ===

The 2010 Loebner Prize Competition was held on October 23 at [[California State University]], Los Angeles. The 2010 competition was the 20th running of the contest. The winner was [[Bruce Wilcox]] with Suzette.

=== 2011 ===
The 2011 Loebner Prize Competition was held on October 19 at the [[University of Exeter]], [[Devon]], United Kingdom. The prize amount for 2011 was $4,000.

The four finalists and their chatterbots were [[Bruce Wilcox]] (Rosette), Adeena Mignogna (Zoe), Mohan Embar (Chip Vivant) and Ron Lee (Tutor), who finished in that order.

That year there was an addition of a panel of junior judges, namely Georgia-Mae Lindfield, William Dunne, Sam Keat and Kirill Jerdev. The results of the junior contest were markedly different from the main contest, with chatterbots Tutor and Zoe tying for first place and Chip Vivant and Rosette coming in third and fourth place, respectively.

=== 2012 ===
The 2012 Loebner Prize Competition was held on the 15th of May in [[Bletchley Park]] in [[Bletchley]], [[Buckinghamshire]], England, in honor of the [[Alan Turing]] centenary celebrations. The prize amount for 2012 was $5,000. The local arrangements organizer was David Levy, who won the Loebner Prize in 1997 and 2009.

The four finalists and their chatterbots were Mohan Embar (Chip Vivant), Bruce Wilcox (Angela), Daniel Burke (Adam), M. Allan (Linguo), who finished in that order.

That year, a team from the University of Exeter's computer science department (Ed Keedwell, Max Dupenois and Kent McClymont) conducted the first-ever live webcast of the conversations.<ref>{{cite web|url = http://people.exeter.ac.uk/km314/loebner/index.php|title = 2012 Loebner Prize Webcast|accessdate = 15 May 2012|url-status = dead|archiveurl = https://web.archive.org/web/20120518095246/http://people.exeter.ac.uk/km314/loebner/index.php|archivedate = 18 May 2012}}</ref>

=== 2013 ===
The 2013 Loebner Prize Competition was held, for the only time on the Island of [[Ireland]], on September 14 at the [[Ulster University]], [[Magee College]], [[Derry]], [[Northern Ireland]], UK.

The four finalists and their chatbots were Steve Worswick (Mitsuku), Dr. Ron C. Lee (Tutor), Bruce Wilcox (Rose) and Brian Rigsby (Izar), who finished in that order.

The judges were Professor [[Roger Schank]] (Socratic Arts), Professor [[Noel Sharkey]] ([[Sheffield University]]), Professor Minhua (Eunice) Ma ([[Huddersfield University]], then [[University of Glasgow]])
and Professor Mike McTear ([[Ulster University]]).

For the 2013 Junior Loebner Prize Competition the chatbots Mitsuku and Tutor tied for first place with Rose and Izar in 3rd and 4th place respectively.

=== 2014 ===
The 2014 Loebner Prize Competition was held at Bletchley Park, England, on Saturday 15 November 2014. The event was filmed live by Sky News. The guest judge was television presenter and broadcaster James May.

After 2 hours of judging, 'Rose' by Bruce Wilcox was declared the winner. Bruce will receive a cheque for $4000 and a bronze medal. The ranks were as follows:

Rose – Rank 1 ($4000 & Bronze Medal); 
Izar – Rank 2.25 ($1500); 
Uberbot – Rank 3.25 ($1000); and 
Mitsuku – Rank 3.5 ($500).

The Judges were Dr Ian Hocking, Writer & Senior Lecturer in Psychology, Christ Church College, Canterbury; 
Dr Ghita Kouadri-Mostefaoui, Lecturer in Computer Science and Technology, University of Bedfordshire; 
Mr James May, Television Presenter and Broadcaster; and 
Dr Paul Sant, Dean of UCMK, University of Bedfordshire.

=== 2015 ===
The 2015 Loebner Prize Competition was again won by 'Rose' by Bruce Wilcox.<ref>{{cite news|title=Chatbot Rose wins 2015's Loebner artificial intelligence prize|work=BBC News|url=https://www.bbc.com/news/technology-34302338|accessdate=29 May 2016}}</ref>

The judges were Jacob Aaron, Physical sciences reporter for New Scientist; Rory Cellan-Jones, Technology correspondent for the BBC; Brett Marty, Film Director and Photographer; Ariadne Tampion, Writer.

=== 2016 ===
The 2016 Loebner Prize was held at Bletchley Park on 17 September 2016. After 2 hours of judging the final results were announced. 
The ranks were as follows:

*1st place: [[Mitsuku]]<ref name="Mitsuku Chatbot" />
*2nd place: Tutor  
*3rd place: Rose

=== 2017 ===
The 2017 Loebner Prize was held at Bletchley Park on 16 September 2017. This was the first contest where a new message by message protocol was used, rather than the traditional one character at a time.
The ranks were as follows, and were announced by a [[Nao_(robot)]]:

*1st place: [[Mitsuku]]<ref name="Mitsuku Chatbot" />
*2nd place: Midge  
*3rd place: Uberbot
*4th place: Rose

=== 2018 ===
The 2018 Loebner Prize was held at Bletchley Park on 8 September 2018. This was the final time it would be held in its traditional Turing Test format and its final time at Bletchley Park.
The ranks were as follows:

*1st place: [[Mitsuku]]<ref name="Mitsuku Chatbot" />
*2nd place: Tutor  
*3rd place: Colombina
*4th place: Uberbot

=== 2019 ===
The 2019 Loebner Prize was held at the University of Swansea from 12th–15th September, as part of a larger exhibition which looked at creativity in computers. 
The format of the contest changed from being a traditional Turing Test, with selected judges and humans, into a 4 day testing session where members of the general public, including schoolchildren, could interact with the bots, knowing in advance that the bots were not humans. Seventeen bots took part instead of the usual 4 finalists. Steve Worswick won for a record 5th time with Mitsuku, which enabled him to be included in the Guinness Book of Records.<ref>{{Cite web|url=https://www.guinnessworldrecords.com/world-records/603076-most-loebner-prize-wins|title=Most Loebner Prize wins &#124; Guinness World Records}}</ref>

A selected jury of judges also examined and voted for the ones they liked best.
The ranks were as follows:

Most humanlike chatbot:
*1st place: [[Mitsuku]]<ref name="Mitsuku Chatbot" /> – 24 points
*2nd place: Uberbot – 6 points
*3rd place: Anna – 5 points

Best overall chatbot
*1st place: [[Mitsuku]]<ref name="Mitsuku Chatbot" /> – 19 points
*2nd place: Uberbot – 5 points
*3rd place: Arckon – 4 points