Editing Web crawler (section)

== Nomenclature ==
A web crawler is also known as a ''spider'',<ref name="spekta">{{cite web|last=Spetka|first=Scott|title=The TkWWW Robot: Beyond Browsing|url=http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/Agents/spetka/spetka.html|publisher=[[National Center for Supercomputing Applications|NCSA]]|access-date=21 November 2010 |archive-url=https://web.archive.org/web/20040903174942/http://archive.ncsa.uiuc.edu/SDG/IT94/Proceedings/Agents/spetka/spetka.html |archive-date=3 September 2004}}</ref> an ''ant'', an ''automatic indexer'',<ref>{{cite journal |author1=Kobayashi, M. |author2=Takeda, K. |name-list-style=amp |title = Information retrieval on the web |journal = ACM Computing Surveys|volume = 32 |issue = 2 |pages = 144–173 |year = 2000 |doi = 10.1145/358923.358934|citeseerx=10.1.1.126.6094 |s2cid=3710903 }}</ref> or (in the [[FOAF (software)|FOAF]] software context) a ''Web scutter''.<ref>See [http://wiki.foaf-project.org/w/Scutter definition of scutter on FOAF Project's wiki] {{Webarchive|url=https://web.archive.org/web/20091213213920/http://wiki.foaf-project.org/w/Scutter |date=13 December 2009 }}</ref>