Apache Lucene

Template:Short description Template:More citations needed {{#invoke:Infobox|infobox}}Template:Template other{{#invoke:Check for unknown parameters | check | showblankpositional=1 | unknown = Template:Main other | preview = Page using Template:Infobox software with unknown parameter "_VALUE_"|ignoreblank=y | AsOf | author | background | bodystyle | caption | collapsetext | collapsible | developer | discontinued | engine | engines | genre | included with | language | language count | language footnote | latest preview date | latest preview version | latest release date | latest release version | latest_preview_date | latest_preview_version | latest_release_date | latest_release_version | licence | license | logo | logo alt | logo caption | logo upright | logo size | logo title | logo_alt | logo_caption | logo_upright | logo_size | logo_title | middleware | module | name | operating system | operating_system | other_names | platform | programming language | programming_language | released | replaced_by | replaces | repo | screenshot | screenshot alt | screenshot upright | screenshot size | screenshot title | screenshot_alt | screenshot_upright | screenshot_size | screenshot_title | service_name | size | standard | title | ver layout | website | qid }}Template:Main other Apache Lucene is a free and open-source search engine software library, originally written in Java by Doug Cutting. It is supported by the Apache Software Foundation and is released under the Apache Software License. Lucene is widely used as a standard foundation for production search applications.<ref>Template:Citation</ref><ref>Template:Citation</ref><ref>Template:Cite journal</ref>

Lucene has been ported to other programming languages including Object Pascal, Perl, C#, C++, Python, Ruby and PHP.<ref name="port">{{#invoke:citation/CS1|citation |CitationClass=web }}</ref>

History

Doug Cutting originally wrote Lucene in 1999.<ref>KeywordAnalyzer {{#invoke:citation/CS1|citation |CitationClass=web }}</ref> Lucene was his fifth search engine. He had previously written two while at Xerox PARC, one at Apple, and a fourth at Excite.<ref>{{#invoke:citation/CS1|citation |CitationClass=web }}</ref> It was initially available for download from its home at the SourceForge web site. It joined the Apache Software Foundation's Jakarta family of open-source Java products in September 2001 and became its own top-level Apache project in February 2005. The name Lucene is Doug Cutting's wife's middle name and her maternal grandmother's first name.<ref>Template:Cite book</ref>

Lucene formerly included a number of sub-projects, such as Lucene.NET, Mahout, Tika and Nutch. These three are now independent top-level projects.

In March 2010, the Apache Solr search server joined as a Lucene sub-project, merging the developer communities.

Version 4.0 was released on October 12, 2012.<ref name="apache.org">{{#invoke:citation/CS1|citation |CitationClass=web }}</ref>

In March 2021, Lucene changed its logo, and Apache Solr became a top level Apache project again, independent from Lucene.

Features and common use

While suitable for any application that requires full text indexing and searching capability, Lucene is recognized for its utility in the implementation of Internet search engines and local, single-site searching.<ref>Template:Cite book</ref><ref>{{#invoke:citation/CS1|citation |CitationClass=web }}</ref>

Lucene includes a feature to perform a fuzzy search based on edit distance.<ref>{{#invoke:citation/CS1|citation |CitationClass=web }}</ref>

Lucene has also been used to implement recommendation systems.<ref>J. Beel, S. Langer, and B. Gipp, “The Architecture and Datasets of Docear’s Research Paper Recommender System,” in Proceedings of the 3rd International Workshop on Mining Scientific Publications (WOSP 2014) at the ACM/IEEE Joint Conference on Digital Libraries (JCDL 2014), London, UK, 2014</ref> For example, Lucene's 'MoreLikeThis' Class can generate recommendations for similar documents. In a comparison of the term vector-based similarity approach of 'MoreLikeThis' with citation-based document similarity measures, such as co-citation and co-citation proximity analysis, Lucene's approach excelled at recommending documents with very similar structural characteristics and more narrow relatedness.<ref name="Schwarzer16">M. Schwarzer, M. Schubotz, N. Meuschke, C. Breitinger, V. Markl, and B. Gipp, https://www.gipp.com/wp-content/papercite-data/pdf/schwarzer2016.pdf "Evaluating Link-based Recommendations for Wikipedia" in Proceedings of the 16th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), New York, NY, USA, 2016, pp. 191-200.</ref> In contrast, citation-based document similarity measures tended to be more suitable for recommending more broadly related documents,<ref name="Schwarzer16" /> meaning citation-based approaches may be more suitable for generating serendipitous recommendations, as long as documents to be recommended contain in-text citations.

Lucene-based projects

Lucene itself is just an indexing and search library and does not contain crawling and HTML parsing functionality. However, several projects extend Lucene's capability:

• Apache Nutch – provides web crawling and HTML parsingTemplate:Citation needed
• Apache Solr – an enterprise search server
• CrateDB – open source, distributed SQL database built on Lucene<ref>Template:Cite news</ref>
• DocFetcher – a multiplatform desktop search applicationTemplate:Citation needed
• Elasticsearch – an enterprise search server released in 2010<ref>{{#invoke:citation/CS1|citation

|CitationClass=web }}</ref><ref>{{#invoke:citation/CS1|citation |CitationClass=web }}</ref>

• Kinosearch – a search engine written in Perl and C<ref name="cmswire">Template:Cite news</ref> and a loose port of Lucene.<ref name="test">{{#invoke:citation/CS1|citation

|CitationClass=web }}</ref> The Socialtext wiki software uses this search engine,<ref name="cmswire" /> and so does the MojoMojo wiki.<ref name="catbook">Template:Cite book</ref> It is also used by the Human Metabolome Database (HMDB)<ref>Template:Cite journal</ref> and the Toxin and Toxin-Target Database (T3DB).<ref>Template:Cite journal</ref>

• MongoDB Atlas Search – a cloud-native enterprise search application based on MongoDB and Apache Lucene
• OpenSearch – an open source enterprise search server based on a fork of Elasticsearch 7
• Swiftype – an enterprise search startup based on Lucene

See also

• Enterprise search
• Information extraction
• Information retrieval
• Text mining

Bibliography

• Template:Cite book
• Template:Cite book

External links

• Template:Official website