Editing Deep linking (section)

==Legend==
Web site owners who do not want search engines to deep link, or want them only to index specific pages can request so using the [[Robots Exclusion Standard]] (<code>robots.txt</code> file).  People who favor deep linking often feel that content owners who do not provide a robots.txt file are implying by default that they do not object to deep linking either by search engines or others.{{cn|date=October 2015}} People against deep linking often claim that content owners may be unaware of the Robots Exclusion Standard or may not use robots.txt for other reasons.{{cn|date=October 2015}} Sites other than search engines can also deep link to content on other sites, so some question the relevance of the Robots Exclusion Standard to controversies about Deep Linking.<ref>{{Cite web|url=https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/|title=Robots.txt meant for search engines don't work well for web archives {{!}} Internet Archive Blogs|date=17 April 2017 |language=en-US|access-date=2019-05-20}}</ref> The Robots Exclusion Standard does not programmatically enforce its directives so it does not prevent search engines and others who do not follow polite conventions from deep linking.<ref>{{Cite web|url=https://www.appsflyer.com/resources/everything-marketer-needs-to-know-deep-linking/deep-linking-basics/|title=Deep Linking Basics: Explaining Key Concepts|website=AppsFlyer|language=en-US|access-date=2019-05-20}}</ref>