Sitemaps XML format (Sitemaps)
An XML file listing the URLs of a site, with optional last-modified, change-frequency and priority hints, that webmasters publish so search engines can crawl more intelligently.
Canonical text: https://www.sitemaps.org/protocol.html, read against version 0.90. In use on this site: manifesto.md/sitemap.xml.
The protocol
- Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling.
- The Sitemap protocol format consists of XML tags; the file itself must be UTF-8 encoded.
- Begin with an opening <urlset> tag and end with a closing </urlset> tag, specifying the namespace http://www.sitemaps.org/schemas/sitemap/0.9.
- Include a <url> entry for each URL, as a parent XML tag.
- Include a <loc> child entry for each <url> parent tag.
- The <lastmod>, <changefreq> and <priority> tags are optional.
- All data values in a Sitemap must be entity-escaped.
- Each Sitemap file that you provide must have no more than 50,000 URLs and must be no larger than 50MB (52,428,800 bytes).
- A Sitemap index file lists multiple Sitemaps, up to 50,000; it can only specify Sitemaps that are found on the same site as the Sitemap index file.
- The location of a Sitemap file determines the set of URLs that can be included in that Sitemap; all URLs must share its protocol and host.
- Point search engines to a Sitemap with a Sitemap line in robots.txt, for example Sitemap: http://www.example.com/sitemap.xml.
Facts
- Maintainer
- sitemaps.org, sponsored by Google, Yahoo! and Microsoft
- Licence of the text
- CC BY-SA 2.5
- Status of the text
- stable
- Listing
- listed, not yet claimed
Read with
-
Robots Exclusion Protocol
The rules a service publishes at /robots.txt to tell crawlers which URIs they may access, as standardised by the IETF in RFC 9309 from Martijn Koster's 1994 method.
-
The /llms.txt file
A proposal for a Markdown file at /llms.txt that gives language models a curated overview of a website and links to clean Markdown versions of its pages.
Badge
[](https://manifesto.md/sitemaps/) Maintainers claim a listing with a pull request setting listing: claimed, or a yes on the listing issue.