The document discusses sitemaps, which are files that provide metadata about a website to search engines to help them better index the site. Sitemaps inform search engines about URLs on a site and additional information like modification dates and priority. They use XML format and common elements include loc, lastmod, changefreq, and priority. The document also covers sitemap index files for large sites and ways to notify search engines about sitemaps through robots.txt files and pinging search engine sites directly.
9. Don¡¯t forgetYour Sitemap file must be UTF-8. As with all XML files, any data values (including URLs) must use entity escape codes for the characters listed in the table below.
11. Letting Search Engines KnowRobots.txt ¡°Sitemap: http://www.news24.com/sitemapindex.xml¡±Ping the search engines¡www.google.com/ping?sitemap=http%3A%2F%2Fwww.news24.com%2Fsitemapindex.xml(URL encode everything after the /ping?sitemap=)Google Webmaster Tools, Bing Webmaster Center, Yahoo! Site Explorer