Does Joomla make a sitemap and robots.txt?
Joomla ships robots.txt.dist: rename it to robots.txt. A sitemap needs an extension such as OSMap.
What comes with Joomla
Joomla ships a ready-made robots file, but not an XML sitemap. A sitemap helps search engines find all your pages; it doesn't guarantee they get indexed.
robots.txt
- Joomla includes
robots.txt.distin the site folder. Rename (or copy) it torobots.txt. - It blocks folders like /administrator/, /cache/ and /tmp/ and allows the rest. Add
Disallow:lines for anything else you want to keep out. - If Joomla runs in a subfolder, the file must be at the domain root and the paths need the folder name.
XML sitemap
- Install a sitemap extension from the Sitemap category of the Joomla Extensions Directory (OSMap and JSitemap are popular).
- Submit the sitemap address in Google Search Console and Bing Webmaster Tools.
Good to know
- Don't block
/media/or/templates/: Google needs the CSS and images to see your pages properly.
Sources
- The robots.txt file – Joomla User Guide
- Using A Sitemap – Joomla User Guide