What is robots.txt?

Robots.txt is a text file that tells search engines which parts of the site to crawl or not to crawl. It helps so control what appears in search resultsand what will remain hidden. It is used, for example, to Preventing indexing of duplicate pages or technical parts of the site. It is designed mainly for search engine robotsnot for the general public.

Educate yourself further

SEO illustration with a robot next to a magnifying glass, the text Apadore and a sitemap link symbolizing the crawling and indexing of the website.

What is technical SEO and why is it important for the success of your website

Technical SEO is a set of practices and adjustments to a website that ensure that search engines (such as Google or Seznam) can crawl, index and evaluate it correctly. While...

SEO concept with graph and cog wheel on blue background

What is SEO?

SEO (Search Engine Optimization) is a set of strategies, techniques and procedures that aim to improve the visibility of a website in search results. The main goal is to get...

Comparing HTTP and HTTPS for Web Security

What are HTTP and HTTPS? What is the difference between them?

The HTTP and HTTPS protocols are among the basic building blocks of the Internet. Everyone who uses the web encounters them, even if they often don't realize it...

Get those Best tips for your website

Mikoláš, the founder of Apadore, will send you weekly recommendations in SEO, analytics, design or development.

By submitting the form, you agree to our GDPR policy.

This is Nicholas