İletişim
Altunizade Mah, Sırma Perde Sk No: 25, 34662 Üsküdar/İstanbul
info@redandgo.com
0216 402 10 75

How to Edit Shopify Robots.txt File

With the updates about the events that take place through the panel consisting of the tools that come with Shopify, it is getting bigger day by day with the Shopify team. Shopify’s Tobi Lutke announced in a tweet on June 16, 2021 that robots.txt editing is now possible through Shopify. From now on, Shopify online stores will be able to manage instructions on which pages on their website should or should not be crawled through their own admin panel.

In this article, we will try to explain step-by-step and in detail what the Shopify robots.txt file is, where it is located in your online store, and how to hide certain pages from search engines.

What is Robots.txt File?

The robots.txt file is where you give instructions to Google and other search engine crawlers about what web pages and resources to crawl and what not.

For example, it’s typical for a robots.txt file to instruct web crawlers not to crawl internal admin or login pages.

What Edits Can I Make from the Robots.txt File?

The following changes can be made to the robots.txt file:

  • allow or disallow certain URLs from being crawled
  • for specific crawlers, add crawl-delay rules
  • add other sitemap URLs
  • block certain crawlers

What is a Web Crawler?

A web crawler, often known as a spider or a search engine bot, is a piece of automated software that discovers and scans web sites and resources in order to index them in a search engine.

What is the Crawling of a Web Page?

It is the automated process by which a web crawler retrieves a web page or resource in order to index it in a search engine.

What Are Google’s Main Web Crawlers?

Google’s main web crawler is Googlebot. Googlebot refers to two independent crawlers, one is a desktop crawler and the other is a mobile crawler. They simulate the experience of desktop and mobile device users on your website.
Although not a web crawler, Google Read Aloud is an important user agent of Google. It supports reading web pages using TextToSpeech (TTS) technology. The proxy is only triggered when requested by the user.

Crawling vs Indexing of a Web Page

Crawling is an automated process for web crawlers to discover and scan your website or resources, while indexing is the process of adding websites or resources to the search engine database.

Where is the Shopify Robots.txt File Located?

The Shopify robots.txt file is located in the root folder of your primary domain.

How Do I Edit the Shopify Robots.txt File?

To edit your Shopify robots.txt file:

In your Shopify admin, go to Online Store> Themes.

Click Action, and then click Edit Code.

Click to add a new template, and then select the robots.

Click Create Template.

Make the changes you want to the default template.

Save the changes to the robots.txt.liquid file in the published theme

Please note that this is an unsupported customization, and Shopify support will not help you resolve any potential issues.

How to Hide Shopify Search Template from Google

To hide the search template from Google:

  • From your Shopify admin, go to Online Store > Themes.
  • Find the theme you want to edit, and then click Actions > Edit code.
  • Click the theme.liquid layout file.
  • Paste the following code in the <head> section:

How to Hide a Specific Shopify Page from Google

To hide a specific page from Google:

  • From your Shopify admin, go to Online Store > Themes.
  • Find the theme you want to edit, and then click Actions > Edit code.
  • Click the theme.liquid layout file.
  • Paste the following code in the <head> section:

Make sure that you replace page-handle-you-want-to-exclude with the correct page handle.

  • Click Save.

How to Hide Multiple Shopify Pages from Google

To hide multiple pages from Google:

  • From your Shopify admin, go to Online Store > Themes.
  • Find the theme you want to edit, and then click Actions > Edit code.
  • Click the theme.liquid layout file.
  • Paste the following code in the <head> section:

Make sure that you replace page-handle-you-want-to-exclude with the correct page handle.

  • Click Save.

How to Hide Dynamic Shopify Pages from Google

To hide dynamic pages from Google:

  • From your Shopify admin, go to Online Store > Themes.
  • Find the theme you want to edit, and then click Actions > Edit code.
  • Click the theme.liquid layout file.
  • Paste the following code in the <head> section:

Make sure that you replace your-text with the correct keyword you want to exclude from indexing.

  • Click Save.

How to Hide Shopify Pages from Web Crawlers

To hide Shopify pages from web crawlers like Googlebot:

  • From your Shopify admin, go to Online Store > Themes.
  • Find the theme you want to edit, and then click Actions > Edit code.
  • Click the theme.liquid layout file.
  • Paste the following code in the <head> section:

Make sure that you replace current_tags with the correct tag you have already assigned to the pages you want to exclude from being crawled.

  • Click Save.

By doing the steps we have explained in detail above, by making the necessary arrangements for the robots.txt file in line with the needs of your own store, you will have the chance to rank higher in Google searches.

To learn more about how to edit the Shopify Robots.txt file, you can review the following pages;

https://help.shopify.com/tr/manual/promoting-marketing/seo/editing-robots-txt

https://help.shopify.com/tr/manual/promoting-marketing/seo/hide-a-page-from-search-engines

Daha iyi bir deneyim için çerezlerden yararlanıyoruz.