Turbify automatically adds a robots.txt file to the root directory of your domain (e.g., https://www.learn2yoga.com/robots.txt) for pages built using Store Editor. This file outlines all of the directories that shouldn't be crawled by search engines. On the Search Engines page in Store Manager, you can add additional information to the file directly. Note: You cannot change the default information.

If you're using the Web Hosting portion of your account to build pages, you can add a robots.txt file to the File Manager.

Jump to:

• Create a robots.txt file for Merchant Solutions
• Create a robots.txt file for Web Hosting

Create a robots.txt file for Merchant Solutions

1. Sign in to your My Services page.
2. Click the Store link.
   
3. Go to Search Engines.
   
4. In the field under Update your robots.txt Exclusion File, edit the file as needed.
   
5. When finished, click the Done button.
   Note: There is no need to publish your store. The file will automatically be publish after clicking the Done button.
   

Create a robots.txt file for Web Hosting

1. Sign in to your My Services page.
2. Click the Web Hosting link.
   
3. Click the File Manager link in the Files module. A new browser window opens to the File Manager. 
   
4. Select the public_html directory in the left column. Learn more about public_html and the File Manager here.
   
5. Click the File link. 
   
6. Enter robots.txt in the New File Name field and click the Create New File button. Note: Make sure to include the .txt extension. 
   
7. Your robots.txt file is now created in the right column. 
   

Alternatively, you can use an FTP client to upload your robots.txt file to the File Manager. Learn more about FTP.