1. Home
  2. Index & Crawl Optimizer
  3. About this extension

About this extension

The Index and Crawl Optimizer extension for OpenCart allows store administrators to define and manage meta robots rules easily. This extension is a comprehensive SEO tool that empowers you to optimize how search engines index and crawl your website. It is compatible with core OpenCart pages and extends functionality for Journal3 blog users.


Features of Index and Crawl Optimizer

  1. Set Meta Robots Rules for Key Pages:
    • Product Pages
    • Category Pages
    • Manufacturer Pages
    • Information Pages
    • Special/Offer Pages
    • Search Pages
    • Tag Pages
  2. Automatic Handling for Empty Pages:
    • Automatically applies noindex, nofollow to pages without items, such as:
      • Empty Product Pages
      • Empty Category Pages
      • Empty Manufacturer Pages
  3. Support for Journal3 Blog (for Journal3 Template Users):
    • Integrates seamlessly with Journal3 blog pages, allowing meta robots rules for blog pages.
  4. Manage Meta Robots for Special Routes:
    • Preconfigured routes with default settings, including:
      • Login Page
      • Register Page
      • Cart Page
      • Checkout Page
      • Affiliate Login/Register Page
      • Gift Voucher Page
      • Contact Page
  5. Customizable Settings:
    • Add custom routes and set meta robots tags (index, noindex, follow, nofollow) as per your requirements.
    • Modify or delete routes directly from the admin panel.
  6. Default Settings After Installation:
    • Default meta robots rules are set upon installation, making it easier to start without manual configuration.

Purpose of the Extension

Search engine optimization (SEO) is essential for improving your store’s visibility and rankings. With the Index and Crawl Optimizer, you can:

  • Avoid indexing low-value pages (like login or cart pages) that can dilute your site’s overall SEO performance.
  • Prevent duplicate content issues by managing robots rules effectively for tags, search results, and other dynamic pages.
  • Enhance the crawling efficiency of search engines, ensuring they focus on high-priority pages.

How to Use the Extension

  1. Installation:
    • Install the extension via the OpenCart admin panel.
    • Once installed, default meta robots rules will automatically be applied.
  2. Access the Settings:
    • Navigate to Extensions > Index and Crawl Optimizer in your OpenCart admin panel.
  3. Default Routes Management:
    • View a pre-configured list of routes with default meta robots rules.
    • Modify the rules for each route if needed.
  4. Add Custom Routes:
    • Add additional custom routes from the admin panel.
    • Assign meta robots rules (index, follow, noindex, nofollow, etc.) for each custom route.
  5. Delete Unused Routes:
    • Remove unwanted routes from the list to keep the configuration clean and focused.
  6. Save and Apply:
    • Save your changes to apply them immediately.

Benefits

  • Improved SEO: Ensures only high-value pages are indexed, enhancing your store’s search engine rankings.
  • Time-Saving: Easily configure robots rules from the admin panel without requiring coding knowledge.
  • Better Crawl Efficiency: Helps search engines prioritize important pages, reducing crawl budget wastage.
  • Enhanced User Experience: Removes unnecessary pages from search results, directing users to relevant content.
  • Customizable: Flexibility to handle specific needs with custom route configuration.

Default Settings on Installation

When you install the Index and Crawl Optimizer, the following meta robots rules are applied by default:

Page/RouteDefault Meta Robots
Product Pagesindex, follow
Category Pagesindex, follow
Manufacturer Pagesindex, follow
Information Pagesindex, follow
Special/Offer Pagesindex, follow
Search Pagesnoindex, follow
Tag Pagesindex, follow
Empty Pages (Products, etc.)noindex, nofollow
Login/Register Pagesnoindex, nofollow
Cart Pagenoindex, nofollow
Checkout Pagenoindex, nofollow
Affiliate Pagesnoindex, nofollow
Gift Voucher Pagenoindex, nofollow
Contact Pagenoindex, nofollow

Advanced Features for Journal3 Blog Users

For stores using the Journal3 template, this extension allows you to manage meta robots tags for Journal3 blog pages, ensuring blog content aligns with your SEO strategy.


Use Cases

  1. SEO Optimization:
    • Prevent search engines from indexing irrelevant pages like login or cart pages.
  2. Efficient Crawling:
    • Direct search engines to focus on high-value content like product or category pages.
  3. Custom Scenarios:
    • Add meta robots rules to custom pages like promotional landing pages or specific user-generated routes.
Was this article helpful to you? Yes No

How can we help?