Storefront Knowledge Base
  • 👋Welcome to Storefront
  • Getting Started
    • 🛠️Quick Start Guide
  • Features
    • Dashboard
    • Sales
      • Orders
        • Create an Order
        • Edit An Order
        • Order Payments
        • Order Fulfilments
      • Enquiries
      • Coupons
      • Gift Cards
      • Wallets
    • Catalogue
      • Categories
      • Brands
      • Families
      • Products
        • Goods Products
          • Goods Product Details
        • Coupons
        • Gift Voucher
      • Coupons
      • Inventory
      • Vendors
      • Branding
      • Attributes
      • Badges
      • Sorting
      • Product Reviews
    • Customers
      • Consumers
      • Companies
      • Customer Groups
    • Promotions
      • Promo Codes
      • Discounts
      • Bulk Discounts
      • Multi-Buys
    • Marketing
      • Mailing List
      • Affiliates
      • Announcements
      • Messages
    • Reports
    • Stores
      • Home
      • Content
        • Pages
        • Blogs
        • News
        • Zones
      • Navigation
      • Store Price Lists
        • Markup Manager
      • Shipping
        • Free Shipping
        • Collection
        • Fixed Shipping
        • Local Delivery
      • Payments
        • Terms
        • EFT
        • Third Party Payment Merchants
      • Themes
        • Look and Feel
        • Styles
        • Scripts
      • Store Settings
        • Store Details
          • Store Name
          • Tax
          • Logo and Favicon
        • Tracking & Analytics
          • Facebook Pixel
          • Google Analytics
        • Sign-up
          • Login Methods
          • Sign-Up Settings
          • Individual Form Fields
          • Corporate Form Fields
          • Login
        • SEO
          • Google Webmaster Tools
          • Robots.txt
          • Sitemap.xml
        • Checkout
          • Customer Accounts
          • Abandoned Cart
          • Email Marketing
          • Google Maps
          • Wallet
        • Security & Privacy
          • Password Lock
          • Google reCAPTCHA
        • Notifications
          • Merchant Emails
          • Customer Emails
          • Email From/Reply To
        • Catalogue
          • Filter Search
          • Product Filters
          • Product Display
          • Gift Registries
          • Wishlists
          • Product Reviews
          • Product Comparison
    • System
      • Email
      • Import
      • Export
      • Bulk Pictures
        • Formatting Images For Bulk Upload
      • Inventory Locations
      • Users & Permissions
  • Storefront
    • 🚀Roadmap
      • Storefront Platform Upgrade – .NET 8
      • From SQL to Solr – A Smarter Search Experience
      • From Static Templates to Liquid Themes – A Customisable Storefront Experience
  • Information
    • 📌Announcements
  • 📝Release Notes
    • ✨New Features
      • May 2025 New Features
        • Stock Display Options
        • Shop the Look Content Part
    • 🛠️Enhancements
      • May 2025 Enhancements
        • Improved Mobile Tap Target Sizing
        • Filter URL Crawling Issue (Mitigation Applied)
        • Splash Page SEO Content
        • Blog and News Page SEO Content
  • 🧩Apps
Powered by GitBook
On this page
  1. Release Notes
  2. Enhancements
  3. May 2025 Enhancements

Filter URL Crawling Issue (Mitigation Applied)

Known Issue:

Automated bots have been crawling filter URLs, especially where multi-select filters are in use. This has resulted in an excessive number of requests and unnecessary server load.

What we’ve done:

We’ve replaced the href attributes on filter <a> tags with a custom data-filter attribute.

  • A jQuery event now listens for user interaction and manually redirects to the selected filter.

  • This approach reduces the exposure of filter URLs to basic web scrapers and mitigates request overload.

Note:

This does not prevent advanced bots that simulate a browser and interact with the page (e.g. headless browsers), but it significantly reduces the impact of standard link crawlers.

PreviousImproved Mobile Tap Target SizingNextSplash Page SEO Content

Last updated 15 days ago

📝
🛠️