How do I monitor thousands/millions of pages?

Even large, dynamic sites generally have a small set page templates.  A huge site like Amazon probably has less than 50 unique templates.   Generally, a template change will affect all the pages generated from that template.  For example, consider a site like Trulia which has a ‘homes for sale’ page for 35,000 cities.  The titles, H1s, rel-canonicals. redirect rules, etc, are are generally all impacted identically.   By managing a sample of these, we will catch problems  that impact all.

Of course, you might have individual optimization on some of these pages done via a CMS.  That’s no problem to add those URLs as well.   If it’s on a large scale,  you may want to consider our API.  The API pings us when a page is updated and queues it up for the next audit.  This works great for all your content initiatives.  We currently have a WordPress plugin too and will be implementing supports for other CMS’s as well in the near future.

---

← Faqs