How we test website change monitoring tools

Every tool gets the same test. We pay for it, use it for a month, and report what happened with screenshots.

Hands-on test in progress

One paid month per tool

We buy one month of each tool on a self-serve plan, the way any customer would. We do not ask vendors for free accounts or special treatment, and vendors do not see reviews before they go live. If a tool has no monthly plan, we will say what we bought.

The same test pages for every tool

We run a fixed set of test pages that we control, so we know exactly when and what we changed. The set covers:

• A plain text page where we edit a sentence.
• A price on a product style page.
• A small change inside a long page.
• An image swap with no text change.
• A page with a rotating banner, a date and a counter that change on every load (noise).
• A page that needs JavaScript to render its content.
• A PDF that we replace with a new version.

We also watch a few real public pages, such as pricing pages and job boards, to see how each tool behaves on sites it does not control.

What we measure

• Alert speed. Time from our change to the alert arriving, at the fastest interval the plan allows.
• Accuracy. Whether each real change is caught, and whether the alert shows the right thing.
• Noise. How many alerts fire for changes that do not matter, before and after using the tool's filters.
• Visual and text diff. How the tool shows what changed: screenshots, highlighted text, HTML, or an AI summary.
• Setup. How long it takes to add a page, pick an area, and handle logins or clicks.
• Pricing value. What the plan costs for a typical volume of pages and checks.

Screenshots

Every review will include our own screenshots from the test account: setup, alerts and change views. We do not use vendor marketing images to show results.

Facts before results

Until a test is done, review pages show only facts from the vendor's official site, with the date we checked and a link to the source. We add results only after the test month ends.

Corrections

If a fact on this site is wrong or out of date, we fix it and update the checked date.