VRTs — Visual Regression Tests

Description

VRTs — Visual Regression Tests is a plugin to test your website for unwanted visual changes. The plugin runs automatic daily tests for chosen pages and posts. The tool creates daily comparison screenshots and compares them with a reference snapshot. If there is a difference between the screenshots, you’ll be automatically notified via email. Use three comparison modes to spot the differences easily.

Please note: The website must be publicly accessible in order to set up and run the tests. Password protection or any kind of firewall might prevent the plugin from working correctly.

YOUR STRATEGY TO SPOT UNWANTED CHANGES

How do you usually check your website after updates and code changes? Do you go manually through all pages or do you just hope everything will run ok? Visual regression testing provides you a method that helps you find errors and visual abnormalities. The VRTs plugin gives you an environment to automate your process.

  1. Activate daily tests for any page or post: Upon activation, a reference screenshot is taken. This will be renewed when a post is saved or updated.
  2. Receive instant alerts: If a change is detected between the snapshot and the comparison screenshot, the plugin will create an alert and notify you via email. The daily test will be paused, until the alert is resolved.
  3. Compare two screenshots: Detect differences between the two snapshots with the difference, split screen or side-by-side view.
  4. Resolve tests: After fixing an issue, mark the alert as resolved. A new snapshot will be generated and the test will start running again.

USE CASES

In which cases can visual regression testing help you spot issues?

  • Plugin and core software updates
  • Manual code changes
  • External software and API issues
  • Server issues
  • Malware and other malicious code
  • Missing quality assurance

FEATURES

  • Instant first test: After plugin activation, the homepage is immediately monitored and alerts are sent to the stored admin email.
  • Daily Tests: The plugin automatically scans selected posts and pages daily. It validates the visual content by comparing two screenshots.
  • 3 comparison modi: Choose between three ways to compare snapshots — Difference, Split, Side-by-Side view.
  • Instant alerts: As soon as a change is detected between the snapshot and the comparison screenshot, you will be notified via email.
  • GDPR compliant: Snapshots are stored on European servers. We do not collect any personal data.
  • Cross-team: Team members with admin rights can create and view tests and work together on the immediate solution.

FREE FOREVER

  • Test up to 3 pages
  • Daily testing interval
  • 30 days alert history

GO PRO

Do you like VRTs and want to run more tests? Unlock more features with VRTs Pro:

  • Test up to 25 pages
  • Daily testing interval
  • 90 days alert history
  • Multiple alert recipients
  • E-mail support

BUG-REPORT

You found a bug? Please report it by creating an issue on the support forum.

READ MORE

You want to learn more about VRTs?

Official product page:

VRTs – Visual Regression Tests

Resources:

How does visual regression testing work?

Screenshots

  • Start a test by toggling on Run Tests in the sidebar of your WordPress page or post.
  • Get an overview of all running and paused tests.
  • Get an overview of your alerts. Review and resolve them one by one.
  • The difference view merges the reference snapshot and the newly created screenshot. Differences between them are highlighted in red.
  • In the split view you can compare two snapshots with a vertical slider.
  • The side by side view displays two snapshots next to each other.

Installation

INSTALL VRTS WITHIN WORDPRESS

(recommended)

  1. Open Plugins > Add new
  2. Search for Visual Regression Tests
  3. Click install and activate the plugin

INSTALL VRTS MANUALLY THROUGH FTP

  1. Download the plugin on the WordPress plugin page
  2. Upload the ‘visual-regression-tests’ folder to the /wp-content/plugins/ directory
  3. Activate the VRTs plugin through the ‘Plugins’ menu in WordPress

AFTER ACTIVATION

  • By default: The homepage is immediately monitored and alerts are sent to the stored admin email.
  • Open the settings to configure who should receive alerts.
  • Open a page or post to activate more tests.

UPGRADE TO VRTS PRO

  1. Open VRTs > Upgrade
  2. Click Buy Pro
  3. Enter license key you have received after purchasing the plugin

FAQ

What is Visual Regression Testing?

With visual regression testing, you can detect errors and unwanted changes on your website by comparing a previous state of the website with a more recent one. For example, errors in the frontend can be caused by plugin updates and changes. For small websites, you may be able to find them right away, but for complex websites, it becomes difficult. A tool can help by taking pictures of pages and posts to detect visual changes and inform you automatically.

How does visual regression testing work?

Tests can be done manually, pixel-by-pixel, DOM-based or AI-based. In all cases you compare an earlier website state with a newer website state. Our Visual Regression Tests Plugin takes periodical screenshots and compares them on a split screen.

Why should I use a tool for visual regression tests?

You can do visual testing either manually or with automated tools. Checking your website for errors manually is time-consuming and less accurate. Automated tests may find errors that are minimal and irrelevant. But the chance of finding critical errors is much higher with a tool. As soon as you discover an error, you’ll receive a warning so that you can fix the problem as soon as possible.

Is the testing done on my server?

Screenshots and comparisons are performed on an external server and sent to your WordPress website. Only required meta data is stored in your database.

Does the plugin work with cookie consent banners?

Yes, cookie banners are not an issue. Before taking a snapshot, the tool can automatically trigger the Accept button to hide the banner. This option can be configured with CSS selectors in the plugin settings.

Reviews

Դեկտեմբերի 15, 2022
DISCLAIMER: Yes I work for the company, but I have worked for many companies and I never recommended a product which I was not convinced of. And because I still have 30+ years until retirement, the time for me to move on will come and I don't want to undermine my credibility and come in a situation where they tell me in my new company "So, you recommended this tool, it was horrible!"And I also work in support, so the last thing I want is to have for example our clients install a tool that brings me headache. Considering all this, I can only recommend this tool. It makes monitoring a website so much easier and I already don't want to work without it anymore.But don't believe my words, test it yourself and you will see what I mean. 
Դեկտեմբերի 5, 2022 2 replies
tja. right now we can't do anything with the plugin : the "add new" test button is disabled. i have tested and verified this on several wordpress installs with various sets of install plugins - including a fresh clean install. the only published version of this plugin right now is 1.0.0 which leads me to think that the four previous reviews are probably fake. one of them even has the author company name in its nickname (mykolableech) another one has only one other plugin review, and that is on another bleech plugin (skil3e) the other two reviews are by very recent accounts : both created just before posting the review. come on guys, this plugin has very promising features and huge potential. the product page on your website is very exciting. i have been waiting for the release for a long time... i even had a pagescreen monitor on your website to make sure i didn't miss it ! (such irony) you can do better than this ! i'll edit this review if anything changes.
Դեկտեմբերի 7, 2022
Very easy to use plugin to monitor your website for visual bugs. Disclaimer: I work at the company who built this.
Դեկտեմբերի 6, 2022
It's very convenient to track visual bugs or editor's errors and prevent them from getting to the production site. Disclaimer: I work at the company that built this plugin and we use it for our clients websites, it does its job well.
Դեկտեմբերի 6, 2022
A perfect tool if you want to make sure you don't get inconsistencies between deployments. Perfect for websites with lots of content. Disclaimer: I work at the company who built this.
Read all 5 reviews

Contributors & Developers

“VRTs — Visual Regression Tests” is open source software. The following people have contributed to this plugin.

Contributors

Changelog

1.2.3

  • Fixed tests and alerts search

1.2.2

  • Fixed url verification for sites using the WPML plugin

1.2.1

  • Fixed url validation on plugin update

1.2

  • Fixed license validations and notifications
  • Fixed alert pixel count
  • Fixed alert view metabox pixel count
  • Fixed status codes for admin ajax
  • Added notification messages if site is moved
  • Added notification inside metabox when service is not available
  • Improved license handling when license is added / removed
  • Improved data removal on plugin uninstall
  • Improved notifications logic inside metabox
  • Minor UI/UX adjustments and improvements

1.1

  • Fixed an issue with the add new test modal in specific cases
  • Fixed notification email site url
  • Added admin-ajax fallback functionality
  • Added messages for error when connecting to external service
  • Improved plugin deactivation & activation
  • Improved test deletion
  • General UI/UX adjustments and improvements

1.0

  • Initial Release