CSS regression tool? [closed]

Question

I'm looking for a visual regression testing tool for CSS refactoring and see whether or not there are any unintended cascading behavior in a website.

Ideally, the tool that can crawl a website (even locally) and grab snapshots of each page and store it in a single repository.

When run for the second time, it will show the pages that are visually different since the last time it was run.

Even better:

1. if it can show the overlapper XOR view of the 2 version of the page.
2. compare rendering results of different browsers (almost like an automated Microsoft Expression Web compare feature).

Cnemis

Answer 1

Check out Litmus.

It'll crawl your site and take screen captures has damn near every browser you'd want.

In addition to the core functionality Litmus also allows you to to track bugs, log in to private sites, and allows you to publish compatibility reports from your tests.

Hypnology

It seems it have the issues that Browser Shots have (site have to be online, and no crawler). But seems extensible enough with API support. will look at it. Thanks – Cnemis

Litmus has since pivoted to test HTML emails rather than websites/webpages. – Assurance

Answer 2

My current favorite is WebDriverCSS in combination with BrowserStack Automate API. This pair of tools allows for multi-platform, multi-browser regression testing across the very wide range of devices that BrowserStack supports. It requires writing code but is much more comprehensive than any solution bound to Phantom or Slimer.

If you are ok with an old WebKit being your only test UA, here's a great writeup on CSS regression testing using PhantomCSS. Their basic example provides exactly what the original question desired: visual diffs between two commits.

For a simpler tool that requires no coding (only YAML config), I point people towards Wraith more often than PhantomCSS. Give @ericcraio's answer a vote if you like Wraith and don't want to write Casper code.

Chancellery

Answer 3

I know this question has been posted for awhile but I wanted to mention about a new CSS regression tool called wraith by bbc-news.

http://github.com/bbc-news/wraith

It utilizes tools such as phantomJS and imagemagick.

http://responsivenews.co.uk/post/56884056177/wraith

Systaltic

Answer 4

Check out Browser Shots. This is a free service.

There are some restrictions on how many tests you can run each day as a free user. But unlike Litmus; you can run tests on all supported browsers--Litmus only allows free users to test their websites on Internet Explorer 7 and Mozilla Firefox 2.

Ogdan

It seems that Browser Shots is having some technical difficulties at the moment. I've used the service myself for about a year, and this is the first time I've encountered any problems. – Ogdan

It seems to be up again now. The issues I have with it are: 1. the site that I want to check has to be up online 2. it doesnt have a crawler built in. The 2nd point I can deal with, whereas the 1st one is a deal breaker. Thanks for the response though. still good to know, but just not applicable in my situation. – Cnemis

Answer 5

I am developing a CSS regression testing tool which is called SUCCSS, it is a npm global, open source: https://github.com/B2F/Succss. Atm, you can read its full documentation there: http://succss.ifzenelse.net

Oballa

Answer 6

What you've described is precisely what Mogotest does. We can log into your site, take screenshots for all the pages you've configured, and do automated comparison using the principles of Web Consistency Testing.

We also keep a full track of history so we can tell you exactly when something broke (and what your site looked at that time) and even cooler, we can detect when you've fixed something. And finally, we snapshot your code at each test run so we can show you exactly what changed for each issue.

Sorry for the self-promoting nature of this answer. I just wanted to be thorough in addressing what you're looking for.

Corn

Mogotest has unfortunately since gone out of business. – Assurance

Unfortunately, I did end up shutting down Mogotest. I made a lot of the code available at bitbucket.org/mogotest and the Web Consistency Testing site is still available (information is still quite relevant). – Corn