Also, with watchdog you could test every revision. If you're afraid about abusing too much server CPU, it can run distributed. I think there is many people who would contribute part of their hardware I'd certainly be first one to do so
I does not run on website CPU, it runs on nightly build machine... (at my home).
Anyway, single run is about 3 hours, so it is unlikely to be possible to test each revision.