[Varnish] #1199: c00045.vtc may fail intermittently depending on compiler and optimization

[Varnish]

#1199: c00045.vtc may fail intermittently depending on compiler and optimization
-------------------------+-------------------------
 Reporter:  mi           |       Owner:
     Type:  defect       |      Status:  closed
 Priority:  normal       |   Milestone:
Component:  varnishtest  |     Version:  3.0.3
 Severity:  minor        |  Resolution:  worksforme
 Keywords:               |
-------------------------+-------------------------
Changes (by phk):

 * status:  new => closed
 * resolution:   => worksforme


Comment:

 Make check is not a 100% deterministic test, and making it 100%
 deterministic is often a very tedious and time-consuming affair.

 In general I do not think that "make check" should be part of automated
 package building, but rather part of the manual QA process of the built
 packages.

 Maybe what we need is a version of "make check" which accepts a trivial
 number of failures, simply to cope with the non-determinism inherent in
 the tests execution ?

 Either way, I'm closing this ticket, as it is not actionable in any way I
 can see.

 If you see very high failure frequencies on specific tests, please let us
 know, and we will try to stabilize those, so we get high success rates
 from "make check", just don't expect us to reach 100%.

-- 
Ticket URL: <https://www.varnish-cache.org/trac/ticket/1199#comment:3>
Varnish <https://varnish-cache.org/>
The Varnish HTTP Accelerator