The WINE Regression Testing logo

This page contains: help about the Summary page and help about the build info page.

Summary page

The summary page shows an overview of all the test results. You can browse forward and back through the database using the navigation buttons.
go to latest result - return to the latest results. go to earliest result - move to earliest result.
go one page later - move one page later. go one page earlier - move one page earlier.
go one result later - move one build later. go one result earlier - move one build earlier.

The page consists of lines, each of which represents a collection of patches made to wine. The following information is displayed:
  • The date the CVS tree was updated. This links to complete information about this particular build and test.
  • A list of patches. These point to the relevant pages on the WineHQ site. Each link lists the details of a particular patch.
  • Whether the build succeeded or not. If the build fails, the results of running "configure" are shown in the build info page.
  • A summary of results from running the regression tests.
All tests are run under each platform in turn and the results are processed to see if the test succeeded or failed (columns S and F). These results are further sub-divided into tests that previously succeeded and previously failed (rows S' and F'). If any new tests were conducted, a extra row (headed with +) is shown. These numbers, along with column total, T, are shown under the platform's name in the table.

An extra column (headed -) is shown if any previously conducted tests were not tested with this build. These are further split into those tests that previously succeeded (S' row) and failed (F' row).

The cell contains a specific target platform for a given build can have six different background colours depending on whether regression errors were detected:

Redone or more regression errors have been introduced
Purple A new regression test has failed (failing tests are either wrong or should be marked "todo")
Orangethere are no new regression errors, but previous errors still exist.
Yellowall regression tests passed, but a previously failing tests have not been checked.
Dark Green all failing tests have been retested and passed.
Light Green no regression errors exist in this build.

Normally, all the cells should be a light green, but if a regression error is found the corresponding cell will be red. If the problem isn't fixed in the next build, then the cell will turn orange. It will stay orange until the problem is fixed. The cell will turn a strong green if the test now succeeds or yellow if the test isn't being checked anymore. After this, the cell will return to a light green.

If regression errors are known to exist, a link is provided that shows the output from that particular platform within the build information page.

Build information

The build information page shows all stored information about a particular build.

After the table of contents, the reference numbers for all applied patches are listed. Each reference number links to the log information for that particular patch.

The next section lists all altered files. Each listed file links to the relevant section of WineHQ's CVSWeb.

Next, the results of trying to build wine is listed. The output from make is listed (without the directory change messages). This includes any warning or error messages. If the build failed, then the results from running configure are also included.

After the build process, the results for each set of regression tests are shown, grouped by target platform. At the head of each group, a summary shows what fraction of the tests failed. Any failed tests are then listed with the corresponding error messages.


Page maintained by Paul Millar.
Please email me (paul@astro.gla.ac.uk) with any comments.

Valid HTML 4.01!