983017 - Provide an alternate view to the tree that shows the individual tests that failed and why

Status: RESOLVED WONTFIX

(Tree Management Graveyard :: TBPL, defect)

Description

[(no longer active)]

Filing here because I don't know what's the right component.

Quoting Jesse in response to what prevents you get your job done?

"TBPL's job-oriented display hides what's really interesting: which individual tests failed, and how."

Can we please have something which lets us do this?

Comment 1

[Ed Morley [:emorley]]

I agree this would be useful - Jesse - any ideas as to how this view would look? A simple list of test failure lines from all jobs alongside the changeset list would work in the simple cases, but for many failures, or where the failures are very noisy/don't involve specific tests filenames, it might be hard to display these helpfully (eg at the moment the errors are just excerpts of stdout, we really need structured logging to de-duplication of mass-failures across several platforms).

Comment 2

[Jesse Ruderman]

Attachment: mockup for flaky-test display

Comment 3

[Jesse Ruderman]

When lots of tests fail, or there's a lot of output for one test, disclosure triangles may be the answer.

Comment 4

[Ed Morley [:emorley]]

Bug 1059770 is filed for Treeherder