I agree with this reasoning for compile-fail tests (for which composing and revising test-expectation comments can be laborious), but for UI tests (for which the expectation files are automatically generated, anyway), test authors have a reasonable expectation that the test output will be the same as when manually invoking rustc on the test file; discovering that this is not the case may be something of a rude surprise.
cc @alexcrichton
I agree with this reasoning for compile-fail tests (for which composing and revising test-expectation comments can be laborious), but for UI tests (for which the expectation files are automatically generated, anyway), test authors have a reasonable expectation that the test output will be the same as when manually invoking
rustcon the test file; discovering that this is not the case may be something of a rude surprise.cc @alexcrichton