Skip to content

tapsum: shell script to summarize test errors. - #174

Closed
mk-pmb wants to merge 0 commit into
jfhbrook:masterfrom
mk-pmb:tapsum
Closed

mk-pmb wants to merge 0 commit into
jfhbrook:masterfrom
mk-pmb:tapsum

Conversation

@mk-pmb

@mk-pmb mk-pmb commented Dec 11, 2015

Copy link
Copy Markdown
Contributor

When I managed to clone the latest ecstatic, the timeout failure was gone, but a lot of other tests failed, so my first measure was to try and get an overview that was less verbose than tap, and to run selected tests instead of all at once.

Example summary generated by script:

________________________________________
· Subtest: test/304.js
    ! 1/3 failed in 304_not_modified
    ! 1/3 failed in 304_not_modified_weak
    ! 1/3 failed in 304_not_modified_strong_compare
    ! 2/3 failed in 304_not_modified_weak_compare
· Subtest: test/core.js
    ! 1/59 failed in core
· Subtest: test/express.js
    ! 1/68 failed in express
· Subtest: test/range.js
    ! 2/4 failed in range
    ! 2/4 failed in range past the end
    ! 2/3 failed in NaN range
    ! 2/3 failed in flipped range
    ! 3/5 failed in partial range
· Subtest: test/union.js
    ! 1/54 failed in union
· versions: nodejs v0.10.40, npm 1.4.28, Ubuntu 12.04.5 LTS (precise), git HEAD=9dfcb7d
-ERR 5

I wonder why it passed on travis with

Now using node v0.10.41 [… on …]
Description: Ubuntu 12.04.5 LTS

… what other versions should I compare/ should tapsum's report include?

@mk-pmb
mk-pmb force-pushed the tapsum branch 3 times, most recently from 9dfcb7d to 722895d Compare December 13, 2015 12:07
@mk-pmb

mk-pmb commented Dec 13, 2015

Copy link
Copy Markdown
Contributor Author

Update: All the errors in the example output were due to proxy settings. They and can be fixed with #175 .

@jfhbrook

Copy link
Copy Markdown
Owner

It might make sense for this to live in its own node module.

@mk-pmb

mk-pmb commented Dec 13, 2015

Copy link
Copy Markdown
Contributor Author

Indeed. I'll try to decouple it, then probably reduce this PR to the .gitignore.
Edit: Done, no changes required here.

@mk-pmb mk-pmb closed this Dec 19, 2015
@mk-pmb
mk-pmb deleted the tapsum branch December 20, 2015 09:18
@mk-pmb
mk-pmb restored the tapsum branch December 20, 2015 09:18
@mk-pmb

mk-pmb commented Oct 18, 2017

Copy link
Copy Markdown
Contributor Author

btw I finally published tapsum to npm.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants