Re: [LTP] [ANNOUNCE] The Linux Test Project has been Released for June 2007,

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Randy Dunlap
Date: Monday, July 2, 2007 - 8:50 am

On Mon, 02 Jul 2007 12:28:50 +0530 Subrata Modak wrote:


I don't know if this qualifies as an input for the output, but
I use a script to parse the results file to compute a gross/overall
"SCORE" value.  Instead of looking at lines that contain
"termination_id" (e.g.:
duration=0 termination_type=exited termination_id=0 corefile=no
), I look at the test results output format messages and count
them (ignoring the INFO lines) and then compute a SCORE based on
all of those lines.  Obviously that's why I've been changing several
test cases to use the standard test results output format.

ltprun-summary.sh is attached.  It uses prtag2tag.pl, which is also
attached.  (I also do this summary SCORE for the Open Posix Test suite.)

Example summary + SCORE:

Using logfile=/cruc/runs/1789/test_output/ltp.log
build errors:  0 lines
PASS:          2225
WARNing:       1
BROKen:        1
RETiRed:       0
FAIL:          0
CONFig error:  11
SCORE.ltp:        99.5



so "[PATCH] float tests: use standard test results output"
(http://sourceforge.net/mailarchive/forum.php?thread_name=20070622214652.d137d055.rdunl...)
will be added next month?

---
~Randy
*** Remember to use Documentation/SubmitChecklist when testing your code ***
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: [LTP] [ANNOUNCE] The Linux Test Project has been Relea ..., Randy Dunlap, (Mon Jul 2, 8:50 am)
[LTP] Validating exact PASS and FAIL scenarios for LTP, Subrata Modak, (Tue Sep 18, 4:51 am)