History | Log In     View a printable version of the current page. Get help!  
Issue Details (XML | Word)

Key: WT-379
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Assignee: Marc Guillemot
Reporter: Andrew Ryan
Votes: 1
Watchers: 2
Operations

If you were logged in you would be able to see more operations.
WebTest

Order of tests in report summary doesn't match run order

Created: 18/Jan/08 21:46:53   Updated: 21/Jan/08 16:39:40
Affects Version/s: None
Fix Version/s: 2.6

Environment: 2 different JVM's on AMD-64

java version "1.5.0_08"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_08-b03)
Java HotSpot(TM) 64-Bit Server VM (build 1.5.0_08-b03, mixed mode)

java version "1.6.0_03"
Java(TM) SE Runtime Environment (build 1.6.0_03-b05)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_03-b05, mixed mode)


 Description   
When I execute my webtests, I get a directory with the tests in the order I requested them to run, labeled sequentially "001_DoSomething, 002_DoAnother, 003_MoreTests...". But in the report that gets created at the end of the test run, it seems that the order of the results is somewhat random. Is there any way to insure that the order of the generated report list matches the order that the reports ran in? This would make the reports a lot easier to parse, since sometimes a failure in an early test can impact a later test, and when the order is scattered, this makes it hard to spot those situations.

Marc G. said:
ups!
In fact I never noticed it before: the code producing the overview report wrongly relies on the default order of File.eachDir. This worked just find for me wit different Java runtime but as you noticed, this is not safe.

Can you open an issue for that?


 All   Comments   Change History      Sort Order:
Comment by Marc Guillemot [21/Jan/08 08:58:45]
This should be fixed in build 1650.

Can you check to confirm?
(as I my java runtime behave differently, I couldn't reproduce the problem)

Comment by Andrew Ryan [21/Jan/08 16:39:40]
Verified FIXED in build 1651. Thanks!