CSE331 Problem Set 3: Cross-Checker Results

Contents:

Statistics
Coder-vs-Tester tabular results
Per-student test suite details

Statistics

Ranks are assigned by first running each test suite against known-correct solutions in order to identify incorrect tests. With incorrect tests eliminated, each test suite is run against all other students' code and ranked according to how many bugs it finds. Test suites with no incorrect tests rank first, followed by test suites with some number of incorrect tests.

Student cross-checking rank	Points earned (out of 15)		% incorrect tests		bugs found in fellow students' code (%)	% fellow students whose correct tests found bugs in this code
Staff			all tests correct		found bugs in 59%	0%
1. PAL-GIN	15	points	all tests correct		found bugs in 50%	0%
2. NODE-BANG	14	points	all tests correct		found bugs in 47%	0%
3b. SEEK-HIDE	13	points	all tests correct		found bugs in 44%	0%
3a. HAS-DAWN	13	points	all tests correct		found bugs in 44%	0%
3c. MIST-BARD	13	points	all tests correct		found bugs in 44%	0%
4b. NIB-ADEN	12	points	all tests correct		found bugs in 41%	0%
4e. RIG-TURF	12	points	all tests correct		found bugs in 41%	0%
4f. FED-TUBA	12	points	all tests correct		found bugs in 41%	0%
4c. FUND-LA	12	points	all tests correct		found bugs in 41%	16%
4a. MOT-DIAL	12	points	all tests correct		found bugs in 41%	16%
4d. HEED-AJAR	12	points	all tests correct		found bugs in 41%	41%
5a. HIGH-ABET	11	points	all tests correct		found bugs in 34%	0%
5b. GETS-FORD	11	points	all tests correct		found bugs in 34%	0%
6. SUB-SHAY	10	points	all tests correct		found bugs in 31%	53%
7a. RING-DOUG	9	points	40%	bad tests	found bugs in 47%	41%
7b. BATE-MUM	9	points	all tests correct		found bugs in 28%	53%
8b. CHAD-SALT	8	points	67%	bad tests	found bugs in 44%	9%
8c. SKIM-FORT	8	points	14%	bad tests	found bugs in 44%	0%
8a. GOAT-DANK	8	points	all tests correct		found bugs in 19%	75%
9. BAH-BLOW	6	points	43%	bad tests	found bugs in 34%	0%
10b. FIR-CURL	5	points	50%	bad tests	found bugs in 31%	0%
10a. SLOB-SHIM	5	points	67%	bad tests	found bugs in 31%	0%
11. DEAF-CON	3	points	67%	bad tests	found bugs in 19%	78%
12. CLAM-SLAY	2	points	50%	bad tests	found bugs in 16%	6%
13. WIND-LA	1	points	50%	bad tests	found bugs in 12%	78%
14a. SANG-BARK	0	points	100%	bad tests	found bugs in 0%	25%
14c. ROE-AHOY	0	points	100%	bad tests	found bugs in 0%	66%
14e. SEE-QUOD	0	points	100%	bad tests	found bugs in 0%	72%
14f. COED-OLIN	0	points	43%	bad tests	found bugs in 0%	78%
14b. ALAN-HARK	0	points	100%	bad tests	found bugs in 0%	66%
14d. HEED-SELL	0	points	100%	bad tests	found bugs in 0%	72%
14g. LESK-NOAH	0	points	100%	bad tests	found bugs in 0%	53%

Coder-vs-Tester tabular results

Ranks in the column headings (labeled "CODERS") are colored red if the indicated student has failed some staff tests. Ranks in the row headings (labeled "TESTERS") are colored red if the indicated student had some incorrect tests (ie, tests which failed when run on the staff solutions).

A red X in a grid box indicates that at least one of the correct tests in the TESTER's test suite had some failures when running against the implementation of the CODER: this could indicate either a faulty test or faulty code.

		CODERS
T E S T E R S		1	2	3b	3a	3c	4b	4e	4f	4c	4a	4d	5a	5b	6	7a	7b	8b	8c	8a	9	10b	10a	11	12	13	14a	14c	14e	14f	14b	14d	14g
	1									X	X	X			X	X	X	X		X				X		X		X	X	X	X	X	X
	2											X			X	X	X	X		X				X		X	X	X	X	X	X	X	X
	3b											X			X	X	X			X				X		X	X	X	X	X	X	X	X
	3a											X			X	X	X			X				X		X	X	X	X	X	X	X	X
	3c									X	X				X		X	X		X				X		X		X	X	X	X	X	X
	4b											X			X	X	X			X				X		X		X	X	X	X	X	X
	4e									X	X				X		X			X				X		X		X	X	X	X	X	X
	4f									X	X				X		X			X				X		X		X	X	X	X	X	X
	4c											X			X	X	X			X				X		X		X	X	X	X	X	X
	4a											X			X	X	X			X				X		X		X	X	X	X	X	X
	4d														X		X			X				X	X	X	X	X	X	X	X	X	X
	5a											X				X				X				X		X	X	X	X	X	X	X
	5b														X		X			X				X		X		X	X	X	X	X	X
	6											X				X				X				X		X		X	X	X	X	X
	7a									X	X				X		X			X				X	X	X	X	X	X	X	X	X	X
	7b											X				X				X				X		X		X	X	X		X
	8b											X			X	X	X			X				X		X	X	X	X	X	X	X	X
	8c											X			X	X	X			X				X		X	X	X	X	X	X	X	X
	8a																							X		X			X	X	X	X
	9														X		X			X				X		X		X	X	X	X	X	X
	10b														X		X			X				X		X		X	X	X		X	X
	10a											X				X				X				X		X		X	X	X	X	X
	11																			X				X		X			X	X		X
	12																			X				X		X				X	X
	13																			X				X		X				X
	14a
	14c
	14e
	14f
	14b
	14d
	14g

Per-student test suite details

Test suite of ALAN-HARK (rank 14b)

Correct Tests

No correct tests

Incorrect Tests

p3tests(ps3.test.ScriptFileTests)
p7paths(ps3.test.ScriptFileTests)

Test suite of BAH-BLOW (rank 9)

Correct Tests

ps3Example1(ps3.test.ScriptFileTests): 10 students failed this test
ps3Example2(ps3.test.ScriptFileTests): 10 students failed this test
ps7SimplePath(ps3.test.ScriptFileTests): 15 students failed this test (5 failed no other test in this suite)
ps7testBoundaryProperties(ps3.test.ScriptFileTests): 9 students failed this test

Incorrect Tests

ps3TestExistence(ps3.test.ScriptFileTests)
ps3testDuplicate(ps3.test.ScriptFileTests)
ps7ComplexTest(ps3.test.ScriptFileTests)

Test suite of BATE-MUM (rank 7b)

Correct Tests

p3Test1(ps3.test.ScriptFileTests): 4 students failed this test
p3Test2(ps3.test.ScriptFileTests): 5 students failed this test
p7Test1(ps3.test.ScriptFileTests): 14 students failed this test
p7Test2(ps3.test.ScriptFileTests): 15 students failed this test (1 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of CHAD-SALT (rank 8b)

Correct Tests

TestFindPath(ps3.test.ScriptFileTests): 20 students failed this test (20 failed no other test in this suite)

Incorrect Tests

TestAddEdge(ps3.test.ScriptFileTests)
TestAddNode(ps3.test.ScriptFileTests)

Test suite of CLAM-SLAY (rank 12)

Correct Tests

p3AddTest(ps3.test.ScriptFileTests): 8 students failed this test (3 failed no other test in this suite)
p3EdgeTest(ps3.test.ScriptFileTests): 5 students failed this test

Incorrect Tests

p3ExceptionTest(ps3.test.ScriptFileTests)
p7FindPathTest(ps3.test.ScriptFileTests)

Test suite of COED-OLIN (rank 14f)

Correct Tests

p3TestAddEdge(ps3.test.ScriptFileTests): 1 students failed this test
p3TestAddNode(ps3.test.ScriptFileTests): 1 students failed this test
p3TestCreateGraph(ps3.test.ScriptFileTests): 1 students failed this test
p3TestCreateNode(ps3.test.ScriptFileTests): 1 students failed this test

Incorrect Tests

p3TestListChildren(ps3.test.ScriptFileTests)
p3TestListNodes(ps3.test.ScriptFileTests)
p7TestPathFinder(ps3.test.ScriptFileTests)

Test suite of DEAF-CON (rank 11)

Correct Tests

p7OneNode(ps3.test.ScriptFileTests): 9 students failed this test (9 failed no other test in this suite)

Incorrect Tests

p3TestAddEdge(ps3.test.ScriptFileTests)
p3TestAddNode(ps3.test.ScriptFileTests)

Test suite of FED-TUBA (rank 4f)

Correct Tests

p3TestCreation(ps3.test.ScriptFileTests): 1 students failed this test
p3TestEdges(ps3.test.ScriptFileTests): 9 students failed this test
p3TestMultPaths(ps3.test.ScriptFileTests): 12 students failed this test (1 failed no other test in this suite)
p3TestNoPath(ps3.test.ScriptFileTests): 13 students failed this test (6 failed no other test in this suite)
p3TestNodes(ps3.test.ScriptFileTests): 8 students failed this test
p3TestOnePath(ps3.test.ScriptFileTests): 10 students failed this test

Incorrect Tests

No incorrect tests

Test suite of FIR-CURL (rank 10b)

Correct Tests

p7TestFindPath(ps3.test.ScriptFileTests): 15 students failed this test (15 failed no other test in this suite)

Incorrect Tests

p3TestAdd(ps3.test.ScriptFileTests)

Test suite of FUND-LA (rank 4c)

Correct Tests

p3TestAdd(ps3.test.ScriptFileTests): 1 students failed this test
p3TestList(ps3.test.ScriptFileTests): 7 students failed this test (1 failed no other test in this suite)
p7TestPath(ps3.test.ScriptFileTests): 17 students failed this test (11 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of GETS-FORD (rank 5b)

Correct Tests

p3TestFindPath(ps3.test.ScriptFileTests): 15 students failed this test (7 failed no other test in this suite)
p3TestListChildren(ps3.test.ScriptFileTests): 9 students failed this test
p3TestListNodes(ps3.test.ScriptFileTests): 8 students failed this test

Incorrect Tests

No incorrect tests

Test suite of GOAT-DANK (rank 8a)

Correct Tests

p3TestGraph(ps3.test.ScriptFileTests): 8 students failed this test (1 failed no other test in this suite)
p7TestPath(ps3.test.ScriptFileTests): 10 students failed this test (3 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of HAS-DAWN (rank 3a)

Correct Tests

p3TestAdd(ps3.test.ScriptFileTests): 7 students failed this test
p3TestAddEdge(ps3.test.ScriptFileTests): 6 students failed this test
p7TestFindPath(ps3.test.ScriptFileTests): 19 students failed this test (11 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of HEED-AJAR (rank 4d)

Correct Tests

p3Tests(ps3.test.ScriptFileTests): 9 students failed this test
p7Tests(ps3.test.ScriptFileTests): 19 students failed this test (10 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of HEED-SELL (rank 14d)

Correct Tests

No correct tests

Incorrect Tests

p3TestAdd(ps3.test.ScriptFileTests)
p3TestConstructors(ps3.test.ScriptFileTests)
p3TestList(ps3.test.ScriptFileTests)
p7TestFindPath(ps3.test.ScriptFileTests)

Test suite of HIGH-ABET (rank 5a)

Correct Tests

ps3testAddEdge(ps3.test.ScriptFileTests): 7 students failed this test
ps3testAddNode(ps3.test.ScriptFileTests): 3 students failed this test
ps7testFindPath(ps3.test.ScriptFileTests): 14 students failed this test (3 failed no other test in this suite)
ps7testFindPath2(ps3.test.ScriptFileTests): 13 students failed this test (1 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of LESK-NOAH (rank 14g)

Correct Tests

No correct tests

Incorrect Tests

ps3TestBasic(ps3.test.ScriptFileTests)
ps7Tests(ps3.test.ScriptFileTests)

Test suite of MIST-BARD (rank 3c)

Correct Tests

p3TestAdd(ps3.test.ScriptFileTests): 4 students failed this test
p3TestConnectParentWithChild(ps3.test.ScriptFileTests): 2 students failed this test
p3TestFindPath(ps3.test.ScriptFileTests): 16 students failed this test
p3TestFindPathOverlappedStartEnd(ps3.test.ScriptFileTests): 13 students failed this test
p3TestFindPathSeparateStartEnd(ps3.test.ScriptFileTests): 20 students failed this test

Incorrect Tests

No incorrect tests

Test suite of MOT-DIAL (rank 4a)

Correct Tests

p3TestGetChildren(ps3.test.ScriptFileTests): 8 students failed this test
p3TestGetNodes(ps3.test.ScriptFileTests): 7 students failed this test
p7TestFindPath(ps3.test.ScriptFileTests): 16 students failed this test (9 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of NIB-ADEN (rank 4b)

Correct Tests

p3TestAdd(ps3.test.ScriptFileTests): 7 students failed this test (2 failed no other test in this suite)
p3TestPath(ps3.test.ScriptFileTests): 15 students failed this test (10 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of NODE-BANG (rank 2)

Correct Tests

p3(ps3.test.ScriptFileTests): 8 students failed this test
p7(ps3.test.ScriptFileTests): 19 students failed this test (3 failed no other test in this suite)
p7extra(ps3.test.ScriptFileTests): 16 students failed this test (1 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of PAL-GIN (rank 1)

Correct Tests

p3Edge(ps3.test.ScriptFileTests): 9 students failed this test
p3Node(ps3.test.ScriptFileTests): 8 students failed this test
p7Path(ps3.test.ScriptFileTests): 21 students failed this test (13 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of RIG-TURF (rank 4e)

Correct Tests

p3TestGraph(ps3.test.ScriptFileTests): 8 students failed this test (1 failed no other test in this suite)
p7TestPathFinder(ps3.test.ScriptFileTests): 18 students failed this test (11 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of RING-DOUG (rank 7a)

Correct Tests

p3AdvancedGraphTest(ps3.test.ScriptFileTests): 9 students failed this test
p7AdvancedFindPathTest(ps3.test.ScriptFileTests): 18 students failed this test
p7AnotherTest(ps3.test.ScriptFileTests): 20 students failed this test (2 failed no other test in this suite)

Incorrect Tests

p3BasicGraphTest(ps3.test.ScriptFileTests)
p7BasicFindPathTest(ps3.test.ScriptFileTests)

Test suite of ROE-AHOY (rank 14c)

Correct Tests

No correct tests

Incorrect Tests

TestGraph(ps3.test.ScriptFileTests)
p7testPathFinder(ps3.test.ScriptFileTests)

Test suite of SANG-BARK (rank 14a)

Correct Tests

No correct tests

Incorrect Tests

p7pathFind(ps3.test.ScriptFileTests)

Test suite of SEE-QUOD (rank 14e)

Correct Tests

No correct tests

Incorrect Tests

p3MyTest(ps3.test.ScriptFileTests)
p7MyTest(ps3.test.ScriptFileTests)

Test suite of SEEK-HIDE (rank 3b)

Correct Tests

p3AddEdge(ps3.test.ScriptFileTests): 1 students failed this test
p3AddNode(ps3.test.ScriptFileTests): 1 students failed this test
p3FindPath0(ps3.test.ScriptFileTests): 13 students failed this test
p3FindPath1(ps3.test.ScriptFileTests): 17 students failed this test (1 failed no other test in this suite)
p3FindPath2(ps3.test.ScriptFileTests): 18 students failed this test
p3Independence(ps3.test.ScriptFileTests): 5 students failed this test
p3ListChildren(ps3.test.ScriptFileTests): 9 students failed this test
p3ListNodes(ps3.test.ScriptFileTests): 8 students failed this test
p3SelfEdges(ps3.test.ScriptFileTests): 2 students failed this test

Incorrect Tests

No incorrect tests

Test suite of SKIM-FORT (rank 8c)

Correct Tests

p3TestAdd(ps3.test.ScriptFileTests): 1 students failed this test
p3TestAddEdge(ps3.test.ScriptFileTests): 1 students failed this test
p3TestListChildren(ps3.test.ScriptFileTests): 4 students failed this test
p3TestListNodes(ps3.test.ScriptFileTests): 5 students failed this test
p7TestFindPath(ps3.test.ScriptFileTests): 15 students failed this test
p7TestFindPathSet(ps3.test.ScriptFileTests): 20 students failed this test (5 failed no other test in this suite)

Incorrect Tests

p7TestExceptionThrowing(ps3.test.ScriptFileTests)

Test suite of SLOB-SHIM (rank 10a)

Correct Tests

p7_pathTest1(ps3.test.ScriptFileTests): 15 students failed this test (15 failed no other test in this suite)

Incorrect Tests

graphTest1(ps3.test.ScriptFileTests)
p7_pathTest2(ps3.test.ScriptFileTests)

Test suite of SUB-SHAY (rank 6)

Correct Tests

go(ps3.test.ScriptFileTests): 10 students failed this test (1 failed no other test in this suite)
p3Test(ps3.test.ScriptFileTests): 12 students failed this test (1 failed no other test in this suite)
p7Test(ps3.test.ScriptFileTests): 13 students failed this test (1 failed no other test in this suite)

Incorrect Tests

No incorrect tests

Test suite of WIND-LA (rank 13)

Correct Tests

test1(ps3.test.ScriptFileTests): 6 students failed this test (6 failed no other test in this suite)

Incorrect Tests

p7test1(ps3.test.ScriptFileTests)