~/markus/bin/getstats.py

Running getstats.py on an assignment will return a summary of the correctness results, test-by-test.

Examples from Fall 2020, a10:

Using getstats.py

1. Navigate to ~/markus/bin
2. Edit getstats.py
   • Change autotest_folder to point to the auto testing results folder. Usually this means /u/cs135/marking/a##/test.0.AUTOTESTRESULTS.
     
   • Change the question_data array to reflect assignment information. Each question should be represented as [‘<question name>’, # of test cases, ‘description of test’]. You can refer to an OUTPUT.txt file to get the number of test cases.
     
   • Note: in the array above, if you need to write any brackets or question marks in the function names, put a slash in front of those characters (e.g., 'cs135-participation \(bonus\)','solved\?')
3. Run getstats.py with the command:

   python getstats.py

   Please note that it might take a while to get the statistics out when there are a lot of correctness tests.
   -- Amy Luo - 2020-12-23