Running getstats.py on an assignment will return a summary of the correctness results, test-by-test.

Examples from Fall 2020, a10:

Using getstats.py

  1. Navigate to ~/markus/bin
  2. Edit getstats.py
    • Change autotest_folder to point to the auto testing results folder. Usually this means /u/cs135/marking/a##/test.0.AUTOTESTRESULTS.
    • Change the question_data array to reflect assignment information. Each question should be represented as [‘<question name>’, # of test cases, ‘description of test’]. You can refer to an OUTPUT.txt file to get the number of test cases.
    • Note: in the array above, if you need to write any brackets or question marks in the function names, put a slash in front of those characters (e.g., 'cs135-participation \(bonus\)','solved\?')
  3. Run getstats.py with the command:
    python getstats.py
    Please note that it might take a while to get the statistics out when there are a lot of correctness tests.
    -- Amy Luo - 2020-12-23
Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r6 - 2021-12-20 - AmyHwang
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback