Testing One or More Students

Terminal can have multiple tabs (Cmd-T) or windows (Cmd-N). Open another one. Use cd to switch into the oat/oat-plandefs/test directory. An ls should show you at least the directories expected and transcripts.

transcripts contain the transcripts for more than a thousand “students”. Students is quoted because many of them started as a real student and then were modified manually to have a different requirement term or to fail a course or ….

Run a degree audit on several of them with the command da-run-tests transcripts/math/bac/cs/cs/. Remember that command completion is your friend. That directory has 10 students. da-run-tests will run a degree audit on each of them and hopefully tell you that they all passed:

oat3 test: da-run-tests transcripts/math/bac/cs/cs/  
10 tasks
Progress:..........   1
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbh-1199-4B.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1179-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1189-grad.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1199-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1209-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1219-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1229-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csbhc-1239-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/csh-1189-syntest.json
PASSED: /Users/oat3/oat/oat-plandefs/test/transcripts/math/bac/cs/cs/cshc-1189-grad.json
Passed: 10;  Failed: 0;  Error: 0
Elapsed Time:  5.1 seconds
oat3 test:

What’s happening is that da-run-tests does a degree audit for each student and compares the result it got with the expected result. The expected results are in expected/math/bac/cs/cs/. If any of them differed, the differences would be shown.

If you’d like to see the degree audit, you have two options:

Do more actual/math/bac/cs/cs/csbhc-1189-grad.txt. The more program prints the contents of a text file to the terminal window. This is the file that’s compared with a similar file in the expected directory. Hopefully, they are the same.
Do open output/csbhc-1189-grad.html which opens the file in Safari. It’s a little prettier and actually contains a bit more information. Note that the directory structure is missing; all the output is just put in a single output directory. Someone (not mentioning any names) should fix that.

Want to run fewer tests? da-run-tests transcripts/math/bac/cs/cs/csh* will run only the two with names starting with csh. The * at the end means you don’t care what comes after the csh in the name.

Want to run more tests? da-run-tests transcripts/math/bac/ will run all the tests of students with a bachelor’s degree in math – just shy of 250. That might take a little while to complete. da-run-tests transcripts/math will tests for all of Math.

Many of the test transcripts include minors or joints, etc. So they may pull in plan definitions that have been edited by someone else. It’s possible those plan definitions were edited and broke. If so, you should reach out to the person who maintains that plan.