Predictive Scores and Ultimate Test Passage

Requires a Wolfram Notebook System
Interact on desktop, mobile and cloud with the free Wolfram Player or other Wolfram Language products.
It is frequently possible to predict whether a particular student at a school will pass some ultimate examination, such as a professional licensure exam or some exam required to achieve a degree. Thus, if one knows the distribution of predictive characteristics for all the students at a school, it is possible to make some composite estimate as to the percentage of students who will pass an ultimate exam. If one understood this relationship, one might then be able to assess whether a particular school, given the profile of students attending it, is doing a better than average or worse than average job in preparing its students to pass the ultimate examination.
[more]
Contributed by: Seth J. Chandler (March 2011)
Open content licensed under CC BY-NC-SA
Snapshots
Details
The numeric values selected for this Demonstration are drawn from the relationship between LSAT scores in the United States and scores on the bar examination generally required to become licensed as an attorney in the United States. In recent years, the American Bar Association, whose accreditation of a law school is generally required before that school's graduates may become attorneys, has required as part of "Interpretation 301-6" that pass rates on the bar examination achieve a certain threshold. Various law schools have complained that this standard unduly burdens them because of the lower predictive scores of the students who attend them. Yet, to know whether such a school is in fact doing a good job educating its students to pass the bar exam, one should know the shape of the relationship between predictive scores and bar passage rates. This Demonstration suggests that, as a matter of theory, the shape should be somewhat sigmoidal.
Snapshot 1: lowering the score required to pass the ultimate examination effectively moves the curve leftward
Snapshot 2: increasing the range of predictive scores of admitted students "flattens" out the sigmoidal shape into a more linear one
Snapshot 3: increasing the standard error of prediction (i.e., weakening the correlation between predictive scores and ultimate examination scores) also flattens out the sigmoidal shape into a more linear one
Snapshot 4: shows the relationship when no school admits students whose predictors are so low that fewer than half will pass an ultimate examination
Permanent Citation
"Predictive Scores and Ultimate Test Passage"
http://demonstrations.wolfram.com/PredictiveScoresAndUltimateTestPassage/
Wolfram Demonstrations Project
Published: March 7 2011