0
   

Question: Evaluation using tests with high pass rates

 
 
pkubin
 
Reply Sun 7 May, 2017 10:53 pm
I am a physician assistant and I write about the profession. Recently a colleague noted correctly that the way physician assistant schools are ranked is very arbitrary (they survey PA program directors and faculty only). He proposed evaluating programs according to a school's 5-year PANCE exam pass rate. The PANCE is the Physician Assistant National Certifying Exam. It is taken by all PA school grads and they must pass it before they can practice. It is scored either pass or fail. The only problem is, most school pass rates are in the high 90's -- even averaged over 5 years. Basically, the vast majority of PA students pass the PANCE exam their first try without difficulty.

My question for you is: is this a good measure statistically speaking? It seems a more statistically valid method than the survey method (but I'm not asking that). It doesn't seem so valid in a larger sense. In tests that have a fairly high pass rate, is there enough variability to draw decent conclusions about questions like this (the question being how to rank different schools)? What variables factor in your determination? I'm a lay person when it comes to stats, so please factor that into your answer.
  • Topic Stats
  • Top Replies
  • Link to this Topic
Type: Question • Score: 0 • Views: 420 • Replies: 1
No top replies

 
ekename
 
  1  
Reply Mon 8 May, 2017 05:33 am
@pkubin,
Try ANOVA for the schools.

https://en.wikipedia.org/wiki/One-way_analysis_of_variance

There may be no identifiable significant statistical difference.

https://en.wikipedia.org/wiki/Misuse_of_statistics
0 Replies
 
 

Related Topics

 
  1. Forums
  2. » Question: Evaluation using tests with high pass rates
Copyright © 2024 MadLab, LLC :: Terms of Service :: Privacy Policy :: Page generated in 0.04 seconds on 04/24/2024 at 06:21:08