Why isn't the CPA exam graded by a computer - Page 2

  • Creator
    Topic
  • #180951
    Jasper
    Member

    I just took my AUD exam and may need to wait about a month before I see the score results. I am understanding that two professionals review and grade each exam, but wouldn’t it be faster if a computer graded the tests. With the exception of written communications, a computer could easily grade MCQ’s and SIMS. A candidate could have their score within moments of completing their tests.

    What’s the reason for humans grading the tests? I am understanding that there is no curving on the tests; so if 90% of candidates got MCQ #20 wrong, it would not be omitted from the test. Maybe, the reasoning is that computers can make errors, but still even having an instant preliminary score would be nice.

    FAR 82
    BEC 82
    AUD 93
    REG 87

Viewing 15 replies - 16 through 30 (of 32 total)
  • Author
    Replies
  • #458052
    Jasper
    Member

    @ wizards8507, this test is starting to seem more and more like a crap shot. So if you have a lot of people who do well on the exam and let's say about 60% receive a raw score of 75, those in power could deem that a 75 is a 55 just to keeping the passing rate down.

    @Ntw6817, I know I saw somewhere that two individuals grade the test, but not sure where. Once I find my source info, I will let everyone know.

    FAR 82
    BEC 82
    AUD 93
    REG 87

    #457932
    jeff
    Keymaster

    Well – this past score release was for the final 15 days of the window and it was for 28,000-ish exams.

    The large majority are computer graded.

    Do they hand-grade exams that need another look? I'm sure they do.

    #458054
    jeff
    Keymaster

    Well – this past score release was for the final 15 days of the window and it was for 28,000-ish exams.

    The large majority are computer graded.

    Do they hand-grade exams that need another look? I'm sure they do.

    #457933
    wizards8507
    Participant

    “Raw score” is likely not even on a 0 to 100 basis. Raw score could be like 491.34 for all the clarity they provide.

    Bottom line, you need to be better than whatever percentage of people they deem will fail.

    NY CPA

    #458056
    wizards8507
    Participant

    “Raw score” is likely not even on a 0 to 100 basis. Raw score could be like 491.34 for all the clarity they provide.

    Bottom line, you need to be better than whatever percentage of people they deem will fail.

    NY CPA

    #457934

    @wizards, I don't think there's a target pass rate. Otherwise they wouldn't be contemplating making BEC harder because the pass rate is “too high”. And the idea of getting the exact same number of questions right but receiving a different score has everything to do with each question being weighted based on difficulty, not the AICPA skewing the scores so a certain amount of people fail. I guess no one really knows for sure but I don't think they sit around manipulating the scores that way.

    FAR - 70, 83
    REG - 82
    BEC - 78
    AUD - 76

    #458058

    @wizards, I don't think there's a target pass rate. Otherwise they wouldn't be contemplating making BEC harder because the pass rate is “too high”. And the idea of getting the exact same number of questions right but receiving a different score has everything to do with each question being weighted based on difficulty, not the AICPA skewing the scores so a certain amount of people fail. I guess no one really knows for sure but I don't think they sit around manipulating the scores that way.

    FAR - 70, 83
    REG - 82
    BEC - 78
    AUD - 76

    #457935
    wizards8507
    Participant

    They do, trust me.

    The reason they need to make BEC more difficult is because there needs to be more distinction between testers. If tons of people score within the same “band” raw score, it's harder to “draw the line” on where to cut people off. If you want a 40% pass rate but there are a bunch of testers all clumped up around the 55 to 65%ile, you have no choice but to pass all the people who are “tied.” Your pass rate becomes either 45% or 35%.

    NY CPA

    #458060
    wizards8507
    Participant

    They do, trust me.

    The reason they need to make BEC more difficult is because there needs to be more distinction between testers. If tons of people score within the same “band” raw score, it's harder to “draw the line” on where to cut people off. If you want a 40% pass rate but there are a bunch of testers all clumped up around the 55 to 65%ile, you have no choice but to pass all the people who are “tied.” Your pass rate becomes either 45% or 35%.

    NY CPA

    #458062
    futureCPA12
    Participant

    Based on how they describe the grading system, this is my take:

    They pre-determine each question's value. The more difficult questions you see, the more likely it is that you will pass. If you do well on your first testlet, you'll get a harder 2nd testlet, and you may feel you do poorly on it, but the questions you do get right are worth more than if you had an easy testlet. I think this explains why so many people think they fail and end up passing. We get so many of these difficult questions which we are unsure of during the test, but its likely we get a chunk of them right which helps boost our MCQ scores in the end. And obviously the SIMs are graded strictly in comparison to how you do in relation to all other takers. So yes SIMs may slam you, but if they gave you problems, other testers likely had similar issues.

    #457936
    futureCPA12
    Participant

    Based on how they describe the grading system, this is my take:

    They pre-determine each question's value. The more difficult questions you see, the more likely it is that you will pass. If you do well on your first testlet, you'll get a harder 2nd testlet, and you may feel you do poorly on it, but the questions you do get right are worth more than if you had an easy testlet. I think this explains why so many people think they fail and end up passing. We get so many of these difficult questions which we are unsure of during the test, but its likely we get a chunk of them right which helps boost our MCQ scores in the end. And obviously the SIMs are graded strictly in comparison to how you do in relation to all other takers. So yes SIMs may slam you, but if they gave you problems, other testers likely had similar issues.

    #458064
    mla1169
    Participant

    futureCPA that is exactly my understanding. The reason why you have test questions in this window is so the AICPA can determine ahead of time which questions with which weighting will keep the pass rates “acceptable” in future windows.

    In a traditional “curve” your score is determined in part by your peers who are taking the same exam at the same time. The AICPA has emphatically declared that this is not the case.

    FAR- 77
    AUD -49, 71, 84
    REG -56,75!
    BEC -75

    Massachusetts CPA (non reporting) since 3/12.

    #457937
    mla1169
    Participant

    futureCPA that is exactly my understanding. The reason why you have test questions in this window is so the AICPA can determine ahead of time which questions with which weighting will keep the pass rates “acceptable” in future windows.

    In a traditional “curve” your score is determined in part by your peers who are taking the same exam at the same time. The AICPA has emphatically declared that this is not the case.

    FAR- 77
    AUD -49, 71, 84
    REG -56,75!
    BEC -75

    Massachusetts CPA (non reporting) since 3/12.

    #458066
    wizards8507
    Participant

    @mla1169 I think you put too much faith in the AICPA. If your theory were correct, there would be no reason for them not to give you your scores immediately a la the GMAT, as another poster suggested.

    NY CPA

    #457938
    wizards8507
    Participant

    @mla1169 I think you put too much faith in the AICPA. If your theory were correct, there would be no reason for them not to give you your scores immediately a la the GMAT, as another poster suggested.

    NY CPA

Viewing 15 replies - 16 through 30 (of 32 total)
  • The topic ‘Why isn't the CPA exam graded by a computer - Page 2’ is closed to new replies.