CAS moves to an "exam item bank" instead of publishing exams/questions

CalebWetherell

This seems like a good idea. It also solidifies the ability for the CAS to offer computer-based exams.

One of my big gripes as an exam taker was that it was clear exam difficulty varied from sitting to sitting (despite the best efforts of the exam creators). Having an item bank will allow a much more robust method of making sure everyone is tested at the same level of difficulty. This seems like the biggest 'win'.

It also felt like item writers sometimes stretch to write strange questions because everything else has been tested and can be memorized. This eliminates that and makes it more likely item writers create reasonable questions that are practically useful to someone in the profession.

On the other side, I found the Examiner's Reports to be incredibly useful. It's too bad those will go away. It would be nice if they can find a way to keep regularly releasing questions that get "retired" or something so students have good reference material as to what will be asked.

How do current exam takers feel about this?

https://www.casact.org/press/index.cfm?fa=viewArticle&articleID=4836

BigPeePee

I'm not sure why you feel happy about dumbing down exams. I feel bitter about taking 35% passrate exams that are now 60% passrate exams.
Are CAS board members envious of the amount of money the SOA is making?

CalebWetherell

BigPeePee Why does this dumb down exams? That doesn't seem likely to me. I think this will make exams harder in the long run because there won't be an examiner's report.

BigPeePee

CalebWetherell
To compensate for no examiner's report, CAS will make the questions easier. It will also be easier to create something like ADAPT for the CAS exams.
I think CAS employees saw the amount of money SOA was raking in and they wanted in on that action. They want their 4th house and BMWs, too.

We need a full accounting investigation on CAS. Did the study manual companies pay off CAS to make this change? What was promised? Who was being paid off?

TedHoffman

CalebWetherell Until/unless the Examiner's Report is replaced by something that helps candidates study beyond syllabus readings alone, the removal of exam questions and those reports clearly makes exams more difficult in the near-term. It's going to drive candidates more toward 3rd-party study materials, which is the exact opposite of what the CAS has long said candidates should do.

What should that replacement be? Good question. I'm curious what others have for ideas. I think sample questions will have to be a piece of this a la what prelim exams had (still have?) but there needs to be a replacement for the feedback candidates get when they don't pass.

There's a number of concerns I have near-term, and even if/when this turns into a question bank that generates random exams online I have questions about consistency in difficulty and syllabus coverage between candidates. [Among other things.] Ultimately, I like this move provided that the CAS really does get to more consistent exams and more frequent sittings. But like many things with the CAS, that will have to be proven over time and the long-term track record on this hasn't been something to brag about.

CalebWetherell

BigPeePee Your glass isn't even half full here, it's just empty. The CAS volunteers, the board, those leading the education committee, etc are all uncompensated. This change is not about money or changing the difficulty of exams.

BigPeePee

CalebWetherell

There are other ways to get compensated besides paychecks. Maybe they were paid off directly similar to the college admissions scandal. Someone had to have been paid off. I just know it.

CalebWetherell

TedHoffman you bring up some good points. Like most things, it's a matter of whether or not this is executed well. The last CBT was obviously not.

The page I linked did mention they will give feedback to candidates (who fail, I think) after the exam so they know what to improve in the future.

I think the Examiners Report being gone is actually not much of a loss in the short term. The historical reports will be highly useful for the next few exams, but they'll become outdated and less useful as the syllabus evolves. I agree that students need a replacement, or it will be harder to pass exams of the same difficulty as today.

hanbae

BigPeePee Who would have been paid off and by whom? for what reason would someone pay off the CAS staff to do this? What are other ways to compensate volunteers that would incentivize them enough to make exams easier? Yes this will increase the CAS revenue, but the option to have more exams per year is a huge benefit to those taking exams. I agree that in the short term, candidates will suffer a little. But we still have access to everything that has been released so far. This means for at least the next few sittings, you will likely not notice much of a difference in your study habits

TedHoffman

BigPeePee You get on that investigation. Let us know how it goes.

knoath

I love my TI-30XS multiview but realistically any form of testing that actually test using spreadsheets (whether it be Excel or whatever may replace it) is much more applicable to life as an actuary. Plus I'm sick of getting cramps in my hand trying to do handwriting (so 20th century!)

CalebWetherell

knoath

The TI-30XS MuktiView has a special place in my ❤️

7.5 years into my career and it still sits on my desk ready to go to work at a moment's notice!