2019 PANCE Passing Rates Causing Concerns?

Experienced PA educators know that board exams, including the PANCE, periodically go through a “rebalancing,” which may involve adjustments to question difficulty, changes to cut scores, blueprint changes, and content focus. Any substantive changes may lead to lower scores for one or more years as programs and students adjust. We saw this happen in pharmacy, where changes to the NAPLEX resulted in lower and declining pass rates for three consecutive years (2015-2017).

Area of concern: we have had more than one PA educator speculate that this year there are more surgical-related questions, which might be a factor in the decline. There has also been student feedback that indicates that the questions are very challenging. What we do know is that there were substantial changes to the 2019 PANCE blueprint (we have a free workbook on this), including the addition of the Professional Practice area and several other content additions, deletions, and reorganizations.

As to the issues of question difficulty, Exam Master has been consistently recognized as having questions that are more difficult than what is encountered on the actual PANCE. While we cannot fully verify this, our users made this abundantly clear on a recent survey. They added that after using our questions to prepare for the PANCE, they ended up being well-prepared and were quite happy about that. One client recently reported that they had their failing students review our practice questions aggressively and that these students subsequently passed the PANCE. We love that type of feedback!

For 2019, we believe we have you and your students covered with our 2019 PANCE practice exam. It has been carefully constructed based on the new blueprints, contains all updated or new questions (with explanations and references), and includes a number of surgical-related questions. Here is a copy of our PANCE practice exam data sheet.

We are offering at no charge the opportunity for your students to test themselves with portions of this exam to build confidence in passing the PANCE the first time. Please drop us a note and we can set up a call to discuss.

Success on NCLEX-RN and Multiple Response Questions

Well, we certainly like positive feedback from our many users, and we are always happy to share that feedback. In this case, our happy nursing graduate makes a particular point of mentioning that she was helped in her success by the select-all-that-apply questions found in our NCLEX-RN test bank and practice board exam. Of course, Multiple Response questions, as these are called, are just one of the item types found on the actual NCLEX exam, and in addition to multiple choice, constructed response, etc.

Our experience, and the opinion of the educators we work with is that students need practice with these alternate item types, even when they may know the material very well. It is something about the way the brain reviews and processes information presented in new ways that can really throw students a curve if they don’t have prior practice or experience. Our NCLEX resources, both our simulated board exams as well as the full question bank, contain dozens of carefully constructed multiple response test items just like the real NCLEX-RN.

A multiple response question is basically a multiple choice question with an important distinction, more than one answer choice can be correct, and it is often necessary to select all correct responses to get full credit (or any credit) for the question. Multiple response questions are normally more difficult to answer compared to multiple choice questions because the participant needs to simultaneously consider more information. Because more than one answer choice is typically required for a fully correct response, these questions feature more permutations than a single-best-answer multiple choice question, and they make guessing more difficult. Here is an example:

What are the elements of a therapeutic milieu environment? Select all that apply.

Answer Choices:

A. Clarifying patient expectations for care
B. Creating a written contract with the patient
C. Creating flexible rules for positive outcomes
D. Avoiding limitations or boundaries within the process
E. Positively reinforcing appropriate behavior

Our 265-item NCLEX-RN simulated board exam contains several dozens of these questions to provide our aspiring students the best possible practice and preparation for this important exam. Click here for a copy of our NCLEX-RN simulated board exam test plan. In this case, practice does make perfect as attested to by our happy nursing graduate.

Of course, developing valid, high-quality test questions is not easy, and typically, the more complex the test question, the harder they are to develop. For the multiple response question, think of scenarios that have elements which almost always go together, like when you change your car’s oil, you always change the filter, too! Likewise, sometimes it helps to develop scenarios that theoretically could be answered without looking at the answer choices. That is also often an important element of a quality test question, the existence of an objective answer not dependent on a set of responses. For more information on developing high-quality test questions including those found in nursing, please reach out here and let’s have a conversation.

Will you be ready for the next generation NCLEX?

According to the National Council of State Boards of Nursing (NCSBN) over 5.4 million nursing professionals have taken the NCLEX since April of 1994. That’s a lot of aspiring nursing professionals, and not surprising given that there are close to five million active nurses in the United States. Since those days, when Green Day, Nirvana and Pearl Jam were at the tops of the charts(!), the nursing profession has undergone many changes. Not least of these is the movement to raise the educational and practiced standards of the profession in response to the ever changing demands of our health care system. Magnet status is now ubiquitous among hospitals and hospital systems a status that requires, among other things, that RN nursing staff working at these facilities have at least a BSN degree. The Doctor of Nursing Practice Degree (DNP), not really seen before 1999, is now the capstone of the nursing profession. According to the American Association of Colleges of Nursing, there are over 330 DNP programs in the U.S. with another 100+ in the planning stages.

Stakeholders in the nursing profession recognize the valuable and vital role that the nursing professional plays in our healthcare system and healthcare delivery. That system has been characterized by rapid change, driven in part by the rapid expansion of knowledge required by nursing and other health professionals to function in interdisciplinary teams. The system is increasingly complex, increasingly data driven, with major emphasis placed on cost-effective and safe delivery of care. Evidence-based practices are de rigueur. These changes have placed new demands for nurses to function at higher levels than ever before as they navigate the increasing complexity of our health care system.

These changes in the landscape where nurses work bring us to “the Next Generation NCLEX” or NGN. A 2013-14 NCSBN Strategic Practice Analysis brought to light the increasingly complex role newly licensed nurses faced during the course of patient care, particularly in the area of clinical judgment and clinical decision-making. The study revealed that many or most newly- licensed nurses were not as prepared as they needed to be to meet the requirements of the modern healthcare system. These findings had serious implications for patient safety, the hallmark of all nursing practice.

If nursing programs need to better prepare nurses for success going forward, it was vitally important that these attributes be measurable by means of the NCLEX, the licensure pathway for all RN and PA nurses. The NGN, therefore, is a research project designed to determine if higher level skills can be assessed by means of a standardized exam. Central to the new NCLEX will be use of new item types, now under research, that are expected to better measure clinical judgment. We will be keeping an eye on this landscape and are working to help prepare the next generation of nursing professionals. Assuming the outcomes of the NGN research demonstrate efficacy in these methods of higher level assessment, the Next Generation NCLEX will be coming to a testing center near you!

Practice Exam Now Available for the New PANRE

Both the Physician Assistant National Certifying Exam (PANCE) and the Physician Assistant National Recertifying Exam (PANRE) have been based on the same or very similar NCCPA (National Commission on Certification of Physician Assistants) exam blueprint. While the exams have differed somewhat in terms of numbers of questions, the body systems that were covered and the proportion of the exam devoted to each body system tended to be the same or very similar between both exams. The cardiovascular system, for example, has always been heavily weighted on both the PANCE and the PANRE.

Because these exams were so similar, we have always offered a single collection of resources for our end users and PA program clients for both PANCE and PANRE. Whether these were question banks or our popular practice exams, our PANCE/PANRE resources were organized essentially the same, and they featured clinically-oriented questions organized by body system and task. There have traditionally been seven tasks.

PANCE and PANRE parting ways

As many in the PA community now know, in 2019 the PANCE and the PANRE will be parting ways to some extent. The PANRE is changing in part because of a multi-year initiative by the NCCPA and its collaborators to identify the core medical knowledge deemed important for all certified physician assistants. Based on a profession-wide survey, practicing PAs and stakeholders were asked to provide detailed feedback on which specific diseases and disorders they thought were core to their practice and role as Physician Assistants. We have seen this approach used in many disciplines, including dentistry, where a complete overhaul of the dental board exams (NBDE/INBDE) is being implemented based in part on detailed surveys of practicing dentists.

What appears to be new to the PANCE/PANRE framework, at least explicitly now, and now covered under the PANRE, is the delineation of different levels of cognitive complexity to which exam questions are to be developed. These levels are associated with the different diseases and disorders and are as follows:

  • Level 1: Recognize most likely diagnosis using signs, symptoms, and risks; refer appropriately.
  • Level 2: Make appropriate diagnosis by recognizing signs, symptoms, risks and/or interpreting results of diagnostic studies, and have knowledge of first-line treatment.
  • Level 3: Make appropriate diagnosis by recognizing signs, symptoms, risks and/or interpreting results of diagnostic studies and have knowledge of first-line treatment. In addition, have knowledge required to manage well-known comorbid conditions, contraindications, and complications.

We’ve got you covered

Accordingly, to reflect this new change for the PANRE, we have developed a new simulated PANRE practice exam that encompasses these different clinical levels assigned to the questions. Both the PANCE and PANRE are including Professional Practice areas as well, and so we have our eye on that, too. The advent of a new certification or recertification exam always creates a bit of anxiety and uncertainty in the community to which it corresponds. Practicing PAs do have the challenge of preparing for a recertification exam often many years after completing their formal education and training or after taking their last certification or recertification exam. It does not appear to us that these changes to the PANRE will be unduly disruptive or cause hardship, but it makes sense for us to keep our resources as relevant as possible so that we can properly support the many folks who rely on Exam Master to help them prepare. More information on the PANRE is available here.

2016 NAPLEX Passing Rates Causing Concern

What’s behind decline in NAPLEX pass rates?

As pharmacy educators know, and have been telling us, there are many factors involved in determining student success on the NAPLEX. These include factors related to student preparedness, prior course history, and prior training and experience (such as prior pharmacy tech experience) before these students enter pharmacy school. Changes in the overall characteristics of the applicant pool may also play a role as the growth in the number of pharmacy schools makes selecting qualified students from a relative decline in the applicant pool more difficult. There are also variations in pharmacy schools’ approach to training their students including variations in curriculum models ranging from three year accelerated programs to six year programs combining undergraduate and graduate level training into a single pathway.

 

Adjusting to changes in the NAPLEX

And, of course, there have been changes to the NAPLEX exam itself. Most significantly, as of November 2016, the NAPLEX increased in length to accommodate more content covering the diversity of clinical cases and medication preparation strategies encountered in pharmacy practice. Similar to trends we are seeing in other health care professions, including dentistry and nursing, there has been a shift in emphasis toward more clinically- and medicine-oriented training of health care professionals with a goal of preparing them for work as an inter-disciplinary health care delivery team.

While we certainly are not qualified to make a judgment about whether the current NAPLEX is properly aligned with what should define a competent, newly-graduated pharmacist, schools are concerned since they are often judged by their ability to train their students to succeed on the exam. We do not look at recent results as necessarily the fault of the schools. Training health care professionals is a difficult task usually involving intense didactic study coupled with clinical training in a variety of health care settings. The pharmacy curriculum is demanding and requires strong math and science aptitude.

 

Help for pharmacy schools adjusting to change

At Exam Master, we work with schools to help them solve these types of challenges. Many of the issues we see are relevant to the wide variety of health science disciplines we serve. While it may take time, educators take their mission quite seriously, and are constantly seeking better methods and approaches to improving student and program performance. While we focus on the assessment side of these challenges, we can help develop resources for all phases of the curriculum including delivery of special readiness programs for early intervention. Studies show that early intervention with students who may be weak in foundational or pre-requisite subjects can really make a difference in outcomes.

Updated Exam Creation Tool Released

One of the defining features of our resources from day one (and that’s going back quite a few years) is the ability we provide our learners to create customized assessments for themselves. This capability has been important because one of the hallmarks of our self-testing, self-study system is to help learners 1) identify their strengths and weaknesses and 2) help them select the material to review that is most important to them. This allows for more efficient, targeted study. Unlike some resources we’ve seen, our system provides learners with very granular ways to select study topics. Interested in reviewing cardiology questions but need to go deeper? Our system allows you to drill down into very specific categories, such as cardiomyopathy or valvular heart disorders, and pull questions just from these areas.

Recently we completely refreshed this whole process. So whether you are interested in creating just one self-testing or self-study exam or a set of exams all at once, we help you do that. Firstly, we make it easy to find the broad subject or content area that is most of interesting to you. We call this the Outline. Next the system presents to you the Topics available in that outline. With convenient check boxes you can then select the Topics, Subjects and Categories of most interest to you. You can also choose All questions, questions Answered Incorrectly, or questions Never Answered for even more targeted selection.

Once completed you can name the exam in a way that is meaningful to you, choose whether you want to Take a Test or go into one of our Study or Learning modes. Of course, with whatever type of assessment you choose, you can be certain it contains questions from just those areas of interest to you. And, of course, all tests and provide detailed scoring feedback and performance diagnostics.