BETTER TOGETHER
Assessments. Learning. Outcomes.

FEATURE SPEAKER SESSION

Panel Discussion

Participants:

• Chris Beauchamp, Meazure Learning

• Kim Brunnert, Elsevier

• David Foster, Caveon

• David Yunger, Vaital

• Jason Fine, Meazure Learning

In the assessment field, Artificial Intelligence (AI) is often misunderstood even though it has been used by testing programs for decades. AI is becoming increasingly commonplace from helping streamline candidate registration to detecting suspicious test-taker behaviors during an exam. AI often works behind the scenes enabling everything from customer service efficiencies in things like chatbots to the generation of sophisticated measurement methods such as adaptive testing.

However, with all the assistance and efficiency that AI provides, there are also several emerging legal and ethical concerns that must be considered. Most concerns lie in the unexplainable black box, meaning the “how” AI works is not explainable or understandable.

The purpose of this presentation is to outline the opportunities, threats, and considerations of using AI in assessment. This includes critical considerations such as transparency, impartiality, authority, and the role of discretion in decision making. In addition, there are several considerations related to the defensibility of AI-led decision making; especially as it relates to the justification and rationale of decisions.

Come engage with a panel of psychometricians, business, and industry leaders as they discuss different ways in which AI can enhance an exam program ranging from improving business operations to strengthening the security of your program as well as what to consider before implementing certain AI tools.

Panel Discussion

Participants:

• Ian Browne, Chartered Accountants Ireland

• Kirk Alford, Meazure Learning

• Manny Straehle, Assessment, Education, and Research Experts, LLC

• John Baker, Zoomorphix Systems

• Gabriel Thompson, Zoomorphix Systems

Developing and managing a testing program often consists of a complicated network of stakeholders and a tech stack that isn’t streamlined. How different platforms interact can significantly impact a program’s internal processes and a candidate's testing experience. It’s important to understand the candidate journey from “prospect” to certification, and all the steps in between. Candidates often use multiple platforms and data is spread across multiple databases, including but not limited to a candidate management system, test driver, proctoring solution, reporting platform, and badging.

Although this is a pervasive issue, integrating a program’s vendor solutions is rarely addressed at industry conversations. For some, the idea of technology integration might seem overwhelming or out of budgetary reach. If this sounds familiar to you, or if you’re exploring ways to improve the candidate experience, make sure to attend this session!

This session is closely aligned with the conference theme of “Better Together,” as we’ll discuss how integration and collaboration positively impact the testing experience. The goal is to remove the jargon and discuss the desired outcomes of integrated solutions that will resonate with business leaders. The panelists will share experiences to illustrate the benefits and costs associated with an integrated testing experience - including some innovative ways to achieve the benefits of an integrated solution without a dedicated development team.

Panel Discussion

Participants:

• Jason Fine, Meazure Learning

• Jared Zurn, National Council of Architectural Registration Boards (NCARB)

• Ray Yan, Financial Industry Regulatory Authority (FINRA)

Increasing exam program access and diversifying the test-taker pool has become an even more important initiative for many testing programs over the last several years. During this presentation, you will hear from assessment organizations who have made increasing test-taker access to their program and diversifying their test-taker population a priority. Learn from these organizations why the topic is important to their organizational mission, the goals for their initiative, how they went about increasing test-taker access and diversity, and most importantly, the outcomes. From researching if and where your program falls short to analyzing the benefits of making modifications to implementing an action plan, starting the process of increasing program access and increasing diversity can be daunting. Hear how two organizations implemented several new tactics, such as creating an entry level exam, challenging education requirements, recruiting a more diverse SME population and providing free access to test preparation materials, all which helped attract a diversified candidate pool. Panelists will share the approach they took, programs they put in place and lessons learned along the way. Join the session to hear how the panelists implemented new diversity programs and ended up restructuring key elements such as eligibility, training, expanded SME roles, and even development of a new exam, all to successfully increase access and broaden their program to more candidates.

Debate

Participants:

• Chris Beauchamp, Meazure Learning

• Maria Incrocci, Meazure Learning

• Joe Williams, IPC International

• Jessica Dangles, CBIC

• Bill West, Cornerstone Strategies

• Nathan Thompson, Assessment Systems Corporation

• Sarah Schnabel, American Board of Ophthalmology

The assessment and testing industry has witnessed solutions developed and implemented at lightning speed to meet the needs of organizations in recent years. Many credentialing programs shifted from testing in-person at test centers to live, remote proctored environments. Now that organizations are positioning themselves to address the future of test delivery among the various modality options, there is a need to review and dissect information from recent examples of test delivery adaptations in the industry.

This session debate will present a 360o perspective to attendees relating to the vast number of variables to consider when evaluating the optimal test delivery model for their program(s). The debate teams will support either the “in-person testing model”, the “remote testing model”, or the “hybrid testing model”. Each debate team will have an opportunity to address key considerations necessary to roadmap test delivery solutions including:

• Technology dependency
• Security
• Accessibility
• Fairness in testing
• Test-taker experience
• Operations
• Psychometric implications

Presentation

Presenters:

• Gabriell Darby, Meazure Learning

• Autumn Saylor, International Code Council (ICC)

• Jim Wollack, University of Wisconsin-Madison

In sports, there are documented definitions of player “fouls” and consequences are enforced by referees. This allows players, coaches, and spectators to understand the ramifications of breaking the rules. Pivot this metaphor to the testing industry. Most testing programs agree on expected candidate behavior and recognize “foul play” when they see it, but the consistency stops there. The policies and actions taken when exam rules are broken vary between and even within programs. Several recent public instances of cheating have occurred where disciplinary actions ranged from canceling scores, banning candidates, taking legal action, and even fining the associated firm. Many programs spend considerable energy on identifying and/or deterring cheating but not enough time outlining policies for how they will handle cheating when it is detected.

Communicating policies is critical to ensuring candidates understand the implications of breaking the rules and maintaining the credibility of your testing organization. In this session, testing professionals will share their “playbook” for handling a full range of incidents. We’ll outline lessons learned and best practices in establishing clear policies and guidelines for multiple types of exam incidents. Industry experts will walk you through the benefits that come from establishing and publicizing exam policies. You’ll leave with actionable insights to help you establish, review, and maintain these critical policies for your program.

FEATURED SPEAKER SESSION

Presentation

Presenters:

• Timothy McClinton, Meazure Learning

• Isabelle Gonthier, PSI Services

• Gary Gates, Pearson VUE

• Joy Jones, GMAC

The past year has been prolific in leadership changes and new vision in our testing industry. How about we take a moment to chat with a few of the new CEOs and discuss their perspective and vision for the future of our industry? From innovations to growth, business strategy and key opportunities, let’s get in the head of these leaders and learn from their experience as well as understand where they see our industry going to ensure it continues to thrive and evolve. Even better, come prepared with the questions you always wanted to ask to these great leaders, and get the most out of having them assembled together for this panel conversation.

FEATURED SPEAKER SESSION

Presentation

Moderator:

• Ashley Norris, Meazure Learning

Panelists:

• Diann Huber, iteach

• Josh Jone, Quanthub

• Roy Swift, Workcred

Market forces – from COVID, to the Great Resignation, to the predicted recession – can have a significant impact on the workforce. This session, comprised of employers and workforce agency representatives recruited from the Dallas region, will provide insight into how these market forces have impacted employers and their use of credentials. For example, how valuable are credentials in a low unemployment market? If the labor market becomes more competitive, does that change their view on credentials? Did they or will they increase pay for individuals holding credentials? Does remote work increase the value of credentials given the more limited visibility into a remote worker’s activities? Do market conditions impact whether they are more or less likely to help subsidize an employee’s efforts to obtain a credential? This will be an “outside-in” perspective of the value of credentials given current market forces.

SPONSOR SESSION

Presentation

Presenters:

• Cory Clark, Meazure Learning

• Sebastian Hesselmans-Dirven, UNE Australia

As the leader in remote proctoring, we understand the challenge testing programs face in continually defending against new security threats. And, as the methods of bad actors evolve, so must the efforts to detect and deter cheating and theft attempts that compromise exam content. This ongoing threat to test security requires a holistic approach that includes vigilance enhanced by technology. Meazure Learning developed the Guardian Browser to provide an additional layer of security and protection against these ever-evolving threats. The Guardian Browser allows us to quickly implement security measures, increase security controls, and enhance the test-taker experience. With a dedicated, secure browser, credentialing programs can be confident that the test-taker's device can only access what is necessary during an exam, increasing confidence in exam integrity. As a full-service assessment company, adding a secure browser to our industry-leading proctoring solutions strengthens the services Meazure Learning offers and leads to better outcomes for our clients and test-takers. With out-of-the box features like restricting access to blocked websites, remote access detection, continual in-session activity tracking, and obstruction of unpermitted activity—with the added bonus of quick link buttons for chat support or help articles—the Guardian Browser expands Meazure Learning’s security capabilities and improves the test-taker experience. Join us for a discussion of the benefits our clients have experienced since the initial launch of the Guardian Browser in November 2022. Hear insights into exam security, test-taker experience, and how Meazure Learning is addressing both with our new Guardian Browser.

FEATURED SPEAKER SESSION

Presentation

Presenters:

• Ashley Norris, Meazure Learning

• Andy Dua, Uexams

• Carl Bowman, CompTIA

As people adapt to new ways of working and meeting, there is a strong push to provide workers the flexibility to work and live anywhere. This change will continue to push the shift to greater hybrid assessment opportunities where the test taker can choose whether they test in-person or remotely. The shift to remote testing changes the nature of special accommodations that are requested by test takers and how they might be implemented. Testing programs and exam providers actively seek ways to manage candidate expectations and maintain the fairness and validity of their assessments.

Presenters will share how two organizations partnered to meet the additional challenges of maintaining content security and identification confirmation while providing accommodations support in remote exam administrations. They will take the audience through the challenges and issues and show how technology provided remote support for the most complex accommodations, including readers, scribes, translators, and more while maintaining content security and verifying test-taker identity. The audience will be introduced to innovative features including content blur, screen, and keyboard control, and much more. Leave the session with a solid understanding of what a program should consider when adopting technologies in a hybrid testing environment.