Trends, Technologies and Insights for the Assessment Industry
Paul Zikopoulos, Award-Winning Author, Speaker, Future Trends Expert, and VP of Big Data Cognitive Systems at IBM, was the Keynote Speaker for the TLX event that took place in Washington, D.C. August 6 – 7.
The following topics were explored during the event.
Data Strategies for the Future (including Alternative Data Sources)
Credentialing Strategies for the Future
Collaboration among industry peers during presentations and break-out sessions elicited stimulating and thought provoking discussions regarding what lies in store with the future of credentialing and certification.
Here’s what some attendees had to say about the event
“Thoroughly enjoyed attending the thought-provoking, forward thinking Alpine TLX.”
— Cornelia Springer, Exam Director at Council for Interior Design Qualification and the NCIDQ Examination
“TLX is my favorite credentialing/certification event of the year because it focuses all of my networking and learning with other leaders who share a passion for innovative approaches to our shared concerns, obstacles, and opportunities. The ideas that we share aren’t only thought experiments, they drive changes in the way I approach my customers and challenges.”
— Tiffany Powell, Senior Director, Knowledge Management at Looker
“At TLX I engage with peers doing really exciting and innovative things in credentialing. I learn “the possible” and bring that back to my credential program, ensuring we are always innovating and improving.”
— Liz Burns, Senior Manager, Curriculum and Credential Programs at Adobe
“TLX is one of the best conferences I attend each year. I learn a lot from this conference because it challenges the way I think about certification and assessment in ways that other conferences do not. This year, I left the conference with tangible ideas for ways to change how we assess skills at Microsoft, how we define the content domains that are part of our certifications, and how to address some of the unique psychometric challenges that we need to resolve as we embark on the journey ahead. TLX is an important part of the progress we’re making on this journey.”
— Liberty Munson, Lead Psychometrician Program Manager at Microsoft Worldwide Learning
“Alpine’s TLX is where thought leaders in the Certification industry exchange big, bold ideas and where the future of the testing industry is envisioned without constraints or limitations.”
— Vikas Wadhwani, Global Head of Certifications and Assessments at Facebook
“The TLX catalyzes and fosters an environment of collaboration, innovation, and breakthrough design thinking amongst critical stakeholder groups for the betterment of the credentialing community!”
Traditionally, IT certification exams have provided evidence that people have the knowledge, skills, and abilities to perform a particular job at a particular level of competency. IT certification is making advances and in many ways is at the forefront of the testing industry; however, the industry has largely continued with a traditional approach to developing and administering certification exams as the sole source of competency evidence. This process and approach are becoming outmoded given the exponential pace of advances in technologies, the dynamic complexity of IT jobs, and the on-the-fly updates resulting from the advent of cloud-based platforms replacing version-based updates. These industry shifts present an opportunity for IT certifications to transform to be more responsive, dynamic, and data-driven than traditional exam development processes and exam formats have previously allowed. This includes the prospect of a more passive approach to the collection of competency data through interaction with apps and platforms collected in real-time as candidates complete their daily work activities. This presentation will summarize the thoughts that resulted from a summit organized to address these challenges and to “re-think” IT certification including what drives it, what value it brings (or not), challenges with the current methodologies, and alternate ways of identifying competence through existing data and/or developing new ways of collecting such data.
Liberty Munson, Ph.D., Lead Psychometrician for Microsoft’s Worldwide Learning organization, Microsoft
Vikas Wadhwani, Head of Certifications and Assessments, Facebook
Russell Smith, Ph.D., VP of Assessment Services and Senior Psychometrician, Alpine Testing Solutions
Lisa O’Leary, Ph.D., Director of Psychometrics and Senior Psychometrician, Alpine Testing Solutions
Looking for Failure to Generate Success: Big Data and the Missing Pieces
As organizations begin to embrace Big Data in their evaluations and predictive models there are a number of lessons we can learn from previous Big Data implementations. In this session we will look at a flipped and often overlooked model of Big Data analysis. We will discuss the human elements needed in Big Data analysis and how many programs miss the forest for the trees.
Paul Edelblut, Vice President of Cognitive Computing, Vantage Labs
Leveling Up: The impact of games on assessment and credentialing programs
What do games offer for your assessment and credentialing programs? Can they be used for assessing knowledge, competencies, and skills? How do they gather and quantify data related to performance? Before you can meaningfully discuss these questions, you need to understand what games are and what they are not. Which elements of games play well for assessment and which don’t? Where do they derive their power? This talk will briefly define key terms and facts about games, provide demonstrations and explanations of games being used for assessment and certification today, briefly share related research efforts, and fuel a discussion on the future of games in assessment.
Jenn McNamara, Vice President, BreakAway Games
Knapp Trend Activities
1. The Future of Certification: A Trend Expedition
Join us for an expedition to learn more about key trends influencing the future of certification. While on this journey of discovery, you’ll travel through a series of activities to explore five trends and their implications for the future of your credentialing programs.
2. Designing a Certification Model for the Future
Team competitions to create a future-focused certification model.
Lenora Knapp, Ph.D., President, Knapp & Associates International, Inc.