Decoding Generative AI in Assessment
The Evolution of Skill Measurement
In the dance between human intuition and AI precision, the future of skill assessment is not about replacement but empowerment; it's a testament to human ingenuity, where machines amplify our potential and humans remain the irreplaceable touchstone of context and creativity.
In today's rapidly evolving technological landscape, the integration of Generative Artificial Intelligence (GAI) has become a focal point of discussions, promising transformative changes. One massive, often overlooked opportunity with tremendous innovation potential is skill assessment.
This week I reconnected with Josh Kamrath, CEO of Bongo, where we delved into the intricacies of how Generative AI can be paired with video to create dynamic, adaptive, and comprehensive skill assessments. This is notable since analog methods, while reliable, often lack the speed and scalability required for a modern business. You can find the full video here or listen to the podcast here.
At the heart of this discussion was the consistent theme that GAI, while radically changing the possibilities, still requires humans at the center. If anything, its ability to automate content analysis, identify learning objectives, create assessment frameworks, and assess performance frees up human capacity to layer on the human touch when and where it matters most. This marriage of human intuition with AI precision ensures a holistic evaluation, emphasizing that while technology can offer unparalleled scalability and insights, human judgment remains irreplaceable in contextualizing and refining them for an organization.
In sum, our conversation not only shed light on the current state of AI in skill analysis and assessment but painted a picture of its promising future. As we move forward, it's evident that the fusion of AI and education will lead to more refined, efficient, and inclusive evaluation methods, setting a new benchmark in the realm of skills.
Top Takeaways
While our conversation threaded the needle across the broad spectrum of technology and skills, there were a few distinguished reflections that stood out.
Automation isn't reinventing the wheel; it's just making it roll faster.
Throughout our conversation, it was evident that GAI isn't creating a new paradigm for skill assessment—it's enhancing what's already there. Before GAI, personalized skill assessment existed but was manual and time-consuming, limiting its reach to a small percentage of the population. GAI takes those manual processes and supercharges them, making them more efficient, consistent, and scalable, massively expanding the reach.
AI is the tool, humans are the craftsmen.
Our discussion emphasized the symbiotic relationship between AI and human intervention, highlighting the resilience and indispensability of human involvement. GAI can sift through data, recognize patterns, and even make predictions with unprecedented accuracy. However, it lacks the emotional intelligence, nuance of human judgment, and contextual understanding only a human can bring to the table. Humans, empowered by AI, can move beyond the mundane to creativity, strategy, and enhanced human touch. This isn't a story of replacement; it's one of empowerment.
In the age of information, results can't hide
We emphasized the escalating demand for accountability, particularly in the professional development realm. As companies invest significant resources—both time and money—into employee growth and skill enhancement, there's a rising expectation of tangible returns on these investments. Organizations are less accepting of completion metrics; they want evidence of genuine skill growth. Furthermore, in a competitive global market, the stakes are higher. Companies can't afford to pour resources into programs without seeing tangible benefits.
From boardrooms to fry rooms, video is the universal language.
We touched on the misconception that video assessments are predominantly tailored for soft skills. Our conversation shed light on the expansive range of skills that can be evaluated through video. Historically, video-based assessments have been perceived as tools to gauge communication abilities, leadership qualities, or interpersonal skills. However, videos provide a tangible, real-time snapshot of a person's competence in a variety of tasks. For instance, assessing someone's capability in safely maneuvering a forklift or ensuring consistency when preparing food items offers invaluable insights that can't be captured through traditional written assessments or quizzes.
We can embrace change or wait for it to be handed to us.
A recurring theme emerged around the inevitable nature of technological change, especially with the rise of AI. The profound reality is that the landscape of work, learning, and assessment is undergoing a seismic shift. The question isn't whether these changes will occur but how we choose to respond to them. Waiting on the sidelines, hoping to adapt only when it becomes unavoidable, is a passive strategy. It's akin to waiting for the future to dictate terms to us.
Call to Action
Following the theme of the conversation, we need to move beyond theoretical appreciation to pragmatic preparedness. It's not enough to be informed; we must be proactive. Here are three actionable steps that each one of us can take to not only brace ourselves for the upcoming shift but seize it as an opportunity for growth.
Ask More Questions: Before diving into tasks or making decisions, take a pause and ask more questions. Assessment, at its core, requires a deep understanding of the desired outcome. By asking questions, you ensure clarity, alignment, and a foundation for measurable success. It's not about being hesitant but about being thorough. In an era driven by data and technology, the human touch of curiosity and clarity becomes even more valuable.
Practice Getting Feedback from AI: The age of AI is upon us, and its influence permeates every sector. To truly understand its capabilities and nuances, interact with it. Input a transcript into tools like ChatGPT or other AI platforms. Ask for feedback. This hands-on approach will provide you with a tangible sense of AI's strengths and risks. By doing so, you'll not only demystify AI but will be better prepared to integrate it into your professional life.
Assess Your Current Impact: In the hustle of daily tasks and long-term projects, it's easy to lose sight of the bigger picture. Take a moment to evaluate how you're measuring success today. When you look at your metrics and achievements, do they stand up to the "so what" test? Is the impact tangible, meaningful, and aligned with broader goals? This introspection will not only refine your current strategies but will ensure that your efforts are truly impactful in a rapidly changing landscape.
Concluding Thoughts
Navigating the intricate dance between human skills and AI-driven assessment is more than just an academic exercise or a technological trend—it's a reflection of our evolving world. As our conversation illuminated, the confluence of human potential and AI's capabilities presents a unique frontier of opportunities and challenges. We shined a light on the measurable nature of human skills, the indispensable role of humans alongside machines, the rising demand for accountability, the versatility of video assessments, and the urgency of embracing change proactively.
But beyond these takeaways, there lies a more profound message: the future is a canvas, and we are its artists. Whether by asking more questions, seeking feedback, or continuously assessing our impact, we have the tools and the agency to shape our trajectory. AI, in its myriad forms and applications, is not a replacement but a collaborator. It's a testament to human ingenuity, and its greatest potential is realized when it complements human intent, creativity, and purpose.
As we stand on the precipice of this new era, let's not be passive observers. Let's be active participants, informed, prepared, and inspired. The future beckons with promise and potential, and it's up to each of us to step into the fray armed with knowledge, conviction, and a vision for a world where humans and AI co-create a tapestry of progress and purpose.