xAPI at Scale

600% More Learning Data

Project Background:

In 2024, the LCMS I manage recorded nearly 80 million interactions from more than 130,000 unique users. Every one of those interactions is a statement: a learner opening a learning material, visiting a page in a self-paced course or paperless guide, or making a granular selection in courses we build. A few years earlier, none of that signal existed. Learning teams could tell you a course was completed, and not much else. Completions and seat time don't tell you where learners struggle, what they revisit, or which content actually gets used. Finally after working with multiple vendors towards this goal, we had the technical capability to capture richer data - but capability isn't adoption.

From 2020 to 2023, a new deliverable I supported called the paperless guide replaced print-based participant workbooks with persistent HTML documents, and because every page visit generates a statement, interaction data began climbing. In 2023, my team internally tested and validated vendor platforms to confirm the organization was ready for xAPI at scale.

2024 was the adoption push. Rather than mandate anything, I championed xAPI through the learning technology community of practice I lead: what it is, why it matters, how to build content in our authoring tools, and most importantly what the resulting data makes possible. I paired those sessions with direct partnership, working alongside designers from several lines of business to design, develop, and deploy their first xAPI deliverables. The result was a 600% increase in xAPI data generation across our learning organization.

The payoff is what the data reveals. Month-by-month engagement now tells a story leadership can act on: an early-summer peak driven by a company-wide code of conduct and workplace policy push, and an early-fall peak driven by new-hire welcome content, brand onboarding, and security and compliance training. One business unit we partnered with went further, using their engagement data to shape their learning strategy, improve existing training content, and decide where to focus their resources.

That's the shift this project was always about: from delivering content to reading the signal it generates. My director summed it up better than I could: "It's hard to express how transformative this is for the company."

What was my role in this project?

  • Identified the gap between completion-only reporting and the engagement questions stakeholders were actually asking

  • Helped onboard learning design teams into the content hub, one business unit at a time, building the user base that would later generate the data

  • Supported the shift from print workbooks to paperless HTML guides, the deliverable that first proved page-level interaction data was worth collecting

  • Internally tested and validated vendor platforms to confirm the organization was ready for xAPI at scale

  • Led community of practice sessions that taught xAPI concepts, how to build and deploy in our tools, and highlighted use cases across every learning team in the organization

  • Partnered directly with designers in several lines of business to design, develop, and deploy their first xAPI deliverables

  • Established standards, from page-level statements to granular UI selections, so data from different teams could be compared and trusted

  • Helped a partner business unit use their engagement data to inform learning strategy, improve content, and focus resources

  • Presented engagement results to leadership and used early wins to recruit more teams into the practice

This project was made with the following tools:

xyleme-client-logo.png

Xyleme

xAPI

Previous
Previous

GUIDE: Open-Source Instructional Design Evaluation

Next
Next

Coaching at Scale: Developing Hundreds of Designers