Pilot and validation plan
Verify the experience
before release.
Collect actual learning time, test the decisions and confirm that the materials work on the devices learners use.
A small practical pilot
Propose an initial pilot with 6–8 clinicians reflecting the primary audience, including primary-care PAs/NPs and physicians. This is a usability and timing sample, not a powered effectiveness study. The provider determines the final sampling plan. No learner honoraria are included in the planning budget.
Observe the complete enduring route and record active time, interruptions, optional media use and time spent reading, deciding and reviewing feedback. Use the existing activity timed-pilot worksheet. Do not add reading and viewing of equivalent recap content as if both were required learning time. Report individual times, median and range, plus the route used.
Ask participants to explain why they chose the case answers. Look for ambiguous stems, multiple defensible choices, implausible distractors and unintended clues. Review parallel live variants for comparable concepts and cognitive demands. Revise and recheck any material problem before approving the item version.
If the observed required route does not support the intended duration, revise the educational design or the proposed credit with the provider. The enduring 90–110-minute design estimate must not be converted into verified learning time by adding inactivity, forced playback or an unnecessary assignment.
Rehearse each live session
Run the session with the actual faculty, moderator and technical team. Time baseline polling, evidence framework, progressive case discussion, audience questions, post cases and evaluation separately. Use the prepared discussion prompts if audience questions are sparse; do not assume a 60-minute duration from the number of slides.
Confirm the platform records the first submitted pre/post response, item version and verified attendance; distinguish a retry from a first response. Check that the answer key is not displayed before the independent response is locked. Confirm who monitors questions and follows up on unanswered clinical issues.
Record technical and accessibility problems, their owner and resolution. The provider approves the final duration, attendance/completion rules, distinct-content/repeat-credit policy and release.
Specific device and media checks
| Check | What must be demonstrated |
|---|---|
| iPhone / Safari and Android / Chrome | Readable portrait layout; usable controls without horizontal overflow; captions do not hide clinically relevant text; all required steps and downloads work |
| Keyboard and screen reader | Logical headings and focus order; named controls; radio-group/feedback announcements; Back/Next focus; no keyboard traps |
| Media listening | Listen end to end; verify pronunciation, numbers, pauses, scene transitions and consistency with the approved transcript |
| Captions and alternatives | Selectable caption files attached; captions synchronized and readable; full recap transcript/audio available; no extra playback completion rule |
| Saved progress and certificates | Resume without losing first attempts; qualifying pass retained; approved identity, credit wording, record retention and certificate retrieval work on the host |
| Reviewer access | Named reviewers can open the materials in their own accounts; no private patient or learner records included in shared links |
Evidence to collect
- Five-item learner preference and barrier survey
- Blank results table with delivery/response denominators
- Live rehearsal timing and acceptance record
- Clinical and assessment issue-resolution log
These are executable review instructions and blank records. The pilot, human clinical signoff, real-device walkthrough, full listening and reviewer-access verification have not been completed by creating these materials.