What is this course about?
Most AI tutors optimize for the wrong thing. A tutor that answers quickly produces high satisfaction and low learning, and the two metrics move in opposite directions. This course covers the design decisions that separate a tutor from an answer service — scaffolding, withholding, misconception diagnosis — and the measurement discipline needed to prove a learning effect rather than an engagement one.
Who is this course for?
- Directors of tutoring and learning centers
- Faculty developing course-embedded AI support
- Instructional designers
- Institutional research staff evaluating learning interventions
What do I need before starting?
- Familiarity with one course's learning objectives and common student errors
- No technical background required
What will I be able to do afterwards?
- Explain why answer-giving tutors improve satisfaction and depress learning
- Implement Socratic scaffolding as a system-level policy rather than a prompt trick
- Design misconception detection that diagnoses the mental model, not the answer
- Ground a tutor in your own course materials so it teaches your curriculum
- Design an outcome evaluation that would survive institutional research review
What does each module cover?
Why do students rate answer-giving tutors highest?
40 minThe core tension of the course: the metric that is easiest to move is the one least connected to learning.
Objectives
- Describe the divergence between satisfaction and learning gain
- Identify the design choices that trade one for the other
- Set an explicit position on the trade before building anything
Topics
Activity. Compare transcripts from an answer-giving and a withholding tutor and predict each one's ratings.
How do you implement Socratic scaffolding that holds up?
55 minScaffolding as an enforced policy, and the failure modes that appear when a determined student pushes.
Objectives
- Specify a scaffolding policy at the system level
- Anticipate and test the ways students defeat withholding
- Calibrate hint progression to the learner's demonstrated state
Topics
Activity. Red-team your own tutor by trying to extract a direct answer, then patch what worked.
How do you diagnose the misconception rather than the error?
55 minThe distinguishing capability of a real tutor: identifying the wrong mental model behind a wrong answer.
Objectives
- Build a misconception catalog for one topic
- Design diagnostic questions that discriminate between misconceptions
- Route remediation by diagnosed model rather than by error
Topics
Activity. Build a misconception catalog for one topic you teach and encode it into the tutor.
How do you make the tutor teach your curriculum?
50 minGrounding in course materials so notation, method, and sequence match what the instructor actually taught.
Objectives
- Ground a tutor in course materials and instructor notation
- Handle divergence between the textbook and the internet's default method
- Keep grounding current as the course evolves
Topics
Activity. Ground the tutor in one unit's materials and test it on problems using your notation.
How do you measure learning rather than usage?
50 minEvaluation design that produces evidence rather than a dashboard.
Objectives
- Design a pre/post assessment tied to learning objectives
- Construct a defensible comparison condition
- Pre-register the analysis to prevent post-hoc metric selection
Topics
Activity. Draft an evaluation protocol and submit it to institutional research for critique.
Where is the line between tutoring and doing the assignment?
45 minIntegrity boundaries built into the tutor rather than left to the student's judgment.
Objectives
- Define the integrity boundary for specific assignment types
- Implement assignment-aware behavior changes
- Design disclosure so instructors know how the tutor was used
Topics
Activity. Write the integrity policy for three assignment types and encode the tutor's behavior for each.
How do you make the tutor usable by every student?
45 minAccessibility and multilingual support treated as core requirements rather than later additions.
Objectives
- Apply WCAG conformance to a conversational tutoring interface
- Support multilingual learners without degrading precision
- Test with assistive technology and real users
Topics
Activity. Run an accessibility audit of the tutor with a screen reader and log every failure.
Building a course-grounded tutor with a withholding policy
60 minThe hands-on module: deploying a tutor with configurable withholding and a misconception catalog.
Objectives
- Deploy a tutor grounded in real course materials
- Configure the withholding policy per assignment type
- Validate against the red-team and accessibility suites
Topics
Activity. Deploy the tutor for one unit and pilot it with five students, recording every place it over-helped.
What is the capstone project?
Course-embedded tutor with a pre-registered evaluation
Design and deploy a tutor for one real course unit, including the misconception catalog, withholding policy, integrity boundaries, accessibility conformance, and a pre-registered evaluation with a comparison condition.
Deliverable: A deployed tutor plus an evaluation protocol accepted by institutional research.
How are learners assessed?
- Red-team exercise — the learner's tutor must resist direct-answer extraction
- Misconception catalog reviewed for diagnostic discrimination
- Capstone evaluated on measurement rigor, not tutor polish
What ships with the course?
Facilitator guide
Session-by-session running order, discussion prompts, and the questions that reliably derail a room.
Learner workbook
Exercises, checklists, and the templates each module's activity produces.
Hands-on lab environment
A sandboxed ibl.ai deployment so exercises run against real agents, not screenshots.
Assessment bank
Scenario questions and rubric criteria mapped to each stated learning outcome.
Source bibliography
Every primary regulation and standard cited on this page, linked and dated.
Which AI agents does this course use?
The hands-on modules run against agents already deployable on the ibl.ai platform for higher education.
Where does the course material come from?
Every module is grounded in primary sources — the regulation, standard, or research itself, not a summary of it. Each was resolved at authoring time.
- Office of Educational Technology
U.S. Department of Education
Federal guidance on AI in teaching and learning, framing the design principles.
- AI and the Future of Teaching and Learning
U.S. Department of Education
The report's guidance on human-in-the-loop instructional design.
- AI Index Report
Stanford HAI
Baseline evidence on model capability and reliability in educational tasks.
- Web Content Accessibility Guidelines
W3C
Conformance target for the accessibility work in Module 7.
Delivery notes
Binding guidance for anyone preparing and delivering this course.
- The red-team exercise in Module 2 is the course's signature. Build a library of extraction attempts from real student behavior — flattery, false premises, claiming the deadline passed, role-play — and keep adding to it.
- Module 3 needs a genuine misconception catalog from a real discipline. Physics force concepts and introductory statistics are both well documented; pick one and build it properly rather than sketching several.
- Be honest in Module 1 that the evidence base for AI tutoring effect sizes is still thin. Do not manufacture a headline number — the course's credibility with institutional research depends on this.
- The integrity module must not become a surveillance design session. Frame disclosure as instructor visibility into how the tool was used, not monitoring of the student.
- Accessibility testing needs a real screen reader user in the room. A sighted facilitator tabbing through is not a substitute and should not be presented as one.
Why run AI training on a platform you own?
You own the course, not a licence to it
Course content, learner data, and the platform run inside your perimeter — you own all the code and the data.
Model-agnostic delivery
Run the course's AI components on any LLM — Claude, GPT, Llama, Gemini, Command — and switch anytime.
No per-seat training licences
Usage-based or self-hosted, so cost tracks actual use rather than headcount.
Deploy anywhere
Cloud, private VPC, on-premise, or fully air-gapped — including for cohorts that cannot use public AI tools.
Frequently asked questions
What does the AI Tutoring That Improves Outcomes, Not Just Engagement course cover?
Most AI tutors optimize for the wrong thing. A tutor that answers quickly produces high satisfaction and low learning, and the two metrics move in opposite directions. This course covers the design decisions that separate a tutor from an answer service — scaffolding, withholding, misconception diagnosis — and the measurement discipline needed to prove a learning effect rather than an engagement one. It runs 6 hours across 8 modules across 8 modules, at intermediate level, and closes with a capstone: Course-embedded tutor with a pre-registered evaluation.
Who should take AI Tutoring That Improves Outcomes, Not Just Engagement?
It is written for Directors of tutoring and learning centers, Faculty developing course-embedded AI support, Instructional designers, Institutional research staff evaluating learning interventions. Prerequisites: Familiarity with one course's learning objectives and common student errors; No technical background required.
Can we run this course on our own infrastructure?
Yes. ibl.ai is model-agnostic and deploy-anywhere — cloud, private VPC, on-premise, or fully air-gapped — and you own all the code and the data. Cohort data, submissions, and any material learners upload stay inside your perimeter, which matters for higher education teams that cannot send work to a public AI tool.
How do we get access to AI Tutoring That Improves Outcomes, Not Just Engagement?
Request access and we will set it up for your cohort — hosted by ibl.ai, or running against your own deployment. Tell us the group size and timing you need, and whether it should run inside your own perimeter.
How much does AI training for higher education cost on ibl.ai?
There is no per-seat pricing — you pay for usage or self-host and pay only for the infrastructure, so a 5,000-person rollout does not cost 5,000 licences. 1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.