CITATION — REFERENCE ENTRY

AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting — Scientific Reports

Revision 3e762cac-e5e2-487c-993a-95a01f468a24 · 9/26/2026, 3:06:47 PM UTC
Key
kestin-2025-ai-tutoring-active-learning
Authors
Kestin, Greg; Miller, Kelly; Klales, Anna; Milbourne, Timothy; Ponti, Gregorio
Issued
2025-6-3
Type
article-journal
Container
Scientific Reports
Volume
15
Issue
1
Pages
17458
Raw CSL JSON
{
  "DOI": "10.1038/s41598-025-97652-6",
  "URL": "https://www.nature.com/articles/s41598-025-97652-6",
  "page": "17458",
  "type": "article-journal",
  "issue": "1",
  "title": "AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting",
  "author": [
    {
      "given": "Greg",
      "family": "Kestin"
    },
    {
      "given": "Kelly",
      "family": "Miller"
    },
    {
      "given": "Anna",
      "family": "Klales"
    },
    {
      "given": "Timothy",
      "family": "Milbourne"
    },
    {
      "given": "Gregorio",
      "family": "Ponti"
    }
  ],
  "issued": {
    "date-parts": [
      [
        2025,
        6,
        3
      ]
    ]
  },
  "volume": "15",
  "container-title": "Scientific Reports"
}

Claims

  1. The authors estimate the effect size of the AI tutor at 0.73 to 1.3 standard deviations, noting that the linear-regression estimate of 0.63 is an underestimate because of a ceiling effect.
    "While the linear regression suggests an effect size of 0.63, this is an underestimation due to ceiling effect"
    Locator: section: Results · Quote language: en
  2. In a randomized crossover trial with 194 Harvard introductory physics students, students using a purpose-built GPT-4 tutor learned more in less time (median 49 minutes) than in an in-class active learning lesson, and reported higher engagement and motivation.
    "We find that students learn significantly more in less time when using the AI tutor, compared with the in-class active learning. They also feel more engaged and more motivated."
    Locator: section: Abstract · Quote language: en
  3. The authors caution that structured AI tutoring may not outperform active learning in all contexts, such as those requiring synthesis of multiple concepts and higher-order critical thinking.
    "we do not presume that structured AI tutoring will always outperform in-class active learning in all contexts, for example, those requiring complex synthesis of multiple concepts and higher-order critical thinking."
    Quote language: en
Available in