6 topics covered

Listen to today's briefing
0:00--:--

AI Boosts Student Grades Without Evidence of Real Learning

What happened: A randomized experiment at Bocconi University with over 1,000 freshmen found that GPT-4o significantly improved assignment grades while a causal reasoning lesson fostered deeper thinking—but neither approach actually tested whether students learned or retained knowledge.

Key details:

  • GPT-4o access boosted grades by nearly a full point on a 5-point scale for a marketing assignment task
  • Students with GPT-4o generated about two more ideas on average, had more logically coherent answers, and more closely matched expert recommendations
  • The grading rubric favored conventional answers; stronger falsifiability and greater idea divergence actually correlated with lower scores
  • A causal reasoning lesson didn't raise traditional scores but pushed students toward more diverse solutions and deeper explanations of cause and effect
  • There was no follow-up test where students had to demonstrate what they actually understood or retained without ChatGPT
  • The study only tested performance on a single narrow marketing task at one university among freshmen
  • Randomization occurred across 13 class sections rather than individually
  • OpenAI was involved in the research and several authors work at OpenAI
  • Prior studies show that when AI is removed, participants who primarily used it for direct answers perform worse than control groups; long-term exam scores declined 18 to 24 percent in a 30-month study of over 26,000 Chinese students

Why it matters: AI can polish student work to match expert standards without requiring the student to understand the underlying concepts. Current grading systems reward output quality, not learning or understanding, making it easy to use AI as a cheating tool rather than a learning aid. This creates a false signal that students are learning when they may only be outsourcing cognition.

Practical takeaway: Educators should explicitly measure retention and independent thinking rather than final output quality. Design assignments that require students to justify their reasoning and make novel decisions—criteria that are harder to fake with AI assistance.

Anthropic Cuts Claude Code Usage Limits After Temporary Boost Expires

What happened: Anthropic is effectively reducing Claude Code's weekly usage limits by 17 percent when a temporary boost expires on September 14, replacing it with a smaller permanent increase.

Key details:

  • A temporary 50 percent boost to usage limits expires September 14, 2026
  • Starting September 14, baseline limits for Pro, Max, Team, and Enterprise plans will increase by 25 percent over the original baseline
  • Anthropic says it's working on changes to "make it feel like you're getting more from Claude" and will provide more control and transparency over usage
  • The company has also shipped performance optimizations and an automatic feedback tool that generates bug reports users can review and submit

Why it matters: The change reflects resource constraints as Anthropic scales operations. While framed as a permanent increase, the timing creates a net reduction in available capacity and signals growing pressure to manage compute costs and capacity allocation.

Practical takeaway: Users should review and adjust their Claude Code workflows before September 14 to account for the reduced effective limits. Consider tiering tasks by priority to maximize utility within lower available capacity.

AI Agents Show Critical Limitations in Time Awareness and Self-Assessment

What happened: A new study finds that popular AI coding assistants lack any sense of time and consistently misjudge both task duration and the quality of their own work.

Key details:

  • Claude Code and OpenAI's Codex systematically overestimate how long tasks will take: Claude was off by three times on average, Codex by six to ten times
  • On ProgramBench, both models guessed around 90 minutes regardless of task difficulty
  • Both models overrated their own work by approximately 20 percentage points on average; in one case, both scored themselves at 70 percent success when actual scores were 7 and 14.5 percent
  • Claude Code runs for a median of 90 minutes, while Codex stops after roughly 30 minutes, despite using the same underlying language model
  • When agents were given access to a tool that reports elapsed time, they achieved accurate time estimation nearly every time
  • The research was conducted by two independent AI researchers as part of the MATS program on 200 tasks from ProgramBench and 18 custom benchmarks

Why it matters: For long-running autonomous tasks, inaccurate time perception makes agents difficult to control and creates oversight problems. This limitation is particularly concerning as AI agents take on more unsupervised work and operate for extended periods without human intervention.

Practical takeaway: When deploying AI agents for long-duration tasks, provide them explicit tools to track elapsed time rather than relying on their internal time sense. Monitor both task-estimate accuracy and self-assessment calibration as key metrics for production readiness.

AI-Generated Content Threatens Entertainment Labor in China and Raises Detection Challenges

What happened: AI-generated video is rapidly displacing human entertainment workers in China while musicians worldwide are forming communities to identify and call out AI-generated music passing as human work.

Key details:

  • In Q1 2026, approximately 128,000 short dramas were released in China; 95 percent were AI-generated, compared to three times the total output for all of 2025
  • One minute of AI video production costs $90 to $120, approximately 10 percent of production costs with human actors
  • The Chinese short drama industry employs 690,000 people directly and generates 15 million livestreaming jobs
  • Some actors are forced to hand over their voice and likeness to AI tools before being fired
  • AI-related labor disputes have risen over the past two to three years, according to lawyers
  • EDM producers like Max Harris and Nihil Young are documenting AI-generated tracks on platforms like Suno, identifying acoustic artifacts including stuttering vocals, persistent hissing from model white-noise processing, and glossy visual artifacts
  • Suno's Simple Mode allows song generation by selecting a genre and clicking a button with essentially zero creative input
  • As of reporting, AI songs account for over 50 percent of new uploads on platforms like Deezer

Why it matters: AI-generated content is reaching economic scale while detection methods remain unreliable. The cost advantage (10 percent of human labor) creates structural economic pressure to replace human workers. Meanwhile, growing difficulty distinguishing AI from human content erodes trust in entertainment platforms and creator authenticity.

Practical takeaway: Platforms and listeners should implement transparent AI-generated content labeling and support development of reliable detection tools. Content creators in entertainment should document their processes publicly as a trust-building measure against AI impersonation.

Anthropic Faces Major Copyright Lawsuit from Music Publishers

What happened: Sony Music, Warner Music, and other major publishers have sued Anthropic in federal court, alleging the company used tens of thousands of copyrighted musical compositions to train Claude models without permission.

Key details:

  • Plaintiffs seek up to $150,000 per infringed work and up to $25,000 per violation for unlawful removal of copyright management information
  • The lawsuit names CEO Dario Amodei and co-founder Benjamin Mann as individual defendants
  • Anthropic allegedly torrented at least seven million books from pirate libraries LibGen and PiLiMi, and scraped song lyrics from licensed platforms MusixMatch and LyricFind
  • Plaintiffs claim Anthropic trained at least one commercial Claude model on synthetic data generated by a non-commercial model trained on pirated content
  • Specific songs named in the complaint include "Ain't No Mountain High Enough" by Marvin Gaye and Tammi Terrell, "Livin' On a Prayer" by Bon Jovi, "September" by Earth, Wind & Fire, "Hallelujah" by Leonard Cohen, and "Paper Rings" by Taylor Swift
  • This follows Anthropic's $1.5 billion settlement with authors and publishers in September 2025 for using pirated books during training

Why it matters: The lawsuit targets the same vulnerability that sank Anthropic in the previous settlement—acquiring copyrighted data through illegal means, not merely using it. This sets a precedent that could extend to other AI companies and reveals ongoing compliance challenges in AI training data sourcing.

Practical takeaway: Companies training AI models should audit their data acquisition methods for legal compliance, not just data use. The repeated pattern of liability suggests that data sourcing practices remain a critical legal and reputational risk.

Google's WikiSkill Framework Boosts AI Agent Performance Through Persistent Memory

What happened: Google Research introduced WikiSkill, a framework that gives AI agents persistent memory of past failures and successes, enabling them to improve performance over time through evolved skill instructions.

Key details:

  • WikiSkill organizes agent learning into three layers: Raw Layer (execution traces), Wiki Layer (structured insights), and Skill Layer (active procedural instructions)
  • On average, WikiSkill boosted Gemini-3.5-Flash from 49.5 percent to 68.1 percent performance and Qwen-3.6-27B from 39.4 percent to 63.3 percent
  • Individual benchmark improvements were larger: Gemini-3.5-Flash jumped from 33.0 percent to 72.6 percent on LiveMath and from 50.5 percent to 76.6 percent on SpreadSheet
  • Framework was tested across five benchmarks covering math reasoning, web search, spreadsheet manipulation, document question-answering, and interactive virtual environment tasks
  • Models tested included Qwen (4B, 9B, 27B), Gemma-4-31B, and Gemini-3.5-Flash
  • Smaller models running WikiSkill can match the performance of larger models without the framework
  • Skills developed by one model often transfer to another model

Why it matters: WikiSkill addresses a fundamental limitation of AI agents—the inability to learn continuously during deployment. By documenting and evolving task procedures without retraining, it enables smaller models to compete with larger ones and reduces the need for constant model updates.

Practical takeaway: Implement persistent skill documentation systems for deployed AI agents to capture learned patterns and failure modes. This approach is particularly valuable for cost-constrained deployments where smaller models need to match larger-model performance.