Skip to main content
Skip to content
Menu

AI Programming Advanced 3 parts

Diagnose whether your AI tool's recent decline is degrading your team's shipping velocity

You'll have a quantified baseline of your AI-assisted coding output quality (defect rate, review cycles, time-to-merge) and clear evidence of whether tool performance changes are affecting real delive

What you'll make

AI Tool Quality Assessment

  1. Quality Baseline: defect rates and review cycles
  2. Performance Comparison: before vs current metrics
  3. Impact Analysis: correlation with shipping velocity

The 3 parts

Each part ends with a check you can see.

  1. Measure Current Output Quality

    Track your AI-assisted code quality using defect rates and review metrics from recent work.

    Done when

    You have baseline quality metrics for 10+ recent AI-assisted commits with defect counts and review cycle data.

  2. Test Against Historical Quality

    Compare current AI tool performance to earlier periods to identify degradation patterns.

    Done when

    You have before/after quality comparison showing whether tool performance changed, with specific metrics that either confirm or refute degradation.

  3. Measure Shipping Velocity Impact

    Quantify how AI tool quality changes affect your team's actual delivery speed and throughput.

    Done when

    You have velocity correlation data showing whether tool quality changes affect shipping speed, with evidence to either continue current tools or justify switching.

    Capstone: you put together your AI Tool Quality Assessment.

Where this helps

An elective: a single lesson that sits outside rtwo's job certificates and doesn't count toward one.

About this lesson

What you'll be able to do

  • Measure your AI coding tool's actual quality output using defect tracking
  • Distinguish tool degradation from workflow changes using baseline comparisons
  • Make evidence-based decisions about switching or adapting coding tools

Who it's for

  • Development teams using AI coding tools daily
  • Engineering managers tracking team velocity
  • Senior developers who've noticed their AI tool 'feels different' lately

What it won't cover

  • How to build AI coding tools
  • Prompt engineering optimization techniques
  • Predictions about which AI tools will improve

Skills you'll practise

  • Quality baseline measurement
  • Tool performance analysis
  • Workflow impact assessment
  • Evidence-based tool evaluation