Skip to main content
Skip to content
Menu

Grok Intermediate 3 parts Updated

Map your AI vendor's health signals

You'll have a one-page tracker showing which red flags (leadership shifts, public admissions of problems, financial stress) matter most to your choice of AI tools.

What you'll make

AI Vendor Health Tracker

  1. Current Vendor Profile: model versions and usage patterns
  2. Red Flag Thresholds: specific signals that trigger evaluation
  3. Health Monitoring: monthly tracking metrics
  4. Decision Triggers: when to start vendor search vs when to switch immediately

Write as a decision dashboard you'd actually check monthly

The 3 parts

Each part ends with a check you can see.

  1. Test Your Vendor's Claims

    Run actual tasks through your current AI vendor and measure performance against their published benchmarks.

    Done when

    You have measured your vendor's actual performance on 3-4 of your real tasks and compared it to their published benchmark scores

  2. Spot the Marketing Patterns

    Compare your vendor's announcement language to competitors' announcements to identify which performance claims are meaningful vs standard marketing.

    Done when

    You can identify 3-5 specific warning signs in AI vendor announcements that indicate performance problems or competitive pressure

  3. Calibrate Your Risk Tolerance

    Define specific numeric thresholds for when vendor changes trigger evaluation vs immediate action based on your actual switching costs.

    Done when

    You have specific thresholds for 5+ vendor health signals that account for your switching costs and risk tolerance

    Capstone: you put together your AI Vendor Health Tracker.

Where this helps

An elective: a single lesson that sits outside rtwo's job certificates and doesn't count toward one.

About this lesson

What you'll be able to do

  • Track 5-7 specific health signals for your current AI vendor with concrete thresholds
  • Identify which vendor changes actually affect your work vs which are just noise
  • Have a documented decision framework for when to switch AI tools
  • Know what questions to ask when evaluating new AI vendors

Who it's for

  • Teams using AI tools in production who need to stay ahead of vendor instability
  • Anyone choosing between AI vendors who wants to move beyond marketing claims
  • People managing AI tool budgets who need early warning of price changes or service degradation

What it won't cover

  • Technical model evaluation or running your own benchmarks
  • Legal contract negotiation or enterprise procurement
  • Building your own AI models as vendor alternatives
  • Predicting which specific AI companies will succeed long-term

Skills you'll practise

  • Performance measurement and tracking
  • Marketing claim verification
  • Risk threshold calibration