
Map your AI vendor's health signals
You'll have a one-page tracker showing which red flags (leadership shifts, public admissions of problems, financial stress) matter most to your choice of AI tools.
What you'll make
AI Vendor Health Tracker
- Current Vendor Profile: model versions and usage patterns
- Red Flag Thresholds: specific signals that trigger evaluation
- Health Monitoring: monthly tracking metrics
- Decision Triggers: when to start vendor search vs when to switch immediately
Write as a decision dashboard you'd actually check monthly
The 3 parts
Each part ends with a check you can see.
Test Your Vendor's Claims
Run actual tasks through your current AI vendor and measure performance against their published benchmarks.
Done when
You have measured your vendor's actual performance on 3-4 of your real tasks and compared it to their published benchmark scores
Spot the Marketing Patterns
Compare your vendor's announcement language to competitors' announcements to identify which performance claims are meaningful vs standard marketing.
Done when
You can identify 3-5 specific warning signs in AI vendor announcements that indicate performance problems or competitive pressure
Calibrate Your Risk Tolerance
Define specific numeric thresholds for when vendor changes trigger evaluation vs immediate action based on your actual switching costs.
Done when
You have specific thresholds for 5+ vendor health signals that account for your switching costs and risk tolerance
Capstone: you put together your AI Vendor Health Tracker.
Where this helps
An elective: a single lesson that sits outside rtwo's job certificates and doesn't count toward one.
About this lesson
What you'll be able to do
- Track 5-7 specific health signals for your current AI vendor with concrete thresholds
- Identify which vendor changes actually affect your work vs which are just noise
- Have a documented decision framework for when to switch AI tools
- Know what questions to ask when evaluating new AI vendors
Who it's for
- Teams using AI tools in production who need to stay ahead of vendor instability
- Anyone choosing between AI vendors who wants to move beyond marketing claims
- People managing AI tool budgets who need early warning of price changes or service degradation
What it won't cover
- Technical model evaluation or running your own benchmarks
- Legal contract negotiation or enterprise procurement
- Building your own AI models as vendor alternatives
- Predicting which specific AI companies will succeed long-term
Skills you'll practise
- Performance measurement and tracking
- Marketing claim verification
- Risk threshold calibration