
Record a 6-minute demo showing how you'd evaluate an AI trading bot's live performance vs. backteste
You'll have a recorded walkthrough demonstrating how to inspect an autonomous agent's real execution history, verify its reported metrics, and spot red flags that backtest results hide.
What you'll make
Trading Bot Performance Audit Demo
- Open: the performance claim and why it matters
- Setup: accessing execution data vs backtest reports
- Audit: live verification workflow in real time
- Red flags: where execution diverged from expectations
- Wrap: the checklist you'd use tomorrow
Upload a screen-recorded video showing your actual verification process on real or simulated trading data
The 4 parts
Each part ends with a check you can see.
Map Performance Claims vs Reality
Collect the bot's reported metrics and identify what data you'd need to verify each claim independently
Done when
A side-by-side comparison of reported performance vs the verification data you can actually access, with gaps clearly marked
Trace Live Execution vs Backtest
Walk through actual trade execution data to find where live performance diverged from backtested expectations
Done when
At least 3 specific examples where live execution differed from what backtesting would predict, with timestamps and trade details
Build Your Red Flag Checklist
Codify the warning signs that indicate an AI trading system is underperforming its reported metrics
Done when
A documented checklist of 5-7 specific red flags with concrete thresholds and examples from your audit
Record the Performance Audit
Screen-record yourself walking through the complete verification process on real trading bot data
Done when
A 6-minute video demonstrating the audit methodology from performance claims through red flag identification
Capstone: you put together your Trading Bot Performance Audit Demo.
Where this helps
An elective: a single lesson that sits outside rtwo's job certificates and doesn't count toward one.
About this lesson
What you'll be able to do
- Record a 6-minute demo showing live performance verification for an AI trading agent
- Identify 3-5 red flags where backtested results hide real-world failures
- Have a documented checklist for auditing autonomous agent performance claims
Who it's for
- Anyone evaluating AI trading systems or autonomous financial agents
- People who need to verify AI performance claims beyond marketing materials
- Traders or analysts who've been burned by backtesting overfitting
What it won't cover
- Building trading algorithms or writing financial models
- Setting up brokerage APIs or live trading infrastructure
- Investment advice or specific trading strategies
Skills you'll practise
- Live performance verification against historical claims
- Autonomous agent audit methodology
- Red flag detection in AI system reporting
- Technical postmortem analysis for system failures