TestPilot Dashboard
Central command center for monitoring test execution activities and metrics.
Dashboard Overview
The TestPilot Dashboard provides real-time visibility into test execution status, performance metrics, project health, and resource utilization. Monitor your testing operations at a glance and drill down into details when needed.
Features: Real-time Updates, Customizable Views, Historical Trends, Interactive Charts
Key Metrics
Total Projects
Total number of test projects (releases) in the system.
- Calculation: Count of all active and archived projects
- Use Cases:
- Track organizational testing scope
- Monitor project growth over time
- Capacity planning
Active Test Runs
Number of test runs currently in progress.
- Calculation: Count of test runs with "In Progress" status
- Use Cases:
- Monitor ongoing test activities
- Identify resource bottlenecks
- Real-time execution tracking
Status Indicators:
- Running: Test execution in progress
- Pending: Waiting to start
- Blocked: Execution halted due to errors
Completed Tests
Total test executions completed in the current month.
- Calculation: Sum of all test executions with any final status
- Use Cases:
- Measure testing productivity
- Track monthly testing velocity
- Compare month-over-month performance
Pass Rate
Percentage of successful test executions.
- Calculation: (Passed Tests / Total Executed Tests) x 100
- Use Cases:
- Quality indicator
- Release confidence metric
- Identify quality trends
Quality Thresholds:
-
= 90%: Excellent quality
- 70-89%: Acceptable with improvements needed
- < 70%: Critical quality issues
Charts & Visualizations
Execution Trend Chart
Track test execution patterns over time.
Displays:
- Daily/Weekly/Monthly execution counts
- Pass/Fail trends
- Execution velocity changes
Insights:
- Peak testing periods
- Quality trends over time
- Capacity planning data
Available Timeframes: Last 7 Days, Last 30 Days, Last 3 Months, Last 12 Months, Custom Range
Pass Rate Trend
Monitor quality metrics over time.
Displays:
- Historical pass rates
- Quality improvement/decline
- Sprint-over-sprint comparison
Insights:
- Quality stability assessment
- Impact of process changes
- Predictive quality analysis
Test Status Distribution
Current state of all tests.
Displays:
- Passed, Failed, Blocked counts
- Not Run, In Progress, Skipped
- Real-time status updates
Insights:
- Immediate attention areas
- Resource allocation needs
- Execution progress
Active Projects
View and monitor your currently active test projects directly from the dashboard.
Example Project View
| Project | Status | Progress | Passed | Failed | Not Run | Due Date |
|---|---|---|---|---|---|---|
| Sprint 23 - Payment Module | Green | 75% | 90 | 5 | 25 | 2 days remaining |
| Release 2.3.0 - Security Features | Yellow | 60% | 48 | 8 | 24 | 5 days remaining |
| Hotfix 2.2.1 - Login Fix | Red | 40% | 12 | 6 | 12 | Overdue by 1 day |
Dashboard Customization
Widget Management
- Show/Hide Widgets: Toggle visibility of dashboard components
- Reorder Widgets: Drag-and-drop to rearrange
- Resize Widgets: Adjust widget dimensions
- Add Custom Widgets: Create personalized views
Metric Selection
- Choose KPIs: Select from 14 available metrics
- Custom Calculations: Define your own formulas
- Threshold Alerts: Set warning levels
- Comparative Views: Compare multiple metrics
Filter Preferences
- Default Filters: Set your preferred filters
- Saved Filter Sets: Quick access to common views
- Team Filters: Share filters with team
- Auto-Refresh: Configure update intervals
Tips for Success
Monitor Key Metrics
Focus on pass rate and active test runs for daily health checks.
Track Trends
Use historical charts to identify patterns and predict future issues.
Set Up Alerts
Configure notifications for critical metrics falling below thresholds.
Regular Reviews
Review dashboard daily in standup, weekly with stakeholders.
Troubleshooting
Metrics not updating
- Check auto-refresh setting (default: 30 seconds)
- Manually refresh browser
- Verify test runs are active
- Check network connectivity
Charts not displaying
- Ensure JavaScript enabled
- Clear browser cache
- Try different browser
- Check date range filter
Slow dashboard performance
- Reduce number of visible widgets
- Shorten time range (e.g., last 30 days)
- Disable auto-refresh temporarily
- Use filters to limit data scope
Next Steps
- Projects Management - Organize test projects
- Test Runs - Execute test campaigns
- Reports & Analytics - Generate insights
- Best Practices - Proven strategies
