Quick Comparison
| Method | Best For | Setup Time | Key Benefit |
|---|---|---|---|
| GitHub App | PR validation & CI/CD | 2 minutes | Zero-config with test promotion |
| Manual | Development & debugging | Immediate | Interactive test creation |
| Scheduled | Production monitoring | 5 minutes | Automated regression testing |
| API | Custom integrations | 10 minutes | Full programmatic control |
Execution Methods
GitHub App
Recommended for GitHub usersAutomatic PR testing with zero configuration. Tests created on feature branches automatically promote to production when merged.
Manual Execution
For development and debuggingRun tests on-demand through Keystone Studio or CLI. Perfect for test creation and troubleshooting.
Scheduled Tests
For continuous monitoringSet up recurring test runs on custom schedules. Ideal for production monitoring and regression testing.
API Integration
For custom workflowsTrigger tests programmatically from any platform. Perfect for non-GitHub CI/CD systems.
Which Method Should I Use?
- I use GitHub
- I use GitLab/Jenkins/Other
- I'm developing tests
- I need monitoring
Start with the GitHub App - It provides:
- Automatic test runs on every PR
- Test promotion when PRs merge
- No API keys in your repo
- Native GitHub status checks
Common Features
Regardless of execution method, all tests benefit from:🤖 AI-Powered Healing
Tests automatically adapt to UI changes, reducing maintenance by up to 90%📸 Rich Debugging Artifacts
- Video recordings of every run
- Screenshots at each step
- Network HAR files
- DOM snapshots
🔧 Flexible Configuration
- Environment-specific settings
- Custom browser configurations
- Parallel execution support
- Retry mechanisms
Getting Started
1
Choose Your Method
Review the comparison above to select the best execution method for your needs
2
Follow Setup Guide
Click on your chosen method’s card to access detailed setup instructions
3
Configure & Run
Follow the specific guide to configure and execute your first test