@umangak I created one separate product for conversational agent testing
please provide some feedback and some feature if you need
You can try using below link: Conversational Agents Testing Tool
Full Github Code
Yash-Kavaiya/CESTestSuiteAgent
Video demo :- https://youtu.be/wRfj6Eq2myA
Could you please review @ilnardo92 @sudhirjain @aniketagrawal @mugdhapattnaik @umangak @MarvinLlamas @
Analytics Dashboard
- Pass/fail rate metrics
- Trend analysis over time
- Coverage statistics
- Recent run summaries
Single Conversation Testing
- Real-time conversation simulation
- Intent detection & confidence scores
- Parameter extraction validation
- Page flow verification
Bulk Testing Suite
- CSV file upload support
- Concurrent test execution
- Progress tracking & reporting
- Batch result analysis
Responsible AI Testing
- Automated vulnerability scanning
- Prompt injection & jailbreak detection
- Safety scoring and analysis
- Custom prompt dataset support
- Comprehensive vulnerability reports
AI Analysis
- Automated conversation insights
- Customer satisfaction scoring
- First Contact Resolution (FCR) tracking
- Escalation rate monitoring
- Bulk analysis capabilities








