Playtest Pilot is a Unity QA bot that helps automate parts of the playtesting process. It tests gameplay, settings, hardware and performance profiles, and basic exploit or security-related issues, then generates a report showing what broke.
For our demo, we used Dragon Crashers as the test game and built a workflow that could run checks automatically and present the results in a dashboard.
Playtesting a Unity game can be repetitive, messy, and hard to organize, especially for smaller teams. Playtest Pilot was built to make testing easier, more structured, and more useful for developers.
It also includes hardware-based game settings for a more personalized and smoother gameplay experience. We added this because many in-game settings can be confusing for players, and if they are not configured properly, they can hurt performance or create a frustrating experience.
- Automated Unity playtesting
- Gameplay path validation
- Settings and configuration checks
- Hardware and performance testing
- Basic exploit and security-related checks
- Bug reporting dashboard
- Severity labels for issues
- Hardware-based personalized settings
Our first version focuses on five core tasks:
- Run the game automatically
- Play one short scripted path
- Change a few settings and test them
- Run 2–3 security or logic checks
- Generate a report
For Dragon Crashers, we prioritized tests such as:
- Duplicate reward claim
- Attack cooldown spam
- Invalid state checks, such as attacking while dead or paused
- Fullscreen/windowed switch
- Low vs high graphics preset performance
- Ultrawide UI/layout check
High-level flow:
React Dashboard → FastAPI Backend → Python Host Agent → Unity Bridge / QA Agent → Telemetry Storage
-
Dashboard (React)
Frontend UI for viewing results and interacting with the system. -
Backend (FastAPI, Port 8000)
Main service connecting the dashboard to the automation system. -
Host Agent Server (Python, Port 19091)
Local automation server that communicates with Unity. -
Unity Bridge (C#, Port 9090)
Connects Unity gameplay data and controls to the automation layer. -
QA Agent
Runs automated actions and checks inside Unity. -
Telemetry Storage (JSON + NDJSON)
Stores logs, events, and test results.
- Unity
- Dragon Crashers
- C#
- Python
- JSON / NDJSON
- React
- Vite
- Tailwind CSS
- Framer Motion
- Lucide React
- FastAPI
- Python host agent
- Unity C# bridge
- Cursor
- Claude
- ChatGPT
- Qwen Local
playtest-pilot/
├── frontend/ # React dashboard
├── backend/ # FastAPI backend
├── host-agent/ # Python host agent / automation runner
├── unity-project/ # Unity game integration and hooks
├── telemetry/ # JSON / NDJSON logs and test results
└── README.md