KnowNonsense VR provides an immersive virtual reality environment to fact-check debates in real-time. The application processes spoken dialogue, identifies claims, and provides true/false feedback with explanations, displayed interactively within the VR experience.
- Real-Time Fact-Checking: Displays true/false feedback with explanations for claims made during a debate.
- Interactive Transcript: A transcript of the debate, along with fact-checking annotations, is presented and saved for later interaction.
- Seamless Integration: Works with a backend powered by FastAPI and a machine learning pipeline for accurate claim verification.
- Dialogue Recording: The VR headset records the debate as audio.
- Speech-to-Text: Audio is sent to the FastAPI backend for transcription.
- Claim Detection: A fine-tuned Hugging Face model determines if a statement contains an objective or statistical claim.
- Fact-Checking: Claims are verified using Google's LLaMA, which provides sources and explanations.
- Visualization: Results are displayed in VR in real-time and stored for later access.