ScriptAR

ScriptAR helps you write it right like a native speaker. Script AR is for language learners tackling non-Latin alphabets, turning unfamiliar characters into muscle memory.

Comment

Inspiration

The project was inspired by the realization that while language learning is a popular pursuit, "doing it right matters". The team identified a critical gap: language learners often don't know how to write correctly by hand, which is a fundamental functional language system that affects reading speed and communication legibility. Statistics showing millions of learners for languages like Japanese and Chinese highlight a massive audience that lacks proper guidance and practice for natural writing habits.

Challenges & Drawbacks of Current Solutions

Our team aimed to solve specific issues found in existing methods:

  1. Inefficient Interfaces: Online dictionaries and traditional apps often have clunky, non-modular interfaces.

  2. Lack of Transferable Skills: Digital motor skills from drawing on tablets do not transfer well to actual pen-and-paper handwriting.

  3. Reinforcing Mistakes: Unguided freehand repetition can lead to reinforcing incorrect writing habits.

What it does

ScriptAR is an AR-based writing assistant designed to help self-learners develop natural writing habits through:

  1. Single Character Practice: Users can practice individual characters with custom repetition exercises.

  2. Sentence Generator: It can generate and translate full sentences in a target language for more advanced practice.

  3. AI-Driven Input: The system leverages AI agent to provide input compatible with any language that the user uses.

  4. Real-time Guidance: It projects a writing boundary and digital overlays onto physical paper to guide the user's writing leveraging AR glasses advantage of high-fidelity visual legibility to address the inherent passthrough limitations of modern XR hardware.

How we built it

  1. Setting Boundaries: The user sets a physical writing boundary using the RayNeoX glasses interface on arms of glasses.

  2. AI Integration: Practice exercises are generated using ChatGPT based on the user's input.

  3. AR Overlay: The instructions and characters are then projected into the user's field of view to guide their physical writing on paper.

Accomplishments that we're proud of

Bridging the Gap: Successfully creating a tool that provides the structure of a digital app with the physical benefits of pen-and-paper practice.

Functional Learning: Moving beyond simple games to create a tool with a high functional impact on a learner's ability to write and learn new language like a native speaker.

What's next for ScriptAR

  1. Stroke Recognition: Implementing real-time feedback to detect if a user is following the correct stroke order.

  2. Broadening Support: Adding more scripts (e.g., Arabic, Cyrillic) and calligraphic styles.

  3. Progress Tracking: Developing a long-term feedback loop to show learners how their legibility and speed have improved.

Built With

Share this project:

Updates