Alif Jakir and Ryan Tran's experiments with OpenAI Assistants

• TTS tied with Metahuman
• Epic rap battles between the TTS
  • Zeus
  • Spongebob
  • Minecraft Steve
  • Flying Dutchman
  • Light Yagami
• Livestreaming

• AI Democracy w/ Assistants?
• Simulation of microeconomics behavior
• Team of Scientists working together to engineer and make the product design

• 2D Canvas in a 3D Scene, with shaders + TTS and (https://www.youtube.com/watch?v=GvfF1YNDrTw&ab_channel=HoustonPublicMedia)

• Youtube Summarizer (https://cookbook.openai.com/examples/gpt_with_vision_for_video_understanding)

• Semantic understanding of segmented data (https://www.projectaria.com/datasets/) w/ Segment Anything (https://segment-anything.com/)

• LTU-AS model for speech foundation model

• AI Town with silly scenarios + AI Play with a Director
  • Episodes
  • Absurd scenarios
  • Generative Characters interacting
  • Parameterization through JSON of structures, scenarios, plots, characters, motives,
  • Events
  • Livestream at a regular time each day, and also specials
  • Map out longitudinal memory decay (realistic memory for agents)
  • Map out environment parameterization
  • Generate 3D Assets: https://developer.nvidia.com/blog/rapidly-generate-3d-assets-for-virtual-worlds-with-generative-ai/
  • AI Images to Meshes for Content Synthesis Pipeline (https://www.youtube.com/watch?v=tBLk4roDTCQ)