Inspiration
Watching lecture videos that are really long
What it does
Chapter indexing for lecture videos
How we built it
OpenCV heuristics for chapter transitions Audio -> text via Whisper (OpenAI), Natural language processing generation via Cohere fine tuned on custom prompt to summarize, Cohere semantic search embeddings finds related chapters
Challenges we ran into
Figuring out heuristics, How to know when to chapter
Accomplishments that we're proud of
Search bar to find relevant chapters/alternative explanations
What's next for Autochapter
Improved chapter detection via deep learning, Self serve web UI
Built With
- cohere
- cv2
- javascript
- python
- typescript
- whisper

Log in or sign up for Devpost to join the conversation.