Inspiration always been on mind to build my own llm
What it does
Takes your input a csv file and returns python data science code aand answers if u wantt
How we built it
Fine tuning using lora
Challenges we ran into
Dataset formating later model traing required around 8 hours to fine tuning
Accomplishments that we're proud of
What we learned
More about llm archietecture
What's next for Data science expert
To combine the adapter lora weights with base model and generate a quantized model which can later be deployed on hugging face cpu free tier Still the model is bit slow since its deployed on a free tier cpu and not just a bit but yeah locally it works fine amazingly hope to make it into saas startup after connecting with suppabase
Log in or sign up for Devpost to join the conversation.