Inspiration always been on mind to build my own llm

What it does

Takes your input a csv file and returns python data science code aand answers if u wantt

How we built it

Fine tuning using lora

Challenges we ran into

Dataset formating later model traing required around 8 hours to fine tuning

Accomplishments that we're proud of

What we learned

More about llm archietecture

What's next for Data science expert

To combine the adapter lora weights with base model and generate a quantized model which can later be deployed on hugging face cpu free tier Still the model is bit slow since its deployed on a free tier cpu and not just a bit but yeah locally it works fine amazingly hope to make it into saas startup after connecting with suppabase

Built With

Share this project:

Updates