Web-Scrape

A webscraper that looks through jobs sites and gets spesific job information. The idea is to automate the script with uipath and then use twilio for notifications on new jobs and approaching deadlines

Comment

Inspiration

I wanted to learn webscraping

What it does

Currently, it scrapes off links to a single page of job postings. Goes to the links and gets the basic information

How I built it

Uses BeutifulSoup library to scrape the html code and urllib library to get it

Challenges I ran into

Scrapping blocks

Accomplishments that I'm proud of

I got it to work!

What I learned

I learned the basics of web-scraping Learned about web-scraping user agents and blocks

What's next for Web-Scrape

Figuring out user-agents and ip changing, so I don't get blocked from anywebsite I am scraping

Built With

Share this project:

Updates