14,956 questions
0
votes
2
answers
78
views
Selenium/Python - cannot find an element
Python 3.11
Selenium 4.38
For the following URL:
https://www.amazon.es/-/en/Womens-Lace-up-Comfortable-Anti-Slip-SDMB2203W/dp/B0B5CX9VZY
On the right hand side of the page it says "Dispatches ...
-4
votes
0
answers
49
views
Instagram Comment Scraping using Selenium - Selenium not loading more than 15 Instagram comments [closed]
I’m working on a Selenium-based Instagram scraper (for learning purposes) and I'm trying to extract the first 20 comments from a post.
However, Selenium always returns only 15 comments, even though ...
2
votes
2
answers
118
views
How do I code a CSS Selector to find a specific button, click on it, and wait until the webpage has completed the clicked task?
I have a working web scraper written in Python, Selenium and Chromedriver (all up-to-date version wise) and various other software packages. The target webpage has a field for the phone number, but ...
2
votes
2
answers
72
views
Can't find HBO Max sign-in, "unable to locate element" error
I'm trying to make a automation that logs into https://auth.hbomax.com/login, however I keep getting the below error as the code can't locate the sign-in element.
selenium.common.exceptions....
0
votes
0
answers
129
views
A problem with Selenium WebDriver manager
I've been parsing some websites using Selenium webdriver (its Chrome variant in particular) about a month ago and all worked fine (using Google Colab). I'm trying to run the same code now and it doesn'...
0
votes
1
answer
73
views
Web Automation w/ Selenium
I'm trying to automate sending a tweet via Selenium (Python) and while I'm able to access the page using my existing chrome profile, I'm not able to access any elements and what's more is that it ...
Best practices
1
vote
3
replies
102
views
Using selenium waits as asserts
I'm trying to use asserts in selenium java. I read that for every validation i need to use an assert as best practice.
i stumbled upon this code example:
WebElement button = wait.until(...
0
votes
0
answers
244
views
Why is my Selenium ChromeDriver crashing with Docker?
I have a service on my application that is scrapping a webpage to obtain some information with Selenium. I have run it without Docker and with Docker in my PC.
I am now working on deploying it with ...
2
votes
2
answers
380
views
Error message when scraping website via selenium
The Python code:
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.support.ui import Select
import pandas as pd
import time
# define the ...
0
votes
1
answer
85
views
Can't find elements when a pdf is opened in tab (chromedriver)
When I open a PDF file via a normal link (e.g., https://unec.edu.az/application/uploads/2014/12/pdf-sample.pdf), Chrome opens the PDF in the same tab with Chrome's integrated PDF viewer component.
In ...
1
vote
1
answer
112
views
Chrome 141 + Xvfb + Selenium: black screenshots after upgrade (worked on Chrome 132)
I’m using Python + Selenium + pyvirtualdisplay (Xvfb) to run Chrome and capture a series of screenshots via ffmpeg.
The series of screenshots is blank while only the last screenshot is proper. As the ...
2
votes
1
answer
44
views
Cannot access 'iwe-autocomplete' element in html with selenium
Website photo with search box visible.
So, this is the website
https://sa.ucla.edu/ro/public/soc
There is a dropdown menu for selecting subject area where I need to write subject and i will receive ...
-1
votes
1
answer
69
views
Selenium script marks all search results as “not found” because details load only after clicking a link [closed]
I’m using Python + Selenium + ChromeDriver to check a list of titles (from a CSV file) against an online library catalog.
My script searches each title and tries to determine if a specific library has ...
0
votes
0
answers
72
views
new verison of chromedriver returns org.openqa.selenium.SessionNotCreatedException: Could not start a new session
I moved the application to a new server and now the following error occurs every time you use selenium
e=org.openqa.selenium.SessionNotCreatedException: Could not start a new session. Response code ...
0
votes
1
answer
83
views
How do I scrape a person's name from their LinkedIn profile using Selenium's Chrome driver in Python?
I have a Python script that uses Selenium's Chrome driver to log into LinkedIn and visit one profile. That works fine. However, I can't get the script to scrape the person's name from their profile.
I ...