[FIXED] Selenium CSS selector (Works in Scrapy but not Selenium) Python

Issue

I have tried probably every kind of selector and am unable to output this selector as text. Id, css selector, xpath, all return no result, but when using the same reference in Scrapy shell the desired output is returned.

Any Idea why the Selenium selector does not work?

I am trying to return the text in masterBody_trSalesDate

発売予定日 ： 7月(2021/4/21予約開始)

https://www.example.co.jp/10777687

    try:
    hatsubai = driver.find_element_by_id('#masterBody_trSalesDate').text

I have honestly tried every possible combination elements and selectors I can think of with no luck, but as mentioned Scrapy shell DOES return the correct data so I am not sure what is going wrong.

Is there any way to test Selenium selectors like scrapy shell without running the script?

Thank you if you have any advice.

image shows working in scrapy shell

Solution

When you use by_id or by_xpath then you don't need char #

hatsubai = driver.find_element_by_id('masterBody_trSalesDate').text

That's all.

---

Minimal working code which works for me

from selenium import webdriver
             
url = 'https://www.1999.co.jp/10777687'

#driver = webdriver.Firefox()
driver = webdriver.Chrome()
driver.get(url)

hatsubai = driver.find_element_by_id('masterBody_trSalesDate').text   
print(hatsubai)

hatsubai = driver.find_element_by_xpath('//*[@id="masterBody_trSalesDate"]').text
print(hatsubai)

hatsubai = driver.find_element_by_css_selector('#masterBody_trSalesDate').text    
print(hatsubai)

---

BTW:

The same is with by_class_name - it needs only name without dot .

Answered By - furas