[FIXED] How to select and scrape specific texts out of a bunch <ul> and <li>?

Issue

I need to scrape "2015" and "09/09/2015" from the below link:

lacentrale.fr/auto-occasion-annonce-87102353714.html

But since there are many li and ul, I cant scrape the exact text. I used the below code Your help is highly appreciated.

from bs4 import BeautifulSoup 
soup = BeautifulSoup(HTML)
soup.find('span', {'class':'optionLabel'}).find_next('span').get_text()

Solution

Try:

import requests
from bs4 import BeautifulSoup

headers = {
    "User-Agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:100.0) Gecko/20100101 Firefox/100.0"
}

url = "https://www.lacentrale.fr/auto-occasion-annonce-87102353714.html"

soup = BeautifulSoup(requests.get(url, headers=headers).content, "html.parser")

v1 = soup.select_one('.optionLabel:-soup-contains("Année") + span')
v2 = soup.select_one(
    '.optionLabel:-soup-contains("Mise en circulation") + span'
)

print(v1.text)
print(v2.text)

Prints:

2015
09/09/2015

Answered By - Andrej Kesely