[FIXED] Webscraping from word hippo

Issue

I have a query regarding word scraping from word hippo. I am new to Beautiful Soup and don't how to get this list of words (described below)

I am trying to get all the synonyms under the following sections of the page (Even those synonyms below the 'more' button.

Section 1

Section 2

#My code.
import requests
from bs4 import BeautifulSoup

response = requests.get("https://www.wordhippo.com/what-is/another-word-for/guard.html")
soup = BeautifulSoup(response.content, 'html.parser')

# select only first '<section class="synonyms-container....'
synonyms = soup.select('.MainContentContainer > section > .synonyms-container a')
print ('synonyms for: Guard')
for synonym in synonyms:
            print (synonym.text)

Please help extract a list of these words.

Thanks in advance.

Solution

The words is in .relatedwords class container, to get the first and second section loop it twice.

synonyms = soup.select('.relatedwords')
for i in range(0, 2):
    print ('synonyms section ' + str(i + 1))
    print (synonyms[i].text)

if you want to store each word as list use synonyms[i].split("\n")

Answered By - uingtea