[FIXED] Spacy - Convert Token type into list

Issue

I have few elements which I got after performing operation in spacy having type Input -

li = ['India', 'Australia', 'Brazil']
for i in li:
    print(type(i))

Output:

<class 'spacy.tokens.token.Token'>

<class 'spacy.tokens.token.Token'>

<class 'spacy.tokens.token.Token'>

I want to make all elements in list with str type for iteration. Expected output -

li = ['India', 'Australia', 'Brazil']
for i in li:
    print(type(i))

Output

<class 'str'>

<class 'str'>

<class 'str'>

please suggest some optimized way..

Solution

Spacy Token has a attribute called text. Here's a complete example:

import spacy
nlp = spacy.load('en_core_web_sm')
t = (u"India Australia Brazil")
li = nlp(t)
for i in li:
    print(i.text)

or if you want the list of tokens as list of strings:

list_of_strings  = [i.text for i in li]

Answered By - bhaskarc