Issue
With Scrapy, I plan to check the response codes of a few thousand domains.
How can I only issue HEAD Requests instead of the default GET?
Solution
you can use the method option in Request
def start_requests(self):
yield scrapy.Request(
url,
method="HEAD"
)
Answered By - zaki98
0 comments:
Post a Comment
Note: Only a member of this blog may post a comment.