[FIXED] Is it possible to implement Scrapy into a dekstop app?

Issue

Can Scrapy be implemented in my custom desktop app where it automates the scraping process on a lists of webpages and export it as table into database?

Solution

Yes, you can. I have done the same via python, PYQT5, scrapy and Database.

1. Create the application frontend using Pyqt5(GUI,Designer option available ).
2. Create scrapy project and run the spider via python script scrapy call.
   If you are deploying the spider in any services, use the service API call.
3. Check the database connectivity in the frontend itself. 
   if it succeeds, save the spider response to the corresponding database. 
4. Use pyinstaller or py2exe to convert the code to a standalone executable.

Answered By - Arun Augustine