mapper-backend

Run

scrapy runspider spyder/springer.py -a query=trading+AND+prediction+AND+crypto -O papers.json

TODO

• Avoid getting banned: https://scrapoxy.io/
• Run multiple spyders in the same process? https://docs.scrapy.org/en/latest/topics/practices.html#running-multiple-spiders-in-the-same-process