Hello, I have my scrapyRT server up and running but now I need to pass parameters to my spider
There is an issue created with 2 solutions but I cant make it work :
[login to view URL]
Options are :
A) Using "meta" field to pass parameters : I cant read them
B) Patch the library with the code of that link : Couldnt make it work
I need this solution quick and if you know about python you will solve it fast. In the link its the information.
Regards
Hi,
I have ~6 year experience with Scrapy and I have used it to build more than 100 scrapers now (one customer had more 600 scrapers).I've also written scrapy proxies extension which is quite popular. But I have not used ScrapyRT, I have custom launchers and schedulers. However I'm sure I can solve this problem, should not be too complicated.
Our dedicated team of software and programming professionals provides our clients with state of the art programming solutions in the python language. Me and my team has 5 years of experience into Python/Django,Selenium & Data Scraping or Web Crawling. Can very well execute this Project and can work at US hours.