Website scrapper & Analyzer for arbitrage (READ before bidding)

Dear Employer, I understand your job completely. Below is the description of what you need: - An app to scrap data daily from the website that doesnt provide API. - Check some internal variable and get only those products which satisfy those criterias. - Get the detail in Excel or CSV or whatever format you need. I understand this and will do this. I have few questions which most of other freelancers will not ask or may not even know: - Most websites create Pagination, which means you will not able to see products after a particular number for a URL, we have to break the URL in multiple on the basis of filters. How are you planning to do that? Or are those 25K products on the basis of some ID (like ASIN in Amazon)? - Do you have an idea about use of proxies and captcha handlers for eCommerce or even data scraping? Please give me an opportunity. I know everything about eCommerce scraping, will give you a good solution. Thanks and Regards, Ash

Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about your project? Thanks, Lin

Dear sir I am a qualified python developer with 8 years of web scraping. I read the job description carefully and am confident with this project. I am ready to work for you. Looking forward to hearing from you soon. Best Regards, Yongtao

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Web Data Extractor & Automator and I'd like to help you. Experience building solutions like: Windows Desktop Apps (using Excel, Access, .NET, Winautomation) Scrapers Apps Scrape services Automation programs/bots Web apps/systems. Message me to have the whole idea about your project. Will wait for your contact. Thanks.

I can provide you fast and effective scraping program that will visit website and process all 25,000 items daily. Also it will check each item against some rules and generate report if needed. Please give me more details (website URL etc) so I can check everything on my side.

Hello. I am a Python programmer and expert in web scraping. I read your description and I am offering this price. We can discuss it further after providing me with more details about what data needs to be scraped and the website. Kind Regards Maciej

EXPERIENCED DEVELOPER... PLEASE CHECK MY BADGES, PROJECTS AND REVIEWS and ensure yourself that I can do this very well and very quick... I have done many scrapings, as well as combined with arbitraging... like arbitrage betting and scraping the odds from booking sites

Hello, I'm web automation expert with 7 years of experience. I've completed many similar jobs and I'm ready to start working right now. I'll make a script that runs on windows/linux/mac If you are interested, please contact me so we can talk about details. Thank you, Borna

Hey there, It seems you require someone to automate the manual processing you've described. You've found the right person for the job! I have over 3 years of experience in Web development with over 8 years in general programming. I have used a wide variety of frameworks and technologies over the years. What you require can be done quite easily using NodeJS and Puppeteer. I have used it on a couple of projects and am fully confident that it fits the job. Looking forward to working on this. See you in chat!

Hi. My name is Oleg and I am senior C#/.NET software developer from Ukraine. Please contact to discuss details regarding the project. What's the website?

Hello, I have briefly read the description on Website scrapper & Analyzer for arbitrage development, and I can deliver as per the requirements however I need us to discuss for more clarity on the details, deadline and budget as well.

Hi. Please see my profile for samples. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now

I am an expert of scraping web sites using python. I can create a script with a gui, if you prefer. The structure of the site is important: I have to examine it beforehand.

Hello, I've read your description. You've mentioned 25,000 items daily. Do you need to compare with certain criteria only daily data? Do you need to scrap data from item's page or from page which contain other items? Do you need to compare with previous day? Is there any specific preference for report i.e. Excel file? I think after getting answers on this question I will be able to complete this project in 1 day. Thanks a lot! Ivan