Amazon web scraper, web scraping into Magento MySQL database - repost
$8-15 USD / hour
Σε Εξέλιξη
Αναρτήθηκε πάνω από 10 χρόνια πριν
$8-15 USD / hour
Hi all,
We would like to scrape Amazon products with photos and import them into our Magento website by providing a URL to scrape from.
The solution has to be as simple as possible.
Our website is:
[login to view URL]
We have a dedicated server with full access. It is an Apache/CentOS/MySQL/WHM/cPanel environment.
For example, we would like to scrape all 9000+ products from the URL:
http://www.amazon.com/s/ref=sr_hi_3?rh=n%3A172282%2Cn%3A!493964%2Cn%3A541966%2Cn%3A1232597011&hidden-keywords=-B0089RPUHO+-B00DG0NUEE&ie=UTF8&qid=1385551805
Another sample URL:
http://www.amazon.com/s/ref=sr_nr_p_89_2?rh=i%3Aaps%2Ck%3Aspigen+case%2Cp_89%3ASpigen|SGP&keywords=spigen+case&ie=UTF8&qid=1391908765&rnid=2528832011
Rules:
1) Scraped products need to match our product columns (we will provide you with a CSV file so that you know how to match the columns)
2) Your scraper will need to interact with our MySQL database and archive products that are no longer available (the scraped data needs to go directly into our database, we are not interested in creating XML or CSV files for import)
3) We must have the ability to scrape by brand, category, price range, Amazon store etc. Basically any URL should work.
4) We need to scrape all product info as directed, for example: SKU, title, availability, price, colour, description, short description and so on
5) You need to be able to employ solutions to defeat current anti-scraping methods: proxies, random scraper pauses etc
6) The scraper needs to have an UPDATE function where we can scrape a URL and only update certain attributes (ie. price, availability) - that way we don't have to scrape all items in full again (and this will save a lot of time on our end)
7) You must create a Magento ADMIN menu for the scraper (we are not interested in running scripts via SSH etc)
So in a nutshell, we enter a URL in our Magento ADMIN and the scraper starts importing all products into our MySQL database.
If you need to ask questions, ask before you bid.
Good luck!
Hi! Mr. dMavo.
please see
[login to view URL]
[login to view URL]
These two demo URL for your two urls that you want scrap.
These scrap 50pages for per url. bcoz these are demo.
These shows that I can scrap all data from url that you want .
and I have scraping experience for 7 years.
I developed a lot of Web sites. so it is enough to input datas to DB.
If you hire me , I will do my best.
Thanks.
PS: are u dmavor in sky?
$12 USD σε 3 ημέρες
0,0 (2 αξιολογήσεις)
0,0
0,0
4 freelancers δίνουν μια μέση προσφορά $14 USD/ώρα για αυτή τη δουλειά
Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words,
let's get it done right away and I mean RIGHT AWAY !! Looking forward to hear from you soon - GOD Bless You.
Hi,
I am ready to do this task for you. I have created any scrapers for my clients and have done lots of jobs in magento. I have very good experience with magento. This is going to be a custom scraper as per your needs and i am sure i can handle this job. I am ready to discuss further on this.
COULD I START YOUR PROJECT NOW?
Hi sir.
how do you do?
I am excellent web scraping developer.
Please see my portfolio.
I don't explain my ability.
If you want, you will see my result on my PC screen.
your job is very easy for me.
I will finish your job 5 days.
I hope you choose me.
would i expect to interview with you?
look forward to working with you.
Good Day.