Amazon web scraper, web scraping into Magento MySQL database - repost 4

Κλειστό Αναρτήθηκε Mar 13, 2014 Πληρώθηκε κατά την παράδοση
Κλειστό Πληρώθηκε κατά την παράδοση

Hi all,

We would like to scrape Amazon products with photos and import them into our Magento website by providing a URL to scrape from.

The solution has to be as simple as possible.

Our website is:

[login to view URL]

We have a dedicated server with full access. It is an Apache/CentOS/MySQL/WHM/cPanel environment.

For example, we would like to scrape all 9000+ products from the URL:

http://www.amazon.com/s/ref=sr_hi_3?rh=n%3A172282%2Cn%3A!493964%2Cn%3A541966%2Cn%3A1232597011&hidden-keywords=-B0089RPUHO+-B00DG0NUEE&ie=UTF8&qid=1385551805

Another sample URL:

http://www.amazon.com/s/ref=sr_nr_p_89_2?rh=i%3Aaps%2Ck%3Aspigen+case%2Cp_89%3ASpigen|SGP&keywords=spigen+case&ie=UTF8&qid=1391908765&rnid=2528832011

Rules:

1) Scraped products need to match our product columns (we will provide you with a CSV file so that you know how to match the columns)

2) Your scraper will need to interact with our MySQL database and archive products that are no longer available (the scraped data needs to go directly into our database, we are not interested in creating XML or CSV files for import)

3) We must have the ability to scrape by brand, category, price range, Amazon store etc. Basically any URL should work.

4) We need to scrape all product info as directed, for example: SKU, title, availability, price, colour, description, short description and so on

5) You need to be able to employ solutions to defeat current anti-scraping methods: proxies, random scraper pauses etc

6) The scraper needs to have an UPDATE function where we can scrape a URL and only update certain attributes (ie. price, availability) - that way we don't have to scrape all items in full again (and this will save a lot of time on our end)

7) You must create a Magento ADMIN menu for the scraper (we are not interested in running scripts via SSH etc)

So in a nutshell, we enter a URL in our Magento ADMIN and the scraper starts importing all products from that URL into our MySQL database.

What we have:

1) Magento online store, running CE 1.8.1

2) MySQL database

3) CentOS dedicated server will full root access

Who you are:

1> Good feedback on Freelancer

2> Good project completion on Freelancer

3> Know web scraping, PHP, MySQL, Apache, CentOS and Magento.

Please ask any questions before bidding. If you bid a certain amount, do not try to revise it later on.

Good luck!

Magento MySQL Perl PHP Web Scraping

Ταυτότητα Εργασίας: #5551709

Σχετικά με την εργασία

16 προτάσεις Απομακρυσμένη εργασία Ενεργό Apr 19, 2014

16 freelancers κάνουν προσφορές κατά μέσο όρο $492 για αυτή τη δουλειά

mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$385 AUD σε 6 μέρες
(414 Αξιολογήσεις)
7.8
prashushinde9

Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bu Περισσότερα

$789 AUD σε 20 μέρες
(54 Αξιολογήσεις)
7.1
VnBestSolutions

Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! Περισσότερα

$778 AUD σε 30 μέρες
(213 Αξιολογήσεις)
6.9
magedev

I am magento developer. I can do this job. Look at my review about my magento work and support. Waiting for your reply.

$631 AUD σε 20 μέρες
(147 Αξιολογήσεις)
6.3