Find Jobs
Hire Freelancers

Connect existing PHP scraper script to MySQL database on Magento website and create an ADMIN page to run the script and perform updates

$30-250 AUD

Σε Εξέλιξη
Αναρτήθηκε περίπου 10 χρόνια πριν

$30-250 AUD

Πληρωμή κατά την παράδοση
Hi all, What you need to do: 1) Connect an existing PHP script (product scraper, JSON based) to our MySQL database. At present, the script is meant to scrape all product data in full. 2) Update the script to be run only as an update (i.e. do not scrape all product info but only scrape price changes and stock level changes or only add products to our database that do not exist yet) 3) Create an ADMIN page in our Magento store where: a) we can run the script to scrape all product details in full (like what it is designed to do now) b) we can run the script only to perform product updates (i.e. scrape only products that are not in the database, update prices and stock levels for existing products in our database + anything else you might suggest). The idea here is to run the script a lot faster. 4) Enable multi threading so that the script runs a lot faster. Use of proxies is preferred. There are over 100,000 products that we are trying to scrape so we need to bring the running time of the scraper down to under 2 days. 5) Allow us to archive products that are no longer in the data feed being scraped (i.e. the item has been removed from the supplier website). So we need to archive it in our database (not remove it as we still need a record of it), so that clients do not buy the item anymore. 6) Install any additional PHP modules on our server if need be to make the above work. What we have: 1) Magento online store, running CE 1.8.1 2) MySQL database 3) CentOS dedicated server will full root access 4) PHP script that scrapes products from a 3rd party website Who you are: 1> Good feedback on Freelancer 2> Good project completion on Freelancer 3> Know web scraping, PHP, MySQL, Apache, CentOS and Magento. Please ask any questions before bidding. If you bid a certain amount, do not try to revise it later on. Good luck!
Ταυτότητα εργασίας: 5532384

Σχετικά με την εργασία

12 προτάσεις
Απομακρυσμένη Εργασία
Ενεργός/ή 10 χρόνια πριν

Ψάχνεις τρόπο για να κερδίσεις μερικά χρήματα;

Πλεονεκτήματα πλειοδοσίας στο Freelancer

Καθόρισε τον προϋπολογισμό σου και το χρονοδιάγραμμα
Πληρώσου για τη δουλειά σου
Περίγραψε την πρόταση σου
Η εγγραφή και η πλειοδοσία σε εργασίες είναι δωρεάν
Βραβεύτηκε στον/στην:
Avatar Χρήστη
Hello, My name is Rui Pimentel and I've more than 6 years of experience in development of web crawler applications. I've read your whole project description and completely understand what you need. I've already worked in a lot of web crawlers that worked as cron in webshops, to keep everything updated, such as price, stock and of course add new products. Some of them were magento, so I already have a good understand of how import products to there. I'm ok with the backend, and I'm sure we'll think of one or other feature that could be useful to add there, and I'll do that with no problem. The multi thread is also ok, it will make everything run smoother, and I've already done it in a lot of web crawlers before. About the proxies, they probably will make the process a bit slower, but it will depend on how fast the proxies are. If you don't want to waste any money on this, I would suggest to automaticly pull the proxies from [login to view URL], I've already used a lot of times and it's not that bad. For last, the archive, seems something simple as well, probably we could just pull that products to a category that's not visible by the users, or even pull them to the backend, what you prefer is ok for me. I hope I can work for you on this, you can see that I've a lot of feedbacks in works like this, and I assure you'll be happy with the final result. I'll be waiting to hear from you and I'm looking forward to work for you on this. Best Regards, Rui Pimentel
$200 AUD σε 3 ημέρες
4,9 (57 αξιολογήσεις)
6,2
6,2
12 freelancers δίνουν μια μέση προσφορά $231 AUD για αυτή τη δουλειά
Avatar Χρήστη
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$250 AUD σε 5 ημέρες
5,0 (348 αξιολογήσεις)
7,6
7,6
Avatar Χρήστη
Hello, My name is Faizan and I am a PHP developer. I have seen your project requirements and its completely doable. We are scrapping specialist. We have list of like 1100 different proxies which we use during the script execution so no chance of getting banned.. I will not make this proposal long. You can see my reviews to get an idea of my work. Not so many but are enough to make a client happy. I can start right ahead. Let me know if you are interested or if you have any questions Best Regards Faizan Shakil Faruqi
$210 AUD σε 4 ημέρες
4,9 (111 αξιολογήσεις)
7,6
7,6
Avatar Χρήστη
A proposal has not yet been provided
$257 AUD σε 3 ημέρες
4,9 (451 αξιολογήσεις)
7,5
7,5
Avatar Χρήστη
Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! Looking forward to hear from you soon - GOD Bless You.
$305 AUD σε 3 ημέρες
4,9 (213 αξιολογήσεις)
6,9
6,9
Avatar Χρήστη
Dear I have just seen your Job posting and upon reading thoroughly, I felt strongly that I would be the most qualified contractor for your project. I have vast experience in IT / Data Entry / Web Research /Admin / SEO / Content upload for eCommerce and Marketing. Understanding how valuable an education is, I am serving Pacific Pharmaceuticals Limited as a Asstt: Manager (MIS), toward earning my Masters of Business Administration (MBA) degree and B. Sc Computer Science. I have completed many web research/data entry/ General Admin and marketing project. I am 100% able to do your project. Sincerely, Tarikul Islam
$222 AUD σε 10 ημέρες
4,4 (6 αξιολογήσεις)
3,7
3,7

Σχετικά με τον πελάτη

Σημαία της AUSTRALIA
Sydney, Australia
4,8
34
Επαληθευμένη μέθοδος πληρωμής
Μέλος από Νοε 24, 2011

Επαλήθευση Πελάτη

Ευχαριστούμε! Σου έχουμε στείλει ένα email με ένα σύνδεσμο για να διεκδικήσεις τη δωρεάν πίστωση σου.
Κάτι πήγε στραβά κατά την προσπάθεια αποστολής του email σου. Παρακαλούμε δοκίμασε ξανά.
Εγγεγραμμένοι Χρήστες Συνολικές Αναρτημένες Δουλειές
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Φόρτωση προεπισκόπησης
Δόθηκε πρόσβαση για Geolocation.
Η σύνδεση σου έχει λήξει και τώρα έχεις αποσυνδεθεί. Παρακαλούμε συνδέσου ξανά.