Find Jobs
Hire Freelancers

Python Scrapy Project (SQLite) Web & FTP scraping

$250-750 USD

Κλειστή
Αναρτήθηκε πάνω από 5 χρόνια πριν

$250-750 USD

Πληρωμή κατά την παράδοση
Python Scrapy Project (SQLite) Web & FTP scraping Skill Require: Language: Python3 (Anaconda Environment) Framework: Scrapy Other Module: Beutifulsoup, Re, lxml, xpath & etc nessacary Storage: SQLite project description: 1) scrap require web & ftp data to local by different possible schedule (daily, weekly, monthly, specific time) 2) use SQLite to store data by sources 3) make a index/log with SQLite for track back history status success/not found/fail/error in [login to view URL] 4) base of the index mention in (3) to decide 3 scraping action - continue routine / if not found, retry after 2 months / not continue routine forever. 4) Proxies list, User Agent list is ready to modify anytime 5) concurrent scraping (50-100 thread) 6) dynamic schedule with scrap manner (100,000 thousand link or more to scrap per day) 7) Must prevent ‘database is locked’ error in sqlite DB during concurrent scraping 8) As long as any device installed Anaconda3 & Scrapy, a simple copy & paste of the project folder can migrate the project to other PC final version of source code submit to us as the indicate of project is complete Please mention "pythonscrapyframework" as a secret passphrase indicating that you have read above project requirements. Communicate [Removed by Freelancer.com Admin for offsiting - please see Section 13 of our Terms and Conditions]
Ταυτότητα εργασίας: 17365666

Σχετικά με την εργασία

9 προτάσεις
Απομακρυσμένη Εργασία
Ενεργός/ή 6 χρόνια πριν

Ψάχνεις τρόπο για να κερδίσεις μερικά χρήματα;

Πλεονεκτήματα πλειοδοσίας στο Freelancer

Καθόρισε τον προϋπολογισμό σου και το χρονοδιάγραμμα
Πληρώσου για τη δουλειά σου
Περίγραψε την πρόταση σου
Η εγγραφή και η πλειοδοσία σε εργασίες είναι δωρεάν
9 freelancers are bidding on average $364 USD for this job
Avatar Χρήστη
Dear yeongN, I would like to discuss your project in brief and I am much interested to assist you on the development of your Project "Python Scrapy Project (SQLite) Web & FTP scraping" with fulfilling all of and elegantly. Also I do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. Relevant Skills and Experience I have 10+ years of experience in Data Mining, Python, Scrapy, Web Scraping I can do this within your budget too $250 - $750 USD please check more from here https://www.freelancer.com/u/mmadi.html?page=portfolio I am ready to work with you,kindly waiting for your response. Thanks & Regards, Mmadi
$525 USD σε 12 ημέρες
5,0 (10 αξιολογήσεις)
6,1
6,1
Avatar Χρήστη
Hi there, I have read through the project description. I have the require skill and the technical know how to complete the project. Please contact me on Pm for details. Relevant Skills and Experience Python Proposed Milestones $250 USD - bid
$250 USD σε 10 ημέρες
4,8 (43 αξιολογήσεις)
5,7
5,7
Avatar Χρήστη
Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.
$375 USD σε 2 ημέρες
4,8 (40 αξιολογήσεις)
5,6
5,6
Avatar Χρήστη
We are a web developing and designing company with various other facilities such as web content and digital marketing related to all types of specialisations. Additional considerations and implementations are assisted concerning the requirement of the work. We specialise in content writing and its types such as academic and blog writing for UK, US, Australia, Singapore and other countries. Our diverse functions in various fields include: 1. Website Designing 2. Website Development 3. SEO & Digital Marketing 4. Android Application Development 5. iOS Application Development 6. Content Writing Our assured services *Punctual Work *24/7 Availability *Plagiarism Free Work *Free suport and assistance *Uncompromised Quality
$300 USD σε 10 ημέρες
0,0 (0 αξιολογήσεις)
0,0
0,0

Σχετικά με τον πελάτη

Σημαία της MALAYSIA
Bukit Mertajam, Malaysia
4,7
9
Επαληθευμένη μέθοδος πληρωμής
Μέλος από Οκτ 21, 2015

Επαλήθευση Πελάτη

Ευχαριστούμε! Σου έχουμε στείλει ένα email με ένα σύνδεσμο για να διεκδικήσεις τη δωρεάν πίστωση σου.
Κάτι πήγε στραβά κατά την προσπάθεια αποστολής του email σου. Παρακαλούμε δοκίμασε ξανά.
Εγγεγραμμένοι Χρήστες Συνολικές Αναρτημένες Δουλειές
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Φόρτωση προεπισκόπησης
Δόθηκε πρόσβαση για Geolocation.
Η σύνδεση σου έχει λήξει και τώρα έχεις αποσυνδεθεί. Παρακαλούμε συνδέσου ξανά.