Write a web crawler

Κλειστό Αναρτήθηκε Πριν 6 χρόνια Πληρώθηκε κατά την παράδοση
Κλειστό Πληρώθηκε κατά την παράδοση

- write a crawler for [login to view URL] and [login to view URL] using [login to view URL] python stack.

- We need to extract the following fields:

- property-type : studio, 1 bedroom, 2 bedroom, office, shop etc.

- city (currency we only support Sofia).

- street (if possible).

- neighborhood

- building type (brick, epg, etc, if it exisits)

- image_urls (no thumbnails, only the large format property images).

- ad-type (rent / buy)

- square meters

- currency

- price

- date the ad was last updated

- contact_details (agency, broker, phone number)

- additional_details (anything else you extract)

- Both crawler need to share their data model.

- The db has to be PostgreSQL

- I would like these two cralwers to also have test, to ensure our crawling is working.

Please research and find a way to test without needing to hit the server, then an easy way to update

the test with the latest info from the crawling target website (so if the website changes we can easily update our tests).

To demonstrate yourself WRITE A PART OF THIS CRAWLER THAT WORKS so I can have an insight in your coding skills before awaring you a project.

I hope this is well defined.

Feel free to reach out with any questions you might have?

Data Scraping JavaScript Web Crawling Web Scraping

Ταυτότητα Εργασίας: #15219689

Σχετικά με την εργασία

48 προτάσεις Απομακρυσμένη εργασία Ενεργό Πριν 6 χρόνια

48 freelancers κάνουν προσφορές κατά μέσο όρο $1130 για αυτή τη δουλειά

ramzitra

Hi, I am a web scraping specialist and I can deliver you the best quality of crawlers. Thanks, Ramzi Relevant Skills and Experience web scraping, Python Proposed Milestones $1250 USD - deliver the 2 crawlers

$1250 USD σε 7 μέρες
(522 Αξιολογήσεις)
8.7
workspaceit

Hello, I m Tahsinul Alam, completed Masters in Software Engineering now working as one of the CEO at Workspace Infotech Ltd, software firm located in Dhaka,Bangladesh. Relevant Skills and Experience Data Scraping, Ja Περισσότερα

$1250 USD σε 20 μέρες
(16 Αξιολογήσεις)
7.6
maxsmith8

Hello, I am available to discuss the project and ready to get started. I have a team of highly skilled professionals, which consists of Designers, Web and App Developers. Relevant Skills and Experience We have enough Περισσότερα

$1500 USD σε 9 μέρες
(33 Αξιολογήσεις)
6.2
Verz1Lka

I'm web-scraping expert with 5 years of experience and i have 500+ finished projects (ecommerce, directory listing, etc...) I can export data into any format (csv, json) or database (mysql, mongo). Relevant Skills and Περισσότερα

$1000 USD σε 5 μέρες
(105 Αξιολογήσεις)
6.5
diamond247

I have gone through the project details, and understand what you are trying to achieve. We have completed a number of similar projects to yours. And we are experienced critical data research. Relevant Skills and Exper Περισσότερα

$750 USD σε 20 μέρες
(115 Αξιολογήσεις)
6.5
tangramua

Hi, I am a professional web developer with 15-year expertise in PHP/ASP, MySQL/MS SQL and various other high-level, low-level and scripting languages as well as in web scraping, where I had many similar projects. I c Περισσότερα

$1184 USD σε 20 μέρες
(21 Αξιολογήσεις)
6.1
shafaqat11

Greetings sir, I am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. I can do this task as per your requirement. Relevant Skills and Experience I have the 5 years of ex Περισσότερα

$833 USD σε 20 μέρες
(58 Αξιολογήσεις)
5.8
abhinavs1ngh

Hello,Sir High-Quality+fast development+good credit+fast communication=My work method! My first aim is to provide you quality and professional task. i have developed for 7 years on freelancer.com. I can work fast f Περισσότερα

$1250 USD σε 20 μέρες
(18 Αξιολογήσεις)
5.2
Nada100200

Hello Client, Hope you are doing well ! I have great experience of extracting information from websites . I provide best solutions at fastest speed with the cheapest cost. Your satisfaction is my only priority. I would Περισσότερα

$750 USD σε 3 μέρες
(14 Αξιολογήσεις)
5.4
laabhaa

Hi Thank's for providing us an opportunity to bid on your project. We read you project description and understand clearly so we are highly interested to work for you Relevant Skills and Experience We specialise in PHP Περισσότερα

$750 USD σε 20 μέρες
(18 Αξιολογήσεις)
5.6
prashushinde9

Hello there, Greetings of the day, hope you doing great! I completely understood your requirement. I'm ready to work with you. Can we discuss further in brief? I would like to discuss this project with you. It Περισσότερα

$1443 USD σε 25 μέρες
(5 Αξιολογήσεις)
4.8
leavetop

i will WRITE A PART OF THIS CRAWLER THAT WORKS before award me. Thanks Relevant Skills and Experience Web scraping

$755 USD σε 6 μέρες
(44 Αξιολογήσεις)
5.2
arksong123

Hi,we're all senior software developers,we've just checked your project requirements,we're able to perform your project and you'll be interesting with us,please come in contact with us to discuss for more project detai Περισσότερα

$1250 USD σε 8 μέρες
(9 Αξιολογήσεις)
4.2
adilhussain0411

Hello, I am expert in web scrapping, java script, data crawling data scriping and data mining, I have 7 years+ experience in data mining, website scraping, screen scraping and I am certified web scrapper expert. I Περισσότερα

$750 USD σε 7 μέρες
(7 Αξιολογήσεις)
4.8
huongth

Hi. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now Relevant Skills and Experience I am an expert i Περισσότερα

$833 USD σε 10 μέρες
(18 Αξιολογήσεις)
4.2
Shopify

Hello , Greetings from Shopify. We can create this website for you at very low cost as we have a team of experienced designers and developers. We want to have long term relations with our clients that's why working Περισσότερα

$1159 USD σε 20 μέρες
(4 Αξιολογήσεις)
3.8
mlys

Let me help you with scraping those sites. Relevant Skills and Experience Have scraped over 100 sites with various throttling and limitations. Proposed Milestones $1444 USD - Analyze, develop scrapers, scrape into DB Περισσότερα

$1444 USD σε 20 μέρες
(3 Αξιολογήσεις)
3.2
mahesh2237

I have read your job post. We have a team of experienced and dedicated developers and Web Designer, who can do any development job for you. Stay tuned, I'm still working on this proposal.

$750 USD σε 20 μέρες
(4 Αξιολογήσεις)
2.7
freelancerkpis

We are happy to bid on this project. We provides dedicate developers and Development and design services as well. ***** We are having a great team of Mobile developers with 7-8 years of experience Relevant Skills a Περισσότερα

$1458 USD σε 20 μέρες
(2 Αξιολογήσεις)
2.8
startechoffshore

Hi there! Your project seems interesting to us and we believe we would be a perfect match for your requirement. Thank you! Relevant Skills and Experience Data Scraping, Web Crawling, Web Scraping Proposed Milest Περισσότερα

$750 USD σε 20 μέρες
(3 Αξιολογήσεις)
1.9