Web Scraping Scripts - Javascript / NodeJS / ES6

Ολοκληρωμένο Αναρτήθηκε Πριν 6 χρόνια Πληρώθηκε κατά την παράδοση
Ολοκληρωμένο Πληρώθηκε κατά την παράδοση

I'm looking for a web scraper to write code in Javascript (ES6) to scrape 31 different websites for specific publicly accessible flight data. This job is ONLY to write the scripts, we already have a functioning scraper. Please read this carefully and make sure to speak to it in your cover letter. Generic cover letters will be reported.

Dev plan / Requirements:

1. You will create a function that takes a url.

2. This url will be translated to English using Google translate or something if it was written in a different language than English.

3. This function should then decide what is this site and based on that it will decide which scrape script it should call.

4. Then after all that it should return an array with json with basic flight data:

2. Url (Flight/Post URL)

3. Source (website name)

4. From Airport

5. To Airport

6. Dates (we will figure out format together)

7. Price

8. Airline

9. Booking link (if provided)

- If one of these info wasn’t present just give that property null or undefined as a value.

- The scrape script will have 31 scrape functions for each individual URL.

- The script should be tested with different flights/posts on the same URL and will need to pass QA by my team before final payment (we can work with milestones in the meantime).

- Script is written in ES6.

Good, but not required:

Script is written in NodeJS. If you have used NodeJs before then we can just ignore next paragraph. If you haven’t used NodeJs and you only know Javascript then it is really simple. You will just copy the javascript scrape script and instead of using jQuery for traversing the DOM you will use Cheerio (it is really really close to how jQuery).

I look forward to seeing your bids and experience!

JavaScript Node.js Web Scraping

Ταυτότητα Εργασίας: #15379510

Σχετικά με την εργασία

9 προτάσεις Απομακρυσμένη εργασία Ενεργό Πριν 6 χρόνια

Ανατέθηκε στον:

dankyung

I have worked with Node.js and especially with ES6 for many years. Additionally, I have worked intensively with RegEx which is important when making a web scraper. Thanks! Relevant Skills and Experience RegEx, Node.j Περισσότερα

$200 USD σε 3 μέρες
(1 Κριτική)
3.8

9 freelancers κάνουν προσφορές κατά μέσο όρο $182 για αυτή τη δουλειά

mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Περισσότερα

$192 USD σε 5 μέρες
(321 Αξιολογήσεις)
7.6
hawkscodeaus

I have 7+ years in web- scraping - javascript developers with very good experience. Relevant Skills and Experience I am good in Javascript, node.js, Web Scraping Proposed Milestones $200 USD - Cost

$200 USD σε 3 μέρες
(61 Αξιολογήσεις)
7.0
laxaar

Hello, Thank you very much for sharing your requirement. I have read the brief project description and I would like to be invited for further discussion to proceed. Relevant Skills and Experience We are a team of 8 y Περισσότερα

$250 USD σε 3 μέρες
(10 Αξιολογήσεις)
5.5
judyferrell3

Hello! I would like to work with you for this project. I have rich experiences for website design and php,sql,javascript,jquery, json, css,etc... Relevant Skills and Experience I'm ready for your project now and will Περισσότερα

$155 USD σε 3 μέρες
(14 Αξιολογήσεις)
4.6
liveexperts123

please ignore the bid amount we will discuss the price later in the chat after we have discussed the project thoroughly Relevant Skills and Experience: . Proposed Milestones: 190 - . Hi nckishtp! please inbox me to dis Περισσότερα

$190 USD σε 2 μέρες
(4 Αξιολογήσεις)
4.5
arksong123

Hi! I have rich experience in this field. If you fast and quality result, you can hire me. Relevant Skills and Experience Javascript, node.js, Web Scraping Please contact me. Proposed Milestones $155 USD - complete Περισσότερα

$155 USD σε 3 μέρες
(10 Αξιολογήσεις)
4.2
suhailflncr

SUHAIL Hello My name is Suhail. I am professional programmer. I have 8+ years experience working Node.js, In addition to writing front-end codes and creating technical specifications for prototypes and guides. I am pro Περισσότερα

$50 USD σε 7 μέρες
(0 Αξιολογήσεις)
0.0