Ολοκληρωμένο

Need web spider scraping program written for the following username DFUSER8493

I need a web scraper written for the .xlsx file in the following directory:

[login to view URL]

The latest .xlsx file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .xlsx extension.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin City*" column (column B)

origin_state --> data located in the "ST" column located after the origin city column (column C)

ship_date --> data located in the "P/U Date" column (column A), change to the YYYY-MM-DD format

destination_city --> data located in the "Dest. City" column (column D)

destination_state --> data located in the "ST" column located after the dest. city column (column E)

receive_date --> leave blank

trailer_type --> data located in the "Eq. Type" column (column F)

load_size --> data located in the "Full/LTL' column (column G)

weight --> data located in the "Weight" column, add three zeros to the end of the

data if there are only 2 numbers (ie. 48 = 48000) (column O)

length --> data located in the "Length" column (column N)

width --> leave blank

height --> leave blank

trip_miles --> data located in the "Miles" column (column H)

pay_rate --> data located in the "Rate" column (column M)

contact_phone --> leave blank

contact_name --> add data from "Dispatcher" and "Ext." columns (columns J & K)

tarp_required --> leave blank

comment --> data located in the "Special Req." column (column L)

load_number --> leave blank

commodity --> data located in the "Commodity" column (column I)

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Ικανότητες: Linux, Perl, Web Scraping

Περισσότερα: need web master, need web designer landing page, write web spider, how to scrape a website, web scraper tutorial, web scraping for beginners, intro to web scraping, how to build a web scraper, learning web scraping, web scraping medium, web scraping examples, python, linux, web scraping, perl, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet

Σχετικά με τον Εργοδότη:
( 62 αξιολογήσεις ) Chillicothe, United States

Ταυτότητα Εργασίας: #17453040

Ανατέθηκε στον:

gangabass

I can provide you same Perl scraping script as before: WWW::Mechanize, HTML::TreeBuilder::LibXML, Text::CSV_XS etc.

$88 USD σε 1 μέρα
(401 Αξιολογήσεις)
7.2

11 freelancers κάνουν προσφορές κατά μέσο όρο $159 για αυτή τη δουλειά

schoudhary1553

raccoon Hello, I can help with you in your project scraping program. I have more than 5 years of experience in Linux, Perl, Web Scraping. We have worked on several similar projects before! We have worked on Περισσότερα

$250 USD σε 3 μέρες
(13 Αξιολογήσεις)
5.6
yongjin818

"raccoon" Dear I am an expert in web scraping. In before, I developed 400+ spiders using scrapy, php, selenium. For example, I scraped data for Many products informations from these sites(ex: ebay, amazon, welivv, bo Περισσότερα

$155 USD σε 3 μέρες
(39 Αξιολογήσεις)
5.3
adampohp79

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, perl, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, Περισσότερα

$300 USD σε 3 μέρες
(11 Αξιολογήσεις)
4.7
$77 USD σε 5 μέρες
(18 Αξιολογήσεις)
4.9
SidhuDN

"raccoon" Dear Sir/Ma'am, I am ready to scrap web data. If you want, then I am able to start your work right now and give you the task within 2-3 days Without wasting your time I want to make a sample, Please a Περισσότερα

$150 USD σε 3 μέρες
(6 Αξιολογήσεις)
4.1
Bluesky122

RACCOON ⭐⭐⭐⭐⭐Please See My Profile⭐⭐⭐⭐⭐ Hi. I see your requirement and bid here. I have some idea about your project. first.I will make admin page to manage scraping. in there,some button will [login to view URL] you click s Περισσότερα

$150 USD σε 3 μέρες
(2 Αξιολογήσεις)
3.4
onedirecttech

Hi I hope you are doing good. You said to mention "raccoon". I have 12 years of experience in scripting in Perl and Shell script. There several Perl modules for reading spreadsheet using which I can use. I can do som Περισσότερα

$277 USD σε 20 μέρες
(1 Κριτική)
0.8
$35 USD σε 3 μέρες
(1 Κριτική)
0.3
EliteTeam7

Hello, how are you ? I'm very interested in your project. I'm really web scraping expert using php, python and C# etc. i can show you several packages such as selenium, scraper etc. I can show you my good s Περισσότερα

$155 USD σε 3 μέρες
(0 Αξιολογήσεις)
0.0
vinothsridhar

raccoon I'm going to use headless chrome with was lambda function

$111 USD σε 2 μέρες
(0 Αξιολογήσεις)
0.0