Φίλτρο

Οι πρόσφατες αναζητήσεις μου
Φιλτράρισμα κατά:
Προϋπολογισμός
σε
σε
σε
Είδος
Δεξιότητες
Γλώσσες
    Κατάσταση Δουλειάς
    2,592 elasticsearch δουλειές που βρέθηκαν, με τιμές EUR
    Project for Jories Έχει λήξει left

    ...routing required. - MongoDB for the datastore using Mongoose ODM. - All the images and files will be stored in S3 servers which will be fetched by the cloudfront CDN to display on the web. - Images processing in NodeJS - Need to use node-uuid npm module for unique identifiers for storing file names etc. - Strong hand on Amazon AWS services. As the server is EC2 running on Ubuntu-Nginx. - Elasticsearch would be required which fits to our algorithm to make search more compatible. - API integration (SMS/Payment) - Usage of Gmap integration would be required to make a better algorithm to display distance. - Need to follow Trello, slack , Github and kanban methodologies to collaborate & carry out the project efficiently. Need the best guys to work as a team member f...

    €275 (Avg Bid)
    €275 Μέση Προσφορά
    1 προσφορές
    marketplace website Έχει λήξει left

    We are looking for a company with a team of developers to help us buid a site like readbeacon, thumbtack or oneflare. Please do not bid on this project unless ...of developers to help us buid a site like readbeacon, thumbtack or oneflare. Please do not bid on this project unless you have used or understand how them works. Graphic work and html/css responsive is done yet. Some of the requirements and skills for this project are: - php/mysql - laravel framework - multilanguage site (3 languages) - frontend and backend - search engine (algolia or elasticsearch) - Git for control versions is a must - google maps/places integration - transactional email/mobile text messages - geohash implementation -facebook/twitter integration We must have access to database and code since ...

    €3919 (Avg Bid)
    €3919 Μέση Προσφορά
    27 προσφορές
    PHP/Nette developer Έχει λήξει left

    Chcete se podílet na projektu, který má smysl? V Košíku již nějakou dobu pracujeme na novém webu a připravujeme naší vlastní skladovou aplikaci, logistický systém a další řadu vnitrofiremních systémů, právě pro které hledáme nové programátory. Bude to běh na dlouhou trať a každá šikovná ruka se bude hodit. :-) Používáme následující technologie: PHP 5.5 Nette 2.3 Mysql Lean Mapper ElasticSearch Kdyby komponenty Když nám nějaká komponenta nevyhovuje, přizpůsobíme si ji nebo si vymyslíme vlastní řešení. Dbáme na správn&...

    €7 / hr (Avg Bid)
    €7 / hr Μέση Προσφορά
    3 προσφορές

    ...the dev team to conform the existing android and ios apps to perform with it. Our time frame is less than 3 weeks to get everything completed. Read complete, detailed, project guideline- Extra: Site uses mysql, we want to transition to use elasticsearch for all. (We will provide full Elasticsearch installed, and usability with a elasticsearch developer to work with your team to make it easy, just have to code in the settings for it, and enable it to use it) Let us know if you can do this too. Please note with your bid: do you have strong experience in codeignitor how much will be the cost of extra hours, will you do UI can your team do ios and android apps how many devs can

    €4359 (Avg Bid)
    Επείγον
    €4359 Μέση Προσφορά
    68 προσφορές
    Redis and Elasticsearch Application Έχει λήξει left

    I need a search application possibly using different aggregations with a REDIS and ElasticSearch as will be two instances of the same application one with redis and one with ElasticSearch. I will provide you the data (which is in txt format nearly 1 million files)to be stored in both of these databases(to be converted in its own format of course) I will give you more detail when contacted.

    €413 (Avg Bid)
    €413 Μέση Προσφορά
    2 προσφορές
    Project for hpprobook Έχει λήξει left

    I need some help for elasticsearch and to configute ubuntu server.

    €9 (Avg Bid)
    €9 Μέση Προσφορά
    1 προσφορές

    ...prepared) - All the images and files will be stored in S3 servers which will be fetched by the cloudfront CDN to display on the web. (needs to be done) - Images processing in NodeJS (it's done but needs to be more perfected) - Need to use node-uuid npm module for unique identifiers for storing file names etc. - Strong hand on Amazon AWS services. As the server is EC2 running on Ubuntu-Nginx. - Elasticsearch would be required which fits to our algorithm to make search more compatible. - API integration (SMS/Payment) - Usage of Gmap integration would be required to make a better algorithm to display distance. - Need to follow Trello, slack , Github and kanban methodologies to collaborate & carry out the project efficiently. Need the best guys to work as a team m...

    €330 (Avg Bid)
    €330 Μέση Προσφορά
    13 προσφορές

    I am nearing launch of an application build with Node/Elasticsearch and Rethink DB in the backend, and Angular for the front-end. I'm looking for an AWS expert to help me with my setup ( I have a basic understanding ) to ensure that the application can autoscale, auto-heal, is backed up and is as cost-effective as possible. I'm only starting small with a few users, but I'm hoping to get a good infrastructure in place so it's easy to grow quickly. I've done some tinkering with AWS and understand the principles of it, I just get stuck on best practice security, scaling and backups. I'd expect a vendor to work with me to develop a recommended solution, then provide documentation on how I can independently maintain that solution. I'm happy to ...

    €314 (Avg Bid)
    €314 Μέση Προσφορά
    12 προσφορές

    debug and fix Elasticsearch on AWS as it keeps crashing. Must have prior ES experience.

    €18 / hr (Avg Bid)
    €18 / hr Μέση Προσφορά
    4 προσφορές
    ELK stack implementation Έχει λήξει left

    I'm looking for a talented individual to assist my company (ISP) in setting up the ELK stack. Elasticsearch, Logstash & Kibana. I can give you a fresh install of the ELK stack across multiple servers (depending on your recommendation). We use Debian OS. At this point we currently send logs via rsyslog from our servers. What we need. ============= The ELS stack setup across multiple servers so it scales. Postfix logs (already sending via rsyslog) Below is a standard rsyslog config we use to send logs. *.*; 103.xx.xx.10:5001 mail.* 103.xx.xx.10:5010 Detailed Netflow analysys. A Kibana dashboard showing the following; * Top 20 downloading IP addresses (can send Netflow to ELK) * Top 20 uploading IP addre...

    €359 (Avg Bid)
    €359 Μέση Προσφορά
    5 προσφορές

    * Get python ETL script running on local machine. * Update python script to load jobs to AWS Elasticsearch instance provided in format provided. * Modify python ETL script to run on amazon lambda when a file is uploaded to S3 in the appropriate location * Write python script to retrieve XML job feeds and store in Amazon S3 from location to be provided. Notes: * Project is managed in Trello * Code is managed in bitbucket * Scope of work may change per Work Here project manager. Working code required for release of funds.

    €14 / hr (Avg Bid)
    €14 / hr Μέση Προσφορά
    1 προσφορές

    ...healthy laziness - If there is a tool, library or open source project out there that does something already, we want you to use it! Solid c# AND VB.Net skills Solid ASP.Net experience, specifically in a large scale online environment Great CSS skills, up to CSS3 Great HTML skills, up to HTML5 Solid Javascript skills Solid DB skills (we use MySQL at the moment, but we have worked with SQL, ElasticSearch, NoSQL, Redis and a few others as well) Working knowledge of server configuration and monitoring. Knowledge of tools like NewRelic, LogEntries and similar would be a great bonus. Desirable Any links to a GitHub repository or similar will really help! Any knowledge/experience of WinForms development Any knowledge/experience of WPF Any knowledge/experience of AWS, EC2...

    €28 / hr (Avg Bid)
    Προεξέχον Επείγον
    €28 / hr Μέση Προσφορά
    46 προσφορές
    ElasticSearch + MongoDB Έχει λήξει left

    Looking for someone to configure Elasticsearch to index by 10,000s of topics based in MongoDB . Configure search results, configure update to Firebase by 1000s of topics Must be competent with Github Must be willing to do a daily update via Slack

    €6 / hr (Avg Bid)
    €6 / hr Μέση Προσφορά
    5 προσφορές

    At we have created a data intelligence solution. It is easy to use if you know how to take transform data and load it. We are looking for great junior data scientists that want to try the tool and write great blog posts on the tool applied to different sectors and datasets. You'll need to...2 max and look forward to a fruitful, long term cooperation which could lead to an employement in Europe or US. Do not apply unless you've tried the software and shown you can load some data in it. When applying point us to previous technical text you have written. Example something along these lines, but of course might be lesser in scope:

    €229 - €688
    Σφραγισμένο
    €229 - €688
    7 προσφορές
    Query on dates / time Έχει λήξει left

    We are using Elasticsearch as a datastore. The documents are events (concerts, art openings, club nights, etc.) and local businesses (shops, bars, restaurants, etc.) with opening dates and hours. We have a Node.js API that executes queries to pull up and sort documents. These are then displayed on our website (we use ) and a mobile app (built in PhoneGap / Cordova). I am looking for consultation to help construct queries that do various things, e.g. select things that are open/happening now, today, tomorrow, etc. and order the results according to various sort criteria, e.g. opening time, geolocation, etc. I'm looking for someone who has experience in Elasticsearch scripting, e.g. script-based sorting.

    €16 - €32 / hr
    €16 - €32 / hr
    0 προσφορές

    Looking for someone to write a thesis that requires data analysis using Elasticsearch and Kibana. Length: 10, 000 words More details to be discussed

    €182 (Avg Bid)
    €182 Μέση Προσφορά
    4 προσφορές
    Help build Kibana Dashboard Έχει λήξει left

    I have parsed Windows Event Logs into ElasticSearch/Kibana. I need assistance building a dashboard to show log activity. I want to show user logins, logoffs, against time, new account creation, account deletion, overall activity based events per time, etc. I do not understand the kibana query language.

    €23 (Avg Bid)
    €23 Μέση Προσφορά
    2 προσφορές
    Scrapping WebSite Έχει λήξει left

    Convert existing Jaunt scrapping script to use Scrapy. Save data to MongoDB and connect with Elasticsearch. Classify scrapped results. URGENT - Need to be done in 24 hours.

    €91 (Avg Bid)
    €91 Μέση Προσφορά
    4 προσφορές
    Javascript + Elasticsearch Έχει λήξει left

    Looking for a developer who is an expert in javascript and has some experience with elasticsearch. In your proposal, please: - State your experience with javascript - Your experience with elasticsearch - Your proposal must begin with "Hi David". Experience with python a strong plus. Experience with mysql a plus.

    €473 (Avg Bid)
    €473 Μέση Προσφορά
    7 προσφορές
    Elasticsearch Expert Έχει λήξει left

    I require the services of an Elasticsearch expert with knowledge of Fuzzy Query and scoring to assist in refining our search formula. You must have a good working knowledge of Elastic & Lucene and understand how to score similar search results based on how close they are to the search term.

    €367 (Avg Bid)
    €367 Μέση Προσφορά
    7 προσφορές

    Hello we are a small hosting company in Italy, and we manage Magento servers for our clients. We need a server with ELK Stack (kibana, elasticsearch, logstash, eg: ) with a custom dashboard for each of our client. then on the client's server we need to install the logstash-forwarder to parse: NGINX -access log -errior log PHP-FPM -error log CSF FIREWALL to monitor failed logins MAGENTO -2/3 other custom logs i will give you a new server where to install the stack, we prefer the stack built on top of ubuntu 14, just like the tutorial

    €586 (Avg Bid)
    €586 Μέση Προσφορά
    21 προσφορές
    Refactor a PHP site to Laravel Έχει λήξει left

    We have a website written in PHP from scratch. The code is undocumented and outdated. Making improvements and adding functionality is a pain. We need to scrap it and replace it with a refactored version in Laravel or a similar framework for sustainability. In this move we are also changing database from Solr to Elasticsearch and moving all our files from Mysql BLOBS to Amazon S3. We are also moving from custom html to Bootstrap. The website requires user classes, faceted search, an administration system with user administration, newsletter sending, email scheduling and a lot of other stuff. The project is estimated to take 2-3 months and if we are satisfied there will be more work. Speed, self-reliancy and professionalism will be rewarded. We use Github for our projects and...

    €1375 (Avg Bid)
    €1375 Μέση Προσφορά
    60 προσφορές
    Build a Website Using a Template Έχει λήξει left

    I require someone to build an ecommerce website using a responsive template. This will be used to display hospitality supplies from a web-scraped database. An example of the data is here: The site... The site will need to be a sub-domain of our current website and will need to look similar. We will not be processing payment through the website. If user wish to purchase they will be sent to the original website. This site will work like an airline aggregator website. You will need to implement the WP elasticsearch plugin if possible. The search needs to include the country, state & product details.

    €332 (Avg Bid)
    €332 Μέση Προσφορά
    56 προσφορές
    Elasticsearch problems with Drupal Έχει λήξει left

    Elasticsearch problems with Drupal. I will explane the problems.

    €32 (Avg Bid)
    €32 Μέση Προσφορά
    2 προσφορές

    10+ year experience IT-specialist, wide and deep specialization with experience in real projects - sr. web developer; - windows and linu...linux web/lan admin - managment and marketing - hardware consultant - teamlead Sr. development, optimization, support: - HightLoad php services, deamon with MQ - development and billing services, AD targeting API and service, corp. framework - use OOP PHP FW (mvc, orm, cache, HightLoad, ...), Perl (before 2010) - deep SQL and NoSQL - search engine integration, deep filters (Sphinx, Elasticsearch) - parsing, XML, API(create amd use, RestFull HTTP), SMM, Social API, oAuth, cloud, partners - frontend developer JavaScript, jQuery - quality and stress autotest, code audit - admin web service(LAMP, nginx+fpm, sql), HW, SW, Linux, Wi...

    €30 / hr (Avg Bid)
    €30 / hr Μέση Προσφορά
    8 προσφορές
    elasticsearch Έχει λήξει left

    looking for a specialist in elastic search to assist with elastic search configuration and use in particular, filtering, sorting pagination, mapping, use of custom analysers, aggregations etc.

    €19 / hr (Avg Bid)
    Προεξέχον Επείγον
    €19 / hr Μέση Προσφορά
    6 προσφορές

    Looking for a server admin to assist in the management of a farm of servers we run ngnix, php-fpm, various cache , haproxy, elasticsearch, mysql

    €22 / hr (Avg Bid)
    Προεξέχον Επείγον
    €22 / hr Μέση Προσφορά
    27 προσφορές

    ...de um módulo para um sistema web, cujo layouts em HTML+CSS já estão prontos. O sistema é feito em AngularJS, Zend Framework, PHP, JavaScript, JQuery e MySQL. Conhecimento nessas tecnologias é essencial. É um módulo de planejamento composto pelas seguintes páginas: - Página de cadastro com cerca de 13 campos - Página de seleção de locais e informações extraídas de um banco de dados em ElasticSearch - Cadastro simples de metas (um número) para cada um dos locais selecionados na tela anterior - Cadastro de um plano de ação para cada local selecionado (cadastro simples com cerca de 10 campos) - Cadastro de ações de marketing (formul&aacu...

    €631 (Avg Bid)
    €631 Μέση Προσφορά
    7 προσφορές
    Développeur Java / Node JS Έχει λήξει left

    Bonjour, Nous montons une plateforme de services et de big data dans le jeu vidéo à vocation internationale avec un périmètre multilingue de départ. Nous avons besoin d'un freelance pour nous aider à développer notre plateforme, nous avons une infra AWS avec bdd Cassandra. Systèmes de batchs de données en masse multilingue, authentification, relat...développer notre plateforme, nous avons une infra AWS avec bdd Cassandra. Systèmes de batchs de données en masse multilingue, authentification, relations complexes entre bases... Idéalement : Au moins 3/4ans d'xp Java 8 : maîtrise des lambdas, dates, ... Plateforme localisées Spring : Spring core, Spring MVC, Spring da...

    €601 (Avg Bid)
    €601 Μέση Προσφορά
    5 προσφορές
    Design and Build Two Websites Έχει λήξει left

    I need two sites designed and built on the following tech stack: node.js using nodedb to connect to a mySql backend. AngularJS on the client using bootstrap as the display framework - sites must be responsive. Need to use sendgrid for EDM / Email / Message distribution and elasticsearch for dynamic content and search results. One site will be heavy google maps integration and the other will be driven around a calendar function. Both sites need admin dashboards built as well - similar to metronic bootstrap / angular theme. OS will be linux. As a rough guide, one site will be similar in functionality and scope to and the other will be similar to customade.com. Wireframes will be complete this week, so first step will be design commencing next week. Once site builds are done

    €2574 (Avg Bid)
    €2574 Μέση Προσφορά
    28 προσφορές

    ...online platforms, including expertise working with "big data" having potentially been involved with large-scale data migration projects. If you experience working on property portals or websites and building large-scale consumer focused products – then this role is for you. Appreciation for open source and big data technologies. Our tech stack: - Python - SQLAlchemy - PostgreSQL - ElasticSearch We are only looking for an individual (not a company). All applications must have read and understood the requirements and have a history of working on similar project of this size. 1) Design the System Architecture 2) Lead the programming on the database side 3) Work with UI programmers and designers We are paying monthly and not by the hour. This is...

    €52775 (Avg Bid)
    €52775 Μέση Προσφορά
    13 προσφορές
    Xây dựng trang web Έχει λήξει left

    Xây dựng trang web với đầy đủ các tính năng: 1. Tastypie-API 2. Search theo Elasticsearch 3. Giỏ hàng và thanh toàn của django-oscar ....

    €545 (Avg Bid)
    €545 Μέση Προσφορά
    6 προσφορές

    I have an elastic search query which seems to work find on ES 1.4.4 but does not work on 1.7.1 (latest version at this moment) I need the query altered and later told what has changed so I can alter my code base later accordingly

    €37 (Avg Bid)
    €37 Μέση Προσφορά
    1 προσφορές

    We are looking for a freelancer who has good skills in django, angular.js and worked with elasticsearch and can expedite development of our web app. We are looking to build an app by caching various social feeds and displaying data on site. Bid as your hourly rate, as for 25 hours of work.

    €229 (Avg Bid)
    €229 Μέση Προσφορά
    11 προσφορές
    Build a Website Έχει λήξει left

    ...XML CasperJS Cassandra Chef Configuration Management Chordiant Chrome OS Cisco Cloud Computing CMS COBOL Cocoa Codeigniter Cold Fusion Computer Graphics Computer Security CRE Loaded CS-Cart CubeCart CUDA D3.js Dari Dart Data Warehousing Database Administration Database Development Database Programming DDS Debian Debugging Delphi Django DNS DOS DotNetNuke Drupal Dynamics eCommerce edX Elasticsearch eLearning Electronic Forms Embedded Software Ember.js Erlang Estonian Express JS Expression Engine Face Recognition FileMaker Firefox Fortran Forum Software FreelancerAPI Game Consoles Game Design Game Development GameSalad Gamification Git Golang Google Analytics Google App Engine Google Cardboard Google Chrome Google Earth Google Maps API Google Plus Google Web Toolk...

    €2792 (Avg Bid)
    Προεξέχον
    €2792 Μέση Προσφορά
    2 προσφορές
    Ruby On Rails Έχει λήξει left

    Description : About you -You are passionate. -You are a full stack mid-senior developer who loves the craft of software engineering. -Y...change the way we live! Our client has a mobile app powered by an ingenious rails backend gets you anything you want delivered in under an hour, from your favourite restaurant or store directly to your door. Our client is a an award winning team in London who have strong industry backing. Our Stack Ruby on Rails, HAML Sass, Javascript jQuery, Angular, Coffeescript, AJAX, MySQL, Redis, ElasticSearch What you get Competitive salary, stock options, great team, free company services from our CTO and his tendency to feed others with chocolate burgers doughnuts! Work in a company with tech at its core that will change mobile commerce as w...

    €29 / hr (Avg Bid)
    €29 / hr Μέση Προσφορά
    24 προσφορές
    Elasticsearch on AWS Έχει λήξει left

    Setup and run Elasticsearch on AWS. Must have done this before.

    €45 (Avg Bid)
    €45 Μέση Προσφορά
    11 προσφορές

    Dear All, Need to implement search functionality using Elasticsearch or Sphinx search Interested programmer may choose either of these search engines based on our requirement and their expertise The entire exercise needs to be completed over a remote screen sharing session, like using teamviewer Details given below. Environment: Centos 7 x64 running MariaDB 10, WHM/Cpanel Sphinx 2.2.9 installed and running Elasticsearch 1.7 installed and running Nature of website: Media sharing community networking website, based on php (symfony framework) What needs to be done: 1. Connect & do a Real-time indexing of all tables/fields in the mysql database 2. Realtime indexing of user submitted documents like .doc, .pdf (optional, if budget would increase) 3. F...

    €271 (Avg Bid)
    Προεξέχον
    €271 Μέση Προσφορά
    2 προσφορές
    DataAnalysis -- 2 Έχει λήξει left

    We have 2 datasets: 1. sales from fastfood restaurants (Product, Day, Time, Amout etc) 2. Weather data we want to know if there is a relationship between temperature and sales I want to use 2 tools: A) Rapidminer on my computer and want you to to the job with me so I learn how its done B) Elasticsearch and KIbana (Server exists) need to load data and to ETL

    €170 (Avg Bid)
    €170 Μέση Προσφορά
    3 προσφορές

    We are making classifieds aggregator site in URL: We have about 1 million of crawled classifieds in our database and we need to make fast search engine for small server. I don't want to burn our database with every queries and that's why I want to use Open Source Search engines for that purpose. I want that you make search engine with Apache Solr, ElasticSearch or other same kind of seaerc systems. It is needed that you have knowledge for that technology already. There is also work in finalizing that site and make it SEO. We can talk more in chat. Give me good message, don't copypaste anything. I want that you understand what we are doing. I want that you have good english and communication.

    €250 (Avg Bid)
    €250 Μέση Προσφορά
    12 προσφορές

    We are looking for a part-time Senior Java Developer to assist immediately on an iOS application development project. The project should take approximately 40-80 hours to complete and focuses on the back-end of the project. The Senior Java Developer should have the following experience: • Expert-level implementation experience with Elasticsearch, add-ons, and related products • Expert understanding and implementation experience with iOS development projects (back-end perspective) • Expert-level Java development experience • Senior to expert-level big data experience • Senior to expert-level big data analytical experience (tools) • Senior to expert-level back-end authentication implementation experience • Senior to expert-level back-end secu...

    €6677 (Avg Bid)
    Προεξέχον Επείγον ΣΜΓ
    €6677 Μέση Προσφορά
    31 προσφορές
    spider keywords google plus more Έχει λήξει left

    develop script using , spider google for results based on keywords, excluding whitelisted domains add those search result urls to an elasticsearch index further manipulate the urls from the index keep track of statistics via a node.js web gui Use AWS for both the front end and elastic index

    €1199 (Avg Bid)
    €1199 Μέση Προσφορά
    6 προσφορές
    DataAnalysis Έχει λήξει left

    We have 2 datasets: 1. sales from fastfood restaurants (Product, Day, Time, Amout etc) 2. Weather data we want to know if there is a relationship between temperature and sales I want to use 2 tools: A) Rapidminer on my computer and want you to to the job with me so I learn how its done B) Elasticsearch and KIbana (Server exists) need to load data and to ETL

    €159 (Avg Bid)
    €159 Μέση Προσφορά
    9 προσφορές

    Install ElasticSearch on server to service wordpress multi-site I want to use the power of ElasticSearch in my wordpress installtion There is a wordpres plugin available that does this, the link is: My plan is to install Elastic Search on a separate server So, not only do I want this done but I also want advice on choosing a suitbale hosting environment. One that will meet the speed requirements and expected user search activity Please only apply if you have had experience with this before

    €112 (Avg Bid)
    ΣΜΓ
    €112 Μέση Προσφορά
    14 προσφορές

    I am looking for an experienced academic writer to do a 36 page (275 words per page) dissertation that involves online data analysis using Elasticsearch and Kibana. More details to be discussed later.

    €400 (Avg Bid)
    €400 Μέση Προσφορά
    13 προσφορές

    We have a live site implemented using the MEAN stack (Mongo, Express, Angular and Node.js) and are looking for a talented dev to add new features to it: - ability for our users to send messages to each other (not realtime but more of a built in inbox system) - improve the search feature of the site to something more robust. Right now it's Mongo search but we're looking to upgrade to elasticsearch or google search api - ability for users to delete their uploaded documents, ability for admins to delete users -some responsive updates to the site so it looks good on mobile and tablet - small bug fixes to existing functionality This has to be completed before sept 1 and the budget is $5,000 Please include bitbucket/github links to 3 of your most impressive MEAN sta...

    €4178 (Avg Bid)
    €4178 Μέση Προσφορά
    20 προσφορές
    Write some Software Έχει λήξει left

    Need help with Elasticsearch. Basically need someone to write the query needed for ES to return the desired search result. The mapping is as following: { "palsx1493": { "mappings": { "pals": { "properties": { "aboutme": { "type": "string" }, "dob": { "type": "date", "format": "date" }, "fccode": { "type": "string" }, "fcname": { "type": "string" },...

    €217 (Avg Bid)
    €217 Μέση Προσφορά
    6 προσφορές

    ...sites that I'd like to crawl - each one roughly 750k pages. I'm interested in stats around how the sites are organized content-wise (the most popular categories and tags), etc... From a crawling standpoint I would prefer either Nutch 2.3 or Scrapy. We then need to parse relevant pieces from the HTML (roughly 10-15 fields that are easily identifiable in the dom), and get the data into an ElasticSearch index. From there we hook Kibana to it and start slicing the data. It's going to run on a single ec2 instance - we will not be clustering the crawl or the ES index. It would be a huge bonus if you were familiar with AWS OpsWorks so we could automate standing up the environments for future crawls. If you've done this before, please mention it in your response...

    €441 (Avg Bid)
    €441 Μέση Προσφορά
    8 προσφορές

    There is a large site on the internet that is split up into categories, it has tags, etc...I want to mine as much about the structure of this site as possible. We are going to start with their s...possible. We are going to start with their files to get a sense of the structure. From there we will fetch certain pages and extract key information from the dom. Alternatively we may just want to crawl the entire site and start with all of the pages. I like Nutch as a crawler - but we can see what you're most experienced in. Bonus points if you have experience working with ElasticSearch. I think that is where I'm going to want to store all of the data that we extract from the site. We will be working iteratively - which is why I am looking for hourly help. Not proje...

    €20 / hr (Avg Bid)
    €20 / hr Μέση Προσφορά
    5 προσφορές