Automated cURL login to www.cmcmarketsstockbroking.com.au and data extraction

** Updated to match your additional description ** Hi, I have developed software for over 20 years, and have lots of experience with most web-related technologies, including HTML, JSON, XML, and much more. Over the years, I have scraped hundreds of sites using many different technologies for various projects. Even though probably not the most efficient, it *should* be possible to do it solely with bash and curl (though I can only confirm it if you provide login details). Note that if you have perl installed (which is the case on most systems, AFAIK), then I'd much prefer using perl than bash, but I can definitely use bash if required. However, if there are any captchas or the like, it's going to be much more difficult to do it with just bash. Let me know if you can provide the requested details or have any questions. Jacques.

I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete this task and will only waste your time. Hire me, a professional with a rock solid reputation and over 8 years of experience specifically in writing scraping code like this. I know what I can and cannot do, and I won't waste your time by saying I can do something that I can't. because I exclusively write scraping code I know what to expect and I will always live up to what I tell you, and will also deliver a higher quality final product than my competitors. This can be done in about a week

Hi! I'm expert in web automation that's why I'm the right person for your project. I can create program you want (using standard linux tools) in less than two days and I can offer you best price here. I'm talking about CLI tool which will accept params you want (username, password, query and optional code) and perform actions you want. The output will be saved to local files. Please give me sample login/password for testing. Thanks. Roman

Hi, I am ok with the additional info but my solution would be php curl based....please let me know. I looked your posting and I am very much interested to work with you ...I am an India based software professional providing a range of IT services and solutions that address the technology needs of your company in a variety of vertical business segments. I have more than 8 years of expertise in Bootstrap, PHP, MySQL, Apache Solr, CouchDB, HTML, CSS, SEO, Smarty, AJAX, jQuery, GoogleMaps, OpenCart, Magento and customized ecommerce based projects as well as most of the payment gateways and many other Open Source Technologies and frameworks, CRON jobs etc. Key points why you should consider me for your work - 1. First of all, I am working independently as freelancer... so no restrictions on working hours 2. Always discuss the project deeply before start so that the development would be fast and on-time. 3. Timing: I am online 8-10 hours daily from 9:30 AM to 8.00 PM (IST). 4. Prompt reply through Email or Skype, Gtalk. 5. Having a staging server to show the development/updates to client (if required). 6. Having a high speed internet 7. Development options : per hour, per week, per month, per project. Looking forward for an positive response and long term business. Nand

100% Completion is our accomplishment Our goal is to provide effective web solutions that are focused on reducing your costs. Our team have breadth and depth of programming and designing knowledge and good client-facing skills. Contact us to receive a Free consultation for your web design, web development , and internet marketing requirements

A proposal has not yet been provided

Hi, For such sites, which are full of AJAX things, curl is not the solution. The best way to handle form tokens, cookies and AJAX is to work with site like user will - via web browser. This can be achieved using Selenium framework + Firefox. On the server side it's a bit more than minimal stuff you described: we'll need JDK, full firefox install and xvfb. But we live in era of clouds, so I can implement it like stand-alone VM somewhere on AWS and provide full access and suitable API for you. OK, if it not scares you, ping me :) But Selenium is really only good solution here... Looking forward for your response. Sergey