General Work Description:
We are looking to create a tool to gather information from websites customized for an individual user. This includes but not limited to billing information and billing cycles (start and end dates of past bills), and customer types. The data we are interested in would then be returned in a structured way to the client that called it. This tasks requires, being able to authenticate with webpages, navigating to certain pages (and cookie management if page views are tracked) as well as doing PUT, POST requests with dynamic information derived from given form data.
Prerequisite:
- Ability to use Wireshark, Charles or other web packet analyzing tools
- Read and parse html and JS
- python requests
- python selenium and phantomJS
- python re
- python BeautifulSoup