Javaspark Set up

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Java Scala and Python. Have worked Shell, Perl and Python Can we talk further on this? Thank you!

I have experience in deploying and maintaining of: Cloud Computing Platforms: AWS Amazon Web Services,Microsoft AZURE, Google Cloud (GCP). Server Operating Systems: Windows Server 2003-to-2012R2, Windows Server 2016 Amazon Linux, Debian, RHEL, CentOS, Ubuntu. Web servers and servlets containers: IIS, APACHE, NGINX, DOCKER Mail servers: POSTFIX, EXIM, MS Exchange 2000-to-2013, MS Exchange 2016, QMAIL Database servers: MySQL, MS SQL Virtualization: MS Hyper-V, VMware Server(ESXI), VirtualBox. Directory service: Active Directory, OpenLDAP. File servers: IIS FTP, proftpd, FileZilla FTP Server, SAMBA. Firewalls: Windows firewall,ISA/Forefront TMG, MikroTik,PFSense Zywall and other Routers; Data Storage Systems: Netapp, FAS, EMC, VNX; Hosting Panels: PLESK,cPanel,Website Panel

Hi, I have 7 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

Hi, Please tell me the details of this setup and I might have a great idea how to handle it automatically. Thank you.