DevOps Engineer with AWS and Bigdata Experience

Company: VentureSoft Global
Location: Beaverton
Posted on: March 27, 2020

Job Description:

Below is a long term contract no less that 18 months with our Direct Client in Beaverton, OR. DevOps Engineer AWS Big Data We are looking for a DevOps engineer with a systems background and AWS operational experience. This role will provide advanced operations support for Big Data workflows and contribute to DevOps automation and system improvements supporting our Big Data platform users. Key experience includes AWS operational experience Hadoop ETL workloads (Hive, Spark, Presto) DevOps (GitHub, Jenkins, Terraform) Python, Linux shell scripting Experience supporting sustaining engineering teams Key responsibilities Advanced support and infrastructure deployment for job scheduling workloads (AirflowAWS EMR). Support infrastructure operations for AWS cloud-based services and ensure SLAs are achieved or exceeded. Improve our infrastructure by developing and improving our CICD workflows and pipelines that provide stable and repeatable infrastructure and builds. Contribute to and support container based infrastructure (EKS, Kubernetes). Enhance observability through improved monitoring and alerting. Provide advanced engineering support services (L3 support) Drive root cause analysis for common problems. Provide status updates to users and stakeholders. Track all details in the issue tracking system (Service Now). Assist with training and onboarding for new end users. Contribute to Agile Kanban workflows and team process work. Other operations and support duties as needed. Required Job Qualifications AWS 3 years experience including EMR, EC2, S3, VPC, Athena, ElasticSearch, etc. Advanced experience with IAM policy and role management. Experience with container systems is desired EKS, ECR, Kubernetes, Docker. Infrastructure Operations 3+ years supporting systems infrastructure operations, upgrades, deployments, and monitoring. Ability to keep systems running at peak performance, upgrade operating systems, patching, and version upgrades as required. CICD Experience with CICD methodologies and environments. Experience with Terraform, Jenkins or Circle-CI and GitHub. GitOps exposure is a plus. Programming 2+ years experience programming with Python. Experience with Bash, REST APIs, and JSON encoding. Linux 5+ years in Unix systems engineering with experience in Red Hat Linux, Centos or Ubuntu. Security Experience implementing role-based security methodolgies, including AD integration, security policies, and auditinglogging in a LinuxAWS environment. Networking Working knowledge of TCPIP networking, HTTPS, load-balancers (ELB, HAProxy) and high availability architecture. AgileScrumKanban experience. Collaborate with Project Managers, Product Managers, QA and Engineering teams to deliver results. Demonstrated good written and verbal communication and interpersonal skills. Ability to work well with data engineer as end users. Proven track record of success in fast-moving organizations with complex technology applications.

Keywords: VentureSoft Global, Beaverton , DevOps Engineer with AWS and Bigdata Experience, Engineering , Beaverton, Oregon