Job Title: Infrastructure Engineer/DevOps Engineer – 18903329
Location: Onsite in either Cupertino, CA OR Seattle, WA (Hybrid)
Duration: 6+ Months
Pay rate: $78 -83 /Hour
Summary
Must have skills:
- Java/JBM Software Engineering/Programming
- AWS /GCP Stack with Automation
- Open Source- Hadoop and Spark
- Data Processing
- Security
Nice to Have: Kubernetes, AI/Client, Big Data
Key Qualifications
- 3+ years of experience scaling and operating distributed systems like big data processing engines (e.g., Apache Hadoop, Apache Spark), distributed file systems (e.g. HDFS, CEPH, S3, etc.), streaming systems (e.g., Apache Flink, Apache Kafka), resource management systems (e.g., Apache Mesos, Kubernetes), or Identity and Access Management (e.g. Apache Ranger, Sentry, OPA)
- 3+ years experience with infrastructure as code and systems automation
- Fluency in Java or a similar language
- Ability to debug complex issues in large-scale distributed systems
- Passion for building infrastructure that is reliable, easy to use, and easy to maintain
- Excellent communication and collaboration skills
- Experience with Spark and ETL processing pipelines is helpful, but not required
- Experience with systems security, identity protocols, and encryption is helpful, but not required
Description
The ideal candidate will have outstanding communication skills, proven data infrastructure design and implementation capabilities, strong business acumen, and an innate drive to deliver results. They will be a self-starter, comfortable with ambiguity, and will enjoy working in a fast-paced dynamic environment.
Responsibilities include:
- Scale and operationalize privacy and security systems in a big data environment leveraging technologies like Spark, Kafka, Presto, Flink, andHadoop in both on-premise and AWS environments through automation and infrastructure-as-code
- Ensure data infrastructure offers reliable high-quality data with consistent SLAs with good monitoring, alerting, and incident response and continual investment to reduce tech-debt
- Write code, and documentation, participate in code reviews and design sessions
To apply for this job please visit www2.jobdiva.com.