Hi
Mindsource is seeking a Data Engineer for one of our Direct Client . If interested, please drop your resume to akhil@mindsource.com
Position : Data Engineer
Location : Cupertino , CA / Seatlle , WA (Hybrid)
Contract
Pay Rate : $83- $87/hr W2
Key Qualifications
• 7+ years overall software development experience with at least 3+ years of experience large-scale data platforms.
• Excellent programming expertise in Object-oriented programming using Java.
• Experience in Hadoop (YARN, Hdfs, Hive, distcp) and AWS Cloud ( S3 , IAM, EKS, RDS and Kubernetes).
• Proficient in designing scheduling workflows in Apache Airflow.
• Improve the Data Pipeline monitoring system and are relevant metrics to monitor the health of the system.
• Understanding of Docker containers and Kubernetes.
• Experience in collecting metrics and building dashboards in DataDog.
• Hands-on experience in developing Streaming pipelines (Data Ingestion) from Kafka to S3/Hive using Spark/Flink.
• Understanding of CI/CD automation and willingness to learn new technologies.
• Excellent problem-solving debugging skills, communication and interpersonal skills.
Mandatory Technical Skills
• Java, Hadoop, Hive, AWS, Airflow, Spark/Flink, Git, Parquet, Avro and CI/CD
• Expertise in Data Dog, Splunk, Apache Iceberg, Docker, and Kubernetes.
To apply for this job please visit www2.jobdiva.com.