Data Engineer
Content + Source + Freshness • 16 Dec 2025 • 95% confidence
Offer value
Moderate value score through a blend of specialized big data skills, AWS experience, and the importance of maintaining operations post-migration.
- Engagement with significant data migration tasks.
- Opportunity to enhance skills in Cloudera and AWS.
- Flexible remote working position.
Pros
- High relevance due to the migration of large healthcare datasets.
- Opportunities for working with advanced data processing tools.
- Valuable experience in cloud-based data environments.
Cons
- Potentially stressful due to tight deadlines and business-critical implications.
- Requires extensive prior knowledge and experience.
Who it's for
Senior / Experienced • Remote
Good fit
- Experienced data engineers with a focus on big data.
- Candidates familiar with data pipeline migrations.
- Technically oriented professionals seeking remote opportunities.
Not recommended for
- Newcomers to data engineering.
- Those without experience in cloud environments.
Motivation fit
Key skills
About the job
• Support the migration of a Medicaid Data Warehouse Implementation in AWS environment.
• Support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another.
• Ensure a seamless transition, validating data integrity and job performance.
• Maintain reliable daily operations post-migration.
• Work closely with the existing project team for the underlying AWS infrastructure.
• Focus on Cloudera cluster migration, data pipeline reconfiguration, and operational stability.
Requirements
- 7+ years of experience in data engineering or big data development
- 4+ years’ experience with Cloudera platform (HDFS, YARN, Hive, Spark, Oozie)
- Experience deploying and operating Cloudera workloads on AWS (EC2, S3, IAM, CloudWatch)
- Strong proficiency in Scala, Java and HiveQL; Python or Bash scripting experience preferred
- Strong proficiency in Apache Spark & Scala programming for data processing and transformation.
- Hands on experience with Cloudera distribution of Hadoop.
- Hands-on experience implementing business-rules processing using Drools.
🔍 ATS Optimization Keywords
Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively — a feature exclusive to JobTailor job listings.
Hard Skills
- data engineering
- big data development
- Cloudera
- HDFS
- YARN
- Hive
- Spark
- Oozie
- Scala
- Java
Soft Skills
- data integrity validation
- job performance monitoring
- operational stability
- team collaboration
