Big Data Engineer

Job Title: Big Data Engineer (Junior-Mid Level)
Location: 100% Remote DMV Area (Preferred) 

Our client is seeking a talented Big Data Engineer to work on internal technical initiatives in data engineering, data analytics, and software integration. This is a highly technical role in a true big data environment hosted on AWS Cloud. The ideal candidate will have 3-6 years of experience, with a strong focus on building data pipelines, optimizing algorithms, and advanced SQL querying, rather than traditional ETL pipelines.

Responsibilities:

• Design, build, and optimize data pipelines to support business initiatives.
• Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities.
• Optimize algorithms and work on complex SQL queries for data solutions.
• Work within an AWS environment, particularly EMR, to manage and process large data sets.
• Use Python, Java, or Scala for development, alongside test-driven development practices.
• Build and maintain unit tests to ensure code quality.

Required Skills:

• 3-6 years of hands-on experience in data engineering.
• Strong expertise in Python (or Java/Scala), with proven coding proficiency.
• Advanced experience in SQL, specifically for structuring complex queries.
• Experience building data pipelines (not ETL) and optimizing algorithms.
• Knowledge of AWS EMR and working in a big data environment.
• Familiarity with Spark and test-driven development.

Preferred Qualifications:

• Bachelor’s degree in Computer Science, Mathematics, Physics, or Electrical Engineering.
• DMV area candidates preferred, though remote options may be available for exceptional candidates.