Talent.com
Lead Data Engineer (AWS)
Lead Data Engineer (AWS)Artech LLC • Jersey city, NJ
Lead Data Engineer (AWS)

Lead Data Engineer (AWS)

Artech LLC • Jersey city, NJ
29 days ago
Job type
  • Full-time
Job description

Job Location

Jersey City, NJ - Hybrid (4 days a week onsite)

Open Positions

6 positions available

Key Skills

  • Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts

Responsibilities

  • Lead the design, development, and implementation of data solutions using AWS and Snowflake.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines, ensuring data quality, integrity, and security.
  • Optimize data storage and retrieval processes to support data warehousing and analytics.
  • Provide technical leadership and mentorship to junior data engineers.
  • Work closely with stakeholders to gather requirements and deliver data-driven insights.
  • Ensure compliance with industry standards and best practices in data engineering.
  • Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.

    • Must Have

  • 8 years of relevant experience in Data Engineering and delivery.
  • 8 years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
  • Strong experience with SQL, Python, and PySpark (20% scoring).
  • Good understanding of Data ingestion and data processing frameworks (20% scoring).
  • Good experience in Snowflake, SQL, AWS (Glue, EMR, S3, Aurora, RDS, AWS architecture) (20% scoring).
  • Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate (20% scoring).
  • Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment (20% scoring).
  • Experience working in Agile Methodology.

    • Good to Have

  • Experience in DevOps tools (Jenkins, GIT, etc.) and practices, continuous integration, and delivery (CI / CD) pipelines.
  • Worked on cloud implementations, data migration, Data Vault 2.0, etc.

    • Requirements

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
  • Strong understanding of data warehousing concepts and best practices.
  • Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Experience in the insurance industry, preferably with knowledge of claims and loss processes.
  • Proficiency in SQL, Python, and other relevant programming languages.
  • Strong problem-solving skills and attention to detail.
  • Ability to work independently and as part of a team in a fast-paced environment.

    • Preferred Qualifications

  • Experience with data modeling and ETL processes.
  • Familiarity with data governance and data security practices.
  • Certification in AWS or Snowflake is a plus.

    • For immediate consideration please click APPLY.

    Create a job alert for this search

    Lead Data Engineer • Jersey city, NJ