Talent.com
Sr. Data Engineer

Sr. Data Engineer

Diverse LynxNew York, NY, United States
3 days ago
Job type
  • Full-time
Job description

Sr. Data Engineer

New York - NY Hybrid

  • Job Description : The ideal candidate will have a strong background in data engineering and development, with expertise in various data skills and tools. The role involves working on complex data projects, collaborating with cross-functional teams, and ensuring the efficient processing and management of data.

Key Responsibilities :

  • Develop and maintain data pipelines using Python and Pyspark.
  • Design and implement efficient SQL queries for data extraction and manipulation.
  • Work with Aurora Postgres and Redshift for data storage and management.
  • Utilize Informatica or other ETL tools for data integration and transformation.
  • Implement and manage AWS cloud services, including Athena, S3 , ECS / Docker, EMR, EC2, Lambda, CloudWatch, and EventBridge.
  • Use Airflow or other orchestration tools for workflow management.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Collaborate with other teams to understand data requirements and deliver solutions.
  • Required Skills :

  • Proficiency in Python and Pyspark.
  • Solid experience in AWS Glue
  • Strong SQL skills.
  • Experience with Aurora Postgres and Redshift.
  • Knowledge of Informatica or other ETL tools.
  • Experience with AWS cloud services, including Athena, S3, Lambda, CloudWatch, and EventBridge.
  • Preferred Skills :

  • ECS / Docker (or any docker experience / concepts)
  • EMR, EC2 (or knowledge of any other distributed computing)
  • Familiarity with Airflow or other orchestration tools.
  • Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

    Create a job alert for this search

    Sr Data Engineer • New York, NY, United States

    Related jobs
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    VimeoNew York, NY, United States
    Full-time
    Vimeo's mission is to help every business and video professional grow their brand with video.Through our ever expanding suite of tools that allows everyone to create, manage, share, and sell video,...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    CVS HealthRutherford, NJ, United States
    Full-time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    InterSourcesNew York, NY, United States
    Full-time
    AWS Console, S3, Lambda, Kinesis, Glue, and CloudWatch.ETL experience using Python, SQL, and Snowflake.Experience requesting, transforming, and ingesting data from REST and SOAP APIs.Proficiency in...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Syntricate TechnologiesMontvale, NJ, United States
    Full-time
    Required Skills : 8+ Year experience.Azure Data Factory and Data bricks.Good understanding on Data modeling.Developing / design solution from detail design specification. Playing an active role in defi...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer role

    Sr Data Engineer role

    ApTaskNew York, NY, United States
    Full-time
    Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java).Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Soros Fund ManagementNew York, NY, United States
    Permanent
    Soros Fund Management LLC (SFM) is a global asset manager and family office founded by George Soros in 1970.With $28 billion in assets under management (AUM), SFM serves as the principal asset mana...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Sr Data Engineer

    Sr Data Engineer

    APN ConsultingJersey City, NJ, United States
    Full-time
    IT staffing and services company offering innovative business solutions to improve client business outcomes.We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and ...Show moreLast updated: 19 hours ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    A.M. BestJersey City, NJ, United States
    Full-time
    Flexible and hybrid work arrangements.Paid time off / Paid company holidays.Medical plan options / prescription drug plan. Dental plan / vision plan options.Flexible spending and health savings accounts.R...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, IncNew York, NY, United States
    Full-time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer Marketing & Campaign Management

    Sr. Data Engineer Marketing & Campaign Management

    Inizio PartnersJersey City, NJ, United States
    Full-time
    Data Engineer Marketing & Campaign Management.Marketing Domain knowledge is mandatory.Worked closely with Marketing / Campaign Management Team. Good understanding of Marketing Data.Knowledge of Data M...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer - Tampa

    Sr Data Engineer - Tampa

    PhotonJersey City, NJ, United States
    Full-time
    Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big Data.Analyze data requirements and identify disparate data sources required for consolidation and distribution.Doc...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Contact Government Services, LLCNew York, NY, United States
    Full-time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Omni InclusiveNew York, NY, United States
    Full-time
    Desired Skill : Bloomberg data acquisition and transformation.Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources int...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer - New Jersey

    Sr Data Engineer - New Jersey

    PhotonJersey City, NJ, United States
    Full-time
    We need a Senior Data Engineer 10+ years exp proficient in Spark, Scala / Java, and Hive, with extensive hands-on development experience in the Big Data Ecosystem. Design, implement, and optimize high...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Damco SolutionsNew York, NY, United States
    Full-time
    Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java).Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Jackson Lewis P.C.New York, NY, United States
    Full-time
    Focused on employment and labor law since 1958, Jackson Lewis P.We help employers develop proactive strategies, strong policies and business-oriented solutions to cultivate high-functioning workfor...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Software Engineer (Data and Personalization)

    Sr. Software Engineer (Data and Personalization)

    Consumer ReportsYonkers, NY, US
    Full-time
    Consumer Reports is an independent, nonprofit organization dedicated to a fair and just marketplace for consumers.Our team is made up of truth tellers, change agents, and consumer advocates who inv...Show moreLast updated: 1 day ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Inizio PartnersJersey City, NJ, United States
    Full-time
    Our client is expanding their Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipel...Show moreLast updated: 3 days ago