Sr. Data Engineer

Omni InclusiveNew York, NY, United States

4 days ago

Job type

Full-time

Job description

Mandatory Skills

Azure Data Bricks
Azure Data Lake
Python
Pyspark

Desired Skill : Bloomberg data acquisition and transformation

Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake.

Integrate data from various sources into the Databricks platform.

Implement data integration and ETL processes using Azure Data Factory.

Develop and optimize data processing workflows and pipelines using PySpark.

Support solving business use cases involving Bloomberg data acquisition and transformation.

Collaborate with data scientists and analysts to support data-driven decision-making.

Ensure data quality and integrity across various data sources and storage solutions.

Monitor and troubleshoot data pipeline performance and reliability.

Assist with dashboarding and data visualization using Power BI.

Create a job alert for this search

Sr Data Engineer • New York, NY, United States

Related jobs

Promoted

Sr. Data Engineer

VimeoNew York, NY, United States

Full-time

Vimeo's mission is to help every business and video professional grow their brand with video.Through our ever expanding suite of tools that allows everyone to create, manage, share, and sell video,...Show moreLast updated: 4 days ago

Promoted

Sr Data Engineer

CVS HealthWhite Plains, NY, United States

Full-time

At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...Show moreLast updated: 4 days ago

Promoted

Sr Data Engineer

InterSourcesNew York, NY, United States

Full-time

AWS Console, S3, Lambda, Kinesis, Glue, and CloudWatch.ETL experience using Python, SQL, and Snowflake.Experience requesting, transforming, and ingesting data from REST and SOAP APIs.Proficiency in...Show moreLast updated: 4 days ago

Promoted

Sr. Data Engineer

Syntricate TechnologiesMontvale, NJ, United States

Full-time

Required Skills : 8+ Year experience.Azure Data Factory and Data bricks.Good understanding on Data modeling.Developing / design solution from detail design specification. Playing an active role in defi...Show moreLast updated: 30+ days ago

Promoted

Sr Data Engineer role

ApTaskNew York, NY, United States

Full-time

Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java).Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Soros Fund ManagementNew York, NY, United States

Permanent

Soros Fund Management LLC (SFM) is a global asset manager and family office founded by George Soros in 1970.With $28 billion in assets under management (AUM), SFM serves as the principal asset mana...Show moreLast updated: 4 days ago

Promoted

Sr Data Engineer

APN ConsultingJersey City, NJ, United States

Full-time

IT staffing and services company offering innovative business solutions to improve client business outcomes.We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and ...Show moreLast updated: 1 day ago

Promoted

Sr. Data Engineer

Diverse LynxNew York, NY, United States

Full-time

Job Description : The ideal candidate will have a strong background in data engineering and development, with expertise in various data skills and tools. The role involves working on complex data pro...Show moreLast updated: 4 days ago

Promoted

Sr. Data Engineer

A.M. BestJersey City, NJ, United States

Full-time

Flexible and hybrid work arrangements.Paid time off / Paid company holidays.Medical plan options / prescription drug plan. Dental plan / vision plan options.Flexible spending and health savings accounts.R...Show moreLast updated: 4 days ago

Promoted

Sr. Data Engineer

Argonaut Management Services, IncNew York, NY, United States

Full-time

Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show moreLast updated: 30+ days ago

Promoted

Sr. Data Engineer Marketing & Campaign Management

Inizio PartnersJersey City, NJ, United States

Full-time

Data Engineer Marketing & Campaign Management.Marketing Domain knowledge is mandatory.Worked closely with Marketing / Campaign Management Team. Good understanding of Marketing Data.Knowledge of Data M...Show moreLast updated: 30+ days ago

Promoted
New!

Sr. Data Engineer

T-MobileNew York, NY, United States

Full-time +1

At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation packa...Show moreLast updated: 7 hours ago

Promoted

Sr Data Engineer - Tampa

PhotonJersey City, NJ, United States

Full-time

Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big Data.Analyze data requirements and identify disparate data sources required for consolidation and distribution.Doc...Show moreLast updated: 4 days ago

Promoted

Sr. Data Engineer

Contact Government Services, LLCNew York, NY, United States

Full-time

Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show moreLast updated: 30+ days ago

Promoted

Sr. Data Engineer

Damco SolutionsNew York, NY, United States

Full-time

Promoted

Sr. Data Engineer

Jackson Lewis P.C.New York, NY, United States

Full-time

Focused on employment and labor law since 1958, Jackson Lewis P.We help employers develop proactive strategies, strong policies and business-oriented solutions to cultivate high-functioning workfor...Show moreLast updated: 4 days ago

Promoted

Sr. Software Engineer (Data and Personalization)

Consumer ReportsYonkers, NY, US

Full-time

Consumer Reports is an independent, nonprofit organization dedicated to a fair and just marketplace for consumers.Our team is made up of truth tellers, change agents, and consumer advocates who inv...Show moreLast updated: 2 days ago

Promoted

Sr. Data Engineer

Inizio PartnersJersey City, NJ, United States

Full-time

Our client is expanding their Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipel...Show moreLast updated: 4 days ago