Sr. Data Engineer
Omni InclusiveNew York, NY, United StatesHace 4 días
Tipo de contrato
- A tiempo completo
Descripción del trabajoDesign, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the Databricks platform. Implement data integration and ETL processes using Azure Data Factory. Develop and optimize data processing workflows and pipelines using PySpark. Support solving business use cases involving Bloomberg data acquisition and transformation. Collaborate with data scientists and analysts to support data-driven decision-making. Ensure data quality and integrity across various data sources and storage solutions. Monitor and troubleshoot data pipeline performance and reliability. Assist with dashboarding and data visualization using Power BI.
Mandatory Skills
- Azure Data Bricks
- Azure Data Lake
- Python
- Pyspark
Desired Skill : Bloomberg data acquisition and transformation
Crear una alerta de empleo para esta búsqueda
Sr Data Engineer • New York, NY, United States