Data Engineer I
MUST BE LOCAL TO ARIZONA*
Description
You will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client.
Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production.
At our client, they understand that our data does not reach its full potential until it is analyzed, and insights effectively communicated to the enterprise.
You will work in close collaboration with mining operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products.
You will be a champion of DataOps, and agile practices; actively participating in project teams to drive value.
Agile Project Work : Work in cross-functional, geographically distributed agile teams of highly skilled data engineers, software / machine learning engineers, data scientists, DevOps engineers, designers, product managers, technical delivery teams, and others to continuously innovate analytic solutions.
o Design, develop, and review real-time / bulk data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, images, video, etc)
o Follow established design patterns for data ingest, transformation, and egress
o Develop documentation of Data Lineage and Data Dictionaries to create a broad awareness of the enterprise data model and its applications
o Apply best practices within DataOps (Version Control, P. R. Based Development, Schema Change Control, CI / CD, Deployment Automation, Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications)
- Problem Solving / Project Management : Constructively challenge while soliciting participation in problem solving to enrich possible solutions.
- Architecture : Utilize modern cloud technologies and employ best practices from DevOps / DataOps to produce enterprise quality production Python and SQL code with minimal errors.
Participate in regular code review sessions and collaboratively discuss opportunities for continuous improvement in all solutions.
Self-Development : Flexibly seek out new work or training opportunities to broaden experience. Independently research latest technologies and openly discuss applications within the department.
Minimum Requirements :
- Bachelor's degree in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline
- Three (3) years of experience as a Data Engineer
- Strong coding skills in SQL
- Working knowledge of Azure (Including Azure Stream Architectures, DBT, Schema Change tools, Data Dictionary tools, Azure Machine Learning Environment, GIS Data)
- Strong experience in data management, data modeling concepts, data architecture
- Experience with Snowflake
- Experience with Databricks
- Working knowledge of Software Engineering and Object Orient Programming Principles
- Experience with coding Python
- Working knowledge of problem solving / root cause analysis on Production workloads
- Working knowledge of Agile, Scrum, and Kanban
- Working knowledge of workflow orchestration using tools such as Airflow, Prefect, Dagster, or similar tooling
- Working knowledge with CI / CD and automation tools like Jenkins or Azure DevOps
- Experience with containerization tools such as Docker
Data Engineer
The Engineer may also be responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department. As part of an agile team, design, develop and maintain an optimal data pipeline architecture using both ...
Azure Sr Data Engineer
...
Sr Data Engineer
You will work on a team including scrum masters, product owners, data architects, data engineers/analyst, data scientists and DevOps. YOU MUST HAVEBachelor's degree in Computer Science, Engineering10+ years of experienceHave 6 - 8 years of data engineering experience in any data warehousing platform...
Lead Data Science Engineer
Key Responsibilities:Data Infrastructure ManagementData Ingestion and PipelinesData WarehousingRequired Qualifications:Minimum of 5 years of experience in data engineering rolesProficiency in programming languages like Python, Scala, or JavaExpertise in cloud platforms such as AWS, GCP, or AzureHand...
Big Data Engineer Java/Scala
Looking for a Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible...
Data Engineer Finance
A company is looking for a Data Engineer for their Finance Data Team. ...
Azure Data Engineer
Design Data Stores utilizing the following architectures:Modern data warehouse (MDW)Big dataLakehouse architecture. Proficient with using the following to create data processing solutions:Azure Data FactoryAzure Synapse AnalyticsAzure Stream AnalyticsAzure Event HubsAzure Data Lake Storage. The Azur...
Security Operations Engineer
In this role, the Security Operations Engineer I will provide organizational support in usage of security equipment, train and monitor utilization and support physical sites as required. Work closely with co-workers, maintenance personnel, project managers, building managers, engineers, and contract...
Senior Data Engineer
Develop tools that automate database processes, such as database provisioning enabling database engineers and developers to do more self service. Practical experience with Data Architecture, translate business data requirements into data models (Conceptual, logical, physical) and using data modeling...
Lead Power Studies Engineer (Mission Critical/Data Center)
W Mission Critical Engineering, a WSP company, is a high-performance, fast-paced consulting engineering firm designing data centers and mission critical environments across the globe. W Mission Critical Engineering, a WSP USA company, is currently initiating a search for a. As a Power Studies Engine...