Job Description : Sr Big Data Engineer at Beaverton, OR
We have an immediate opportunity for a Sr Big Data Engineer with our direct client in Beaverton, OR. The ideal candidate will have a strong background in data engineering and experience working with big data technologies.
Location : Beaverton, OR
Duration : Long Term
Job Type : Contract
Core Responsibilities
Expert data engineers will work with product teams across the client to help automate and integrate various data domains with a wide variety of data profiles into the client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes.
Required Skills / Experience
- 5+ years of professional development experience in Python (preferred) or Scala / Java; familiarity with both is ideal
- 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales
- 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized)
- 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services
- 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc)
- Direct task development and / or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc.
- Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds
Desired Skills
A demonstrably strong understanding of security and credential management between application / platform componentsA demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimizationDirect experience with Netflix GeniePrior experience with the operational backbone of a CI / CD environment (pipeline orchestration + configuration management)Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub)Keys to Success
Demonstrate accountability and integrityBe willing to learn and adapt every dayWe are an equal opportunity employer and welcome applications from diverse candidates. All your information will be kept confidential according to EEO guidelines.
J-18808-Ljbffr