Talent.com
Data Engineer (Remote - California Residents Only)
Data Engineer (Remote - California Residents Only)Identified Talent Solutions • Phoenix, AZ, US
Data Engineer (Remote - California Residents Only)

Data Engineer (Remote - California Residents Only)

Identified Talent Solutions • Phoenix, AZ, US
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Job Description

Job Description

Data Engineer (Remote - California Residents Only)

We are looking for a data engineering expert to join our Infrastructure Team.

As part of the Infrastructure Team, you will be a key strategic leader in the expansion, refinement, and continued development of our infrastructure utilizing Amazon Web Services (AWS), as well as continuing to build out our data analytics and engineering tools. This role will be instrumental in helping us scale our work statewide and open the door for expanded use of our higher education planning platform for K-12th grade students, parents, and educators.

Qualifications

  • SQL : 2 years (Required)
  • Cloud infrastructure : 2 years (Required)
  • US work authorization (Required)
  • Data Engineer - 2 years
  • Remote / Virtual - All candidates must live in California

The ideal candidate for this team has extensive experience building out complex data architectures, including the testing, maintenance, and refinement of all data pipelines.They have also experience successfully scaling up an organization’s data intake to terabytes and petabytes of data, as well as optimizing data delivery and automating manual processes. This person is comfortable working with structured and unstructured data and can troubleshoot data loading and processing tools via SQL, Python, shell scripting, AWS, etc, and take on a leadership role in special projects when needed.

Extensive experience developing robust data documentation and data governance protocols is required for this role.There are no direct supervisory responsibilities for this position, but you must be able to proactively and successfully partner and collaborate with other subject matter experts on a project management basis. You must be comfortable leading and project managing work with many unknowns and ambiguous solutions, as well as carry a deep knowledge and / or curiosity about the needs and behaviors of students, educators, and parents, and a passion for educational equity.

What Will You Be Doing :

  • Manage, refine, and enhance AWS cloud services infrastructure which include the following :
  • EC2, VPC, RDS, ECS, CloudWatch, CloudFormation, CloudTrail

  • Transfer for sFTP, S3, Lambda, Secrets Manager, and Route 53
  • Lead ETL / ELT processes which include the development, refinement, and implementation of data loading and processing tools, including Snowflake, Airflow, Python, SQL, dbt, and shell scripts

  • Review, redesign, and expand existing analytics and data processing architecture to create an optimal data pipeline(s)
  • Identify, design, and implement internal process improvements :

    automating manual processes, optimizing data delivery, designing infrastructure for greater scalability and automation

  • Maintain and update documentation of data architecture from both the macro view (i.e. architectural diagrams) and the micro view (i.e. script level tasks in Airflow)
  • Lead meetings, research processes, collect data, analyze information
  • Collaborate with the key stakeholders of your projects
  • Develop and maintain expert knowledge of our platform and organization
  • Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.
  • Necessary Technical Skills :

  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Advanced proficiency with cloud analytical tools : Snowflake, Redshift, Hadoop, Spark, Kafka, etc.
  • Advanced proficiency with ETL tools like Matillion, dbt, Talend, etc.
  • Advanced proficiency with data pipeline and workflow management tools : Airflow, Azkaban, Luigi, etc.
  • Advanced proficiency building and optimizing data pipelines, cloud architectures, and data sets.
  • Advanced proficiency with scripting languages like Python, R, Scala, etc.
  • Advanced proficiency developing cloud infrastructure in AWS or currently has or is in the process of obtaining AWS
  • Certification as a Solutions Architect - Associate
  • Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases.
  • A successful history of manipulating, processing and extracting value from large structured and unstructured datasets.
  • Your Strengths :

  • Strong decision-making skills and collaborative spirit with the ability to take abstract brainstorming and generate concrete proposals for action
  • Advance projects without detailed supervision, balancing multiple responsibilities, and providing colleagues with actionable proposals for advancing collective efforts
  • Thrive in a fast-paced environment with changing priorities and deadlines
  • Juggle multiple projects of various scopes with ease and grace
  • Meticulous attention to detail
  • Excellent verbal communication skills; ability to communicate with various levels of professionals.
  • Strong organizational, project, and time management skills
  • We are committed to providing an environment of mutual respect where equal employment opportunities (EEO) are available to all employees and applicants without regard to race, color, ancestry, national origin, genetic characteristics, sex, gender identity, gender expression, sexual orientation, marital / parental status, political affiliation, religion, age, disability, pregnancy, childbirth, breastfeeding or veteran status.

    In addition to federal law requirements, we comply with applicable state and local laws governing nondiscrimination in employment. We are committed to workplace policies and hiring practices that comply with federal, state, and local law. We are interested in hiring qualified candidates who are eligible and authorized to work in the United States. At this time, we are not able to sponsor visas. As a result, we cannot hire applicants that currently, or in the future, require immigration sponsorship for work authorization (i.e., H1B or F1 Student Visa).

    Create a job alert for this search

    Resident Engineer • Phoenix, AZ, US

    Related jobs
    Data Engineer

    Data Engineer

    PrePass • Phoenix, AZ, US
    Full-time
    PrePass® is North America's most trusted weigh station bypass and toll management platform.We’re transforming how the transportation industry operates—creating solutions that ke...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer (Scottsdale)

    Data Engineer (Scottsdale)

    Glocomms • Scottsdale, AZ, US
    Part-time
    Data Engineer (Hybrid - Scottsdale, AZ or Relocation Required).We are seeking a highly skilled.This role is ideal for someone with strong experience in modern data engineering practices and a passi...Show more
    Last updated: 2 days ago • Promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data Annotation • Maricopa, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Sales Call Center Agent - Entry Level

    Sales Call Center Agent - Entry Level

    EchoStar • CASA GRANDE, Arizona, United States
    Full-time
    Paid full-time training provided!.This role is on-site at 350 N McClintock Dr, Chandler, Arizona 85226.EchoStar is reimagining the future of connectivity. Our business reach spans satellite televisi...Show more
    Last updated: 5 days ago • Promoted
    Retention Call Center Agent - Entry Level

    Retention Call Center Agent - Entry Level

    EchoStar • MARICOPA, Arizona, United States
    Full-time
    Paid full-time training provided!.This role is on-site at 350 N McClintock Dr, Chandler, Arizona 85226.EchoStar is reimagining the future of connectivity. Our business reach spans satellite televisi...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Kindsight • Scottsdale, AZ, US
    Full-time
    Kindsight builds technology that helps fundraisers make a difference.For decades, Kindsight has supported the education, healthcare, and nonprofit sectors with fundraising tools and the largest cha...Show more
    Last updated: 15 days ago • Promoted
    Call Center Sales Rep - Entry Level

    Call Center Sales Rep - Entry Level

    EchoStar • MARICOPA, Arizona, United States
    Full-time
    Paid full-time training provided!.This role is on-site at 350 N McClintock Dr, Chandler, Arizona 85226.EchoStar is reimagining the future of connectivity. Our business reach spans satellite televisi...Show more
    Last updated: 5 days ago • Promoted
    Remote Financial Planner - AI Trainer

    Remote Financial Planner - AI Trainer

    Data Annotation • Maricopa, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    GradGuard • Phoenix, AZ, US
    Full-time
    You'll work with modern tools like Snowflake, Metabase, Mage, Airbyte, and MySQL to enable data visualization, data mining, and efficient access to high-quality insights across our GradGuard ec...Show more
    Last updated: 15 days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    iSoftTek Solutions Inc • Phoenix, AZ, US
    Full-time
    SoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team.In this role, you will be responsible for developing and maintaining big data solutions and frameworks.You will work c...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Achieve • Tempe, AZ, US
    Full-time
    Achieve is a leading digital personal finance company.We help everyday people move from struggling to thriving by providing innovative, personalized financial solutions. By leveraging proprietary da...Show more
    Last updated: 11 days ago • Promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data Annotation • Maricopa, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Fullbay • Phoenix, AZ, US
    Full-time
    Fullbay is a leading SaaS organization dedicated to providing exceptional products / services to our clients.We are passionate about growth, innovation, and delivering top-notch customer experiences....Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Platform - Peoria, USA

    Software Engineer, Platform - Peoria, USA

    Speechify • Peoria, AZ, US
    Full-time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Glocomms • Scottsdale, AZ, United States
    Full-time
    Data Engineer (Hybrid - Scottsdale, AZ or Relocation Required).We are seeking a highly skilled.This role is ideal for someone with strong experience in modern data engineering practices and a passi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Hudson Manpower • Phoenix, AZ, US
    Temporary
    Location : PHX, AZ (HYBRID) (Local only).We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaining scalab...Show more
    Last updated: 3 days ago
    Data Engineer

    Data Engineer

    Forhyre • Phoenix, AZ, US
    Full-time
    We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsib...Show more
    Last updated: 30+ days ago • Promoted
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data Annotation • Goodyear, Arizona
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted