Talent.com
Data Engineer (PySpark/Python)
Data Engineer (PySpark/Python)Highmark Health • Jackson, MS, US
No longer accepting applications
Data Engineer (PySpark / Python)

Data Engineer (PySpark / Python)

Highmark Health • Jackson, MS, US
17 hours ago
Job type
  • Full-time
Job description

Company : Highmark Health

Job Description : JOB SUMMARY

CANDIDATE MUST BE US Citizen (due to contractual / access requirements)

Work Arrangement : This is a fully remote position.

We are seeking an integral member for our technical team, responsible for supporting the design, development, and maintenance of the organization's data and programming infrastructure, ensuring the efficient and reliable flow of data across various systems. This role requires a strong understanding of data and ETL architecture, cloud-based data solutions (ideally GCP & databricks), Programming languages like Python / PySpark with ETL(Extract Transform load) experience. The ideal candidate will have a proven track record of success in designing, programming and implementing advanced data engineering solutions and possess hands-on experience with the entire software development life cycle (SDLC), with heavy coding experience in relevant languages (Python, PySpark) and deep knowledge of SQL with working knowledge of Tools like Informatica as a plus.

ESSENTIAL RESPONSIBILITIES

Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems.

Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs

Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs

Monitor work against the production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly.

Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.

Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking

Perform data analysis and provide insights to support decision-making across various departments

Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed

Other duties as assigned or requested.

EXPERIENCE

Required

3 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems

3 years of experience in a data engineering, ETL development, or data management role.

3 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).

3 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery)

Preferred

3 years of experience with data pipeline and workflow management tools (e.g., Apache, GCP Tools, Databricks, PySpark).

3 Years of experience building ETL and Data Integration pipelines in Python, PySpark and knowledge of Informatica is a plus

3 years of experience working with On Prem databases like Oracle, Teradata and DB2

3 years of experience with Cloud platforms (GCP and Azure) and their respective data services

3 years of deep SQL experience & Unix experience

1 year of experience working with a variety of technology systems, designing solutions or developing data solutions in healthcare

3 years of experience translating requirements, design mockups, prototypes or user stories into technical designs

3 years of experience with data-related code that is fault-tolerant, efficient, and maintainable

SKILLS

Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment

Adaptability : Ability to take on diverse tasks and projects, adapting to the evolving needs of the organization

Analytical Thinking : Analytical skills with a focus on detail and accuracy

Interest and ability to learn other data development technologies / languages as needed

Technical Proficiency : Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed

Track record in designing and implementing large-scale data sources

Sense of ownership, urgency, and drive

Demonstrated passion for user experience and improving usability

Team Collaboration : A team player who can work effectively in cross-functional environments

Experience and willingness to mentor junior data engineers and help develop their skills and leadership

EDUCATION

Required

  • Bachelor's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field or relevant experience and / or education as determined by the company in lieu of bachelor's degree.

Preferred

  • Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field
  • LICENSES or CERTIFICATIONS

    Required

  • None
  • Preferred

  • None
  • Language (Other than English) :

    None

    Travel Requirement : 0% - 25%

    PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS

    Disclaimer : The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.

    Compliance Requirement : This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.

    As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company's Handbook of Privacy Policies and Practices and Information Security Policy.

    Furthermore, it is every employee's responsibility to comply with the company's Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.

    Pay Range Minimum : $67,500.00

    Pay Range Maximum : $126,000.00

    Base pay is determined by a variety of factors including a candidate's qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.

    Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

    We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

    For accommodation requests, please contact HR Services Online at HRServices@highmarkhealth.org

    California Consumer Privacy Act Employees, Contractors, and Applicants Notice

    Req ID : J269807

    J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Jackson, MS, US

    Related jobs
    Databricks Data Engineer

    Databricks Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior Cloud Data Engineer.Key Responsibilities Design and build scalable ETL pipelines in Databricks using PySpark and Spark SQL Migrate legacy ETL processes to cloud...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Python Engineer

    Senior Python Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior Python Engineer to join their remote team.Key Responsibilities Architect, develop, and maintain Python-based applications and services Collaborate with cross-fu...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior Data Engineer to support data initiatives and optimize data delivery architecture.Key Responsibilities Update, analyze, and enhance products through direct inter...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Lead

    Big Data Lead

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Big Data Lead.Key Responsibilities Oversee and manage data processes using Azure, Databricks, ADF, and Pyspark / Python Understand design and source to target mapping (S...Show more
    Last updated: 30+ days ago • Promoted
    Junior Data Engineer

    Junior Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Junior Data Engineer to join their data team and contribute to improving digestive health outcomes. Key Responsibilities : Develop well-documented, tested data pipelines ...Show more
    Last updated: 30+ days ago • Promoted
    Professional Data Engineer

    Professional Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Data Engineer who will be responsible for building operational reporting solutions and integrating data sources for data-driven decision-making.Key Responsibilities Col...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior Software Engineer - Data

    Senior Software Engineer - Data

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior Software Engineer (React / React Native) - Data.Key Responsibilities Design and maintain event-driven pipelines and manage Snowflake administration Collaborate wi...Show more
    Last updated: 3 days ago • Promoted
    Software Data Engineer

    Software Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Software Data Engineer.Key Responsibilities Build and maintain data platforms for data integration, ensuring data access, security, and governance Source, compile, and...Show more
    Last updated: 7 hours ago • Promoted • New!
    Data Engineer II

    Data Engineer II

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...Show more
    Last updated: 30+ days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Software Engineer, Data.Key Responsibilities Design, implement, and maintain scalable data ingestion pipelines Design, implement, and maintain scalable APIs for extern...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Databricks

    Data Engineer - Databricks

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Technical Consultant specializing in Databricks.Key Responsibilities Design, develop, and maintain ETL / ELT pipelines and Databricks notebooks for data ingestion, transf...Show more
    Last updated: 8 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Data Engineer - Analytics and AI Platforms.Key Responsibilities Build and manage ELT / ETL processes from various data sources into Microsoft Fabric Lakehouse / Warehouse ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer III

    Data Engineer III

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...Show more
    Last updated: 30+ days ago • Promoted
    Python Engineer

    Python Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Middle+ Python Engineer to join its innovative team.Key Responsibilities Reverse-engineer undocumented API endpoints and deliver full API documentation Design and impl...Show more
    Last updated: 30+ days ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Data Analytics Engineer to work with operational and customer stakeholders on data acquisition, processing, and analysis. Key Responsibilities Collaborate with data engi...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Lead Data Engineer.Key Responsibilities Collaborate with Agile teams to design, develop, test, implement, and support technical solutions Utilize programming languages...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Cloud Data Engineer (SQL, AI Search, and Observability).Key Responsibilities : Build cloud foundational components in the Azure cloud Monitor, scale, and maintain produ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    VirtualVocations • Jackson, Mississippi, United States
    Full-time
    A company is looking for a Senior AI Engineer (Python and AI Programming) - Level III.Key Responsibilities : Develop scalable, production-grade AI / ML models using Python and relevant frameworks B...Show more
    Last updated: 30+ days ago • Promoted