Talent.com
Data Engineer
Data EngineerSynechron • Pittsburgh, Pennsylvania, USA
Data Engineer

Data Engineer

Synechron • Pittsburgh, Pennsylvania, USA
7 hours ago
Job type
  • Full-time
Job description

We are

At Synechron we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechrons progressive technologies and optimization strategies span end-to-end Artificial Intelligence Consulting Digital Cloud & DevOps Data and Software Engineering servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization from Artificial Intelligence and Blockchain to Data Science models Digital Underwriting mobile-first applications and more. Over the last 20 years our company has been honored with multiple employer awards recognizing our commitment to our talented teams. With top clients to boast about Synechron has a global workforce of 14500 and has 58 offices in 21 countries within key global markets.

Our challenge

We are seeking a talented and detail-oriented Data Engineer to design develop and maintain scalable data pipelines and big data solutions. The ideal candidate will have strong expertise in Python PySpark Apache Spark and Big Data technologies. Candidate will work closely with data scientists analysts and stakeholders to ensure data is collected processed and made available for analytics and decision-making.

Additional Information

The base salary for this position will vary based on geography and other accordance with law the base salary for this role if filled within Pittsburgh PA is$105k - $115k / year & benefits (see below).

The Role

Responsibilities :

  • Design develop and optimize large-scale data pipelines using Spark and Python (PySpark).
  • Build and maintain scalable data architecture and infrastructure in big data environments.
  • Collaborate with data scientists and analysts to understand data requirements and deliver reliable data solutions.
  • Extract transform and load (ETL) data from various sources into data lakes or data warehouses.
  • Implement data quality checks validation and monitoring processes to ensure data integrity.
  • Optimize Spark jobs for performance and resource utilization.
  • Automate data workflows and pipelines using scheduling tools like Apache Airflow Luigi or similar.
  • Work with cloud-based big data services (e.g. AWS EMR Azure HDInsight Google Cloud Dataproc) as applicable.
  • Document data pipelines architecture and processes for future maintenance and compliance.
  • Stay updated with emerging big data technologies and industry best practices.

Requirements :

  • Bachelors or Masters degree in Computer Science Data Engineering or related field.
  • Experience in data engineering big data or similar roles.
  • Strong programming skills in Python especially with PySpark.
  • Hands-on experience with Apache Spark (preferably version 2.x or 3.x).
  • Experience working with large-scale data processing frameworks and data lakes.
  • Familiarity with SQL and NoSQL databases.
  • Knowledge of distributed computing concepts and data storage solutions.
  • Experience with cloud platforms such as AWS Azure or Google Cloud is a plus.
  • Knowledge of data modeling data warehousing and ETL best practices.
  • Proficiency with data orchestration tools like Apache Airflow or Luigi.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.
  • Preferred but not required :

  • Experience with Kafka Hadoop Hive or other big data tools.
  • Familiarity with containerization (Docker) and orchestration (Kubernetes).
  • Understanding of data security privacy and compliance standards.
  • Knowledge of streaming data processing and real-time analytics.
  • We offer :

  • A highly competitive compensation and benefits package.
  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
  • 10 days of paid annual leave (plus sick leave and national holidays).
  • Maternity & paternity leave plans.
  • A comprehensive insurance plan including medical dental vision life insurance and long- / short-term disability (plans vary by region).
  • Retirement savings plans.
  • A higher education certification policy.
  • Commuter benefits (varies by region).
  • Extensive training opportunities focused on skills substantive knowledge and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
  • Cutting edge projects at the worlds leading tier-one banks financial institutions and insurance firms.
  • A flat and approachable organization.
  • A truly diverse fun-loving and global work culture.
  • S YNECHRONS DIVERSITY & INCLUSION STATEMENT

    Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

    All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law .

    Candidate Application Notice

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 105 - 115

    Create a job alert for this search

    Data Engineer • Pittsburgh, Pennsylvania, USA

    Related jobs
    Sr Data Engineer

    Sr Data Engineer

    Techstra Solutions • Pittsburgh, Pennsylvania, United States
    Full-time
    The main function of a data engineer is to develop and implement data solutions for data platforms.Coordinate the collection, normalization and analysis of datasets across multiple data platforms.A...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    V2soft • Pittsburgh, PA, United States
    Full-time
    V2Soft is a global leader in IT services and business solutions, delivering innovative and cost-effective technology solutions worldwide since 1998. We have headquarteerd in Bloomfiled Hills, MI and...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Diverse Lynx • Pittsburgh, PA, United States
    Full-time
    Developer Well versed with Hadoop, Spark, Cloud, PythonScala and Java, Streaming, Kafka, Backend, J2EE.You evangelize an extremely high standard of code quality, system reliability, and performance...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Two95 International Inc. • Pittsburgh, PA, US
    Full-time
    Quick Apply
    Type : 6 months (contract to hire).Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop / HDFS, Hive, Drill, Pig, etc. Big Data technology stacks (Hortonworks, Cloudera, etc.Agile...Show more
    Last updated: 30+ days ago
    Advanced Data Engineer

    Advanced Data Engineer

    Naval Nuclear Laboratory • West Mifflin, PA, United States
    Full-time
    Working at the Naval Nuclear Laboratory we foster pride in belonging to an organization whose culture is made up of these core values : Trust, Empowerment, and Collaboration.Our company promotes a p...Show more
    Last updated: 23 days ago • Promoted
    Data Engineer

    Data Engineer

    Bloomfield Robotics • Pittsburgh, Pennsylvania, United States
    Full-time
    Bloomfield is a Carnegie Mellon spinout creating a global platform shaping the future of precision agriculture.We scan farms and vineyards at scale (capturing high-resolution imagery and other sens...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Qode • Pittsburgh, PA, United States
    Full-time
    We are seeking a skilled and motivated.Data Engineer with strong expertise in PySpark, SQL.You will be responsible for designing, building, and maintaining scalable data pipelines and processing sy...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer - Manager - Consulting - Location Open

    Databricks Data Engineer - Manager - Consulting - Location Open

    EY • Pittsburgh, PA, United States
    Full-time
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II

    Data Engineer II

    Teletracking Technologies • Pittsburgh, Pennsylvania, United States
    Full-time
    Location : Pittsburgh, PA - Onsite.Are you looking for a patient-focused, innovation-driven company that will inspire you and empower you to shine? Join us as A Data Engineer.As a Data Engineer at ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Govini • Pittsburgh, PA, United States
    Full-time
    Govini transforms Defense Acquisition from an outdated manual process to a software-driven strategic advantage for the United States. Our flagship product, Ark, supports Supply Chain, Science and Te...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Bny • Pittsburgh, Pennsylvania, United States
    Full-time
    Senior Data Engineer At BNY, our culture empowers you to grow and succeed.As a leading global financial services company at the center of the world's financial system we touch nearly 20% of the wor...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Databricks, Pyspark

    Data Engineer - Databricks, Pyspark

    Diverse Lynx • Pittsburgh, PA, United States
    Full-time
    Databricks, Pyspark,python,sql.Diverse Lynx LLC is an Equal Employment Opportunity employer.All qualified applicants will receive due consideration for employment without any discrimination.All app...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II

    Data Engineer II

    TeleTracking • Pittsburgh, PA, United States
    Full-time
    Location : Pittsburgh, PA - Onsite.Are you looking for a patient-focused, innovation-driven company that will inspire you and empower you to shine? Join us as A Data Engineer.As a Data Engineer at T...Show more
    Last updated: 4 days ago • Promoted
    Databricks Data Engineer - Senior - Consulting - Location Open

    Databricks Data Engineer - Senior - Consulting - Location Open

    EY • Pittsburgh, PA, United States
    Full-time
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Kforce • Pittsburgh, PA, United States
    Full-time
    Kforce has a client seeking a Data Engineer on a contract basis in Pittsburgh, PA.The Data Engineer will be tasked with translating data requirements into applications, as well as well as will need...Show more
    Last updated: 4 days ago • Promoted
    Databricks Senior Data Engineer

    Databricks Senior Data Engineer

    eTeam • Pittsburgh, PA, United States
    Full-time
    Role name : Databricks Senior Data Engineer.Work site : Pittsburgh, PA (Onsite).Data Architecture Design : Develop / Modify the architecture for the EDW, including data models, data quality standards, d...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    TWO95 International • Pittsburgh, PA, United States
    Full-time
    Type : 6 months (contract to hire).Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop / HDFS, Hive, Drill, Pig, etc. Big Data technology stacks (Hortonworks, Cloudera, etc.Agile devel...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Azure Databricks

    Data Engineer - Azure Databricks

    Pittsburgh Paints • Cranberry Twp, PA, United States
    Full-time
    Data & Analytics team in the US or Canada.The ideal candidate will have extensive experience in data engineering, working with Databricks and Azure cloud services, designing and implementing scalab...Show more
    Last updated: 4 days ago • Promoted