Talent.com
Data EngineerIntegration Specialist

Data EngineerIntegration Specialist

City of PhiladelphiaPhiladelphia, PA, United States
1 day ago
Job type
  • Full-time
Job description

Job Description

Data Engineering at the City is a unique opportunity for meaningful, exciting work and professional development using state-of-the art technologies and software development best practices. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies in innovating, and enhancing the City’s service to its residents.

The data engineer / integration specialist will develop an intimate understanding of the City’s diverse data and contribute to improving the City’s data engineering infrastructure, pipelines, models, and integrations. The team uses a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations () and open data publishing (). Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include :

www.phila.gov / solarmap

www.phila.gov / stressmap

We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.

Essential Functions

  • Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility.
  • Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance.
  • Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City’s DataBridge, Databridge-Airflow and AIS.
  • Write clear, descriptive technical documentation for systems / applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.

Competencies, Knowledge, Skills and Abilities

Competencies :

  • Clear and concise writing and communication skills.
  • Creative problem-solving and critical thinking.
  • Ability to work with data from diverse domains.
  • Efficient time management and the ability to manage multiple workflows simultaneously.
  • Ability to seek innovative opportunities and continuous improvement.
  • Knowledge and Skills :

  • Proficient in Python
  • Strong SQL skills and experience with databases (Postgres preferred).
  • Familiarity with Docker, bash and minimal Linux server administration.
  • Experience with cloud services (AWS preferred).
  • Understanding of Git / GitHub for version control and CI / CD pipelines.
  • Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft.
  • Experience working with spatial datasets a plus.
  • Experience using command line interfaces.
  • Abilities :

  • To reason about, model and manipulate complex datasets.
  • To maintain clean and secure data environments.
  • To work effectively in a hybrid (on-premises and cloud) environment.
  • To communicate complex technical concepts in understandable terms.
  • Qualifications : Qualifications

  • Bachelor’s degree in Computer Science, Information Systems, or a related field. Equivalent work experience may be considered.
  • Demonstrated experience in data engineering or a similar role, with a focus on data management / integration / ETL / ELT.
  • Proven track record with Python, SQL, and database management.
  • Experience with working with modern data engineering tech stack.
  • Familiarity with development of custom ETL / CI / CD tools and the ability to learn and adapt to new technologies.
  • Previous work in a public sector or large organization setting is a plus.

    Additional Information

    Salary Range : $65,000 - $80,000

    Did you know?

  • We are a Public Service Loan Forgiveness Program qualified employer : 25% tuition discount program for City employees (and sometimes spouses and dependents as well) in partnership with area colleges and universities
  • We offer Comprehensive health coverage for employees and their eligible dependents
  • Our wellness program offers eligibility into the discounted medical plan
  • Employees receive paid vacation, sick leave, and holidays
  • Generous retirement savings options are available
  • The successful candidate must be a city of Philadelphia resident within six months of hire
  • Please note that effective September 1, 2021, the City of Philadelphia is requiring all new employees to

    present proof of vaccination against COVID-19.

    The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race,

    ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr @phila.gov. For more information, go to : Human Relations Website :

    Compensation :

    $65,000-$65,000 per year

    Create a job alert for this search

    Data Specialist • Philadelphia, PA, United States

    Related jobs
    Lead Databricks Data Engineer

    Lead Databricks Data Engineer

    eTeam IncPhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will lever...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Databricks Engineer

    Sr. Databricks Engineer

    Omni InclusiveLansdale, PA, United States
    Full-time
    Databricks - Pyspark,Python Job,SQL.Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organizati...Show moreLast updated: 9 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Highmark HealthTrenton, NJ, United States
    Full-time
    This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenanc...Show moreLast updated: 9 days ago
    • Promoted
    (Spark / Storm) Eng.-Philadelphia, PA

    (Spark / Storm) Eng.-Philadelphia, PA

    Staffing the UniversePhiladelphia, PA, United States
    Full-time
    On W2 Only Us Citizen, Green Card Only.Job Description : Scope : Big Data Engineer Will Be Designated To Work On Active Decisioning Related To The Moves Assistant Use Case. Skills : Experience With Rea...Show moreLast updated: 1 day ago
    Drexel Co-Op : Data Engineer

    Drexel Co-Op : Data Engineer

    NBMEPhiladelphia, PA, USA
    Full-time
    Quick Apply
    NBME is proud to partner with Drexel University and give students the opportunity to utilize the skills they have learned in the classroom and leverage them in an educational setting.Responsible fo...Show moreLast updated: 4 days ago
    • Promoted
    Data Scientist - II (Associate) / Data Engineer

    Data Scientist - II (Associate) / Data Engineer

    ApTaskLansdale, PA, United States
    Full-time
    Education : Candidates with a degree in computer science or related field; or a degree in the chemistry disciplines with strong programming capabilities. Experience : 4-6 years of relevant experience....Show moreLast updated: 1 day ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    TWO95 InternationalPhiladelphia, PA, United States
    Full-time
    Job Title : Senior Azure Data Engineer.Location : Philadelphia, PA (Hybrid Work).Azure Data Engineering : Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, Dev...Show moreLast updated: 30+ days ago
    • Promoted
    Data Integration Engineer

    Data Integration Engineer

    Eliassen GroupTrenton, NJ, United States
    Full-time +1
    We are currently seeking a talented Data Integration Principal to join us as we develop our data driven, analytic focused and predictive products to help revolutionize the law enforcement sector.Th...Show moreLast updated: 1 day ago
    Data Engineer

    Data Engineer

    CGSPhiladelphia, Pennsylvania, United States, 19102
    Full-time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show moreLast updated: 30+ days ago
    • Promoted
    Data & DevSecOps Engineer

    Data & DevSecOps Engineer

    ClearanceJobsRidley Park, PA, United States
    Temporary
    Advanced Information Technologist - Data Engineer.At Boeing, we innovate and collaborate to make the world a better place. We're committed to fostering an environment for every teammate that's welco...Show moreLast updated: 4 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Diverse LynxMt Laurel, NJ, United States
    Full-time
    Location - Mount Laurel, NJ (Day 1 Onsite).Senior Data Engineer with 12+ years of experience.Worked on ETL, Azure, Databricks, Informatica, Oracle and Business Reports. Excellent Communication Skill...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer / Analyst

    Data Engineer / Analyst

    Stoltz Management of DelawareBala-Cynwyd, PA, US
    Full-time
    United States employment visas at this time.Co-CEO & Chief Operating Officer.We are seeking a seasoned professional with expertise in data engineering, data management, analytics, and reporting...Show moreLast updated: 28 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    LTIMindtreePhiladelphia, PA, US
    Full-time
    Seeking a GCP Data Engineer with expertise in GCP services and data engineering tools for a media domain client.GCP Storage, BigQuery, DataProc, Cloud Composer, DMS. Apache Airflow, Dataflow, Pub / Su...Show moreLast updated: 6 days ago
    • Promoted
    IT Positions : CLOUD ENGINEERS - DATA ANALYST

    IT Positions : CLOUD ENGINEERS - DATA ANALYST

    Logic PlanetPrinceton, NJ, United States
    Full-time
    IT Positions : Princeton, NJ & various unanticipated locations throughout the U.CLOUD ENGINEERS : Lead & mng dsgn, implmntn, & migrtn of cloud solns across AWS & Azure envirmnts.Bld & mng atomtn frmw...Show moreLast updated: 1 day ago
    Data Engineer-1

    Data Engineer-1

    eTeam IncPhiladelphia, Pennsylvania, United States
    Full-time
    Quick Apply
    We are seeking a skilled and experienced Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical team member, you will lever...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data engineer

    Azure Data engineer

    Diverse LynxMt Laurel, NJ, United States
    Full-time
    Diverse Lynx LLC is an Equal Employment Opportunity employer.All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solel...Show moreLast updated: 2 days ago
    • Promoted
    BI Data Engineer

    BI Data Engineer

    Insight GlobalPhiladelphia, PA, United States
    Full-time
    Insight Global is seeking a Business Intelligence Engineer to join the IS team of an AM 100 law firm.This position is a staff-level role on the Enterprise Data Services team.The individual in this ...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer (ADF, Databricks, Python, Spark

    Azure Data Engineer (ADF, Databricks, Python, Spark

    Diverse LynxHamilton Twp, NJ, United States
    Full-time
    Hands on experience in ADF, Databricks, Python, Spark, SQL, Good communication skills - Able to articulate clearly his / her ideas. Experience with Agile methodologies - Scrum.Attention to detail, Des...Show moreLast updated: 30+ days ago