Talent.com
ACA Group
Senior Algorithm Developer - PySpark / SQLACA Group • Durham, NC, United States
No longer accepting applications
Senior Algorithm Developer - PySpark / SQL

Senior Algorithm Developer - PySpark / SQL

ACA Group • Durham, NC, United States
7 days ago
Job type
  • Full-time
Job description
Senior Algorithm Developer - PySpark / SQL

Date: Apr 22, 2026

Location: Durham, NC, US

Company: ACA Group

Senior Algorithm Developer – PySpark / SQL

Company Overview: ACA Global delivers market abuse surveillance solutions to institutional investors, hedge funds, and asset managers. The Market Abuse Surveillance (MAS) platform monitors trading activity across equities, fixed income, and derivatives to identify potential regulatory and policy violations.

The Opportunity: This role sits on the Market Abuse Surveillance Product Development team and focuses on validating, optimizing, and advancing a PySpark-based surveillance platform. Following a multi-year algorithm migration initiative, the emphasis is now on production quality, performance optimization, and next-generation algorithm development. The position blends deep PySpark/Python and SQL expertise with financial markets and regulatory domain knowledge.

What You'll Do:

  • Validate and QA migrated surveillance algorithms by reconciling PySpark outputs against legacy SQL baselines across multiple client environments
  • Optimize PySpark algorithms and Spark infrastructure to meet processing SLAs across large data volumes
  • Enhance and develop new surveillance algorithms aligned to evolving regulatory and client requirements
  • Support legacy SQL systems during transition and ensure data integrity and auditability

Technical Skill Set:

  • 3+ years of hands-on PySpark/Python development in production environments
  • Strong Spark expertise (DataFrames, SQL functions, windowing, joins, optimization, execution plans)
  • 5+ years of advanced SQL experience (CTEs, window functions, performance tuning, stored procedures)
  • Experience operating within the Spark ecosystem (EMR, Iceberg, Spark UI)
  • Strong AWS experience (S3, EMR, IAM, CloudWatch, cost optimization)
  • Familiar with CI/CD, Git workflows, JIRA, automated testing, and code review practices

Domain Expertise (or Strong Willingness to Learn):

  • Financial instruments: equities, fixed income, and derivatives
  • Trade lifecycle and portfolio concepts
  • Market abuse and regulatory surveillance (KYC/AML, best execution, fair dealing)
  • Institutional trading behavior and surveillance patterns

Experience Profile:

  • 5+ years total software development experience, including large-scale data processing systems
  • Proven track record delivering production-ready data or algorithmic platforms
  • Strong validation, testing, and reconciliation experience across complex data systems
  • Background in fintech, RegTech, or financial services strongly preferred
  • Experience working in agile teams with cross-functional stakeholders (QA, DevOps, Product)

What Success Looks Like:

  • Quickly ramp on MAS platform architecture and algorithm logic
  • Validate and production-ready multiple surveillance algorithms with audit-ready documentation
  • Improve algorithm performance and stability across client environments
  • Contribute to new algorithm development and next-generation platform initiatives
  • Become a subject matter expert on specific surveillance domains or platform components

Impression: This is a senior, hands-on algorithm development role ideal for someone who enjoys working at the intersection of big data engineering, Python/Spark optimization, and financial regulatory logic in a production-critical environment.

Create a job alert for this search

Senior Algorithm Developer - PySpark / SQL • Durham, NC, United States

Similar jobs

Senior Go Engineer - Secure Cloud Platforms

IBMDurham, NC, United States
Full-time

A leading tech company in Durham, North Carolina is looking for a software engineer to lead the design and implementation of impactful features while working with Golang.You'll collaborate with cro... Show more

 • Promoted

Senior Software Engineer, Hardware‑Centric Systems

National Society for Black EngineersDurham, NC, United States
Full-time

A leading technology organization is seeking a Senior Software Engineer in North Carolina to develop sophisticated systems and software tailored to customer needs.The successful candidate will be r... Show more

 • Promoted

Senior Software Engineer - OpenShift & Cloud Automation

Red HatNC, United States
Full-time

A leading open-source software company in the U.Lead Technical Engagements role to guide independent software vendors in integrating solutions with their platforms.Candidates will manage automation... Show more

 • Promoted

IoT Data Architect — Edge-to-Cloud & Analytics Foundation

Pentair plcApex, NC, United States
Full-time

A global water solutions company based in Apex, NC, seeks a Data Architect to standardize data strategies across IoT products.The ideal candidate has over 8 years of experience in data architecture... Show more

 • Promoted

Senior Backend Engineer — AI Data Pipelines for Enterprise SaaS

ENFOS, Inc.NC, United States
Full-time

A leading environmental management company is seeking a Senior Software Engineer to enhance their SaaS platform.This role involves designing high-performance backend systems and collaborating acros... Show more

 • Promoted

IoT Data Architect – Edge-to-Cloud & AI Readiness

Pentair Management CompanyApex, NC, United States
Full-time

A leading water solutions company is looking for a Data Architect to join the Apex, NC team.The ideal candidate will define data models, drive alignment across teams, and build structures for analy... Show more

 • Promoted

Senior Software Engineer — Scale & Lead System Design

Google Inc.Durham, NC, United States
Full-time

A leading global technology firm based in North Carolina is seeking a Software Engineer to develop cutting-edge technologies.The ideal candidate will have a Bachelor's degree and 5 years of experie... Show more

 • Promoted

Cloud Data Architect for Brokerage Platforms — Hybrid

Leadership TriangleDurham, NC, United States
Full-time

A leading investment firm is seeking a Data Architect to drive the design of scalable, cloud-based data architectures.You will collaborate with teams to standardize solutions and lead modernization... Show more

 • Promoted

Senior Data Analytics Engineer – GPU-Scale Compute

NVIDIANC, United States
Full-time

NVIDIA is seeking candidates for a role focused on analyzing large-scale data and improving GPU-accelerated workloads.The ideal candidate will have over 5 years of experience in data analysis, stro... Show more

 • Promoted

Senior Backend Architect, Data Streaming Platform

ConfluentNC, United States
Full-time

A leading data streaming company based in North Carolina seeks a Senior Software Engineer II to own backend systems in Stream Governance products.You will lead the design and development of large-s... Show more

 • Promoted

IoT Data Architect - Edge-to-Cloud & Analytics Leader

PentairApex, NC, United States
Full-time

A global water solutions company is seeking a Data Architect in Apex, NC, to unify and elevate their IoT data strategy across product lines.You will architect data ecosystems, collaborate across te... Show more

 • Promoted

Senior Software Engineer, Kotlin Multiplatform SDKs

Clutch CanadaChapel Hill, NC, United States
Full-time

Clutch Canada is seeking a Senior Software Engineer to join the Core Experiences Team.This role focuses on building and optimizing SDKs, enhancing user experience through strategic design of APIs, ... Show more

 • Promoted

Senior Software Engineer - Informix

Inmar Inc.NC, United States
Full-time

We are seeking a highly skilled and proactive Senior Software Engineer – Informix to lead the development, enhancement, and support of mission-critical applications built on the IBM Informix platfo... Show more

 • Promoted

Senior Data Architect: Cloud DW, Data Lakes & Governance

PiTech Solutions IncDurham, NC, United States
Full-time

A leading technology solutions provider is seeking an experienced Data Architect in Durham, North Carolina.The role involves designing and maintaining enterprise-scale data solutions while collabor... Show more

 • Promoted

Senior Software Engineer

DataAnnotationNC, United States
Full-time

Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule.We are looking for proficient programm... Show more

 • Promoted

Senior Software Engineer, Genomic Variant Classification

LabcorpNC, United States
Full-time

Labcorp is seeking a Senior Software Engineer, Variant Classification, to join our Labcorp Genetics team.This full-time position offers a hybrid work schedule in North Carolina, with responsibiliti... Show more

 • Promoted

Senior Software Engineer - HashiCorp Secure Products

IBM ComputingDurham, NC, United States
Full-time

At IBM Software, we transform client challenges into solutions.Building the world’s leading AI-powered, cloud-native products that shape the future of business and society.Our legacy of innovation ... Show more

 • Promoted

Senior Data Cloud Architect & Enterprise Data Lead

1000 Kyndryl, Inc.Durham, NC, United States
Full-time

You will oversee the IT data lifecycle and work closely with clients to design data solutions tailored to their needs.The ideal candidate has over 10 years of experience with cloud-based data platf... Show more

 • Promoted

Hybrid Data Architect — Snowflake, Kafka & Oracle (12+ Mo)

Pyramid Consulting, IncDurham, NC, United States
Temporary

Pyramid Consulting, Inc is seeking a skilled Data Architect for a 12+ month contract in Durham, NC.This role involves designing and implementing robust data architectures, supporting various databa... Show more

 • Promoted

Senior Software Engineer

CNA SearchNC, United States
Full-time

Work with business analysts to fix bugs and refine and implement new features.Work on back-end API written in C# using Akka.CQRS, and MediatR (prior experience a plus), including writing.XUnit and ... Show more