Data Operations Engineer

Data Operations Engineer

About Us :

OptionMetrics, headquartered in New York, NY. is a dynamic and innovative technology company, a trusted provider of financial information and research derived from the option markets. We are at the forefront of developing solutions that empower businesses. Our commitment to excellence, coupled with a collaborative, forward-thinking culture, has made us the preferred choice for top-tier talent. Our data and analytics models are utilized by over 350 investment banks, hedge funds, asset management firms, and academic institutions globally, solidifying our position as a leader in the industry.

What youll do :

As a Data Operations Engineer at OptionMetrics, youll play a key role in ensuring the smooth and reliable flow of data that powers our analytics and products. Youll be responsible for monitoring, maintaining, and improving the systems and pipelines that deliver critical financial data to our clients worldwide. In this role, you will troubleshoot data pipeline issues, implement quality checks to ensure accuracy, and collaborate closely with our development and infrastructure teams to build resilient, efficient, and secure workflows. Youll also contribute to process improvements, optimize performance across cloud platforms, and help ensure data is delivered with speed, integrity, and consistency.

Objectives :

Customer Distribution & Delivery : Ensure data feeds / files are successfully delivered to customers (SFTP, APIs, etc.) with integrity checks and audit logs.

Exception Handling : Build processes for handling late / missing vendor data, schema changes, and bad data without disrupting downstream systems.

Resiliency : Incorporate backup / retry logic, failover planning, and support for disaster recovery scenarios in pipelines.

Audit Support : Maintain data lineage, access logs, and documentation.

Continuous Improvement : Identify repetitive operational tasks and propose efficiency improvements.

Collaboration with Dev & Infra Teams : Ensure quality designed workflows, platform resiliency, and secure data handling practices are enforced in every pipeline.

SLA Adherence : Track data processing and SLA management.

Responsibilities :

Monitor and maintain ETL / ELT workflows for uptime and performance.

Implement data validation, quality checks, and reconciliation to ensure accuracy.

Reduce mean time to detect (MTTD) and mean time to resolve (MTTR) for data issues.

Troubleshoot and resolve operational issues in data pipelines.

Partner with Dev Team and Data QA teams to Ingest and normalize feeds from market data vendors.

Optimize workflows for cost and performance across cloud platforms.

Maintain documentation and runbooks for operational processes.

Support incident management and root cause analysis related to data movement failures.

Visualize data flows and error tracking.

Required skills and qualifications :

Strong SQL and scripting (Python, Bash).

Experience with workflow orchestration.

Familiarity with data warehouses like Snowflake.

Experience with FTP and similar data distribution platforms.

Cloud-native data services like AWS SQS and general AWS knowledge.

Basic observability (monitoring, logging, alerting).

Financial Data knowledge preferred.

What We Offer :

A collaborative environment where everyone's input makes a difference.

Paid time off : Vacation, Personal, Sick days, and Holidays.

Pre-tax commuter benefits (NJT, MTA, etc.) and 401k plan offered.

Full medical and dental insurance coverage.

Pay ranges at OptionMetrics are established based on an analysis of salaries for positions with a similar level of accountability and impact in the relevant labor market. Salary levels are expected to change to reflect an employees job performance (results and impact) over time. Salaries at the time of hire are typically offered in the lower to middle of the above-referenced range in order to provide the opportunity to reflect performance-based increases over time. In addition to base salaries, employees at OptionMetrics are eligible for a comprehensive package of benefits.

OptionMetrics is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. Further, OptionMetrics will not discriminate against applicants for inquiring about, discussing or disclosing their pay or, in certain circumstances, the pay of their coworker, Pay Transparency Nondiscrimination .

If you need a reasonable accommodation for any part of the employment process, please contact us by email and let us know the nature of your request and your contact information. Requests for accommodation will be considered on a case-by-case basis. Please note that only inquiries concerning a request for reasonable accommodation will be responded to from this email address.

$100,000 - $150,000 a year

Compensation details : 100000-150000 Yearly Salary

PIad8db4ba1859-30511-38550136