Talent.com
No longer accepting applications
Senior Data Engineer (Python, Spark, AWS)

Senior Data Engineer (Python, Spark, AWS)

Capital OneCharlottesville, VA, United States
30+ days ago
Job type
  • Full-time
  • Part-time
Job description

Senior Data Engineer (Python, Spark, AWS)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,

inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking

Data Engineers

who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

As a Senior Data Engineer, you will build robust data pipelines to process data for data modeling purposes. This team plays a critical role in Capital One’s credit line increase program. Our Data Engineers leverage technologies like Snowflake, Databricks, and AWS Glue to build world class data pipelines and datasets that power credit modeling and decision, and drive the growth of Capital One credit card line of business.

What You’ll Do :

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems

Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake

Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community

Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment

Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Basic Qualifications :

Bachelor’s Degree

At least 3 years of experience in application development (Internship experience does not apply)

At least 1 year of experience in big data technologies

Preferred Qualifications :

5+ years of experience in application development including Python, SQL, Scala, or Java

2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)

3+ years experience with Distributed data / computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)

2+ year experience working on real-time data and streaming applications

2+ years of experience with NoSQL implementation (Mongo, Cassandra)

2+ years of data warehousing experience (Redshift or Snowflake)

3+ years of experience with UNIX / Linux including basic commands and shell scripting

2+ years of experience with Agile engineering practices

At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).

The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

McLean, VA : $158,600 - $181,000 for Senior Data Engineer

Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter.

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and / or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the

Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability / vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at

RecruitingAccommodation@capitalone.com

  • . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.

For technical support or questions about Capital One's recruiting process, please send an email to

Careers@capitalone.com

Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.

Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Create a job alert for this search

Senior Data Engineer • Charlottesville, VA, United States

Related jobs
Senior Database Engineer

Senior Database Engineer

Syms Strategic Group, LLC (SSG)Charlottesville, VA, US
Full-time
Quick Apply
Syms Strategic Group (SSG) is seeking a talented Senior Database Engineer Location : .Remote Department : Veterans Affairs Type : Full Time Min. Experienced Security Clearance Level : P...Show moreLast updated: 12 days ago
  • Promoted
Customer Service Associate

Customer Service Associate

Wawa, Inc.Elkton, VA, US
Full-time
We believe we can make life a little better every day – one smile, hoagie, or experience at a time.And there’s one secret ingredient that truly sets Wawa apart : Our Associates.At Wawa, ...Show moreLast updated: 30+ days ago
  • Promoted
Senior Systems Engineer

Senior Systems Engineer

Apex Clean EnergyCharlottesville, VA, United States
Full-time
Apex Clean Energy was founded with a singular focus : to accelerate the shift to clean energy.Through origination, construction, and operation of utility-scale wind, solar, and storage facilities, d...Show moreLast updated: 30+ days ago
  • Promoted
PING Engineer

PING Engineer

Booz Allen HamiltonCharlottesville, VA, United States
Full-time +1
You know that the user is the last frontier for cybersecurity.It's where the perimeter is drawn, and securing identities is pivotal in the fight against cybercriminals. As an Identity and Access Man...Show moreLast updated: 6 days ago
  • Promoted
Hybrid AWS DevOps Engineer with Security Clearance

Hybrid AWS DevOps Engineer with Security Clearance

Seneca ResourcesState Farm, VA, United States
Full-time
Role Highlights : Title : DevOps Engineer Program : Dept.Defense Clearance : Secret clearance Location : Northern Virginia, remote schedule with occasional on-site requirements.Pay : $150K (hourly equiva...Show moreLast updated: 2 days ago
Software Engineer, Sr. – Cloud & DevSecOps with Top Secret

Software Engineer, Sr. – Cloud & DevSecOps with Top Secret

Maania Consultancy ServicesCharlottesville, VA, US
Full-time
Quick Apply
Hi {First Name}, Our client is looking for a Software Engineer, Sr.If you're interested please share your updated resume along with your best interview availability timings to speak with cli...Show moreLast updated: 19 days ago
  • Promoted
CDL-A Truck Driver - Home Daily - Average $85,000 / Year

CDL-A Truck Driver - Home Daily - Average $85,000 / Year

SyscoShenandoah, VA, US
Full-time
Sysco is Now Hiring Local CDL-A Drivers in Harrisonburg, VA.Drivers Average $85,000 Annually! •.Home Daily - Industry-Leading Total Rewards Package. We offer our colleagues the opportunity to grow pe...Show moreLast updated: 30+ days ago
Hyperspectral Engineer

Hyperspectral Engineer

C-Star Solutions, LLCGordonsville, VA, US
Full-time
Quick Apply
Hyperspectral Data Scientist / Engineer C-Star supports our customers with advanced GEOINT analysis to aid analysts, the warfighters and decision makers. You will be supporting a team in the Northern ...Show moreLast updated: 30+ days ago
Senior Software Systems Engineer - II

Senior Software Systems Engineer - II

Syms Strategic Group, LLC (SSG)Charlottesville, VA, US
Full-time
Quick Apply
Syms Strategic Group (SSG) is seeking a talented Senior Software Systems Engineer (.Remote Department : Veterans Affairs (VA) Type : Full Time Min. Experienced Security Clearance Level : ...Show moreLast updated: 5 days ago
Senior Database Developer - II

Senior Database Developer - II

Syms Strategic Group, LLC (SSG)Charlottesville, VA, US
Full-time
Quick Apply
Syms Strategic Group (SSG) is seeking a talented Senior Database Engineer Location : .Remote Department : Veterans Affairs Type : Full Time Min. Experienced Security Clearance Level : P...Show moreLast updated: 4 days ago
  • Promoted
Senior Project Engineer, Alternative Delivery

Senior Project Engineer, Alternative Delivery

RK&KCharlottesville, VA, United States
Full-time
RK&K is seeking a Senior Project Engineer to play a key role in the planning, design, and delivery of Transportation Projects throughout the firm. In this role, you'll work under the guidance of exp...Show moreLast updated: 3 days ago
  • Promoted
CDL-A Lease Purchase – $2,000 / Wk NET, $0 Down Lease

CDL-A Lease Purchase – $2,000 / Wk NET, $0 Down Lease

DriveLine SolutionsCHARLOTTESVILLE, VA, USA
Full-time
CDL-A Lease Purchase – $2,000 / Wk NET, $0 Down Lease.Why Drivers Love This Opportunity.Trailer rental available : dry van $225 / week. Weekly truck payments : $300–$650 (varies by truck).Fuel card provid...Show moreLast updated: 30+ days ago
  • Promoted
AWS Developer

AWS Developer

Diverse LynxPalmyra, VA, United States
Full-time
Digital : Amazon Web Service(AWS) Cloud Computing.Design and implement highly scalable, and fault tolerant solutions in AWS. Define best practice for AWS infrastructure, including AWS services like ...Show moreLast updated: 30+ days ago
  • Promoted
Senior Sales Director - Software

Senior Sales Director - Software

Charlotte StaffingCharlottesville, VA, US
Full-time
Job Opportunity At GE Aerospace.In this role, you will be part of the Americas regional commercial team for GE Aerospace's software as a service business and be dedicated to sales of GE Aerospace's...Show moreLast updated: 1 day ago
  • Promoted
Grubhub Driver - Charlottesville, VA - Fast Cash, Flexible Work!

Grubhub Driver - Charlottesville, VA - Fast Cash, Flexible Work!

GrubhubDyke, VA, US
Full-time
Earn big and work on your own time and terms as a Grubhub delivery partner! Grubhub is looking for drivers and bikers like you to hit the road quick and start delivering from restaurants, liquor st...Show moreLast updated: 30+ days ago
  • Promoted
Dashers - Sign Up and Start Earning

Dashers - Sign Up and Start Earning

DoorDashLouisa, VA, United States
Full-time +1
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show moreLast updated: 8 days ago
  • Promoted
Data Architect - Software Engineer III-IV (109)

Data Architect - Software Engineer III-IV (109)

National Radio AstronomyCharlottesville, VA, United States
Full-time
National Radio Astronomy Observatory.Data Architect - Software Engineer III-IV (109).Green Bank Observatory, PO Box 2, GREEN BANK, West Virginia, United States of America • NRAO Array Operations Cen...Show moreLast updated: 30+ days ago
  • Promoted
Senior Azure DevOps Engineer with Top Secret

Senior Azure DevOps Engineer with Top Secret

Maania Consultancy ServicesCharlottesville, VA, United States
Full-time
Azure in a secure environment (Python / Bash preferred) - 6 months provisioning, installation, configuration, operation, and maintenance of software and infrastructure-as-code in a DevSecOps and co...Show moreLast updated: 6 days ago