Talent.com
No longer accepting applications
Senior Software Engineer, Core GenAI Platform

Senior Software Engineer, Core GenAI Platform

UpstartColumbus, OH, US
3 days ago
Job type
  • Full-time
Job description

About Upstart

Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstart's AI marketplace, Upstart-powered banks and credit unions can have higher approval rates and lower loss rates across races, ages, and genders, while simultaneously delivering the exceptional digital-first lending experience their customers demand. More than 80% of borrowers are approved instantly, with zero documentation to upload.

Upstart is a digital-first company, which means that most Upstarters live and work anywhere in the United States. However, we also have offices in San Mateo, California; Columbus, Ohio; and Austin, Texas.

Most Upstarters join us because they connect with our mission of enabling access to effortless credit based on true risk. If you are energized by the impact you can make at Upstart, we’d love to hear from you!

The Team

Upstart’s new Core GenAI Platform team is building foundational infrastructure that democratizes access to generative AI / LLMs for every product and engineering team across the company.

As a Senior Software Engineer on Upstart's Core GenAI Platform team, you will help design and build a unified interface for securely interacting with large language models - abstracting away the complexity of model selection, prompt orchestration, evaluation, and scaling. You'll help build a centralized GenAI layer that enables engineers to use best-in-class LLMs through clean APIs, configurable pipelines, and intuitive tooling.

Reporting to our Senior Director of Engineering, the team operates with broad scope and high visibility, partnering across Machine Learning, Product, and Compliance to ensure every model integration is performant, secure, and compliant. Whether it's embedding LLMs in user-facing products or optimizing backend workflows, this team makes it seamless for Upstart Engineering to adopt and scale GenAI company-wide.

How you’ll make an impact :

  • Build the Core GenAI platform powering generative AI use cases across all of Upstart Engineering.
  • Design and implement reliable, observable infrastructure for model inference, prompt orchestration, and data workflows.
  • Drive cross-functional adoption of AI tooling by delivering reusable components and intuitive interfaces.Increase developer productivity through automation, metrics dashboards, and streamlined GenAI integrations.
  • Set the technical roadmap for platform capabilities, balancing innovation with reliability and compliance.
  • Partner with ML researchers, product engineers, and design to bridge experimentation and production.
  • Ensure the platform adheres to emerging standards of security, fairness, and explainability for LLM systems.

What we’re looking for :

  • Minimum requirements :
  • 6+ years of experience in object-oriented software engineering, with a strong systems engineering background

  • Proven experience independently leading impactful, cross-functional, multi-quarter projects with mid-large teams
  • Proficiency in backend development with Python (leveraging frameworks like FastAPI, Flask, or similar), microservices architecture, and infrastructure tools like Kubernetes, Docker, and Terraform
  • Hands-on experience building ML platforms or infrastructure supporting LLMs or inference systems
  • Familiarity with observability tools (e.g., Prometheus, Grafana, Datadog) and data processing pipelines
  • Strong written and verbal communication skills and a collaborative approach to cross-functional work
  • Strong stakeholder management skills
  • Preferred qualifications :
  • Full Stack development skills including hands on experience with React or similar

  • Proficiency with Kotlin or Java and the Spring framework ecosystem
  • Experience with LLM toolchains such as LangChain, LlamaIndex, or OpenAI APIs
  • Deep understanding of model inference optimization (e.g., quantization, ONNX, streaming)
  • Exposure to retrieval-augmented generation (RAG), vector databases (e.g., FAISS, Pinecone), or prompt engineering
  • Experience operationalizing LLMs in production, including latency management and prompt versioning
  • Ability to influence platform direction and drive alignment across multiple engineering teams
  • Awareness of LLM-specific risk domains, including hallucinations, fairness, and data privacy
  • Position Location - This role is available in the following locations : Remote, San Mateo, Columbus, Austin

    Time Zone Requirements - This team operates across all U.S. time zones.

    Travel Requirements - This team has regular on-site collaboration sessions. These occur 3 days per quarter at an Upstart office. If you need to travel to make these meetups, Upstart will cover all travel related expenses.

    What you'll love :

  • Competitive Compensation (base + bonus & equity)
  • Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart
  • 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
  • Employee Stock Purchase Plan (ESPP)
  • Life and disability insurance
  • Generous holiday, vacation, sick and safety leave
  • Supportive parental, family care, and military leave programs
  • Annual wellness, technology & ergonomic reimbursement programs
  • Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
  • Catered lunches + snacks & drinks when working in offices
  • #LI-REMOTE

    #LI-MidSenior

    At Upstart, your base pay is one part of your total compensation package. The anticipated base salary for this position is expected to be within the below range. Your actual base pay will depend on your geographic location–with our “digital first” philosophy, Upstart uses compensation regions that vary depending on location. Individual pay is also determined by job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

    In addition, Upstart provides employees with target bonuses, equity compensation, and generous benefits packages (including medical, dental, vision, and 401k).

    United States | Remote - Anticipated Base Salary Range

    $163,600—$226,400 USD

    Upstart is a proud Equal Opportunity Employer. We are dedicated to ensuring that underrepresented classes receive better access to affordable credit, and are just as committed to embracing diversity and inclusion in our hiring practices. We celebrate all cultures, backgrounds, perspectives, and experiences, and know that we can only become better together.

    If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please email candidate_accommodations@upstart.com

    https : / / www.upstart.com / candidate_privacy_policy

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Software Engineer • Columbus, OH, US

    Related jobs
    • Promoted
    Sr. Software Engineer

    Sr. Software Engineer

    RXC RxC Acquisition CompanyColumbus, OH, United States
    Full-time
    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...Show moreLast updated: 1 day ago
    • Promoted
    Senior Software Engineer (Python / Django)

    Senior Software Engineer (Python / Django)

    JobotColumbus, OH, US
    Full-time +1
    Groundbreaking SaaS Data Analytics platform for Healthcare Providers / Meaningful equity!.This Jobot Job is hosted by : Craig Rosecrans. Are you a fit? Easy Apply now by clicking the "Apply Now" butt...Show moreLast updated: 3 days ago
    • Promoted
    Maximo Technical Lead

    Maximo Technical Lead

    Omni InclusiveMarysville, OH, United States
    Full-time
    IDP-Maximo integrations using REST APIs, MIF, and middleware platforms.Project specific Responsibilities : .Lead the design and delivery of IDP-Maximo integrations using REST APIs, MIF, and middlewa...Show moreLast updated: 4 days ago
    Senior ATG Developer | Ohio | Rate Open

    Senior ATG Developer | Ohio | Rate Open

    Two95 International Inc.Blacklick, OH, US
    Full-time
    Quick Apply
    Job Title : Senior ATG Architect.Develop Digital Commerce experiences based on a foundation of ATG Commerce platform.Develop awesome features such as product catalog, search, order management, promo...Show moreLast updated: 5 days ago
    • Promoted
    New Model Senior Project Manager

    New Model Senior Project Manager

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 2 days ago
    Oracle is hiring : Principal Software Engineer - Studio in the Cloud in Columbus

    Oracle is hiring : Principal Software Engineer - Studio in the Cloud in Columbus

    MediabistroColumbus, OH, United States
    Full-time
    Job Location (No exceptions - onsite).You will work with a talented group of software developers, designing scalable, highly available cloud services in a world class cloud development environment....Show moreLast updated: 30+ days ago
    • Promoted
    Palantir Foundry Data Engineer

    Palantir Foundry Data Engineer

    Purple DriveMilford Center, OH, United States
    Full-time
    Palantir Foundry Data Engineer.Design, Development and enhancement of data pipelines on Palantir Foundry platform.Data Analyis using contour module of palantir. Building of custom application and In...Show moreLast updated: 4 days ago
    • Promoted
    Early Career - Manufacturing Engineer (Multiple Positions)

    Early Career - Manufacturing Engineer (Multiple Positions)

    Honda Dev. and Mfg. of Am.,LLCMarysville, OH, US
    Full-time
    What Makes a Honda, is Who makes a Hond.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that wi...Show moreLast updated: 2 days ago
    • Promoted
    Travel Echo Tech - $2600 / Week

    Travel Echo Tech - $2600 / Week

    Premier Medical Staffing Services, LLCLancaster, OH, US
    Full-time
    Premier Medical Staffing Services, LLC is seeking an experienced Echo Tech for an exciting Travel Allied job in Lancaster, OH. Shift : 5x8 hr days Start Date : 10 / 20 / 2025 Duration : 13 weeks Pay : $2600...Show moreLast updated: 2 days ago
    • Promoted
    New Model Engineer

    New Model Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Mechanical Design Engineer

    Senior Mechanical Design Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    RelativityColumbus, OH, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show moreLast updated: 30+ days ago
    • Promoted
    Facilities Senior Engineer

    Facilities Senior Engineer

    Honda Dev. and Mfg. of Am.,LLCMarysville, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 2 days ago
    • Promoted
    Supplier Process Senior Engineer

    Supplier Process Senior Engineer

    Honda Dev. and Mfg. of Am.,LLCMarysville, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 2 days ago
    • Promoted
    Mechanical Design Senior Principal Engineer

    Mechanical Design Senior Principal Engineer

    American Honda Motor Co., Inc.Raymond, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 2 days ago
    • Promoted
    Senior Project Engineer, NA

    Senior Project Engineer, NA

    Vantage Data CentersNew Albany, OH, United States
    Full-time
    Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America,...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Robotics Software Engineer

    Senior Robotics Software Engineer

    Apricity RoboticsDublin, OH, US
    Full-time
    At Apricity Robotics we strive to harness the power of AI and robotics to bring the warmth of hope and healing, revolutionizing healthcare and transforming challenging situations into opportunities...Show moreLast updated: 2 days ago
    • Promoted
    Core Application Senior Developer

    Core Application Senior Developer

    Northwest BankColumbus, OH, United States
    Full-time
    The Core Application Senior Developer is an application developer role that will be responsible for writing code mainly in RPGLE, SQL RPG and CLLE. This position is responsible for designing, coding...Show moreLast updated: 9 days ago
    Sr. Software Engineer

    Sr. Software Engineer

    Cardinal HealthUSA, Ohio, Dublin
    Full-time
    What Commercial Technologies Software Engineering contributes to Cardinal Health.Commercial Technologies manages the enterprise's portfolio of commercial technologies to maximize the business value...Show moreLast updated: 17 days ago
    Senior ATG Architect

    Senior ATG Architect

    Two95 International Inc.Blacklick, OH, US
    Full-time
    Quick Apply
    Job Title : Senior ATG Architect.Develop Digital Commerce experiences based on a foundation of ATG Commerce platform.Develop awesome features such as product catalog, search, order management, promo...Show moreLast updated: 5 days ago