Talent.com
Senior Software Engineer, Managed AI

Senior Software Engineer, Managed AI

CrusoeSan Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Crusoe's mission is to accelerate the abundance of energy and intelligence. We're crafting the engine that powers a world where people can create ambitiously with AI - without sacrificing scale, speed, or sustainability.

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that's setting the pace for responsible, transformative cloud infrastructure.

About This Role :

The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior Software Engineer to join their team. You'll have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform. You will lead the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role gives you the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers.

From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. As part of a dynamic, fast-growing team, you'll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product that will be central to Crusoe's business growth.

This is an on-site role based in San Francisco, CA, or Sunnyvale, CA, requiring in-office presence

What You'll Be Working On :

  • Design and develop core infrastructure for the Managed AI platform :

Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms.

  • Build and optimize systems for high-volume AI inference, handling millions of API requests per second.
  • Develop and maintain core services for AI model deployment and management.
  • Collaborate with cross-functional teams :
  • Work closely with product managers, data scientists, and other engineers to define and deliver AI services.

  • Integrate with other Crusoe Cloud services to provide a seamless user experience.
  • Collaborate with research and development teams to explore and implement new AI technologies.
  • Ensure high availability and performance :
  • Design and implement systems with high availability, low latency, and fault tolerance.

  • Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling.
  • Continuously monitor and improve the performance and reliability of AI services.
  • What You'll Bring to the Team :

  • Strong Engineering Foundations :
  • Advanced degree in Computer Science, Engineering, or a related field.

  • Proven experience in distributed systems design and implementation.
  • Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc.
  • Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
  • Experience using REST APIs and common communication protocols, such as gRPC.
  • Demonstrated experience in the software development cycle and familiarity with CI / CD tools.
  • AI / ML Expertise :
  • Experience in Generative AI (Large Language Models, Multimodal).

  • Technical Skills :
  • Proficiency in Golang or Python for large-scale, production-level services. (Preferred)

  • Familiarity with AI infrastructure, including training, inference, and ETL pipelines. (Preferred)
  • Contributions to open-source AI projects such as VLLM or similar frameworks. (Preferred)
  • Performance optimizations on GPU systems and inference frameworks. (Preferred)
  • Soft Skills :
  • Proven track record of delivering early-stage projects under tight deadlines.

  • Strong communication and collaboration skills.
  • Proactive and results-oriented with the ability to work independently and as part of a team.
  • Passion for building high-quality, scalable, and impactful products.
  • Bonus Points :

  • Experience with AI / ML frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.
  • Knowledge of machine learning algorithms and data structures.
  • Experience with data streaming and real-time processing technologies.
  • Contributions to open-source projects outside of AI.
  • Benefits :

  • Industry competitive pay
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Subscription to the Calm app
  • MetLife Legal
  • Company paid commuter benefit; $300 per month
  • Compensation :

    Compensation will be paid in the range of $166,000 - $201,000 a year + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.

    Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex / gender, sexual preference / orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

    Create a job alert for this search

    Senior Software Engineer Ai • San Francisco, CA, United States

    Related jobs
    • Promoted
    Senior Staff Software Engineer, Managed AI

    Senior Staff Software Engineer, Managed AI

    Crusoe Energy Systems LLCSan Francisco, CA, United States
    Full-time
    As a Senior Staff Software Engineer on the Managed AI team at Crusoe, you'll have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform.You will le...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Software Engineer (AI)

    Senior Software Engineer (AI)

    Transparent Search GroupSan Francisco, CA, United States
    Full-time
    Founding AI Engineer, Growth Systems.San Francisco, CA (On-site, Hayes Valley).Full-Time | $180K - $220K + Equity.Visa sponsorship + relocation available. You'll join a small, world-class team backe...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Software Engineer, AI / ML

    Senior Software Engineer, AI / ML

    GLUESan Francisco, CA, United States
    Full-time
    Glue is a well-funded startup working on the next generation of work communication tools.We believe that today’s work chat is noisy, unstructured, and not designed for productivity.We’re drawing fr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    SentrySan Francisco, CA, United States
    Full-time
    Bad software is everywhere, and we're tired of it.Sentry is on a mission to help developers write better software faster so we can get back to enjoying technology. With more than $217 million in fun...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer AI / ML Enterprise SaaS

    Senior Software Engineer AI / ML Enterprise SaaS

    Pony Express HQSan Mateo, CA, United States
    Full-time
    Senior Software Engineer AI / ML Enterprise SaaS at Pony Express HQ.Join to apply for the Senior Software Engineer AI / ML Enterprise SaaS role at Pony Express HQ. Pony Express HQ helps businesses uncov...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    CentariSan Francisco, CA, United States
    Full-time
    We are hiring a Senior Software Engineer, AI to join our product team.You'll be a key player in designing Centari's core AI technology, working alongside engineers who share a bias for action.As on...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Software Engineer - Generative AI

    Senior Software Engineer - Generative AI

    C3.ai, Inc.Redwood City, CA, United States
    Full-time
    C3 AI (NYSE : AI), is the Enterprise AI application software company.C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing,...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI

    Senior Software Engineer - AI

    CorVelFoster City, CA, United States
    Full-time
    As our business continues to grow, we are expanding our capabilities in harnessing cutting-edge AI advancements.We seek a highly motivated problem solver who thrives in addressing complex challenge...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Staff Software EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Senior Staff Software EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Form EnergyBerkeley, CA, United States
    Full-time
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show moreLast updated: 11 days ago
    • Promoted
    Senior Software Engineer, AI / ML, GenAI, Ads

    Senior Software Engineer, AI / ML, GenAI, Ads

    Google Inc.Mountain View, CA, United States
    Full-time
    Senior Software Engineer, AI / ML, GenAI, Ads.Google place Pittsburgh, PA, USA.Bachelor’s degree or equivalent practical experience. Large Language Models, Multi-Modal, Large Vision Models) or GenAI-r...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Software Engineer, AI / ML

    Senior Software Engineer, AI / ML

    GLUE IncSan Francisco, CA, United States
    Full-time
    Glue is a well-funded startup working on the next generation of work communication tools.We believe that todays work chat is noisy, unstructured, and not designed for productivity.Were drawing from...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Firmware EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Senior Firmware EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Form EnergyBerkeley, CA, United States
    Full-time
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    AI First Software Engineer - Senior Manager

    AI First Software Engineer - Senior Manager

    PwCSan Francisco, CA, United States
    Full-time
    At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients.These individuals comb...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer, AI Agentic Experience (Auth0)

    Senior Software Engineer, AI Agentic Experience (Auth0)

    Okta, Inc.San Francisco, CA, United States
    Full-time
    Okta is The World's Identity Company.We free everyone to safely use any technology, anywhere, on any device or app.Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secur...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Software Engineer, AI Products

    Senior Software Engineer, AI Products

    AttentiveSan Francisco, CA, United States
    Full-time
    Attentive® is the AI-powered mobile marketing platform transforming the way brands personalize consumer engagement.Attentive enables marketers to craft tailored journeys for every subscriber, drivi...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Generative AI

    Senior Software Engineer - Generative AI

    C3 AIRedwood City, CA, United States
    Full-time
    C3 AI (NYSE : AI), is the Enterprise AI application software company.C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing,...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Software Engineer, Full-Stack - Enterprise Gen AI

    Senior Software Engineer, Full-Stack - Enterprise Gen AI

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Senior Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, an...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Software Engineer - AI

    Senior Software Engineer - AI

    Hinge HealthSan Francisco, CA, United States
    Full-time
    Hinge Health is a digital health company focused on providing innovative, evidence-based solutions for musculoskeletal (MSK) pain. Through a combination of personalized exercise therapy and virtual ...Show moreLast updated: 8 hours ago