Talent.com
AI Systems Engineer

AI Systems Engineer

CyberCodersNew York, NY, US
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

AI Systems Engineer

Title : AI Systems Engineer

Location : FULLY remote!

Salary : $175k-$250k base + RSUs + Full Benefits

Requirements : 3+ years of Systems Engineering / DevOps / AI Infrastructure, AI, Python / Golang / Rust, and HPC experience

Our HPC infrastructure goes beyond just the GPU - allowing companies to train, iterate, and deploy AI & ML projects faster than ever! We specialize in high-performance GPU cloud solutions tailored for AI & ML projects and cutting-edge infrastructure (including GPU clusters, high-speed networking, and scalable storage) to support demanding workloads. Our services are designed to optimize performance, reliability, and affordability for AI researchers, ML engineers, and enterprises.

We're currently experiencing MASSIVE GROWTH... Our revenue grew over 95% in the last YEAR! We have made several acquisitions and formed several partnerships during this period of growth, and we need YOUR HELP to keep it going... We're currently seeking a talented and highly motivated AI Systems Engineer to design, build, and optimize the infrastructure that powers AI-driven applications. You'll work at the intersection of hardware, software, and data - enabling efficient deployment of AI models and solutions at scale.

The ideal candidates have a strong background in systems engineering, high-performance computing, software defined networking, and general software development, with some experience in machine learning and deploying / maintaining AI systems in production.

What You'll be Doing

  • AI Infrastructure Design and Development :

Design and implement scalable AI / ML infrastructure.

  • Optimize AI pipelines for performance and reliability.
  • Integrate AI models using CI / CD best practices.
  • Model Deployment and Optimization :
  • Deploy AI models in various environments (cloud, edge, on-premises).

  • Optimize inference performance for latency, throughput, and energy efficiency.
  • Use tools like TensorRT and ONNX to accelerate models.
  • Systems Engineering :
  • Maintain HPC clusters, GPUs, and distributed systems.

  • Develop tools for system monitoring and troubleshooting.
  • Ensure AI system reliability through proactive maintenance.
  • Collaboration and Cross-Functional Work :
  • Align AI systems with overall product architecture.

  • Support AI researchers with efficient data pipelines and computing environments.
  • Security and Compliance :
  • Ensure compliance with security standards and data privacy regulations.

  • Secure sensitive data and models in production.
  • Emerging Technology Integration :
  • Stay updated with AI and machine learning advancements.

  • Integrate new tools and methods to enhance systems.
  • What You Need for this Position

  • 5+ years of Systems Engineering, DevOps, or AI / ML Infrastructure experience
  • 2+ years of experience in High Performance Computing
  • Experience building cloud computing platforms (from scratch is a huge plus)
  • Hands-on experience with AI frameworks (TensorFlow, PyTorch, etc.)
  • Experience deploying AI / ML models in production environments
  • Strong knowledge of distributed systems & HPC for AI workloads
  • Experience with c ontainerization & orchestration tools (Docker, Kubernetes, etc.)
  • Programming skills in Golang, Python, or Rust
  • Familiarity with AI platform tools (Mosaic AI, Run.AI, SageMaker, Vetex AI, etc.)
  • Familiarity with Infiniband and / or RoCEv2 networking, & NCCL
  • Proficiency in using AI hardware accelerators (GPUs, TPUs, etc)
  • BS in Computer Science, Engineering, or related (Master's degree is a huge plus)
  • What's In It for You

  • $175k - $250k / year DOE
  • RSU's
  • 5 weeks PTO
  • 401k w / match
  • Comprehensive Benefit Plan
  • For this position, you must be currently authorized to work in the United States without the need for sponsorship for a non-immigrant visa. This job was first posted by CyberCoders on 08 / 05 / 2025 and applications will be accepted on an ongoing basis until the position is filled or closed.
  • CyberCoders is proud to be an Equal Opportunity Employer

    All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act.  CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at Benefits@CyberCoders.com to make arrangements.

    Create a job alert for this search

    System Engineer • New York, NY, US

    Related jobs
    • Promoted
    • New!
    AI Research Engineer

    AI Research Engineer

    VirtualVocationsPaterson, New Jersey, United States
    Full-time
    A company is looking for an AI Research Engineer specializing in LLM orchestration and prompting.Key Responsibilities Build LLM-powered software by designing prompt flows and orchestrations for o...Show moreLast updated: 19 hours ago
    • Promoted
    Systems Engineer

    Systems Engineer

    SubstackNew York, NY, US
    Full-time
    Substack is building a new economic engine for culture, giving the brightest, most interesting, and most creative people on the internet the power of their own publishing platform.The terms of our ...Show moreLast updated: 21 days ago
    • Promoted
    AI Infrastructure Engineer, Model Serving Platform

    AI Infrastructure Engineer, Model Serving Platform

    Scale AI, Inc.New York, NY, United States
    Full-time
    As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and product...Show moreLast updated: 30+ days ago
    • Promoted
    Systems Engineer

    Systems Engineer

    Options TechnologyNew York, NY, US
    Full-time
    Join our team of expert engineers in the Engineering Team!.Options is the largest global financial technology company headquartered in Belfast. We are at the forefront of banking and trading infrast...Show moreLast updated: 30+ days ago
    Senior AI Systems Engineer (Rails + LLMs)

    Senior AI Systems Engineer (Rails + LLMs)

    Ant-TechNew York, United States
    Full-time
    Quick Apply
    We are seeking a dynamic and seasoned.If you are looking for a niche in the staffing industry that brings innovation to how staffing services are delivered, this is a great opportunity to explore.W...Show moreLast updated: 21 days ago
    • Promoted
    Systems Engineer

    Systems Engineer

    MedReviewNew York, NY, US
    Full-time
    The System Engineer is responsible for the day-to-day operation and maintenance of all servers, storage and infrastructure systems that are located on premises and in the cloud.The Systems Engineer...Show moreLast updated: 30+ days ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Columbia UniversityNew York, NY, United States
    Full-time
    Job Type : Officer of Administration.Salary Range : $130,000-$150,000.The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departm...Show moreLast updated: 30+ days ago
    • Promoted
    Research Engineer (Simulation Systems)

    Research Engineer (Simulation Systems)

    AmigoNew York, NY, US
    Full-time
    Amigo builds trust and safety infrastructure for AI in mission-critical environments.We partner with organizations in healthcare and other regulated sectors to deploy AI systems that operate reliab...Show moreLast updated: 14 days ago
    Systems Engineer

    Systems Engineer

    GEM TechnologiesNew York, NY, US
    Full-time
    Quick Apply
    GEM Technologies is a leading Managed Service Provider (MSP) headquartered in the heart of New York City.With a commitment to delivering exceptional IT solutions and services, we serve a diverse ra...Show moreLast updated: 30+ days ago
    AI Engineer

    AI Engineer

    LifeMDNew York, NY, US
    Full-time
    Quick Apply
    LifeMD is a leading digital healthcare company committed to expanding access to virtual care, pharmacy services, and diagnostics by making them more affordable and convenient for all.Focused on bot...Show moreLast updated: 30+ days ago
    • Promoted
    Systems Engineer

    Systems Engineer

    ClarapathHawthorne, NY, US
    Full-time
    Clarapath is a medical robotics company based in Westchester County, NY.Our mission is to transform and modernize laboratory workflows with the goal of improving patient care, decreasing costs, and...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    VirtualVocationsPaterson, New Jersey, United States
    Full-time
    A company is looking for an AI Engineer who has experience architecting and shipping robust multi-agent systems in production. Key Responsibilities Design, develop, and deploy AI Coach capabilitie...Show moreLast updated: 30+ days ago
    AI Engineer

    AI Engineer

    WinaxisJersey City, NJ, United States
    Full-time
    Quick Apply
    MsoNoSpacing" style="text-align : justify"> Title : AI Engineer ML / NLP pipelines using Databricks, Docker / Kubernetes Show moreLast updated: 3 days ago
    • Promoted
    AI Infrastructure Engineer, Agents

    AI Infrastructure Engineer, Agents

    Scale AI, Inc.New York, NY, United States
    Full-time
    As a Software Engineer on the ML Infrastructure team, you will design and build the platform for our agent sandboxing platform : the secure, high-performance code execution layer powering our agenti...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI DevOps Engineer

    AI DevOps Engineer

    Axelon Services CorporationWoodbridge Township, NJ, US
    Full-time
    Job Title : AI DevOps Engineer.An AI DevOps Engineer bridges the gap between artificial intelligence development and operations, ensuring that AI models and systems are deployed efficiently, monito...Show moreLast updated: 13 hours ago
    • Promoted
    Director AI Engineer

    Director AI Engineer

    Webster BankStamford, CT, United States
    Full-time
    If you’re looking for a meaningful career, you’ll find it here at Webster.Founded in 1935, our focus has always been to put people first—doing whatever we can to help individuals, families, busines...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    OneStream SoftwareNew York, NY, United States
    Full-time
    Range applies to US candidates only) + Benefits / Variable Comp / Equity - Range may vary based on experience.Vision, Medical, Life, Dental, 401K. This role requires the candidate to work from one of th...Show moreLast updated: 3 days ago
    Associate Systems Engineer (Avid)

    Associate Systems Engineer (Avid)

    Company3New York, NY, US
    Full-time +1
    Quick Apply
    Company 3 Position : Associate Systems Engineer (Avid) Location : New York, NY (On-Site) •Pay Range : $30 - $35 USD hourly POSITION SUMMARY : Company 3, including its various business units and fami...Show moreLast updated: 30+ days ago