Base pay range
$150,000.00 / yr - $200,000.00 / yr
Overview
HUD (YC W25) is developing agentic evals for Computer Use Agents (CUAs) that browse the web. Our CUA Evals framework is the first comprehensive evaluation tool for CUAs. HUD (YC W25) is backed by Y Combinator and works closely with frontier AI labs to provide agent evaluation infrastructure at scale. Our mission is to create detailed evals for a wide range of tasks so AI agents can work effectively in the real world.
We’re looking for a systems / full-stack engineer to help build out the technical infrastructure that enables comprehensive CUA testing at scale.
Responsibilities
- Build out HUD's existing CUA evaluation framework
- Optimize our evaluation infrastructure at scale
Experience & Technical Skills
Experience with AWS, Kubernetes, Docker, Redis, Linux, Python, PostgreSQLSystems design, performance security, CI / CD management experience preferredYou May Be a Good Fit If You
Have hands-on experience with scalable infrastructure design and implementationHave contributed to large-scale system architecture projectsBuilt reliable, high-performance distributed systemsWorked with containerized applications and orchestration platformsStrong Candidates May Have
Startup experience in early-stage technology companies with ability to work independently in fast-paced environmentsStrong communication skills for remote collaboration across time zonesFamiliarity with current AI tools and LLM capabilitiesUnderstanding of LLM evaluation frameworks and methodologiesEvidence of rapid learning and adaptability in technical environmentsWe prioritize technical aptitude and learning potential over years of experience. Motivated candidates are encouraged to apply even if they do not meet all criteria.
Team & Company Details
Team Size : ~15 people currently, mostly full-time in-person, but some remote.Our team includes 4 international Olympiad medallists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS, etc.Company stage : We have received $2 million in seed funding and are scaling profitably to meet demand.Logistics
Employment : Full-timeLocation : On-site only for now. You can join the team in the San Francisco Bay Area or Singapore, offices.Visa Sponsorship : We provide support for relocation and visas for strong full-time candidates to USA or Singapore. For part-time / contract / internship arrangements, we’ll work fully remote.Timeline : Applications are rolling. The process should involve 2 technical interviews and a 1-week work trial.Due to high volume, we may not actively respond to every application, but feel free to contact us at recruiting@hud.so or elsewhere if we missed your application!
Seniority level
Entry levelEmployment type
Full-timeJob function
Information TechnologyIndustries
TechnologyInformation and InternetReferrals increase your chances of interviewing at hud (YC W25) by 2x
Sign in to set job alerts for “System Engineer” roles.
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr