Software Engineer - Large Scale Inference

We're going to secure the financial risk of the largest infrastructure build-out in the history of the world.

When people finance clusters, the data centers that house them, and the power that powers them, they need "offtake". Offtake just means someone who's signed a contract to buy the thing they're building for some period of time. It's pretty hard to write a loan against a cluster that isn't sold to someone. The lender doesn't want to take on the risk that the cluster developer can't sell it, and the cluster developer really does not take on that risk. So instead, they ship it to the customer, by forcing folks to buy risky long-term contracts. Since margins are thin & volumes are large, if they mess up that purchase, that's game over. A 20% utilization gap might mean the difference between profit & bankruptcy.

If we don't solve that risk, there's a bubble. Application layer companies sign multi-year contracts for compute and inference, but sell to their customers on monthly subscriptions. This isn't SaaS anymore. A minor shift in your growth rate could cause the revenue to fail to come in the door, the compute bill to still come due, at the same time the venture capital slows down.

As AI scales, the folks who can most effectively take on that risk become the largest players. After all, a 2-person startup in a San Francisco Victorian can't realistically sign a 5-year take or pay contract on $100m supercomputer. But they may be able to buy the month of liquidity that someone else sold back.

So that's what we make : a liquid market for GPU offtake.

About the Role

As an engineer working on Large Scale Inference you will build and scale software systems that accept, distribute, and purchase compute for inference work loads. We're working with a cutting edge technology company as our partner. You will play a key role in building out and defining the inference products at SFC. You will work closely with a small competent team driving high impact revenue generating changes. You will have the opportunity to deliver the highest quality, most affordable inference products at scale.

On a day-to-day basis, you might...

• Quantify, optimize, and visualize the unit economics of inference
• Design solutions to maximize compute utilization
• Create automated compute purchasing software to optimally fulfill inference job demand
• Scale inference software pipeline systems to hundred trillion token scale

This role may be a good fit for you if...

Bonus points if you...

Benefits

Generous equity grant

Team members are offered a competitive salary along with equity in the company

Visa Sponsorships

Yes, we sponsor visas and work permits

Retirement matching

We match 401(k) plans up to 4%

Medical, dental & vision

We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums

Time off

We offer unlimited paid time off as well as 10+ observed holidays

Parental leave

We offer biological, adoptive, and foster parents paid time off to spend quality time with family

Daily lunch

We cover lunch daily for employees

Unlimited office book budget

You can buy as many books for the office as you want

The San Francisco Compute Company is committed to maintaining a workplace free from discrimination and harassment.

We make employment decisions based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, belief, national origin, social or ethical origin, age, physical, mental, or sensory disability, sexual orientation, gender identity or expression, marital status, civil union or domestic partnership status, past or present military service, HIV status, family medical history or genetic information, family or parental status including pregnancy, or any other status protected by law.

We welcome the opportunity to consider qualified applicants with prior arrest or conviction records. Our commitment to diversity includes hiring talented individuals regardless of their criminal history, in accordance with local, state, and federal laws, including San Francisco's Fair Chance Ordinance and California's ban-the-box laws.

If you require reasonable accommodation for any reason, please reach out to us at team@sfcompute.com.