Iron Systems is an innovative, customer-focused provider of custom-built computing infrastructure platforms such as network servers, storage, OEM / ODM appliances & embedded systems. For more than 15 years, customer have trusted us for our innovative problem solving combined with holistic design, engineering, manufacturing, logistic and global support services.
Job Title : Software Engineer II
Location : US - CA - Remote
Job Description : True Job Title : AI Multimedia Generation Product Evaluator
About Our Team :
- The Multimedia Generation team focuses on fine tuning and productionizing media foundational models in the GenAI space.
- The team consists of AI applied scientists of five members, each responsible for different products like videos, image editing, and developing evaluation metrics.
Job Description :
We are seeking a highly motivated and detail-oriented individual to join our team as an AI Multimedia Generation Product Evaluator.In this role, you will support the evaluation of various AI multimedia generation products for images and videos.You will work closely with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement.Responsibilities :
Set up Halo tasks and run model inferenceEnqueue new queues to Halo Audit annotations from vendorsBuild necessary tooling for managing evaluation datasetsCollaborate with model development teams to conduct offline evaluations and automate pipelinesFacilitate, set up queues, manage image radio data, and audit resultsEnsure consistency and accuracy in measurements, involving programming and auditing tasksRequirements :
1-2 years of basic Python knowledge, particularly in working with image / video data and JSONExperience in SQL and handling large data tablesExperience in the image and video domainAbility to adapt to new code General know-howFlexibility in working hoursNice-to-Have Skills :Experience as a GenAI user in the image and video domain Basic shell script knowledgeDegrees / Certifications -
Bachelor's preferred, not requiredDay-to-Day Responsibilities :
Collaborate with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement.Main tasks include facilitating, setting up queues, managing image radio data, and auditing results.About the Team :
The Multimedia GenerationGenAI Media Foundations team focuses on finetuning and productionizing media foundational models in the GenAI space.The team consists of AI applied scientists, each responsible for different products like videos, image editing, and developing evaluation metrics.The role will support engineers in ensuring consistency and accuracy in measurements, involving programming and auditing tasks.Mandatory Skills
1-2 years of basic Python knowledge, particularly in working with image / video data and JSON Experience in SQL and handling large data tables