About Position :
Job Title : UX Researcher
Location : Mountain View, CA / San Francisco, CA - Hybrid
Pay rate : $45 / Hr.
Duration : 6 Months with possible extension
Work Description
The job will require careful monitoring and thorough analysis of eval data that are produced by a set of data labelers in the agentic automation and action space. Quality control of such eval data is critical in arriving at useful insights about the current state and capabilities (including strengths & weaknesses, performance reliability) of other competitors' agentic actions. The job is to help drive competitive evals and analysis, compiling reports on performance of new, in-development Chrome products and other products as requested, and running targeted evaluations and comparisons to inform upcoming work. This is a hybrid role that combines deep, hands-on, and careful product testing with an analytic thinking and data-driven mindset (both qualitative and quantitative).
Desired Skills and Experience
- Proven experience in a Quality Assurance (QA) and / or user research role.
- Excellent technical writing skills, with experience creating detailed documentation, training materials, or labeling guidelines.
- Ability to conduct hands-on, exploratory testing of new and in-development software.
- Experience analyzing and communicating both qualitative (e.g., bug reports, user feedback) and quantitative (e.g., error rates, quality metrics) data.
- Strong communication and collaboration skills, with experience working with cross-functional teams (e.g., Product, Engineering).
- Experience working with third-party vendors - creating labeling guidelines, experience evaluating the quality of data being delivered, etc.
Example Tasks
Review traces of user interactions with our product to identify bugs, usability issues, and areas for improvement.Author and update a detailed set of instructions and examples for a vendor team that is labeling a new feature, ensuring the guidelines are clear and unambiguous.Perform hands-on testing of a new product feature before it launches, document any bugs in detail, and provide feedback to the engineering team.Help curate a regular quality report from a labeling vendor to identify trends, summarize key findings, and present recommendations to product stakeholders.