Job Summary
- As a Data Scientist with Quant research background, you will work to drive product improvements through behavioral analytics, conversational data, and empirical user insights. As an early member of our team, you will play a pivotal role in shaping the direction of our product and building our data foundation on top of our user research infrastructure. You will collaborate with our Product, Engineering, and Design teams, to help deepen our understanding of user behavior, develop metrics, create frameworks and support continuous monitoring and deep-analysis to help us understand and improve our AI assistant's performance.
- The ideal candidate will help lead efforts on metrics and measurements, evaluate user satisfaction, define our north-star metrics, and bring-forth creative analytical methods suitable for our AI conversational product to address the most critical questions. The ideal candidate will provide deep, actionable insights into user behavior and user satisfaction, and excitement in gaining hands-on experience analyzing multi-turn conversation logs for an improved product experience.
- This role is based onsite in Santa Clara, CA.
Job Description
What You'll DoUser Behavior Analysis & Research StrategyBuild and scale quantitative UX methodologies to enhance data-driven decision making across the organizationDesign and conduct quantitative research studies, with a focus on survey design and deployment, and behavioral data analyses to understand user satisfaction, behavior, retention, and AI-engagement patternsPerform user segmentation and clustering analysis to uncover user patterns and product opportunitiesConduct analyses to extract meaningful patterns from complex user interaction dataUser Analytics Measurement & ImplementationEstablish key analytics frameworks, UX and success metrics, to ensure we track and optimize the right signals at launch and beyond towards product-market fitDefine key performance metrics and success indicators for AI assistant performance and user satisfactionCollaborate with Engineering to ensure appropriate tracking and event-logging implementation onto product analytics platforms (e.g., Posthog)User Satisfaction with Conversational AI ExperiencesAnalyze natural language prompts and identify patterns that connect with user satisfaction metricsDemonstrated ability to derive actionable insights from user dialogues in chatbots or voice assistantsExperience in understanding user intent and context by dissecting the sequential (multi-turn) interactions between AI and usersConduct topic modeling on conversational data to identify top use-cases from customersTriangulate explicit signals, such as reported user satisfaction, with user prompts to help inform what makes a good sessionAbility to utilize NLP / LLM tools to assess user satisfaction, identify conversation topics, and derive user needsFlexible mindset and willingness to stay current with fast-evolving LLM / NLP technologies and incorporate them into research workflowsTake advantage of a fast-paced AI ecosystem where you can experiment with new methods and significantly expand your analytical skill setCommunication & CollaborationCollaborate with cross-functional teams to identify and scope research questions that address critical questionsTransform analytical findings into clear, actionable recommendations for product improvementsPartner with qualitative researchers to design comprehensive mixed-methods studiesClear and concise communication of data insights to both technical and non-technical audiencesStrong capability to translate strategic research questions into analytical frameworks and proposed data experimentsQualifications
7+ years of experience working as a quantitative researcher, data scientist, or related roleAdvanced degree (MS / PhD) in Human-Computer Interaction, Statistics, Psychology, Data Science, -Behavioral Economics, or a related discipline2+ years of work experience in data querying languages (SQL), and programming languages for data manipulation (Python or R)Experience in survey methodology (ie. survey design, sampling, and analysis)Experience in analyzing AI conversational data (ie, topic modeling)Experience in statistical analysis (ie. regressions, causal inference, clustering)Experience owning and delivering quantitative research or data science solutions and driving resultsExcellent storytelling and communication skillsSelf-starter and take ownership of your work end-to-endComfortable with open-ended problemsBonus SkillsExpertise in multivariate statistics and the design of experimentsExperience in AI-driven product researchExperience conducting research on productivity tools, personal assistants, or digital planning applicationsWhat's On Offer
Impact at scale?you'll be designing a cutting-edge AI assistant that redefines how people interact with technology to bring value to their lives.A culture of craft and collaboration?we're a tight-knit team of researchers, engineers, and designers, who care deeply about the details.Growth & learning?you'll have the opportunity to push the boundaries of Agentic UX and AI product design.Global collaboration?work alongside teams across Santa Clara, CA, and Pangyo, South Korea, shaping an international AI experience.Competitive Benefits?we are proud to offer extremely competitive benefits that will allow you to flourish in your role while being taken care of.Apply online or feel free to contact us directly for more information about the opportunity. Due to the high volume of applicant, we regret to inform that only shortlisted candidates will be notified. Thank you for your understanding.