## About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (more importantly) plugins/connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks that require context, judgment, planning, and use of connected tools such as Google Drive, Expedia, Notion, and other plugins/connectors. This role is ideal for people who use AI heavily in their personal lives and can do a better job replicating what AI could do if it weren’t available ## What You’ll Do You will help evaluate AI systems on complex personal workflows, including tasks across: - Personal health - Travel - Activity planning, including food and dining - Services, such as home repair - Career search - Other life organization workflows Responsibilities may include: - Creating realistic prompts for complex personal-life tasks - Executing tasks and actions while recording your screen (required) - Using your personal plugins/connectors while you complete actions - Writing clear explanations of AI successes and failures - Judging whether AI outputs are practical, personalized, and well-reasoned - Identifying where models miss context, overreach, fail to use tools correctly, or produce unrealistic results - Creating and applying detailed rubrics to assess model performance ## Who We’re Looking For Strong candidates will have: - US-based only - Strong MCP experience and plug in / connector usage - Experience using LLM plugins/connectors such as Google Drive, Expedia, Notion, and similar tools, multiple times a week - Heavy personal usage of LLM products - An active, rich LLM account with regular usage and approximately 6+ months of history - **Willingness to sign a data-share consent form via DocuSign** - Experience using AI for multi-step planning, research, decision-making, or personal workflows - Strong written judgment and attention to detail - Ability to explain what makes an AI output good, bad, incomplete, unsafe, or unrealistic - Experience writing and evaluating against rubrics Extensive rubric experience is especially valuable, including 100+ hours on prior rubric projects involving rubric design, evaluation, and quality assessment. ## Ideal Candidate Profile The strongest candidates are LLM power users who are already using plug-in tools in their personal lives for high-context tasks such as trip planning, health research, home services, food and dining decisions, career planning, personal organization, or similar workflows. Candidates who want to be more competitive for this and future opportunities are encouraged to proactively spend time learning MCP and using LLM plugins/connectors before applying. ## Why This Work Matters LLMs are quickly becoming personal assistants for everyday decisions, but truly useful AI needs to do more than produce generic advice. It needs to understand context, preferences, constraints, tradeoffs, and what success looks like in real life. Your evaluations will help improve how AI systems support people with practical, high-context tasks across food, health, travel, productivity, careers, and life organization. This work directly contributes to making AI assistants more personalized, trustworthy, and useful for real-world personal workflows. ## Engagement Details - Expected commitment: 20+ hours/week - Ramp-up: 1–2 days required - Turnaround expectation: Ability to complete tasks within 24 hours - Equipment: Desktop or laptop required; Chromebooks are not supported - Experts added to the project will begin in a trial period to assess project fit, quality, and consistency before being considered for ongoing tasking. - Please note: This project is still in its early stages, so there may be an initial delay before tasking begins.
Remote MCP & Plug In Connectors Expert - AI Trainer ($50-$190 per hour) • Scranton, Pennsylvania, US
Start a Fulfilling Caregiver Career With Comfort Keepers.Becoming a Comfort Keepers in-home caregiver is a great way to make a difference in the lives of seniors and their families and to make a po... Show more
Principal Compliance Specialist.The Principal Compliance Specialist serves as the organization's subject matter authority for a defined regulatory domain or program area, independently managing com... Show more
This position primarily reports in person to our Scranton office and may require travel between clinics as needed.Ideal candidates would be local or willing to relocate upon offer.The Credentialing... Show more
Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more
Find Your Passion and Purpose as a Caregiver.Reimagine Your Career in Home Care.As a medical professional, you know that what you do impacts you as much as your clients and their families, and at A... Show more
Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more
Professional Coding Auditor And Educator - Remote This role focuses on activities related to revenue cycle operations such as billing, collections, and payment processing.In addition, this role foc... Show more
Home Helpers Home Care Caregiver Position.At Home Helpers Home Care, we believe meaningful work and strong relationships are just as important as the care we provide.We're looking for compassionate... Show more
Home Helpers Home Care Caregiver Position.At Home Helpers Home Care, we believe meaningful work and strong relationships are just as important as the care we provide.We're looking for compassionate... Show more
We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more
Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more
Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more
Access Services is seeking to contract with licensed professionals (LCSW, LPC, and LMFT) certified in the state of Pennsylvania to provide services to children and families across eastern Pennsylva... Show more
Practice Solutions ConsultantAt Rectangle Health, we believe that our team members are our most important asset.We grow our team by hiring best-in-class talent.We encourage all employees to contrib... Show more
Direct Support Professional - DSP.We're hiring Direct Support Professionals to provide compassionate, hands-on care to individuals in our residential programs across Pennsylvania.As a DSP, you'll e... Show more
We're currently seeking motivated individuals to participate in online surveys and paid gaming opportunities for well-known national brands.If you're looking for a flexible way to earn extra cash f... Show more
Leads and develops teams effectively by teaching, training, and actively listening to associates touring stores and providing feedback.TourtoTeach, communicate, and collaborate with all levels of a... Show more
Luke's University Health Network.Luke's is proud of the skills, experience and compassion of its employees.Luke's are our most valuable asset! Individually and together, our employees are dedicated... Show more
Direct Support Professional - DSP.Position at Clarvida - Pennsylvania.Job Title: Direct Support Professional - DSP Location: Pennsylvania Employment Type: Full-time Salary: $16.About the Role We're... Show more
Join Help at Home as a Direct Support Professional (DSP) and make a meaningful difference in your community.You will provide one-on-one support to individuals with intellectual and developmental di... Show more
