## About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (more importantly) plugins/connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks that require context, judgment, planning, and use of connected tools such as Google Drive, Expedia, Notion, and other plugins/connectors. This role is ideal for people who use AI heavily in their personal lives and can do a better job replicating what AI could do if it weren’t available ## What You’ll Do You will help evaluate AI systems on complex personal workflows, including tasks across: - Personal health - Travel - Activity planning, including food and dining - Services, such as home repair - Career search - Other life organization workflows Responsibilities may include: - Creating realistic prompts for complex personal-life tasks - Executing tasks and actions while recording your screen (required) - Using your personal plugins/connectors while you complete actions - Writing clear explanations of AI successes and failures - Judging whether AI outputs are practical, personalized, and well-reasoned - Identifying where models miss context, overreach, fail to use tools correctly, or produce unrealistic results - Creating and applying detailed rubrics to assess model performance ## Who We’re Looking For Strong candidates will have: - US-based only - Strong MCP experience and plug in / connector usage - Experience using LLM plugins/connectors such as Google Drive, Expedia, Notion, and similar tools, multiple times a week - Heavy personal usage of LLM products - An active, rich LLM account with regular usage and approximately 6+ months of history - **Willingness to sign a data-share consent form via DocuSign** - Experience using AI for multi-step planning, research, decision-making, or personal workflows - Strong written judgment and attention to detail - Ability to explain what makes an AI output good, bad, incomplete, unsafe, or unrealistic - Experience writing and evaluating against rubrics Extensive rubric experience is especially valuable, including 100+ hours on prior rubric projects involving rubric design, evaluation, and quality assessment. ## Ideal Candidate Profile The strongest candidates are LLM power users who are already using plug-in tools in their personal lives for high-context tasks such as trip planning, health research, home services, food and dining decisions, career planning, personal organization, or similar workflows. Candidates who want to be more competitive for this and future opportunities are encouraged to proactively spend time learning MCP and using LLM plugins/connectors before applying. ## Why This Work Matters LLMs are quickly becoming personal assistants for everyday decisions, but truly useful AI needs to do more than produce generic advice. It needs to understand context, preferences, constraints, tradeoffs, and what success looks like in real life. Your evaluations will help improve how AI systems support people with practical, high-context tasks across food, health, travel, productivity, careers, and life organization. This work directly contributes to making AI assistants more personalized, trustworthy, and useful for real-world personal workflows. ## Engagement Details - Expected commitment: 20+ hours/week - Ramp-up: 1–2 days required - Turnaround expectation: Ability to complete tasks within 24 hours - Equipment: Desktop or laptop required; Chromebooks are not supported - Experts added to the project will begin in a trial period to assess project fit, quality, and consistency before being considered for ongoing tasking. - Please note: This project is still in its early stages, so there may be an initial delay before tasking begins.
Remote MCP & Plug In Connectors Expert - AI Trainer ($50-$190 per hour) • Harrisburg, Pennsylvania, US
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
A facility in Camp Hill, PA is seeking its next amazing Rad Tech.Read on if this sounds like your perfect fit!Nurses and allied healthcare professionals are in high demand nationwide, and our team ... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Data Migration And Implementation Lead.Lead the data migration and implementation projects for Employee Central and S/4 system.Develop and maintain data governance policies and procedures to ensure... Show more
ASIC Design for Test EngineerWork Location :PA Telecommuting or Baltimore, Mooresville, NCDuration :12 Months +9 / 80 Work ScheduleDescriptionLooking for a DFT (Design for Test) engineer to join ou... Show more
Job Title :SAP FI / CO, FM & PS SMELocation :Middletown, PA (Remote; may shift to hybrid -- only candidates within 1.Duration :6 MonthsOverviewNavitas Partners, LLC is seeking a senior SAP FI /... Show more
Please go through the job description given below and if you are interested do share an updated word copy of your resume and best time to reach you over the phone.Position :IAM Developer / Speciali... Show more
Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Classification Analyst needed for a contract opportunity with SOC's client to work remotely in the US.Responsibilities :Obtain drawings directly or by coordinating with Procurement.Review d... Show more
We are looking for caring, compassionate, and energetic DSPs to provide supportive living to individuals in assisting them in daily living and personal care services.Transport and accompany individ... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
AI Developer Dauphin County, PA Remote 6 months Extension Please do not submit profiles of candidates who are not local to Pennsylvania (PA).Candidates with prior experience working for State Gover... Show more
Director, Data Analysis - Software (Remote)Ever since our first credit card customer in 1994, Capital One has recognized that technology and data can enable even large companies to be innovative an... Show more
Advanced Electronics / Computer Field (ET/FC).The Advanced Electronics and Computer Field trains Sailors to maintain, operate, and repair some of the Navy’s most sophisticated electronics and compu... Show more
We're Hiring Direct Support Professionals.Full-Time & Part-Time Positions Available $16.Pay based on experience & education.Do you enjoy helping others, building meaningful relationships, and makin... Show more
Certified Nursing Assistant - CNA.Certified Nursing Assistant (CNA) - Join Our Family at The Manor at Penn Village!.Job Type: Full-Time/Part-Time/PRN.At the Manor at Penn Village, we believe our re... Show more
Job DescriptionDo you have a passion for gaining a comprehensive understanding of software programs? As a Security Researcher 4, you will collaborate with fellow researchers on the software assuran... Show more
