HirePortal

AI Agent Power User

Role Title: AI Agent Power User

Role Type: Contract

Location: Remote (US, CA, UK, IE, AU, NZ)

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  • Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows.
  • Document each step, highlighting where AI performance aligns with or diverges from realistic business needs.
  • Evaluate and score AI-generated outputs using specified rubrics and criteria, focusing on quality, completeness, and relevance.
  • Draft clear, constructive, and actionable feedback based on rubric findings to inform AI research and product teams.
  • Identify recurring patterns in AI behavior—strengths, weaknesses, and opportunities for process improvement.
  • Connect AI tools to frequently used workplace platforms (e.g., Google Drive, Gmail, Slack, Notion) to mirror authentic use cases.
  • Maintain meticulous written records and communicate findings in professional English, ensuring transparency and reproducibility.

Preferred Qualifications

  • 5+ years of professional experience in any business function, utilizing technology to solve operational challenges.
  • Completed Bachelor’s degree or higher in any discipline.
  • Consistent, hands-on daily use of ChatGPT and/or Claude for actual work, not just experimentation.
  • Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines (academic, QA, hiring, or annotation experience strongly valued).
  • General comfort integrating AI tools with business software and productivity platforms.
  • Demonstrated excellence in written English, with a focus on clear, actionable documentation and feedback.
  • Authorized for contract work and based in the US, Canada, UK, Ireland, Australia, or New Zealand (US strongly preferred).

Skills

  • Prompt Engineering
  • AI Evaluation
  • ChatGPT
  • Claude
  • Documentation
  • Business Process Analysis
  • API Integration

Related jobs

Xperteez TechnologyApply for this job