AI Training Subject Matter Expert — Accounting

We are seeking highly skilled Subject Matter Experts in accounting and bookkeeping to participate in an intensive, two-week pilot campaign centered on AI model evaluation, task design, and objective grading framework development.

The primary goal of this campaign is to challenge and benchmark next-generation AI models by designing complex, highly realistic, domain-specific tasks. Experts will craft workflows requiring multi-step web research, data extraction, and deep professional reasoning to evaluate model performance and establish scoring criteria.

This is a full-time commitment for the duration of the contract.

Key Responsibilities
Complex Prompt Creation: Craft detailed, highly realistic scenario prompts rooted in actual accounting workflows — reconciliation and month-end close, AR/AP management, payroll processing, BAS/tax preparation, financial statement review, chart-of-accounts restructuring, and multi-entity reporting in QuickBooks.

AI Model Testing: Execute prompts directly within the AI platform to surface failure modes, hallucination triggers, and reasoning gaps. Continuously iterate and escalate task complexity to rigorously evaluate performance.

Rubric & Checklist Authoring: Write objective, self-contained scoring checklists and rubrics supported by explicit reference sources and justifications so peer reviewers can grade AI outputs consistently.

Requirements & Eligibility
- Domain Expertise: 5+ years professional experience in accounting or bookkeeping.
- Platform Expertise: 3–4 years hands-on QuickBooks experience.
- AI Training Experience: Hands-on experience creating complex prompts, evaluating LLM outputs, and constructing detailed evaluation rubrics.
- Language: Professional English fluency (written and spoken).
- Availability: Full-time availability across the full two-week campaign.
- Device Security: Work must be conducted exclusively on secure personal or corporate devices. Access via public or shared computers is strictly prohibited.