AI Evaluation & Quality Review Experts Needed

Freelance Government Domain Experts – AI Evaluation & Quality Review

Project ID: Government Skills Hillclimbing
Engagement Type: Freelance / Short-Term Contract
Experience Required: 2+ years of relevant professional experience
Location: US-based candidates or India-based candidates with relevant US experience
Platform: Ulabel
Openings: 2–3 resources per expert cohort, subject to final confirmation

Project Overview

We are seeking experienced professionals with specialized knowledge of US government processes, regulatory compliance, eligibility documentation, or public-sector procurement to support a short-term AI evaluation pilot.

The project involves researching authoritative sources, developing human-authored reference cases and expected answers, evaluating AI-generated responses, and reviewing peer work for accuracy, consistency, and quality.

This is a freelance project opportunity, not an employment position or government appointment. The engagement does not authorize participants to make decisions on behalf of government agencies.

Open Expert Cohorts

1. Public Records, FOIA & Privacy Compliance Auditors

Focus: Automated redaction testing and privacy compliance auditing.

Responsibilities:
- Review public records and assess document redaction accuracy.
- Verify whether sensitive information, including personally identifiable and protected health information, is appropriately handled.
- Research applicable legal requirements and statutory exemptions using authoritative sources.
- Develop reference cases and expected answers for evaluating AI-generated redaction decisions.
- Identify errors and provide evidence-based explanations and corrections.

Preferred Experience:
- FOIA and public records compliance.
- Privacy auditing, information governance, or legal document review.
- Hands-on experience with document redaction and relevant US privacy regulations.
- Ability to cite applicable legal provisions accurately.

2. Government Intake & Eligibility Caseworkers

Focus: Government application document extraction, cleanup, and validation.

Responsibilities:
- Review application documents and supporting evidence for completeness and consistency.
- Create reference cases for testing AI-based document extraction and validation.
- Identify missing information, conflicting details, mathematical inconsistencies, and potential data extraction errors.
- Evaluate AI performance on handwritten, distorted, incomplete, and multi-page documents.
- Document findings and provide clear, evidence-based feedback.

Preferred Experience:
- Government benefits administration or eligibility casework.
- Public assistance, social services, or application processing.
- Document verification, income validation, or case management.
- Familiarity with US government eligibility workflows.

3. Government Procurement & RFP Evaluators

Focus: Vendor proposal scoring and evaluation against structured rubrics.

Responsibilities:
- Review government RFPs, vendor proposals, technical submissions, and cost sheets.
- Apply predefined scoring criteria consistently and objectively.
- Compare vendor responses against stated requirements.
- Develop reference evaluations and expected scoring justifications.
- Review AI-generated scores and identify unsupported conclusions, inconsistencies, or evaluation errors.

Preferred Experience:
- Government procurement and public-sector sourcing.
- RFP evaluation, contract management, or proposal assessment.
- Technical bid evaluation and cost analysis.
- Experience writing defensible, evidence-based scoring justifications.

General Eligibility Requirements

- At least 2 years of relevant professional experience.
- US-based candidates or India-based professionals with relevant US experience.
- Strong analytical reasoning, research, and written communication skills.
- Ability to identify and verify authoritative sources.
- Attention to detail and commitment to objective, evidence-based evaluations.
- Availability for the short pilot engagement.
- Willingness to work through the Ulabel platform and follow project guidelines.
- Ability to review feedback and maintain the required quality standards.

Project Duration & Workload

- Indicative task effort: 2 hours for editing and 1 hour for review; the final AHT and task allocation will be confirmed by the project team.
- Actual workload and task assignments will depend on the pilot requirements.

Compensation & Payment

Compensation will be discussed with shortlisted candidates based on relevant experience, expertise, and agreed project terms.

Important: Only tasks that satisfy the project's defined quality criteria will be considered for payment. Candidates should review the acceptance criteria and payment terms before commencing work.

Application Process

Interested professionals should submit:

1. An updated resume or CV.
2. A LinkedIn profile URL.
3. Their relevant expert cohort.
4. A brief summary of directly relevant professional experience.
5. Current location and details of relevant US experience, where applicable.
6. Expected hourly rate and currency.
7. Immediate availability and confirmation of availability for the project period.

Please apply only if your professional experience closely matches one of the specialist cohorts listed above.

This is a short-term pilot, with the possibility of additional freelance project opportunities following successful completion. Future opportunities are not guaranteed.