Frontend Code Evaluator - Expert
Budget / Salary$90–90
TypeContract
LocationAustria
Posted2 hours ago
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Frontend Engineer — Web Replication Preference Rater
Type:Contract
Compensation:$90/hour
Location:Remote
Role Responsibilities
Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid.
Write structured rationales for every judgment, ranking defects by importance in precise language.
Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
3+ years of professional web development experience, primarily in frontend or full-stack work.
Fluency in hand-written HTML and CSS.
Working command of browser devtools.
Enough JavaScript to read scripts and understand DOM manipulation.
Comfort in a terminal for local server setup.
Strong written English and discipline to justify judgments.
Preferred
Prior RLHF, preference labeling, or model evaluation work.
Code review or technical assessment background.
Pixel-perfect design-to-code experience.
Web accessibility expertise (WCAG, ARIA).
Familiarity with LLMs' typical failures in codegen.
Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Frontend Engineer — Web Replication Preference Rater
Type:Contract
Compensation:$90/hour
Location:Remote
Role Responsibilities
Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid.
Write structured rationales for every judgment, ranking defects by importance in precise language.
Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
3+ years of professional web development experience, primarily in frontend or full-stack work.
Fluency in hand-written HTML and CSS.
Working command of browser devtools.
Enough JavaScript to read scripts and understand DOM manipulation.
Comfort in a terminal for local server setup.
Strong written English and discipline to justify judgments.
Preferred
Prior RLHF, preference labeling, or model evaluation work.
Code review or technical assessment background.
Pixel-perfect design-to-code experience.
Web accessibility expertise (WCAG, ARIA).
Familiarity with LLMs' typical failures in codegen.
Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Apply on Himalayas →
Job sourced from Himalayas. Applications happen directly on the original platform — we never collect your data.