AI Evaluator

Job Description

Requirements

• Have completed a Bachelor's degree or higher in English or Literature.
• Fluency in English at C1/C2 level.
• Excellent English grammar and comprehension.
• A critical eye and the ability to clearly explain the strengths and weaknesses of a given piece of text.
• Excellent sense of writing style.
• At least 2 years of experience in a creative writing role.
• Experience working with NLP/GenAI models is an added advantage.
• Strong critical thinking, reasoning, and exceptional problem-solving skills.
• Excellent written and oral communication skills.
• Demonstrable ability to perform well in a rapidly changing and extremely global team.
• Excellent attention to details.
• Passion for our mission of ensuring a world-class support experience for our community and customers.
• Experience as an editor is an added advantage.
• Application Process: Once you’re part of our talent pool, here’s what you can expect during the interview process: After submitting your application, if you're shortlisted, we’ll invite you to a 60-minute in-person/ virtual assessment.
• If you pass the assessment, we’ll let you know via email.
• Once a project is ready to go live, those who’ve passed will be invited to training (this can happen anywhere from a few days to a few weeks after the assessment, depending on the project timeline)
• Kindly note that a valid Police Clearance Certificate (Certificate of Good Conduct) is a mandatory requirement for consideration into training.
• We’ll provide helpful feedback along the way so you know where you stand and feel supported throughout the entire process.
• About Sama Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott.
• We’re experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models.
• Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and s.

Responsibilities

• Write detailed top-tier original content that demonstrates great creativity and an excellent grasp of English grammar and comprehension.
• Evaluate, edit, and improve the quality of AI-generated writing as well as that from humans-in-the-loop.
• Rate the quality of AI-generated content on rubrics such as grammar, brevity, and correctness.
• Be a thought partner to Delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
• Deliver just-in-time coaching/mentorship support to production teams on new or changing project instructions as well as “refreshers” on existing instructions on an as-needed basis.
• Manage investigations of escalations to understand the root cause(s), work through the remediation actions, and champion the recovery process.
• Manage the performance and quality of your team through coaching and mentoring to improve writing quality.
• Be a master of the Sama platform.

Benefits

• Sama offers competitive compensation commensurate with experience and a full benefits package, including: medical, dental, and vision insurance, long-term disability insurance, life, and AD&D insurance, employer-matching Group RRSP, generous holiday and vacation policies, a monthly fitness stipend, monthly cell phone reimbursement and professional development opportunities.
• Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.
• At Sama, we pride ourselves in being a diverse and equal opportunity employer.