About the Role:
We are looking for a QA Analyst to focus on evaluating the accuracy and logic of AI-generated grading and feedback for student assignments. This role does not require subject-matter expertise but demands strong logical reasoning skills to assess whether the grading aligns with the provided instructions. The ideal candidate should be able to analyze grading outputs and determine if they make sense based on submission details and TA guidelines.
About the Project:
Our customer is an education technology company that offers a hybrid human-machine intelligence solution, enabling educators to analyze and assess student work more efficiently. By leveraging artificial intelligence, the platform helps provide personalized feedback and adaptive learning experiences.
The customer describes itself as the world’s first AI-driven solution that identifies patterns in student submissions, allowing scalable and personalized education to go hand in hand. The platform is primarily used for Computer Science and STEM courses with high enrollments, making open-ended assignments as practical as multiple-choice questions.
The AI processes student responses in two key steps:
- Pattern Recognition – Algorithms analyze submissions and cluster them into 5-10 solution types.
- Educator Feedback – Teachers review and provide feedback to each solution type, significantly reducing grading time while improving accuracy and personalization.
This platform enables large-scale courses to maintain high-quality personalized education, offering a revolutionary approach to grading, adaptive learning, and student engagement.
What You Will Do:
- Review AI-generated grading and feedback to ensure alignment with provided instructions.
- Identify inconsistencies or errors in automated evaluations.
- Work closely with AI developers to refine grading accuracy.
- Document findings and provide structured feedback for system improvements.
- Maintain a logical and detail-oriented approach to quality assurance.
- Collaborate with the existing QA team to integrate AI evaluation processes.
What We Expect from You:
- Strong logical reasoning and analytical skills.
- Attention to detail in reviewing AI-generated outputs.
- Good written communication skills in English.
- Ability to work independently and provide structured feedback.
Preferred:
- Prior experience in quality assurance or educational technology is a plus but not required.
- Experience working with AI-driven applications.
- Familiarity with grading or assessment processes in education.
What We Offer:
- The opportunity to work on an innovative educational project.
- Flexible schedule and remote work options.
- Competitive compensation and professional growth opportunities.
- A supportive team that values quality and collaboration.
Join our team and help shape the future of AI-powered education by ensuring accurate and meaningful grading experiences for students worldwide!