Senior Psychometrician

Overview

Job Description

Responsibilities

• - Lead psychometric oversight for AI-evaluation tools, including automated scoring of open-ended questions, AI testing, and candidate recommendation models
• - Collaborate with data scientists and engineers to design, validate, and monitor AI-powered scoring systems and candidate evaluations for fairness, transparency, and predictive validity
• - Contribute to assessment innovation while maintaining scientific integrity and compliance with legal and ethical standards
• - Integrate various aspects of psychometric science to provide cohesive, high-quality solutions
• - Lead and execute scientific studies in psychometrics, including reliability and fairness analyses of assessments
• - Act as the primary expert and point of contact for psychometric rigor in the team, while mentoring the existing team member
• - Collaborate with data scientists, engineers, and product managers to embed psychometric principles effectively in our AI-first platform
• - Uphold TestGorilla's behaviors and foster an inclusive, supportive culture
• - Collaborate effectively with global colleagues across teams and time zones

Required Skills

• - Passionate about TestGorilla's mission to help one billion people find their dream jobs
• - Strong written and verbal communication skills in English
• - Thrives in a fast-paced, remote-first environment
• - Skills and experience with psychometric applications in AI/ML environments
• - Strong expertise in psychometrics, with hands-on experience in designing, validating, and improving assessments
• - Familiarity with algorithmic fairness principles and the ability to apply statistical and psychometric techniques to evaluate bias in AI systems
• - Capability to ''bring it all together'', integrating different aspects of psychometric theory and practice to support business and product goals
• - Ability to work independently, handling responsibilities reliably without requiring extensive oversight

Benefits

• - Join a fully remote, mission-driven team from around the world
• - Competitive compensation with Share Appreciation Rights (SARs)
• - Remote & flexible work with flexible hours and asynchronous work
• - Remote work budget: €1,000 available each year or up to €2,000 from day 1 if you're buying a laptop
• - Growth & development with a 3.5% L&D budget and clear growth opportunities
• - Stimulating work environment with innovative technology
• - Connect with your team through optional fun virtual socials, AMAs with team members and leadership, and regular fun chats
• - TestGorilla community groups for connection, advocacy, and professional development
• - Parent/Caregiver support with paid 8-16 week parental leave and tailored return-to-work approaches
• - Work-life balance with unlimited and flexible time off policy