Certiverse AI Psychometrician Remote · Full time

The ideal candidate will have deep expertise in operational psychometrics, experience researching AI applications in measurement, and the ability to develop proof-of-concept software solutions in Python or similar languages. This position requires a balance between rigorous scientific research, practical application, and the implementation of innovative solutions to enhance our assessment systems

Description

Key Responsibilities:

· Conduct and support psychometric analyses related to test development, calibration, scaling, equating, and validation studies.

· Research AI-related applications in psychometrics, including machine learning techniques and automated assessment models.

· Develop and implement proof-of-concept software solutions in Python or other relevant programming languages.

· Collaborate with cross-functional teams, including data scientists, engineers, and exam development specialists, to integrate psychometric models into operational processes.

· Ensure the delivery of high-quality outcomes through rigorous methodology, innovative thinking, and attention to detail.

· Adapt to evolving research and business priorities while maintaining a flexible and goal-oriented approach.



Required Qualifications:

· Master’s or PhD in psychometrics, I/O psychology, educational measurement, statistics, or an aligned field.

· Strong programming skills in Python or similar languages.

· Strong analytical skills in R.

· Experience with AI-related research in measurement, such as machine learning applications in assessment.

· Proficiency in psychometric methodologies such as classical test theory (CTT), item response theory (IRT), equating, test form assembly, standard setting, item/form analysis, automated item generation, test security analysis, report writing, and bias and fairness analysis.

· Demonstrated ability to work both independently and collaboratively in a distributed, dynamic team environment.

· Strong problem-solving skills, attention to detail, customer-focus, and commitment to high-quality outcomes.



Preferred Qualifications:

· A strong desire to make a better future where assessments are high-quality and unbiased while also being hyper efficient and accessible.

· At least 2-5 years of experience in applied psychometrics, preferably in an operational testing environment.

· Experience in researching and/or implementing AI-driven innovations in assessment.

· Familiarity with large-scale assessment programs and operational constraints.

· Experience implementing automated scoring algorithms or adaptive testing models.