Assessment Scientist / IO Psychologist

Assessment Scientist / IO Psychologist


I’m Kim, the Head of Assessments at TestGorilla. We’re a fast-growing HR tech startup that helps teams make better, faster and more objective hiring decisions.

Over the past year, we’ve experienced tremendous growth. More than 7,500 companies have replaced CVs with our assessments to screen candidates in an objective and data-driven way.
As we scale our efforts in 2022 and beyond, we’re looking for an Assessment Scientist / IO Psychologist who’s passionate about joining our quest to help people land their dream jobs.

What’s in it for you?

  • Helping shape a fast-growing HR tech startup as an early employee
  • Fully remote position with bright, motivated, and friendly colleagues around the world 
  • Competitive salary + share appreciation rights (SARs) commiserate with an early employee
  • Flexible hours and vacation
  • Paid parental leave 
  • Remote working budget: €1,000 per year
  • Learning and development budget: 3.5% of salary per year

The job in a nutshell

We are looking for open-minded, tech-savvy professionals to assist in the ongoing development of our assessment products. As an Assessment Scientist / IO Psychologist, you will work directly with TestGorilla’s core offering: our assessments and test instruments. 

You will collaborate with cross-functional teams and interdisciplinary experts around the globe to enhance, innovate, scale and accelerate our assessment and test development. You will ensure that our existing and future psychometric and skills-based assessments are robust, fit for purpose, psychometrically sound, empirically grounded, and legally defensible. In addition to developing reliable, valid, and fair tests, and enhancing our tools and methodologies, you will perform validation, adverse impact and/or DIF studies and maintain appropriate industry standard documentation. 

You will bring innovation, creativity and deep subject matter expertise in psychometric testing which will support us to expand into new and related domains such as exploring new constructs, models and methods of assessment, innovations in test development, and novel ways to generate and capitalize on data-driven insights and analytics.

This is an amazing opportunity to contribute to the innovation and development of talent assessment products within TestGorilla’s portfolio and join the team shaping and creating the future of hiring.

You’ll spend time on the following:

  • Proactively identifying innovation and enhancement opportunities including leveraging new technologies, models, constructs, data collection, research, validation or technical aspects to increase our competitive advantage and ensure efficient and streamlined delivery
  • Leading the development of new and enhanced test instruments including cognitive ability, personality and culture, situational judgment, role-specific skills and job skills (e.g. language, software, programming) which may include activities such as:
    • analyzing and interpreting quantitative data and qualitative feedback
    • creating item content and providing design input
    • advising on scoring and analytic methods
    • generating report content and display logic
    • conducting research and job analysis
    • validating the predictive properties of tools 
    • producing robust technical documentation
  • Leading customized psychometric analyses including validation, adverse impact, differential item functioning (DIF), and item and model fit that ensure compliance with industry standards for security, validity, reliability, fairness and defensibility
  • Supporting data collection, test and item-level data analysis (classical and IRT) activities including item bank design, calibration, test scoring and equating, scaling, and other relevant psychometric and maintenance activities
  • Collaborating with interdisciplinary and international colleagues including Test Development, Product, Engineering and other teams to analyze and solve problems, contribute insights and best practices and ensure our platform offers a bias-free, compliant and accurate experience
  • Conceptualizing new approaches and alternative routes including new models, constructs, test design and modes of administration and implementing pragmatic solutions, methods and techniques that ensure quality, growth, scalability, and are suitable for a production environment handling high-volumes of data
  • Keeping up to date with relevant research and developments, sharing latest thinking and advancements, and providing thought leadership and support internally and externally when needed as a ‘go-to’ expert in your field

Here’s what we are looking for:

  • You are inspired by our mission to put one billion people in dream jobs
  • You are fully aligned with our values 
  • You are passionate about digital solutions, HR tech and recruitment trends, are eager to revolutionize tests and assessments, combined with proven psychometric assessments 
  • You have advanced knowledge of industry trends, innovations and best practices in the areas of computer-based testing, job analysis, psychometric assessment, reporting, and data analysis, for high stakes and volume assessment, and screening and hiring purposes
  • You have applied experience in developing assessment instruments,  measurement and test theory (classical, IRT, CAT) with knowledge of computer-based test construction and development
  • You have experience in research design and statistical analysis and have performed a variety of validity and/or adverse impact studies and are comfortable using a variety of analytic tools (e.g., Excel, SPSS, SAS, R, Python, IRT software) 
  • You make empirically driven decisions and you are not afraid to challenge the industry status quo or best practices
  • You have experience summarizing complex technical information and data into compelling stories and communicating to high-level, non-technical audiences
  • You are comfortable with and excited by a fast-paced, agile, iterative environment and prefer a degree of ambiguity rather than strict and defined processes 
  • You are a creative problem-solver, can anticipate needs and proactively work to accomplish future goals, and have a flexible, positive, can-do attitude
  • You are motivated by new challenges, breaking new ground, dealing with complexity, and you are willing to fail fast or try non-traditional approaches
  • You have experience successfully delivering in a remote, asynchronous, multicultural work setting and you are comfortable working with a team spread across the globe and in different timezones 
  • You are comfortable with the ambiguity and pace of iteration of a hyper-growth HR tech startup

We typically expect candidates with PhD-level understanding in industrial organizational psychology, business psychology, psychometrics, occupational psychology, educational measurement, cognitive science or a related discipline to have the skills mentioned above.

Bonus points if…

  • You have experience working in a SaaS company and a fast-growing startup
  • You have operated within a corporate, product design/development, consulting or professional services environment
  • You have knowledge of EEOC, ADA, GDPR, and other regulatory guidelines, frameworks and evolving legislation relevant to our field
  • You have experience with new and emerging technologies in assessment (e.g. FC-IRT, mobile-first, gamification, AI/ML)

About TestGorilla

At TestGorilla, we envision a world where everyone has their dream job. To achieve this, employers and employees need to have the right information about each other. 

We started in 2020 by building a screening platform that enables employers to evaluate candidates in the skills that matter most for success in a role. Our product replaces subjective, incomplete, and often inflated CVs with objective, reliable, and fair test results measuring aptitude, practical job skills, motivation, and culture add.

Improving and expanding this platform is currently our core focus, but it’s only the beginning of our journey to get everyone their dream job. Over time, we will launch more products that support this mission.

We have procured $70m in Series A funding from the venture-capital firms Atomico and Balderton Capital, and our growth is on target to continue exponentially. Chances are you’re familiar with some of our biggest customers, like Sony, PepsiCo, H&M, Deloitte, Bain & Company, Oracle, Revolut, and the UK’s National Health Service.

We work remotely, spread across the Americas, Europe, Asia, and Africa.


We don’t offer rainbow glitter unicorns or dog-friendly offices (we literally don’t have an office), but we do offer real people, solid core values, and a product meant to give everyone a fair, unbiased chance at their dream jobs.

Here at TestGorilla, we eat our own dog food. We use our assessment platform to make sure we make the best hiring decisions faster and bias-free. 

So if this role sounds like a good fit for you, I’d like you to apply by taking this assessment. This will take about an hour and will focus on your soft and hard skills required to succeed in this role. It’s also a great opportunity for you to get to know our product!

If you’re hired, I’ll do everything I can to help you succeed at TestGorilla and throughout the rest of your career!

departments: Test development
employment types: Full Time
job locations: 100% Remote