Original Research

Investigating the construct validity of an electronic in-basket exercise using bias-corrected bootstrapping and Monte Carlo re-sampling techniques

Jurgen Becker, Deon Meiring, Jan H. van der Westhuizen
SA Journal of Industrial Psychology | Vol 45 | a1582 | DOI: https://doi.org/10.4102/sajip.v45i0.1582 | © 2019 Jurgen Becker, Deon Meiring, Jan H. van der Westhuizen | This work is licensed under CC Attribution 4.0
Submitted: 23 August 2018 | Published: 26 September 2019

About the author(s)

Jurgen Becker, Department of Industrial Psychology, University of the Western Cape, Bellville, South Africa
Deon Meiring, Department of Human Resource Management, University of Pretoria, Pretoria, South Africa
Jan H. van der Westhuizen, xperttech Group, Pretoria, South Africa


Share this article

Bookmark and Share

Abstract

Orientation: Technology-based simulation exercises are popular assessment measures for the selection and development of human resources.

Research purpose: The primary goal of this study was to investigate the construct validity of an electronic in-basket exercise using computer-based simulation technology. The secondary goal of the study was to investigate how re-sampling techniques can be used to recover model parameters using small samples.

Motivation for the study: Although computer-based simulations are becoming more popular in the applied context, relatively little is known about the construct validity of these measures.

Research approach/design and method: A quantitative ex post facto correlational design was used in the current study with a convenience sample (N = 89). The internal structure of the simulation exercise was assessed using a confirmatory factor analytical approach. In addition, bias-corrected bootstrapping and Monte Carlo simulation strategies were used to assess the confidence intervals around model parameters.

Main findings: Support was not found for the entire model, but only for one of the dimensions, namely, the Interaction dimension. Multicollinearity was found between most of the dimensions that were problematic for factor analyses.

Practical/managerial implications: This study holds important implications for assessment practitioners who hope to develop unproctored simulation exercises.

Contribution/value-add: This study aims to contribute to the existing debate regarding the validity and utility of assessment centres (ACs), as well as to the literature concerning the use of technology-driven ACs. In addition, the study aims to make a methodological contribution by demonstrating how re-sampling techniques can be used in small AC samples.


Keywords

Assessment centres; electronic in-basket; Monte Carlo; bias-corrected bootstrapping; small sample analyses; computer-based simulations.

Metrics

Total abstract views: 192
Total article views: 116


Crossref Citations

No related citations found.