Journal of Iranian Public Administration Studies

Journal of Iranian Public Administration Studies

Investigating the Effectiveness of General Competencies Model of Professional Managers in Public-Sector

Document Type : Original Article

Authors
Milad Shams Zare 1
MirAli Seyyednaghavi 2
Vajhollah Ghorbanizadeh 2
Mohammad Afkane 3
1 PhD Student in Public Administration, Department of Public Administration, Faculty of Accounting and Management, Allameh Tabataba'i University, Tehran, Iran.
2 Professor, Public Administration Department, Allameh Tabataba’i University, Tehran, Iran.
3 Assistant Professor, Public Administration and Business Management Department, Faculty of Humanities, Shahed University, Tehran, Iran.
10.22034/jipas.2023.415532.1647
Abstract
The purpose of this research is to investigate the effectiveness of general competencies model of professional managers included in the “Guidelines on how to evaluate and develop general competencies of professional managers” announced by the Administrative and Recruitment Affairs Organization of Iran. For this purpose, by designing and implementing the assessment center for 1616 qualified government employees in three public organizations and analyzing the scores of eight competencies based on the assessment center scores, competency scores, and job performance scores based on the evaluation of direct managers, the required data was collected. The results of internal construct validity, external construct validity, criterion validity of competencies, and the fit of the competency model were analyzed. The results indicate that the current competency model does not have sufficient validity and effectiveness. The competencies of “responsibility” and “organizational commitment and belonging” had the lowest levels of construct validity and criterion validity. “Supervision and control” competence had the highest external construct validity and “analytical thinking and problem solving” competence had the highest criterion validity. At the end, practical, policy and research proposals were presented.
Keywords
Assessment Center
General Competency Model of Professional Managers
Construct Validity
Criterion Validity
Arthur Jr, W., Woehr, D. J., & Maldegen, R. (2000). Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical reexamination of the assessment center construct-related validity paradox. Journal of Management, 26(4), 813-835.
Arthur Jr, W., & Villado, A. J. (2008). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology, 93(2), 435.
Arthur, W., Day, E. A., & Woehr, D. J. (2008). Mend it, don’t end it: An alternate view of assessment center construct-related validity evidence. Industrial and Organizational Psychology, 1(1), 105-111.
Arthur Jr, W., Day, E. A., McNelly, T. L., & Edens, P. S. (2003). A meta‐analysis of the criterion‐related validity of assessment center dimensions. Personnel Psychology, 56(1), 125-153.
Barrick, M. R., Day, D. V., Lord, R. G., & Alexander, R. A. (1991). Assessing the utility of executive leadership. The Leadership Quarterly, 2(1), 9–22. https://doi.org/10.1016/1048-9843(91)90004-L
Bartram, D. (2005). The Great Eight competencies: a criterion-centric approach to validation. Journal of applied psychology, 90(6), 1185.
Bong, M.; & Hong, S. (2010). “Multitrait–Multimethod Designs”, In P. Peterson, E. Baker, & B. McGaw (eds.), (P. Peterson, E. Baker, & B. McGaw, eds.), International Encyclopedia of Education (Third Edition), (pp.111-119),Oxford:Elsevier.Retrievedfrom https://www.sciencedirect.com/science/article/pii/B9780080448947002888
Bott, J. P., Svyantek, D. J., Goodman, S. A., & Bernal, D. S. (2003). Expanding the performance domain: who says nice guys finish last?. The International Journal of Organizational Analysis, 11(2), 137-152.
BPS. (2015). The design and delivery of Assessment Centres. The British PsychologicalSociety.https://www.bps.org.uk/sites/bps.org.uk/files/Member Networks/Divisions/DOP/DOP The Design and Delivery of Assessment Centres.pdf
Byham, W. C. (1970). Assessment center for spotting future managers. Harvard Business Review, 48, 150–160, plus appendix.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.
Campion, M. A., Fink, A. A., Ruggeberg, B. J., Carr, L., Phillips, G. M., & Odman, R. B. (2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64, 225–262. doi:10.1111/j.1744- 6570.2010.01207.x
Connelly, B. S., Ones, D. S., Ramesh, A., & Goff, M. (2008). A pragmatic view of assessment center exercises and dimensions. Industrial and Organizational Psychology, 1, 121–124.
Fleenor, J. W. (1996). Constructs and developmental assessment centers: Further troubling empirical findings. Journal of Business and Psychology, 10 (3), 319–333.
Gaugler Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of applied psychology, 72, 493–511.
Hair, J. et al. (2010) ‘Multivariate Data Analysis.pdf’, Australia : Cengage, p. 758.
Hermelin, E., Lievens, F., & Robertson, I. T. (2007). The validity of assessment centres for the prediction of supervisory performance ratings: A meta‐analysis. International Journal of Selection and Assessment, 15(4), 405-411.
Hoffman, B. J., Kennedy, C. L., LoPilato, A. C., Monahan, E. L., & Lance, C. E. (2015). A review of the content, criterion-related, and construct-related validity of assessment center exercises. Journal of Applied Psychology, 100, 1143–1168.
Hoffman, B. J., Melchers, K. G., Blair, C. A., Kleinmann, M., & Ladd, R. T. (2011). Exercises and dimensions are the currency of assessment centers. Personnel Psychology, 64, 351–395.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6.
Hughes, D., Riley, P., Shalfrooshan, A., Gibbons, A., & Thornton, G. C. III (2012). A global survey of assessment centre practices. Surrey, UK: Assessment & Development Consultants. www.adc.uk.com/resources/library/?resources_page=1&cat[]=16 Accessed August 25, 2023.
International Taskforce on Assessment Center Guidelines. (2015). “Guidelines and Ethical Considerations for Assessment Center Operations”, Journal of Management, Vol. 41. No. 4. PP. 1244-1273.
Jackson, D. J. R., Lance, C. E., & Hoffman, B. J. (2012). The psychology of assessment centers.New York, NY: Routledge.
Jr, J.F.H. et al. (2018) Multivariate Data Analysis. doi:10.1002/9781119409137.ch4.
Kleinmann, M., & Ingold, P. V. (2019). Toward a Better Understanding of Assessment Centers: A Conceptual Review. Annual Review of Organizational Psychology and Organizational Behavior, 6(1), 349–372.
Lance Jackson, D. J. R., Stillman, J. A., & Atkins, S. G. (2005). Rating tasks versus dimensions in assessment centers: A psychometric comparison. Human Performance, 18 (3), 213-241.
Lance, C. E. (2008). Why Assessment Centers Do Not Work the Way They Are Supposed To. Industrial and Organizational Psychology, 1(1), 84–97.
Lance, C. E., Lambert, T. A., Gewin, A. G., Lievens, F., & Conway, J. M. (2004). Revised estimates of dimension and exercise variance components in assessment center post exercise dimension ratings. Journal of Applied Psychology, 89(2), 377-385.
Lance, Charles E.; Newbolt, William H.; Gatewood, Robert D.; Foster, Mark R.; French, Nita R.; & Smith, David E. (2000). “Assessment Center Exercise Factors Represent Cross-Situational Specificity, Not Method Bias”, Human Performance, Vol. 13. No. 4. PP. 323-353.
Lievens, F. (2002). Trying to understand the different pieces of the construct validity puzzle of assessment centers: An examination of assessor and assessee effects. Journal of Applied Psychology, 87(4), 675–686.
Lievens, F. (2008). What Does Exercise-Based Assessment Really Mean? Industrial and Organizational Psychology, 1(1), 112–115. https://doi.org/10.1111/j.1754-9434.2007.00020.x
Lievens, F., & Keer, E. (2001). The construct validity of a Belgian assessment centre: A comparison of different models. Journal of Occupational and Organizational Psychology, 74(3), 373–378.
Meriac, J. P., Hoffman, B. J., & Woehr, D. J. (2014). A conceptual and empirical review of the structure of assessment center dimensions. Journal of Management, 40, 1269–1296.
Meriac, J. P., Hoffman, B. J., Woehr, D. J., & Fleisher, M. S. (2008). Further evidence for the validity of assessment center dimensions: A meta-analysis of the incremental criterion-related validity of dimension ratings. Journal of Applied Psychology, 93(5), 1042- 1052.
Merkulova, N., Melchers, K. G., Kleinmann, M., Annen, H., & Szvircsev Tresch, T. (2016). A test of the generalizability of a recently suggested conceptual model for assessment center ratings. Human Performance, 29(3), 226-250.
Messick, S. (1980). Test validity and the ethics of assessment. American Psychological Association.
Monahan Monahan, E. L., Hoffman, B. J., Lance, C. E., Jackson, D. J., & Foster, M. R. (2013). Now you see them, now you do not: The influence of indicator–factor ratio on support for assessment center dimensions. Personnel Psychology, 66, 1009–1047.
Nako, Z. C., & ARTS, M. in. (2011). Construct validity of a managerial assessment centre [, Citeseer]. EndNote Tagged Import Format.
Putka, D. J., & Hoffman, B. J. (2013). Clarifying the contribution of assessee-, dimension-, exercise-, and assessor- related effects to reliable and unreliable variance in assessment center ratings. Journal of Applied Psychology, 98, 114–133. doi:10.1037/a0030887
Roch, S. G., Woehr, D. J., Mishra, V., & Kieszczynska, U. (2012). Rater training revisited: An updated meta-analytic review of frame-of-reference training. Journal of Occupational and Organizational Psychology, 85, 370-395.
Rupp, D. E., Hoffman, B. J., Bischof, D., Byham, W., Collins, L., Gibbons, A., Hirose, S., Kleinmann, M., Kudisch, J. D., Lanik, M., Jackson, D. J. R., Kim, M., Lievens, F., Meiring, D., Melchers, K. G., Pendit, V. G., Putka, D. J., Povah, N., Reynolds, D.,... Thornton, G. (2015). Guidelines and Ethical Considerations for Assessment Center Operations. Journal of Management, 41(4), 1244–1273.
Sackett, P. R., & Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Reprint: Nr. 228.
 Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040.
SHL (2018). 2018 global assessment trends report.
Shore, T. H., Thornton, G. C., & Shore, L. M. (1990). Construct validity of two categories of assessment center dimension ratings. Personnel Psychology, 43(1), 101–114.
Speer, A. B., Christiansen, N. D., Goffin, R. D., & Goff, M. (2014). Situational bandwidth and the criterion-related validity of assessment center ratings: Is cross-exercise convergence always desirable? Journal of Applied Psychology, 99 (2), 282-295.
Thornton III, G. C., Rupp, D. E., & Hoffman, B. J. (2014). Assessment center perspectives for talent management strategies. Routledge.
Thornton, G. C., & Rupp, D. E. (2006). Assessment centers in human resource management: Strategies for prediction, diagnosis, and development. Mahwah, NJ: Erlbaum.
Thornton, G. C., Rupp, D. E., & Hoffman, B. J. (2015). Assessment center perspectives for talent management strategies (Second edition). Routledge.
Thornton, George C.; Mueller-Hanson, Rose A.; & Rupp, Deborah E. (2017). “Developing organizational simulations: a guide for practitioners, students, and researchers”, (Second Edition), New York London: Routledge, Taylor & Francis Group.
Woehr, D. J., & Arthur Jr, W. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29(2), 231-258.
Zysberg, L. (2012).Assessment center dimensions predict performance-based bonus in business management settings. Psychology, 3, 500–503.

  • Receive Date 22 October 2023
  • Revise Date 03 December 2023
  • Accept Date 10 December 2023