Internet Gaming Disorder Test (IGDT-10): a reliability generalization meta-analysis

Internet Gaming Disorder Test (IGDT-10): a reliability generalization meta-analysis

Main Article Content

Sergio Hidalgo-Fuentes

Abstract

Although video game use is not inherently negative, a small percentage of players may develop pathological video game use with characteristics similar to other types of addictive behaviors. Internet gamind disorder has been increasingly interest over the last decade. Since its inclusion in the 5th Edition of Diagnostic Statistical Manual, numerous measures have been developed using the DSM-5 criteria, including the Internet Gaming Disorder Test (IGDT-10). The purpose of this work is to carry out a reliability generalization meta-analysis of the IGDT-10 by means of which to estimate the reliability of this instrument. PsycINFO, PubMed, Web of Science and Scopus were searched and a total of 29 papers were included in this meta-analysis. The pooled reliability of the IGDT-10 is α =.81 for the Likert-type version and α =.72 for the version with dichotomized scores. Analyses of risk of publication bias were nonsignificant. The present work shows how the IGDT-10 presents an adequate reliability for its use for research purposes. The limitations of the study are presented.

References

Las referencias con un asterisco (*) se encuentran incluidas en el meta-análisis de generalización de la fiabilidad.

*Akbari, M., Bahadori, M. H., Khanbabaei, S., Milan, B. B., Horvath, Z., Griffiths, M. D., y Demetrovics, Z. (2023). Psychological predictors of the co-occurrence of problematic gaming, gambling, and social media use among adolescents. Computers in Human Behavior, 140, 107589. https://doi.org/10.1016/j.chb.2022.107589

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Publishing

*Bányai, F., Griffiths, M. D., Demetrovics, Z., y Király, O. (2019). The mediating effect of motivations between psychiatric distress and gaming disorder among esport gamers and recreational gamers. Comprehensive Psychiatry, 94, 152117. https://doi.org/10.1016/j.comppsych.2019.152117

Bonett, D. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27(4), 335-340. https://doi.org/10.3102/10769986027004335

Botella, J. y Sánchez-Meca, J. (2015). Meta-Análisis en Ciencias Sociales y de la Salud. Editorial Síntesis.

*Brandtner, A., Wegmann, E., y Brand, M. (2020). Desire thinking promotes decisions to game: The mediating role between gaming urges and everyday decision-making in recreational gamers. Addictive Behaviors Reports, 12, 100295. https://doi.org/10.1016/j.abrep.2020.100295

*Cervigón-Carrasco, V., Schulze-Steinen, L., Ballester-Arnal, R., Billieux, J., Gil-Juliá, B., Giménez-Garcia, C., y Castro-Calvo, J. (2023). Attentional inhibitory control interference related to videogames, pornography, and TV series exposure: An experimental study in three independent samples. Computers in Human Behavior, 143, 107683. https://doi.org/10.1016/j.chb.2023.107683

Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. The Journal of General Psychology, 130(3), 290-304. https://doi.org/10.1080/00221300309601160

*Chiu, Y. C., Pan, Y. C., y Lin, Y. H. (2018). Chinese adaptation of the Ten-Item Internet Gaming Disorder Test and prevalence estimate of Internet gaming disorder among adolescents in Taiwan. Journal of Behavioral Addictions, 7(3), 719-726. https://doi.org/10.1556/2006.7.2018.92

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessments instruments in psychology. Psychological Assessment, 6, 284–290. https://doi.org/10.1037/1040-3590.6.4.28

Conn, V. S., Valentine, J. C., Cooper, H. M., & Rantz, M. J. (2003). Grey Literature in MetaAnalyses. Nursing Research, 52(4), 256–261. https://doi.org/10.1097/00006199-200307000-00008

Darvesh, N., Radhakrishnan, A., Lachance, C. C., Nincic, V., Sharpe, J. P., Ghassemi, M., Straus, S. E.; & Tricco, A. C. (2020). Exploring the prevalence of gaming disorder and Internet gaming disorder: A rapid scoping review. Systematic reviews, 9, 1-10. https://doi.org/10.21203/rs.2.19279/v2

*Demetrovics, Z., van den Brink, W., Paksi, B., Horváth, Z., y Maraz, A. (2022). Relating Compulsivity and Impulsivity With Severity of Behavioral Addictions: A Dynamic Interpretation of Large-Scale Cross-Sectional Findings. Frontiers in Psychiatry, 13, 831992. https://doi.org/10.3389/fpsyt.2022.831992

*Evren, C., Evren, B., Dalbudak, E., Topcu, M., y Kutlu, N. (2020). Psychometric validation of the Turkish Ten-Item Internet Gaming Disorder Test (IGDT-10). Dusunen Adam, 33(1), 19–28. https://doi.org/10.14744/dajpns.2019.00057

Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., Santaguida, P., Lau., J., y Trikalinos, T. A. (2011). Conducting quantitative synthesis when comparing medical interventions: AHRQ and the Effective Health Care Program. Journal of Clinical Epidemiology, 64(11), 1187-1197. https://doi.org/10.1016/j.jclinepi.2010.08.010

Gao, Y.-X., Wang, J.-Y., & Dong, G.-H. (2022). The prevalence and possible risk factors of internet gaming disorder among adolescents and young adults: Systematic reviews and meta-analyses. Journal of Psychiatric Research, 154, 35–43. https://doi.org/10.1016/j.jpsychires.2022.06.049

*Giardina, A., Di Blasi, M., Schimmenti, A., King, D. L., Starcevic, V., y Billieux, J. (2021). Online gaming and prolonged self-isolation: evidence from Italian gamers during the COVID-19 outbreak. Clinical Neuropsychiatry, 18(1), 65-74. https://doi.org/10.36131/cnfioritieditore20210106

*Hébert-Ratté, R., Dufour, M., y Hébert, M. (2023, March 9). Validation of the Internet Gaming Disorder Test (IGDT-10) in a Sample of Quebec French-Speaking Youth and Associations With Trauma and PTSD. Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement. Advance online publication. https://doi.org/10.1037/cbs0000374

Higgins, J. P., Thompson, S. G., Deeks, J. J., y Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557-560. https://doi.org/10.1136/bmj.327.7414.557

King, D. L., Chamberlain, S. R., Carragher, N., Billieux, J., Stein, D., Mueller, K.,... y Delfabbro, P. H. (2020). Screening and assessment tools for gaming disorder: A comprehensive systematic review. Clinical Psychology Review, 77, 101831. https://doi.org/10.1016/j.cpr.2020.101831

*Király, O., Bőthe, B., Ramos-Diaz, J., Rahimi-Movaghar, A., Lukavska, K., Hrabec, O., Miovsky, M., Billieux, J., Deleuze, J., Nuyens, F., Karila, L., Griffiths, M. D., Nagygyörgy, K., Urbán, R., Potenza, M. N., King, D. L., Rumpf, H.-J., Carragher, N., y Demetrovics, Z. (2019). Ten-Item Internet Gaming Disorder Test (IGDT-10): Measurement invariance and cross-cultural validation across seven language-based samples. Psychology of Addictive Behaviors, 33(1), 91–103. https://doi.org/10.1037/adb0000433

*Király, O., Sleczka, P., Pontes, H. M., Urbán, R., Griffiths, M. D., y Demetrovics, Z. (2017). Validation of the ten-item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria. Addictive Behaviors, 64, 253-260. https://doi.org/10.1016/j.addbeh.2015.11.005

Király, O., Tóth, D., Urbán, R., Demetrovics, Z., y Maraz, A. (2017). Intense video gaming is not essentially problematic. Psychology of Addictive Behaviors, 31(7), 807-817. https://doi.org/10.1037/adb0000316

*Kircaburun, K., Demetrovics, Z., Griffiths, M. D., Király, O., Kun, B., y Tosuntaş, Ş. B. (2020). Trait emotional intelligence and internet gaming disorder among gamers: The mediating role of online gaming motives and moderating role of age groups.

International Journal of Mental Health and Addiction, 18, 1446-1457. https://doi.org/10.1007/s11469-019-00179-x

*Kircaburun, K., Griffiths, M. D., y Billieux, J. (2019). Psychosocial factors mediating the relationship between childhood emotional trauma and internet gaming disorder: A pilot study. European Journal of Psychotraumatology, 10(1), 1565031. https://doi.org/10.1080/20008198.2018.1565031

Kisamore, J. L., y Brannick, M. T. (2008). An illustration of the consequences of metaanalysis model choice. Organizational Research Methods, 11(1), 35-53. https://doi.org/10.1177/1094428106287393

Kuss, D. J., y Griffiths, M. D. (2012). Online gaming addiction in children and adolescents: A review of empirical research. Journal of Behavioral Addictions, 1(1), 3-22. https://doi.org/10.1556/jba.1.2012.1.1

Lipsey, M. W., y Wilson, D. B. (2001). Practical meta-analysis. SAGE. *Maftei, A., y Enea, V. (2020). Symptoms of Internet Gaming Disorder and parenting styles in Romanian adolescents. Psihologija, 53(3), 307-318. https://doi.org/10.2298/psi190808008m

*Männikkö, N., Ruotsalainen, H., Tolvanen, A., y Kääriäinen, M. (2019). Psychometric properties of the Internet Gaming Disorder Test (IGDT‐10) and problematic gaming behavior among Finnish vocational school students. Scandinavian Journal of Psychology, 60(3), 252-260. https://doi.org/10.1111/sjop.12533

McAuley, L., Tugwell, P., & Moher, D. (2000). Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. The Lancet, 356(9237), 1228-1231. https://doi.org/10.1016/s0140-6736(00)02786-0

*Mihara, S., Osaki, Y., Kinjo, A., Matsuzaki, T., Nakayama, H., Kitayuguchi, T., Harada, T., y Higuchi, S. (2022). Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) based on the clinical diagnosis of IGD in Japan. Journal of Behavioral Addictions, 11(4), 1024-1034. https://doi.org/10.1556/2006.2022.00070

*Muhametjanova, G., Adanır, G. A., y Arpaci, I. (2021). Investigation of Gaming Habits, Personality Traits, and Internet Gaming Disorder Among Kyrgyz Adolescents. International Journal of Mental Health and Addiction, 21(2), 869-877. https://doi.org/10.1007/s11469-021-00628-6

*Müller, S. M., Wegmann, E., Garcia Arías, M., Bernabeu Brotons, E., Marchena Giráldez, C., y Brand, M. (2022a). Decision Making and Risk Propensity in Individuals with Tendencies towards Specific Internet-Use Disorders. Brain Sciences, 12(2), 201. https://doi.org/10.3390/brainsci12020201

*Müller, S. M., Wegmann, E., Oelker, A., Stark, R., Müller, A., Montag, C., Wölfling, K., Rumpf, H. J., y Brand, M. (2022b). Assessment of Criteria for Specific Internet-use Disorders (ACSID-11): Introduction of a new screening instrument capturing ICD11 criteria for gaming disorder and other potential Internet-use disorders. Journal of Behavioral Addictions, 11(2), 427-450. https://doi.org/10.1556/2006.2022.00013

*Murray, A., Mannion, A., Chen, J. L., y Leader, G. (2021). Gaming disorder in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 52, 2762- 2769. https://doi.org/10.1007/s10803-021-05138-x

Nunnally, J. C., y Bernstein, I. H. (1994). Psychometric theory. McGraw Hill.

*Pan, Y. C., Chiu, Y. C., y Lin, Y. H. (2019). Development of the problematic mobile gaming questionnaire and prevalence of mobile gaming addiction among adolescents in Taiwan. Cyberpsychology, Behavior, and Social Networking, 22(10), 662-669. https://doi.org/10.1089/cyber.2019.0085

*Péter, L., Paksi, B., Magi, A., Eisinger, A., Kótyuk, E., Czakó, A., Griffiths, M. D., Demetrovics, Z., y Andó, B. (2023). Severity of behavioral addiction symptoms among young adults using non-prescribed sedatives/hypnotics. Addictive Behaviors Reports, 17, 100485. https://doi.org/10.1016/j.abrep.2023.100485

Sánchez‐Meca, J., Marín‐Martínez, F., López‐López, J. A., Núñez‐Núñez, R. M., Rubio‐Aparicio, M., López‐García, J. J., López-Pina, J. A., Blázquez-Rincón, D. M., López-Ibáñez, C., y López‐Nicolás, R. (2021). Improving the reporting quality of reliability generalization meta‐analyses: The REGEMA checklist. Research Synthesis Methods, 12(4), 516-536. https://doi.org/10.1002/jrsm.1487

Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107-120. https://doi.org/10.1007/s11336-008-9101-0

*Siste, K., Hanafi, E., Sen, L. T., Damayanti, R., Beatrice, E., y Ismail, R. I. (2022). Psychometric properties of the Indonesian Ten-item Internet Gaming Disorder Test and a latent class analysis of gamer population among youths. Plos One, 17(6), e0269528. https://doi.org/10.1371/journal.pone.0269528

*Stenseng, F., Falch-Madsen, J., y Hygen, B. W. (2021). Are there two types of escapism? Exploring a dualistic model of escapism in digital gaming and online streaming. Psychology of Popular Media, 10(3), 319-329. https://doi.org/10.1037/ppm0000339

*Vaarala, S., Ruotsalainen, H., Hylkilä, K., Kääriäinen, M., Konttila, J., Männistö, M., y Männikkö, N. (2022). The association of problematic gaming characteristics with dietary habits among Finnish vocational school students. Scientific Reports, 12(1),

https://doi.org/10.1038/s41598-022-25343-7

Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journalof Statistical Software, 36(3), 1-48.

https://doi.org/10.18637/jss.v036.i03

*Wang, Q. (2022). Alcohol Consumption in Chinese Young Adult Gamers: Factor Structure and Measurement Invariance of the Alcohol Use Disorders Identification Test (AUDIT). International Journal of Mental Health and Addiction, 1-21. https://doi.org/10.1007/s11469-022-00866-2

*Wang, P., Wang, J., Yan, Y., Si, Y., Zhan, X., y Tian, Y. (2021). Relationship between loneliness and depression among Chinese junior high school students: the serial mediating roles of internet gaming disorder, social network use, and generalized pathological internet use. Frontiers in Psychology, 11, 529665. https://doi.org/10.3389/fpsyg.2020.529665

*Warburton, W. A., Parkes, S., y Sweller, N. (2022). Internet Gaming Disorder: Evidence for a risk and resilience approach. International Journal of Environmental Research and Public Health, 19(9), 5587. https://doi.org/10.3390/ijerph19095587

World Health Organization. (2018). International Classification of Diseases 11th Revision (ICD-11). https:// icd.who.int/

*Zsila, Á., Shabahang, R., Aruguete, M. S., y Orosz, G. (2022). Toxic behaviors in online multiplayer games: Prevalence, perception, risk factors of victimization, and psychological consequences. Aggressive Behavior, 48(3), 356-364. https://doi.org/10.1002/ab.22023