Considerations for the Use of Online Open-Ended Survey Questions in Educational Research on Youth Experience of the School System
Abstract views: 132
/ 
PDF downloads: 34
DOI:
https://doi.org/10.59455/qietp.44Keywords:
youth, school-based research, survey, interpretivism, online methodsAbstract
Eğitim psikolojisi araştırma uygulamaları, kişisel ve ilişkisel konuları incelemek için kişisel olmayan yöntemler kullanmaları nedeniyle eleştirilmiştir. Bu gerilimlere yanıt olarak, eğitim psikolojisinde daha nitel araştırmalara ve gençlerin katılımını artırmak için genç dostu araştırma yaklaşımlarının kullanımına doğru bir yönelim söz konusudur. Eğitim psikolojisinde nitel araştırmanın titizliğiyle ilgili eleştirilere duyarlı araştırmacılar ve büyük miktarda veriyi ele almak için nitel bir yöntem kullanmak isteyen pozitivist araştırmacılar için bir 'orta yol' olarak bağımsız çevrimiçi açık uçlu anketlerin kullanımını öneriyoruz. Ergen öğrencilerin öğretmen-öğrenci ilişkisine ilişkin algılarına dair uzunlamasına okul tarafından uygulanan bir anketten elde edilen açık uçlu verileri kullanarak, beş adımımız (alan çalışmasına giriş, yanıt veren ve yanıt vermeyenlerin analizi, veri hazırlığı, veri analizi ve yorumlama), titizliği artırmak için anket içindeki verilerin nasıl üçgenleştirileceğini ve kristalleştirileceğini açıklamaktadır ve bütünsel veri yönetiminin, veri kümesi içinde ve birden fazla soruda kodlamanın üçgenleştirme ve kristalleştirmenin yeniden düşünülmesini sağladığını savunmaktadır. Yaklaşımımız, öğrenci bakış açılarının çeşitliliğini onurlandıran dört tema ortaya koydu: “Çekme ve İtme”, “Öğrencinin elini tutmak”, “Öğretmen okuldur” ve “Tek başına uçanlar”. Bu yöntemle elde edilebilecek veri zenginliğine örnekler sunuyoruz. Bulgularımız, öğretmenlerin ilişki kurma becerilerinin öğrenciler tarafından değerli bulunduğunu ve içerik ve derslerin daha derinlemesine anlaşılması için olumlu öğrenci öğrenme eğilimlerini geliştirmede önemli olduğunu göstermektedir. Araştırmacıları, okul temelli araştırmalarda öğrenci çeşitliliğini ve kapsayıcılığını onurlandırmak için çevrimiçi açık uçlu anket verilerini yorumlayıcı bir bakış açısıyla analiz etmeyi düşünmeye teşvik ediyoruz.
References
Anderson, T., & Shattuck, J. (2012). Design-based research:A decade of progress in education research? Educational Researcher, 41(1), 16-25. https://doi.org/10.3102/0013189X11428813 DOI: https://doi.org/10.3102/0013189X11428813
Arslan, G., Allen, K. A., & Ryan, T. (2020). Exploring the impacts of school belonging on youth wellbeing and mental health among Turkish adolescents. Child Indicators Research, 13(5), 1619-1635. https://doi.org/10.1007/s12187-020-09721-z DOI: https://doi.org/10.1007/s12187-020-09721-z
Burruss, G. W., & Johnson, A. (2021). Online survey research. The encyclopedia of research methods in criminology and criminal justice, 1, 104-107. https://doi.org/10.1002/9781119111931.ch21 DOI: https://doi.org/10.1002/9781119111931.ch21
Cauce, A. M., Ryan, K. D., & Grove, K. (1998). Children and adolescents of color, where are you? Participation, selection, recruitment, and retention in developmental research. In Studying minority adolescents (pp. 159-178). Psychology Press. https://doi.org/10.4324/9781410601506 DOI: https://doi.org/10.4324/9781410601506-15
Christou, P. A. (2023). How to use artificial intelligence (AI) as a resource, methodological and analysis tool in qualitative research?. Qualitative Report, 28(7). https://doi.org/10.46743/2160-3715/2023.6406 DOI: https://doi.org/10.46743/2160-3715/2023.6406
Denny, S. J., Milfont, T. L., Utter, J., Robinson, E. M., Ameratunga, S. N., Merry, S. N., ... & Watson, P. D. (2008). Hand-held internet tablets for school-based data collection. BMC Research Notes, 1, 1-4. https://doi.org/10.1186/1756-0500-1-52 DOI: https://doi.org/10.1186/1756-0500-1-52
Dusko Biferie, M., Hussey, R., Sam, J., Xiao, B., and Shapka, J. (2024, Jan.). Adolescent Mental Health in the Time of COVID-19: A Reflexive Thematic Analysis of Social Connectedness and Technology Use. AHSE – Arts, Humanities, Social Sciences & Education Conference, Honolulu, HI, USA. https://artshumanitieshawaii.org/wp-content/uploads/2024/05/Dusko-Biferie-Michelle-2024-HUIC-AHSE.pdf
Eckhoff, A. (2019). Participation takes many forms: exploring the frameworks surrounding children’s engagement in participatory research. Participatory Research with Young Children, 3-19. https://doi.org/10.1007/978-3-030-19365-2_1 DOI: https://doi.org/10.1007/978-3-030-19365-2_1
Elliott, J. (2022). The craft of using NVivo12 to analyze open-ended questions: an approach to mixed methods analysis. The Qualitative Report. https://doi.org/10.46743/2160-3715/2022.5460 DOI: https://doi.org/10.46743/2160-3715/2022.5460
Flanagan, S. M., Greenfield, S., Coad, J., & Neilson, S. (2015). An exploration of the data collection methods utilised with children, teenagers and young people (CTYPs). BMC Research Notes, 8, 1-14. https://doi.org/10.1186/s13104-015-1018-y DOI: https://doi.org/10.1186/s13104-015-1018-y
Göktaş, E., & Kaya, M. (2023). The effects of teacher relationships on student academic achievement: a second order meta-analysis. Participatory Educational Research, 10(1), 275-289. https://doi.org/10.17275/per.23.15.10.1 DOI: https://doi.org/10.17275/per.23.15.10.1
Hai-Jew, S. (2022). Using Computational Text Analysis to Explore Open-Ended Survey Question Responses. In Research Anthology on Implementing Sentiment Analysis Across Multiple Disciplines (pp. 342-366). IGI Global. DOI: 10.4018/978-1-6684-6303-1.ch019 DOI: https://doi.org/10.4018/978-1-6684-6303-1.ch019
Heine, S. J., & Ruby, M. B. (2010). Cultural psychology. Wiley Interdisciplinary Reviews: Cognitive Science, 1(2), 254-266. DOI: https://doi.org/10.1002/wcs.7
Higgins, S. E., Ford, K., & Oberski, I. (2000). Computer-aided qualitative analysis of interview data: some recommendations for collaborative working. The Qualitative Report. http://www.nova.edu/ssss/QR/QR4-3/oberski.html
Immordino-Yang, M. H., Darling-Hammond, L., & Krone, C. R. (2025). Nurturing nature: How brain development is inherently social and emotional, and what this means for education. In Social and Emotional Learning (pp. 63-83). Routledge. https://www.academia.edu/download/60775066/Nurturing_Nature_How_Brain_Development_Is_Inherently_Social_and_Emotional_and_What_This_Means_for_Education20191002-19689-1obrkq4.pdf DOI: https://doi.org/10.4324/9781003054573-5
Jackson, K. M., & Trochim, W. M. (2002). Concept mapping as an alternative approach for the analysis of open-ended survey responses. Organizational Research Methods, 5(4), 307-336. https://doi.org/10.1177/109442802237114 DOI: https://doi.org/10.1177/109442802237114
Jaeger, S. R., & Rasmussen, M. A. (2021). Importance of data preparation when analysing written responses to open-ended questions: An empirical assessment and comparison with manual coding. Food Quality and Preference, 93, 104270. https://doi.org/10.1016/j.foodqual.2021.104270 DOI: https://doi.org/10.1016/j.foodqual.2021.104270
Jiang, E. H. C. (2025). Hierarchy fetishism in an urban Chinese school. Dialectical Anthropology, 1-23. https://doi.org/10.1007/s10624-025-09771-1 DOI: https://doi.org/10.1007/s10624-025-09771-1
Junjie, M., & Yingxin, M. (2022). The Discussions of Positivism and Interpretivism. Online Submission, 4(1), 10-14. DOI: 10.36348/gajhss.2022.v04i01.002 DOI: https://doi.org/10.36348/gajhss.2022.v04i01.002
Kelly, G., McKnight, M., & Schubotz, D. (2020). ‘Is there anything else you’d like to say about community relations?’Thematic time series analysis of open-ended questions from an annual survey of 16-year olds. Methods, Data, Analysis. https://mda.gesis.org/index.php/mda/article/view/2020.07/277
Kirk, S. (2007). Methodological and ethical issues in conducting qualitative research with children and young people: A literature review. International Journal of Nursing Studies, 44(7), 1250-1260.https://doi.org/10.1016/j.ijnurstu.2006.08.015 DOI: https://doi.org/10.1016/j.ijnurstu.2006.08.015
Kristjansson, A. L., Sigfusson, J., Sigfusdottir, I. D., & Allegrante, J. P. (2013). Data collection procedures for school‐based surveys among adolescents: The Youth in Europe Study. Journal of School Health, 83(9), 662-667. https://doi.org/10.1111/josh.12079 DOI: https://doi.org/10.1111/josh.12079
Krumpal, I. (2023). Social desirability bias and context in sensitive surveys. In Encyclopedia of quality of life and well-being research (pp. 1-7). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-69909-7_4086-2 DOI: https://doi.org/10.1007/978-3-319-69909-7_4086-2
Kumar, R., & DeCuir-Gunby, J. (2023). What is the role of race in educational psychology? A review of research in Educational Psychologist. Educational Psychologist, 58(1), 1-17. https://doi.org/10.1080/00461520.2022.2137804 DOI: https://doi.org/10.1080/00461520.2022.2137804
LaDonna, K. A., Taylor, T., & Lingard, L. (2018). Why open-ended survey questions are unlikely to support rigorous qualitative insights. Academic Medicine, 93(3), 347-349. DOI: 10.1097/ACM.0000000000002088 DOI: https://doi.org/10.1097/ACM.0000000000002088
Lim, W. M. (2025). What is qualitative research? An overview and guidelines. Australasian Marketing Journal, 33(2), 199-229. https://doi.org/10.1177/14413582241264619 DOI: https://doi.org/10.1177/14413582241264619
Matthews, J. S., & López, F. (2020). Race-reimaging educational psychology research: Investigating constructs through the lens of race and culture. Contemporary Educational Psychology, 61, 101878. https://doi.org/10.1016/j.cedpsych.2020.101878 DOI: https://doi.org/10.1016/j.cedpsych.2020.101878
McCabe, S. E., Boyd, C. J., Young, A., & Crawford, S. (2004). Feasibility study for collecting alcohol and other drug use data among secondary school students: a web-based survey approach. Journal of Drug Education, 34(4), 373-383. https://doi.org/10.2190/TGMB-0X3Q-6PV1-9A6W DOI: https://doi.org/10.2190/TGMB-0X3Q-6PV1-9A6W
McDermott, E., Roen, K., & Piela, A. (2013). Hard-to-reach youth online: Methodological advances in self-harm research. Sexuality Research and Social Policy, 10, 125-134. https://doi.org/10.1007/s13178-012-0108-z DOI: https://doi.org/10.1007/s13178-012-0108-z
McInroy, L. B. (2016). Pitfalls, potentials, and ethics of online survey research: LGBTQ and other marginalized and hard-to-access youths. Social Work Research, 40(2), 83-94. https://doi.org/10.1093/swr/svw005 DOI: https://doi.org/10.1093/swr/svw005
Meyer, D. K., & Schutz, P. A. (2020). Why talk about qualitative and mixed methods in educational psychology? Introduction to special issue. Educational Psychologist, 55(4), 193-196. https://doi.org/10.1080/00461520.2020.1796671 DOI: https://doi.org/10.1080/00461520.2020.1796671
Miller, A. L., & Lambert, A. D. (2014). Open-ended survey questions: item nonresponse nightmare or qualitative data dream?. Survey Practice, 7(5). https://doi.org/10.29115/SP-2014-0024 DOI: https://doi.org/10.29115/SP-2014-0024
Murthy, D. (2008). Digital ethnography: An examination of the use of new technologies for social research. Sociology, 42(5), 837-855. https://doi.org/10.1177/0038038508094565 DOI: https://doi.org/10.1177/0038038508094565
Newman, D. S., & Clare, M. M. (2016). School psychology as a relational enterprise: The role and process of qualitative methodology. Contemporary School Psychology, 20, 327-335. https://doi.org/10.1007/s40688-016-0090-1 DOI: https://doi.org/10.1007/s40688-016-0090-1
Popping, R. (2015). Analyzing open-ended questions by means of text analysis procedures. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 128(1), 23-39. https://doi.org/10.1177/0759106315597389 DOI: https://doi.org/10.1177/0759106315597389
Porter, S. R., & Whitcomb, M. E. (2005). Non-response in student surveys: The role of demographics, engagement and personality. Research in Higher Education, 46, 127-152. https://doi.org/10.1007/s11162-004-1597-2 DOI: https://doi.org/10.1007/s11162-004-1597-2
Raclaw, J., Barchas-Lichtenstein, J., & Bajuniemi, A. (2020). Online surveys as discourse context: Response practices and recipient design. Discourse, Context & Media, 38, 100441. https://doi.org/10.1016/j.dcm.2020.100441 DOI: https://doi.org/10.1016/j.dcm.2020.100441
Rasberry, C. N., Rose, I., Kroupa, E., Hebert, A., Geller, A., Morris, E., & Lesesne, C. A. (2018). Overcoming challenges in school-wide survey administration. Health Promotion Practice, 19(1), 110-118. https://doi.org/10.1177/1524839917733476 DOI: https://doi.org/10.1177/1524839917733476
Rodriguez Espinosa, P., & Verney, S. P. (2021). The underutilization of community‐based participatory research in psychology: A systematic review. American Journal of Community Psychology, 67(3-4), 312-326. https://doi.org/10.1002/ajcp.12469 DOI: https://doi.org/10.1002/ajcp.12469
Schelbe, L., Chanmugam, A., Moses, T., Saltzburg, S., Williams, L. R., & Letendre, J. (2015). Youth participation in qualitative research: Challenges and possibilities. Qualitative Social Work, 14(4), 504-521. https://doi.org/10.1177/1473325014556792 DOI: https://doi.org/10.1177/1473325014556792
Smith, W. G. (2008). Does gender influence online survey participation? A record-linkage analysis of university faculty online survey response behavior. Online submission. https://files.eric.ed.gov/fulltext/ED501717.pdf
Stantcheva, S. (2023). How to run surveys: A guide to creating your own identifying variation and revealing the invisible. Annual Review of Economics, 15(1), 205-234. https://doi.org/10.1146/annurev-economics-091622-010157 DOI: https://doi.org/10.1146/annurev-economics-091622-010157
Teixeira, S., Augsberger, A., Richards‐Schuster, K., & Sprague Martinez, L. (2021). Participatory research approaches with youth: Ethics, engagement, and meaningful action. American Journal of Community Psychology, 68(1-2), 142-153. https://doi.org/10.1002/ajcp.12501 DOI: https://doi.org/10.1002/ajcp.12501
ten Kleij, F., & Musters, P. A. (2003). Text analysis of open-ended survey responses: A complementary method to preference mapping. Food Quality and Preference, 14(1), 43-52. https://doi.org/10.1016/S0950-3293(02)00011-3 DOI: https://doi.org/10.1016/S0950-3293(02)00011-3
Tilley, S., & Taylor, L. (2018). Qualitative methods and respectful praxis: Researching with youth. The Qualitative Report, 23(9), 2184-2204. https://core.ac.uk/download/pdf/215362947.pdf DOI: https://doi.org/10.46743/2160-3715/2018.3482
Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16(10), 837-851. https://doi.org/10.1177/1077800410383121 DOI: https://doi.org/10.1177/1077800410383121
Tracy, S. J., & Hinrichs, M. M. (2017). Big tent criteria for qualitative quality. The International Encyclopedia of Communication Research Methods, 1-10. https://doi.org/10.1002/9781118901731.iecrm0016 DOI: https://doi.org/10.1002/9781118901731.iecrm0016
Tran, V. T., Porcher, R., Tran, V. C., & Ravaud, P. (2017). Predicting data saturation in qualitative surveys with mathematical models from ecological research. Journal of Clinical Epidemiology, 82, 71-78. https://doi.org/10.1016/j.jclinepi.2016.10.001 DOI: https://doi.org/10.1016/j.jclinepi.2016.10.001
Wallace, T. L., & Kuo, E. (2020). Publishing qualitative research in the Journal of Educational Psychology: Synthesizing research perspectives across methodological silos. http://dx.doi.org/10.1037/edu0000474 DOI: https://doi.org/10.1037/edu0000474
Wu, M. J., Zhao, K., & Fils-Aime, F. (2022). Response rates of online surveys in published research: A meta-analysis. Computers in Human Behavior Reports, 7, 100206. https://doi.org/10.1016/j.chbr.2022.100206 DOI: https://doi.org/10.1016/j.chbr.2022.100206
Yamazaki, I., Hatanaka, K., Nakamura, S., & Komatsu, T. (2023, December). The Effects of Order and Text Box Size of Open-ended Questions on Withdrawal Rate and the Length of Response. In Proceedings of the 35th Australian Computer-Human Interaction Conference (pp. 446-453). https://doi.org/10.1145/3638380.36384 DOI: https://doi.org/10.1145/3638380.3638419
Zuell, C., Menold, N., & Körber, S. (2015). The influence of the answer box size on item nonresponse to open-ended questions in a web survey. Social Science Computer Review, 33(1), 115-122. https://doi.org/10.1177/0894439314528091 DOI: https://doi.org/10.1177/0894439314528091
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Qualitative Inquiry in Education: Theory & Practice
This work is licensed under a Creative Commons Attribution 4.0 International License.
