Professional Documents
Culture Documents
Dahal 2024 How Can Generative Ai Genai Enhance
Dahal 2024 How Can Generative Ai Genai Enhance
Dahal 2024 How Can Generative Ai Genai Enhance
3-3-2024
Part of the Aesthetics Commons, Business Commons, Education Commons, Engineering Commons,
Fine Arts Commons, Law Commons, Life Sciences Commons, Medicine and Health Sciences Commons,
Physical Sciences and Mathematics Commons, Quantitative, Qualitative, Comparative, and Historical
Methodologies Commons, Social Justice Commons, and the Social Statistics Commons
This Article is brought to you for free and open access by the The Qualitative Report at NSUWorks. It has been
accepted for inclusion in The Qualitative Report by an authorized administrator of NSUWorks. For more
information, please contact nsuworks@nova.edu.
How Can Generative AI (GenAI) Enhance or Hinder Qualitative Studies? A Critical
Appraisal from South Asia, Nepal
Abstract
Qualitative researchers can benefit from using generative artificial intelligence (GenAI), such as different
versions of ChatGPT—GPT-3.5 or GPT-4, Google Bard—now renamed as a Gemini, and Bing Chat—now
renamed as a Copilot, in their studies. The scientific community has used artificial intelligence (AI) tools
in various ways. However, using GenAI has generated concerns regarding potential research unreliability,
bias, and unethical outcomes in GenAI-generated research results. Considering these concerns, the
purpose of this commentary is to review the current use of GenAI in qualitative research, including its
strengths, limitations, and ethical dilemmas from the perspective of critical appraisal from South Asia,
Nepal. I explore the controversy surrounding the proper acknowledgment of GenAI or AI use in qualitative
studies and how GenAI can support or challenge qualitative studies. First, I discuss what qualitative
researchers need to know about GenAI in their research. Second, I examine how GenAI can be a valuable
tool in qualitative research as a co-author, a conversational platform, and a research assistant for
enhancing and hindering qualitative studies. Third, I address the ethical issues of using GenAI in
qualitative studies. Fourth, I share my perspectives on the future of GenAI in qualitative research. I would
like to recognize and record the utilization of GenAI and/or AI alongside my cognitive and evaluative
abilities in constructing this critical appraisal. I offer ethical guidance on when and how to appropriately
recognize the use of GenAI in qualitative studies. Finally, I offer some remarks on the implications of
using GenAI in qualitative studies
Keywords
qualitative data analysis, GenAI, research methods, ethical issues, critical appraisal
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 4.0 International
License.
Acknowledgements
I express my sincere gratitude to the reviewer, editor, and senior editor—Alicia King, Martha Snyder, and
Chip Turner—of TQR for their valuable feedback, insightful suggestions, and meticulous corrections
throughout this commentary. Equally, I wish to acknowledge the use of ChatGPT—GPT-3.5 or GPT-4,
Google Bard—now renamed as a Gemini, and Bing Chat—now renamed as a Copilot in this commentary.
ChatGPT was used to brainstorm and structure the content. Google Bard was employed to distill the key
themes from academic papers, while Bing Chat was used to refine the language and ensure a consistent
flow and cohesion throughout the sentences and paragraphs. Thus, I wish to recognize and record the
application of both GenAI and AI and my cognitive and evaluative abilities in the formulation of this
commentary.
Niroj Dahal
Kathmandu University School of Education, Lalitpur, Nepal
Introduction
Using input prompts, generating artificial intelligence (GenAI) can produce new
content, including text, images, videos, or audio clips. It uses trained data to learn and generate
results and patterns that share similar traits. As GenAI tools are based on machine learning
724 The Qualitative Report 2024
algorithms and natural language processing (Aattouri et al., 2023), machine learning algorithms
are used in quantitative GenAI to process and analyze large amounts of numerical data. In
contrast, natural language processing is used in qualitative GenAI to analyze and understand
text-based data such as reviews and feedback.
Programmers and software developers have created artificial intelligence (AI)
technologies that incorporate natural language processing (NLP), and researchers can now use
AI-powered tools to help them analyze qualitative data. GenAI-based “NLP uses linguistics
and machine learning” (Anis & French, 2023, p. 1140) models to understand, interpret, and
create language in the human style. Some GenAI and AI tools for qualitative studies in general
that are being used on the web are Scite Assistant, Consensus, Elicit, ChatGPT, ChatPDF,
Research Rabbit, SciSpace, Perplexity, Google Bard, and Bing Chat. These platforms and
models offered researchers ample opportunities to communicate with GenAI by using
ChatGPT from OpenAI, a specific NLP application in a chatbot format. However, there were
AI tools that had been in practice before the launch of ChatGPT. For instance, with the most
cutting-edge AI and machine learning algorithms, Atlas.ti is widely considered the most
efficient tool for qualitative text analysis and market research because it automatically
generates deep insights for quicker outcomes. Likewise, in a recent development, GenAI can
perform challenging linguistic tasks like text generation, language translation, and even
question-and-answer sessions as a co-author in conversational platforms and research
assistants (Fui-Hoon Nah et al., 2023; Salinas-Navarro et al., 2024).
GenAI does, however, have some limitations. “Due to the training data, it uses and its
limited capacity to interpret tacit knowledge” (Anis & French, 2023, p. 1140) in humanistic
approaches with a critical perspective, GenAI frequently produces biased results and factual
errors based on the caliber of the training data. It also doesn't have a solid understanding of the
subtleties of human language—feelings, emotions, behavioral behaviors, and authentic tasks
of the physical and social world. Shimizu et al. (2023) noted that GenAI positively impacts
teaching and learning efficiency and access to information while negatively affecting
independent thinking and the adaptability of current assessment methods. They suggested
integrating GenAI literacy, ethics, and compliance into research and curriculum, enhancing
learning efficiency, aiding information collection and distribution, promoting students’
participation in learning processes by nurturing advanced cognitive learning domains and
incorporating more communication exercises. However, while using “GenAI tools such as
ChatGPT, Google Bard, and Bing Chat” (Dahal, 2023a, p. 249), among others, it is essential
to note that certain aspects like observable behaviors during research, genuine tasks, and
simultaneous multiple assessments may not be trackable.
Contrary to these significant downsides, GenAI benefits qualitative researchers in
several ways. Christou (2023a) critically examines the ethical and methodological implications
of using GenAI and/or AI tools in qualitative research by arguing that it can serve as an asset
and collaborator for qualitative researchers; however, it also presents certain challenges and
risks that need to be recognized and addressed. So, the discussion should be grounded in the
potential advantages and drawbacks of GenAI, along with the ethical norms and guidelines that
should guide its application in qualitative research. Consequently, researchers face a dilemma
in reporting and justifying the use of GenAI or AI in their studies. This must include disclosing
the GenAI’s or AI’s types, roles, and functions, explaining the reasoning and criteria for its
selection and evaluation, and acknowledging its limitations and uncertainties.
“GenAI tools, such as ChatGPT, Google Bard, and Bing Chat” (Dahal, 2023a, p. 249),
among other similar platforms, can mitigate the limitations arising from the small data size in
Niroj Dahal 725
In this digital era, educators and researchers are engaging with a substantial portion of
mundane text, wherein GenAI can serve as an augmentation of the researcher's capacity to
comprehend and discern the underlying significance within data. This allows the researchers
and/or users to direct their attention toward the more interpretive elements of their research,
including the refinement of the code book, the establishment of conceptual connections, the
process of meaning-making, and the development of theoretical frameworks. Consequently,
the efficiency of research is enhanced as the researcher's primary focus shifts towards critical
thinking, deliberation, and the cultivation of an interpretative repertoire, thereby relieving them
from the more time-intensive tasks that GenAI can handle. On the other hand, educators and
researchers in the field of academia frequently face a multitude of unorganized qualitative data,
posing a substantial obstacle in terms of its organization and analysis. For example, a scholar
engaged in charting the evolving landscape of discourse in qualitative research (Fransman,
2018). In this alignment, Ciechanowski et al. (2020) presented a tutorial on how to conduct
GenAI or AI research without coding. They used the metaphor of “the art of fighting without
fighting” (p. 322) from the movie Enter the Dragon to explain how qualitative researchers can
benefit from using GenAI or AI tools that do not require programming skills. These tools
include text mining, sentiment analysis, social network analysis, and natural language
generation. The authors also discussed the ethical and methodological challenges of using
GenAI and/or AI tools, such as data quality, validity, reliability, and transparency. In addition,
common techniques such as content analysis and sentiment analysis can capture certain aspects
726 The Qualitative Report 2024
GenAI has the potential to greatly benefit as research assistants for researcher—novice
and/or veteran from diverse backgrounds who possess limited social and cultural capital (Anis
& French, 2023). Social and cultural capital are the resources that are available to an individual
through their social interactions and cultural knowledge, which can influence their social
Niroj Dahal 727
mobility and status in society. GenAI is proving advantageous to researchers of all experience
levels and backgrounds while also tackling the challenges of limited social and cultural capital
that some researchers encounter. On the contrary, GenAI may present challenges for
underprivileged groups due to differential access to resources within an academic context. The
use of GenAI can assist researchers in addressing the constraints associated with language
proficiency, academic conventions, and the various forms and styles employed in scholarly
discourse (Dahal et al., 2023). For example, GenAI can serve as a valuable research assistant
for researchers by aiding in tasks such as information retrieval, hypothesis generation,
experiment design, data analysis, and qualitative report writing (Parker et al., 2023). However,
ChatGPT and other GenAI or AI tools cannot produce high-quality scientific abstracts that can
replace human writing. Gao et al. (2022) conducted the study three methods to evaluate the
ChatGPT abstracts: an artificial intelligence output detector (AIOD), a plagiarism detector
(PD), and blinded human reviewers (BHR) and concluded that ChatGPT abstracts were more
likely to be detected as AI-generated than human-written ones by AIOD, had lower similarity
scores with the original abstracts by PD, and were rated lower in terms of clarity, accuracy, and
relevance by BHR.
Nevertheless, GenAI and AI technologies can enhance researchers' capabilities,
enabling them to become more resourceful and self-reliant in their roles. These forms of
independence can empower researchers to conduct significant and analytical research
according to their preferences. Furthermore, GenAI has the potential to enhance scholarly
discourse by incorporating diverse perspectives and augmenting their impact within the realm
of mainstream academia.
GenAI can enhance the depth and value of qualitative research by serving as a co-
author, a conversational platform for users—researchers, and educators, and a research
assistant for researchers. However, it is crucial to consider the ethical implications associated
with using GenAI or AI tools in the digital era. In general, the ethics of GenAI in qualitative
research is a critical area of consideration. It ensures that GenAI systems are used responsibly
and transparently in research processes. This includes respecting the privacy and
confidentiality of data, obtaining informed consent for data use, and avoiding harm to
participants.
Furthermore, it is essential to ensure that GenAI tools are unbiased and that their use
does not lead to unfair outcomes. Transparency in the use of GenAI and/or AI in research and
the limitations of these tools are also critical ethical requirements. Ultimately, the goal is to use
GenAI to enhance research without compromising ethical standards. With the above, Vianello
et al. (2023) proposed a qualitative approach to evaluate and improve “the trustworthiness of
GenAI solutions from the perspectives of end-user explain ability and normative ethics and
present a case study of a GenAI recommendation system used in a real business setting” (p.
1408) and show how their approach can identify practical issues and ethical considerations
related to the GenAI system. Here, the researcher's explainability refers to the researcher's
ability to clearly convey research methods, findings, and limitations to experts and the public
and sometimes to understand subjective explanations from research subjects. As a user of
GenAI in qualitative studies, it is essential to recognize that GenAI serves as a tool to enhance
researchers' capabilities rather than replace them. In this regard, Anis and French (2023) have
warned about GenAI's and AI’s potential pitfalls, including factual inaccuracies, biased
outcomes, an absence of subtlety, and ethical dilemmas. Thus, qualitative researchers should
view GenAI as an instrument to aid their work rather than a replacement by advocating for a
thoughtful and introspective methodology to assess the rigor and credibility of the qualitative
728 The Qualitative Report 2024
research insights (Dahal, 2023b) produced by GenAI. So, ownership and authorship of research
cannot be attributed to GenAI or AI tools.
Moreover, Albalawi and Mustafa (2022) explored the capabilities of AI to offer
groundbreaking strategies for disease prevention and control and highlighted the constraints
and obstacles that must be overcome for the successful and ethical application of AI. The results
produced by AI minimize the ethical impediments to its responsible deployment. Likewise,
Marshall et al. (2023) have underscored the ethical considerations of employing GenAI in
qualitative research. They contend that while GenAI can augment qualitative research by
introducing novel techniques for data gathering, scrutiny, and elucidation, it also presents
considerable challenges and hazards. In this regard, Yu and Yu (2023) explored the ethical
issues of GenAI in education. They identified principles of GenAI ethics in education, such as
“deontology, utilitarianism, virtue, transparency, justice, fairness, equity, non-maleficence,
responsibility, and privacy” (p. 9). In opposition, Akabayashi et al. (2022) argued that ChatGPT
and similar tools could hijack author contributions by generating indistinguishable human-
written text without proper disclosure or attribution. So, when utilizing GenAI or AI tools, the
challenges associated with obtaining informed consent, ensuring privacy and confidentiality,
establishing trust and rapport, and maintaining research validity and reliability for investigators
and participants are significantly reduced.
Meanwhile, GenAI cannot be regarded as an autonomous and unbiased interpreter of
the social sphere. Human researchers will always be responsible for the task of interpretation.
Elali and Rachid (2023) added that the ethical and practical implications of using GenAI to
generate research papers in the scientific community and argue that GenAI-generated papers
pose a severe threat to the integrity and quality of scientific research, as they can be used to
fabricate or plagiarize data, methods, results, and conclusions. So, Elali and Rachid (2023)
added the challenges and limitations of detecting and preventing GenAI-generated papers, such
as the lack of standardized criteria, the difficulty of verifying sources, and the possibility of
adversarial attacks, and propose some potential solutions and recommendations, such as
developing more robust and transparent peer-review processes, enhancing the education and
awareness of researchers and editors, and establishing ethical guidelines and policies for using
GenAI in scientific writing. Thus, GenAI can be used to automate identifying patterns and
trends in data. However, the researcher needs to maintain control by designing the
interpretative repertoire. The researcher's values and assumptions ultimately shape the research
process and findings. By allowing the researcher to support interpretative control, concerns on
ownership, authorship, and the researcher's positionality in the research can be addressed.
Furthermore, GenAI exhibits inherent biases that are present in the data used for
training. Hence, the dominant ideas, beliefs, and attitudes prevalent in society are expected to
influence the various tasks performed during the research. This is particularly crucial for
researchers engaged in critical work that challenges societal norms and aims to change social
structures. In conclusion, researchers aware of the ethical considerations surrounding GenAI
and AI can effectively use this technology to analyze extensive qualitative data, conduct
meaningful research, and empower fellow researchers.
Final Remarks
References
Aattouri, I., Mouncif, H., & Rida, M. (2023). Modeling of an artificial intelligence-based
enterprise callbot with natural language processing and machine learning algorithms.
IAES International Journal of Artificial Intelligence, 12(2), 943.
https://doi.org/10.11591/ijai.v12.i2.pp943-955
Akabayashi, A., Nakazawa, E., & Ino, H. (2022). Could artificial intelligence hijack author
contributions? Nature, 606(7915), 653-653. https://doi.org/10.1038/d41586-022-
01697-w
Al Naqbi, H., Bahroun, Z., & Ahmed, V. (2024). Enhancing Work Productivity through
Generative Artificial Intelligence: A Comprehensive Literature Review. Sustainability,
16(3), 1166. https://doi.org/10.3390/su16031166
Niroj Dahal 731
Albalawi, U., & Mustafa, M. (2022). Current artificial intelligence (AI) techniques, challenges,
and approaches in controlling and fighting COVID-19: A review. International Journal
of Environmental Research and Public Health, 19(10), 5901.
https://doi.org/10.3390/ijerph19105901
Amann, Vayena, E., Ormond, K. E., Frey, D., Madai, V. I., & Blasimme, A. (2023).
Expectations and attitudes towards medical artificial intelligence: A qualitative study
in the field of stroke. PloS One, 18(1), e0279088–e0279088.
https://doi.org/10.1371/journal.pone.0279088
Anis, S., & French, J. A. (2023). Efficient, explicatory, and equitable: Why qualitative
researchers should embrace ai, but cautiously. Business & Society, 62(6), 1139-
1144. https://doi.org/10.1177/00076503231163286
Chiu, T. K. (2023). The impact of Generative AI (GenAI) on practices, policies and research
direction in education: A case of ChatGPT and Midjourney. Interactive Learning
Environments, 1-17. https://doi.org/10.1080/10494820.2023.2253861
Chiu, T. K. (2024). Future research recommendations for transforming higher education with
generative AI. Computers and Education: Artificial Intelligence, 6, 100197.
https://doi.org/10.1016/j.caeai.2023.100197
Christou, P. A. (2023a). A critical perspective over whether and how to acknowledge the use
of artificial intelligence (AI) in qualitative studies. The Qualitative Report, 28(7), 1981-
1991. https://doi.org/10.46743/2160-3715/2023.6407
Christou, P. A. (2023b). How to use artificial intelligence (AI) as a resource, methodological
and analysis tool in qualitative research? The Qualitative Report, 28(7), 1968-1980.
https://doi.org/10.46743/2160-3715/2023.6406
Chubb, J., Cowling, P., & Reed, D. (2022). Speeding up to keep up: Exploring the use of AI in
the research process. AI & Society, 37(4), 1439–1457. https://doi.org/10.1007/s00146-
021-01259-0
Ciechanowski, L., Jemielniak, D., & Gloor, P. A. (2020). Tutorial: AI research without coding:
The art of fighting without fighting: Data science for qualitative researchers. Journal of
Business Research, 117, 322-330. https://doi.org/10.1016/j.jbusres.2020.06.012
Cingillioglu, I. (2023). Detecting AI-generated essays: the ChatGPT challenge. The
International Journal of Information and Learning Technology, 40(3), 259-268.
https://doi.org/10.1108/IJILT-03-2023-0043
Dahal, N. (2023a). Digital citizenship and digital ethics: An educator's perspective. In J. DeHart
(Ed.), Critical Roles of Digital Citizenship and Digital Ethics (pp. 249-257). IGI
Global. https://doi.org/10.4018/978-1-6684-8934-5.ch014
Dahal, N. (2023b). Ensuring quality in qualitative research: A researcher's reflections. The
Qualitative Report, 28(8), 2298-2317. https://doi.org/10.46743/2160-3715/2023.6097
Dahal, N., Lamichhnae, B. R., Luitel, B. C., & Pant, B. P. (2023). AI chatbots as math algorithm
problem solvers: A critical evaluation of its capabilities and limitations. Proceedings of
the 28th Asian Technology Conference in Mathematics, 28(1), 429-438.
https://atcm.mathandtech.org/EP2023/regular.html
Denzin, N. K. (2006). Evaluating qualitative research in the poststructural moment: The lessons
James Joyce teaches us. Qualitative Studies in Education, 7(4), 295-308.
https://doi.org/10.1080/0951839940070401
Elali, F. R., & Rachid, L. N. (2023). AI-generated research paper fabrication and plagiarism in
the scientific community. Patterns, 4(3) 1-4.
https://doi.org/10.1016/j.patter.2023.100706
Feuston, J. L., & Brubaker, J. R. (2021). Putting tools in their place: The role of time and
perspective in human-AI collaboration for qualitative analysis. Proceedings of the ACM
on Human-Computer Interaction, 5(CSCW2), 1-25.
732 The Qualitative Report 2024
Author Note
Article Citation
Dahal, N. (2024). How can generative AI (GenAI) enhance or hinder qualitative studies? A
critical appraisal from South Asia, Nepal. The Qualitative Report, 29(3), 722-733.
https://doi.org/10.46743/2160-3715/2024.6637