The effect of ChatGPT on EFL students' social and emotional learning

Wagdi Rashad Ali Bin-Hady (Department of English, Hadhramout University, Socotra, Yemen)
Jamal Kaid Mohammed Ali (Department of English Language and Literature, College of Arts and Letters, University of Bisha, Bisha, Saudi Arabia)
Mustafa Ahmed Al-humari (Department of Languages and Translation, Faculty of Science and Arts-Rafha, Northern Border University, Arar, Saudi Arabia)

Journal of Research in Innovative Teaching & Learning

ISSN: 2397-7604

Article publication date: 17 June 2024

Issue publication date: 22 August 2024

645

Abstract

Purpose

Chat Generative Pre-trained Transformer (ChatGPT) has become everyone’s talk. It frightens many professionals, who worry about losing their jobs. ChatGPT may reconstruct some professions; some occupations may vanish while new ones may appear.

Design/methodology/approach

This mixed-methods study explores whether and how the use of ChatGPT impacts English is taught as a foreign language (EFL) students' social and emotional learning (SEL). The study used a questionnaire and collected perception data from 57 EFL students. A discussion with seven EFL professors was also formulated to triangulate the findings.

Findings

Results indicate that EFL students have high positive perceptions of using ChatGPT in their learning (M = 3.87). Results also showed that using ChatGPT has a moderate impact on EFL students' SEL (R = 514). This moderate effect was confirmed by the qualitative findings, which indicated that ChatGPT positively impacts EFL students' SEL by allowing them to practice conversation skills, aiding them in managing their emotional intelligence, providing them with feedback and reducing their anxiety. However, findings also indicated that ChatGPT reduces students' creativity and limits their emotional growth. Finally, the findings reported that for better use of ChatGPT, supervision is key.

Originality/value

This study recommends the use of ChatGPT in a way that helps students' creativity and emotional growth.

Keywords

Citation

Bin-Hady, W.R.A., Ali, J.K.M. and Al-humari, M.A. (2024), "The effect of ChatGPT on EFL students' social and emotional learning", Journal of Research in Innovative Teaching & Learning, Vol. 17 No. 2, pp. 243-255. https://doi.org/10.1108/JRIT-02-2024-0036

Publisher

:

Emerald Publishing Limited

Copyright © 2024, Wagdi Rashad Ali Bin-Hady, Jamal Kaid Mohammed Ali and Mustafa Ahmed Al-humari

License

Published in Journal of Research in Innovative Teaching & Learning. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


Introduction

Due to how widespread artificial intelligence (AI) applications are and the range of services that they provide, professionals around the globe have been frightened that this “devil,” as described by Tlili et al. (2023), may result in job loss. To relieve this horror, the Secretary-General of the United Nations in July, 2023, called an urgent meeting to determine the use of AI technology in our lives. Since the emergence of Chat Generative Pre-trained Transformer (ChatGPT), hundreds of studies have already been published focusing on the topic from different perspectives. Our focus in this study is on the use of ChatGPT in EFL learning and teaching, a topic which has been the focus of many studies (Bin-Hady et al., 2023; Han et al., 2023; Koraishi, 2023; Liu and Ma, 2023; Mohamed, 2023; Yan, 2023). The previous studies on ChatGPT can be categorized in the use of ChatGPT in EFL informal learning (Liu and Ma, 2023), the application of ChatGPT in English language teaching (Mohamed, 2023), using ChatGPT in language assessment (Koraishi, 2023), integrating ChatGPT in teaching writing (Han et al., 2023; Yan, 2023), proposing a dimensional model of English language learning (Bin-Hady et al., 2023) and the use of ChatGPT in motivating EFL learners (Ali et al., 2023). As the learning process is perceived to be affected by self and social awareness and self and social management, there seems to be an important need for exploring the impact of ChatGPT on EFL social and emotional learning (SEL).

Teachers perceive SEL positively in schools (Bai et al., 2021). Language instructors can integrate SEL into any classroom-based approach (Huda et al., 2022). Previous studies on SEL took various dimensions. Some studies focused on integrating SEL to teach the four language skills (Bai et al., 2021), while others aimed at proposing a SEL model (Suganda et al., 2018). SEL has not been sufficiently explored in contexts where English is taught as a foreign language (EFL) (Bai et al., 2021). Therefore, this study connects ChatGPT as an independent variable with SEL as a dependent variable. Findings of this investigation open new horizons regarding the combination of AI bots with the psychology of students learning. This study explores the following:

  1. Do EFL students have positive perceptions of ChatGPT use in their language learning?

  2. To what extent does ChatGPT have an effect on the dimensions of SEL?

Literature review

EFL AI-based teaching

English language teaching witness a fabulous change due to the widespread of technology (Zhang, 2022). The improvement begins with the leverage of technology in the learning/teaching process. Learning technologies provide various opportunities for students and teachers to obtain during the learning teaching process (Bin-Hady and Ali, 2024; Bin-Hady and Al-Tamimi, 2021; Moqbel and Rao, 2013). Furthermore, the emergence of AI helps teachers and students to push the learning process forwards. AI-based applications have been developed for language teaching in general and, in particular for teaching EFL classrooms. However, not all students and stakeholders perceive AI-based learning positively. One way to understand whether AI could be harmful or beneficial to EFL teaching and learning is to examine the perceptions of teachers and learners (Kim et al., 2021). Professionals within the field of language learning have predicted that chatbots would provide new opportunities for the teaching and learning of languages. Despite the assumed benefits of utilizing chatbots in language classrooms, such as providing opportunities for interaction or helping to create an anxiety-free environment, little is known about learners' actual use of chatbots during language classes or how chatbots affect their motivation to learn a language (Jeon, 2024). This study tries to provide a current view of EFL students' perception on the role of chatbot in their English language learning and its impact on their SEL.

Chatbot technology has various types and can be applied for different functions. Large language models (LLMs) are one such example (Afjal, 2023; Jeon et al., 2023). Similar to Computer-assisted langauge learning (CALL), or Mobile-assisted language learning (MALL), the term artificial intelligence-assisted language learning (AIALL) was introduced (Nong et al., 2021; Bin-Hady et al., 2023). ChatGPT is an AI-powered chatbot where language instructors use it for various purposes and functions in language learning. It induces the meaning of words in context, creates various text types and corrects mistakes in language (Kohnke et al., 2023). These LLMs, which ChatGPT is descended from, are trained on various text types and produce human-like conversation in answering questions and interacting with any task where language is used (Kasneci et al., 2023). LLMs are deep learning models which understand and generate natural language (Shen et al., 2023). Many applications of LLMs are in the literature; what is important to us is the use of LLMs in language teaching and learning.

ChatGPT

Previous research bridged several gaps in ChatGPT use, especially in the educational and language-learning contexts. Several studies tried to produce a model of AI-power language learning (Bin-Hady et al., 2023; Liu and Ma, 2023; Nong et al., 2021). Bin-Hady et al. (2023) produced a penta-dimensional AIALL model for language learning. The model emphasizes the importance of a flexible teacher’s role in promoting learner autonomy, creating an enjoyable learning experience, encouraging future innovation and recognizing diverse applications. Furthermore, Nong et al. (2021) reported that the AIALL model has the potential to enhance primary school students' English proficiency and overall learning ability. Liu and Ma (2023) also presented empirical evidence that highlights the effectiveness of ChatGPT as a language-learning tool for EFL learners. They strongly recommend EFL learners leverage this tool to actively and creatively engage in the ecological CALL. However, the positive effect that such studies reported resulted from using ChatGPT. Other studies (e.g. Chaka, 2023) reported negative perspectives that AI bots plagiarized information without giving credit to authors; they also produced shallow responses to given questions.

Some of the previous research has focused on using ChatGPT for language learning. Jeon et al. (2023) reviewed 37 studies on ChatGPT to get a clear idea about how such chatbots assist students' language learning. Kohnke et al. (2023) investigated the harnessing of ChatGPT in language learning and teaching as well as the competencies required for optimal use of such a chatbot. Furthermore, Bin-Hady et al. (2023) proposed a model for ChatGPT use in students' English language learning. However, the importance of such studies, their focused was oriented on ChatGPT use in the teaching/learning process. Additionally, Agustini (2023) gauged the impact of ChatGPT on students' autonomy. With Agustini’s (2023) study in mind, an urgent question arises: is there an effect of ChatGPT on EFL students' SEL. And is such an effect positive or negative? This query is the center of this study. In the following section, students' SEL will be discussed.

Social and emotional learning

SEL refers to the acquisition and application of skills that enable individuals of all ages to recognize and regulate their emotions, set and achieve positive objectives, understand different viewpoints, cultivate supportive relationships, make responsible choices and effectively navigate personal and interpersonal situations (Osher et al., 2016). Students must develop competencies for SEL; these competencies are divided into four categories, which include 17 skills and attitudes. These groups are centered on developing self-awareness and awareness of others, cultivating positive values and attitudes, making responsible decisions and enhancing social interaction skills (Payton et al., 2000).

SEL has attracted attention in fields other than English as foreign language (Bai et al., 2021). Bai et al. (2021) pinpointed the competency level of EFL students at Hong Kong secondary schools regarding SEL. The study also calculated the correlation between the four SEL components and students' achievement. Results revealed a medium competency level. The study also reported a gap between students' high awareness level and medium awareness level. Likewise, Suganda et al. (2018) designed a creative model for developing EFL Indonesian competence in SEL. The creative social emotional learning English (CSELE) model, included stating the learning objectives and analyzing needs, classroom strategy and assessment. The CSELE model integrates teaching material from the Indonesian curriculum. It also integrates creative teaching which is based on self and social awareness, relationship skills and decision-making responsibility. Findings reported that the CSELE model positively impacted the Indonesian SEL, classroom environment and academic motivation. Suganda et al. (2021) explored the impact of EFL Indonesian teachers code-switching as a classroom strategy in building teachers’ and students’ social and emotional abilities. Several tools were used to collect data including questionnaires, observations and interviews. Findings indicated that code-switching plays a major role in teaching various SEL-based activities in the Indonesian context. Findings also showed that code-switching builds social skills in students and teachers. These three studies were conducted in China and Indonesia. Yet, in Yemen, there seems a necessity to fill such a gap. Furthermore, Bai et al. (2021) recruited secondary school students. Suganda et al. (2021) studied the effect of code switch in building SEL. The current research deals with Yemeni EFL tertiary students.

While the studies reported in this review discuss ChatGPT (e.g. Agustini, 2023; Chaka, 2023) and students' SEL (e.g. Payton et al., 2000; Suganda et al., 2018; Suganda et al., 2021), no study explored the influence of ChatGPT on students' SEL. No previous study showed there is an influence of ChatGPT on EFL students' SEL or not and whether the influence is negative or positive. These queries are the core of the present study.

Methods

Research design

This study used mixed methods research. It quantitatively explored the perceptions of EFL students in several countries on using ChatGPT in language learning. It also qualitatively studied the effects of ChatGPT on students' self and social awareness and self and social management. The study collected data using a questionnaire and discussion from participants in various settings.

Participants

The study collected data from 57 EFL undergraduate students in various settings, Table 1. Students at the beginning were asked if they used ChatGPT in their English language learning. If yes, they continue responding to the questionnaire items. If not, they stop. All students were studying English as a foreign language. They belonged to various contexts with different exposure to English language use and technology access. The sample had different language-learning background and different first languages. They also belong to different cultures. The majority are Asian, some are African and just one is South American. Table 1 shows that the participants were from 16 countries. Most are from Indonesia (N = 24), Jordan (N = 7), Pakistan (N = 6), Libya (N = 4), Saudi Arabia (N = 3) and Iraq (N = 2). Other individuals belonged to other countries like Egypt, Palestine, Togo, Yemen, Kenya, Trinidad and Tobago, India, Iran and Tunisia. Table 1 also indicates that participants included both females (N = 38, 66.7%) and males (N = 19, 33.3%).

Seven professors also participated in ResearchGate discussion. ResearchGate is a platform for scientists and scholars. It combines millions of researchers from the entire world. The researchers selected ResearchGate due to its reliability as many experts in the field of EFL and technology-based learning are available there. Furthermore, those interested researchers can respond willingly in which the researchers avoid discomfort to direct contact with researchers. They belonged to India, Yemen, Saudi Arabia, Iraq, Algeria, Egypt and France. They are professors at universities measured with Teaching English to Speakers of Other Languages (TESOL) and Applied Linguistics.

Instruments

A questionnaire was designed which constructs three parts. The questionnaire is close-ended in line with previous studies’ findings. The questionnaire consists of 32 items. The first part aims to measure the participants' perception of using ChatGPT in English language learning. This constitutes 8 items. The first part of the questionnaire has been prepared by the researchers, using previous studies’ findings (Bin-Hady et al., 2023; Mohamed, 2023) (see Table 3). The second part is adopted from Bai et al. (2021). It focused on probing students' EFL under four subcategories which are self and social awareness and self and social managements. Self-awareness included 5 items and social awareness included 7 items. Self-management consisted of 7 items whereas social management had 5 items (Appendix). The questionnaire was submitted for validation to 3 referees specialized in English language teaching. However, the second part is already validated as it had been used by Bai et al. (2021). The questionnaire was also piloted on 10 students to check its reliability before the final administration. The reliability of the questionnaire was measured using Alpha. Table 2 shows the average Alpha score which reached high level (0.911). Similarly, the individual dimensions of the questionnaire were measured; they scored high ranged from 0.801 into 0.907.

This study opened a discussion on ResearchGate to get opinions from specialists in the field. The discussion question was posted on August 23 and continues till September 23. The discussion question stated, “How does ChatGPT impact EFL students' social and emotional learning?” The post was read by 271 users and answered by 7 users.

Data analysis

This study used SPSS (23rd version) process the data. It obtained descriptive analysis including extracting the mean scores and standard deviation. It also applied Cronbach Alpha to check the reliability of the questionnaire. It also used linear regression to measure the effects of the independent variable (ChatGPT) on students' SEL (dependent variable). Thematic analysis was obtained to analyze the responses of the professors.

The qualitative data were analyzed according to Braun and Clarke (2006). The analysis of qualitative data involves some stages starting familiarizing oneself with the data, then generating codes to identify key concepts, followed by developing broader themes from the codes. The themes are reviewed to ensure they accurately reflect the data, and then they are defined and named. Finally, exemplar cases are located to illustrate the identified themes. The collected data comprised a corpus of 1,500 words. The researcher read and reread the raw data. Three themes emerged which are the positive impact of ChatGPT on EFL students' SEL, the negative impact of ChatGPT on EFL students' SEL a neutral impact of ChatGPT on EFL students' SEL. The first theme comprises five codes with 7 initial responses, the second theme includes two codes with 6 responses and finally, the third theme incorporates three codes with 4 responses. The researchers reread each of the responses many times, at different moments to check that no code was omitted. To check the validity of the analysis, the researchers themselves reworked the categories after two weeks. Slight modifications were added to the first analysis, Table 5.

Results and discussion

RQ1.

Do EFL students have positive perceptive on using ChatGPT in their language learning?

Table 3 indicates that the EFL learners have a high positive perspective, M = 3.87 and Std = 0.575 on the use of ChatGPT in their language learning. The responses ranged between M = 4.04 as the highest mean score and M = 3.63, as the low mean score. This finding showed the high awareness of students toward using technologies in their learning. This finding partially agreed with Aljabr (2023) who reported that Saudi EFL students are highly aware of the important of AI bot in their learning. Aljabr’s (2023) study revealed that student moderately use ChatGPT in their learning. The finding also agreed with Ajlouni et al. (2023) who reported that Jordanian EFL students adopted a high attitude toward using ChatGPT as a learning tool.

RQ2.

To what extent does ChatGPT have an effect on EFL students' SEL? And How?

Table 4 displays the students' perception of the effect of using ChatGPT on their SEL. Table 4 shows that students revealed a total high perception, M = 3.86, Std = 0.65 on the impact of ChatGPT on their SEL. Regarding the individual dimensions of SEL, students reported high perception starting from 3.69 with social management, then social awareness with a Mean score of 3.89. Similarly, the students perceive ChatGPT high with 3.94 for individual awareness and 3.95 for individual management. The standard deviations, which indicate the spread or variability in the data, are all relatively low, ranging from 0.592 to 0.692, suggesting the data are quite homogeneous. To measure the impact of ChatGPT on students' SEL, Table 5 displays the results.

Results in Table 5 indicate a statistically significant positive effect of using ChatGPT on improving the SEL of English language students. The regression coefficient value was 0.432, with the calculated T-value of 4.448 indicated the significance of the regression coefficient, with a probability value of 0.000. This affirms that for every unit increase in the use of ChatGPT, there was a 43.2% increase in the improvement of the SEL of English language students. Furthermore, the correlation is moderate and positive as the value was 0.514. This means that as the use of ChatGPT increased, the improvement in students' SEL also increased and vice versa. The explanatory regression model, as represented by the coefficient of determination (R2 = 0.265), indicating that 26.5% of the changes in the improvement of students' SEL was due to the application of the use of ChatGPT alone (with the other factors remaining constant), while 73.5% of the changes were due to other factors. The calculated F-test, which had a value of 19.783, indicated that the regression model is statistically significant, with a probability value of 0.000.

To triangulate the quantitative results, a thematic analysis of the discussion responses was reported in Table 6.

Positive impact

Based on the responses provided, ChatGPT has the potential to positively impact EFL students' SEL. ChatGPT helps students to practice communication skills (evident in 4 responses). Participant 6 indicates “ChatGPT can facilitate collaboration among EFL students, encourage them to work together on language-learning tasks and projects. This can promote social skills like teamwork, negotiation, and conflict resolution, which are vital for success in both personal and professional contexts”. ChatGPT also aids EFL students to manage their emotion (this is evident in 2 responses). Participant 1 affirms, “ChatGPT helps EFL students develop their emotional intelligence by enhancing their self-awareness, self-regulation, and empathy skills”. It can also provide tailored feedback (evident in 2 responses). Participant 2 says, “ChatGPT can positively impact EFL students' language practice by offering a non-judgmental environment, immediate feedback, and practice opportunities”. Furthermore, ChatGPT has the potential to empower EFL students with cultural understanding (evident in 1 response). Participants 4 opines, “ChatGPT can provide EFL students with insights into different cultures and perspectives, enabling them to better understand and appreciate diverse backgrounds and viewpoints”. Finally, this bot participates in reducing EFL students' L2 performance anxiety (evident in 1 response). Participant 7 views, “Using Chatbots has potential to reduce L2 performance anxiety. It seems that learners are less stressed when talking to a Chatbot than a real human”. These findings are confirmed by Liu and Ma (2023) who highlighted the effectiveness of ChatGPT as a language-learning tool for EFL learners. They strongly recommend EFL learners make use of ChatGPT to develop their language skills in innovative ways.

Negative effect

The second viewpoint displays that ChatGPT has a negative impact on EFL students' SEL. One of the negative sides of ChatGPT is that it reduces users’ creativity and emotional intelligence. This is evident in 3 responses. Participant 5 says, “to my knowledge, students or other users cannot rely on using ChatGPT because it does not help develop critical thinking and emotional learning”. Participant 4 confirms, “ChatGPT reduces users’ creativity and limits their abilities and emotional intelligence”. The second defect that EFL students get while using ChatGPT is that ChatGPT hinders students' emotional growth and cultural comprehension (which is evident in 3 responses). Participant 2 argues, “ChatGPT might lack emotional understanding, context, and genuine human connection, potentially hindering emotional growth and cultural comprehension. Participant 3 reports, “ChatGPT would minimize aspects of social and emotional learning.” ChatGPT has more towards personal interaction rather than social learning. It negatively affects emotional learning, too”. These finding are in line with Chaka (2023) who reported that AI bots plagiarized information without giving credit to the authors; they also produced shallow responses to given questions.

Neutral effect

As we have displayed, various stakeholders consider that ChatGPT has a positive, negative or mixed impact on EFL students’ SEL. Therefore, achieving a balance between the utilization of AI technologies and human interaction is crucial (this is evident in 1 response). Participant 1 says, “it is important to balance the use of AI technologies with human interaction to ensure that students have meaningful social interactions and emotional connections with their peers and teachers”. Another neutral view is that ChatGPT may help no doubt but it could also lead to the laziness (which is evident in one response). Participant 4 mentions, “over-reliance on ChatGPT may lead to the laziness of students and limit critical thinking and emotional growth”. Therefore, the best solution is that AI should be used under supervision. This is evident in 2 responses. Participant 5 reports, “ChatGPT will improve emotional learning, contexts, and cultural understanding if used effectively and under control”. Participant 3 confirms, “ChatGPT can be used as an appropriate AI tool to enhance education if used correctly and controlled by providing relevant information, answering questions, and solving problems”. These findings are supported by Taecharungroj (2023) who revealed that ChatGPT has positive and negative impacts on users. Similarly, Bitzenbauer (2023) affirmed that although ChatGPT has the potential to improve learning outcomes and assist teachers, it is crucial to use it cautiously to address any defects and biases.

These findings have implications on the field of AIALL, policy makers as well as teaching English as a foreign/second language. Beginning with the proponents of AIALL, it is important to shed produce a theoretical model for the use of ChatGPT in a way that collaborates students' learning not to hinder them and makes them bot-dependent. Furthermore, for policy makers especially in the field of course design, they are recommended to produce ChatGPT as a user friendly in the curriculum. They are suggested to add ChatGPT in the University course prescriptions to assertion the understanding of the work of such bots to all students in all departments. Among the content they offer, they are suggested to show some positive ways of using ChatGPT and some others in which ChatGPT should not be used. Amongst the implications are for teachers and students in the field of English language learning and teaching, teachers should introduce ChatGPT as a teaching stagey as well as evaluation strategy for students. EFL teachers should make their students acquaintance how to use of AI tools in the learning process. Furthermore, students may be warned that they are not allowed to use AI in producing their written tasks or preparing their presentation because such AI tools cannot produce the task as human do. Such tools are observed to have great benefits (Sullivan et al., 2023). Users need to acquire competencies for using such AI tools (Kasneci et al., 2023). Furthermore, as the study reports, ChatGPT may have some negative consequences; therefore, EFL teachers should prevent students from interacting with such bots all the time. Teachers should make time for students to respond, interact and solve the learning activities themselves under the teacher’s observation.

Conclusion

This study focused on the effect of using ChatGPT on EFL students' SEL. Students strongly perceive on a positive impact of ChatGPT in their English language learning. The study reported medium effects of this chatbot on EFL students’ SEL. The effect is found in 3 forms: positive, negative and neural. The positive impact was induced and stemmed from ChatGPT participating in boosting EFL students' communication skills, aiding them to manage their emotion effectively, providing them with feedback, acquainting them with different cultures and reducing students' anxiety. These advantages are more likely providing students with a rich environment for language practice and aiding them with whatever they need socially, emotionally and academically. Findings also showed some warning that ChatGPT may affect students by reducing creativity and hindering their emotional growth. These negatives should be prevented; EFL teachers as well as students at higher levels, should try to stop using ChatGPT in areas which would affect their emotional learning and creativity. Finally, the study highlighted a need to make use of ChatGPT under the supervision of teachers.

However, the important result of this study is that no research is complete. This study has some limitations; it just reflects the perceptions of EFL students who have already used ChatGPT. Moreover, the sample is constructed from participants in ten countries. Furthermore, as reported previously, this study reported the perceptions. Empirical studies are needed to check the real use of ChatGPT by students in certain contexts and the impact of AI bots on students' SEL. Therefore, these findings cannot be generalized. This study recommends further research to explore some solutions for the negative impacts that ChatGPT may have on students' learning.

Sample nationality and gender

Country CountColumn N %CountryCountColumn N %
Indonesia2543.1Togo11.7
Jordan712.1Yemen11.7
Libya46.9Kenya11.7
Saudi Arabia35.2Trinidad and Tobago11.7
Iraq23.4India11.7
Pakistan610.3Iran11.7
Egypt11.7Tunisia11.7
Palestine11.7Total57100.0
GenderFemale3866.7
Male1933.3
Total57100.0

Source(s): Authors’ own work

Reliability of the questionnaire items

DimensionsN of itemsCronbach’s alpha
ChatGPT80.801
Individual awareness50.823
Social awareness70.841
Individual management70.907
Social management50.811
Average320.911

Source(s): Authors’ own work

EFL students' perception on using ChatGPT in their language learning

StatementsNMeanStd. Deviation
1. I use ChatGPT to improve my English language skills in conversational practice573.791.047
2. ChatGPT provides personalized language instruction573.930.798
3. ChatGPT adapts each learner’s level and pace to improve the learning experience573.630.899
4. ChatGPT exposes me to a wide range of language use which enhances my language proficiency573.930.798
5. ChatGPT is a highly accessible language-learning option for EFL learners of all levels574.040.865
6. ChatGPT is a cost-effective language-learning option for EFL learners of all levels573.860.766
7. ChatGPT provides me with feedback573.950.933
8. ChatGPT can effectively ignite my creativity573.810.971
Average573.870.575

Source(s): Authors’ own work

EFL students' perception on the impact of using ChatGPT on their language learning

DimensionsNMeanStd. Deviation
Social awareness573.890.692
Individual awareness573.940.647
Individual management573.950.592
Social management573.690.684
Valid N (listwise)573.860.65

Source(s): Authors’ own work

The effect of ChatGPT on EFL students' social and emotional learning

Unstandardized coefficientsStandardized coefficients RR2FSig
ModelBStd. ErrorBetatSig
Constant2.2020.3800.5145.8010.0000.514a0.26519.7830.000b
ChatGPT0.4320.0974.4480.000

Note(s): a = Predictors (Constant); b= Dependent variable

Source(s): Authors’ own work

The qualitative findings reported three points of views

QuestionDescriptive categorySub-category [number of responses endorsing each sub-category]
The impact of ChatGPT on EFL students' SEL1. Positive impact of ChatGPT on EFL students' SEL1. ChatGPT can help EFL students practice their communication skills [4]
2. ChatGPT can teach EFL students how to identify and manage their own emotions more effectively [2]
3. ChatGPT can offer tailored feedback and support to individual EFL students [2]
4. ChatGPT can provide EFL students with insights into different cultures and perspectives [1]
5. Using Chatbots has potential to reduce L2 performance anxiety [1]
2. Negative impact of ChatGPT on EFL students' SEL1. ChatGPT reduces users’ creativity and emotional intelligence [3]
2. ChatGPT hinders students' emotional growth and cultural comprehension [3]
3. Neutral impact of ChatGPT on EFL students' SEL1. ChatGPT should be used in balanced with human interaction [1]
2. ChatGPT may help no doubt but it could also lead to the laziness of students [1]
3. AI should be used under supervision [2]

Source(s): Authors’ own work

StatementsMeanStd. Deviation
ChatGPT
These items are displayed in Table 3
Individual awareness1. I am aware of what I am feeling (e.g. happy, anxious and bored) in English learning3.73680.97333
2. I know what I do or do not well in English learning3.98250.83434
3. I know what I want to achieve in English learning and how to achieve it3.87720.82527
4. I am aware of the importance of a positive attitude towards English learning3.92980.79865
5. I am aware that successful English learning depends on myself4.17540.78200
Social awareness1. I think that my classmates and I should help each other in English learning4.12280.88782
2. I know whom (e.g. siblings, parents, classmates and teachers) I can seek help from in English learning3.69641.09411
3. I know what family resources (e.g. private tutoring, buying books and English programs) I have in English learning3.87721.05340
4. I know what school resources (e.g. school library, English clubs and overseas exchange programs) I have in English learning3.78570.96699
5. I think that English learning can be better facilitated through group activities3.98250.79037
6. I know that my classmates’ success stories in English learning can provide me with new insights into my own English learning3.87720.94624
7. I am aware that my contribution to group activities in English learning is important3.92860.93141
Individual management1. I can manage my emotions (e.g. happiness, anxiety and boredom) in English learning3.82460.80451
2. I can solve my problems in English learning3.91230.76253
3. I can find effective ways to learn English4.01750.66792
4. I can set and achieve goals in English learning4.01750.69414
5. I can stay focused on my English learning3.92980.79865
6. I can keep a positive attitude towards English learning3.98180.80487
7. I can cope with challenges in English learning3.98210.64642
Social management1. My classmates and I help each other in English learning3.71930.75010
2. My classmates and I engage in collaborative activities in English learning3.61400.90147
3. I have discussions on English learning with my classmates3.68420.86928
4. I seek suggestions from other people (e.g. siblings, parents, classmates and teachers) in English learning3.64911.02628
5. I try to find out why some classmates have learned English well3.78950.95874

Source(s): Authors’ own work

Appendix

Table A1

References

Afjal, M. (2023), “ChatGPT and the AI revolution: a comprehensive investigation of its multidimensional impact and potential”, Library Hi Tech, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/LHT-07-2023-0322.

Agustini, N.P.O. (2023), “Examining the role of ChatGPT as a learning tool in promoting students' English language learning autonomy relevant to Kurikulum Merdeka Belajar”, Edukasia: Jurnal Pendidikan Dan Pembelajaran, Vol. 4 No. 2, pp. 921-934, doi: 10.62775/edukasia.v4i2.373.

Ajlouni, A.O., Wahba, F.A.A. and Almahaireh, A.S. (2023), “Students' attitudes towards using ChatGPT as a learning tool: the case of the university of Jordan”, International Journal of Interactive Mobile Technologies, Vol. 17 No. 18, pp. 99-117, doi: 10.3991/ijim.v17i18.41753.

Ali, J.K.M., Shamsan, M.A.A., Hezam, T.A. and Mohammed, A.A. (2023), “Impact of ChatGPT on learning motivation: teachers and students' voices”, Journal of English Studies in Arabia Felix, Vol. 2 No. 1, pp. 41-49, doi: 10.56540/jesaf.v2i1.51.

Aljabr, F. (2023), “Gauging the Saudi EFL learners' level of awareness and attitudes towards the use of ChatGPT”, Information Sciences Letters, Vol. 12 No. 11, pp. 3101-3109, doi: 10.18576/isl/121120.

Bai, B., Shen, B. and Wang, J. (2021), “Impacts of social and emotional learning (SEL) on English learning achievements in Hong Kong secondary schools”, Language Teaching Research, Vol. 28 No. 3, pp. 1176-1200, doi: 10.1177/136216882110217.

Bin-Hady, W.R.A. and Al-Tamimi, N.O.M. (2021), “The use of technology in informal English language learning: evidence from Yemeni undergraduate students”, Learning and Teaching in Higher Education: Gulf Perspectives, Vol. 17 No. 20, pp. 107-120, doi: 10.1108/LTHE-09-2020-0037.

Bin-Hady, W.R.A. and Ali, J.K.M. (2024), “A study of Yemeni EFL students' perceptions on the role of learning technologies in developing creativity and autonomy”, Library Hi Tech, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/LHT-08-2023-0373.

Bin-Hady, W.R.A., Al-Kadi, A., Hazaea, A. and Ali, J.K.M. (2023), “Exploring the dimensions of ChatGPT in English language learning: a global perspective”, Library Hi Tech, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/LHT-05-2023-0200.

Bitzenbauer, P. (2023), “ChatGPT in physics education: a pilot study on easy-to-implement activities”, Contemporary Educational Technology, Vol. 15 No. 3, p. ep430, doi: 10.30935/cedtech/13176.

Braun, V. and Clarke, V. (2006), “Using thematic analysis in psychology”, Qualitative Research in Psychology, Vol. 3 No. 2, pp. 77-101, doi: 10.1191/1478088706qp063oa.

Chaka, C. (2023), “Generative AI chatbots-ChatGPT versus YouChat versus Chatsonic: use cases of selected areas of applied English language studies”, International Journal of Learning, Teaching and Educational Research, Vol. 22 No. 6, pp. 1-19, doi: 10.26803/ijlter.22.6.1.

Han, J., Yoo, H., Kim, Y., Myung, J., Kim, M., Lim, H., Kim, J., Lee, T. Hong, H., Ahn, S. and Oh, A. (2023), “RECIPE: how to integrate ChatGPT into EFL writing education”, Proceedings of the Tenth ACM Conference on Learning @ Scale, Association for Computing Machinery, pp. 416-420, doi: 10.1145/3573051.3596200.

Huda, A.I.N., Mohamad, M. and Abd Rahman, M.J. (2022), “Integrating social and emotional learning (SEL) in the ESL classroom to improve creative writing among year 6 pupils”, International Journal of Academic Research in Business and Social Sciences, Vol. 12 No. 5, pp. 52-61, doi: 10.6007/ijarbss/v12-i6/13950.

Jeon, J. (2024), “Exploring AI chatbot affordances in the EFL classroom: young learners' experiences and perspectives”, Computer Assisted Language Learning, Vol. 37 Nos 1-2, pp. 1-26, doi: 10.1080/09588221.2021.2021241.

Jeon, J., Lee, S. and Choe, H. (2023), “Beyond ChatGPT: a conceptual framework and systematic review of speech-recognition chatbots for language learning”, Computers and Education, Vol. 206, 104898, doi: 10.1016/j.compedu.2023.104898.

Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., Weller, J., Kuhn, J. and Kasneci, G. (2023), “ChatGPT for good? On opportunities and challenges of large language models for education”, Learning and Individual Differences, Vol. 103, 102274, doi: 10.1016/j.lindif.2023.102274.

Kim, H.S., Cha, Y. and Kim, N.Y. (2021), “Effects of AI chatbots on EFL students' communication skills”, Korean Journal of English Language and Linguistics, Vol. 21, pp. 712-734.

Kohnke, L., Moorhouse, B.L. and Zou, D. (2023), “ChatGPT for language teaching and learning”, RELC Journal, Vol. 54 No. 2, pp. 4-12, doi: 10.1177/00336882231162868.

Koraishi, O. (2023), “Teaching English in the age of AI: embracing ChatGPT to optimize EFL materials and assessment”, Language Education and Technology, Vol. 3 No. 1, pp. 55-72.

Liu, G. and Ma, C. (2023), “Measuring EFL learners' use of ChatGPT in informal digital learning of English based on the technology acceptance model”, Innovation in Language Learning and Teaching, Vol. 18 No. 2, pp. 1-14, doi: 10.1080/17501229.2023.2240316.

Mohamed, A.M. (2023), “Exploring the potential of an AI-based chatbot (ChatGPT) in enhancing English as a foreign language (EFL) teaching: perceptions of EFL faculty members”, Education and Information Technologies, Vol. 29 No. 3, pp. 1-23, doi: 10.1007/s10639-023-11917-z.

Moqbel, M.S. and Rao, L.P. (2013), “Enhancing EFL teaching and learning through technology”, International Journal of Social Science Tomorrow, Vol. 2 No. 2, pp. 1-9.

Nong, L., Liu, G. and Tan, C. (2021), “An empirical study on the implementation of AI assisted language teaching for improving learner's learning ability”, 2021 Tenth International Conference of Educational Innovation through Technology (EITT), IEEE, pp. 215-221, doi: 10.1109/EITT53287.2021.00050.

Osher, D., Kidron, Y., Brackett, M., Dymnicki, A., Jones, S. and Weissberg, R.P. (2016), “Advancing the science and practice of social and emotional learning: looking back and moving forward”, Review of Research in Education, Vol. 40 No. 1, pp. 644-681, doi: 10.3102/0091732x16673595.

Payton, J.W., Wardlaw, D.M., Graczyk, P.A., Bloodworth, M.R., Tompsett, C.J. and Weissberg, R.P. (2000), “Social and emotional learning: a framework for promoting mental health and reducing risk behavior in children and youth”, Journal of School Health, Vol. 70 No. 5, pp. 179-185, doi: 10.1111/j.1746-1561.2000.tb06468.x.

Shen, Y., Heacock, L., Elias, J., Hentel, K.D., Reig, B., Shih, G. and Moy, L. (2023), “ChatGPT and other large language models are double-edged swords”, Radiology, Vol. 307 No. 2, e230163, doi: 10.1148/radiol.230163.

Suganda, L.A., Petrus, I., Zuraida, Z. and Kurniawan, D. (2018), “A study on the creative social emotional learning English (CSELE) classroom model in Indonesian context”, The Journal of English Literacy Education: The Teaching and Learning of English As a Foreign Language, Vol. 5 No. 1, pp. 34-41.

Suganda, L.A., Petrus, I. and Zuraida, Z. (2021), “EFL teacher's code switching in the social emotional learning context”, Indonesian Research Journal in Education| IRJE|, Vol. 5 No. 2, pp. 317-344, doi: 10.22437/irje.v5i2.12195.

Sullivan, M., Kelly, A. and McLaughlan, P. (2023), “ChatGPT in higher education: considerations for academic integrity and student learning”, Journal of Applied Learning and Teaching, Vol. 6 No. 1, pp. 1-10, doi: 10.37074/jalt.2023.6.1.17.

Taecharungroj, V. (2023), “‘What can ChatGPT do?’ Analyzing early reactions to the innovative AI chatbot on Twitter”, Big Data and Cognitive Computing, Vol. 7 No. 1, p. 35, doi: 10.3390/bdcc7010035.

Tlili, A., Shehata, B., Adarkwah, M.A., Bozkurt, A., Hickey, D.T., Huang, R. and Agyemang, B. (2023), “What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education”, Smart Learning Environments, Vol. 10 No. 1, p. 15, doi: 10.1186/s40561-023-00237-x.

United Nations (2023), Secretary-General Urges Security Council to Ensure Transparency, Accountability, Oversight, in First Debate on Artificial Intelligence, United Nations, New York, available at: https://press.un.org/en/2023/sgsm21880.doc.htm

Yan, D. (2023), “Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation”, Education and Information Technologies, Vol. 28 No. 11, pp. 1-25, doi: 10.1007/s10639-023-11742-4.

Zhang, W. (2022), “The role of technology-based education and teacher professional development in English as a foreign language classes”, Frontiers in Psychology, Vol. 13, 910315, doi: 10.3389/fpsyg.2022.910315.

Further reading

Nall, M. (2020), “Supporting social and emotional learning in the EFL/ESL classroom: how the new science of child development can inform second language acquisition theory and practice”, Journal of English Learner Education, Vol. 10 No. 1, p. 5.

Acknowledgements

Ali, J. K. M. is thankful to the Deanship of Graduate Studies and Scientific Research at University of Bisha for supporting this work through the Fast-Track Research Support Program.

Al-humari, M. A. extends his appreciation to the Deanship of Scientific Research at Northern Border University, Arar, KSA for funding this research (No. NBU-FFR-2024–2964–01).

Corresponding author

Wagdi Rashad Ali Bin-Hady can be contacted at: wagdyrashad@hu.edu.ye

Related articles