Journal Evaluation in Education (JEE)

Education in the ChatGPT Era: A Sentiment Analysis of Public Discourse on the Role of Language Models in Education

Niel Francis B. Casillano — Mon, 28 Oct 2024 22:53:45 +0700

Purpose of the study: This research explored the public discourse on the role of language models in education, particularly ChatGPT.

Methodology: The study employed sentiment analysis, word cloud analysis, and thematic analysis of YouTube video news transcripts.

Main Findings: The study identified key themes and public perceptions surrounding AI's role in education. The analysis revealed frequent mentions of AI, education, and learning, highlighting AI's transformative potential in personalizing education and improving administrative efficiency. The study also emphasizes significant concerns about academic integrity, with terms like cheating and plagiarism reflecting ethical apprehensions. The sentiment analysis revealed a compound sentiment of 0.866, a generally positive perception of AI's impact on education. However, some negative sentiments were recorded, particularly around data privacy and potential biases. The thematic analysis identified five key topics: the future of AI and human intelligence, AI in education and learning enhancement, innovative teaching tools and technologies, AI-assisted writing and learning tools, and ethics and academic integrity in AI usage. The findings revealed the importance of developing robust ethical guidelines and policies for integrating AI into educational settings and the need for further research into the long-term impacts of AI on teaching methodologies.

Novelty/Originality of this study: The research used YouTube news transcripts to explore public discourse on ChatGPT's role in education, providing real-time insights into societal perceptions. Combining sentiment, word cloud, and thematic analyses offers a balanced examination of the transformative potential and ethical concerns surrounding AI in education.

Assessment of PhD Research and Evaluation Program: Insights from the Graduate Tracer Study

Mon, 28 Oct 2024 00:00:00 +0700

Purpose of the study: The study assessed the effectiveness of the PhD in Research and Evaluation (PhD RE) program in a state university in Central Visayas, Philippines by examining the career trajectories and competencies of its graduates from 2017 to 2024.

Methodology: The study utilized a mixed-methods approach, employing online surveys and open-ended questionnaires distributed through Google Forms. Descriptive statistics was used to analyzed quantitative data, while Braun and Clarke’s thematic analysis was used for qualitative data.

Main Findings: The main findings indicate that PhD RE graduates excel in research, instruction, and leadership, with most achieving professional advancement. Employers provided positive feedback, highlighting the graduates’ critical thinking, problem-solving, and research capabilities.

Novelty/Originality of this study: This study is novel in that it focuses on PhD graduates in Research and Evaluation and offers fresh perspectives on how the degree affects research competencies and career advancement. The study advances understanding on doctorate programs by outlining the need for more mentoring and interdisciplinary collaboration and making recommendations for curriculum enhancements.

Career Choice Shift of the English Students Based on Gender

Tue, 29 Oct 2024 00:00:00 +0700

Purpose of Study: Exploring the students’ motivations for studying in the English departments, comparing career choices and interests based on gender, and determining the ‘time’ and reasons for shifting careers.

Methodology: This study employed mixed methods. The sample was drawn through proportional random sampling and involved 1100 students from the English departments in Lombok, Indonesia. 380 male and 820 female students, more than 25 percent of the total, filled out the Google Forms questionnaire. The data were collected through questionnaires and academic documents. Quantitative data analysis employed descriptive statistics, while qualitative analysis used ‘Iterative Analysis.’

Main Findings: 1) Being a teacher is the primary motivation for studying in the English departments; 2) Females far dominate men in the choice of the teaching profession, while males in the tourism and hospitality sector; 3) But, career choice shift occurs at the end of the study motivated by socio-economic orientation. So, curriculum developers should consider biological and socio-cultural aspects of English education gender. Further studies should be conducted on the interrelation of gender and socio-cultural and religious perspectives.

Novelty/Originality of this Study: The choice of work of the students of the English departments in Indonesia is still determined by its suitability with gender. Some studies on career shifts in universities have been carried out, but a specific study that explored the career choice shift of English department students based on gender has never been carried out. This is the ‘novelty.’ Nevertheless, this study did not include the students’ religion-based educational background.

Technology and Livelihood Education Learning Brochures for Grade 7 Students

John Paul C. Demapendan, Emily Anne T. Aquino, Gracelle P. Hilario — Tue, 29 Oct 2024 01:13:44 +0700

Purpose of the study: The study focuses on developing and evaluating Technology and Livelihood Education (TLE) brochures for 7th-grade students, aiming to address educational gaps specifically lack of instructional materials among TLE exploratory subjects.

Methodology: The methodology involved a needs assessment survey to identify the least learned competencies in TLE 7. Select experts evaluated criteria such as design, standards alignment, content quality, and ease of use. The suggestions and recommendations were thematically analyzed to improve the learning brochures further. Cost analysis was employed to determine the cost of producing the learning materials.

Main Findings: Expert evaluations rated the brochures highly across design, standards alignment, content quality, and ease of use, with recommendations for improving graphic elements and layout consistency. The cost analysis confirmed the affordability and local availability of production materials. Additionally, a proposed Instructional Brochure Development Framework was introduced, encompassing five phases: Conceptualization, Designing, Development, Evaluation, and Refinement.

Novelty/Originality of this study: The study advocates the use of learning brochures as instructional material in Technology and Livelihood Education and proposes an Instructional Brochure Development Framework for designing and developing learning brochures for other subjects.

The English Competencies of Tourism High School Students

Intan Fajrian Nurika, Natasha Engelbrecht, Amina Zemieche — Tue, 29 Oct 2024 01:32:38 +0700

Purpose of the study: This study was designed to investigate what are the competencies of tourism high school students in DKI Jakarta.

Methodology: There were 420 students of 21 tourism high schools in DKI Jakarta that participated in this study. Theoretical (study of theoretical literature and sources) and empirical methods of the research data obtaining methods (students and teachers’ interviews, teachers and students questionnaire, and unstructured observation) and also both qualitative and quantitative data processing method were used in this study.

Main Findings: The result showed that the most needed skill to work in tourism industries is speaking skill. Students were expected to have good oral communication since it was useful when they had a job training program in real industry. They need more vocabularies which are in tourism terminology. However, the result of teachers’ instruments indicated more than 75% English teachers focus on national examination which is mean that students learned more in reading rather than speaking. Teachers also followed a curriculum which is provided for all major of vocational high school. The curriculum compilers were not develop curriculum for each major. It means that the curriculum itself was in general ideas. The teachers should select and develop the appropriate materials for students’ major.

Novelty/Originality of this study: It can be concluded that the tourism high school students need good oral communication by improving speaking and also listening skill to achieve both learning objective stated in Regulation Number 22 year 2006 and industry needs.