International Journal of Practical and Pedagogical Issues in English Education

International Journal of Practical and Pedagogical Issues in English Education

Evaluating Cohesion as a Predictor of Writing Quality: An Analysis of Local, Global, and Text-Level Indices in IELTS Writing Task 2

Document Type : Original Article

Authors
Centre for Academic Writing, Middle East College, Muscat, Oman
Abstract
This study examines the predictive validity of local, global, and text-level cohesion indices for human ratings of Cohesion and Coherence (CC) in IELTS Writing Task 2. A corpus consisting of 105 essays rated by official IELTS examiners was analyzed using the Tool for the Automatic Analysis of Cohesion (TAACO 2.0.4). Forty cohesion indices were extracted and correlated with CC scores using Spearman’s Rank Correlation. The results revealed that additive connectives and overall connectives use relate positively to CC scores, while too much redundant local lemma overlap relates negatively. In the global category, overlap of function lemmas and semantic similarity between paragraphs were positively correlated with higher ratings. At the text level, lexical diversity (MATTR and TTR) positively correlated most strongly, while lexical repetition had a negative effect on perceived quality. This suggests that selective and varied use of cohesive devices enhances writing quality, whereas repetition detracts from it. Further implications for automated essay scoring and L2 writing instruction are discussed.
Keywords

Subjects


 Abdi Tabari, M., & Johnson, M. D. (2023). Exploring new insights into the role of cohesive devices in written academic genres. Assessing Writing, 57, 100749. https://doi.org/10.1016/j.asw.2023.100749
Abdi Tabari, M., & Wind, A. (2023). Dynamic development of cohesive devices in English as a second language writing. International Review of Applied Linguistics in Language Teaching. https://doi.org/10.1515/iral-2022-0205
Abdi Tabari, M., Johnson, M. D., & Farahanynia, M. (2023). Automated analysis of cohesive features in L2 writing: Examining effects of task complexity and task repetition. Assessing Writing, 58, 100783. https://doi.org/10.1016/j.asw.2023.100783
Abdi Tabari, M., Johnson, M., & Gao, J. (2024). Using automated indices of cohesion to explore the growth of cohesive features in L2 writing. International Review of Applied Linguistics in Language Teaching. https://doi.org/10.1515/iral-2023-0185
Cotton, F., & Wilson, K. (2011). An investigation of examiner rating of coherence and cohesion in the IELTS academic writing task 2. IELTS Research Reports, 12, 1–76.
Crossley, S. A. (2020). Linguistic features in writing quality and development: An overview. Journal of Writing Research, 11(3), 415–443. https://doi.org/10.17239/jowr-2020.11.03.01
Crossley, S. A., Kyle, K., & Dascalu, M. (2019). The Tool for the Automatic Analysis of Cohesion 2.0: Integrating semantic similarity and text overlap. Behavior Research Methods, 51(1), 14–27. https://doi.org/10.3758/s13428-018-1142-4
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016a). The development and use of cohesive devices in L2 writing and their relations to judgments of essay quality. Journal of Second Language Writing, 32, 1–16. https://doi.org/10.1016/j.jslw.2016.01.003
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016b). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods, 48(4), 1227–1237. https://doi.org/10.3758/s13428-015-0651-7
Crossley, S. A., & McNamara, D. S. (2010). Cohesion, coherence, and expert evaluations of writing proficiency. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd annual conference of the cognitive science society (pp. 984–989). Austin, TX: Cognitive Science Society.
Crossley, S. A., & McNamara, D. S. (2011). Text coherence and judgments of essay quality: Models of quality and coherence. In L. Carlson, C. Hoelscher, & T. F. Shipley (Eds.), Proceedings of the 29th annual conference of the cognitive science society (pp. 1236–1241). Austin, TX: Cognitive Science Society.
Ebrahimi, S. F., & Mallaki, A. (2024). The pronoun “this” in civil engineering research articles. International Journal of Practical and Pedagogical Issues in English Education, 2 (2), 1, 12. https://doi.org/10.22034/ijpie.2024.461451.1021
Granados, A., & Lorenzo, F. (2021). English L2 connectives in academic bilingual discourse: A longitudinal computerized analysis of a learner corpus. Revista Signos, 54(106), 626–644. https://doi.org/10.4067/s0718-09342021000200626
Halliday, M. A. K., & Hasan, R. (1976). Cohesion in English. Longman.
Haswell, R. H. (2000). Documenting improvement in college writing. Written Communication, 17(3), 307–352. https://doi.org/10.1177/0741088300017003001
Jafarpur, A. (1991). Cohesiveness as a basis for evaluating compositions. System, 19(4), 459–465. https://doi.org/10.1016/0346-251X(91)90026-L
Johnson, P. (1992). Cohesion and coherence in compositions in Malay and English. RELC Journal, 23(2), 1–17. https://doi.org/10.1177/003368829202300201
King, M. L., & Rentel, V. (1979). Toward a theory of early writing development. Research in the Teaching of English, 13, 243–253.
Louwerse, M. (2001). An analytic and cognitive parametrization of coherence relations. Cognitive Linguistics, 12(3), 291–316. https://doi.org/10.1515/cogl.2002.005
McCutchen, D., & Perfetti, C. A. (1982). Coherence and connectedness in the development of discourse production. Text-Interdisciplinary Journal for the Study of Discourse, 2(1–3), 113–140. https://doi.org/10.1515/text.1.1982.2.1-3.113
McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication, 27, 57–86. https://doi.org/10.1177/0741088309351547
McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14(1), 1–43. https://doi.org/10.1207/s1532690xci1401_1
Morallo, A. B. (2024). Cross-cultural and cross-proficiency analysis of selected cohesion indices in student essays. Journal of English and Applied Linguistics, 3(1), 7.
Neuner, J. L. (1987). Cohesive ties and chains in good and poor freshman essays. Research in the Teaching of English, 21, 92–105.
Tasouji Azari, M. & Mohammadi, K. (2024). Book review: The Routledge Handbook of Discourse Analysis, edited by Michael Handford and James Paul Gee (2023). International Journal of Practical and Pedagogical Issues in English Education, 2(4), 91-97. https://doi.org/10.22034/ijpie.2024.474284.1042
Tywoniw, R., & Crossley, S. (2019). The effect of cohesive features in integrated and independent L2 writing quality and text classification. Language Education and Assessment, 2(3), 110–134. https://doi.org/10.29140/lea.v2n3.151
Yang, W., & Sun, Y. (2012). The use of cohesive devices in argumentative writing by Chinese EFL learners at different proficiency levels. Linguistics and Education, 23(1), 31–48. https://doi.org/10.1016/j.linged.2011.09.004
Zhang, M. (2000). Cohesive features in the expository writing of undergraduates in two Chinese universities. RELC Journal, 31(1), 61–95. https://doi.org/10.1177/003368820003100104
Volume 3, Issue 4
Autumn 2025
Pages 97-117

  • Receive Date 27 July 2025
  • Revise Date 14 September 2025
  • Accept Date 18 October 2025