Developing an Online Test Battery for Testing EFL Pragmatic Competence: What Can It Tell Us?
(1) Institut Agama Islam Negeri Lhokseumawe
(2) Institut Agama Islam Negeri Langsa
(3) The University of Melbourne
(*) Corresponding Author
Abstract
This study aims to develop a practical and reliable test to assess second language pragmatic knowledge as well as to investigate the effect of study abroad experience and proficiency level on EFL learners’ pragmatic competence. A total 59 participants, consisting of 34 females and 29 males, were categorized into groups based on their exposure to the target language and proficiency. The results show that the reliability of the test reaches ?=.798 which means it is acceptable for a language test. Further development of test items is required to achieve more adequate test reliability. The findings also suggest that learners' pragmatic knowledge can be influenced by both study-abroad experience and linguistic competence. These factors may contribute to learners' ability to appropriately respond to pragmatic utterances from the test. Thus, language learners should focus on increasing their linguistic proficiency to enhance their understanding and use of pragmatic language. This study underscores the importance of designing effective language pragmatic tests that incorporate a variety of pragmatics components and comprehensive instruments to achieve the desired test reliability and validity.
Keywords
Full Text:
PDFReferences
Bardovi?Harlig, K. (2013). Developing L2 Pragmatics. Language learning, 63, 68-86.
Bardovi-Harlig, K. (2019). Routines in L2 pragmatics research. In The Routledge handbook of second language acquisition and pragmatics (pp. 47-62). Routledge.
Beltrán-Planques, V., & Querol-Julián, M. (2018). English language learners’ spoken interaction: What a multimodal perspective reveals about pragmatic competence. System, 77, 80-90.
Chen, Y. S., & Lin, M. F. (2021). Effects of peer collaboration on EFL learners’ comprehension of conversational implicatures. System, 97, 102441.
Garcia, P. (2004). Pragmatic comprehension of high and low level language learners. Tesl-Ej, 8(2), n2.
Ishihara, N., & Cohen, A. D. (2022). Teaching and Learning Pragmatics: Where Language and Culture Meet (Second). Routledge.
Jeon, E. H., & Kaya, T. (2006). Effects of L2 instruction on interlanguage pragmatic development. Synthesizing research on language learning and teaching, 165-211.
Kasper, G., & Rose, K. R. (2002). Pragmatic development in a second language. Language learning.
Kim, J. (2019). Being polite or appropriate? The sociolinguistic aspect of politeness in speech acts and a pedagogical approach for pragmatic awareness and strategies focused on refusal. MA TESOL Journal, 5(1), 77–89.
Kim, J., & Lantolf, J. P. (2018). Developing conceptual understanding of sarcasm in L2 English through explicit instruction. Language Teaching Research, 22(2), 208-229.
Köylü, Y. (2018). Comprehension of conversational implicatures in L2 English. Intercultural Pragmatics, 15(3), 373-408.
Longworth, G. (2019). Illocution and understanding. Inquiry, 18(1), 40–57. https://doi.org/10.1080/0020174X.2019.1667869
Petrey, S. (2016). Speech Acts and Literary Theory. Routledge.
Rafieyan, V. (2018). Knowledge of formulaic sequences as a predictor of language proficiency. International Journal of Applied Linguistics and English Literature, 7(2), 64-69.
Ren, W. (2019). Pragmatic development of Chinese during study abroad: A cross-sectional study of learner requests. Journal of Pragmatics, 146, 137-149.
Roever, C. (2006). Validation of a web-based test of ESL pragmalinguistics. Language Testing, 23(2), 229-256.
Roever, C. (2021). Teaching and Testing Second Language Pragmatics and Interaction: A Practical Guide. Routledge.
Roever, C., & Ellis, R. (2021). 7 Testing of L2 pragmatics: The challenge of implicit knowledge. In New Directions in Second Language Pragmatics (pp. 142-155). De Gruyter Mouton.
Roever, C., Fraser, C., & Elder, C. (2014). Testing ESL Sociopragmatics: Development and Validation of a Web-Based Test Battery. Germany: Peter Lang.
Roever, C., Higuchi, Y., Sasaki, M., Yashima, T., & Nakamuro, M. (2023). Validating a test of L2 routine formulae to detect pragmatics learning in stay abroad. Applied Pragmatics, 5(1), 41-63.
Rose, K. R. (2005). On the effects of instruction in second language pragmatics. System, 33(3), 385-399.
Röver, C. (2005). Testing ESL Pragmatics: Development and Validation of a Web-Based Assessment Battery. Germany: Peter Lang.
Soler, E. A., & Hernández, A. S. (2017). Learning pragmatic routines during study abroad: A focus on proficiency and type of routine. Atlantis, 191-210.
Su, Y. (2021). Accepting invitations and offers in second language Chinese: Effect of proficiency on pragmatic competence in interaction. Journal of Pragmatics, 180, 131-149.
Tabatabaei, S., & Tabatabaei, S. (2019). Language proficiency and appropriateness of using refusal speech acts by Iranian EFL learners. Applied Linguistics Research Journal, 4(1), 35-45.
Taguchi, N. (2009). Corpus-informed assessment of comprehension of conversational implicatures in L2 English. TESOL quarterly, 43(4), 738-749.
Taguchi, N. (2018). Contexts and pragmatics learning: Problems and opportunities of the study abroad research. Language Teaching, 51(1), 124-137.
Taguchi, N. (2022). Teaching and learning Pragmatics. In Handbook of practical second language teaching and learning (pp. 499-512). Routledge.
Taguchi, N., & Roever, C. (2017). Second Language Pragmatics. Oxford University Press.
Taguchi, N., & Yamaguchi, S. (2020). Intercultural pragmatics in English as a lingua franca. In Pragmatics pedagogy in English as an international language (pp. 76-94). Routledge.
Taguchi, N., Chen, Y., & Qin, Y. (2023). Metapragmatic knowledge and transfer of learning across speech acts. Applied Linguistics.
Taguchi, N., Hirschi, K., & Kang, O. (2022). Longitudinal L2 development in the prosodic marking of pragmatic meaning: Prosodic changes in L2 speech acts and individual factors. Studies in Second Language Acquisition, 44(3), 843-858.
Trebits, A. (2021). Degree of multilingualism, code-switching and intensity of target language contact predict pragma-linguistic awareness in an English as a foreign language context. International journal of multilingualism, 18(3), 475-490.
Umale, J. (2011). Pragmatic failure in refusal strategies: British versus Omani interlocutors. Arab World English Journal, 2(1), 18-46.
Vidal, C. P., & Shively, R. L. (2019). L2 pragmatic development in study abroad settings. In The Routledge handbook of second language acquisition and pragmatics (pp. 355-371). Routledge.
Ward, G. L. (2016). The Semantics and Pragmatics of Preposing. Routledge.
Yule, G. (2022). The Study of Language. Cambridge University Press. https://doi.org/101017/9781009233446
DOI: http://dx.doi.org/10.30998/scope.v8i1.17418
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Fadhlur Rahman, Ella Yuzar, Wanying Zhou
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License