AUTHORS

Tobie van Dyk

0000-0002-0303-5669

Herculene Kotzé

0000-0001-5816-8090

Piet Murre

ABSTRACT

In this paper a number of variables influencing study success are acknowledged, among others underpreparedness for university education, difficulties with the transition from school to higher education, financial challenges, emotional well-being, motivation, study skills, self-efficacy, and educational background. The paper explores the use of tests as indicators of what students struggle with in terms of their language and literacy abilities, since the results of such tests are often used to inform support practices and curriculum design. Indeed, as is asserted in the literature, one of the purposes of language testing is to provide information to make decisions about possible subsequent courses of action. This is reiterated in discussions of test use, i.e. that data generated by tests should benefit stakeholders. The pertinent question is whether it is responsible merely to use and reuse tests in different, albeit comparable, contexts? Although such a pragmatic approach seems to be justifiable, can it still be considered fair and valid, objectively measuring what it aims to test? Does one size fit all? This paper considers the translation of an Afrikaans academic literacy test, designed for South African universities, into Dutch for use in the Netherlands. Theoretical frameworks for academic literacy and test translation will be presented, as well as empirical data derived from statistical analyses (alpha values, t-tests, p-values, DIF) and qualitative feedback based on interpretations made after consultation with subject experts. The paper will conclude with recommendations on ensuring fair and unbiased practices, particularly in the field of test translation.

CITATION

Van Dyk, T.J., Murre, P., & Kotzé, H. 2021. Does one size fit all? Some considerations for test translation. DOI: 10.21832/9781788926218-006
In Weideman, Albert, Read, John & Du Plessis, Theo (Eds.) Assessing academic literacy in a multilingual society: Transition and transformation, pp. 52-74. Bristol: Multilingual Matters. DOI: 10.21832/WEIDEM6201

ACCESS

View or buy this chapter from De Gruyter –>

REFERENCES

Bachman, L.F. (1990) Fundamental Considerations in Language Testing. Oxford: Oxford
University Press.

Bachman, L.F. (2003) Building and supporting a case for test use. Language Assessment Quarterly 2 (1), 1–34.

Bachman, L.F. (2009) Generalizability and research use arguments. In K. Ercikan and W. Roth (eds) Generalizing from Educational Research: Beyond Qualitative and Quantitative Polarization (pp. 127–148). New York: Routledge.

Bachman, L.F. and Palmer, A.S. (1996) Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford: Oxford University Press.

Ballard, B. and Clanchy, J. (1988) Literacy in the university: An ‘anthropological’ approach. In G. Taylor, B. Ballard, V. Beasley, H.K. Bock, J. Clanchy and P. Nightingale (eds) Literacy by Degrees (pp. 7–23). Milton Keynes: Open University Press.

Barchi-Ferreira, A.M., Loureiro, S.R., Torres, A.R., Da Silva, T.D.A., Moreno, A.L., DeSousa, D.A., Chagas, M.H.N., Dos Santos, R.G., Machado-de-Souza, J.P., Chagas, N.M.S., Hallak, J.E.C., Crippa, J.A.S. and Osório, F.L. (2019) Personality Inventory for DSM-5 (PID-5): Cross-cultural adaptation and content validity in the Brazilian context. Trends Psychiatry Psychother 30 May. DOI: 10.1590/2237-6089-2018-0098.

Beaton, D.E., Bombardier, C., Guillemin, F. and Ferraz, M.B. (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25 (24), 3186–3191.

Blanton, L.L. (1994) Discourse, artefacts and the Ozarks: Understanding academic literacy. Journal of Second Language Writing 3 (1), 1–16.

Butler, G. (2017) Translating the Test of Academic Literacy Levels into Sesotho. Journal for Language Teaching 51 (1), 11–44.

Canale, M. (1983) From communicative competence to communicative language pedagogy. In J.C. Richards and R.W. Schmidt (eds) Language and Communication (pp. 2–14). London: Longman.

Canale, M. and Swain, M. (1980) Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1 (1), 1–47.

Carroll, J.B. (1961) Fundamental considerations in testing for English proficiency of foreign students. In H.B. Allen and R.N. Campbell (eds) (1965) Teaching English as a Second Language: A Book of Readings (pp. 313–330). New York: McGraw Hill.

CITO (2005) TiaPlus User’s Manual. Arnhem: CITO.

Coxhead, A. (2000) A new academic word list. TESOL Quarterl 34 (2), 213–238.

Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T. and McNamara, T. (1999) Dictionary of Language Testing. Cambridge: Cambridge University Press.

Defazio, J., Jones, J., Tennant, F. and Hooke, S.A. (2010) Academic literacy: The importance and impact of writing across the curriculum. Journal of the Scholarship of Teaching and Learning 10 (2), 34–47.

Department of Higher Education and Training (2019) Post-School Education and Training Monitor. Pretoria: Department of Higher Education and Training.

Deygers, B. (2019) Fairness and social justice in English language assessment. In Second Handbook of English Language Teaching (pp. 1–29). New York: Springer.

Fourie, J. and Feinauer, I. (2005) The quality of translated medical research questionnaires. Southern African Linguistics and Applied Language Studies 23 (4), 349–367.

Gee, J.P. (1990) Social Linguistics and Literacies: Ideology in Discourse. London: Falmer.

Gile, D. (2017) Traditions and innovation in Interpreting Studies: A personal analysis for Dominios de Lingua@gem, Uberlandia 11 (5), 1424–1439.

Halliday, M.A.K. (1978) Language as Social Semiotic. London: Edward Arnold.

Halliday, M.A.K. (1985) An Introduction to Functional Grammar. London: Edward Arnold.

Hambleton, R.K. (1993) Translating achievement tests for use in cross-national studies. European Journal of Psychological Assessment 9, 57–68.

Hambleton, R.K. (1994) Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment 10, 229–244.

Hambleton, R.K. (2005) Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton, P.F. Merenda and C.D. Speilberger (eds) Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 3–38). New York: Taylor and Francis Psychology Press.

Hambleton, R.K. and Patsula, L. (1998) Adapting tests for use in multiple languages and cultures. Social Indicators Research 45, 153–171.

Holtzman, J.M., Elliot, N., Biber, C.L. and Sanders, R.M. (2005) Computerized assessment of dental student writing skills. Journal of Dental Education 69 (2), 285–295.

Inspectie van het Onderwijs (2019) Rapport De Staat van het Onderwijs 2019: Onderwijsverslag over 2017/2018. Utrecht: Inspectie van het Onderwijs (Annual report of the Dutch Inspectorate on Education in the Netherlands). See https://www.onderwijsinspectie.nl/documenten/rapporten/2019/04/10/rapport-de-staat-van-hetonderwijs-2019 (accessed July 2019).

International Test Commission (2016) The ITC Guidelines for Translating and Adapting Tests (2nd edn). See http://www.InTest.Com.org (accessed July 2019)

Jacobs, C. (2005) On being an insider on the outside: New spaces for integrating academic literacies. Teaching in Higher Education 10 (4), 475–487.

Koch, E. (2009) The case for bilingual language tests: A study of test adaptation and analysis. South African Linguistics and Applied Language Studies 27 (3), 301–316.

Lamoureux-Hébert, M. and Morin, D. (2009) Translation and cultural adaptation of the supports intensity scale in French. American Journal on Intellectual and Developmental Disabilities 114 (1), 61–66

Laufer, B., Elder, C., Hill, K. and Congdon, P. (2004) Size and strength: Do we need both to measure vocabulary knowledge? Language Testing (21), 202–226

McGorry, S. (2000) Measurement in a cross-cultural environment: Survey translation issues. Qualitative Market Research: An International Journal 3 (2), 74–81.

McNamara, T. (2004) Language testing. In A. Davies and C. Elder (eds) The Handbook of Applied Linguistics (pp. 763–783). Malden, MA: Blackwell.

Mongkolsirikiet, K. and Akaraborworn, C. (2019) A revisit of Holton’s HRD Evaluation and Research Model (2005) for Learning Transfer. Journal of Community Development Research (Humanities and Social Sciences) 12 (2), 15–34.

Munday, J. (2012) Introducing Translation Studies: Theories and Applications (3rd edn). Routledge: New York.

Vereniging Hogescholen (2019) Dashboard studiesucces, uitval en studiewissel. See https://www.vereniginghogescholen.nl/kennisbank/feiten-en-cijfers/artikelen/dashboardstudiesucces-uitval-en-studiewissel (accessed July 2019).

Weideman, A. (2003) Justifying course and task construction: Design considerations for language teaching. Acta Academica 35 (3), 26–48.

Weideman, A. 2021. A skills-neutral approach to academic literacy assessment. In Weideman, Albert, Read, John & Du Plessis, Theo (Eds.) Assessing academic literacy in a multilingual society: Transition and transformation, pp. 22-51.

Weir, C.J. (1990) Communicative Language Testing. London: Prentice Hall.

Weir, C.J. (2005) Language Testing and Validation. Basingstoke: Palgrave Macmillan.

Zajacova, A., Lynch, S.M. and Espenshade, T.J. (2005) Self-efficacy, stress and academic success in college. Research in Higher Education 46 (6), 677–706.

Zamel, V. and Spack, R. (1998) Preface. In V. Zamel and R. Spack (eds) Negotiating Academic Literacies: Teaching and Learning Across Languages and Cultures. Mahwah, NJ: Lawrence Erlbaum.