Validity and Reliability Reports in Applied Linguistics Research Articles: The case of tests and questionnaire

This study intended to determine the way validity and reliability i.e., psychometric properties were reported in the Applied Linguistics research articles. The study also focused on the measurement methods applied to determine the validity and reliability of the scores derived from the tests and questionnaires in the empirical studies. The corpus of the study included ۳۳۱ empirical studies derived from ۷۳۳ research articles (RAs) published between ۲۰۰۵ and ۲۰۱۸ in three prominent Applied Linguistics journals – Applied Linguistics, Modern Language Journal, and TESOL Quarterly, The selected papers used test and/or questionnaire for data collection. Our analysis indicated that ۷۷(۲۰.۹۸%) of the studies did not report validity and reliability measures, ۸۲(۲۲.۳۵%) reported only reliability measures, ۲۶(۷.۰۸%) reported only validity measures, and ۱۸۲(۴۹.۵۹%) reported both the validity and reliability measures for the instruments. It was also found that content validity assessed through the pilot study had the highest frequency among validity evidences while internal consistency, mostly identified by Cronbach's alpha, was the most frequent reliability evidence.

کلیدواژه ها:

validity ، reliability ، Applied Linguistics ، test ، questionnaire