A Sample Analysis of Empirical Validity in the Articles Publishedin A Lifetime of Language Testing Journal

Sampling has long been a central concern in planning empirical research because of its significant impact on the accuracy and quality of the findings. Validation studies are particularly sample oriented because their findings are assumed to be context and sample dependent. An analysis of samples and sampling in such studies will be of interest and benefit to language testing researchers and professors to illustrate the representation of stakeholders in language testing research. This study is a systematic review on the sampling issues in all the empirical validity articles published in the lifespan of Language Testing Journal. The issues of concern were sampling frame, sampling method, and specific characteristics of samples including gender, age, and language. The study used a qualitative approach and all the articles were qualitatively annotated, coded and analyzed. The findings revealed that the researchers predominantly used simple random sampling. A majority of the articles failed to present the age and gender of the samples. Further, sample gender and age range were reported in ۴۰% and ۲۶% of the articles respectively. The published articles favored dominantly an anglophone orientation and context (۲۲%). Sampling frame notoriously received no attention and was missing in the articles. The implications of the findings will help future researchers, and research and assessment course professors.

کلیدواژه ها:

sampling ، empirical research ، validation ، systematic review ، language testing