Ruirui Jia

Self-report questionnaires on individual differences (IDs) are central to second language acquisition (SLA) research, yet the qualitative procedures that generate their item pools remain largely unexamined. Drawing on argument-based validation theory and cross-disciplinary measurement guidelines, this study offers the first systematic methodological synthesis of how that formative phase is reported. We reviewed 85 peer-reviewed SLA studies published between 1983 and 2025 that developed or substantially revised an ID scale, coding each along four dimensions: transparency, theoretical grounding, methodological rigor, and content-validity evidence. Four research questions examined how qualitative item development was documented, which methods and frameworks were employed, how item inclusion was justified, and how content validity was assessed. Results expose a pervasive reporting gap: Only 25% of studies described any qualitative data collection, 16% referenced an explicit theoretical framework, 2% linked draft items to participant quotations, and only one study reported a numerical content validity index. Details on coder agreement, reflexivity, and response-process evidence were nearly absent. These gaps threaten construct representativeness, invite cultural bias, and undermine validation claims. We translate our findings into a seven-section reporting checklist for the qualitative phase, with implications for editorial policy, doctoral training, and future meta-analyses.

In the past decade, researchers have been increasingly interested in understanding the process of language learning, in addition to the effect of instructional interventions on L2 performance gains (i.e., learning products). One goal of such investigations is to reveal the interplay between learning conditions, processes, and outcomes where, for example, certain conditions can promote attention to the learning targets, which in turn facilitates learning. However, the statistical modeling approach taken often does not align with the conceptualization of the complex relationships between these variables. Thus, in this paper, we introduce mediation analysis to SLA research. We offer a step-by-step, contextualized tutorial on the practical application of mediation analysis in three different research scenarios, each addressing a different research design using either simulated or open-source datasets. Our overall goal is to promote the use of statistical techniques that are consistent with the theorization of language learning processes as mediators.

We recruited a total of 209 in-person and 209 crowdsourced participants for comparison. Both groups completed the short versions of the Foreign Language Classroom Anxiety Scale and the Foreign Language Enjoyment Scale, provided their demographic and language learning background information, and completed the LexTALE test. Measurement invariance testing revealed that most (sub)constructs exhibited partial or full invariance, indicating stability in the measurement systems across both data collection settings. However, crowdsourced participants reported higher enjoyment and lower anxiety than in-person participants. These differences can be attributed to the more relaxed mental state of the crowdsourced participants who completed the survey outside of the classroom. 

Second language (L2) automaticity is essential to develop L2 proficiency. It features an automatization process from a more controlled, effortful process to a more unconscious, effortless process (McLaughlin et al., 1983). In this article, we offered an overview of L2 automaticity, exploring its conceptual foundations and significance in second language acquisition. We introduce the theoretical frameworks that underpin the study of automaticity and how automaticity relates to major cognitive mechanisms, such as attention and processing speed. We also discuss methodological advancements aimed at measuring automaticity and review empirical studies that have explored ways to promote automaticity and, in turn, linguistic performance.