摘要 | 第5-6页 |
Abstract | 第6-7页 |
Abbreviations | 第13-14页 |
Chapter 1 Introduction | 第14-20页 |
1.1 Research Rationale | 第14-15页 |
1.2 Research Context | 第15-16页 |
1.3 Purpose of This Study | 第16页 |
1.4 Significance of This Study | 第16-17页 |
1.5 Key Terms Used in This Study | 第17-18页 |
1.5.1 Writing Assessment | 第17页 |
1.5.2 Reliability and Validity | 第17-18页 |
1.6 Organization of This Thesis | 第18-20页 |
Chapter 2 Literature Review | 第20-33页 |
2.1 Theoretical Underpinning | 第20-24页 |
2.1.1 Introduction to G-Theory | 第20-22页 |
2.1.2 Reliability in Writing Assessment | 第22-23页 |
2.1.3 Validity in Writing Assessment | 第23-24页 |
2.2 Empirical Studies | 第24-31页 |
2.2.1 Rater Bias in Writing Assessment | 第24-27页 |
2.2.2 Effects of Rater Background on Writing Assessment | 第27-30页 |
2.2.3 Use of G-Theory in Examining the Reliability and Validity of Writing Assessment | 第30-31页 |
2.3 Research gaps | 第31-32页 |
2.4 Summary | 第32-33页 |
Chapter 3 Methodology | 第33-40页 |
3.1 Research Questions | 第33页 |
3.2 Study Design | 第33-36页 |
3.2.1 The Selection of Writing Samples | 第34页 |
3.2.2 The Selection of Raters | 第34-35页 |
3.2.3 The Rating Procedure | 第35-36页 |
3.3 Data Analyses | 第36-38页 |
3.3.1 Descriptive Analyses | 第36页 |
3.3.2 Generalizability Analyses | 第36-38页 |
3.3.3 Computer Programs | 第38页 |
3.4 Questionnaire and Interview | 第38页 |
3.5 Summary | 第38-40页 |
Chapter 4 Results | 第40-56页 |
4.1 Results of Descriptive Statistics | 第40-41页 |
4.2 Results of G-Studies | 第41-48页 |
4.2.1 Results of G-Study for All Raters | 第42页 |
4.2.2 Results of G-Studies for Male and Female Raters | 第42-44页 |
4.2.3 Results of G-Studies for Raters with and without Language Testing Educational Background | 第44-46页 |
4.2.4 Results of G-Studies for Experienced and Inexperienced Raters | 第46-48页 |
4.3 Results of D-Studies | 第48-54页 |
4.3.1 Overall Phi Coefficients for All Raters | 第48-49页 |
4.3.2 Comparisons of Phi Coefficients between Male and Female Raters | 第49-51页 |
4.3.3 Comparisons of Phi Coefficients between Raters with and without Language Testing Educational Background | 第51-52页 |
4.3.4 Comparisons of Phi Coefficients between Experienced and Inexperienced Raters | 第52-54页 |
4.4 Results of Interview | 第54-55页 |
4.5 Summary | 第55-56页 |
Chapter 5 Discussion | 第56-65页 |
5.1 Restatement of Research Purpose and Questions | 第56页 |
5.2 Research Methods | 第56-57页 |
5.3 Major Findings | 第57-61页 |
5.3.1 Descriptive Statistics | 第57页 |
5.3.2 Overall Reliability and Validity of Writing Assessment | 第57-58页 |
5.3.3 Differences in Reliability and Validity between Male and Female Raters | 第58-59页 |
5.3.4 Differences in Reliability and Validity between Raters with and without Language Testing Educational Background | 第59-60页 |
5.3.5 Differences in Reliability and Validity between Experienced and Inexperienced Raters | 第60-61页 |
5.4 Discussion of Results | 第61-64页 |
5.4.1 Discussion on the Differences between Male and Female Raters | 第61-62页 |
5.4.2 Discussion on the Differences between Raters with and without Language Testing Educational Background | 第62-63页 |
5.4.3 Discussion on the Differences between Experienced and Inexperienced Raters | 第63-64页 |
5.5 Summary | 第64-65页 |
Conclusion | 第65-69页 |
Findings | 第65-66页 |
Implications | 第66-67页 |
Limitations | 第67-68页 |
Recommendations for Future Research | 第68-69页 |
References | 第69-75页 |
AppendixA 攻读学位期间所发表的学术论文 | 第75-76页 |
AppendixB | 第76-83页 |
B.1 Rating Criteria | 第76-77页 |
B.2 Questionnaire | 第77-78页 |
B.3 Questions for Interview | 第78-79页 |
B.4 Control Card for G-studies | 第79-83页 |
B.4.1 Control Card for p ⅹ r:g Mixed Effects G-study | 第79-80页 |
B.4.2 Control Card for p ⅹ r:e Mixed Effects G-study | 第80-81页 |
B.4.3 Control Card for p ⅹ r:w Mixed Effects G-study | 第81-82页 |
B.4.4 Control Card for p ⅹ r Random Effects G-study | 第82-83页 |
AppendixC 详细中文摘要 | 第83-86页 |
Acknowledgements | 第86页 |