This study examined the scores on a state standards-based Grade 5 Science assessment obtained by a group of students without learning disabilities who took the standard form of the test and by three groups of students with learning disabilities: one taking the standard form of the test without accommodations or modifications, a second taking the test with accommodations, and a third group taking the test with modifications. The groups received accommodations or modifications that were specified in their 504 or IEP plans. Unlimited time was granted to complete the test. A series of item-level, then parcel-level, exploratory and confirmatory factor analyses investigated whether or not the assessment demonstrated factorial invariance for the four groups of students studied. The results of this study help substantiate the validity of test scores for students with disabilities who take the test with the particular set of accommodations or modifications that were used in this study. In addition, the results lend support to modifying this state's policy in order to aggregate scores obtained by students without learning disabilities and by students with learning disabilities who have taken the assessment with accommodations or modifications required by their 504 plans or IEPs for AYP purposes. Appended are: (1) Observed Reporting Strand Intercorrelation Matrices by Group Adjusted for Attenuation; (2) Parcel-Covariance Matrices; (3) Summary of Parcel-Level Exploratory Factor Analyses by Group; and (4) Summary of Factor Loadings and Residuals From Final Parcel-Level Multi-Group Confirmatory Factor Analyses. (Contains 26 tables, 4 figures and 17 notes.)
Authors
- Authorizing Institution
- Educational Testing Service
- Education Level
- ['Elementary Education', 'Grade 5']
- Peer Reviewed
- F
- Publication Type
- ['Numerical/Quantitative Data', 'Reports - Research']
- Published in
- United States of America
Table of Contents
- Examining the Factor Structure of a State Standards-Based Science Assessment for Students with Learning Disabilities 1
- Jonathan Steinberg 1
- Frederick Cline 1
- Yasuyo Sawaki 1
- September 2011 1
- List of Approved Accommodations and Modifications Used in Grade 5 Science 11
- Number of Items by Content Area and Grade Level for Grade 5 Science 20
- Raw Score Summary Statistics for Grade 5 Science Factor Analysis Samples 21
- N N 21
- Figure 1. 23
- Total Test and Strand Length-Adjusted Reliabilities by Group 23
- Correlations of Observed Strand Scores to Total Test Score 24
- Summary of Proposed Factor Analyses 25
- Figure 2. 28
- Original Grade 5 Science Parcel Design 30
- Figure 3. 31
- Summary of Parcel Factor Loadings on General Science Factor 32
- Figure 4. 33
- Summary of Individual-Group Parcel-Level Confirmatory Factor Analysis Results 34
- Latent Factor Intercorrelation Matrices From Three-Factor Individual-Group Confirmatory 35
- Factor Analysis Models 35
- Summary of Proposed Parcel-Level Multi-Group Confirmatory Factor Analyses 36
- Summary of Parcel-Level Multi-Group Confirmatory Factor Analysis Results 37
- Summary of Revised Parcel-Level Multi-Group Confirmatory Factor Analysis Results 38
- Summary of Standardized Factor Loadings for Final Factor Invariance Model 38
- Journal of the 42
- Academy of Marketing Science 16 42
- Applied 42
- Psychological Measurement 12 42
- Confirmatory factor analysis for applied research 42
- Testing structural equation models . 42
- Structural equation modeling with LISREL PRELIS and SIMPLIS Basic 42
- Structural equation modeling with EQS Basic concepts applications and 42
- Psychometrika 10 42
- Structural Equation Modeling 9 42
- The essentials of factor analysis. 42
- Psychometrika 40 42
- Journal of Educational Statistics 13 43
- Exceptionality 12 43
- Psychological Methods 4 43
- Educational Measurement Issues and Practice 13 43
- Multivariate Behavioral Research 23 43
- Exceptional Children 67 43
- School Psychology Review 29 43
- British Journal of Statistical Psychology 17 43
- Journal of Special Education 32 43
- Structural equation modeling Concepts issues and applications 44
- Structural Equation Modeling 6 44
- Applied Measurement in 44
- Education 19 44
- Applied Measurement 44
- LISREL 8 users reference guide 44
- PRELIS 2 users reference guide 44
- Principles and practices of structural equation modeling. 44
- Empirical comparison between factor analysis and item 44
- Educational Evaluation and Policy 44
- Analysis 22 44
- Effects of a reading accommodation on the validity of a 44
- Structural Equation Modeling 9 44
- Biometrika 57 45
- British Journal of 45
- Mathematical and Statistical Psychology 27 45
- School Psychology Review 32 45
- Personality and Individual Differences 45
- Journal of Educational Statistics 11 45
- The foundations of factor analysis 45
- Psychometrika 45
- Sociological Methods and 45
- Research 18 45
- Applied Measurement in Education 7 45
- Review of Educational 45
- Research 71 45
- A first course in structural equation modeling. 45
- Journal 45
- The internal construct validity of the SAT 46
- Licensure testing Purposes procedures and practices 46
- SASSTAT users guide Version 6 46
- The effects of test accommodations on test 46
- Review of Educational Research 75 46
- The effect of using computers as an 46
- The new rules of measurement what every psychologist and educator 46
- Interaction Hypothesis differential boost 47
- Reporting Strand Intercorrelation Matrix for Grade 5 Science Group 1 51
- Reporting Strand Intercorrelation Matrix for Grade 5 Science Group 2 51
- Parcel Variance-Covariance Matrix - Group 1 53
- Parcel Variance-Covariance Matrix - Group 2 53
- Parcel Variance-Covariance Matrix - Group 3 54
- Parcel Variance-Covariance Matrix- Group 4 54
- Note. 55
- Note. 56
- Note. 57
