1 / 36

Pattern Matching for Construct Validity

Pattern Matching for Construct Validity. The Pattern-Matching Model. - Theories - Ideas - Hunches. - Theories - Ideas - Hunches. The Pattern-Matching Model. - Theories - Ideas - Hunches. - Theories - Ideas - Hunches. - Theories - Ideas - Hunches. Conceptualization task.

Download Presentation

Pattern Matching for Construct Validity

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Pattern Matching for Construct Validity

  2. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches

  3. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task

  4. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern

  5. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern - Observations - Data - Measures

  6. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures

  7. The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures

  8. The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Pattern matching Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures - Observations - Data - Measures

  9. The Pattern-Matching Model - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

  10. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

  11. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

  12. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

  13. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

  14. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

  15. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

  16. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Pattern match r Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

  17. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Test questions Algebra Geometry Reading Observational realm

  18. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Geometry Reading Closer if more similar Observational realm

  19. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm

  20. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm

  21. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading High interitem correlation means more similar. Observational realm

  22. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm

  23. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm

  24. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

  25. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

  26. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

  27. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Matrix of inter-item correlations Observational realm

  28. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Patter- Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm

  29. A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm

  30. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Observational realm

  31. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

  32. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

  33. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Estimate of construct validity Pattern match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

  34. Why Does Pattern Matching Work? • Theoretical pattern is like a fingerprint -- more detail is better, if you can match it to reality. • If you find a match to a detailed theoretical pattern, it provides evidence for your theory. • The more detail, the less likely there are alternative explanations (threats) to construct validity.

  35. Disadvantages of Pattern Matching • Requires a detailed conceptual framework • Requires that theoretical and observed patterns are structured the same

  36. Advantages of Pattern Matching • More general and flexible than MTMM • Yields an overall estimate of construct validity • Requires you to specify what you think about the constructs • Treats convergence and discrimination as a continuum

More Related