Using Action Research to Advance Planning and Learning (Part 1)

1. Using Action Research to Advance Planning and Learning (Part 1) Lisa Armour, Ph.D. Vice President for Assessment, Research, and Technology Santa Fe College Wendi Dew Director, Faculty and Instructional Development Valencia College

2. Today’s Learning Outcomes • Identify the elements of action research • Give examples of action research frames as means for inspiring professional development for faculty • Relate action research frames to iterative cycles of improvement within a department or division • Discuss action research as a tool for meeting department planning and learning goals • Identify resources available to faculty conducting action research projects

3. Action research attempts to provide some insight into how students learn. It encourages teachers, counselors and librarians to use their classrooms, offices and libraries as laboratories for the study of learning. Tom Angelo

4. Action Research supports data-informed decision-making by faculty. • The purpose of action research is to make decisions • Research questions derive from individual practice • Theory plays a secondary role (McMillan, J. H. & Wergin. J. F., Understanding and Evaluating Educational Research)

5. Action Research is • A deliberate, solution-oriented investigation • Characterized by spiraling cycles of • problem identification • systematic data collection • analysis • reflection • data-driven action • problem redefinition • (Kemmis & McTaggart, The Action Research Planner)

6. Act Plan Act Plan Reflect Observe Act Plan Reflect Observe Reflect Observe Continuous Improvement

7. “Ways in” to the Scholarship of Teaching and Learning (SoTL) • Examine unexplained student successes, in order to replicate or build on them • Focus on critical and challenging teaching goals and/or student learning outcomes • Apply general, research-based principles for good practice in teaching and learning to our specific practice • Examine a hunch (developed through observation and practice) about what is likely to work • Focus on a common problem or an issue that seems to recur Tom Angelo

8. Which action research frames (or “ways in” to SoTL) could you emphasize to inspire professional development in your department?

9. Action Research supports improved individual practice, and serves as an incubator for institutional innovations. • Applied research develops faculty as informed change agents, focused on improving student learning through reflective teaching • Faculty insights, based on direct observation of students, contribute to innovative institutional practices and programs related to student engagement and learning • Direct evidence of student learning informs institutional strategy

10. Elements of an Action Research Project • Clear Goals (Abstract and Research Question) • Adequate Preparation • Appropriate Methods • Significant Results • Reflective Critique • Effective Presentation

11. Writing an Effective Research Question • Does it address a persistent problem or area of concern in the class/professional setting? • Is it specific, significant, and related to improving student learning? • Can the goal or standard for students’ achievements be clearly stated? • What kind of evidence can be produced to show the situation as it is? • Is it within the faculty member’s power to address the question (teaching strategies, classroom activities, student assignments)? • Is it feasible in terms of time, effort and available resources? • Can action be taken based on the results? • Is this an area where the faculty member is willing to make a change?

12. Do you have experience with research questions embedded in Faculty Learning Outcomes associated with action research? If so, do they typically exhibit the qualities of an effective research question? • How can you inspire faculty to pursue research that assists you in meeting department learning goals? • How can you coach faculty to ensure the research questions they pose are feasible in terms of time, effort, and available resources?

13. Elements of an Action Research Project • Clear Goals • Adequate Preparation (Perspectives) • Appropriate Methods • Significant Results • Reflective Critique • Effective Presentation

14. Finding answers to educational problems is a complex undertaking. Whether awareness of the problem arises as a result of classroom observation, the reading of learned journals or armchair theorising, there is always a range of perspectives that can be brought to bear on a problem. Mary Ainley and Sarah Buckley Action Research supports reflective or scholarly teaching.

15. Perspectives to Consider • Look at the work from multiple perspectives • Student • Colleague • Expert • Self

16. What do • interaction with students • interaction with colleagues • the literature • your personal experience • tell you about topics of importance in your department or discipline?

17. Elements of an Action Research Project • Clear Goals • Adequate Preparation • Appropriate Methods (Methods and Assessment) • Significant Results • Reflective Critique • Effective Presentation

18. Student Learning Outcomes, Performance Indicators, and Assessments • Are the Student Learning Outcomes observable, measurable, and consistent with shared expectations (e.g. Course Outlines) • Do identified Performance Indicators provide convincing evidence of student learning? • Will the chosen assessments provide direct evidence of mastery of the Student Learning Outcomes? • Validity is the extent to which an assessment measures what it is supposed to measure.

19. Teaching Strategies, Action Research and Methodology Design • For an action research project, consider these questions: • What teaching strategies are appropriate for achieving the Student Learning Outcomes? • What data would convince other professionals (particularly faculty members in the discipline) of the level of student mastery of the Student Learning Outcomes? • How can the project be organized and described so that it will serve as a catalyst for improvement as well as a blueprint? • Focus on one or two valid measures of the project’s impact. • Reliability is the extent to which an experiment is repeatable and yields consistent results.

20. Please join us after the break for Part 2!

21. Using Action Research to Advance Planning and Learning (Part 2) Lisa Armour, Ph.D. Vice President for Assessment, Research, and Technology Santa Fe College Wendi Dew Director, Faculty and Instructional Development Valencia College

22. What are the student learning outcomes central to student success in your department or discipline? • What are some related performance indicators and assessment measures? • Would these assessment measures be considered convincing by most faculty in your discipline? • How can you promote the use of assessment measures considered convincing by most faculty in your discipline within individual action research projects?

23. Elements of an Action Research Project • Clear Goals • Adequate Preparation • Appropriate Methods • Significant Results (Project Results) • Reflective Critique • Effective Presentation

24. Action Research makes a difference! • Are results described clearly and completely? • Did the students achieve the Student Learning Outcomes? • What if they did not achieve the SLOs?

25. Interpretation of Results • Cause and Effect vs. Correlation • Action research may reveal correlation between variables, but often it will not establish a cause and effect relationship. • Controlled experiments are needed to convince sophisticated readers of a cause and effect relationship between variables. • Faculty may choose to make cases for cause and effect based on their professional judgment. If they do, they should explain the factors informing their judgment.

26. Explanations • When correlation is claimed, explanations other than cause/effect (confounding variables) should be considered and explained. • What perceived impact did the project have in terms of changes in knowledge, abilities, attitudes, values and commitment of students or faculty? • Were the results as expected?

27. How can we use action research to make learning more meaningful to students?

28. Elements of an Action Research Project • Clear Goals • Adequate Preparation • Appropriate Methods • Significant Results • Reflective Critique (General Reflection, Essential Competencies) • Effective Presentation

29. Action research includes reflection about what has happened, as well as reflection about what should happen next. In a reflective critique, faculty Analyze the project Apply professional judgment Share insights Describe plans for improvement Express personal observations in a professional manner

30. Elements of an Action Research Project • Clear Goals • Adequate Preparation • Appropriate Methods • Significant Results • Reflective Critique • Effective Presentation

31. Effective Presentation • Spelling, grammar, and style are important • Pay attention to language and tone • Charts and graphs should be used when possible • “Accessible” (audience-appropriate) statistics should be provided • Measures of central tendency and measures of variation should be included when quantitative data are described. • Valencia’s Action Research Builder provides structure

32. Learning-centered Planning and Assessment • Learning-centered questions are the essential foundation for strategic planning and learning-centered program assessment • Key Questions • “Ways In” to an iterative cycle of improvement • What do we want to change or improve about student learning, development and/or the student experience? • How will this impact student learning? • How will we know?

33. Planning Essentials:A Cascading Mission Institution Cascading Mission, Goals and Outcomes • Meaningful connection to institutional planning across all units • Critical alignment to the mission and goals • Meaningful assessment and improvement “down and in” • Creates opportunities for unit-to-unit collaboration Individual - Kurt Ewen, Valencia College

34. Planning Essentials:Collaborative, Inter-related Reflection and Planning Cycles Assessment Measures and Criteria for Success Use data to make decisions to improve over time Document and analyze evidence - Kurt Ewen, Valencia College

35. Some “ways in” to the Scholarship of Teaching and Learning (slide 8) for individual faculty are • Focus on critical and challenging teaching goals and/or student learning outcomes • Focus on a common problem or an issue that seems to recur • How can you partner with faculty conducting action research so their “ways in “ to SoTL have the additional benefit of serving as department or division “ways in” to an iterative cycle of improvement?

36. Planning and LearningOutcomes to Assessment • Planning Objectives/Outcomesare brief, clear statements that describe the desired outcomes of the organization, division, or unit • Division Action Plan (academic units) • Department Action Plan (non-academic units, Student Affairs) • May or may not be learning outcomes • Learning Objectives/Outcomesare clear statements that describe the desired learning result • What students should be able to know or do at the end of a program, course or co-curricular experience (specific skills, values, and attitudes) • Curricular and co-curricular learning outcomes

37. How will you ensure alignment of your planning goals and outcomes, as well as the college’s learning goals and outcomes with • The Faculty Learning Outcomes associated with individual projects (specifically action research projects) • Student Learning Outcomes associated with individual faculty projects • What resources are available to faculty conducting action research projects? • What resources are available to deans sponsoring action research projects?

38. Thanks for participating!