1 / 42

MIXED METHOD RESEARCH MMR

MK. METIL-PDKL-PPSUB. MIXED METHOD RESEARCH MMR. I WAYAN SUSANTO, D.A. SIHASALE DAN SOEMARNO. Sumber : Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt). MIXED-METHODS DATA ANALYSIS Graduate Seminar in English Language Studies Suranaree , March 2011. Overview.

chenoa
Download Presentation

MIXED METHOD RESEARCH MMR

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MK. METIL-PDKL-PPSUB MIXED METHOD RESEARCHMMR I WAYAN SUSANTO, D.A. SIHASALE DAN SOEMARNO

  2. Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt) MIXED-METHODS DATA ANALYSISGraduate Seminar in English Language StudiesSuranaree, March 2011

  3. Overview • RisetKuantitatifmurni • RisetKualitatifMurni • MMR = Mixed-methods research • Collecting both QUANT and QUAL data using different instruments • MMDA = Mixed-methods data analysis • Usually only QUAL data collected • Data is treated both quantitatively and qualitatively • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  4. KuantitatifatauKualitatif? • QUANT – QUAL distinction in applied linguistics research • QUANT: data is numbers; uses statistics • Experimental research; surveys • QUAL: data is words; uses thematic or narrative interpretation • Conversation analysis; ethnography • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  5. MMR = Mixed-methods research • “MMR melibatkanpengumpulanatauanalisis data kuantitatifdankualitatifdalamsuatustudidenganupayamengintegrasikankeduapendekatanpadasatufaseataulebihdalamprosespenelitiannya” (Dörnyei, 2007) • Tujuan: • Mencapaipemahaman yang tuntas • Triangulasitemuan-temuan. • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  6. Contoh-contoh MMR • Contoh yang jelek • Research into attitudes: survey a large number and interview a predetermined small number of subjects • Purpose: unclear • Contoh yang agaklebihbaik • Research into attitudes: survey a large number of subjects, then, selecting based on questionnaire responses, interview a small number • Purpose: follow-up on interesting results • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  7. Contoh-contoh MMR • An example of the opposite • Interview a small number to gain insights to design a questionnaire, then survey a large number • Purpose: informing instrument design • Another similar example • Research into beliefs: interview 4 teachers but survey 80 students • Purpose: accounting for practicality in using instruments • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  8. Contoh-contoh MMR • Contoh yang fokuspadatriangulasi • Research into strategies: comparing results from different instruments • Much strategy research involves the use of SILL • SILL asks respondents to identify how often they use a particular strategy • Strategy use is context-dependent • Research question: Will recent context of learning change responses to SILL? • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  9. Contoh-contoh MMR • Metode • Subyektunggal • Time 1: read academic articles • Time 2: read short stories for pleasure • Responded to SILL twice • Interviewed 4 times (background interview, after SILL responses, summary interview) • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  10. Contoh-contoh MMR • SILL responses • Showed major differences between 2 times e.g. “If I guess the meaning of a word, later I will check whether my guess is correct by using a dictionary.” rated Always at Time 1; Never at Time 2 • Interview responses • Showed that recent learning contexts influenced different ratings • Triangulation to confirm results or triangulation to provide different perspectives • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  11. MMDA = Mixed-methods data analysis “The most common perception of mixed methods research is that it is a modular process in which qualitative and quantitative components are carried out either concurrently or sequentially. Although this perception is by and large true, it also suggests that the analysis of the data should proceed independently for the QUANT and QUAL phases and mixing should occur only at the final interpretation stage. This conclusion is only partially true … we can also start integrating the data at the analysis stage, resulting in what can be called mixed methods data analysis” Dörnyei (2007) • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  12. MMDA = Mixed-methods data analysis • Monodata-multianalysis—this is the analysis of one type of data using both qualitative and quantitative anslysis. • The logic of this approach is to: • First, analyze your data with the standard approach (e.g., qualitative analysis for your qualitative data or quantitative analysis for your quantitative data). • Second, either qualitative or quantitize one set of data for additional analysis. • Qualitize—transforming quantitative data into qualitative data (e.g., provide names or labels to quantitative characteristics). • Quantitize—transforming qualitative data into quantitative data (e.g., do numerical counts of qualitative categories and themes). • MMDA berarti: • Quantitising qualitative data • Qualitising quantitative data • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  13. Mengkuantitatifkan Data Kualitatif • Kuantifikasiseringkalidilakukansecaratidaksadar • Melakukananalisis “keyword” • Menggunakanskor IELTS dalamriset • Quantitising helps a qualitative analysis by allowing a reliability check • Quantitising can be used to count and compare frequency of themes • Quantitising allows further statistical analysis of data, but information is always lost when converting QUAL to QUANT • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  14. Mengkualitatifkan Data Kuantitatif Websites for Qualitative Data Analysis Programs Program name and Website address AnSWR (freeware) http://www.cdc.gov/hiv/software/answr.htm ATLAS http://atlasti.de/ Ethnographhttp://qualisresearch.com HyperResearchhttp://researchware.com Nvivohttp://www.qsrinternational.com NUD*IST http://www.qsrinternational.com/products_previous-products_n6.aspx (Note: NUD*IST is being replaced by NVivo). • Tidaklazim, jarangdilakukan • Penyusunanprofilnaratif • Using quantitatively obtained questionnaire data in a qualitative description of a subject • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  15. MMDA yang lebihKompleks • Sifat Data of QUANT • Ringkas • Memnungkinkananalisislanjut (Statistikainferensial) • Menyediakaninformasiringkas (ikhtisar) • Sifat Data QUAL • Detail daninformatif • Memungkinkanpemahamankasus-kasus • Menyediakaninformasi yang mendalam • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  16. MMDA yang lebihKompleks • What purposes can mixing QUANT and QUAL data analysis serve? • Illustration for insight • Concise summary to give overview • Preliminary overview to inform analysis • Providing a more well-rounded and more persuasive analysis • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  17. MMDA: IlustrasiuntukPemahaman • In many QUANT studies, it is easy to get lost in the numbers and forget what they mean • If the numbers are derived from QUAL data, it is useful to give a QUAL example to concretise the QUANT findings • In Case 1, the original data is QUAL; this is quantitised for analysis; a QUAL example is given to concretise the data and to show how the quantitative analyses was applied • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  18. MMDA: Ikhtisar • In some QUAL research (primarily involving categorisation or thematisation), the lengthy, detailed data make it difficult to see the overall pattern • It can be useful to provide a QUANT summary as an overview • In Case 2, the data is QUAL and analysed in a QUAL way, but the overall pattern of results is presented as QUANT • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  19. MMDA: TelaahawaluntukAnalisis • In QUAL studies with large amounts of data, it is difficult for the researcher to ensure that all relevant issues have been identified • It is also difficult to see underlying patterns that can be drowned in the sheer quantity of data • It is useful to conduct a preliminary QUANT analysis to ensure all issues and underlying patterns are identified • In Case 3, QUAL data is treated qualitatively to find keywords which then inform a QUAL thematic analysis • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  20. MMDA: Analisis yang lebihpersuasif • In QUAL studies with large amounts of data, restricting analysis to either QUANT or QUAL cannot provide a full picture of the data • QUAL provides detailed description of the data • QUANT provides generalisations of patterns to the whole data set • In Case 4, QUAL and QUANT analyses are used together to produce a fuller description of the data • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  21. Penggunaan Illustration for insight Summarise for overview Inform analysis Provide full picture Pola-pola QUANT → QUAL QUAL → QUANT QUANT → QUAL Mix of QUANT and QUAL Penggunaan MMDA • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

  22. UsingMIXED METHODS RESEARCH to Analyze Surveys Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  23. MMR ituapa? • Sulitmendefiniskannya • Contoh-contohdefinisi • The use of qualitative and quantitative techniques in both the collection and analysis of data • Mixed Methods research is given a priority in the research and the integration of both the quantitative and qualitative results occurs at some point in the research process • Research that includes both quantitative and qualitative data in a single research study, and either the QUAN or QUAL data provides data that would not otherwise be obtainable when using only the primary method Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  24. Mengapa MMR penting? • Answers questions that other modalities cannot • Provides a deeper understanding of the examined behavior or a better idea of the meaning behind what is occurring • The inferences made with mixed methods research can be stronger • Mixed methods research allows for more divergent findings • MM research can include culture in the design by giving a voice to everyone involved in the behavior being examined Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  25. MMR – Kolaboratif • Berupayamelibatkan stakeholders dalamdisaindanprosespenelitian • Can be very beneficial when many of the stakeholders are more likely to be critics • Includes less powerful groups and helps to ensure that they have an equitable impact on the research • Collaboration has the ability to stimulate ways of thinking that might not occur when working individually on a project Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  26. Merancang MMR • The key to any study is the research question(s) because this dictates the selection of the research methods • In designing a study the underlying purpose is the reason for doing it, and is a necessary component • Why are we doing the study? • The quality of the study and the meaningfulness of the results are enhanced if we are clear about the purpose Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  27. EnamKategori MMR • DisainEksplanatoriSekuensial • Disain Exploratory Sekuensial • DisainTransformatifSekuensial • DisainTriangulasiKonkuren • Concurrent Nested Design • DisainTransformatifKonkuren Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  28. DesainEksplanatoriSekuensial • Collection and analysis of QUAN data followed by the collection and analysis of QUAL data • Priority is usually given to QUAN data • Integration of QUAN and QUAL data usually occurs in the interpretation phase of the study • The purpose is usually to use the QUAL results to help explain the QUAN results Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  29. DesainEksploratoriSekuensial • Conducted in two phases • Priority is given to the first phase of QUAL data collection • The second phase involves QUAN data collection • Overall priority is given to QUAL data collection and analysis • The findings are integrated in the interpretation phase • Most basic purpose is to use QUAN data to help interpret the results of the QUAL phase Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  30. DesainTransformatifSekuensial • Mempunyaiduafasepengumpulan data yangtberbeda • Perspektifteoritisdipakaiuntukmengarahkanstudi • Purpose is to use methods that will best serve the theoretical perspective of the researcher Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  31. DisainTriangulasiKonkuren • This is probably the most familiar MM design • The QUAL and QUAN data collection are concurrent, and happen during one data collection phase • Priority could be given to either QUAL or QUAN methods, but ideally the priority between the two methods would be equal • Two methods are integrated in the interpretation phase • The integration focuses on how the results from both methods are similar or different, with the primary purpose being to support each other Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  32. Disain Nested Konkuren • Gathers both QUAL and QUAN data during the same phase • Either QUAL or QUAN dominates the design • The analysis phase mixes both the QUAL and QUAN data • The QUAL data is used to help explain or better understand the QUAN data Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  33. DisainTransformatifKonkuren • Guided by a specific theoretical perspective • The QUAN and QUAL data are collected during the same phase • The integration of data occurs during the analysis phase • The integration of data could occur in the interpretation phase • Again, the purpose is to use methods that will best serve the theoretical perspective of the researcher Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  34. ProsesIntegrasi Data QUAL dan QUAN • The process of integrating QUAL and QUAN research needs to be well thought out prior to the study • QUAL portion needs to be constructed in a way so that more novel information can be discovered • Need to decide if QUAL portion is exploratory or confirmatory • If exploratory, the purpose is to identify other dimensions that the QUAN portion is missing • If confirmatory, the purpose is to support the QUAN relationship • QUAL results can also be used to explain why there wasn’t a statistically significantly difference Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  35. ArahanuntukIntegrasiHasil-hasil QUAL dan QUAN • Selection of research methods need to be made after the research questions are asked • Some methods work well in some domains and not in others • There is no model of integration that is better than another • When there are results that support each other, it is possible that both the QUAN and QUAL results are biased and both are not valid • The main function of integration is to provide additional information where information obtained from one method only was is insufficient • If the results lead to divergent results, then more than one explanation is possible Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  36. Mengintegrasikan Data QUAL dan QUAN • One process of incorporating QUAL data with QUAN data is known as quantitizing, or quantifying the open-ended responses • Dummy Coding (i.e. binarizing) – refers to giving a code of 1 when a concept is present and a code of 0 if it is not present Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  37. MenyajikanTemuan-temuan MMR • As with any research findings, if they cannot be communicated to the people who can use the information than the findings are worthless • Presenting MM research can be more challenging because we are trying to communicate two types of information to readers • For instance, writing-up QUAN research is very well defined, and QUAL research is more often about discovery Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  38. Menjaminrelevansitemuan-temuan MMR • Melibatkansemua stakeholders dalammerencanakanpenelitian • Using MM research design may help a wider range of audiences connect to the material • Make sure to define the language used in the report • It is important to decide how the MM research findings are going to be written: combined or separately Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  39. Contoh MMR • The form was not developed by IR • Evaluated paid tutors on five job qualification areas • Job skills • Job knowledge • Work habits • Communication skills • Attitude • Three point rubric was used to evaluate paid tutors • Did not meet the requirement • Met the requirement • Exceeded requirements • Evaluators were also asked to provide comments Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  40. Contoh MMR • How did I combine the qualification ratings (QUAN) with the evaluator comments (QUAL)? • Found an example of how to do this from Sandelowski (2003) • Sandelowski provided an example where the QUAN responses were categorized and themes for each category were generated from the open-ended comments Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  41. Contoh MMR • First step is to create the categories from the QUAN data • This step involves being very familiar with your data, and also some creativity • With the paid tutor evaluation it was fairly easy to develop the categories • Paid tutors who received a perfect rating in every category (n = 13) • Paid tutors who had an average ranking equal to or above the mean (n = 5) • Paid tutors who had an average below the mean (n = 11) Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

  42. Contoh MMR • Mencampur data QUAL dan QUAN dalamfaseanalisis data • After I created the three categories I printed out the comments associated with the paid tutors for each category and identified a theme for each one Sumber: Keith Wurtz , Senior Research Analyst, Chaffey College. www.chaffey.edu/research

More Related