720 likes | 1.1k Views
Reading : Course-Pack Chapters 17 – 18, 23 - 26. SAMPLING DISTRIBUTION FOR PROPORTIONS AND MEANS CONFIDENCE INTERVALS FOR PROPORTIONS AND MEANS HYPOTHESES TESTINGS FOR PROPORTIONS AND MEANS. SAMPLING DISTRIBUTION MODELS. SAMPLING DISTRIBUTION MODEL FOR A PROPORTION
E N D
Reading: Course-Pack Chapters 17 – 18, 23 - 26 • SAMPLING DISTRIBUTION FOR PROPORTIONS AND MEANS • CONFIDENCE INTERVALS FOR PROPORTIONS AND MEANS • HYPOTHESES TESTINGS FOR PROPORTIONS AND MEANS
SAMPLING DISTRIBUTION MODELS • SAMPLING DISTRIBUTION MODEL FOR A PROPORTION PROBLEM FORMULATION: SUPPOSE THAT p IS AN UNKNOWN PROPORTION OF ELEMENTS OF A CERTAIN TYPE S IN A POPULATION. EXAMPLES • PROPORTION OF LEFT - HANDED PEOPLE; • PROPORTION OF HIGH SCHOOL STUDENTS WHO ARE FAILING A READING TEST; • PROPORTION OF VOTERS WHO WILL VOTE FOR MR. X.
ESTIMATION OF p • TO ESTIMATE p, WE SELECT A SIMPLE RANDOM SAMPLE (SRS), OF SIZE SAY, n = 1000, AND COMPUTE THE SAMPLE PROPORTION. • SUPPOSE THE NUMBER OF THE TYPE WE ARE INTERESTED IN, IN THIS SAMPLE OF n = 1000 IS x= 437. THEN THE SAMPLE PROPORTION IS COMPUTED USING THE FORMULA
WHAT IS THE ERROR OF ESTIMATION? • THAT IS, WHAT IS • WHAT MODEL CAN HELP US FIND THE BEST ESTIMATE OF THE TRUE PROPORTION OF p? • LET’S START THE ANALYSIS BY FIRST ANSWERING THE SECOND QUESTION.
APPROACH • SUPPOSE THAT WE TAKE A SECOND SAMPLE OF SIZE 1000 AND COMPUTE P(HAT); CLEARLY, THE NEW ESTIMATE WILL BE DIFFERENT FROM 0.437. NOW, TAKE A THIRD SAMPLE, A FOURTH SAMPLE, UNTIL THE TWO THOUSANDTH (2000 –TH) SAMPLE, EACH OF SIZE 1000. IT IS OBVIOUS THAT WE WILL LIKELY OBTAIN TWO THOUSAND DIFFERENT P(HATS) AS ILLUSTRATED IN THE TABLE BELOW.
TABLE OF 2000 SAMPLES OF SIZE EACH n=1000, AND THEIR CORRESPONDING P(HATS)
WHAT DO WE DO WITH THE DATA FOR P(HATS)? • WE CONSTRUCT A HISTOGRAM OF THESE 2000 P(HATS). # OF SAMPLES p P(HATS)
THE HISTOGRAM ABOVE IS AN EXAMPLE OF WHAT WE WOULD GET IF WE COULD SEE ALL THE PROPORTIONS FROM ALL POSSIBLE SAMPLES. THAT DISTRIBUTION HAS A SPECIAL NAME. IT IS CALLED THE SAMPLING DISTRIBUTION OF THE PROPORTIONS. • OBSERVE THAT THE HISTOGRAM IS UNIMODAL, ROUGHLY SYMMETRIC, AND IT’S CENTERED AT P.
WHAT DOES THE SHAPE OF THE HISTOGRAM REMIND US ABOUT A MODEL THAT MAY JUST BE THE RIGHT ONE FOR SAMPLE PROPORTIONS? • ANSWER: IT IS AMAZING AND FORTUNATE THAT A NORMAL MODEL IS JUST THE RIGHT ONE FOR THE HISTOGRAMS OF SAMPLE PROPORTIONS. • HOW GOOD IS THE NORMAL MODEL? • IT IS GOOD IF THE FOLLOWING ASSUMPTIONS AND CONDITIONS HOLD.
ASSUMPTIONS AND CONDITIONS • ASSUMPTIONS • INDEPENDENCE ASSUMPTION: THE SAMPLED VALUES MUST BE INDEPENDENT OF EACH OTHER. • SAMPLE SIZE ASSUMPTION: THE SAMPLE SIZE, n, MUST BE LARGE ENOUGH • REMARK: ASSUMPTIONS ARE HARD – OFTEN IMPOSSIBLE TO CHECK. THAT’S WHY WE ASSUME THEM. GLADLY, SOME CONDITIONS MAY PROVIDE INFORMATION ABOUT THE ASSUMPTIONS.
CONDITIONS • RANDOMIZATION CONDITION: THE DATA VALUES MUST BE SAMPLED RANDOMLY. IF POSSIBLE, USE SIMPLE RANDOM SAMPLING DESIGN TO SAMPLE THE POPULATION OF INTEREST. • 10% CONDITION: THE SAMPLE SIZE, n, MUST BE NO LARGER THAN 10% OF THE POPULATION OF INTEREST. • SUCCESS/FAILURE CONDITION: THE SAMPLE SIZE HAS TO BE BIG ENOUGH SO THAT WE EXPECT AT LEAST 10 SUCCESSES AND AT LEAST 10 FAILLURES. THAT IS,
THE CENTRAL LIMIT THEOREM FOR THE SAMPLING DISTRIBUTION OF A PROPORTION • FOR A LARGE SAMPLE SIZE n, THE SAMPLING DISTRIBUTION OF P(HAT) IS APPROXIMATELY THAT IS, P(HAT) IS NORMAL WITH
EXAMPLE 1 • ASSUME THAT 30% OF STUDENTS AT A UNIVERSITY WEAR CONTACT LENSES • (A) WE RANDOMLY PICK 100 STUDENTS. LET P(HAT) REPRESENT THE PROPORTION OF STUDENTS IN THIS SAMPLE WHO WEAR CONTACTS. WHAT’S THE APPROPRIATE MODEL FOR THE DISTRIBUTION OF P(HAT)? SPECIFY THE NAME OF THE DISTRIBUTION, THE MEAN, AND THE STANDARD DEVIATION. BE SURE TO VERIFY THAT THE CONDITIONS ARE MET. • (B) WHAT’S THE APPROXIMATE PROBABILITY THAT MORE THAN ONE THIRD OF THIS SAMPLE WEAR CONTACTS?
EXAMPLE 2 • INFORMATION ON A PACKET OF SEEDS CLAIMS THAT THE GERMINATION RATE IS 92%. WHAT’S THE PROBABILITY THAT MORE THAN 95% OF THE 160 SEEDS IN THE PACKET WILL GERMINATE? BE SURE TO DISCUSS YOUR ASSUMPTIONS AND CHECK THE CONDITIONS THAT SUPPORT YOUR MODEL. • SOLUTION
SAMPLING DISTRIBUTION OF THE SAMPLE MEANAPPROACH FOR ESTIMATINGSAME AS FOR SAMPLING DISTRIBUTION FOR PROPORTIONSILLUSTRATED ABOVE
ASSUMPTIONS AND CONDITIONS • ASSUMPTIONS • INDEPENDENCE ASSUMPTION: THE SAMPLED VALUES MUST BE INDEPENDENT OF EACH OTHER • SAMPLE SIZE ASSUMPTION: THE SAMPLE SIZE MUST BE SUFFICIENTLY LARGE. • REMARK: WE CANNOT CHECK THESE DIRECTLY, BUT WE CAN THINK ABOUT WHETHER THE INDEPENDENCE ASSUMPTION IS PLAUSIBLE.
CONDITIONS • RANDOMIZATION CONDITION: THE DATA VALUES MUST BE SAMPLED RANDOMLY, OR THE CONCEPT OF A SAMPLING DISTRIBUTION MAKES NO SENSE. IF POSSIBLE, USE SIMPLE RANDOM SAMPLING DESIGN TO ABTAIN THE SAMPLE. • 10% CONDITION: WHEN THE SAMPLE IS DRAWN WITHOUT REPLACEMENT (AS IS USUALLY THE CASE), THE SAMPLE SIZE, n, SHOULD BE NO MORE THAN 10% OF THE POPULATION. • LARGE ENOUGH SAMPLE CONDITION: IF THE POPULATION IS UNIMODAL AND SYMMETRIC, EVEN A FAIRLY SMALL SAMPLE IS OKAY. IF THE POPULATION IS STRONGLY SKEWED, IT CAN TAKE A PRETTY LARGE SAMPLE TO ALLOW USE OF A NORMAL MODEL TO DESCRIBE THE DISTRIBUTION OF SAMPLE MEANS
CENTRAL LIMIT THEOREM FOR THE SAMPLING DISTRIBUTION FOR MEANS • FOR A LARGE ENOUGH SAMPLE SIZE, n, THE SAMPLING DISTRIBUTION OF THE SAMPLE MEAN IS APPROXIMATELY • THAT IS, NORMAL WITH
EXAMPLE 3 • SUPPOSE THE MEAN ADULT WEIGHT, , IS 175 POUNDS WITH STANDARD DEVIATION, , OF 25 POUNDS. AN ELEVATOR HAS A WEIGHT LIMIT OF 10 PERSONS OR 2000 POUNDS. WHAT IS THE PROBABILITY THAT 10 PEOPLE WHO GET ON THE ELEVATOR OVERLOAD ITS WEIGHT LIMIT? • SOLUTION
EXAMPLE 4 • STATISTICS FROM CORNELL’S NORTHEAST REGIONAL CLIMATE CENTER INDICATE THAT ITHACA, NY, GETS AN AVERAGE OF 35.4 INCHES OF RAIN EACH YEAR, WITH A STANDARD DEVIATION OF 4.2 INCHES. ASSUME THAT A NORMAL MODEL APPLIES. • (A) DURING WHAT PERCENTAGE OF YEARS DOES ITHACA GET MORE THAN 40 INCHES OF RAIN? • (B) LESS THAN HOW MUCH RAIN FALLS IN THE DRIEST 20% OF ALL YEARS? • (C) A CORNELL UNIVERSITY STUDENT IS IN ITHACA FOR 4 YEARS. LET y (bar) REPRESENT THE MEAN AMOUNT OF RAIN FOR THOSE 4 YEARS. DESCRIBE THE SAMPLING DISTRIBUTION MODEL OF THIS SAMPLE MEAN, y (bar). • (D) WHAT’S THE PROBABILITY THAT THOSE 4 YEARS AVERAGE LESS THAN 30 INCHES OF RAIN?
CONFIDENCE INTERVALS FOR PROPORTIONS ESTIMATION POINT ESTIMATION PRODUCES A NUMBER (AN ESTIMATE) WHICH IS BELIEVED TO BE CLOSE TO THE VALUE OF UNKNOWN PARAMETER. FOR EXAMPLE: A CONCLUSION MAYBE THAT “PROPORTION P OF LEFT-HANDED STUDENTS IN MSU IS APPROXIMATELY O.46”
INTERVAL ESTIMATION • PRODUCES AN INTERVAL THAT CONTAINS THE ESTIMATED PARAMETER WITH A PRESCRIBED CONFIDENCE. • A CONFIDENCE INTERVAL OFTEN HAS THE FORM:
DEFINITION • GIVEN A CONFIDENCE LEVEL C%, THE CRITICAL VALUE IS THE NUMBER SO THAT THE AREA UNDER THE PROPER CURVE AND BETWEENIS C (IN DECIMALS).
WHAT DOES C% CONFIDENCE REALLY MEAN? • FORMALLY, WHAT WE MEAN IS THAT C% OF SAMPLES OF THIS SIZE WILL PRODUCE CONFIDENCE INTERVALS THAT CAPTURE THE TRUE PROPORTION. • C% CONFIDENCE MEANS THAT ON AVERAGE, IN C OUT OF 100 ESTIMATIONS, THE INTERVAL WILL CONTAIN THE TRUE ESTIMATED PARAMETER. • E.G. A 95% CONFIDENCE MEANS THAT ON THE AVERAGE, IN 95 OUT OF 100 ESTIMATIONS, THE INTERVAL WILL CONTAIN THE TRUE ESTIMATED PARAMETER.
CONFIDENCE INTERVAL FOR PROPORTION P [ONE-PROPORTION Z-INTERVAL] ASSUMPTIONS AND CONDITIONS • RANDOMIZATION CONDITION • 10% CONDITION • SAMPLE SIZE ASSUMPTION OR SUCCESS/FAILURE CONDITION • INDEPENDENCE ASSUMPTION • NOTE: PROPER RANDOMIZATION CAN HELP ENSURE INDEPENDENCE.
SAMPLE SIZE NEEDED TO PRODUCE A CONFIDENCE INTERVAL WITH A GIVEN MARGIN OF ERROR, ME SOLVING FOR n GIVES WHERE IS A REASONABLE GUESS. IF WE CANNOT MAKE A GUESS, WE TAKE
EXAMPLE 1 A MAY 2002 GALLUP POLL FOUND THAT ONLY 8% OF A RANDOM SAMPLE OF 1012 ADULTS APPROVED OF ATTEMPTS TO CLONE A HUMAN. • FIND THE MARGIN OF ERROR FOR THIS POLL IF WE WANT 95% CONFIDENCE IN OUR ESTIMATE OF THE PERCENT OF AMERICAN ADULTS WHO APPROVE OF CLONING HUMANS. • EXPLAIN WHAT THAT MARGIN OF ERROR MEANS. • IF WE ONLY NEED TO BE 90% CONFIDENT, WILL THE MARGIN OF ERROR BE LARGER OR SMALLER? EXPLAIN. • FIND THAT MARGIN OF ERROR. • IN GENERAL, IF ALL OTHER ASPECTS OF THE SITUATION REMAIN THE SAME, WOULD SMALLER SAMPLES PRODUCE SMALLER OR LARGER MARGINS OF ERROR?
EXAMPLE 2 DIRECT MAIL ADVERTISERS SEND SOLICITATIONS (a.k.a. “junk mail”) TO THOUSANDS OF POTENTIAL CUSTOMERS IN THE HOPE THAT SOME WILL BUY THE COMPANY’S PRODUCT. THE RESPONSE RATE IS USUALLY QUITE LOW. SUPPOSE A COMPANY WANTS TO TEST THE RESPONSE TO A NEW FLYER, AND SENDS IT TO 1000 PEOPLE RANDOMLY SELECTED FROM THEIR MAILING LIST OF OVER 200,000 PEOPLE. THEY GET ORDERS FROM 123 OF THE RECIPIENTS. • CREATE A 90% CONFIDENCE INTERVAL FOR THE PERCENTAGE OF PEOPLE THE COMPANY CONTACTS WHO MAY BUY SOMETHING. • EXPLAIN WHAT THIS INTERVAL MEANS. • EXPLAIN WHAT “90% CONFIDENCE” MEANS. • THE COMPANY MUST DECIDE WHETHER TO NOW DO A MASS MAILING. THE MAILING WON’T BE COST-EFFECTIVE UNLESS IT PRODUCES AT LEAST A 5% RETURN. WHAT DOES YOUR CONFIDENCE INTERVAL SUGGEST? EXPLAIN.
EXAMPLE 3 IN 1998 A SAN DIEGO REPRODUCTIVE CLINIC REPORTED 49 BIRTHS TO 207 WOMEN UNDER THE AGE OF 40 WHO HAD PREVIOUSLY BEEN UNABLE TO CONCEIVE. • FIND A 90% CONFIDENCE INTERVAL FOR THE SUCCESS RATE AT THIS CLINIC. • INTERPRET YOUR INTERVAL IN THIS CONTEXT. • EXPLAIN WHAT “90 CONFIDENCE” MEANS. • WOULD IT BE MISLEADING FOR THE CLINIC TO ADVERTISE A 25% SUCCESS RATE? EXPLAIN. • THE CLINIC WANTS TO CUT THE STATED MARGIN OF ERROR IN HALF. HOW MANY PATIENTS’ RESULTS MUST BE USED? • DO YOU HAVE ANY CONCERNS ABOUT THIS SAMPLE? EXPLAIN.
ASSUMPTIONS AND CONDITIONS • INDEPENDENCE ASSUMPTION: THE DATA VALUES SHOULD BE INDEPENDENT. THERE’S REALLY NO WAY TO CHECK INDEPENDENCE OF THE DATA BY LOOKING AT THE SAMPLE, BUT WE SHOULD THINK ABOUT WHETHER THE ASSUMPTION IS REASONABLE. • RANDOMIZATION CONDITION: THE DATA SHOULD ARISE FROM A RANDOM SAMPLE OR SUITABLY A RANDOMIZED EXPERIMENT.
ASSUMPTIONS AND CONDITIONS • 10% CONDITION: THE SAMPLE IS NO MORE THAN 10% OF THE POPULATION. • NORMAL POPULATION ASSUMPTION OR NEARLY NORMAL CONDITION: THE DATA COME FROM A DISTRIBUTION THAT IS UNIMODAL AND SYMMETRIC. REMARK: CHECK THIS CONDITION BY MAKING A HISTOGRAM OR NORMAL PROBABILITY PLOT.
CONSTRUCTING CONFIDENCE INTERVALS FOR MEANS • POINT ESTIMATOR: • STANDARD ERROR: • C% MARGIN OF ERROR:
WHERE tn-1*IS A CRITICAL VALUE FOR STUDENT’S t – MODEL WITH n – 1 DEGREES OF FREEDOM THAT CORRESPONDS TO C% CONFIDENCE LEVEL.
FINDING CRITICAL t - VALUES • Using t tables (Table T) and/or calculator, find or estimate the • 1. critical value t7* for 90% confidence level if number of degrees of freedom is 7 • 2. one tail probability if t = 2.56 and number of degrees of freedom is 7 • 3. two tail probability if t = 2.56 and number of degrees of freedom is 7 • NOTE: If t has a Student's t-distribution with degrees of freedom, df, then TI-83 function tcdf(a,b,df) , computes the area under the t-curve and between a and b.
TESTING HYPOTHESES ABOUT PROPORTIONS • PROBLEM • SUPPOSE WE TOSSED A COIN 100 TIMES AND WE OBTAINED 38 HEADS AND 62 TAILS. IS THE COIN BIASED? • THERE IS NO WAY TO SAY YES OR NO WITH 100% CERTAINTY. BUT WE MAY EVALUATE THE STRENGTH OF SUPPORT TO THE HYPOTHESIS THAT “THE COIN IS BIASED.”
TESTING • HYPOTHESES NULL HYPOTHESIS • ESTABLISHED FACT; • A STATEMENT THAT WE EXPECT DATA TO CONTRADICT; • NO CHANGE OF PARAMETERS. ALTERNATIVE HYPOTHESIS • NEW CONJECTURE; • YOUR CLAIM; • A STATEMENT THAT NEEDS A STRONG SUPPORT FROM DATA TO CLAIM IT; • CHANGE OF PARAMETERS