Transcript:
Welcome to stats cast. The purpose of this series is to explain statistical concepts in a way that is clear and simple, even if you don’t have any previous experience with stats. This video explains the purpose of t-tests how they work and when to use them in another set of videos. I’ll show you how to use an interpreter test on some popular software programs. So what does the t-test do? Well, it’s very simple. A t-test checks. The averages or means of two groups are reliably different. That’s all it does. You may ask well. Why not just look at the means looking at the means may tell us if there’s any difference at all, but that doesn’t tell us if the difference is reliable, for example, if you and I both look a coin 100 times and you get heads 52 times and I get heads 49 times. Does that mean you reliably get more hits than me are? You somehow more likely to get heads in the future. Now there’s no real difference. Its only chance this leads us to the difference between descriptive and inferential statistics. A descriptive statistic only describes the sample. We have it doesn’t. Tell us if our results are likely to happen again. In contrast, a t-test is what we call an inferential statistic. Inferential statistics don’t just describe our sample. They tell us what we can expect in new samples that we don’t even have inferential statistics allow us to generalize our findings to a whole population beyond the sample that we’re testing that can be very powerful. Let’s take an example. Researchers have developed a new drug they hope will lower cholesterol lets. Call it! D Test role They take two groups of people and give the drug to one group for a month. That’s the treatment condition. The other group gets an empty pill. That’s the control or placebo condition. After that month has gone by the researchers measure cholesterol for both groups, they find that the control group, which didn’t receive the drug now, has a mean cholesterol score of 36 the treatment group, which did receive the drug now has a mean cholesterol score of 34 descriptively. These two means are different, but does the drug actually work or was this just chance when a similar result happen again with a new sample? That’s why we need inferential and not just descriptive stats. The t-test will tell us how likely this difference is to be reliable or whether it’s just due to chance well. How does the t-test do this? How does it work well? I won’t go into the full formula. But basically, it measures the difference between the groups and compares it to the difference within the groups. The t-value is just 2 ratio of these two numbers variance between groups over variance within groups. A t-value of three into two groups are about three times as different from each other as they are within each other, That also means that if groups have wider more scattered scores, it will be harder to detect a real difference between the groups, and if they had narrow, tightly clustered scores, you can think of it as the signal-to-noise ratio, the signal, that’s the difference is easier to detect when there’s less noise. That’s the scanner in our example with the cholesterol drug. The difference between groups is about two, while the difference within the groups is about six two over six gives us a T value of one-third, which is not big enough to be reliable based on these results. We can’t save the drug actually helps lower cholesterol. But how do we know if it’s big enough each? T value has a corresponding p value. The P value is the probability that the pattern produced by our data could be produced by random data. In other words, it tells us whether the difference between our groups is real, or if it’s just a fluke, so a p-value of 0.05 means there’s only a 5% chance we would get these results with random data. A p-value of 0.01 means there’s only a 1% chance we would get these results with random data while Point 1 means there’s a 10% chance in most research, the cutoff for what we consider reliable or a statistically significant is a p-value of 0.05 or below. The exact p-value associated with the t-value depends on how many people are in your sample. Bigger samples make it easier to find statistically significant differences, for example, with two groups of five. A t-value of 2 has a p-value of 0.05 when you increase the sample size to two groups of 10 that same. T value of 2 now has a p-value of 0.03 bigger samples are helpful, but the benefit diminishes as the sample size increases. A good guideline is to try and have at least 20 to 30 data points in each group. If your sample is too small, you may not have the statistical power to detect differences that really are their sample. Sizes represented through number called degrees of freedom for T tests. The DF is the sample size minus 1 There are three main types of t-test, the independent samples prepared samples and the one sample test. The most common type is the independent samples t-test. This is when you have two different groups. You want to compare our cholesterol experiment is an example this type of test. Let’s take Another example. T-test we’re first developed in the early 1900’s to check for differences in quality and batches of Guinness Beer. That’s another example of an independent samples t-test. If you need to test two different groups, this is the test you need just to make things confusing. There are a few different names, Other than independent samples. T-test, they’re also called between samples or unpaired samples. T-test, however, they all mean the same thing. Another type of t-test is the paired-samples t-test. This is we have one group that is measured at two different times, For example, we could test the quality control team at Guinness and test their balance before and after they test their batches of beer in a paired samples, t-test each score is paired with another score, usually because the measurements come from the same subject. This is different from an independent sample t-test, where scores between groups are not related. This pairing gives us more statistical power as it reduces possible variability between subjects, however, it’s also susceptible to ordering effects again paired samples. T-tests have a few different names. They’re also called within subjects, repeated measures or dependent samples. T-tests again. It all means the same thing. The last type of t-test is the one sample t-test. This is when we only have one group and we want to compare it to a hypothetical value or a known population. Mean, for example, the mean. IQ is 100 You could test if your co-worker’s average IQ differs from that by using a one sample t-test like most stats, there are some limitations that go a t-test first. You can only generalize to a population that resembles your sample. If our cholesterol experiment was only tested on adults, we can’t rightfully say the results also apply to children. Second, your sample and population should be roughly normal in their distribution. This means the scores resemble a bell curve around the meet. If the distribution is skewed. Your p-value’s may be inaccurate. Thankfully, t-test can handle a fair amount of departure from normality before they start to break down third. You should have close to the same number of scores in each group. Comparing a large group to a small group can lead to inaccurate results. Fourth, your data point should be independent of each other. That means the outcome on one score should not influence the outcome on another score fifth. Your data should be at least interval level or close to it. This means that one unit of your score is equal to any other unit. If you’re using ranks like first second third, your results may be inaccurate if your data is unruly and breaks some of these rules. You do have a few options you can do a. Monte Carlo simulation to test whether it is safe to use the t-test. You can also use another kind of test instead like a man. Whitney, you test. They can take more abuse, but statistically, if there was powerful, Finally, let’s go for how to read and write a t-test. Let’s go back to our cholesterol example. Styles may vary, but this is a typical way you may see T-test presented first. The name of the test is given then each of the statistical values the T value tells us the size of the difference and the P value tells us if this is reliable if the P value is less than 0.05 and the difference is considered reliable or statistically significant. The number in parentheses is the degrees of freedom. Which is the sample size minus 1 here since the DF is 99 that tells us. There were 100 people in the sample. Finally, the mean scores of each group are given in this case. There is no significant difference, but if there was a significant difference. This is how we would write it out. When you have a significant difference, the means are especially important as they show the reader, which group is bigger. Well, that’s all for this video in future stats cast videos. We’ll learn how to do t-test using a computer. Bye for now and happy computing.