Questions tagged [hypothesis-testing]
Hypothesis testing assesses whether data are inconsistent with a given hypothesis (usually a null hypothesis of no effect).
11,120 questions
4
votes
2
answers
88
views
Statistical testing for bimodal/multimodal sample
I am looking to see what is the best statistical test to test whether a bimodal/multimodal sample is significantly different from a value.
I am making a device that deviate a certain result away from ...
- 51
0
votes
0
answers
31
views
Machine Learning and Hypothesis Testing [closed]
In machine learning, do decisions rely on hypothesis tests and p-values?
I am uneasy with NHST. The 0.05 threshold is often used by journals without due discretion. To the best of my understanding, ...
- 679
0
votes
0
answers
23
views
Difference between Inference, Decision, Estimation, and Learning/Fitting in Generalized Decision Theory?
I am trying to strictly define the relationships between Inference, Decision, Estimation, and Learning/Fitting using the framework of Generalized Bayesian Decision Theory (as taught in MIT 6.437).
Set-...
- 7,398
6
votes
2
answers
498
views
Testing binary data for statistical independence
Suppose I have two data samples $\mathbf{x}=(x_1,x_2,..,x_n)$ and $\mathbf{y}=(y_1,y_2,..,y_n)$, where $x_i\in\{0,1\},y_i\in\{0,1\}$, where the entries with the same index are related (e.g., come from ...
- 5,091
4
votes
1
answer
312
views
Which t-test should I use?
its my first time posting here and I‘m quite new to this topic, so I’m not really sure how it works. Sorry if there is any mistake!
I’m comparing the performance of two indices, the DAX and the DAX ...
- 41
6
votes
2
answers
866
views
Why does the p-value increase when I add more observations to my t-test?
I am comparing the means of two groups using an independent two-sample t-test in R. Initially, I had the following samples:
Group A: n = 15, mean = 52.3, sd = 4.8
Group B: n = 15, mean = 48.1, sd = 5....
- 86
0
votes
0
answers
24
views
Statistical Test to Compare Two Groups of Percentages
I have a metric that is measured in %, think "% satisfaction". I have observations of the same group with their percentages before and after a treatment, so the data looks like this. Before: ...
6
votes
2
answers
510
views
How to test i.i.d. assumption?
Given a sample $X_1,\ldots X_n$, how can I test the hypothesis that these are i.i.d. samples from a fixed (unknown) distribution?
To add context, assume this is a time series and I want evidence ...
- 179
5
votes
3
answers
320
views
Assumptions when conducting hypothesis test for population mean
Consider the following problem:
A report in USA Today stated that the average age of commercial jets in the U.S. is 14 years. The population of commercial jet age is known to be normally distributed ...
- 391
1
vote
0
answers
43
views
Wilcoxon signed one sample test and asymmetry
Hi i would like to prove that wilcoxon signed rank (one sample) statistics measure asymmetry. The setup of Wilcoxon test is given a sample from a distribution $X_1,\dots, X_n$ and given a fixed value ...
- 11
5
votes
1
answer
511
views
Why can I fit a horizontal line through the 95% confidence intervals region of my OLS model even though its overall p-value is close to 0.05?
Original question: ~~I don't know how to intrepet the result I got from my OLS analysis. The issue is that I can fit a horizontal line within the 95% CI even though the overall p-value for the model ...
- 61
1
vote
1
answer
46
views
Guarantees of different experiments with the same p-value
Frequentists often explain that:
If we construct a 95% confidence interval for the mean of some unknown distribution using n random samples from a population, the ...
- 153
1
vote
1
answer
29
views
types of non-parametric one sample distributions to choose when the entire population data is available
first of all, I'm really sorry if this seems like an obvious or simple question to you, I know this place is mostly for serious and trained people, but I have no one else to ask this to. I have no ...
- 19
0
votes
0
answers
19
views
How can I test the proportional odds assumption for cumulative logit models estimated with svyVGAM?
I'm trying to estimate a cumulative logit model with partial proportional odds while taking into account sampling weights (to make the sample representative of the population). My best option seems to ...
1
vote
0
answers
13
views
Log-linear models and multiple comparisons: exploring multiple categorical and binary variables
I'm trying to understand how three categorical variables affect several binary variables. I am roughly following these instructions. Here is what my data look like (not my real data):
Binary answers ...
