Non-parametric statistics focus on analyzing data without making strong assumptions about the underlying distribution. Python offers various methods for exploring data distributions, such as histograms, kernel density estimation (KDE), and Q-Q plots. Apart from this, non-parametric hypothesis testing techniques like the Wilcoxon rank-sum test, Kruskal-Wallis test, and chi-square test allow for inferential analysis without relying on parametric assumptions.<\/em><\/p>\n<\/blockquote>\n\n\n\n In this article, we have divided non-parametric statistics into two parts – Methods for Exploring the underlying distribution and Hypothesis Testing and Inference. <\/p>\n\n\n\n Recommended: How To Calculate Power Statistics?<\/a><\/em><\/strong><\/p>\n\n\n\n Exploration of distribution helps us visualize the data and pin it to a theoretical distribution. It also helps us summarize the stats.<\/p>\n\n\n\n This subheading will teach us about Histograms, Kernel Density Estimation, and Q-Q Plots. We will also implement each of them in Python.<\/p>\n\n\n\n Histograms are used to visualize the distribution of numerical data. The histogram gives us the range and shows the frequency of the range. They are very similar to Bar charts. Let us understand it further with Python code.<\/p>\n\n\n Let us look at the output for the above code.<\/p>\n\n\n\n Kernel Density Estimation (KDE) approximates the random variable’s probability density function (pdf). It provides us with continuous and much smoother visualization of the distribution. Let us look at the Python code for the same.<\/p>\n\n\n Let us look at the output of the above code.<\/p>\n\n\n\n Q-Q Plots or quantile=quantile plots are used to compare two probability distributions. They help us visualize whether two datasets came from some population or have the same distribution. Let us look at the Python code for the same.<\/p>\n\n\n Let us look at the output of the plot.<\/p>\n\n\n\n Now let us move on and see what are the methods for Hypothesis Testing and Inference.<\/p>\n\n\n\n In Hypothesis testing and inference for non-parametric statistics, minimal assumptions about the underlying distribution are made and more focus is on rank-based statistics.<\/p>\n\n\n\n Under this subheading, we will learn about the Wilcoxon rank-sum, Krusal-Wallis, and Chi-square tests. Let us learn all of these with their Python implementation.<\/p>\n\n\n\n The Wilcoxon rank sum test, or the Mann-Whitney U test, is a non-parametric statistical test used to compare the means of two independent groups. In the code below, we have two datasets, and we want to conclude if there is any difference between the mean of the datasets. Let us look at the code below.<\/p>\n\n\n Let us look at its output.<\/p>\n\n\n\n Since the p-value is greater than 0.05, we can conclude that there is no difference between the mean of the datasets.<\/p>\n\n\n\n One-way ANOVA<\/a> on ranks or Krusal-Wallis test is a non-parametric test to compare the mean of three or more independent groups. It does not assume normally distributed data. Let us look at the output code where we have assumed three datasets.<\/p>\n\n\n Let us look at the output of the code below.<\/p>\n\n\n\n We fail to reject the null hypothesis since the p-value is greater than 0.05.<\/p>\n\n\n\n The chi-square test <\/a>tests the difference between observed and expected frequencies in one or more categorical variables. It is also used for goodness-of-fit tests or whether they are independent. Let us look at the code below.<\/p>\n\n\n Let us look at the output of the code below.<\/p>\n\n\n\n Since the p-value is more than 0.05, we cannot conclude any dependence between datasets.<\/p>\n\n\n\n Here we go! Now you know what non-parametric tests are. In this article, we have learned about the exploration of distribution and hypothesis testing of data without considering any parameters. We also learned about different kinds of tests to compare different datasets.<\/p>\n\n\n\n Hope you enjoyed reading it!!<\/p>\n\n\n\n Recommended: Chi-square test in Python \u2014 All you need to know!!<\/a><\/em><\/strong><\/p>\n\n\n\nExploring Data Distributions<\/h2>\n\n\n\n
Visualizing Data with Histograms<\/strong><\/h3>\n\n\n\n
\nimport matplotlib.pyplot as plt\nimport numpy as np\n\n# Sample data (replace with your actual data)\ndata = [2, 5, 7, 8, 2, 1, 9, 4, 5, 3, 7, 8, 2, 6, 1]\n\n# Create the histogram\nplt.hist(data, bins=10, edgecolor='black') # Adjust 'bins' for different bin counts\n\n# Customize the plot (optional)\nplt.xlabel('Data Values')\nplt.ylabel('Frequency')\nplt.title('Histogram of Sample Data')\nplt.grid(True)\n\n# Display the plot\nplt.show()\n\n# Output: This will display the generated histogram.\n\n<\/pre><\/div>\n\n\n![\"Histogram](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Histogram-output.png\")
Estimating Probability Density with Kernel Density Estimation<\/strong><\/h3>\n\n\n\n
\nimport seaborn as sns\nimport matplotlib.pyplot as plt\nimport numpy as np\n\n# Sample data (replace with your actual data)\ndata = [2, 5, 7, 8, 2, 1, 9, 4, 5, 3, 7, 8, 2, 6, 1]\n\n# Create the KDE plot\nsns.kdeplot(data)\n\n# Customize the plot (optional)\nplt.xlabel('Data Values')\nplt.ylabel('Probability Density')\nplt.title('KDE Plot of Sample Data')\nplt.grid(True)\n\n# Display the plot\nplt.show()\n\n# Output: This will display the generated KDE plot.\n<\/pre><\/div>\n\n\n![\"Kernel](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Kernel-Density-Estimation-Plot.png\")
Comparing Distributions with Q-Q Plots<\/strong><\/h3>\n\n\n\n
\nimport matplotlib.pyplot as plt\nimport numpy as np\n\n# Sample data sets (replace with your actual data)\ndata1 = [2, 5, 7, 8, 2, 1, 9, 4, 5, 3, 7, 8, 2, 6, 1]\ndata2 = [3, 6, 8, 9, 3, 2, 10, 5, 6, 4, 8, 9, 3, 7, 2]\n\n# Calculate quantiles\nq1 = np.quantile(data1, np.linspace(0, 1, 100))\nq2 = np.quantile(data2, np.linspace(0, 1, 100))\n\n# Create the Q-Q plot\nplt.plot(q1, q2, 'o', markersize=5)\n\n# Reference line for perfect match (optional)\nplt.plot(q1, q1, color='red', linestyle='--')\n\n# Customize the plot (optional)\nplt.xlabel('Quantiles of Data Set 1')\nplt.ylabel('Quantiles of Data Set 2')\nplt.title('Q-Q Plot of Sample Data Sets')\nplt.grid(True)\n\n# Display the plot\nplt.show()\n\n<\/pre><\/div>\n\n\n![\"Q](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Q-Q-Plot-output.png\")
Non-Parametric Hypothesis Testing and Inference<\/h2>\n\n\n\n
Comparing Means with Wilcoxon Rank-Sum Test<\/strong><\/h3>\n\n\n\n
\nimport scipy.stats as stats\nimport matplotlib.pyplot as plt\n\n# Sample data (replace with your actual data)\ndata1 = [2, 5, 7, 10, 12]\ndata2 = [3, 6, 8, 9, 11, 13]\n\n# Perform Wilcoxon Rank Sum Test\nstatistic, pvalue = stats.ranksums(data1, data2)\n\n# Print test results\nprint("Test Statistic:", statistic)\nprint("p-value:", pvalue)\n\n# Decide on rejecting the null hypothesis based on significance level (e.g., 0.05)\nif pvalue < 0.05:\n print("Reject null hypothesis: There is a significant difference between the distributions.")\nelse:\n print("Fail to reject null hypothesis: Insufficient evidence to conclude a difference.")\n<\/pre><\/div>\n\n\n![\"Wilcox](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Wilcox-rank-sum-test-1024x93.png\"){kind=icon}
One-way ANOVA on ranks\/Krusal Wallis Test<\/strong><\/h3>\n\n\n\n
\nimport scipy.stats as stats\nimport matplotlib.pyplot as plt\n\n# Sample data (replace with your actual data)\ndata1 = [2, 5, 7, 10, 12]\ndata2 = [3, 6, 8, 9, 11, 13]\ndata3 = [1, 4, 6, 9, 10]\n\n# Perform Kruskal-Wallis test\nstatistic, pvalue = stats.kruskal(*[data1, data2, data3])\n\n# Print test results\nprint("Test Statistic:", statistic)\nprint("p-value:", pvalue)\n\n# Decide on rejecting the null hypothesis based on significance level (e.g., 0.05)\nif pvalue < 0.05:\n print("Reject null hypothesis: There is a significant difference between distributions.")\nelse:\n print("Fail to reject null hypothesis: Insufficient evidence to conclude a difference.")\n<\/pre><\/div>\n\n\n![\"Krusal](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Krusal-Wallis-Test-output-1024x91.png\")
Testing Categorical Variables with Chi-Square Test<\/strong><\/h3>\n\n\n\n
\nimport scipy.stats as stats\n\n# Sample contingency table (replace with your actual data)\nobserved_data = [[10, 20],\n [15, 25]]\n\n# Perform Chi-square test\nchi2_statistic, pvalue, expected_counts, variance = stats.chi2_contingency(observed_data)\n\n# Print test results\nprint("Chi-square statistic:", chi2_statistic)\nprint("p-value:", pvalue)\n\n# Decide on rejecting the null hypothesis based on significance level (e.g., 0.05)\nif pvalue < 0.05:\n print("Reject null hypothesis: There is a significant association between the variables.")\nelse:\n print("Fail to reject null hypothesis: Insufficient evidence to conclude an association.")\n\n<\/pre><\/div>\n\n\n![\"Chi](\"https:\/\/www.askpython.com\/wp-content\/uploads\/2024\/03\/Chi-Square-test-output-1024x80.png\")
Conclusion<\/h2>\n\n\n\n