Learn what topic modelling entails and its implementation using Python’s nltk, gensim, sklearn, and pyLDAvis packages — Introduction Topic modeling is a type of Natural Language Processing (NLP) task that utilizes unsupervised learning methods to extract out the main topics of some text data we deal with. The word “Unsupervised” here means that there are no training data that have associated topic labels. …

Overview of all the components of NLP Analysis in a nutshell — Introduction Natural Language Processing (NLP) is a gigantic field that encompasses various components from cleaning, lemmatization, stemming to deep learning models for text classification and State-of-the-Art (SOTA) pre-trained language models for advanced tasks such as summarization, text generation and sentiment analysis. …

Keep them in your NumPy Arsenal — 1. np.nonzero The nonzero function returns the list of indexes on which nonzero elements in the array are located. import numpy as np arr = np.random.randint(-4,4, size=10) print(arr) print(np.nonzero(arr)) >> [-1 -1 0 1 -4 -3 -1 -1 2 -1] (array([0, 1, 3, 4, 5, 6, 7, 8, 9]),) 2. np.copysign The copysign, as…

Learn how to easily collect Movie, Finance and News Data using Open Source Packages — Introduction For a successful data science project, understanding which data will be appropriate to use and actually collecting it is a key task for data scientists. As the amount of data being generated on the web increases exponentially, the interest towards web scraping is also augmenting. What are some ways to…

Using Kaggle’s 2022 Data Science & ML Survey as an Example — Introduction In the past few decades, new forms of data from text, audio to photos, videos, and signals have been generated in huge amounts which resulted in a relatively less spotlight towards traditional forms of data such as surveys. However, surveys continue to play a huge role in the world of…

Review concepts that you may think you already know because they might strike you back during interviews — Python List v.s. Tuples Lists can be edited and hence mutable. Tuples, on the other hand, are immutable. Although it may depend on the specific situation, tuples are generally faster than lists in terms of computational or operational speed. What is Inheritance? Inheritance is a quality in a lot of object oriented programming languages such as Python…

You just need this one article for all the normality tests and their Python implementations — Introduction Normal Distribution is a kind of distribution that is probably the most frequently mentioned and used by statisticians. This is probably the first distribution you would learn in your statistics 101 class. What is this distribution, exactly? It is also referred to as Gaussian distribution and is a distribution of…

Learn what I think are the two tests that most essential for researchers in the field of social sciences — Introduction There are hundreds of statistical tests that help us test out hypotheses and validate assumptions. There is a even a book called 100 Statistical Tests which I recommend having as an encyclopedia for statistical tests. Among all these tests, I personally think the Analysis of Variance (ANOVA) test and the…

Shedding light on NumPy functions that are underrated and less known but are useful for your data science projects — Introduction NumPy is a go-to package for data scientists along with pandas, scipy and sklearn because it offers a wide range of functionalities spanning from “mathematical functions, random number generators to linear algebra routines and Fourier transforms”. In this article, we focus on 11 gem functions that are less known but…