machine learning

Hi I have two survival curves/functions given by two sets of data points (t1, P(T>t1)), (t2, P(T>t2) ), ..., (tn, P(T>tn) ) (t1, P*(T>t1)), (t2, P*(T>t2) ), ..., (tn, P*(T>tn) ) where the time points are t1, t2, ..., tn and for each time point I have an estimated probability of survival...

I understand that we go for t test in regression , after the data has been normally disributed using z distribution. Need to know why cant we use t - test in all the phases , i mean why is it required that t- test requires that the data is normally distributed.....why t-test can't handle this...

For a study I am comparing companies based on the posts written by their Instagram followers. I apply the following technique: Nike has 1.000.000 followers. 2000 random followers of Nike are selected and the posts created during the last 365 days by these profiles are obtained. The posts of...

I am not able to distinguish the outliers - When to go with std. dev and When do we need to go with Median. My understanding on std. dev. is - if the data is away from mean by more than 2 std dev. we consider that as outlier. Similarly for Median, we say that any data that is not in-between q1...

A classifier is expected to face with many datasets with different characteristics such as being unbalanced. Besides, their missions are different, for example, categorizing data into just two classes or more than two. There are many different parameters for evaluating the performance of a...

Hey all, similar to last year, I'm passing along the tracker for the top 4 statistical model trackers for the season. https://tinyurl.com/ybwyffu3 Good news is that they are all at 100% so far...

Hi, I have a set of data. Those data are based on data mining from my website. I have the number of users per month who go to my website ( X ) , and the time they spent on the website on each webpage ( y ) . Now with this dataset as an example, could you...

I am a bit confused on how to calculate type 2 error to check whether the sample data I am using is sufficient. I have a data file that I have used to build a machine learning model. This data file consists of 500 entries describing information about entities and the funding these entities have...

Lately i developed an idea of understanding the behavior of kids in their childhood. I was wondering how kids are molded into different adults in no time. So i created a problem statement based on my ideology and hoped to solve using applications of mathematics. Coming from a non engineering and...

Hi, I have data from two very different sources (bird counts from ships and bird counts from the shore) which aim to estimate the same population/outcome. Both data have different covariates/predictors and thus it is difficult to combine both data in the same regression model. Does...

Hi, I am currently learning ML algorithms and implementing in R. I have a couple basic questions. 1.)Is dimensionality reduction same as feature selection? I know that in R specifying importance=T parameter in randomForest function gives you the important features based on info.gain.I was...

I want to rank a set of sellers. Each seller is defined by parameters var1,var2,var3,var4...var20. I want to score each of the sellers. Currently I am calculating score by assigning weights on these parameters(Say 10% to var1, 20 % to var2 and so on), and these weights are determined based on...

I want to Study and analyzing of algorithms and make predictions on key data for different sports. There are 3 #'s. 1. the screens predicted number 2. our predicted number 3. the outcome number Prediction works like, #2 predicts the right side of #1 with #3 at a rate of 57% or higher...

Disclaimer: I am not a stats major, and would love it if people shred my question to bits if it contains any obvious logical flaws. I am not a native English speaker, but I try my best to be concise. The reason why I am writing here is to get to the proper statistical lingo/jargon to better...

Let's say we're predicting an employee's performance review score for the following year based on that emplyee's metrics from each previous year of his/her employment. We might have these training observations below. Note that "2014i" means "that employee's set of input values from 2014", which...

I have a large set of search data from a particular website. A sample data set is attached here. Data set includes nearly 11,000 rows. What I want to do is to predict the price. I want to predict the price for a particular holiday id, particular Inhouse rating, particular star rating...

Hi all, I need to do predict the values of some variables from a set of predictors. The variables I need to predict are called Y1 and Y2 belonging to Y. The predictors I have are X0, ..., X400 belonging to X. I tried to predict Y from X with several techinques (linear regression, lasso...

Consider two classifiers A and B giving binary labels to a big set of candidates, say, we have a million cats and a million dogs for labeling. Assume the two classifiers give independent predictions. Now if classifier A gives a list (500,000) of candidates that are most likely to be dogs (top...

Hope some of you can offer some advice here. I have a Ph.D. in statistical signal processing (part of electrical engineering) and I've worked for almost 15 years in the defense industry on digital communication systems. I'm currently working from home for a small company and the work is sort of...

I built a learning model (for classification) based on a Random Forest classifier and i am asked to assess the statistical significance of its performances. Up to now, i trained and tested it on two different datasets A and B, respectively. What kind of test can i use?