+ Reply to Thread
Results 1 to 2 of 2

Thread: Method to calculate the most accurate method of prediction

  1. #1
    Points: 1,369, Level: 20
    Level completed: 69%, Points required for next Level: 31

    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Method to calculate the most accurate method of prediction



    Hi, this is my first post, and I'm entirely self taught re statistics, so go easy on me.

    I want to calculate which of several prediction methods generates the most accurate predictions for a given actual result.

    eg. 1 have a table with 3 columns...
    Col1 = actual results
    Col2 = Predictions using method 1
    Col3 = Predictions using method 2

    ie..

    Speed --- Prediction1 --- Prediction2
    100--------99---------------103
    102--------110--------------94
    110--------112--------------110
    108--------107--------------99
    ...and so on

    How do I determine which method is the most accurate?

    I searched these forums using the terms prediction and accuracy and came across a few posts, but most dealt with calculating the accuracy of one prediction to the actual result, not multiple predictions.
    Furthermore, the posts I saw referred to using correlation to estimate accuracy.

    To me, while using correlation will certainly reveal which method is the most correlated, it does not necessarily show which is the most accurate... by which I guess I define as the prediction where the mean of those predictions is the closest to the actual mean of the results, and where the standard deviation is the smallest.

    While using correlation will help, it doesnt necessarily seem, to me at least, to help me fully.

    Ie.. its possible that the correlation between the actual and one of the predicted columnns may be perfect, but the actual prediction is always double, eg, or some other figure that is correlated...

    speed--------predicted1
    100----------200
    101----------202
    99-----------198

    if you see what I mean.

    I guess I'm having a bit of difficulty verbalising my question, so if you need further info or have any questions, please let me know.

    Thank you for any help/advice.
    joshAU

  2. #2
    Ninja say what!?!
    Points: 8,297, Level: 61
    Level completed: 49%, Points required for next Level: 153
    Link's Avatar
    Posts
    1,165
    Thanks
    37
    Thanked 82 Times in 75 Posts

    Re: Method to calculate the most accurate method of prediction


    There are (at least) two good ways to do it. Either 1) calculate the MSE and compare between the models, or 2) compare the R^2 values (assuming you're using regression).

+ Reply to Thread

Similar Threads

  1. What method I have to use?
    By grl in forum Statistics
    Replies: 0
    Last Post: 11-12-2009, 03:38 PM
  2. Please help: what method shall I use?
    By Qiqi in forum Psychology Statistics
    Replies: 4
    Last Post: 02-09-2009, 07:08 PM
  3. When to use each method ?
    By WeeG in forum Psychology Statistics
    Replies: 1
    Last Post: 02-08-2009, 09:05 PM
  4. p-value method
    By sarah169 in forum Statistics
    Replies: 0
    Last Post: 11-22-2008, 03:45 AM
  5. What method would you use?
    By SusanF in forum Statistics
    Replies: 1
    Last Post: 06-26-2008, 10:05 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts








Advertise on Talk Stats