+ Reply to Thread
Results 1 to 4 of 4

Thread: Critiquing a Network Meta-analysis: Interpreting inconsistency

  1. #1
    Points: 6, Level: 1
    Level completed: 11%, Points required for next Level: 44

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Critiquing a Network Meta-analysis: Interpreting inconsistency




    Hi all. I'm a non-statistician trying to critique a network meta-analysis on a group of migraine medications called triptans (PDF link). The statistics is a bit over my head so I'm hoping you kind folk can help.
    Not sure what happened with my last post but I'll try again..

    I'm struggling with how they're assessing inconsistency: "We also plotted the posterior mean deviance of the individual data points in the inconsistency model against their posterior mean deviance in the consistency model to identify any loops where inconsistency is present."

    I'm not entirely sure what this means. What is a posterior mean deviance? They report inconsistency for 2 of their outcomes. A plot for one of their outcomes is here:



    Correct me if I'm wrong. Does this mean that the circled outliers indicate that the direct and indirect estimates for these data points do not agree and therefore there is some invalidity in the pooled estimate? What would it mean if the outliers fell above the diagonal line?

    I've found some references on this topic but they're a bit technical that I'm having a tough time understanding.

    Appreciate any help.

    Thanks!

  2. #2
    Devorador de queso
    Points: 97,410, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent PosterActivity Award
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,981
    Thanks
    308
    Thanked 2,639 Times in 2,254 Posts

    Re: Critiquing a Network Meta-analysis: Interpreting inconsistency

    Your original post was automatically placed in the moderation queue waiting approval by a moderator. Posts by new users that contain attachments/images sometimes get placed in that queue and it can take a day for a mod to notice. I deleted the original since this one didn't seem to get caught by the filter.
    I don't have emotions and sometimes that makes me very sad.

  3. #3
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: Critiquing a Network Meta-analysis: Interpreting inconsistency

    I am not overly familiar with network meta-analyses, since it is a newer analytic. Given I am fairly ignorant take my interpretation to the above content with extreme reservations. In addition they appear to use a Bayesian approach.


    Well per the article reference #20,


    "Inconsistency can be thought of as a conflict between “direct” evidence on a comparison between treatments B and C and “indirect” evidence gained from AC and AB trials. Like heterogeneity, inconsistency is caused by effect modifiers and specifically by an imbalance in the distribution of effect modifiers in the direct and indirect evidence. Defining inconsistency as a property of loops of evidence, the relation between inconsistency and heterogeneity and the difficulties created by multiarm trials are described. We set out an approach to assessing consistency in 3-treatment triangular networks and in larger circuit structures, its extension to certain special structures in which independent tests for inconsistencies can be created, and describe methods suitable for more complex networks. "


    So you are looking for data to fall on or near the 45 degree line. So think of it like a correlation of two variables, but this is two variable defining the same relationship, so you want a correlated relationship. The circled values appear to have a near 1 value per inconsistent model and higher values for consistent model. So if the later is direct evidence, I would assume the inconsistency model must have other factors deluding the effect.


    I would imagine it is typical for values to stochastically land on either side of the line, but stay close unless the inconsistency based estimates have additional noise or neglecting to control for variability.


    Interesting stuff.


    P.S., I would imagine you should be able to look up these outlier (studies) and see if they appear different in some regard via design.
    Stop cowardice, ban guns!

  4. #4
    Points: 18, Level: 1
    Level completed: 35%, Points required for next Level: 32

    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Critiquing a Network Meta-analysis: Interpreting inconsistency


    hlsmith,
    Thanks for your post. insightful

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats