Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cluster failure (fMRI data analysis) paper

Ivan
August 29, 2016

Cluster failure (fMRI data analysis) paper

Presentation of the cluster failure paper (fMRI data analysis, fMRI 101, software vs non-software bug) during papers we love #022 @ hackerspace.sg

Ivan

August 29, 2016
Tweet

More Decks by Ivan

Other Decks in Science

Transcript

  1. f?

  2. the most common software packages for fMRI analysis … can

    result in false-positive rates of up to 70%. These results question the validity of some 40,000 fMRI studies and may have a large impact on the interpretation of neuroimaging results. a bug that's been sitting in a package <xyz> for 15 years, fixed in May 2015, produced bad results. “ “
  3. randcraw says: …For a couple years now philosophers have insisted

    that fMRI images prove there is no such thing as free will. pfooti says: The dead salmon study seems relevant here in discussion of how fMRI is used. “ “
  4. honkhonkpants says: Doesn't sound like a straight up bug, but

    rather unsound statistical methods which can happen with or without software… greenyoda replies: I'd say it's a bug, since the unsound statistical methods are incorporated into the three most common software packages… “ “
  5. FMRI 101 rest (normal condition) increased activity (stimulus) Blood Oxygenation

    Level Dependent (BOLD) effect brain activity -> local increase on blood flow -> [oxy/deoxy hemoglobin] -> MR signal change (1-5%)
  6. FMRI 101 EPI acquisition (brain volume) 10 to 15 slices,

    ~5mm each 64x64 to 128x128 in-plane res. (2 to 4mm) ~50 to 100K voxels/volume 100 to 200 volumes every 2 to 3 seconds Data Acquisition
  7. FMRI 101 Data Analysis 1. Pre processing: motion correction, slice-timing,

    (spatial smoothing) 2. Statistical analysis: t-test, correlation, OLS, PCA, ICA, … 3. Visualization
  8. METHODS • Resting state fMRI date from 499 subjects •

    4 simulated activation conditions (2 block-, 2 event-related) • 4 levels of spatial smoothing • one- or two-sample t-test • voxel or cluster level inference
  9. RESULTS Fig. 2. Results for two-sample t test and ad

    hoc cluster-wise inference, showing estimated FWE rates for 6 mm of smoothing
  10. WHAT DOES IT MEAN? • Is all of fMRI junk

    science? NO • Is it a software bug? NO (AFNI’s 3dClustSim was a minor issue) • What about “philosophical/political” fMRI studies? ??? (read with a big grain of salt) • What about the “Salmon study”? GOOD STORY for STATS 102 (multiple comparisons)
  11. time Hemodynamic Response Function OPEN DATA jballanc says: The real

    takeaway lesson from this research should be the vital importance of Open Data to the modern scientific enterprise “ adapted from https://xkcd.com/54/