For each pair of areas that shared a border in the parcellation, we computed a paired samples two-tailed t-test across subjects on these parcellated data for each feature (ignoring tests that involved the diagonal in the resting state parcellated functional connectome). We thresholded these tests at the Bonferroni-corrected significance level of P < 9 × 10−8 (number of area pairs across both hemispheres (1,050) × number of features (266) × number of tails (2) × 0.05) and an effect size threshold of Cohen’s d > 1. We grouped the features into 4 independent categories (cortical thickness, myelin, task fMRI, and resting state fMRI) to determine for each area pair whether it showed robust and statistically significant differences across multiple modalities. For more details, see
Multimodal Imaging
This integrated approach allows researchers and clinicians to leverage the strengths of different imaging modalities, resulting in enhanced diagnostic accuracy, improved treatment planning, and a deeper insight into complex physiological and pathological phenomena.
By integrating data from various imaging techniques, Multimodal Imaging enables a more holistic and informative representation of the subject of interest, facilitating better decision-making and more effective patient care.
This powerful tool is widely used in fields like neuroscience, oncology, and cardiovascular medicine, and continues to evolve with the advancements in imaging technologies and data analysis techniques.
Most cited protocols related to «Multimodal Imaging»
For each pair of areas that shared a border in the parcellation, we computed a paired samples two-tailed t-test across subjects on these parcellated data for each feature (ignoring tests that involved the diagonal in the resting state parcellated functional connectome). We thresholded these tests at the Bonferroni-corrected significance level of P < 9 × 10−8 (number of area pairs across both hemispheres (1,050) × number of features (266) × number of tails (2) × 0.05) and an effect size threshold of Cohen’s d > 1. We grouped the features into 4 independent categories (cortical thickness, myelin, task fMRI, and resting state fMRI) to determine for each area pair whether it showed robust and statistically significant differences across multiple modalities. For more details, see
For clarity, we overview the analytical workflows for each data type below:
Single-cell gene expression: We analyze scRNA-seq data using standard pipelines in Seurat which include normalization, feature selection, and dimensional reduction with PCA. We then construct a KNN graph after dimensional reduction.
Single-cell cell surface protein level expression: We analyze single-cell protein data (representing the quantification of antibody-derived tags (ADTs) in CITE-seq or ASAP-seq data) using a similar workflow to scRNA-seq. We normalize protein expression levels within a cell using the centered-log ratio (CLR) transform, followed by dimensional reduction with PCA, and subsequently construct a KNN graph. Unless otherwise specified, we do not perform feature selection on protein data, and use all measured proteins during dimensional reduction.
Single-cell chromatin accessibility: We analyze single-cell ATAC-seq data using our previously described workflow (Stuart et al., 2019 (link)), as implemented in the Signac package. We reduced the dimensionality of the scATAC-seq data by performing latent semantic indexing (LSI) on the scATAC-seq peak matrix, as suggested by Cusanovich et al. (2018) (link). We first computed the term frequency-inverse document frequency (TF-IDF) of the peak matrix by dividing the accessibility of each peak in each cell by the total accessibility in the cell (the “term frequency”), and multiplied this by the inverse accessibility of the peak in the cell population. This step ‘upweights’ the contribution of highly variable peaks and down-weights peaks that are accessible in all cells. We then multiplied these values by 10,000 and log-transformed this TF-IDF matrix, adding a pseudocount of 1 to avoid computing the log of 0. We decomposed the TF-IDF matrix via SVD to return LSI components, and scaled LSI loadings for each LSI component to mean 0 and standard deviation 1.
For cross-subject registration of the cerebral cortex, we used a two-stage process based on the multimodal surface matching (MSM) algorithm14 (link) (see
Resting state fMRI data were denoised for spatially specific temporal artefacts (for example, subject movement, cardiac pulsation, and scanner artefacts) using the ICA+FIX approach, which includes detrending the data and aggressively regressing out 24 movement parameters36 (link),37 (link). We avoided regressing out the ‘global signal’ (mean grey-matter time course) from our data because preliminary analyses showed that this step shifted putative connectivity-based areal boundaries so that they lined up less well with other modalities, likely because of the strong areal specificity of the residual global signal after ICA+FIX clean up. Task fMRI data were temporally filtered using a high pass filter. More details on resting state and task fMRI temporal preprocessing are described in the
In addition, another independent group of healthy subjects were included to do the repeatability validation. The dataset included 40 (20 males, age range, 17–20 years, age, 19.10 ± 0.80 years, mean ± SD) right-handed participants. The multimodal MRI data of 40 healthy adults were acquired using a 3.0 T GE MR Scanner (see Zhuo et al. (2016) (link) for a full description of the data sample and acquisition parameters).
Most recents protocols related to «Multimodal Imaging»
where σ represents the sigmoid function, and wm represents the parameter matrix at training time. The features of different modalities are stitched together after the maximum pooling layer. Finally, a Fully Connected (FC) layer is created in the corresponding dimension of the channel and output to the classifier to obtain the classification result.