Cardinal 2: User guide for mass spectrometry imaging analysis
Revised: May 25, 2019
Contents
1 Introduction
Cardinal 2 provides new classes and methods for the manipulation, transformation, visualization, and analysis of imaging experiments–specifically mass spectrometry (MS) imaging experiments.
MS imaging is a rapidly advancing field with consistent improvements in instrumentation for both MALDI and DESI imaging experiments. Both mass resolution and spatial resolution are steadily increasing, and MS imaging experiments grow increasingly complex.
The first version of Cardinal was written with certain assumptions about MS imaging data that are no longer true. For example, the basic assumption that the raw spectra can be fully loaded into memory is unreasonable for many MS imaging experiments today.
Cardinal 2 was re-written from the ground up to handle the evolving needs of high-resolution MS imaging experiments. Some advancements include:
New imaging experiment classes such as
ImagingExperiment,SparseImagingExperiment, andMSImagingExperimentprovide better support for out-of-memory datasets and a more flexible representation of complex experimentsNew imaging metadata classes such as
PositionDataFrameandMassDataFramemake it easier to manipulate experimental runs, pixel coordinates, and m/z-values by storing them as separate slots rather than ordinary columnsNew
plot()andimage()visualization methods that can handle non-gridded pixel coordinates and allow assigning the resulting plot (and data) to a variable for later re-plottingSupport for writing imzML in addition to reading it; more options and support for importing out-of-memory imzML for both “continuous” and “processed” formats
Data manipulation and summarization verbs borrowed from dplyr such as
select(),filter(), andsummarize()for easier subsetting and summarization of imaging datasetsDelayed pre-processing via a new
process()method that allows queueing of delayed pre-processing methods such asnormalize()andpeakPick()for later executionParallel processing support via the BiocParallel package for all pre-processing methods and any statistical analysis methods with a
BPPARAMoption
Classes and methods from older versions of Cardinal will continue to be supported; however, new code should use the new classes and methods implemented by Cardinal 2.
Note that Cardinal 2 uses parallel execution using the registered BiocParallel backend by default. This may not be appropriate for all situations. If you run into problems, try using
register(SerialParam())to run code serially instead.
2 Installation
Cardinal can be installed via the BiocManager package.
install.packages("BiocManager")
BiocManager::install("Cardinal")The same function can be used to update Cardinal and other Bioconductor packages.
Once installed, Cardinal can be loaded with library():
library(Cardinal)3 Components of an MSImagingExperiment
In Cardinal, imaging experiment datasets are composed of multiple sets of metadata, in addition to the actual experimental data. These are (1) pixel metadata, (2) feature (\(m/z\)) metadata, (3) the actual imaging data, and (4) a class that holds all of these and represents the experiment as a whole.
MSImagingExperiment is a matrix-like container for complete MS imaging experiments, where the “rows” represent the mass features, and the columns represent the pixels. An MSImagingExperiment object contains the following components:
pixelData()accesses the pixel information, stored in aPositionDataFramefeatureData()accesses the feature information, stored inMassDataFrameimageData()accesses the spectral information, stored in aImageArrayList
Unlike many software packages designed for analysis of MS imaging experiments, Cardinal is designed to work with multiple datasets simultaneously and can integrate all aspects of experimental design and metadata.
3.1 Example data
We will use simulateImage() to prepare an example dataset.
register(SerialParam())
set.seed(2020)
mse <- simulateImage(preset=1, npeaks=10, nruns=2, baseline=1)
mse## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSE3.2 Pixel metadata with PositionDataFrame
The pixelData() accessor extracts the pixel information for an MSImagingExperiment. The pixel data are stored in a PositionDataFrame object, which is a type of data frame that separately tracks pixel coordinates and experimental run information.
pixelData(mse)## PositionDataFrame with 800 rows and 1 column
## :run: coord:x coord:y circle
## <factor> <integer> <integer> <logical>
## 1 run0 1 1 FALSE
## 2 run0 2 1 FALSE
## 3 run0 3 1 FALSE
## 4 run0 4 1 FALSE
## 5 run0 5 1 FALSE
## ... ... ... ... ...
## 796 run1 16 20 FALSE
## 797 run1 17 20 FALSE
## 798 run1 18 20 FALSE
## 799 run1 19 20 FALSE
## 800 run1 20 20 FALSEThe coord() accessor specifically extracts the data frame of pixel coordinates.
coord(mse)## DataFrame with 800 rows and 2 columns
## x y
## <integer> <integer>
## 1 1 1
## 2 2 1
## 3 3 1
## 4 4 1
## 5 5 1
## ... ... ...
## 796 16 20
## 797 17 20
## 798 18 20
## 799 19 20
## 800 20 20The run() accessor specifically extracts the vector of experimental runs.
run(mse)[1:10]## [1] run0 run0 run0 run0 run0 run0 run0 run0 run0 run0
## Levels: run0 run13.3 Feature metadata with MassDataFrame
The featureData() accessor extracts the feature information for an MSImagingExperiment. The feature data are stored in a MassDataFrame object, which is a type of data frame that separately tracks the m/z-values associated with the mass spectral features.
featureData(mse)## MassDataFrame with 3919 rows and 0 columns
## :mz:
## <numeric>
## 1 426.528500300166
## 2 426.699145829392
## 3 426.869859630484
## 4 427.040641730756
## 5 427.211492157533
## ... ...
## 3915 2041.17154600331
## 3916 2041.9881779481
## 3917 2042.80513661101
## 3918 2043.62242212276
## 3919 2044.44003461411The mz() accessor specifically extracts the vector of m/z-values.
mz(mse)[1:10]## [1] 426.5285 426.6991 426.8699 427.0406 427.2115 427.3824 427.5534 427.7245
## [9] 427.8956 428.06683.4 Accessing spectra and image data
The imageData() accessor extracts the image data for an MSImagingExperiment. The data are stored in an ImageArrayList, which is a list of matrix-like objects.
It is possible to store multiple matrices of intensities in this list. Typically, only the first entry will be used by pre-processing and analysis methods.
imageData(mse)## MSContinuousImagingSpectraList of length 1
## names(1): intensity
## class(1): matrix
## dim(1): <3919 x 800>
## mem(1): 25.1 MBEntries in this list can be extracted by name with iData().
iData(mse, "intensity")The spectra() accessor is a shortcut for accessing the first data matrix.
spectra(mse)[1:5, 1:5]## [,1] [,2] [,3] [,4] [,5]
## [1,] 0.9295940 0.9779923 0.9415157 0.9115036 0.8960595
## [2,] 1.0087009 1.3108664 1.0928983 1.0243944 1.0706272
## [3,] 1.0578001 1.0625834 1.2407371 0.9319758 0.8822412
## [4,] 0.8949165 1.1568158 0.9250994 0.9499621 1.0127282
## [5,] 1.0660395 1.0123048 1.0291570 0.8999156 1.1126816Rows of these matrices correspond to mass features. Columns correspond to pixels. In other words, each column is a mass spectrum, and each row is a flattened vector of images.
3.5 Specialized classes
In order to specialize to the needs of different datasets, Cardinal provides specialized versions of MSImagingExperiment that reflect different spectra storage strategies.
3.5.1 “Continuous” MS imaging experiments
MSContinuousImagingExperiment is a specialization that enforces the data matrices be stored as dense, column-major matrices. These include R’s native matrix and matter_matc objects from the matter package.
mse## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSEimageData(mse)## MSContinuousImagingSpectraList of length 1
## names(1): intensity
## class(1): matrix
## dim(1): <3919 x 800>
## mem(1): 25.1 MB3.5.2 “Processed” MS imaging experiments
MSProcessedImagingExperiment is a specialization that enforces the data matrices be stored as sparse, column-major matrices. These include sparse_matc objects from the matter package. This specialization is useful for processed data.
set.seed(2020)
mse2 <- simulateImage(preset=3, npeaks=10, nruns=2)
mse3 <- as(mse2, "MSProcessedImagingExperiment")
mse3## An object of class 'MSProcessedImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(3): square1 square2 circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSEimageData(mse3)## MSProcessedImagingSpectraList of length 1
## names(1): intensity
## class(1): sparse_matc
## dim(1): <3919 x 800>
## mem(1): 25.2 MBBecause the data is stored sparsely, spectra from MSProcessedImagingExperiment objects are binned on-the-fly to the m/z-values specified by mz().
The resolution of the binning can be accessed by resolution().
resolution(mse3)## ppm
## 200The resolution can be set to change how the binning is performed.
resolution(mse3) <- c(ppm=400)## nrows changed from 3919 to 1959Changing the binned mass resolution will typically change the effective dimensions of the experiment.
dim(mse2)## Features Pixels
## 3919 800dim(mse3)## Features Pixels
## 1959 800The effective m/z-values are also updated to reflect the new bins.
mz(mse2)[1:10]## [1] 426.5285 426.6991 426.8699 427.0406 427.2115 427.3824 427.5534 427.7245
## [9] 427.8956 428.0668mz(mse3)[1:10]## [1] 426.5285 426.8699 427.2115 427.5534 427.8956 428.2380 428.5808 428.9238
## [9] 429.2670 429.6106Note that the underlying data will remain unchanged, but the binned values for the intensities will be different.
4 Data import and export
Cardinal 2 natively supports reading and writing imzML (both “continuous” and “processed” versions) and Analyze 7.5 formats via the readMSIData() and writeMSIData() functions.
We will focus on imzML.
The imzML format is an open standard designed specifically for interchange of mass spectrometry imaging datasets. Many other formats can be converted to imzML with the help of free applications available online at .
Let’s create a small image to demonstrate data import/export.
set.seed(2020)
tiny <- simulateImage(preset=1, from=500, to=600, dim=c(3,3))
tiny## An object of class 'MSContinuousImagingExperiment'
## <456 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run0
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 500.0000 to 599.8071
## centroided: FALSEWe’ll also create a “processed” version for writing “processed” imzML.
tiny2 <- as(tiny, "MSProcessedImagingExperiment")
tiny2## An object of class 'MSProcessedImagingExperiment'
## <456 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run0
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 500.0000 to 599.8071
## centroided: FALSENote that despite the name, the only difference between “continuous” and “processed” imzML is how the data are stored, rather than what processing has been applied to the data. “Continuous” imzML stores spectra densely, with each spectrum sharing the same m/z-values. “Processed” imzML stores spectra sparsely, and each spectrum can have its own distinct m/z-values.
4.1 Writing imzML
Use writeMSIData() to write datasets to imzML and Analyze formats.
4.1.1 Writing “continuous” imzML
Internally, writeMSIData() will call either writeImzML() or writeAnalyze() depending on the value of outformat. The default is outformat="imzML".
path <- tempfile()
writeMSIData(tiny, file=path, outformat="imzML")Two files are produced with extensions “.imzML” and “.ibd”. The former contains an XML description of the dataset, and the latter contains the actual intensity data.
## [1] "file1a64744342c0.ibd" "file1a64744342c0.imzML"Because tiny is a MSContinuousImagingExperiment, it is written as “continuous” imzML.
mzml <- readLines(paste0(path, ".imzML"))
grep("continuous", mzml, value=TRUE)## [1] "\t\t\t<cvParam cvRef=\"IMS\" accession=\"IMS:1000030\" name=\"continuous\" value=\"\" />"4.1.2 Writing “processed” imzML
We can also write “processed” imzML if we export a MSProcessedImagingExperiment file.
path2 <- tempfile()
writeMSIData(tiny2, file=path2, outformat="imzML")mzml2 <- readLines(paste0(path2, ".imzML"))
grep("processed", mzml2, value=TRUE)## [1] "\t\t\t<cvParam cvRef=\"IMS\" accession=\"IMS:1000031\" name=\"processed\" value=\"\" />"4.1.3 Writing datasets with multiple runs
If an experiment contains multiple runs, then each run will be written to a separate imzML file.
set.seed(2020)
tiny3 <- simulateImage(preset=1, from=500, to=600, dim=c(3,3), nruns=2)
runNames(tiny3)## [1] "run0" "run1"path3 <- tempfile()
writeMSIData(tiny3, file=path3, outformat="imzML")## [1] "file1a646027541b-run0.ibd" "file1a646027541b-run0.imzML"
## [3] "file1a646027541b-run1.ibd" "file1a646027541b-run1.imzML"4.2 Reading imzML
Use readMSIData() to read datasets in imzML or Analyze formats.
4.2.1 Reading “continuous” imzML
Internally, readMSIData() will guess the format based on the file extension (which must be included) and call either readImzML() or readAnalyze().
path_in <- paste0(path, ".imzML")
tiny_in <- readMSIData(path_in, attach.only=TRUE)
tiny_in## An object of class 'MSContinuousImagingExperiment'
## <456 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(2): 3DPositionX 3DPositionY
## metadata(8): spectrum representation ibd binary type ... files
## name
## run(1): file1a64744342c0
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 500.0000 to 599.8071
## centroided: FALSEThe attach.only argument is used to specify that the intensity data should not be loaded into memory, but instead attached as a file-based matrix using the matter package.
Starting in Cardinal 2, the default is attach.only=TRUE. This is more memory-efficient, but some methods may be more time-consuming due to the file I/O.
imageData(tiny_in)## MSContinuousImagingSpectraList of length 1
## names(1): intensity
## class(1): matter_matc
## dim(1): <456 x 9>
## mem(1): 10.6 KBspectra(tiny_in)## <456 row, 9 column> matter_matc :: out-of-memory numeric matrix
## [,1] [,2] [,3]
## [1,] 0 0.0408783257007599 0
## [2,] 0 0.162409648299217 0
## [3,] 0 0 0.0359107814729214
## [4,] 0.187441676855087 0.0405706577003002 0.0885359272360802
## [5,] 0 0.193072378635406 0
## [6,] 0.30000975728035 0 0.0878914147615433
## ... ... ... ...
## [,4] [,5] [,6] ...
## [1,] 0 0.0166400671005249 0.0327425710856915 ...
## [2,] 0 0 0 ...
## [3,] 0.0125106507912278 0.0794587582349777 0.0879494920372963 ...
## [4,] 0.0557640492916107 0 0.0971635207533836 ...
## [5,] 0.124683283269405 0 0.117957629263401 ...
## [6,] 0 0.115523137152195 0.0507860481739044 ...
## ... ... ... ... ...
## (10.6 KB real | 16.4 KB virtual)An out-of-memory matter matrix can be subsetted like an ordinary R matrix. The data values are only read from file and loaded into memory when they are requested (via subsetting).
spectra(tiny_in)[1:5, 1:5]## [,1] [,2] [,3] [,4] [,5]
## [1,] 0.0000000 0.04087833 0.00000000 0.00000000 0.01664007
## [2,] 0.0000000 0.16240965 0.00000000 0.00000000 0.00000000
## [3,] 0.0000000 0.00000000 0.03591078 0.01251065 0.07945876
## [4,] 0.1874417 0.04057066 0.08853593 0.05576405 0.00000000
## [5,] 0.0000000 0.19307238 0.00000000 0.12468328 0.00000000If loading the data fully into memory is desired, either set attach.only=FALSE when reading the data, or use as.matrix() on the intensity matrix.
spectra(tiny_in) <- as.matrix(spectra(tiny_in))
imageData(tiny_in)## MSContinuousImagingSpectraList of length 1
## names(1): intensity
## class(1): matrix
## dim(1): <456 x 9>
## mem(1): 33 KBUsing collect() on the MSImagingExperiment will also load all data into memory.
tiny_in <- collect(tiny_in)4.2.2 Reading “processed” imzML
For “processed” imzML files, the spectra must be binned to common m/z-values. By default, readImzML() will detect the mass range from the data. This requires reading a large proportion of data from the file, even if attach.only=TRUE.
path2_in <- paste0(path2, ".imzML")
tiny2_in <- readMSIData(path2_in)
tiny2_in## An object of class 'MSProcessedImagingExperiment'
## <456 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(2): 3DPositionX 3DPositionY
## metadata(8): spectrum representation ibd binary type ... files
## name
## run(1): file1a64a524239
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 500.0000 to 599.8071
## centroided: FALSEIf known, it can be much more efficient to specify mass.range when importing “processed” imzML data. This can also be used to pre-filter the data to a smaller mass range.
The size of the m/z bins can be changed with the resolution argument.
tiny2_in <- readMSIData(path2_in, mass.range=c(510,590),
resolution=100, units="ppm")
tiny2_in## An object of class 'MSProcessedImagingExperiment'
## <729 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(2): 3DPositionX 3DPositionY
## metadata(8): spectrum representation ibd binary type ... files
## name
## run(1): file1a64a524239
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 510.000 to 589.934
## centroided: FALSEThe resolution for the m/z bins can be changed after importing the data by setting the resolution() of the dataset.
resolution(tiny2_in) <- c(ppm=400)## nrows changed from 729 to 1824.3 Building from scratch
While importing formats besides imzML and Analyze are not explicitly supported by Cardinal, if the data can be read into R, it is easy to construct a MSImagingExperiment object from its components.
set.seed(2020)
s <- simulateSpectrum(n=9, peaks=10, from=500, to=600)
coord <- expand.grid(x=1:3, y=1:3)
run <- factor(rep("run0", nrow(coord)))
fdata <- MassDataFrame(mz=s$mz)
pdata <- PositionDataFrame(run=run, coord=coord)
out <- MSImagingExperiment(imageData=s$intensity,
featureData=fdata,
pixelData=pdata)
out## An object of class 'MSContinuousImagingExperiment'
## <456 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(0):
## run(1): run0
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 500.0000 to 599.8071
## centroided: FALSEFor loading data into R, read.csv() and read.table() can be used to read CSV and tab-delimited text files, respectively.
Likewise, write.csv() and write.table() can be used to write pixel metadata and feature metadata after coercing them to an ordinary R data.frame with as.data.frame().
Use saveRDS() and readRDS() to save and read and entire R object such as a MSImagingExperiment. Note that if intensity data is to be saved as well, it should be pulled into memory and coerced to an R matrix with as.matrix() first.
5 Visualization
Visualization of mass spectra and molecular ion images is vital for exploratory analysis of MS imaging experiments. Cardinal provides a plot() method for plotting mass spectra and an image() method for plotting ion images.
Cardinal 2 provides some useful visualization updates compared to previous versions:
A new default color scale (viridis) for images that doesn’t use the flawed rainbow color scheme
Non-gridded pixel coordinates are allowed, and plotting of non-rastered image data is better supported
The new
plot()andimage()methods return values that can be assigned to a variable for later re-plotting
5.1 Visualizing mass spectra with plot()
Use plot() to plot mass spectra. Either pixel or coord can be specified to determine which mass spectra should be plotted.
plot(mse, pixel=c(211, 611))
The plusminus argument can be used to specify that multiple spectra should be averaged and plotted together.
plot(mse, coord=list(x=10, y=10), plusminus=1, fun=mean)
A formula can be specified to further customize mass spectra plotting. The LHS of the formula should specify one or more elements of imageData() and the RHS of the formula should be a variable in featureData().
plot(mse, intensity + I(-log1p(intensity)) ~ mz, pixel=211, superpose=TRUE)
5.2 Visualizing images with image()
Use image() to plot ion images. Either feature or mz can be specified to determine which mass features should be plotted.
image(mse, mz=1200)
The plusminus argument can be used to specify that multiple mass features should be averaged and plotted together.
image(mse, mz=1227, plusminus=0.5, fun=mean)
By default, images from all experimental runs are plotted. If this is not desired, a subset can be specified instead.
image(mse, mz=1227, subset=run(mse) == "run0")
image(mse, mz=c(1200, 1227), subset=circle)
Multiplicative variance in spectral intensities can cause images to be noisy and dark due to hot spots.
Often, images may require some type of processing and enhancement to improve interpretation.
image(mse, mz=1200, smooth.image="gaussian")
image(mse, mz=1200, contrast.enhance="histogram")
The default viridis colorscale is chosen to enable ease of interpretation. However, other colorscales can be chosen. All colorscales from the viridisLite package are available in Cardinal, including cividis, magma, inferno, and plasma.
The magma colorscale is used below with a different dataset.
image(mse2, mz=1136, colorscale=magma)
Cardinal will try to choose an appropriate layout for the images. However, a user-defined one can be specified by layout. Use layout=NULL to use the current plotting device as-is.
image(mse2, mz=c(781, 1361), layout=c(1,4), colorscale=magma)
Multiple images can be superposed with superpose=TRUE. Use normalize.image="linear" to normalize all images to the same intensity range.
image(mse2, mz=c(781, 1361), superpose=TRUE, normalize.image="linear")
Like plot(), a formula can be specified. The LHS should specify one or more elements of imageData() and the RHS should specify two to three variables from pixelData().
image(mse2, log1p(intensity) ~ x * y, mz=1136, colorscale=magma)
5.3 Visualizing 3D imaging experiments
3D imaging datasets can be plotted with image3D().
set.seed(1)
mse3d <- simulateImage(preset=9, nruns=7, dim=c(7,7), npeaks=10,
peakheight=c(2,4), representation="centroid")
image3D(mse3d, mz=c(1001, 1159), colorscale=plasma, cex=3, theta=30, phi=30)
Any dataset with 3 or more spatial coordinates (columns in coord()), can be plotted in 3D.
5.4 Region-of-interest selection
Use selectROI() to select regions-of-interest on an ion image. It is important to specify a subset so that selection is only made on a single experimental run, otherwise results may be unexpected. The form of selectROI() is the same as image().
sampleA <- selectROI(mse, mz=1200, subset=run(mse) == "run0")
sampleB <- selectROI(mse, mz=1200, subset=run(mse) == "run1")selectROI() returns a logical vector specifying which pixels from the imaging experiment are contained in the selected region.
makeFactor() can then be used to combine multiple logical vectors (e.g., from selectROI()) into a single factor.
regions <- makeFactor(A=sampleA, B=sampleB)5.5 Saving plots and images
Plots and images can be saved to a file by using R’s built-in graphics devices.
Use pdf() to initialize a PDF graphics device, create the plot, and then use dev.off() to turn off the graphics device.
Any plots printed while the graphics device is active will be saved to the specified file(s).
pdf_file <- paste0(tempfile(), ".pdf")
pdf(file=pdf_file, width=9, height=4)
image(mse, mz=1200)
dev.off()Graphics devices for png(), jpeg(), bmp(), and tiff() are also available. See their documentation for usage.
5.6 Dark themes
While many software for MS imaging data use a light-on-dark theme, Cardinal uses a transparent background by default. However, a dark theme is also provided through darkmode().
darkmode()
image(mse, mz=1200)
darkmode()
image(mse2, mz=1135, colorscale=magma)
Any future plots on the current device will use the new mode. The default mode can be restored to the current device with lightmode().
lightmode()The default for new plots can be changed by options(Cardinal.dark=TRUE).
5.7 A note on plotting speed
While plotting spectra should typically be fast for most datasets regardless of data format, plotting images will typically be slower for out-of-memory (file-based) datasets and for MSProcessedImagingExperiment objects in general.
This is due to the way the spectra are stored in imzML and Analyze files, and the way sparse spectra are stored (regardless of location). Calculating and decompressing the images simply takes longer than reading the spectra.
For the fastest visualization of images, experiments should be coerced to an in-memory MSContinuousImagingExperiment.
Also note that all Cardinal 2 visualizations produce a print()-able object that can be assigned to a variable and print()-ed later without the need to read the data again.
g <- image(mse, mz=1200)
print(g)This is useful for re-creating or updating plots without accessing the data again.
6 Common operations on MSImagingExperiment
6.1 Subsetting
MSImagingExperiment are matrix-like objects that can be subsetted using the [ operator.
When subsetting, the “rows” are the mass features, and the “columns” are the pixels.
# subset first 10 mass features and first 5 pixels
mse[1:10, 1:5]## An object of class 'MSContinuousImagingExperiment'
## <10 feature, 5 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run0
## raster dimensions: 5 x 1
## coord(2): x = 1..5, y = 1..1
## mass range: 426.5285 to 428.0668
## centroided: FALSESubsetting the dataset this way requires knowing the desired row and column indices.
features() returns row indices based on specified feature metadata.
# get row index corresponding to m/z 1200
features(mse, mz=1200)## [1] 2587# get row indices corresponding to m/z 1199 - 1201
features(mse, 1199 < mz & mz < 1201)## [1] 2585 2586 2587 2588 2589pixels() returns column indices based on specified pixel metadata.
# get column indices corresponding to x = 10, y = 10 in all runs
pixels(mse, coord=list(x=10, y=10))## [1] 190 590# get column indices corresponding to x <= 3, y <= 3 in "run0"
pixels(mse, x <= 3, y <= 3, run == "run0")## [1] 1 2 3 21 22 23 41 42 43These methods can be used to determine row/column indices of particular m/z-values or pixel coordinates to use for subsetting.
fid <- features(mse, 1199 < mz & mz < 1201)
pid <- pixels(mse, x <= 3, y <= 3, run == "run0")
mse[fid, pid]## An object of class 'MSContinuousImagingExperiment'
## <5 feature, 9 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run0
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 1199.043 to 1200.963
## centroided: FALSE6.2 Slicing
MSImagingExperiment represents the data as a matrix, where each column is a mass spectrum, rather than as a true “data cube”. This is typically simpler when operating on the mass spectra, and more space efficient when the data is pixel-sparse (i.e., non-rectangular).
Sometimes, however, it is useful to index into the data as an actual “data cube”, with explicit array dimensions for each spatial dimension.
Use slice() to slice an MSImagingExperiment as a data cube and extract images.
# slice image for first mass feature
a <- slice(mse, 1)
dim(a)## x y run
## 20 20 2Any arguments to slice() are passed to features(), making it easy to select the desired image slices.
By default, array dimensions with only one level are dropped; use .preserve=TRUE to keep all dimensions.
# slice image for m/z 1200
a2 <- slice(mse, mz=1200, .preserve=TRUE)
dim(a2)## x y run feature
## 20 20 2 1Note that when plotting images from raw arrays, the images are upside-down due to differing coordinate conventions used by graphics::image().
image(a2[,,1,1], col=bw.colors(100))
6.3 Combining
Because MSImagingExperiment is matrix-like, rbind() and cbind() can be used to combine multiple MSImagingExperiment objects by “row” or “column”, assumping certain conditions are met.
Use cbind() to combine datasets from different experimental runs. The m/z-values must match between all datasets to succesfully combine them.
# divide dataset into separate objects for each run
mse_run0 <- mse[,run(mse) == "run0"]
mse_run1 <- mse[,run(mse) == "run1"]
mse_run0## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 400 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run0
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSEmse_run1## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 400 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(1): run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSE# recombine the separate datasets back together
mse_cbind <- cbind(mse_run0, mse_run1)
mse_cbind## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(1): circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSESome processing may be necessary to ensure datasets are compatible before combining them.
6.4 Getters and setters
Most components of an MSImagingExperiment that can be accessed through getter functions like pixelData(), featureData(), and imageData(), can also be re-assigned with analogous setter functions. These can likewise be used to get and set columns of the pixel and feature metadata.
pData() and fData() are aliases for pixelData() and featureData(), respectively.
The $ operator will access the corresponding columns of pixelData().
mse$region <- makeFactor(circle=mse$circle,
bg=!mse$circle)
pData(mse)## PositionDataFrame with 800 rows and 2 columns
## :run: coord:x coord:y circle region
## <factor> <integer> <integer> <logical> <factor>
## 1 run0 1 1 FALSE bg
## 2 run0 2 1 FALSE bg
## 3 run0 3 1 FALSE bg
## 4 run0 4 1 FALSE bg
## 5 run0 5 1 FALSE bg
## ... ... ... ... ... ...
## 796 run1 16 20 FALSE bg
## 797 run1 17 20 FALSE bg
## 798 run1 18 20 FALSE bg
## 799 run1 19 20 FALSE bg
## 800 run1 20 20 FALSE bgiData() can be used to access elements of the imageData() list by name or index.
Using iData() with no arguments besides the dataset will get or set the first element of imageData(). Providing a name or index will get or set that element.
iData(mse, "log2intensity") <- log2(iData(mse) + 1)
imageData(mse)## MSContinuousImagingSpectraList of length 2
## names(2): intensity log2intensity
## class(2): matrix matrix
## dim(2): <3919 x 800> <3919 x 800>
## mem(2): 25.1 MB 25.1 MBFor MSImagingExperiment, spectra() is an alias for iData().
spectra(mse, "log2intensity")[1:5, 1:5]## [,1] [,2] [,3] [,4] [,5]
## [1,] 0.9482973 0.9840368 0.9571834 0.9347079 0.9230042
## [2,] 1.0062627 1.2084339 1.0655022 1.0174904 1.0500678
## [3,] 1.0411028 1.0444525 1.1639734 0.9500770 0.9124515
## [4,] 0.9221343 1.1089029 0.9449329 0.9634461 1.0091524
## [5,] 1.0468679 1.0088489 1.0208805 0.9259353 1.0790753Whether or not the spectra have been centroided or not can be accessed using centroided()
centroided(mse)## [1] FALSEThis can also be used to set whether the spectra should be treated as centroided or not.
centroided(mse) <- FALSE6.5 Using dplyr verbs
The dplyr package introduced popular verbs for manipulating data, and promoted widespread adoption of the expressive %>% piping operator used for chaining verbs together.
Cardinal 2 implements the dplyr verbs filter(), select(), mutate(), and summarize() for MSImagingExperiment objects.
filter()subsets anMSImagingExperimentby row, i.e., mass featuresselect()subsets anMSImagingExperimentby column, i.e., pixelsmutate()adds a pixel metadata column to anMSImagingExperimentsummarize()summarizes anMSImagingExperimentby either feature or pixel
The %>% operator can be used to chain these operations together. For file-based data, the subsetting should be quick, as only metadata is modified.
# filter mass range
filter(mse, mz > 700, mz < 900)
# select pixels
select(mse, x <= 3, y <= 3, run == "run0")
# chain verbs together
mse %>%
filter(mz < 1000) %>%
select(x == 10, y == 10)
# calculate mean spectrum
summarize(mse, .stat="mean", .by="feature", .as="DataFrame")
# calculate tic
summarize(mse, .stat=c(tic="sum"), .by="pixel", .as="DataFrame")
# calculate mean spectrum of circle region
mse %>%
select(region == "circle") %>%
summarize(.stat="mean", .as="DataFrame")6.6 Collect data into memory
By default, Cardinal 2 does not load the spectra from imzML and Analyze files into memory, but retrieves them from files when necessary.
For very large datasets, this is necessary and memory-efficient.
However, for datasets that are known to fit in computer memory, this may be unnecessarily slow, especially when plotting images (which are perpendicular to how data are stored in the files).
# coerce spectra to file-based matter matrix
spectra(mse) <- matter::as.matter(spectra(mse))
spectra(mse)## <3919 row, 800 column> matter_matc :: out-of-memory numeric matrix
## [,1] [,2] [,3] [,4]
## [1,] 0.929593985749523 0.977992334255707 0.941515698898047 0.911503628041379
## [2,] 1.00870086651911 1.31086642293593 1.09289833045394 1.02439444262814
## [3,] 1.05780006935272 1.06258344855023 1.24073708584273 0.93197575318083
## [4,] 0.894916515700226 1.15681575755041 0.92509939130322 0.949962119177309
## [5,] 1.06603952985143 1.01230482004299 1.02915697989109 0.899915591256897
## [6,] 0.921759798412127 1.06647982270475 0.983971732163821 0.844834986167779
## ... ... ... ... ...
## [,5] [,6] ...
## [1,] 0.896059510791875 0.995104040677534 ...
## [2,] 1.07062719616811 1.06550164549397 ...
## [3,] 0.882241208579355 0.977646123538851 ...
## [4,] 1.01272818923958 1.15616832323534 ...
## [5,] 1.11268157414036 0.955812180737613 ...
## [6,] 1.13482107107674 1.08524715504496 ...
## ... ... ... ...
## (13.4 KB real | 25.1 MB virtual)imageData(mse)## MSContinuousImagingSpectraList of length 2
## names(2): intensity log2intensity
## class(2): matter_matc matrix
## dim(2): <3919 x 800> <3919 x 800>
## mem(2): 13.4 KB 25.1 MBUse collect() to pull all imageData() elements in an MSImagingExperiment into memory.
mse <- collect(mse)
imageData(mse)## MSContinuousImagingSpectraList of length 2
## names(2): intensity log2intensity
## class(2): matrix matrix
## dim(2): <3919 x 800> <3919 x 800>
## mem(2): 25.1 MB 25.1 MBBy default, the spectra from MSProcessedImagingExperiment objects will still be represented as sparse matrices after using collect().
To coerce sparse spectra to an R matrix as well, use as.matrix=TRUE.
mse3 <- collect(mse3, as.matrix=TRUE)6.7 Coercion to/from other classes
Use as() to coerce between different MSImagingExperiment sub-classes.
mse3## An object of class 'MSProcessedImagingExperiment'
## <1959 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(3): square1 square2 circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2042.8053
## centroided: FALSEas(mse3, "MSContinuousImagingExperiment")## An object of class 'MSContinuousImagingExperiment'
## <1959 feature, 800 pixel> imaging dataset
## imageData(1): intensity
## featureData(0):
## pixelData(3): square1 square2 circle
## metadata(1): design
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2042.8053
## centroided: FALSEThis will often change the underlying data representation, so some information may be lost depending on the coercion.
Objects of the older MSImageSet class can also be coerced to MSImagingExperiment this way.
# requires CardinalWorkflows installed
data(cardinal, package="CardinalWorkflows")
cardinal2 <- as(cardinal, "MSImagingExperiment")7 Pre-processing
A major change in Cardinal 2 from earlier versions is how pre-processing is handled.
Instead of applying pre-processing immediately, each pre-processing step is queued to the dataset, and only applied once process() is called.
This approach is more computationally and memory efficient in most cases, as ideally each spectrum is only processed once, and no extraneous copies of the data are made.
7.1 Delayed processing with process()
On its own, the process() method queues a new pre-processing function, and then applies all currently queued processing functions.
For example, the following code applies very basic total-ion-current (TIC) normalization to all spectra.
mse_tic <- process(mse, function(x) length(x) * x / sum(x), label="norm")
mse_tic## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(2): intensity log2intensity
## featureData(0):
## pixelData(2): circle region
## metadata(1): design
## processing complete(1): norm
## processing pending(0):
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSEBy default, this is applied immediately. However, delay=TRUE delays this, and allows us to queue multiple pre-processing functions at once.
mse_pre <- mse %>%
process(function(x) length(x) * x / sum(x), label="norm", delay=TRUE) %>%
process(function(x) signal::sgolayfilt(x), label="smooth", delay=TRUE)
processingData(mse_pre)## List of length 2
## names(2): norm smoothWe can view all pending and completed pre-processing steps in more detail.
mcols(processingData(mse_pre))[,-1]## DataFrame with 2 rows and 6 columns
## kind pending complete has_pre has_post has_plot
## <character> <logical> <logical> <logical> <logical> <logical>
## norm pixel TRUE FALSE FALSE FALSE FALSE
## smooth pixel TRUE FALSE FALSE FALSE FALSECalling process() on the dataset again without any other arguments will apply all queued pre-processing steps.
mse_proc <- process(mse_pre)
mse_proc## An object of class 'MSContinuousImagingExperiment'
## <3919 feature, 800 pixel> imaging dataset
## imageData(2): intensity log2intensity
## featureData(0):
## pixelData(2): circle region
## metadata(1): design
## processing complete(2): norm smooth
## processing pending(0):
## run(2): run0 run1
## raster dimensions: 20 x 20
## coord(2): x = 1..20, y = 1..20
## mass range: 426.5285 to 2044.4400
## centroided: FALSENote that subsetting retains any queued pre-processing steps.
mse_pre %>%
select(x <= 3, y <= 3) %>%
filter(mz <= 1000) %>%
process()## An object of class 'MSContinuousImagingExperiment'
## <2131 feature, 18 pixel> imaging dataset
## imageData(2): intensity log2intensity
## featureData(0):
## pixelData(2): circle region
## metadata(1): design
## processing complete(2): norm smooth
## processing pending(0):
## run(2): run0 run1
## raster dimensions: 3 x 3
## coord(2): x = 1..3, y = 1..3
## mass range: 426.5285 to 999.9239
## centroided: FALSEAll pre-processing methods for MSImagingExperiment queue delayed processing by default.
If this is not desired, you can set options(Cardinal.delay=FALSE) to apply all pre-processing steps immediately.
7.2 Normalization
Use normalize() to queue normalization to an MSImagingExperiment.
mse_pre <- normalize(mse, method="tic")method="tic"performs total-ion-current (TIC) normalizationmethod="rms"performs root-mean-square (RMS) normalizationmethod="reference"normalizes all spectra to a reference feature
TIC normalization is one of the most common normalization methods for mass spectrometry imaging. For comparison between datasets, TIC normalization requires that all spectra are the same length. RMS normalization is more appropriate when spectra are of different lengths.
Normalization to a reference is the most reliable form of normalization, but is only possible when the experiment contains a known reference peak with a constant abundance throughout the dataset. This is often not possible in unsupervised and exploratory experiments.
7.3 Spectral smoothing
Use smoothSignal() to queue spectral smoothing to an MSImagingExperiment.
mse %>% smoothSignal(method="gaussian") %>%
select(x==10, y==10, run=="run0") %>%
process(plot=TRUE,
par=list(main="Gaussian smoothing", layout=c(3,1)))
mse %>% smoothSignal(method="ma") %>%
select(x==10, y==10, run=="run0") %>%
process(plot=TRUE, par=list(main="Moving average smoothing"))
mse %>% smoothSignal(method="sgolay") %>%
select(x==10, y==10, run=="run0") %>%
process(plot=TRUE, par=list(main="Savitzky-Golay smoothing"))
mse_pre <- smoothSignal(mse_pre, method="gaussian")method="gaussian"performs smoothing with a Gaussian kernelmethod="ma"performs moving average smoothingmethod="sgolay"applies a Savitzky-Golay smoothing filter
7.4 Baseline correction
Use reduceBaseline() to queue baseline correction to an MSImagingExperiment.
mse %>% reduceBaseline(method="locmin") %>%
select(x==10, y==10, run=="run0") %>%
process(plot=TRUE, par=list(main="Local minima", layout=c(2,1)))
mse %>% reduceBaseline(method="median") %>%
select(x==10, y==10, run=="run0") %>%
process(plot=TRUE, par=list(main="Median interpolation"))
mse_pre <- reduceBaseline(mse_pre, method="locmin")method="locmin"interpolates a baseline from local minimamethod="median"splits a spectrum into blocks and interpolates from binned medians
7.5 Peak processing
Peak processing encompasses multiple steps, including (1) picking peaks, (2) aligning peaks, (3) filtering peaks, and (4) binning profile spectra to the detected peaks.
Prior to peak detection is a good time to apply the previous processing steps.
mse_pre <- process(mse_pre)(This is optional, and not necessary if only the peaks are desired, and if it is acceptable to have peaks with intensities of zero in pixels where that peak was not detected.)
7.5.1 Peak picking
Use peakPick() to queue peak picking to an MSImagingExperiment.
mse_pre %>% select(x==10, y==10, run=="run0") %>%
process() %>%
peakPick(method="mad") %>%
process(plot=TRUE, par=list(main="MAD noise", layout=c(3,1)))
mse_pre %>% select(x==10, y==10, run=="run0") %>%
process() %>%
peakPick(method="simple") %>%
process(plot=TRUE,
par=list(main="Simple SD noise"))
mse_pre %>% select(x==10, y==10, run=="run0") %>%
process() %>%
peakPick(method="adaptive") %>%
process(plot=TRUE, par=list(main="Adaptive SD noise"))
mse_peaks <- peakPick(mse_pre, method="mad")method="mad"calculates adaptive noise from interpolating local mean absolute deviationsmethod="simple"calculates a constant noise from standard deviations of low-kurtosis binsmethod="adaptive"calculates adaptive noise from standard deviations of low-kurtosis bins
7.5.2 Peak alignment
Use peakAlign() to queue peak alignment to an MSImagingExperiment.
mse_peaks <- peakAlign(mse_pre, tolerance=200, units="ppm")Peaks are matched based on proximity of their m/z-values, according to tolerance, in either parts-per-millin (“ppm”) or absolute (“mz”) units.
The m/z-values of known reference peaks can be provided. If no reference is provided, the mean spectrum is calculated, and the local maxima of the mean spectrum are used as the reference.
7.5.3 Peak filtering
Use peakFilter() to queue peak filtering to an MSImagingExperiment.
mse_peaks <- peakFilter(mse_pre, freq.min=0.05)The proportions of pixels where a peak was detected at each m/z-value are calculated. Only peaks with frequencies greater than freq.min are retained.
7.5.4 Peak binning
Use peakBin() to queue binning of spectra to reference peaks.
Typically, this is applied to processed profile spectra after peak detection, to extract a more accurate representation of the peak intensities.
mse_peaks <- process(mse_peaks)
mse_peaks <- peakBin(mse_pre, ref=mz(mse_peaks), type="height")
mse_peaks <- mse_peaks %>% process()A tolerance in either parts-per-million (“ppm”) or absolute (“mz”) units is used to match the reference peaks to local maxima in each spectrum.
The peak is then expanded to the nearest local minima in both directions. The intensity of the peak is then summarized either by the maximum intensity (type="height") or sum of intensities (type="area").
Rather than use the m/z-values of the detected peaks, we can also use known reference peaks (in this case, from the design of the simulated data).
mzref <- mz(metadata(mse)$design$featureData)
mse_peaks <- peakBin(mse_pre, ref=mzref, type="height")
mse_peaks <- mse_peaks %>% select(x %in% 9:11, y %in% 9:11) %>% process()
plot(mse_peaks, coord=list(x=10, y=10))
We typically recommend binning the processed profile spectra to detected or reference peaks to produce centroided spectra suitable for downstream analysis.
It is possible to use the detected and aligned peaks directly (after applying peakAlign() and peakFilter()), but pixels where a peak was not detected will have zero intensities for those peaks. Moreover, all peak intensities will be the peak heights, even when peak areas may be desired instead. However, using the detected peaks directly does mean that there is no need to calculate and store the processed profile spectra, so this saves on storage space.
Generally, it is preferable and more accurate to bin the processed profile spectra to the detected peaks whenever possible and reasonable.
7.6 Mass alignment
Although peak alignment and peak binning will generally account for small differences in m/z between spectra, alignment of the profile spectra is sometimes desireable as well.
Use mzAlign() to queue alignment of spectra so that peaks will have a consistent m/z-value.
First, we need to simulate spectra that are in need of calibration.
set.seed(2020)
mse4 <- simulateImage(preset=1, npeaks=10, from=500, to=600,
sdmz=750, units="ppm")
plot(mse4, pixel=185:195, xlim=c(535, 570), key=FALSE, superpose=TRUE)
If no reference spectrum is provided, the mean spectrum is calculated and used as the reference.
mse4_align <- mzAlign(mse4, tolerance=2000, units="ppm")
mse4_align <- process(mse4_align)
plot(mse4_align, pixel=185:195, xlim=c(535, 570), key=FALSE, superpose=TRUE)
The algorithm will try to match the most intense peaks in the reference to local maxima in each spectrum, within tolerance. If tolerance is too small, the matching local maxima may not be found. If tolerance is too large, then peaks may be matched to the wrong local maxima.
This method is still experimental and under development.
7.7 Mass binning
While the m/z binning scheme of MSProcessedImagingExperiment objects can be adjusted on-the-fly, this does not apply to other types of MSImagingExperiment.
Use mzBin() to queue binning of spectra to new m/z-values.
mse_bin <- mzBin(mse_pre, from=1000, to=1600, resolution=1000, units="ppm")
mse_bin <- select(mse_bin, x %in% 9:11, y %in% 9:11) %>% process()
plot(mse_bin, coord=list(x=10, y=10))
This is useful if you need to combine datasets with different m/z-values.
7.8 Mass filtering
Sometimes it is necessary to filter the mass features of a dataset that has not been peak picked and aligned. For example, to remove noisy or low-intensity m/z-values.
Use mzFilter() to queue filtering of mass features.
mse_filt <- mzFilter(mse_pre, thresh.max=0.05)
mse_filt <- select(mse_filt, x %in% 9:11, y %in% 9:11) %>% process()
plot(mse_filt, coord=list(x=10, y=10), type='h')
mzFilter() and peakFilter() are actually the same function internally, but with different defaults for profile and centroided spectra, respectively.
Note that mzFilter() this does not set centroided() to TRUE; it is up to the user to decide whether the result represent centroided spectra or not, and set centroided() appropriately.
7.9 Example processing workflow
Delayed pre-processing makes it easy to chain together multiple pre-processing steps with the %>% operator, and then apply them all at once.
mse_proc <- mse %>%
normalize() %>%
smoothSignal() %>%
reduceBaseline() %>%
peakPick()
# preview processing
mse_proc %>%
select(x == 10, y == 10, run == "run0") %>%
process(plot=TRUE, par=list(layout=c(2,2)))
# process detected peaks
mse_peakref <- mse_proc %>%
peakAlign() %>%
peakFilter() %>%
process()
# bin profile spectra to peaks
mse_peaks <- mse %>%
normalize() %>%
smoothSignal() %>%
reduceBaseline() %>%
peakBin(mz(mse_peakref))8 Advanced operations on MSImagingExperiment
Internally, most methods that iterate over pixels or mass features use some combination of pixelApply(), featureApply(), and spatialApply().
While summarize() is useful for summarizing a MSImagingExperiment, it is limited in that it can only apply summary functions that return a single value, which can be simplified into the columns of a MassDataFrame or PositionDataFrame.
By contrast, these functions (like apply() and lapply()) can return any value.
8.1 Using pixelApply() and featureApply()
pixelApply() is used to apply functions over pixels.
# calculate the TIC for every pixel
tic <- pixelApply(mse, sum)
image(mse, tic ~ x * y)
featureApply() is used to apply functions over features.
# calculate the mean spectrum
smean <- featureApply(mse, mean)
plot(mse, smean ~ mz)
Note that featureApply() will typically be slower than pixelApply() for out-of-memory data for MSProcessedImagingExperiment objects, due to the way the data is stored.
8.2 Using spatialApply()
spatialApply() is used to iterate over spatial neighborhoods of an imaging experiment.
Rather than vectors, it operates on matrices, where each column is a mass spectrum from a different pixel in the neighborhood.
# calculate a spatially-smoothed TIC
sptic <- spatialApply(mse, .r=1, .fun=mean)
image(mse, sptic ~ x * y)
See ?spatialApply for more details on attributes that are made available to the calling function (e.g., information about the neighborhood offsets, center pixel, etc.).
9 Parallel computing using BiocParallel
All pre-processing methods and most statistical analysis methods in Cardinal 2 can be executed in parallel using BiocParallel.
If your R session hangs inexplicably, try using register(SerialParam()) to run the code serially instead.
9.1 Using BPPARAM
Any method that supports parallelization includes BPPARAM as an argument (see method documentation). The BPPARAM argument can be used to specify a parallel backend for the operation, such as SerialParam(), MulticoreParam(), SnowParam(), etc.
# run serially, rather than in parallel
tic <- pixelApply(mse, sum, BPPARAM=SerialParam())9.2 Registering a parallel backend
Registered backends can be viewed with registered().
registered()## $SerialParam
## class: SerialParam
## bpisup: FALSE; bpnworkers: 1; bptasks: 0; bpjobname: BPJOB
## bplog: FALSE; bpthreshold: INFO; bpstopOnError: TRUE
## bpRNGseed: ; bptimeout: 2592000; bpprogressbar: FALSE
## bpexportglobals: TRUE
## bplogdir: NA
## bpresultdir: NA
##
## $SnowParam
## class: SnowParam
## bpisup: FALSE; bpnworkers: 4; bptasks: 0; bpjobname: BPJOB
## bplog: FALSE; bpthreshold: INFO; bpstopOnError: TRUE
## bpRNGseed: ; bptimeout: 2592000; bpprogressbar: FALSE
## bpexportglobals: TRUE
## bplogdir: NA
## bpresultdir: NA
## cluster type: SOCKA backend can be registered with register() to be used as the default backend from then on.
# register a SNOW backend
register(SnowParam())Note that not all backends are available on all systems. (For example, MulticoreParam() is only available on macOS and Linux.)
See the BiocParallel package documentation for more details on available parallel backends.
9.3 RNG and reproducibility
For methods that rely on random number generation to be reproducible when run in parallel, the RNG must be set to “L’Ecuyer-CMRG” before setting a seed.
RNGkind("L'Ecuyer-CMRG")
set.seed(1)10 Session information
sessionInfo()## R version 3.6.1 (2019-07-05)
## Platform: x86_64-w64-mingw32/x64 (64-bit)
## Running under: Windows Server 2012 R2 x64 (build 9600)
##
## Matrix products: default
##
## locale:
## [1] LC_COLLATE=C
## [2] LC_CTYPE=English_United States.1252
## [3] LC_MONETARY=English_United States.1252
## [4] LC_NUMERIC=C
## [5] LC_TIME=English_United States.1252
##
## attached base packages:
## [1] stats4 parallel stats graphics grDevices utils datasets
## [8] methods base
##
## other attached packages:
## [1] Cardinal_2.4.0 ProtGenerics_1.18.0 S4Vectors_0.24.0
## [4] EBImage_4.28.0 BiocParallel_1.20.0 BiocGenerics_0.32.0
## [7] BiocStyle_2.14.0
##
## loaded via a namespace (and not attached):
## [1] biglm_0.9-1 locfit_1.5-9.1 tidyselect_0.2.5
## [4] xfun_0.10 purrr_0.3.3 lattice_0.20-38
## [7] htmltools_0.4.0 viridisLite_0.3.0 yaml_2.2.0
## [10] rlang_0.4.1 pillar_1.4.2 glue_1.3.1
## [13] DBI_1.0.0 sp_1.3-1 jpeg_0.1-8.1
## [16] stringr_1.4.0 htmlwidgets_1.5.1 evaluate_0.14
## [19] Biobase_2.46.0 knitr_1.25 irlba_2.3.3
## [22] Rcpp_1.0.2 BiocManager_1.30.9 abind_1.4-5
## [25] png_0.1-7 digest_0.6.22 stringi_1.4.3
## [28] tiff_0.1-5 bookdown_0.14 dplyr_0.8.3
## [31] grid_3.6.1 tools_3.6.1 bitops_1.0-6
## [34] magrittr_1.5 RCurl_1.95-4.12 tibble_2.1.3
## [37] crayon_1.3.4 pkgconfig_2.0.3 MASS_7.3-51.4
## [40] Matrix_1.2-17 matter_1.12.0 assertthat_0.2.1
## [43] rmarkdown_1.16 R6_2.4.0 fftwtools_0.9-8
## [46] mclust_5.4.5 signal_0.7-6 nlme_3.1-141
## [49] compiler_3.6.1