Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Feb 1.
Published in final edited form as: Proc SPIE Int Soc Opt Eng. 2021 Feb 15;11599:1159904. doi: 10.1117/12.2582266

Task-based assessment of binned and list-mode SPECT systems

Md Ashequr Rahman 1,2, Abhinav K Jha 1,2
PMCID: PMC8325874  NIHMSID: NIHMS1727728  PMID: 34345113

Abstract

In SPECT, list-mode (LM) format allows storing data at higher precision compared to binned data. There is significant interest in investigating whether this higher precision translates to improved performance on clinical tasks. Towards this goal, in this study, we quantitatively investigated whether processing data in LM format, and in particular, the energy attribute of the detected photon, provides improved performance on the task of absolute quantification of region-of-interest (ROI) uptake in comparison to processing the data in binned format. We conducted this evaluation study using a DaTscan brain SPECT acquisition protocol, conducted in the context of imaging patients with Parkinson’s disease. This study was conducted with a synthetic phantom. A signal-known exactly/background-known-statistically (SKE/BKS) setup was considered. An ordered-subset expectation-maximization algorithm was used to reconstruct images from data acquired in LM format, including the scatter-window data, and including the energy attribute of each LM event. Using a realistic 2-D SPECT system simulation, quantification tasks were performed on the reconstructed images. The results demonstrated improved quantification performance when LM data was used compared to binning the attributes in all the conducted evaluation studies. Overall, we observed that LM data, including the energy attribute, yielded improved performance on absolute quantification tasks compared to binned data.

Keywords: List-mode, SPECT, binning, reconstruction, quantification, objective assessment of image quality

1. INTRODUCTION

Single photon emission computed tomography (SPECT) is a widely used clinical imaging modality with multiple clinical applications. In SPECT, using the detector measurements, for each detected photon, multiple attributes including the position of interaction in the detector, energy deposited in the detector and angle of acquisition can be estimated and stored. Recording attributes for each detected photon results in list-mode (LM) data format.1 Traditional methods typically bin the attributes before reconstructing the image. Studies have shown that this process of binning leads to information loss.25 In particular, it was shown that a larger set of null functions exist when binning is introduced.3,4,6 The increase in null function results in bias on the task of quantification.7 Further, it has also been shown in a simplified SPECT system that the process of binning the angle of acquisition attribute negatively impacts performance on the task of quantification.7 These findings motivate studying the impact of binning on quantification performance for more realistic SPECT systems.

One key attribute estimated by a SPECT system for each gamma-ray photon is the energy deposited by the photon in the scintillation crystal. Studies are suggesting that this energy attribute contains information to perform tasks such as estimating the attenuation distribution.5,810 However, typically this attribute is binned, leading to different energy windows, and of these, the scatter-window data is typically discarded. More recent studies are demonstrating that photons in the scatter-window data may contain information to estimate the activity distribution.5,11 Thus, that leads to the question of whether processing these photons in LM format without binning the energy attribute results in improved image quality. Our goal in this manuscript was to investigate this question. This would provide further insights on the impact of processing binned vs. LM data on image quality in SPECT.

Imaging systems and methods are developed for specific clinical tasks, such as detection, quantification, or a combination of both. Thus, a rigorous approach to image-quality evaluation should account for the clinical task performed on the acquired image. Objective assessment of image quality (OAIQ)-based studies provide a mechanism for conducting such task-based evaluation quantitatively and by accounting for population variability, imaging-system physics, the observer performing the task, and a figure of merit that quantifies this performance.1219 Thus, we conducted an OAIQ-based study to evaluate the impact of binning on performance in quantification tasks.

A key enabler of our OAIQ-based study was a recently developed iterative method that uses LM data, including scatter-window data and containing the energy attribute, to reconstruct the activity distribution in SPECT.20 This method compensates for the relevant image-degrading processes in SPECT including scatter, attenuation, noise, and collimator-detector response. The method provides an avenue to investigate the impact of binning the LM event attributes, including the energy attribute, on performance in absolute quantification tasks in SPECT. Our objective in this study was to investigate this impact using an OAIQ framework on the task of absolute quantification in SPECT. For this purpose, we conducted OAIQ-based studies in the context of quantiative dopamine transporter (DaT) SPECT. Quantitative uptakes in striatal regions in the brain, as extracted for DaT SPECT images, are being explored as biomarkers to measure severity of Parkinson’s disease. There is an important need for such biomarkers, given the exciting developments in developing disease-modifying therapies for this disease. However, for these quantitative uptakes to be applicable as biomarkers, they need to be reliably estimated from the images. We investigated whether using LM data would yield more reliable quantification of these uptake values.

2. METHOD

A simulation-based OAIQ study typically consists of five components: (a) a definition of the task, (b) object model, (c) simulation of the imaging process, (d) process to extract the task-specific information and (e) figure of merit to measure task performance. In this section, we describe each of these components in our study. As mentioned above, the study was conducted in the context of quantitative DaT-SPECT.

2.1. Definition of task

We evaluated the LM and binned systems on the task of quantifying activity within a pre-defined region of interest (ROI). In DaT-SPECT, the goal is to estimate the activity in the caudate and putamen regions. The boundaries for these regions can be obtained by either segmenting these regions,2123 or from other imaging modalities, such as MRI.24 Thus, the ROI can be defined. We thus frame our task as estimating the activity within the known ROIs from the SPECT images. These SPECT images were acquired using a 2D acquisition protocol, as described in more detail in the next section.

We conducted the quantitative analysis with a synthetic phantom that has similar properties as the brain phantom. Task performance was assessed over multiple realizations. The background was also varied in the different realizations, while the signal properties were constant. Thus, this was a signal-known-exactly/background-known-statistically (SKE/BKS) study in the context of a quantification task except that the signal intensity was not known. The rationale behind conducting this study was to evaluate performance as the background varied on quantification tasks. Variation in background has been known to impact detection-task performance.25

2.2. Object model

To simulate an object similar to the brain, an elliptical shaped synthetic phantom (Fig. 1a) was considered where the background was simulated using a clustered lumpy background model.26 A circular region with 7 mm radius located at an off-center position inside the phantom was considered as the known signal. To analyze the effect of varying signal/tumor-to-background ratio (SBR/TBR) on task performance, the mean SBR value was varied between 1.2:1, 1.5:1, 2:1 and 3:1. The attenuation distribution was considered to be non-uniform (Fig. 1b). The attenuation coefficient was 21m−1 at the rim region of phantom which simulates a skull and 15m−1 at the inner region simulating the soft tissue.

Figure 1.

Figure 1.

For synthetic phantom, (a) a realization of true activity distribution for signal-present case where mean SBR = 2:1 and (b) true attenuation distribution.

2.3. Simulating the imaging process

We simulated a 2-D SPECT system with configuration similar to GE’s Optima 640 system and a low-energy high resolution (LEHR) parallel-hole collimator. We considered that the phantom has been injected with Ioflupane (I-123) radiotracer, which emits gamma-ray photon at 159 KeV energy. The detector position resolution was set to 4 mm. The detector energy resolution was set to 10% FWHM at 159 KeV and was assumed to be constant in the range of 80 KeV to 175 KeV. LM data, that falls into the energy range 70 KeV to 175 keV, was generated using Monte Carlo simulation and only contained events that went through up to first order of scatter. The data was acquired in 120 fixed angular position over 360°. Approximately 8 × 104 events were detected in a energy window ranging from 80 KeV to 175 KeV, thus simulating a low-dose SPECT protocol.

This LM data was reconstructed as such using the reconstruction algorithm described below. To study the impact of binning on task performance, we binned the energy attribute of this data into multiple bins, namely 2 bins and 3 bins. We set the first bin as same as the photo-peak energy window (143–175 KeV for DaT-SPECT). All the events inside this bin were assigned a fixed energy value, equal to the primary photon energy (159 KeV). Depending on the total number of bins, the scatter-window was then divided into equal-width windows. All photons within a given scatter-energy bin were assigned the energy value at the center of that bin. These binned data were also reconstructed using the reconstruction algorithm described below.

2.4. Process to extract task-specific information

The measured projection data was reconstructed using the maximum-likelihood expectation-maximization-based method as briefly described in Rahman et al.20 The method extends upon an approach originally proposed in8,27 and allows processing LM data acquired in any arbitrary-sized energy window and incorporate the energy attribute of detected photon. Further, the method compensates for attenuation, scatter, collimator-detector response, and noise in SPECT. Here we briefly describe the technique.

Consider a SPECT system that acquires LM data for a fixed scan time, T. The objective of the reconstruction method is to estimate the discrete activity distribution denoted by the N-dimensional vector λ over Q voxels. Let λq denote the mean rate of emission from qth voxel. Denote the number of detected events by J. The detected events are stored in LM format where for each photon, the attributes of position of interaction of detected photon in the the scintillation crystal, energy deposited by the detected photon and time of detection are recorded. We denote the true and measured attributes of jth detected event by vectors Aj and A^j, respectively. We also denote as the path traversed by an emitted photon and A^ as the full set of measured attributes where A^={A^j,j=1,2,J}. We can write the likelihood of the measured LM data as

pr(A^,Jλ)=Pr(Jλ)pr(A^λ)=Pr(Jλ)j=1Jpr(A^jλ) (1)
=Pr(Jλ)j=1Jpr(A^j)Pr(λ), (2)

where, in the second step, we have used the fact that the LM events are all independent, while in the third step, we have decomposed pr(A^jλ) as a mixture model in terms of the probability that a photon takes a path and the probability of that path. Here, we point that J is a Poisson distributed random variable. Let seff() denote the sensitivity of a path and λ() denote the activity at the voxel where the path originates from. We can derive the form of pr(A^j) using radiative transport equation as27

pr(λ)=λ()seff()λ()seff(). (3)

Thus we can write the log-likelihood of observed LM data as

L(λA^,J)=j=1Jlogpr(A^j)λ()seff()+J log(T)Tλ()seff()log J!. (4)

To maximize this likelihood, an expectation-maximization algorithm is developed. For each event j and each possible path , we denote a hidden variable zj, where

zj,={1 if event j took the path .0 otherwise.

Let us denote the vector zj by accumulating all the hidden vectors of all possible path for this specific event j. The observed LM data and the hidden vectors form the complete data. We can derive the form of complete data log-likelihood as:

LC(λ{A^j,zj;j=1,J},J)=j=1J[zj,{log pr(A^j)+log λ()+log seff()}]+J log TTλ()seff()log J!. (5)

Taking the expectation and maximization steps on this complete data log-likelihood leads to following iterative update:

λ^q(t+1)=j=1Jqz¯j,q(t+1)Tqseff(q), (6)

where, q denotes paths that start from voxel q, λq denotes the activity rate at that starting voxel and z¯j,(t+1)=E[zj,A^j;λ(t)] is the expected value of the hidden variable conditioned on observed LM data.

However, the algorithm was still computationally intensive. Thus, in our OAIQ-based studies, we considered only up to first-order scatter events. Further, to ensure that the number of scatter events in the forward and inverse model match, we reconstructed the images using photons that scatter only once.

From the reconstructed images, we estimated the mean activity uptake inside the known region of interest (ROI). Let the N-dimensional vector χk denote the binary mask that denotes the ROI for the kth region. Let a^k denote the estimated activity in that region using this procedure. Then, mathematically,

a^k=q=1Qλqχqkq=1Qχqk. (7)

2.5. Figure of merit to measure task performance

The performance of the list-mode and binned-based estimation approaches on the task of activity estimation was quantified on the basis of accuracy and precision of the estimated uptake using the metrics of normalized bias and variance. Further, the overall reliability of the estimated uptake was quantified using the metric of normalized root mean squared error (NRMSE). This is a summary figure of merit that quantifies the effect of both bias and variance, and thus indicates the overall reliability on the quantification task. Let ak and a^k denote the true and estimated activities within the kth ROIs. Let P denote the number of noise realizations. Then, the NRMSE for the kth ROI was defined as:

NRMSE=1aki=1P(aka^ki)2P. (8)

3. RESULTS

Fig. 2a shows that processing the energy attribute in LM format led to a lower bias for SBR values greater than1.5 in comparison to binning this attribute. Binning the list-mode attributes leads to increase in null space,3,4 and as shown in another study,7 this causes a bias in quantification performance. Our results are consistent with that study and show that binning the energy attribute leads to an increase in bias.

Figure 2.

Figure 2.

For different binning configuration, (a) normalized bias, (b) variance and (c) NRMSE between the estimated activity uptake inside signal region and true mean activity uptake as a function of mean SBR in a SKE/BKS setup.

At the same time, we observe that the standard deviation when using the LM data is higher compared to when using the binned format (Fig. 2b). However, in case of the NRMSE, which is a combination of the bias and variance, it is observed that LM data yields a lower NRMSE compared to the binned format (Fig. 2c). This suggest that the improvement in bias is more significant compared to the impact on increasing variance when using list-mode data

4. DISCUSSIONS

In this manuscript we evaluated the effect of binning the energy attributes of the LM data on the task of quantifying uptake within a pre-defined ROI in a 2-D DaT-SPECT system. We consistently observed that processing data in LM format yielded improved quantification performance. As mentioned above, LM format allows storing the data at higher precision compared to binned format. Our results show that this increase in precision very much translates into a tangible improved performance on quantification tasks.

In our quantification study, we did not perform any partial volume compensation (PVC). Previous studies28 have demonstrated that compensating for PVEs results in improved quantification performance. Thus, integrating this LM-based reconstruction approach with a PVC approach may lead to even more reliable quantification, and is an important area of future research.

The current study has some limitations. We evaluated the performance of LM and binned data based on a 2-D SPECT system. We considered only up to single-order of scatter in forward model and reconstruction framework. Our promising results motivate extension of this study to 3-D setup and modeling multiple scatter events.

5. CONCLUSIONS

Our objective-assessment-of-image-quality-based analysis provides evidence that processing SPECT-emission data in list-mode format provides improved performance compared to binned format for the task of estimating activity within a known region of interest, as evaluated in clinically relevant applications conducted in the context of quantitaitve dopamine transporter SPECT. This analysis motivates large-scale 3D simulation and physical-phantom studies to further validate this finding. Improved performance with list-mode data in these studies would provide evidence to process the energy attribute in list-mode format as opposed to binning data in energy windows.

ACKNOWLEDGMENTS

This work was financially supported by NIH R21 EB024647 (Trailblazer award) and by an NVIDIA GPU grant. The authors thank Richard Laforest, PhD for helpful discussions.

REFERENCES

  • [1].Barrett HH, White T, and Parra LC, “List-mode likelihood,” J Opt Soc Am A Opt Image Sci Vis 14, pp. 2914–2923, November 1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [2].Caucci L, Liu Z, Jha A, Han H, Furenlid L, and Barrett H, “Towards continuous-to-continuous 3D imaging in the real world,” Phys Med Biol 64(18), p. 185007, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [3].Jha AK, Barrett HH, Frey EC, Clarkson E, Caucci L, and Kupinski MA, “Singular value decomposition for photon-processing nuclear imaging systems and applications for reconstruction and computing null functions,” Phys Med Biol 60, pp. 7359–7385, September 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [4].Clarkson E and Kupinski M, “Quantifying the loss of information from binning list-mode data,” JOSA A 37(3), pp. 450–457, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [5].Rahman MA, Zhu Y, Clarkson E, Kupinski MA, Frey EC, and Jha AK, “Fisher information analysis of list-mode SPECT emission data for joint estimation of activity and attenuation distribution,” Inverse Problems 36(8), p. 084002, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [6].Caucci L, Jha AK, Furenlid LR, Clarkson EW, Kupinski MA, and Barrett HH, “Image science with photon-processing detectors,” in 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), pp. 1–7, IEEE, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [7].Jha AK and Frey EC, “Estimating ROI activity concentration with photon-processing and photon-counting SPECT imaging systems,” Proc SPIE Med Imag 9412, p. 94120R, April 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [8].Jha AK, Clarkson E, Kupinski MA, and Barrett HH, “Joint reconstruction of activity and attenuation map using LM SPECT emission data,” in Proc SPIE Med Imag, 8668, pp. 86681W1–9, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [9].Cade SC, Arridge S, Evans MJ, and Hutton BF, “Use of measured scatter data for the attenuation correction of single photon emission tomography without transmission scanning,” Med Phys 40(8), p. 082506, 2013. [DOI] [PubMed] [Google Scholar]
  • [10].Yu Z, Rahman MA, Laforest R, Norris SA, and Jha AK, “A physics and learning-based transmissionless attenuation compensation method for SPECT,” in SPIE Med Imag (accepted), 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [11].Kadrmas DJ, Frey EC, and Tsui BM, “Analysis of the reconstructibility and noise properties of scattered photons in Tc-99m SPECT,” Phys Med Biol 42(12), p. 2493, 1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [12].Barrett HH and Myers KJ, Foundations of image science, Wiley, first ed., 2004. [Google Scholar]
  • [13].Barrett HH, Yao J, Rolland JP, and Myers KJ, “Model observers for assessment of image quality,” Proceedings of the National Academy of Sciences 90(21), pp. 9758–9765, 1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [14].Frey EC, Gilland KL, and Tsui BM, “Application of task-based measures of image quality to optimization and evaluation of three-dimensional reconstruction-based compensation methods in myocardial perfusion SPECT,” IEEE Trans. Med. Imaging 21(9), pp. 1040–1050, 2002. [DOI] [PubMed] [Google Scholar]
  • [15].Jha AK, Clarkson E, and Kupinski MA, “An ideal-observer framework to investigate signal detectability in diffuse optical imaging,” Biomedical optics express 4(10), pp. 2107–2123, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [16].Li X, Jha AK, Ghaly M, Elshahaby FE, Links JM, and Frey EC, “Use of sub-ensembles and multi-template observers to evaluate detection task performance for data that are not multivariate normal,” IEEE Trans. Med. Imaging 36(4), pp. 917–929, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [17].Yu Z, Rahman MA, Schindler T, Gropler R, Laforest R, Wahl R, and Jha A, “AI-based methods for nuclear-medicine imaging: Need for objective task-specific evaluation,” Journal of Nuclear Medicine 61(supplement 1), pp. 575–575, 2020. [Google Scholar]
  • [18].Marin T, Kalayeh MM, Parages FM, and Brankov JG, “Numerical surrogates for human observers in myocardial motion evaluation from SPECT images,” IEEE Trans. Med. Imaging 33(1), pp. 38–47, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [19].Jha AK, Caffo B, and Frey EC, “A no-gold-standard technique for objective assessment of quantitative nuclear-medicine imaging methods,” Phys Med Biol 61(7), p. 2780, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [20].Rahman MA, Laforest R, and Jha AK, “A list-mode OSEM-based attenuation and scatter compensation method for SPECT,” in 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pp. 646–650, IEEE, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [21].Boudraa A-O and Zaidi H, “Image segmentation techniques in nuclear medicine imaging,” in Quantitative analysis in nuclear medicine imaging, pp. 308–357, Springer, 2006. [Google Scholar]
  • [22].Moon HS, Liu Z, Ponisio M, Laforest R, and Jha A, “A physics-guided and learning-based estimation method for segmenting 3D DaT-Scan SPECT images,” Journal of Nuclear Medicine 61(supplement 1), pp. 10–10, 2020. [Google Scholar]
  • [23].Liu Z, Moon HS, Laforest R, Perlmutter JS, Norris SA, and Jha AK, “Fully automated 3D segmentation of dopamine transporter SPECT images using an estimation-based approach,” arXiv preprint arXiv:2101.06729, 2021. [Google Scholar]
  • [24].Colloby SJ, O’Brien JT, Fenwick JD, Firbank MJ, Burn DJ, McKeith IG, and Williams ED, “The application of statistical parametric mapping to 123I-FP-CIT SPECT in dementia with lewy bodies, Alzheimer’s disease and Parkinson’s disease,” Neuroimage 23(3), pp. 956–966, 2004. [DOI] [PubMed] [Google Scholar]
  • [25].Rolland J and Barrett HH, “Effect of random background inhomogeneity on observer detection performance,” JOSA A 9(5), pp. 649–658, 1992. [DOI] [PubMed] [Google Scholar]
  • [26].Bochud FO, Abbey CK, and Eckstein MP, “Statistical texture synthesis of mammographic images with clustered lumpy backgrounds,” Opt Express 4(1), pp. 33–43, 1999. [DOI] [PubMed] [Google Scholar]
  • [27].Jha AK, Retrieving information from scattered photons in medical imaging. PhD thesis, College of Optical Sciences, University of Arizona, Tucson, AZ, USA, 2013. [Google Scholar]
  • [28].Du Yong Tsui BMW, and Frey EC, “Partial volume effect compensation for quantitative brain SPECT imaging,” IEEE Trans. Med. Imaging 24(8), pp. 969–976, 2005. [DOI] [PubMed] [Google Scholar]

RESOURCES