Skip to main content

Advertisement

SpringerLink
Log in

Morphological segmenting and neighborhood pixel-based locality preserving projection on brain fMRI dataset for semantic feature extraction: an affective computing study

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Two specific chemical receptive fields of brain, namely the amygdala and the orbital-frontal cortex, are related to valence and arousal in medical experiments. Functional magnetic resonance imaging (fMRI), which is a noninvasive, repeatable, and atomical tool for medical imaging in clinic system, was widely used in affective computing; however, it faces its dataset processing difficulty for dimensional reduction as well as for decreasing the computational complexity. In addition, features extraction from those de-dimensionality datasets is a challenging issue. The current work solved the de-dimensionality issue by using some preprocessing algorithms including clustering, morphological segmenting, and locality preserving projection. In order to keep useful information in fMRI dataset for reduction process, improved neighborhood pixel-based locality preserving projection (NP-LPP) algorithm was addressed and continuously for feature extraction operating using Otsu weighted sum of histogram. Furthermore, a modified covariance power spectral density (MC-PSD) separately in an fMRI Valence–Arousal experiments was measured. The results were analyzed and compared with affective norms English words system. The experiments established that the proposed methods of NP-LPP effectively simplified high complexity of fMRI, and Otsu weighted sum of histogram exhibited superior performance for features extraction compared to the MC-PSD through the calculation root mean standard error. The current proposed method provided a potential application and promising research direction on human semantic retrieval through medical imaging dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Anderson AJ, Zinszer BD, Raizada RD (2016) Representational similarity encoding for fMRI: pattern-based synthesis to predict brain activity using stimulus-model-similarities. NeuroImage 128:44–53

    Article  Google Scholar 

  2. Abdul-Nasir AS, Mashor MY, Mohamed Z (2012) Modified global and modified linear contrast stretching algorithms: new color contrast enhancement techniques for microscopic analysis of malaria slide images. Comput Math Methods Med AID637360, 1–16

    Article  Google Scholar 

  3. Behjat H, Leonardi N, Srnmo L, Ville DVD (2015) Anatomically-adapted graph wavelets for improved group-level fMRI activation mapping. NeuroImage 123:185–199

    Article  Google Scholar 

  4. Bellezza FS, Greenwald AG, Banaji MR (1986) Words high and low in pleasantness as rated by male and female college students. Behav Res Methods Instrum Comput 18(3):299–303

    Article  Google Scholar 

  5. Bradley MM, Lang PJ (1999) Affective norms for English words (ANEW): instruction manual and affective ratings. Technical Report C-1, The Center for Research in Psychophysiology, University of Florida

  6. Chao W-L, Ding J-J, Liu J-Z (2015) Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection. Sig Process 117:1–10

    Article  Google Scholar 

  7. Copland DA, de Zubicaray GI, McMahon K, Eastburn M (2007) Neural correlates of semantic priming for ambiguous words: an event-related fMRI study. Brain Res 1131:163–172

    Article  Google Scholar 

  8. Corona F, Zhu Z, de Souza Jnior AH, Mulas M, Muru E, Sassu L, Barreto G, Baratti R (2013) Supervised distance preserving projections: applications in the quantitative analysis of diesel fuels and light cycle oils from NIR spectra. J Process Control 30: 10–21. cAB/DYCOPS 2013CAB/DYCOPS 2013 selected papers from two joint IFAC conferences: 10th international symposium on dynamics and control of process systems and the 12th international symposium on computer applications in biotechnology, Mumbai, India, December, pp 16–20

  9. Cuadriello EF, Fernndez-Guinea Ó, Eiró N, González LO, Junquera S, Vizoso FJ (2016) Relationship between morphological features and kinetic patterns of enhancement of the dynamic breast magnetic resonance imaging and tumor expression of metalloproteases and their inhibitors in invasive breast cancer. Magn Reson Imaging 34(8):1107–1113

    Article  Google Scholar 

  10. Ferreira RA, Gbel SM, Hymers M, Ellis AW (2015) The neural correlates of semantic richness: evidence from an fMRI study of word learning. Brain Lang 143:69–80

    Article  Google Scholar 

  11. Gardumi A, Ivanov D, Hausfeld L, Valente G, Formisano E, Uluda K (2016) The effect of spatial resolution on decoding accuracy in fMRI multivariate pattern analysis. NeuroImage 13:232–242

    Google Scholar 

  12. Gong Y, Cai J, Wang Y (2014) Some new structure-preserving algorithms for general multi-symplectic formulations of hamiltonian PDEs. J Comput Phys 279:80–102

    Article  MathSciNet  Google Scholar 

  13. Gu X, Liu C, Wang S, Zhao C, Wu S (2015) Uncorrelated slow feature discriminant analysis using globality preserving projections for feature extraction. Neurocomputing 168:488–499

    Article  Google Scholar 

  14. Handjaras G, Ricciardi E, Leo A, Lenci A, Cecchetti L, Cosottini M, Marotta G, Pietrini P (2016) How concepts are encoded in the human brain: a modality independent, category-based cortical organization of semantic knowledge. NeuroImage 135:232–242

    Article  Google Scholar 

  15. He F, Xu J (2016) A novel process monitoring and fault detection approach based on statistical locality preserving projections. J Process Control 37:46–57

    Article  Google Scholar 

  16. He T, Pamela MB, Shi F (2016) Curvature Manipulation of the Spectrum of a Valence–Arousal-related fMRI Dataset using a Gaussian-shaped fast fourier transform and its application to fuzzy KANSEI adjective modeling. Neurocomputing 174:1049–1059

    Article  Google Scholar 

  17. He X, Niyogi P (2003) Locality preserving projections. In: Advances in neural information processing systems 16 (NIPS 2003), Vancouver, Canada

  18. Huang P, Gao G (2015) Local similarity preserving projections for face recognition. AEU Int J Electron Commun 69(11):1724–1732

    Article  Google Scholar 

  19. Jahidin AH, Megat Ali MSA, Taib MN, Tahir N, Yassin IM, Lias S (2014) Classification of intelligence quotient via brainwave sub-band power ratio features and artificial neural network. Comput Methods Programs Biomed 114(1):50–59

    Article  Google Scholar 

  20. Ji TY, Wu QH (2013) Broadband noise suppression and feature identification of ECG waveforms using mathematical morphology and embedding theorem. Comput Methods Programs Biomed 112(3):466–480

    Article  Google Scholar 

  21. Jiang R, Fu W, Wen L, Hao S, Hong R (2016) Dimensionality reduction on anchorgraph with an efficient locality preserving projection. Neurocomputing 187:109–118

    Article  Google Scholar 

  22. Jyothi B, Madhavee Latha Y, Mohan PK, Reddy V (2016) Integrated multiple features for tumor image retrieval using classifier and feedback methods. Proc Comput Sci 85:141–148. International conference on computational modelling and security (CMS 2016)

    Article  Google Scholar 

  23. Lang PJ, Bradley, MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8, University of Florida, Gainesville, FL

  24. Li H, Li L, Zhang J (2015) Multi-focus image fusion based on sparse feature matrix decomposition and morphological filtering. Opt Commun 342:1–11

    Article  Google Scholar 

  25. Li X, Bin H, TingtingXu JS, Ratcliffe M (2015) A study on EEG-based brain electrical source of mild depressed subjects. Comput Methods Programs Biomed 120(3):135–141

    Article  Google Scholar 

  26. Li X, Pan J, He Y, Liu C (2015) Bilateral filtering inspired locality preserving projections for hyper spectral images. Neurocomputing 164:300–306

    Article  Google Scholar 

  27. Li Y-M, Zeng X-P (2006) A new strategy for urinary sediment segmentation based on wavelet, morphology and combination method. Comput Methods Programs Biomed 84(2–3):162–173

    Article  Google Scholar 

  28. Liao B, Xiao C, Jin L, Fu H (2013) Efficient feature-preserving local projection operator for geometry reconstruction. Comput Aided Des 45(5):861–874

    Article  Google Scholar 

  29. Moraru L, Moldovanu S, Biswas A (2014) Optimization of breast lesion segmentation in texture feature space approach. Med Eng Phys 36(1):124–130

    Article  Google Scholar 

  30. Luo L, Bao S, Mao J, Tang D (2016) Nonlinear process monitoring based on kernel global Locality preserving projections. J Process Control 38:11–21

    Article  Google Scholar 

  31. Mehrabian A (1974) An approach to environmental psychology. MIT Press, Cambridge

    Google Scholar 

  32. Macedo AA, Pessotti HC, Almansa LF, Felipe JC, Kimura ET (2016) Morphometric information to reduce the semantic gap in the characterization of microscopic images of thyroid nodules. Comput Methods Programs Biomed 130:162–174

    Article  Google Scholar 

  33. Operto G, Bulot R, Anton J-L, Coulon O (2008) Projection of fMRI data onto the cortical surface using anatomically-informed convolution kernels. NeuroImage 39(1):127–135

    Article  Google Scholar 

  34. Papageorgiou EI, CsabaHuszka JD, Roo N, Jaulent M-C, Colaert D (2013) Application of probabilistic and fuzzy cognitive approaches in semantic web framework for medical decision support. Comput Methods Programs Biomed 112(3):580–598

    Article  Google Scholar 

  35. De Potter P, Cools H, Depraetere K, Mels G, Debevere P, De Roo J, Huszka C, Colaert D (2012) Semantic patient information aggregation and medicinal decision support. Comput Methods Programs Biomed 108(2):724–735

    Article  Google Scholar 

  36. Punga MV, Gaurav R, Moraru L (2014) Level set method coupled with energy image features for brain MR image segmentation. Biomed Eng 59(3):219–229

    Article  Google Scholar 

  37. Qi M, Hao Q, Guan Q, Kong J, Zhang Y (2015) Image dehazing based on structure preserving. Optik Int J Light Electron Opt 126(22):3400–3406

    Article  Google Scholar 

  38. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cyber 9(1):62–66

    Article  Google Scholar 

  39. Reilly J, Garcia A, Binney RJ (2013) Does the sound of a barking dog activate its corresponding visual form? An fMRI investigation of modality-specific semantic access. Brain Lang 159(2016):45–59

    Google Scholar 

  40. Rothermich K, Kotz SA (2013) Predictions in speech comprehension: fMRI evidence on the meter semantic interface. NeuroImage 70:89–100

    Article  Google Scholar 

  41. Shao W, Tian X, Wang P (2015) Supervised local and non-local structure preserving projections with application to just-in-time learning for adaptive soft sensor. Chin J Chem Eng 23(12):1925–1934

    Article  Google Scholar 

  42. Shi Y, Zeng W, Wang N, Chen D (2015) A novel fMRI group data analysis method based on data-driven reference extracting from group subjects. Comput Methods Programs Biomed 122(3):362–371

    Article  Google Scholar 

  43. Shi F, Bush PM (2013) A Gaussian mixed fuzzy clustering model on Valence–Arousal related fMRI data-set. Acta Polytech Hung 10(8):85–104

    Google Scholar 

  44. Shikkenawis G, Mitra SK (2016) On some variants of locality preserving projection. Neurocomputing 173(Part 2):196–211

    Article  Google Scholar 

  45. Skipper-Kallal LM, Mirman D, Olson IR (2015) Converging evidence from fMRI and aphasia that the left temporoparietal cortex has an essential role in representing abstract semantic knowledge. Cortex 69:104–120

    Article  Google Scholar 

  46. Takaki T, Sakane S, MunekazuOhno YS, Shimokawabe T, Aoki T (2016) Primary arm array during directional solidification of a single-crystal binary alloy: large-scale phase-field study. Acta Mater 118:230–243

    Article  Google Scholar 

  47. Tune S, Schlesewsky M, Nagels A, Small SL, Bornkessel-Schlesewsky I (2016) Sentence understanding depends on contextual use of semantic and real world knowledge. NeuroImage 136:10–25

    Article  Google Scholar 

  48. Uno T, Uno Y (2015) Mining preserving structures in a graph sequence. Theor Comput Sci. doi:10.1016/j.tcs.2015.12.007

    Article  MATH  Google Scholar 

  49. Wang B, Gao X, Li J, Li X, Tao D (2015) A level set method with shape priors by using locality preserving projections. Neurocomputing 170:188–200

    Article  Google Scholar 

  50. Wen Y, Zhang L, von Deneen KM, He L (2016) Face recognition using discriminative locality preserving vectors. Digit Signal Proc 50:103–113

    Article  Google Scholar 

  51. Zhang Q, Deng K, Chu T (2016) Sparsity induced locality preserving projection approaches for dimensionality reduction. Neurocomputing 200:35–46

    Article  Google Scholar 

  52. Zhong F, Li D, Zhang J (2014) Robust locality preserving projection based on maximum correntropy criterion. J Vis Commun Image Represent 25(7):1676–1685

    Article  Google Scholar 

  53. Zingman I, Saupe D, Lambers K (2014) A morphological approach for distinguishing texture and individual features in images. Pattern Recognit Lett 47:129–138. Advances in mathematical morphology

    Article  Google Scholar 

  54. Gaudes CC, Van de Ville D, Petridou N, Lazeyras F, Gowlandc P (2011) Paradigm-free mapping with morphological component analysis: getting most out of fMRI data. Proc SPIE 8138(3):815–822

    Google Scholar 

Download references

Acknowledgements

This work was supported by Zhejiang Provincial Natural Science Fund under Grant No. LY17F030014.

Author information

Authors and Affiliations

  1. Beijing Shijitan Hospital Affiliated to Capital Medical University, Beijing, 100038, People’s Republic of China

    Zongmei Tian

  2. Department of Information Technology, Techno India College of Technology, Kolkata, West Bengal, 740000, India

    Nilanjan Dey

  3. Department of Electronics and Electrical Communications Engineering, Faculty of Engineering, Tanta University, Tanta, 31111, Egypt

    Amira S. Ashour

  4. Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL, 32825, USA

    Pamela McCauley

  5. College of Information and Engineering, Wenzhou Medical University, Wenzhou, 320065, People’s Republic of China

    Fuqian Shi

Authors
  1. Zongmei Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nilanjan Dey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amira S. Ashour
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pamela McCauley
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fuqian Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fuqian Shi.

Ethics declarations

Conflict of interest

We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tian, Z., Dey, N., Ashour, A.S. et al. Morphological segmenting and neighborhood pixel-based locality preserving projection on brain fMRI dataset for semantic feature extraction: an affective computing study. Neural Comput & Applic 30, 3733–3748 (2018). https://doi.org/10.1007/s00521-017-2955-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-2955-2

Keywords

Search

Navigation