Article details
Title: Non-negative Matrix Factorization, A New Tool for Feature Extraction: Theory and Applications
Author(s):  Ioan Buciu;  
Keywords:  Non-negative matrix factorization, image decomposition, applications



CITE THIS PAPER AS:
Buciu, I., Non-negative Matrix Factorization, A New Tool for Feature Extraction: Theory and Applications, International Journal of Computers Communications and Control, Volume:3, Supplement: Suppl. S, pp. 67-74, 2008.

Abstract:  
Despite its relative novelty, non-negative matrix factorization (NMF) methodknew a huge interest from the scientific community, due to its simplicity and intuitive decomposition.Plenty of applications benefited from it, including image processing (face, medical,etc.), audio data processing or text mining and decomposition. This paper briefly describesthe underlaying mathematical NMF theory along with some extensions. Several relevantapplications from different scientific areas are also presented. NMF shortcomings and conclusionsare considered.
Introduction:  
Conclusions:  
References:  
[1] D. D. Lee and H. S. Seung, “Algorithms for non-negative matrix factorization,” Advances Neural Information ProcessingSystems, vol. 13, pp. 556–562, 2001.
[2] A. P. Dempster and N. M. Laird and D. B. Rubin, “Maximum likelihood from incomplete data using the EM algorithm,”Journal of the Royal Statistical Society, vol. 39, pp. 1–38, 1977.
[3] S. Z. Li, X.W. Hou and H. J. Zhang, “Learning spatially localized, parts-based representation,” Int. Conf. Computer Visionand Pattern Recognition, pp. 207–212, 2001.
[4] I. Buciu and I. Pitas, “A new sparse image representation algorithm applied to facial expression recognition,” in Proc. IEEEWorkshop on Machine Learning for Signal Processing, pp. 539–548, 2004.
[5] P. Hoyer, “Non-negative matrix factorization with sparseness constraints,” J. of Machine Learning Research, vol. 5, pp.1457–1469, 2004.
[6] A. Pascual-Montano, J. M. Carazo, K. Kochi, D. Lehmann, and R. D. Pascual-Marqui, “Nonsmooth nonnegative matrixfactorization (nsNMF),” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 28, nr. 3, pp. 403–415, 2006.
[7] Z. Yuan and E. Oja, “Projective nonnegative matrix factorization for image compression and feature extraction,” 14thScandinavian Conference on Image Analysis, pp. 333–342, 2005.
[8] Z. Chen and A. Cichocki, “Nonnegative matrix factorization with temporal smoothness and/or spatial decorrelation constraints,”Preprint, 2005.
[9] M. Mørup, K. H. Madsen, and L. K. Hansen, “Shifted Non-negative Matrix Factorization,” IEEE Workshop on MachineLearning for Signal Processing, 2007.
[10] S. S. Bucak, B. Gunsel, and O. Gursoy, “Incremental non-negative matrix factorization for dynamic background modelling,”ICEIS 8th International Workshop on Pattern Recognition in Information Systems, 2007.
[11] M. Mørup, L. K. Hansen, and S. M. Arnfred, “Algorithms for sparse higher order non-negative matrix factorization(HONMF),” Technical Report, 2006.
[12] I. Buciu, N. Nikolaidis, and I. Pitas, “Non-negative matrix factorization in polynomial feature space,” IEEE Trans. onNeural Nerworks, in Press, 2008.
[13] M. Helén and T. Virtanen, “Separation of drums from polyphonic music using non-negative matrix factorization andsupport vector machine,” 13th European Signal Processing Conference, 2005.
[14] E. Benetos, C. Kotropoulos, T. Lidy, A. Rauber, “Testing supervised classifiers based on non-negative matrix factorizationto musical instrument classification,” in Proc. of the 14th European Signal Processing Conference, 2006.
[15] Univ. of Iowa Musical Instrument Sample Database, http://theremin.music.uiowa.edu/index.html.
[16] P. Sajda, S. Du, T. Brown, R. Stoyanova, D. Shungu, X. Mao, and L. Parra, “Non-negative matrix factorization forrapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain,” IEEE Trans. on MedicalImaging, vol. 23, no. 12, pp. 1453–1465, 2004.
[17] V. P. Pauca, J. Piper, and R. J. Plemmons, “Nonnegative Matrix Factorization for Spectral Data Analysis,” Linear Algebraand its Applications, vol. 416, pp. 29–47, 2006.
[18] T. M. Rutkowski, R. Zdunek, and A. Cichocki, “Multichannel EEG brain activity pattern analysis in time-frequencydomain with nonnegative matrix factorization support,” International Congress Series, vol. 1301, pp. 266–269, 2007.
[19] http://www.uk.research.att.com/[20] D. Guillamet and Jordi Vitrià, “Non-negative matrix factorization for face recognition,” Topics in Artificial Intelligence,Springer Verlag Series: Lecture Notes in Artificial Intelligence, vol. 2504, pp. 336–344, 2002.
[21] I. Buciu, N. Nikolaidis, and I. Pitas, “A comparative study of NMF, DNMF, and LNMF algorithms applied for facerecognition,” 2006 Second IEEE-EURASIP International Symposium on Control, Communications, and Signal Processing,2006.
[22] http://cvc.yale.edu
[23] I. Buciu and I. Pitas, “Application of non-negative and local non negative matrix factorization to facial expression recognition,”International Conference on Pattern Recognition, pp. 288–291, 2004.
[24] T. Kanade, J. Cohn and Y. Tian, “Comprehensive database for facial expression analysis,” in Proc. IEEE Inter. Conf. onFace and Gesture Recognition, pp. 46–53, 2000.
[25] M.W. Spratling, “Learning image components for object recognition,” Journal of Machine Learning Research, vol. 7, pp.793–815, 2006.
[26] X. Chen, L. Gu, S. Z. Li, and H.-J. Zhang, “Learning representative local features for face detection,” 2001 IEEE ComputerSociety Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1126–1131, 2001.
[27] J. P. Brunet, P. Tamayo, T.R. Golub, and J. P. Mesirov, “Metagenes and molecular pattern discovery using matrix factorization”,Proc Natl Acad Sci U S A., vol. 101, no. 12, pp. 4164–4169, 2004.
[28] P. Fogel, S. S. Young, D. M. Hawkins, and N. Ledirac, “Inferential, robust non-negative matrix factorization analysis ofmicroarray data”, Bioinformatics, vol. 23, no. 1, pp.44 – 49, 2007.
[29] G. Wang, A. V. Kossenkov, and M. F. Ochs, “LS-NMF: a modified non-negative matrix factorization algorithm utilizinguncertainty estimates”, BMC Bioinformatics, vol. 7, no. 1, pp. 175, 2006.
[30] D. Dueck, Q. D. Morris and B. J. Frey, “Multi-way clustering of microarray data using probabilistic sparse matrix factorization”,Bioinformatics, vol. 21, no. 1, pp. 144–151, 2005.
[31] Y. Liu, R. Jin, and L. Yang, “Semi-supervised Multi-label Learning by Constrained Non-negative Matrix Factorization,”in Proc. of The Twenty-First National Conference on Artificial Intelligence and the Eighteenth Innovative Applications ofArtificial Intelligence Conference, vol. 21, pp. 421–426, 2006.
[32] M. W. Berry and M. Browne, “Email Surveillance Using Nonnegative Matrix Factorization,” Computational & Mathe-matical Organization Theory, vol. 11, pp. 249–264, 2005.
[33] H. Li, T. Adali, W. Wang, D. Emge, A. Cichocki, “Non-negative matrix factorization with orthogonality constraints andits application to Raman spectroscopy,” Journal of VLSI Signal Processing, vol. 48, no. 1-2, pp. 83–97, 2007.
[34] S. Wild, “Seeding non-negative matrix factorization with the spherical k-means clustering,” Master thesis, University ofColorado, 2002.
[35] C. Boutsidis and E. Gallopoulos, “On SVD-based initialization for nonnegative matrix factorization,” Tech. Rep.HPCLAB-SCG-6/08-05, University of Patras, Patras, Greece., 2005.
[36] I. Buciu, N. Nikolaidis, and I. Pitas, “On the initialization of the DNMF algorithm,” IEEE International Symposium onCircuits and Systems, pp. 4671–4674, 2006.
File link :  To download full article text in PDF format click here