Image Segmentation using Differential Evolution

1. Image Segmentation usingDifferential Evolution Michael Georgiopoulos Tiantian Zhang

2. Mentor Information Faculty Mentor Info: Name: Michael Georgiopoulos Email: michaelg@ucf.edu Phone:407-312-0957 Graduate Student Mentor Info: Name: Tiantian Zhang Email: watera427@gmail.com Phone: 407-284-0799

3. Motivation • Image segmentation is based on non-supervised pattern classification techniques. In image segmentation, different features are extracted and grouped into different clusters, and thus the image is more visually preferable to reading useful information of differently grouped semantic regions. • Image segmentation has been widely used in various fields [1]. • - Computer-aided diagnosis (CAD) for cancer detection, • - Remote sensing image analysis, • - Outdoor object recognition& robot vision, • - Content-based image and marketplace decision support. [1] Jose Alfredo F. Costa and Jackson G. de Souza, “Image Segmentation through Clustering Based on Natural Computing Techniques”, pp. 57-82, In: Image Segmentation, Pei-Gee Ho (Ed.), 2011

4. Applications of Image Segmentation • Medical Image Analysis Figure from [2] [2]Tong Hau Lee, Mohammad Faizal Ahmad Fauzi, Ryoichi Komiya, “Segmentation of CT Brain Images Using Unsupervised Clusterings”, Journal of Visualization, Vol. 12, No. 2 (2009) 131-138 , 2009

5. Applications of Image Segmentation • Remote Sensing Image Analysis Figure from [3] [3] PatrikB. G. Dammert, Jan I. H. Askne, Sharon Kuhlmann, “Unsupervised Segmentation of MultitemporalInterferometric SAR Images”, IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 5, Sep. 1999

6. Applications of Image Segmentation • Document Analysis – Background removal Figure from [4] [4] Benjamin Perret, SébastienLefèvre, Christophe Collet, and ÉricSlezak, “Hyperconnections and Hierarchical Representations for Grayscale and Multiband Image Processing”, IEEE Transactions on Image Processing, Vol. 21, No. 1, January 2012

7. Applications of Image Segmentation • Sclera Recognition as human identification Matching Segmented Sclera Color Image Figure from [5] After Morphological Operations Segmented Sclera Region After Enhancement After Thresholding [5] Zhi Zhou, Eliza Yingzi Du, N. Luke Thomas, Edward J. Delp, “A New Human Identification Method: Sclera Recognition”, IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, Vol. 42, No. 3, May 2012

8. Proposed Project Work • In this project, we are going to do Image Clustering using a variety of clustering approaches. • Typical clustering algorithms are: • - K-means Algorithms • - ISODATA Clustering Algorithms • - Fuzzy C-Means (FCM) • - Expectation-Maximization (EM) • - K-harmonic Means (KHM) • - Artificial Neural Networks (ANN)

9. Proposed Project Work • The disadvantages of these algorithms are [6]: • The performance of some algorithms is highly dependent on initial conditions; • The number of clusters must be known a-priori informationfor some of algorithms; • Clustering is deemed to be a particular kind of NP-hard problem. Therefore, local search algorithms are inefficient sometimes. • Evolutionary Algorithms are designed to be population-based global search algorithms. They are metaheuristics widely believed to be effective on NP-hard problems, being able to provide near-optimal solutions to such problems in reasonable time [6]. • Differential Evolution is a simple and robust optimizer compared with other EAs. [6] Eduardo R. Hruschka, Ricardo J. G. B. Campello, Alex A. Freitas, André C. P. L. F. de Carvalho, “A Survey of Evolutionary Algorithms for Clustering”, IEEE Transactions on Systems, Man, and Cybernetics, 2012

10. Proposed Project Work • Advantages of DE [7]: • Compared to most EAs, DE is much simpler and thus straightforward to implement. • Despite its simplicity, DE exhibits much better performance in comparison with several other EAs. • - DE finished third in the First International Contest on Evolutionary Optimization in May 1996 (CEC, 1996). • - DE turned out to be the best evolutionary algorithm for solving the real-valued test function suite of the 1st ICEO • - In the 2005 CEC competition on real time parameter optimization, on 10-D problems classical DE secured 2nd rank, while a self-adaptive DE variant called SaDEsecured third rank. • The number of control parameters in DE are is very few (Cr, F and Np in classical DE • DE has been widely used in signal and image processing, pattern recognition, chemical engineering, electrical power system, and bioinformatics, etc. [7] [7] Swagatam Das, PonnuthuraiNagaratnamSuganthan, Differential Evolution: A Survey of the State-of-the-Art, IEEE Transactions on Evolutionary Computation, Vol. 15, pp. 4-31, Feb. 2011.

11. Proposed Work; Related Knowledge • Image Fundamentals: • Image Representation, Pixel Intensity, Color, Gray-Scale Images • Useful Image Transformations • Mathematical Knowledge: • - Vectors and Operations on Vectors • - Geometrical Representation of Vectors • - Euclidean Distance calculation in multi- dimensional space. • Programming Techniques: • Matlab Fundamentals • Image Processing Toolbox Functionality • Machine Learning Knowledge: • - K-Means Clustering Algorithm • - Differential Evolution and variant Algorithms

12. Timeline for Proposed Work • Week 1: • - How to use MATLAB • Week 2: • - Fundamentals of Image Processing • - Introduction to Clustering • - K-means Algorithm and its implementation • Week 3: • K-means algorithm and image clustering applications • DE algorithm and its variants • Week 4: • - DE implementation and optimization problem applications • - ACDE algorithm • Week 5: • - Implementation of ACDE and image clustering applications • Week 6: • - Work on deliverables

13. References [1] Jose Alfredo F. Costa and Jackson G. de Souza, “Image Segmentation through Clustering Based on Natural Computing Techniques”, pp. 57-82, In: Image Segmentation, Pei-Gee Ho (Ed.), 2011 [2]Tong Hau Lee, Mohammad Faizal Ahmad Fauzi, Ryoichi Komiya, “Segmentation of CT Brain Images Using Unsupervised Clusterings”, Journal of Visualization, Vol. 12, No. 2 (2009) 131-138 , 2009 [3] Patrik B. G. Dammert, Jan I. H. Askne, Sharon Kuhlmann, “Unsupervised Segmentation of MultitemporalInterferometric SAR Images”, IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 5, Sep. 1999 [4] Benjamin Perret, SébastienLefèvre, Christophe Collet, and ÉricSlezak, “Hyperconnections and Hierarchical Representations for Grayscale and Multiband Image Processing”, IEEE Transactions on Image Processing, Vol. 21, No. 1, January 2012 [5] Zhi Zhou, Eliza Yingzi Du, N. Luke Thomas, Edward J. Delp, “A New Human Identification Method: Sclera Recognition”, IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, Vol. 42, No. 3, May 2012 [6] Eduardo R. Hruschka, Ricardo J. G. B. Campello, Alex A. Freitas, André C. P. L. F. de Carvalho, “A Survey of Evolutionary Algorithms for Clustering”, IEEE Transactions on Systems, Man, and Cybernetics, 2012 [7] Swagatam Das, PonnuthuraiNagaratnamSuganthan, Differential Evolution: A Survey of the State-of-the-Art, IEEE Transactions on Evolutionary Computation, Vol. 15, pp. 4-31, Feb. 2011.

14. Thank you! Any Questions?