We use cookies to improve your experience with our site.

Indexed in:

SCIE, EI, Scopus, INSPEC, DBLP, CSCD, etc.

Submission System
(Author / Reviewer / Editor)
Advanced Search
Volume 26 Issue 2
March  2011
Turn off MathJax
Article Contents
Abstract
References
Related Articles
Mahsa Chitsaz, Chaw Seng Woo. Software Agent with Reinforcement Learning Approach for Medical Image Segmentation[J]. Journal of Computer Science and Technology, 2011, 26(2): 247-255. DOI: 10.1007/s11390-011-1127-6
Citation: Mahsa Chitsaz, Chaw Seng Woo. Software Agent with Reinforcement Learning Approach for Medical Image Segmentation[J]. Journal of Computer Science and Technology, 2011, 26(2): 247-255. DOI: 10.1007/s11390-011-1127-6
shu

Software Agent with Reinforcement Learning Approach for Medical Image Segmentation

  • Faculty of Computer Science and Information Technology, University of Malaya, 50603 Kuala Lumpur, Malaysia

Funds: This research was funded by Peruntukan Penyelidikan Pascasiswazah (PPP) under Grant No. PS349/2008C.
More Information
  • Author Bio:

    Mahsa Chitsaz received her B.S. degree in compt. eng. from Shiraz University in 2006. She then obtained her M.Sc. degree from University of Malaya in 2010 under the guidance of Chaw Seng Woo in the area of reinforcement learning in medical image segmentation. Chitsaz’s research interest is in artificial intelligence in real-time systems, mainly in the areas of machine learning and dynamic processes. She also works at the intersection of learning and topics as varied as medical image segmentation, telemedicine, and head-mounted display.

    Chaw Seng Woo is a senior lecturer at the Faculty of Computer Science and Information Technology, University of Malaya. His research interests include image processing and mobile applications.

  • Received Date: December 02, 2009
  • Revised Date: December 03, 2010
  • Published Date: March 04, 2011
    Abstract
  • Many image segmentation solutions are problem-based. Medical images have very similar grey level and texture among the interested objects. Therefore, medical image segmentation requires improvements although there have been researches done since the last few decades. We design a self-learning framework to extract several objects of interest simultaneously from Computed Tomography (CT) images. Our segmentation method has a learning phase that is based on reinforcement learning (RL) system. Each RL agent works on a particular sub-image of an input image to find a suitable value for each object in it. The RL system is define by state, action and reward. We defined some actions for each state in the sub-image. A reward function computes reward for each action of the RL agent. Finally, the valuable information, from discovering all states of the interest objects, will be stored in a Q-matrix and the final result can be applied in segmentation of similar images. The experimental results for cranial CT images demonstrated segmentation accuracy above 95%.
    • FullText(HTML)
    • References (22)
  • [1]
    Pham D L, Xu C, Prince J L. A survey of current methods in medical image segmentation. Annual Review of Biomedical Engineering, 2000, 2: 315-337.
    [2]
    Jain A K. Fundamentals of Digital Image Processing. Printice Hall, 1989.
    [3]
    Chen P, Pavlidis T. Image segmentation as an estimation problem. Computer Graphics and Image Processing, 1980, 12(20): 153-172.
    [4]
    Liu J. Synergistic hybrid image segmentation: Combining model and image-based Sstartegies
    [Ph.D. Dissertation]. Univ. Pennsylvania, 2006.
    [5]
    Kaelbling L P, Littman M L, Moore A W. Reinforcement learning: A survey. Artificial Intelligence Research, 1996, 4: 237-285.
    [6]
    Chitsaz M, Woo C S. Medical image segmentation by using reinforcement learning agent. In Proc. International Conference on Digital Image Processing (ICDIP 2009), Bangkok, Thailand, Mar. 7-10, 2009, pp.216-219.
    [7]
    Watkins C J C H. Learning from delayed rewards
    [Ph.D. Dissertation]. Cambridge, 1989.
    [8]
    Watkins C, Dayan P. Q-learning. Machine Learning, 1992, 8(3): 279-292.
    [9]
    Chitsaz M, Woo C S. The rise of multi-agent and R.L. segmentation methods for biomedical images. In Proc. The 4th Malaysian Software Engineering Conference (MySEC2008), Kuala Terengganu, Malaysia, 2008, p.5.
    [10]
    Bhanu B, Peng J. Adaptive integrated image segmentation and object recognition. IEEE Transaction on Systems, Man, and Cybernetics, 2000, 30(4): 427-441.
    [11]
    Peng J, Bhanu B. Delayed reinforcement learning for adaptive image segmentation and feature extraction. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 1998, 28(3): 482-488.
    [12]
    Peng J, Bhanu B. Closed-loop object recognition using reinforcement learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(2): 139-154.
    [13]
    Shokri M, Tizhoosh H R. Using reinforcement learning for image thresholding. In Proc. IEEE Canadian Conference on Electrical and Computer Engineering, May 4-7, 2003, pp.1231-1234.
    [14]
    Shokri M, Tizhoosh H R. A reinforcement agent for threshold fusion. Applied Soft Computing, 2008, 8(1): 174-181.
    [15]
    Sahba F, Tizhoosh H R, Salama M M A. A reinforcement learning framework for medical image segmentation. In Proc. International Joint Conference on Neural Networks, Vancouver, Canada, Jul. 16-21, 2006, pp.511-517.
    [16]
    Sahba F, Tizhoosh H R, Salama M M A. A reinforcement agent for object segmentation in ultrasound images. Expert Systems with Applications, 2008, 35(3): 772-780.
    [17]
    Obaidellah U H B. A finite element approach for the planning and simulation of 3D mandibular osteotomy for orthoganathic surgery
    [Master Thesis]. Faculty of Computer Science and Information Technology, University of Malya, 2006.
    [18]
    DICOMsample: DICOM Files. July 2008, http://pubimage.hcuge.ch:8080/.
    [19]
    Zhang Y J. A review of recent evaluation methods for image segmentation. In Proc. The Sixth International Symposium on Signal Processing and Its Applications, Kuala Lumpur, Malaysia, Aug. 13-16, 2001, pp.148-151.
    [20]
    Te-shen Liang, Rodriguez J J. MR cranial image segmentation — A morphological and clustering approach. In Proc. IEEE Southwest Symp. Image Analysis and Interpretation, San Antonio, USA, Apr. 8-19, 1996, pp.184-189.
    [21]
    Pan Z, Lu J. A Bayes-based region-growing algorithm for medical image segmentation. Computing in Science & Engineering, 2007, 9(4): 32-38.
    [22]
    Lu H, Bao S. An extended image force model of snakes for medical image segmentation and smoothing. In Proc. The 8th International Conference on Signal Processing, Beijing, China, Nov. 16-20, 2006.
    • Relative Articles

  • Related Articles

    [1]WANG wen jun, ZHONG Cuihao. The Distributed Workflow Management System - Flow Agent[J]. Journal of Computer Science and Technology, 2000, 15(4): 376-382.
    [2]LUO Jianhua, ZHUANG Tiange. Reduction of Artifacts in Images from MR Truncated Data Using Singularity Spectrum Analysis[J]. Journal of Computer Science and Technology, 2000, 15(4): 360-367.
    [3]WANG Huaimin, WU Quanyuan. A Formal Framework of Multi-Agent Systems with Requirement/Service Cooperative Style[J]. Journal of Computer Science and Technology, 2000, 15(2): 106-115.
    [4]FAN Xiaocong, XU Dianxiang, HOU Jianmin, ZHENG Guoliang. Reasoning about Concurrent Actionsin Multi-Agent Systems[J]. Journal of Computer Science and Technology, 1999, 14(4): 422-428.
    [5]XI Haifeng, LUO Yupin, YANG Shiyuan. An Approach to Active Learning for Classifier Systems[J]. Journal of Computer Science and Technology, 1999, 14(4): 372-378.
    [6]Cai Yong, Heng Phengann, Wu Enhua, Liu Xuehui, Li Hongju, Sun Qingjie. An Image-Based Virtual Reality Prototype System[J]. Journal of Computer Science and Technology, 1998, 13(5): 475-480.
    [7]Ma Feng, Xia Shaowei. A Multiscale Approach to Automatic Medical Image Segmentation Using Self-Organizing Map[J]. Journal of Computer Science and Technology, 1998, 13(5): 402-409.
    [8]Guan Weiguang, Xie Lin, Ma Songde. Deformable Registration of Digital Images[J]. Journal of Computer Science and Technology, 1998, 13(3): 246-260.
    [9]Zheng Nanning, Liu Jianqin. Visual Knowledge Representation and Intelligent Image Segmentation[J]. Journal of Computer Science and Technology, 1992, 7(3): 219-225.
    [10]Song Maoqiang, Felix Grimm, Horst Bunke. A Prototype Expert System for Automatic Generation of Image Processing Programs[J]. Journal of Computer Science and Technology, 1991, 6(3): 296-300.
    • Supplements (0)

Catalog

    Get Citation
    PDF
    XML
    Article views (48) PDF downloads (3076) Cited by()
    Related

    Copyright ©2025 JCST, All Rights Reserved     京ICP备05002829号-1

    Institute of Computing Technology, Chinese Academy of Sciences
    P.O. Box 2704, Beijing 100190, P.R. China

    Tel.: 86-10-62610746 E-mail: jcst@ict.ac.cn

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return