We use cookies to improve your experience with our site.

Indexed in:

SCIE, EI, Scopus, INSPEC, DBLP, CSCD, etc.

Submission System
(Author / Reviewer / Editor)
Mohamed Abdel-Kawy Mohamed Ali Soliman, Rasha M. Abo-Bakr. Linearly and Quadratically Separable Classifiers Using Adaptive Approach[J]. Journal of Computer Science and Technology, 2011, 26(5): 908-918. DOI: 10.1007/s11390-011-0188-x
Citation: Mohamed Abdel-Kawy Mohamed Ali Soliman, Rasha M. Abo-Bakr. Linearly and Quadratically Separable Classifiers Using Adaptive Approach[J]. Journal of Computer Science and Technology, 2011, 26(5): 908-918. DOI: 10.1007/s11390-011-0188-x

Linearly and Quadratically Separable Classifiers Using Adaptive Approach

More Information
  • Author Bio:

    Mohamed Abdel-Kawy Mohamed Ali Soliman received the B.S. degree in electrical and electronic engineering from M.T.C (Military Technical College), Cairo, Egypt, with grade (Excellent) in 1974, the M.S. degree in electronic and communications engineering from Faculty of Engineering, Cairo University, Egypt, with the research on "observers in modern control systems theory", 1985, and the Ph.D. degree in aeronautical engineering, the thesis title is "Intelligent Management for Aircraft and Spacecraft Sensors Systems", 2000. He is currently head of Computer and Systems Engineering Department, Faculty of Engineering, Zagazig University. His research interests lie in the intersection of the general fields of computer science and engineering, brain science, and cognitive science.

    Rasha M. Abo-Bakr was born in 1976 in Egypt, received her Bachelor's degree from Mathematics (Computer Science) Department, Faculty of Science, Zagazig University, Egypt. She was also awarded her Master's degree in computer science in 2003, with a thesis titled "Computer Algorithms for System Identification". Since 2003 she has been an assistant lecturer at Mathematics (Computer Science) Department, Faculty of Science, Zagazig University. She received her Ph.D. degree in mathematics & computer science from Zagazig University, in 2011, with a dissertation titled "Symbolic Modeling of Dynamical Systems Using Soft Computing Techniques". Her research interests are artificial intelligence, soft computing technologies, and astronomy.

  • Received Date: October 02, 2009
  • Revised Date: May 13, 2011
  • Published Date: September 04, 2011
  • This paper presents a fast adaptive iterative algorithm to solve linearly separable classification problems in Rn. In each iteration, a subset of the sampling data (n-points, where n is the number of features) is adaptively chosen and a hyperplane is constructed such that it separates the chosen n-points at a margin ε and best classifies the remaining points. The classification problem is formulated and the details of the algorithm are presented. Further, the algorithm is extended to solving quadratically separable classification problems. The basic idea is based on mapping the physical space to another larger one where the problem becomes linearly separable. Numerical illustrations show that few iteration steps are sufficient for convergence when classes are linearly separable. For nonlinearly separable data, given a specified maximum number of iteration steps, the algorithm returns the best hyperplane that minimizes the number of misclassified points occurring through these steps. Comparisons with other machine learning algorithms on practical and benchmark datasets are also presented, showing the performance of the proposed algorithm.
  • [1]
    Duda R O, Hart P E, Stork D G. Pattern Classification. New York: Wiley-Interscience, 2000.
    [2]
    Theodoridis S, Koutroumbas K. Pattern Recognition. Academic Press, An Imprint of Elsevier, 2006.
    [3]
    Cristianini N, Shawe T J. An Introduction to Support Vector Machines. Vol. I, Cambridge University Press, 2003.
    [4]
    Atiya A. Learning with kernels: Support vector machines, regularization, optimization, and beyond. IEEE Transactions on Neural Networks, 2005, 16(3): 781.
    [5]
    Rosenblatt F. Principles of Neurodynamics. Spartan Books, 1962.
    [6]
    Taha H A. Operations Research An Introduction. Macmillan Publishing Co., Inc, 1982.
    [7]
    Zurada J M. Introduction to Artificial Neural Systems. Boston: PWS Publishing Co., USA, 1999.
    [8]
    Barber C B, Dodkin D P, Huhdanpaa H. The quickhull algorithm for convex hulls. ACM Transactions on Mathematical Software, 1996, 22(4): 469-483.
    [9]
    Tajine M, Elizondo D. New methods for testing linear separability. Neurocomputing, 2002, 47(1-4): 295-322.
    [10]
    Elizondo D. Searching for linearly separable subsets using the class of linear separability method. In Proc. IEEE-IJCNN, Budapest, Hungary, Jul. 25-29, 2004, pp.955-960.
    [11]
    Elizondo D. The linear separability problem: Some testing methods. IEEE Transactions on Neural Networks, 2006, 17(2): 330-344.
    [12]
    www.archive.ics.uci.edu/ml/datasets.html, Mar. 31, 2009.
    [13]
    Fisher R A. The Use of Multiple Measurements in Taxonomic Problems. Annals of Eugenics, 1936, 7: 179-188.
    [14]
    http://www.cs.waikato.ac.nz/?ml/weka/, May 1, 2009.
    [15]
    Witten I H, Frank E. Data Mining: Practical Machine Learning Tools and Techniques. Elsevier, 2005.
  • Related Articles

    [1]Hong-Ding Wang, Yun-Hai Tong, Shao-Hua Tan, Shi-Wei Tang, Dong-Qing Yang, Guo-Hui Sun. An Adaptive Approach to Schema Classification for Data Warehouse Modeling[J]. Journal of Computer Science and Technology, 2007, 22(2): 252-260.
    [2]WEN Jirong, CHEN Hong, WANG Shan. POTENTIAL: A Highly Adaptive Core of Parallel Database System[J]. Journal of Computer Science and Technology, 2000, 15(6): 527-541.
    [3]LU Sanglu, ZHOU Xiaoboand, XIE Li. A Model for Dynamic Adaptive Coscheduling[J]. Journal of Computer Science and Technology, 1999, 14(3): 267-275.
    [4]Lin Chengiiang, Li Sanli. Strategy and Simulation of Adaptive RID for Distributed Dynamic Load Balancing in Parallel Systems[J]. Journal of Computer Science and Technology, 1997, 12(2): 113-120.
    [5]Zhou Jianqiang, Xie Li, Dai Fei, Sun Zhongxiu. Adaptive Memory Coherence Algorithms in DSVM[J]. Journal of Computer Science and Technology, 1994, 9(4): 365-372.
    [6]Tian Xinmin, Wang DingXing, Shen Meiming, Zheng Weimin, Wen Dongchan. Granularity Analysis for Exploiting Adaptive Parallelism of Declarative Programs on Multiprocessors[J]. Journal of Computer Science and Technology, 1994, 9(2): 144-152.
    [7]Zhou Jianqiang, Xie Li, Sun Zhongxiu, Zhu Genjiang. An Adaptive Strategy Integrating Locking with Optimistic Concurrency Control[J]. Journal of Computer Science and Technology, 1993, 8(4): 61-69.
    [8]Zhang Yaoxue, Shi Meilin, Norio Shiratori. A Knowledge-Based Specification Technique for Protocol Development[J]. Journal of Computer Science and Technology, 1993, 8(2): 92-96.
    [9]Yu Shiwen. Application of Grammatical Parsing Technique in Chinese Input[J]. Journal of Computer Science and Technology, 1990, 5(4): 312-318.
    [10]Zhou Di. A Recovery Technique for Distributed Communicating Process Systems[J]. Journal of Computer Science and Technology, 1986, 1(2): 34-43.

Catalog

    Article views (38) PDF downloads (2029) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return