Fusion of Hand-crafted and Deep Features for
Automatic Diabetic Foot Ulcer Classification
AuthorsNora Al-Garaawi, Tim Morris
JournalTEM Journal
AbstractThis paper proposes to combine both the
texture and deep features to build a robust diabetic
foot ulcer recognition system since both features
represent valuable information about the disease. The
proposed system consists of three stages: feature
extraction, feature fusion, and DFU classification. The
feature extraction is performed by extracting the
handcrafted and deep features. The feature fusion is
performed by concatenating both feature vectors into a
single vector. The DFU classification is performed by
training a random forest classifier on the fusion vectors
and the resulting classifier is used then for
classification. Experimental results showed that the
proposed approach provides satisfactory performance
in DFU, ischaemia, and infection classification.
Clock Drawing Test Interpretation System
Authorszainab Harbi, Yulia Hicks , Rossi Setchi
JournalProcedia Computer Science
Volume 112, 2017, Pages 1641-1650
AbstractA clock drawing test (CDT) is a neurological test used for the assessment of cognitive impairment based on sketches of a clock completed by a patient. Usually, a medical expert assesses the sketches to discover any deficiencies in the cognitive processes of the patient. More recently, automatic tools for assessing such tests have been developed. However, the problem of automatic interpretation of clock drawings, especially those sketched by people with cognitive impairment, is not fully solved, and in more difficult cases, the automatic systems have to revert to the help of human assessors in labelling the sketched objects forming the clock drawing. Moreover, the labelling of the sketched objects could be more reliable if prior knowledge of the expected CDT sketch structure and human reasoning could be integrated into the drawing interpretation system.
This paper proposes a novel CDT sketch interpretation system, which represents the prior knowledge of the CDT structure by using ontology and integrating human reasoning through a fuzzy inference engine. The combination of the above technologies fuses multiple sources of information concerning the sketch structure and the visual appearance of the sketched objects whilst dealing with the interpretation uncertainty inherent to CDT sketches. The proposed CDT interpretation system is evaluated using two CDT data sets. The first data set consists of 65 drawings made by healthy people, while the second set contains 100 drawings reproduced from the drawings of dementia patients to simulate the kind of challenging sketches the system may have to work with. The evaluation analysis shows an improved interpretation performance of the proposed system in comparison with the classical approach, which does not receive benefits from the prior knowledge of the CDT sketch structure or simulated human reasoning.
Clock Drawing Test Digit Recognition Using Static and Dynamic Features
AuthorsZainab Harbi, Yulia Hicks, Rossi Setchi
JournalProcedia Computer Science
Volume 96, 2016, Pages 1221-1230
open access
AbstractThe clock drawing test (CDT) is a standard neurological test for detection of cognitive impairment. A computerised version of the test promises to improve the accessibility of the test in addition to obtaining more detailed data about the subject's performance. Automatic handwriting recognition is one of the first stages in the analysis of the computerised test, which produces a set of recognized digits and symbols together with their positions on the clock face. Subsequently, these are used in the test scoring. This is a challenging problem because the average CDT taker has a high likelihood of cognitive impairment, and writing is one of the first functional activities to be affected. Current handwritten digit recognition system perform less well on this kind of data due to its unintelligibility. In this paper, a new system for numeral handwriting recognition in the CDT is proposed. The system is based on two complementary sources of data, namely static and dynamic features extracted from handwritten data. The main novelty of this paper is the new handwriting digit recognition system, which combines two classifiers—fuzzy k-nearest neighbour for dynamic stroke-based features and convolutional neural network for static image- based features, which can take advantage of both static and dynamic data.
Segmentation of Clock Drawings Based on Spatial and Temporal Features
AuthorsZainab Harbi, Yulia Hicks, Rossi Setchi
JournalProcedia Computer Science
Volume 60, 2015, Pages 1640-1648
AbstractThe Clock Drawing Test (CDT) is an inexpensive and effective measure for early detection of cognitive impairment in the elderly, which is important for timely diagnosis and initiation of appropriate treatment. Currently, medical experts assess the drawings based on their judgement and a number of available scoring systems. An automatic system for assessment of CDT drawings would simultaneously decrease the waiting time for a specialist appointment and improve accessibility of the test to the patients. Published research has only started to address the problem of automatic assessment of CDT drawings and existing systems require user intervention during the segmentation of the CDT drawing into its composing parts, such as numbers and clock hands. In this paper, a new set of temporal and spatial features automatically extracted from the CDT data acquired using a graphics tablet is proposed. Consequently, a Support Vector Machine (SVM) classifier is employed to segment the CDT drawings into their elements, such as numbers and clock hands, on the basis of the extracted features. The proposed algorithm is tested on two data sets, the first set consisting of 65 drawings made by healthy people, and the second consisting of 100 drawings reproduced from actual drawings of dementia patients. The test on both data sets shows that the proposed method outperforms the current state-of-the-art method for CDT drawing segmentation.
Feature Extraction Method for Clock Drawing Test
AuthorsTomoaki Shigemori, Zainab Harbi, Hiroharu Kawanakaa ,Yulia Hicks, Rossi Setchi , Haruhiko Takasea, Shinji Tsuruoka
JournalProcedia Computer Science Volume 60, 2015, Pages 1707-1714
AbstractRecently, the number of elderly persons with dementia has been increasing. In the past, we proposed a dementia evaluation system using daily conversations and developed the system with a conversational robot. However, the current system is not ready for practical use because it can only evaluate time/geographical orientation and short-term memory, and some methods to evaluate other orientations and functions is required as well. In this paper, we discuss a new dementia evaluation system using not only daily conversations but also drawing tests. The authors employed a Clock Drawing Test (CDT) as a new dementia evaluation test and implemented it in a tablet device. This paper discusses a feature extraction and recognition method to distinguish normal cases from dementia cases. After evaluation experiments, the proposed method could recognize 87.6% of the clock drawing images
A Study on Feature Extraction Method for Clock Drawing Images Using Weighted Direction Index Histogram
AuthorsTomoaki Shigemori, Hiroharu Kawanaka, Zainab Harbi, Yulia Hicks, Rossi Setchi, Haruhiko Takase
JournalProceedings of the Fuzzy System Symposium
AbstractRecently, the number of elderly persons with dementia has been increasing. In the past, we have proposed a dementia evaluation system using daily conversations and developed the system with a conversational robot. However, the current system is not sufficient for practical use because it can evaluate time/geographical orientation and short-term memory only, and the method to evaluate other orientations and functions is required as well as them. In this paper, we discussed a new dementia evaluation system using not only daily conversations but also drawing tests. The authors employed Clock Drawing Test (CDT) as new dementia evaluation test and implemented it in the tablet device. This paper discussed a feature extraction and recognition method to distinguish normal cases from dementia ones. After evaluation experiments, the proposed method could recognize 87.6% of the clock drawing images appropriately