An image retrieval framework for real-time endoscopic image retargeting

File Description SizeFormat 
Ye_et_al-2017-International_Journal_of_Computer_Assisted_Radiology_and_Surgery.pdfPublished version3.4 MBAdobe PDFView/Open
Title: An image retrieval framework for real-time endoscopic image retargeting
Authors: Ye, M
Johns, E
Walter, B
Meining, A
Yang, G-Z
Item Type: Journal Article
Abstract: Purpose Serial endoscopic examinations of a patient are important for early diagnosis of malignancies in the gastrointestinal tract. However, retargeting for optical biopsy is challenging due to extensive tissue variations between examinations, requiring the method to be tolerant to these changes whilst enabling real-time retargeting. Method This work presents an image retrieval framework for inter-examination retargeting. We propose both a novel image descriptor tolerant of long-term tissue changes and a novel descriptor matching method in real time. The descriptor is based on histograms generated from regional intensity comparisons over multiple scales, offering stability over long-term appearance changes at the higher levels, whilst remaining discriminative at the lower levels. The matching method then learns a hashing function using random forests, to compress the string and allow for fast image comparison by a simple Hamming distance metric. Results A dataset that contains 13 in vivo gastrointestinal videos was collected from six patients, representing serial examinations of each patient, which includes videos captured with significant time intervals. Precision-recall for retargeting shows that our new descriptor outperforms a number of alternative descriptors, whilst our hashing method outperforms a number of alternative hashing approaches. Conclusion We have proposed a novel framework for optical biopsy in serial endoscopic examinations. A new descriptor, combined with a novel hashing method, achieves state-of-the-art retargeting, with validation on in vivo videos from six patients. Real-time performance also allows for practical integration without disturbing the existing clinical workflow.
Issue Date: 2-Jun-2017
Date of Acceptance: 23-May-2017
ISSN: 1861-6429
Publisher: Springer Verlag
Start Page: 1281
End Page: 1292
Journal / Book Title: International Journal of Computer Assisted Radiology and Surgery
Volume: 12
Issue: 8
Copyright Statement: © The Author(s) 2017 This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Keywords: Science & Technology
Life Sciences & Biomedicine
Engineering, Biomedical
Radiology, Nuclear Medicine & Medical Imaging
Endoscopic navigation
Image recognition
Binary codes
1103 Clinical Sciences
Nuclear Medicine & Medical Imaging
Publication Status: Published
Appears in Collections:Faculty of Engineering

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx