Environment Descriptor for the Visually Impaired

TitleEnvironment Descriptor for the Visually Impaired
Publication TypeConference Proceedings
Year of Conference2018
AuthorsAnkush, A. Mishra, C. Madhurima, M. R. Gautham Sai, D.. Annapurna, and J. Jishin
Conference NameInternational Conference on Advances in Computing, Communications and Informatics (ICACCI 2018)
PublisherIEEE Xplore
KeywordsDepartment of Computer Science and Engineering

The ability to provide a system for automatically describing images to the users, especially the blind is a matter which can improve their lives significantly, if made possible to a user a friendly way. We present, a way of achieving the task of producing natural language descriptions of images through the use of recent deep architectures in neural networks, specifically based on recurrent and convolution architectures. A generative model for this is created and the accuracy for the MSCOCO Captioning dataset is presented along with a software architecture of how this can be extended as a standalone application for the blind.