keyboard_arrow_up
Image Content Description Using LSTM Approach

Authors

Sonu Pratap Singh Gurjar, Shivam Gupta and Rajeev Srivastava, IIT-BHU, India

Abstract

In this digital world, artificial intelligence has provided solutions to many problems, likewise to encounter problems related to digital images and operations related to the extensive set of images. We should learn how to analyze an image, and for that, we need feature extraction of the content of that image. Image description methods involve natural language processing and concepts of computer vision. The purpose of this work is to provide an efficient and accurate image description of an unknown image by using deep learning methods. We propose a novel generative robust model that trains a Deep Neural Network to learn about image features after extracting information about the content of images, for that we used the novel combination of CNN and LSTM. We trained our model on MSCOCO dataset, which provides set of annotations for a particular image, and after the model is fully automated, we tested it by providing raw images. And also several experiments are performed to check efficiency and robustness of the system, for that we have calculated BLUE Score.

Keywords

Image Annotation, Feature Extraction, LSTM, Deep Learning, NLP.

Full Text  Volume 7, Number 9