EnglishPortugueseSpanish

COLORFUL HELP – Object Identification Device for Visually Impaired People

Project summary

Colorful Help is a scientific project located in the areas of computer science, Machine Learning, Deep Learning and assistive technology, which aims to help people with visual impairments to perform routine tasks through a device capable of recognizing objects and their respective colors. Considering that independence is an important factor for self-esteem, it is recognized that, even if these people can rely on the sense of touch or existing mobile apps, this process can often be uncomfortable or complicated. Therefore, the intention of this research is to contribute to this audience by developing a device that the person can wear as an accessory, initially recognizing garments and communicating to the user, through audio, the shape and color of the clothes. For this, several Convolutional Neural Networks (CNN's) will be made to compare their performance and find out which one is capable of distinguishing and classifying the patterns found in the shapes of each object. Color distinction also compares a computer vision algorithm programmed in Python language and an RGB (Red, Green, Blue) color sensor, programmed in Arduino, and the intention is to find out which of the two methods has the best result and under what circumstances it is recommended. The first evaluation of the neural network will be done with your Test Dataset, which is a set of images similar to those used for your training. Her second evaluation and the computer vision algorithm test were performed with samples captured with a webcam, in order to ascertain the accuracy in a real situation, based on the average of correct answers. The evaluation of the RGB sensor, however, because it cannot recognize images, was done in a different way, just to evaluate its accuracy in readings. Thus, based on the acquired data, it was found that the elaboration of the device is feasible, as the most capable model among neural networks can predict shapes and colors at a distance of 650mm from the object, with an average accuracy of 95% in the 4 categories , while the computer vision algorithm achieved 90% average accuracy in the 9 colors of its programmed spectrum. As future forecasts, it is intended to implement more categories, precision in more saturated environments and/or with a lot of brightness variation, in addition to allowing the distinction of more details, such as differentiating a checkered outfit from a striped one, for example. Keywords: Visual impairment, Assistive Technology, Deep Learning, Machine Learning, Artificial Intelligence

Students

Thiago Kasper de Souza

Guidance counsellors

Alexandre Giacomin
Augusto Mombach

Institution

Liberato Salzano Vieira da Cunha Technical School Foundation
New Hamburg /
  RS -
  Brazil

Popular vote*

Did you like it? So vote and share now:

56+

Leave your comment

What did you think of this project? Participate by leaving your comment below:

Subscribe now
Notify of
guest
7 Comments
Oldest
Newest Most Voted
Inline feedback
View all comments
Mareli Helena Kasper
Mareli Helena Kasper
1 year ago

Very cool

2+
Erica Oliveira Francisco
Erica Oliveira Francisco
1 year ago

Congratulations on the project!!!

2+
Felipe Larini Schneider
Felipe Larini Schneider
1 year ago

Excellent project, Thiago! Congratulations on your efforts! Success and pride in being your friend/colleague!

2+
Daiana de Souza Roxo
Daiana de Souza Roxo
1 year ago

Great job ! Congratulations on your efforts. May he come to help many people!

2+
Luana
Luana
1 year ago

Congratulations Thiago!! We really like your work, we are a company and we want to encourage you for the future.
Call us on whatsapp 982951815
And good luck on your project ❤

1+
Thiago Kasper De Souza
Thiago Kasper De Souza
1 year ago
Reply to  Luana

Good afternoon, how are you?
Thanks for your interest, if you can send more details to the project email, colorfulhelp2020@gmail.com, thank you 😁

0
Katia Rech - mecca
Katia Rech - mecca
1 year ago

Congratulations!!!!! Success !!!! cheering. Hug.

2+

Popular vote*

Did you like it? So vote and share now:

56+

Students

Thiago Kasper de Souza

Guidance counsellors

Alexandre Giacomin
Augusto Mombach

Institution

Fundação Escola Técnica Liberato Salzano Vieira da Cunha
  RS –
  Brasil

Educational Incentives and Awards Offered

Research Areas

Get to know the projects that are competing in all of Mostratec Virtual's research areas:

Cellular and Molecular Biology and Microbiology
Biochemistry and Chemistry
Environmental Sciences
Animal and Plant Sciences
Computer Science
Planetary and Earth Sciences and Mathematics and Physics
Health Sciences
Education and Humanities
Environmental and Sanitary Engineering
Engineering and Materials
Electrical engineering
Electronic Engineering
Mechanical Engineering
History and Social Sciences
7
0
Click to leave your comment and participate!x
()
x

Popular Jury Awards

For the People's Jury awards, only single votes (one per user) and that are cast between 0/00 and 26:10 on 23/59 will be considered valid.

Entrepreneur Profile Test

Fill in your details below to perform your test: