We want to help blind people to be even more autonomous in their daily lives. Thanks to Artificial Intelligence, we can design products which will bring new possibilities to individuals and redesign the world surrounding them. That's why, with GUEYES we want to guide blind people when they walk in the city, describe them the world around them and suggest them new places to go.
Here are the steps:
Then, if we want to create an Image / Video Classification app, we can use this code. We'll only need to get pictures and videos.
// Initialize the Image Classifier method with MobileNet. A callback needs to be passed.
const classifier = ml5.imageClassifier('MobileNet', modelReady);
// A variable to hold the image we want to classify
let img;
function setup() {
noCanvas();
// Load the image
img = createImg('images/bird.jpg', imageReady);
img.size(400, 400);
}
// Change the status when the model loads.
function modelReady(){
document.getElementById('status').html('Model Loaded')
}
// When the image has been loaded,
// get a prediction for that image
function imageReady() {
classifier.predict(img, gotResult);
// You can also specify the amount of classes you want
// classifier.predict(img, 10, gotResult);
}
// A function to run when we get any errors and the results
function gotResult(err, results) {
if (err) {
console.error(err);
}
// The results are in an array ordered by probability.
select('#result').html(results[0].className);
select('#probability').html(nf(results[0].probability, 0, 2));
}
There are lots of free tools for us to use in order to develop our project. We can learn many things from it and gain deeper knowledge.
Here are few selected ressources that will help us in our project :
These articles are also very interresting to understand how AI works. By using new technologies, especially AI to help blind people, we need to take into account research litteratures to improve our understanding of the subject.
Here are few articles: