BeyondWords

BeyondWords - AI Reading Companion for Individuals with Dyslexia

#Dyslexia & BeyondWords

Dyslexia is a major cause for limited reading proficiency around the world. BeyondWords empowers individuals with dyslexia to read and comprehend any text with the help of Artificial Intelligence.

#Description

BeyondWords is an Artificial Intelligence Reading Companion for individuals experiencing Dyslexia. People with dyslexia find it very difficult to read and interpret words and characters. Apart from text that is modified specifically for them, almost every other text around them (books, bills, brochures, and even anything with small text like ingredients printed on food items that increases the reading difficulty) is almost impossible for them to read and understand. BeyondWords tackles this challenge by providing several dyslexic-friendly features powered by Artificial Intelligence to help them interpret the text better.

Initially, the user takes a picture of the text that they have trouble reading. Only the text content from the image is extracted from the image using Google Machine Learning Kit's Optical Character Recognition (OCR) Library.

The extracted text using OCR is then converted and displayed in a special text format designed specifically to people with dyslexia read with ease, known as OpenDyslexic. The user can then access the other dyslexic-friendly features of the app.

Firstly, the user can adjust text size, and even add letter spacing, which helps them toward reading the text better. The read-aloud feature, built using Google AI's Text to Speech Library, as its name states, reads the text out using a realistic computer generated voice, which the user can follow along with. Last but certainly not least, the user can leverage the AI Summarizer which automatically gives a simple summary of intricate texts so it is easier and quicker to read, and more comprehensible overall. This part was built using Hugging Face's BART CNN Large Language Model (Bidirectional & Auto Regressive Transformer combined with a Convolutional Neural Network).

#Inspiration

There are more than 780 million individuals around the world of all ages who are experiencing dyslexia, and 40 million in the United States, and only around 2% of them receive any diagnosis. What is really unfortunate is that the high school dropout rate for children with reading problems is a whopping 62%, with the main factor being reading disabilities like dyslexia. This is what devastated me the most. Just because of the fact that they interpret text differently, they were not able to perform as well as they desired, leading to them having to drop out of school. Knowledge is vital, and I believe everyone should have the ability to read whatever they would like to and are curious about without any hassle. So this is mainly why I created BeyondWords, with a goal to unite everyone in the aspect of having the ability to read as much as they would like!

#Future

In Version 2.0, I am planning to implement reading evaluations using Reinforcement Learning. As the user continues to use the application, the Reinforcement Learning Model will start adapting text formatting to increasing the readability for that user. It will also support listening to the user reading out the material so that it can track the accuracy of the user's reading. I would also like to provide insights for each of the user's reading sessions, so that the user can read out the texts to find their accuracy and mispronounced or skipped words, and also provide analytics to the user periodically to help them gain insight into their overall reading performance.

Apart from this, I would also like to integrate a Generative AI Question-Answer Model that will respond to the questions that the user has regarding the text, to help increase their comprehension of the material.

As they say, "A picture is worth a Thousand Words". I would also like to incorporate Generative AI for creating images about the text using models like OpenAI's Dall.E and Stable Diffusion XL. This will also help the user understand the meaning of the text better by relating it to the image they see.

Most importantly, I would also like to connect with organizations around the world that help such individuals with Dyslexia to collaborate and continue using advancements in Artificial Intelligence to help tackle this problem.

#Access or Download BeyondWords!

BeyondWords has been published to the Google Play Store, and can be downloaded from the following link:

https://play.google.com/store/apps/details?id=com.beyondwords

Coming soon to the App Store!

#Conclusion

Dyslexia has prevented millions of people around the world from reading, which I believe should never be the case. BeyondWords is just the stepping stone to help solve this problem, and using the frequent advancements in Artificial Intelligence, I envision everyone with the ability to read one day.