Engineering ProjectsAndroid ProjectsBsc-ITDiplomaIT ProjectsMsc-IT Projects

Android TTS OCR Converter for Visual Impairment

Visual impairment can significantly hinder the ability to perform daily activities, especially reading, which is fundamental in navigating the world. The Android TTS (Text-to-Speech) OCR (Optical Character Recognition) Converter System is designed to empower individuals with visual disabilities by converting written text into spoken words, allowing them to perceive and understand their surroundings effectively.

Bridging the Gap with Technology:

The TTS OCR Converter system is an innovative application that uses a camera to capture text from various sources – be it books, signboards, or digital screens. It then employs OCR technology to recognize and extract the text, which is subsequently converted into speech using TTS technology. This entire process transforms the way visually impaired individuals interact with textual content.

How It Works:

  • Capture and OCR: The application uses the device’s camera to capture an image containing text. The OCR technology, particularly Google Cloud Vision API, is employed to accurately detect and extract text from the image.
  • Text-to-Speech Conversion: After text extraction, the system converts the textual information into speech. The user can listen to the content through the device’s speaker or headphones.
  • User Interaction: Users can control the application using the device’s volume buttons – repeating the text, capturing a new image, or closing the application.

Key Features:

  • Auto-Capture Photo: The system automatically captures images, reducing the need for manual operation and ensuring ease of use.
  • Efficient Text Detection: Utilizes advanced OCR technology to detect text accurately and quickly.
  • Intuitive Audio Feedback: Provides clear and understandable audio feedback, making it easy for users to comprehend the text.
  • Volume Button Navigation: Users can easily navigate through the application functions using the device’s volume buttons.

Advantages of the TTS OCR Converter:

  • Increased Independence: Visually impaired individuals can more freely interact with their environment, reading texts that would otherwise be inaccessible.
  • User-Friendly Design: The system is designed with simplicity and ease of use in mind, making it accessible to a wide range of users.
  • Versatile Text Recognition: Capable of reading various types of text, from printed documents to digital displays and signboards.
  • Portable and Convenient: As a mobile application, it can be used anywhere, providing assistance on-the-go.

Conclusion:

The Android TTS OCR Converter System is a testament to how technology can significantly enhance the quality of life for individuals with disabilities. By converting text to speech, it opens up a world of information that was previously difficult to access, fostering greater independence and empowerment for visually impaired users.

Sample Code

Setting Up the Project:

Create a new Android project in Android Studio with an empty activity.

Adding Dependencies:

In your build.gradle (Module: app) file, add the necessary dependencies for Google Cloud Vision API and Android Text-to-Speech.

dependencies {
    implementation 'com.google.android.gms:play-services-vision:20.1.3'
    // other necessary dependencies
}

Permissions:

<uses-permission android:name="android.permission.CAMERA"/>
<uses-permission android:name="android.permission.INTERNET"/>
import android.speech.tts.TextToSpeech;
import android.support.v7.app.AppCompatActivity;
import android.os.Bundle;
import com.google.android.gms.vision.text.TextRecognizer;
// ... other imports ...

public class MainActivity extends AppCompatActivity {

    private TextToSpeech textToSpeechSystem;
    private TextRecognizer textRecognizer;

    @Override
    protected void onCreate(Bundle savedInstanceState) {
        super.onCreate(savedInstanceState);
        setContentView(R.layout.activity_main);
        
        // Initialize Text To Speech
        textToSpeechSystem = new TextToSpeech(this, new TextToSpeech.OnInitListener() {
            @Override
            public void onInit(int status) {
                if (status == TextToSpeech.SUCCESS) {
                    // Set Language, speed and other parameters
                }
            }
        });
        
        // Initialize the OCR
        textRecognizer = new TextRecognizer.Builder(getApplicationContext()).build();

        if (!textRecognizer.isOperational()) {
            // Handle case where OCR is not yet ready
        } else {
            // Start camera source and process frames
            // Implement camera source, capture image, and process using textRecognizer
        }
    }

    // Function to convert text to speech
    private void speakOut(String text) {
        textToSpeechSystem.speak(text, TextToSpeech.QUEUE_FLUSH, null, null);
    }

    // Ensure to shutdown TextToSpeechSystem when activity is destroyed.
    @Override
    public void onDestroy() {
        if (textToSpeechSystem != null) {
            textToSpeechSystem.stop();
            textToSpeechSystem.shutdown();
        }
        super.onDestroy();
    }
}
Click to rate this post!
[Total: 0 Average: 0]

Download Android TTS OCR Converter for Visual Impairment PDF


Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button