Gesture Recognition and Voice Control On Devices

Gesture recognition and Voice control on
Devices
ABSTRACT
The current paper presents how the signals from an accelerometer can be processed to
accurately recognize user gestures after applying a small accelerometer to a handheld device. For
gesture-based control to be effective in handheld devices the overheads involved in recognizing
gestures should be minimal and the gestures accurately recognized in real operational
environments. Therefore, the signals detected from accelerometers were classified into
acceleration and dynamic acceleration, then the signal patterns of the accelerometers in relation
to simple gestures were analyzed. A device control module was created and its operating process
compared to that of a normal control device to evaluate the usability of gesture recognition. As a
result, gesture-based control was found to be easy to use, reduced the preparation process, a
produced a rapid system reaction. Accordingly, gesture-based control would seem to be an
effective user interface for handheld devices primarily used in mobile environments.
Here the project is designed using the Embedded C. This project is connected to the external
hardware; Which accepts the commands from the hardware and accordingly performs the desired
task. The project aims at the C graphics and Peripheral interface par. Here the objective is to
connect or interface the inputs to the external hardware and also to control the external hardware.
The proposal, design and implementation of a microcontroller based voice activated
wireless automation system. As speech is the preferred mode of operation for human being, this
project intends to make the voice oriented command words for controlling home appliances. In
this project, one voice recognition module has been added to the wireless network. The
automation centers at recognition of voice commands and uses the Radio Frequency (RF)
technology. The voice command is a person independent. The system comprises of transmitting
section and receiving section. Initially, the voice command is stored in the data base with the
help of the function keys. Then the input voice commands are transmitted through wireless. The
voice received is processed in the voice recognition system where the feature of the voice
command is extracted and matched with the existing sample in the database. The module
recognizes the voice and sends control messages to the Microcontroller. The programmed
Dept. of ECE, SIET, Tumkur-06
Page 1

Devices
microcontroller then processes the received data and switches the respective appliances via
connected driver circuits.
INTRODUCTION
Here the project is designed using the Embedded C. This project is connected to the external
hardware;Which accepts the commands from the hardware and accordingly performs the desired
task. In other words:
The project aims at the C graphics and Peripheral interface par. Here the objective is to connect
or interface the inputs to the external hardware and also to control the external hardware.
Here the project consists of following blocks,
1.Software with Embedded C.
2. Interface.
3.Hardware
The software reads the data from the interface, generated from the external hardware and
interprets them into suitable Inputs formats. For various data, the project image behaves in a
different pre-programmed manner. For example, if the joystick is bent for 45 degrees, respective
applications will be controlled.
Over the past decade, technology has dramatically changed our life and living styles. The
internet has made it possible for people to connect to the world without stepping out of the house
and wireless communication has given people the convenience of keeping in touch with each
other anytime anywhere. The design of new future house is full of advanced technologies. These
new technologies offer homeowners a more comfortable home environment doing automation
which refers to any process that gives remote or automatic control of home devices and
appliances. The challenge to design better automation products is to accommodate the variation
among different users. Also, a better user interface design can be the solution to some existing
automation design problems. The perfect user interface still does not exist at present and to build
a good interface requires knowledge of both sociology and technology fields. According to major
companies that are involved in speech recognition researches, voice will be the primary interface
between humans and machines in the near future. Researchers have investigated the possibility
Page 2

Devices
of using voice activation in cars to enable hands free controlling. Recently, a Hidden Markov
Model (HMM) based speech recognition system was implemented in to enable voice activated
wheelchair controlling. Speech recognition technology allows computers to translate speech in
pure audio or spoken form and convert it to text. By providing a specific grammar and limiting
the vocabulary, the system needs to recognize the speech with good recognition results. The
performance of the speech recognition in home environments depends on the implementation of
the speech recognition system interfaced with the smart chip called microcontroller with proper
programming. The main contribution of this paper is proposal, implementation and evaluation of
a microcontroller based voice activated wireless home automation system for assessing the
feasibility of using voice as the unified control method in real wireless home environments.
PROBLEM STATEMENT
Many of the handicapped people should depend on others necessarily to fulfill their needs
of work, such as
To control the electronic devices, lights.
To open and close the door.
And also the common people who are so much stressed due to their work and cant do
their daily deeds .
SOLUTION
For such problems listed above the gesture recognition and voice controlled commands
are helpful. The patients and handicaps can show the signs for their needs as they required and
their work can be easily done.
And also normal people can reduce their workload by the help of this technology.
Page 3

Devices
a. BLOCK DIAGRAM
Page 4

Devices
b. BLOCK DIAGRAM
MICROPHONE
VOICE CHIP
PRE AMPLIFIER
BUFFER
DRIVER
Load AC and DC
POWER SUPPLY UNIT
HARDWARE AND SOFTWARE REQUIREMENT

HARDWARE REQUIREMENT
SOFTWARE REQUIREMENT
Gesture Sensors
Keil Software
MC 89c51
Embedded C
Electromagnetic Relays
Drivers ULN 2003
Buffer CD 4050
DESIGN IMPLEMENTATION
In the global arena of technological revolution, remote control is one of the fastest growing fields
where the technology is thrust on distance and type of data command. The popular methods of
remote controller are using Radio Frequency, Frequency modulation, Infrared technology etc.
Page 5

Devices
These techniques have limitation of range and are quite old established technique. The long
distance technology uses GSM, GPRS network technology for remote operation. The voice
based remote operation is a modern short range remote controller and that accept voice
commands. The remote controller is designed to accept command directly from the human voice.
A voice processor is used to recognize the voice and accordingly carry out the tasks assigned in
the controller.
EXPLANATION
In our project we are implementing various parameters like controlling different devices like fan,
TV, Refrigerator, Radio, Tube lights, etc.., in short we have designed our project in such a way
that we will be controlling two devices like controlling the speed of the FAN depending on the
tilt sensor. When we want to control the action of any device with the help of the tilt sensor and
the moments of the hands or what we can is moment of the palm we can rotate the angle to the
required direction such that depending on that particular sensor output will be generated whereby
that output will be given to the 74154 for which it acts like an triggering pulse to it with respect
to that an output will be generated and that output will be given to the not gate which will invert
the signal from there it will be given to the buffer IC which will amplify the signal strength as
buffer is an device which amplifies both voltage and current of the information signal even
buffer is also called as unity gain amplifier. The output of the buffer is maintained to +5v even
though there is variation of 2.5v to 5.5v at the input of the buffer.
The output of the buffer is given to the driver which will drive the relay to control the different
actions of the device, like to control the speed of the fan we will be controlling the firing angle of
the triac and diac by varying the resistance of triggering input of the triac.
When we tilt our palms from which we will be activating the RF Transmitters which will
transmit the signal to the TRIAC point, mean to say where we keep the RF receiver from which
we will trigger the TRIAC and Diac.
Page 6

Devices
Similarly, to control the action of different operation of the TV we will use the same circuit but
instead of using the TRIAC and diac circuit we will be using IR Transmitter (Remote) to control
the volume of the TV.
MAIN FEATURES OF THE PROJECT:

1. Economical in nature, simple in design & operation.
2. Highly flexible in nature. The system can be used as a stand-alone unit or a remote
interfaced one.
3. Due to the Micro-controller Interface facility, the system is highly accurate & automatic in
nature.
4. Since this system is associated with a MC, keep track of the parameters & analyze it, for
further study of the parameter.
APPLICATIONS:
1. This project is an effective tool to demonstrate the functioning & applications of Virtual
Reality and its effective implementation.
2. The project described here can be usefully extended for the modern applications like
Tele-medicine & Tele-robotics.
3. The project can be used to demonstrate the other similar remote operational applications.
4. This project forms a direct tool to interface the human-like or analogue movements to the
computer and carry out the desired operation through the internet or any other similar
communication protocol.
5. This project can be used in remote war related tactics.
Page 7

Devices
Conclusion:
Gesture based smart control and voice controlled devices are the helpful technologies for
handicaps for helping them to do their works easily..
And also for the normal people to reduce their workload by the help of this technology.
Page 8

Gesture Recognition and Voice Control On Devices

Uploaded by

Copyright:

Available Formats

Gesture Recognition and Voice Control On Devices

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Gesture Recognition and Voice Control On Devices

Uploaded by

Copyright:

Available Formats

Gesture recognition and Voice control on

Dept. of ECE, SIET, Tumkur-06