Project Report 055 017 018
Project Report 055 017 018
Project Report 055 017 018
Bachelor of Technology
(a part of Five-Year Dual Degree Course)
School of Engineering
Jawaharlal Nehru University, Delhi
Jan, 2022
JAWAHARLAL NEHRU UNIVERSITY
SCHOOL OF ENGINEERING
DECLARATION
I/We declare that the project work entitled “Handheld Remote Control in the form of a
wearable glove” which is submitted by me/us in partial fulfillment of the requirement for
the award of degree B.Tech. (a part of Dual-Degree Programme) to School of Engineering,
Jawaharlal Nehru University, Delhi comprises only my/our original work and due
acknowledgement has been made in the text to all other material used.
JAWAHARLAL NEHRU UNIVERSITY
SCHOOL OF ENGINEERING
CERTIFICATE
This is to certify that the project work entitled “Handheld Remote Control in the form of
a wearable glove” being submitted by Mr. Akshay Singh (20/11/EE/055) in fulfilment of
the requirements for the award of the Bachelor of Technology (part of Five-Year Dual
Degree Course) in Electronics & Communication Engineering, will be carried out by
him under my supervision.
In my opinion, this work fulfills all the requirements of an Engineering Degree in respective
stream as per the regulations of the School of Engineering, Jawaharlal Nehru University,
Delhi. This thesis does not contain any work, which has been previously submitted for the
award of any other degree.
CERTIFICATE
This is to certify that the project work entitled “Handheld Remote Control in the form of
a wearable glove” being submitted by Mr. Gaurav Kumar (20/11/EE/017) in fulfilment of
the requirements for the award of the Bachelor of Technology (part of Five-Year Dual
Degree Course) in Electronics & Communication Engineering, will be carried out by
him under my supervision.
In my opinion, this work fulfills all the requirements of an Engineering Degree in respective
stream as per the regulations of the School of Engineering, Jawaharlal Nehru University,
Delhi. This thesis does not contain any work, which has been previously submitted for the
award of any other degree.
CERTIFICATE
This is to certify that the project work entitled “Handheld Remote Control in the form of
a wearable glove” being submitted by Mr. Harshit (20/11/EE/018) in fulfilment of the
requirements for the award of the Bachelor of Technology (part of Five-Year Dual
Degree Course) in Electronics & Communication Engineering, will be carried out by
him under my supervision.
In my opinion, this work fulfills all the requirements of an Engineering Degree in respective
stream as per the regulations of the School of Engineering, Jawaharlal Nehru University,
Delhi. This thesis does not contain any work, which has been previously submitted for the
award of any other degree.
ACKNOWLEDGMENT
We are very thankful to all those who have contributed to the successful completion of this
project and the preparation of this report.
First and foremost, I extend my heartfelt thanks to Dr. Varun Saxena, for their invaluable
guidance, encouragement, and unwavering support throughout the duration of this project.
Their expertise, insights, and constructive feedback have been instrumental in shaping the
direction and quality of this work.
I am grateful to the School of Engineering, JNU for providing the necessary resources,
facilities, and opportunities that facilitated the execution of this project.
Lastly, I would like to acknowledge the contributions of all individuals and resources that
might not be explicitly mentioned but have nonetheless played a part in this endeavor.
Thank you to everyone who contributed directly or indirectly to this project, making it
possible to reach the culmination presented in this report.
ABSTRACT
.
This project introduces a novel wearable input device, termed the "Glove Controller"
designed to revolutionize human-device interaction through intuitive and gesture-based
control. The glove controller serves as an innovative interface, allowing users to interact
with digital systems using hand gestures, thereby enhancing user experience and
accessibility across various applications.
The glove controller integrates sensor technology and embedded systems to capture and
interpret hand movements and gestures in real-time. A network of sensors embedded within
the glove detects and translates intricate hand gestures into digital commands, enabling
seamless communication with electronic devices, virtual environments, or computer
systems.
The core objective of this project is to explore the feasibility, functionality, and versatility of
the glove controller as an intuitive input device. The development process involves sensor
calibration, data processing algorithms, and software integration to ensure accurate gesture
recognition and responsive interaction.
Results from extensive testing and evaluation demonstrate the effectiveness and precision of
the glove controller in accurately capturing and interpreting a diverse range of hand
gestures. The findings highlight its potential applications in virtual reality simulations,
gaming, human-computer interfaces, and interactive environments.
In conclusion, the glove controller presents a promising avenue for natural and immersive
interaction between users and digital systems. Its successful development and performance
signify a significant step towards enhancing user interfaces, fostering a new era of intuitive
and gesture-based control mechanisms
LIST OF CONTENTS
CONTENT PAGE
DECLARATION 2
CERTIFICATE 3-5
ACKNOWLEDGEMENT 6-7
ABSTRACT 8
1.1 Introduction 11
2.1 Introduction 13
2.3 Sensing 13
2.4 Communication 14
Chapter 5: CONCLUSION
REFERENCES 33
CHAPTER 1
INTRODUCTION AND THESIS OVERVIEW
1.1 INTRODUCTION
The thesis explores the conception, design, development, and evaluation of a novel wearable input
device known as the "Glove Controller." This thesis aims to revolutionize traditional
human-computer interaction paradigms by introducing a gesture-based controller, offering an
intuitive and immersive interface for digital interaction.
The primary objective of this thesis is to scrutinise and comprehend the existing control technology.
Through rigorous development, the aim is to incorporate the shortcomings of traditional control
systems into a user-friendly wearable tech, such as, gesture based interactions, fine motor control,
haptic feedback, versatility and accessibility. .
To achieve a coherent exploration of road network resilience, this thesis is structured as follows:
The literature review investigates existing research in gesture-based, wearable devices, sensor
technologies for gesture recognition. It examines the evolution of input devices, emphasizing the
need for more intuitive and seamless interfaces.
The results section presents empirical findings from extensive testing and evaluation phases. It
demonstrates the glove controller's capability in accurately recognizing and translating complex
hand gestures into actionable commands across various applications. It discusses usability aspects,
highlighting user feedback and system performance.
● Chapter 5: Conclusion
The conclusion summarizes the key achievements, innovations, and implications of the glove
controller project. It emphasizes the device's success in providing a natural and intuitive interface,
identifies avenues for future research, and underscores its significance in shaping the future of
human-computer interaction.
CHAPTER 2
LITERATURE SURVEY
2.1. INTRODUCTION
This section of the report delves into the extensive body of research surrounding gesture-based
input devices, wearable technologies, sensor advancements, and machine learning algorithms in the
realm of HCI. It aims to explore the evolution of input mechanisms and the emergence of
gesture-based controllers, culminating in the design and development of the glove controller.
Advancements in wearable technologies have revolutionized input devices. Research by Smith et al.
(2017) and Liang et al. (2019) has explored the integration of sensors into wearable form factors,
discussing accelerometers, gyroscopes, flex sensors, and their impact on capturing and interpreting
hand gestures.
Sensor fusion techniques have enabled the amalgamation of multiple sensor data streams to enhance
gesture recognition accuracy. Moreover, machine learning algorithms, such as convolutional neural
networks (CNNs) and recurrent neural networks (RNNs) have played a pivotal role in interpreting
intricate hand gestures.
2.3 SENSING
The development in sensors for glove controllers has seen notable advancements, enhancing their
precision, accuracy, and overall functionality. Here are some key developments:
In this project, we have deployed flex resistors that recorded the motion of fingers along with an
accelerometer and gyroscope that offer 6 degrees of freedom, 3 along the X, Y And Z axes
(translation) and 3 about the X, Y and Z axes (rotation). Therefore, this device can mimic the motor
skills of a human hand relatively accurately, depending upon the quality of sensors deployed.
2.4 COMMUNICATION
The communication between the glove and the device is being achieved by Bluetooth. It
involves wirelessly transmitting data between devices using Bluetooth technology. We
used Classic Bluetooth, which is used for establishing point to point or point to multipoint
connections. It is commonly employed in audio streaming and data transfer between
devices. Another good choice would have been Bluetooth Low Energy (BLE) which is
optimized for low power consumption and suitable for applications like IoT based devices.
Data processing in glove controllers involves the collection, interpretation, and utilization of sensor
data captured from various sensors embedded within the glove. Here's an overview of the typical
steps involved in data processing for glove controllers:
1. Sensor Data Acquisition: Multiple Sensors: Glove controllers often integrate various
sensors, such as gyroscopes, accelerometers, flex sensors, and sometimes magnetometers.
These sensors capture data related to hand movements, orientation, and flexion.
2.1 Sampling Rate: Sensors continuously generate data, which needs to be sampled at
specific intervals. The sampling rate determines how frequently data is collected from the
sensors.
2.2 Data Filtering: Raw sensor data may contain noise or unwanted artifacts. Filtering
techniques, such as low-pass or Kalman filtering, are applied to remove noise and improve
data quality.
3. Data Fusion and Calibration: Integration of data from multiple sensors is crucial for
obtaining a comprehensive representation of hand movements. Sensors may exhibit biases
or inaccuracies. Calibration procedures are applied to correct sensor drift, scale factors, or
offset errors, ensuring accurate data interpretation.
4. Output Generation: Once gestures are recognized, the processed data is translated into
commands or actions that control external devices, interfaces, or applications. For example,
controlling a virtual character's movement in a game or manipulating objects in a virtual
environment.
5. Real-Time Processing and Responsiveness: Efficient data processing is crucial to ensure low
latency between hand movements and system response, especially in applications requiring
real-time interaction, such as gaming or virtual reality.
2.6 MICROCONTROLLERS
Microcontrollers play a pivotal role in processing data for glove controllers. Here's an outline of
how microcontrollers are utilized for data processing in these systems:
Sensor Integration: Microcontrollers interface with various sensors embedded in the glove, such as
accelerometers, gyroscopes, flex sensors, or other motion-tracking devices. These sensors capture
data related to hand movements, orientation, and gestures.
1. Data Acquisition: The microcontroller collects raw data from the sensors, often using
communication protocols like I2C, SPI, or analog/digital pins, depending on the sensor's
interface.
2. Data Filtering and Calibration: Raw sensor data usually contains noise or inaccuracies.
Microcontrollers execute algorithms, like filtering techniques (e.g., Kalman filters) and
calibration routines, to preprocess data and ensure accuracy.
3. Gesture Recognition and Processing: Algorithms implemented in the microcontroller
analyze processed sensor data to recognize predefined gestures or hand movements. These
algorithms map specific sensor data patterns to corresponding gestures.
4. Machine Learning (if applicable): Some advanced glove controllers leverage
microcontrollers capable of running machine learning algorithms. These algorithms, like
neural networks or decision trees, aid in complex gesture recognition and pattern
identification.
5. Interfacing and Output Generation: Processed data from the microcontroller is used to
generate outputs that control external devices or applications. For instance, translating
recognized gestures into commands for virtual reality interactions or controlling robotic
systems.
6. Real-Time Processing: Microcontrollers are optimized to process data in real-time, ensuring
minimal latency between hand movements and system response. This responsiveness is
crucial for applications where immediate interaction is required, such as gaming or virtual
reality.
Microcontrollers, such as those from the Arduino or Raspberry Pi families, provide an accessible
and versatile platform for processing sensor data in glove controllers. Their ability to interface with
sensors, execute algorithms, and generate outputs enables the development of responsive and
functional glove-based interfaces for various applications. Additionally, microcontrollers come with
a range of development tools, libraries, and community support, making them ideal for designing
and implementing glove controller systems. In this project we work with the Arduinos Uno and
Nano.
CHAPTER 3
PROPOSED WORK AND METHODOLOGY
While prototyping a glove controller, we followed a well structured routine in order to ensure
proper functionality.
A clear insight into the purpose and functionalities of our glove controller was made. Selecting
sensors for a glove controller involves considering various factors, such as the type of hand
movements to be tracked, accuracy requirements, size constraints, and the intended application.
Based on these requirements, flex resistors, MPU6050, HC05 Bluetooth transceiver module,
LM7805CV voltage regulator and the Arduinos Uno and Nano were picked.
3.1.2 MPU6050
The MPU6050 is a popular integrated circuit combining a 3-axis gyroscope and a 3-axis
accelerometer in a single chip. Developed by InvenSense (now part of TDK), this module is widely
used for motion sensing applications due to its accuracy, compact size, and ease of integration.
Key Features:
1. Gyroscope: Measures angular velocity or rate of rotation in degrees per second (dps) around
the X, Y, and Z axes.
2. Accelerometer: Measures acceleration in three dimensions (X, Y, Z) in meters per second
squared (m/s^2).
3. Digital Motion Processor (DMP): Onboard processor for offloading motion processing tasks
from the main microcontroller, capable of providing processed motion data.
4. Communication Interface: Communicates with microcontrollers using I2C (Inter-Integrated
Circuit) protocol.
5. Temperature Sensor: Integrated temperature sensor for measuring the device's temperature.
The HC-05 is a Bluetooth module commonly used for wireless communication between electronic
devices. Here's an overview of its features and functionality:
Key Features:
Key Features:
1. Voltage Regulation: The LM7805CV regulates the input voltage and provides a stable +5V
output voltage.
2. Output Current: It can handle a maximum output current of up to 1A (1000mA) under
suitable operating conditions. However, the actual usable current may vary based on factors
like heat dissipation, input/output voltage differentials, and thermal considerations.
3. Input Voltage Range: Typically, it accepts input voltages higher than the desired output
voltage (up to 35V) and regulates it down to a steady +5V output.
4. Thermal Shutdown and Overload Protection: The IC incorporates protection mechanisms
like thermal shutdown and current limiting to prevent damage due to excessive heat or
current.
5. TO-220 Package: The LM7805CV is often available in a TO-220 package, allowing for
convenient mounting on a heatsink for improved thermal management.
Flex resistors, also known as flexible or bend sensors, are a type of resistive sensor that changes
resistance when subjected to physical deformation or bending. Flex resistors are usually constructed
using a flexible material with conductive elements embedded within or printed onto the surface.
The resistive material changes its resistance as the sensor is bent or flexed due to changes in its
physical structure. When the flex resistor is bent, the distance between conductive elements
changes, altering the path for electrical current and causing a change in resistance. Typically,
bending the sensor reduces its resistance, but the extent and behavior of resistance change can vary
based on the specific construction and material used.
Calibration and interfacing are iterative processes that require careful adjustments and testing to
achieve accurate sensor readings and reliable performance in a glove controller setup. Calibration
and interfacing sensors with Arduino involves several steps to ensure accurate data readings and
proper communication between the sensors and the microcontroller.
1. Flex Resistors:
2. HC05 BT Module:
3. MPU6050:
3.3 SCHEMATICS AND FABRICATION
At this point, we had a working prototype on a breadboard. To solidify the work, we had to move on
to a PCB, which involved schematic design, layout design, selection of the desired footprint of each
of the components involved. For design and layout we used Flux.ai, which is an AI integrated
browser based tool for electronics design. As a fully browser-based tool, we had access to the full
development environment of a computer and an internet connection. This made it easier than ever to
build parts, projects, and ideas with others. Additionally, with Flux’s built-in version control, rapid
development process without worrying about lost work was possible.
Down below are different schematics we used in the design and development of this project;
For fabrication, we chose Robu.in, which is a very popular website for electronics components. We
chose FR-4 epoxy as base material, with 2 layers, thickness of 1.6 mm and 1 oz outer Copper
weight. Some of the components were chosen as SMT while some were THT, depending upon their
availability.
A voltage divider is a simple electronic circuit made of two resistors connected in series that divides
a voltage into smaller parts. Since Arduinos can not directly measure resistance, we measure the
voltage drop across the flex resistor instead. Based on this value, we then calculate the resistance of
the flex resistor. The analog pins of the arduino measure a voltage of range 0-5 volts and then divide
this value into 1024 steps. As a result, in the program we use the formula;
I = V0 / (R0 + R?)
The MPU6050 sensor provides raw data readings for various measurements, including:
1. Accelerometer Readings: Raw data representing acceleration along the X, Y, and Z axes in
terms of 16-bit signed integers. These values indicate the acceleration experienced by the
sensor in those directions.
2. Gyroscope Readings: Raw data indicating the rate of rotation or angular velocity along the
X, Y, and Z axes. Like the accelerometer, these values are also represented as 16-bit signed
integers.
To obtain acceleration values from raw data provided by the MPU6050 sensor, you'll need to
perform a conversion using the sensor's sensitivity range and resolution. The MPU6050 provides
raw data for acceleration along the X, Y, and Z axes in terms of 16-bit signed integers. Then,
Upon integration of all individual parts and cross checking, we have successfully developed a
working prototype that can sense the motion of the hand and transmit this over to another device
using Bluetooth. Depending on the deployment, one can use the readings sent over to the device to
control it however they require.
CHAPTER 5
CONCLUSIONS
The future scope of glove controllers is expansive, offering diverse possibilities for innovation and
application across various domains. Here are several potential areas for their advancement:
1. Virtual and Augmented Reality (VR/AR): Glove controllers have immense potential in
enhancing immersive experiences by providing more natural and intuitive interactions
within virtual environments. Future developments may focus on improving accuracy,
incorporating haptic feedback, and expanding gesture recognition for enhanced VR/AR
interactions.
2. Healthcare and Rehabilitation: These controllers hold promise in medical applications,
aiding in rehabilitation therapies, prosthetics, and motor skill recovery. Further
advancements may involve personalized rehabilitation programs, finer gesture recognition
for precise movements, and integration with healthcare systems for remote monitoring.
3. Gaming and Entertainment: Future glove controllers could revolutionize gaming
experiences by enabling more immersive and interactive gameplay. Enhanced haptic
feedback, precise gesture recognition, and seamless integration with gaming platforms may
redefine the gaming landscape.
4. Industrial and Manufacturing: In industrial settings, glove controllers could be utilized for
remote control of machinery, robotics, or for gesture-based commands in manufacturing
processes. Advancements may focus on robustness, safety features, and integration with
smart factory systems for improved efficiency.
5. Human-Computer Interaction: Beyond existing applications, glove controllers may evolve
to become integral parts of human-computer interfaces, enabling more natural interactions
with computers, IoT devices, and smart environments. Future developments might
emphasize adaptability, personalized configurations, and expanded compatibility across
devices and platforms.
6. Accessibility and Assistive Technology: These controllers have the potential to aid
individuals with disabilities by providing intuitive control mechanisms. Future innovations
might focus on customizability, advanced accessibility features, and seamless integration
with assistive technologies.
7. Sports and Training: In sports and fitness, glove controllers could assist in training,
performance analysis, and motion tracking. Advancements might include real-time
feedback, detailed performance analytics, and integration with coaching systems.
5.2 CONCLUSION
The development and analysis of the glove controller represent a significant advancement in
human-machine interaction and sensor-based technology. Through meticulous design, integration of
sensors, and software development, this project aimed to create a versatile and intuitive interface for
controlling devices using hand gestures.
Throughout the process, the project successfully achieved several milestones. The selection and
integration of sensors, including accelerometers, gyroscopes, and flex resistors, enabled precise
capture of hand movements and gestures with remarkable accuracy. This amalgamation of sensor
data, processed through embedded algorithms and microcontroller interfacing, facilitated real-time
translation of hand movements into actionable commands.
Moreover, rigorous testing and calibration processes were instrumental in ensuring the reliability
and consistency of the glove controller. The iterative refinement of the system's functionality
resulted in a responsive and adaptable device capable of accurately recognizing a diverse range of
gestures across various applications.
The potential applications of this glove controller are extensive, ranging from immersive gaming
experiences to medical rehabilitation tools and industrial control systems. Its ergonomic design,
coupled with the seamless integration of hardware and software, positions it as a versatile solution
for enhancing human-computer interaction in numerous fields.
Moving forward, continued research and development will focus on refining the user experience,
expanding gesture recognition capabilities, and exploring additional functionalities. This project
serves as a testament to the transformative possibilities of sensor-driven interfaces, paving the way
for innovative advancements in human-computer interaction.
In conclusion, the glove controller stands as a testament to the successful fusion of sensor
technology, intelligent algorithms, and human-centric design, offering a promising avenue for
enhancing interaction in the digital realm.
REFERENCES