-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathgisa.html
133 lines (131 loc) · 7.13 KB
/
gisa.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta name="google-site-verification" content="G4gClB66Jr2h0XiecdD1OyTE0HCHwwS707_GIuEMCfU" />
<meta name="description"
content="The DRISHTI-ROBOCON is a student initiative at SVNIT to build robots for participating in ABU-ROBOCON">
<meta name="keywords" content="Drishti,ROBOCON, robocon,WE,ME">
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<title>
GISA
</title>
<link rel="apple-touch-icon" sizes="180x180" href="favicon_io/apple-touch-icon.png">
<link rel="icon" type="image/png" sizes="32x32" href="favicon_io/favicon-32x32.png">
<link rel="icon" type="image/png" sizes="16x16" href="favicon_io/favicon-16x16.png">
<link rel="manifest" href="favicon_io/site.webmanifest">
<link href="css/all.min.css" rel="stylesheet">
<link href="css/fontawesome.min.css" rel="stylesheet">
<link rel="stylesheet" href="css/bootstrap.min.css">
<link rel="stylesheet" type="text/css" media="screen" href="footer.css">
<link rel="stylesheet" type="text/css" media="screen" href="gisa.css">
</head>
<body>
<div class="main-div">
<nav class="navbar navbar-expand-md navbar-light" style="background-color: rgba(2,2,2,0.4);">
<a href="http://svnit.ac.in/" class="navbar-brand">
<img class="nit_photo" src="images/svnit.png">
</a>
<div class="navbar-brand v1"></div>
<a href="https://drishti-svnit.github.io/drishti/" class="navbar-brand">
<img src="images/logoleft.jpg" class="svnit_photo">
</a>
<button type="button" class="navbar-toggler" data-toggle="collapse" data-target="#menu">
<span class="navbar-toggler-icon"></span>
</button>
<div class="collapse navbar-collapse" id="menu">
<ul class="navbar-nav ml-auto">
<li class="nav-item" style="font-weight: bold; margin-right: 20px;"><a href="index.html"
class="nav-link">Home</a></li>
<li class="nav-item" style="font-weight: bold; margin-right: 20px;"><a href="gallery.html"
class="nav-link">Gallery</a></li>
<li class="nav-item dropdown " style="font-weight: bold; margin-right: 20px;">
<a href="#" class="nav-link dropdown-toogle" data-toggle="dropdown">Projects</a>
<div class="dropdown-menu" style="background-color: rgb(220,220,220);">
<a href="tunex.html" class="dropdown-item">
Tunex
</a>
<a href="virtuon.html" class="dropdown-item">
Virtuon
</a>
<a href="gisa.html" class="dropdown-item">
GISA
</a>
<a href="planet.html" class="dropdown-item">
PlaNet
</a>
<a href="acs.html" class="dropdown-item">
Automated-Check-in-System
</a>
<a href="aicolorization.html" class="dropdown-item">
Ai-image-Colorization
</a>
</div>
</li>
<li class="nav-item" style="font-weight: bold; margin-right: 40px;"><a href="#down"
class="nav-link">Contact</a></li>
</ul>
</div>
</nav>
<div class="ref-image">
<div class="ref-title">
<h1>
GISA
</h1>
<h3>2019-2020</h3>
</div>
</div>
</div>
<br><br><br>
<div class="ref-aim">
<h1>ABSTRACT</h1>
<p> It is observed that specially abled people are unable to communicate properly due to the lack of knowledge about
their sign language amongst common people. <b>GISA (GESTURE INTERPRETER FOR SPECIALLY ABLED)</b> as the name suggests this
system aims at encountering this problem and proposing a feasible solution. It’s aim is to build a human responsive
system that can aid specially abled (blind, deaf and aphonic) people by interpreting the sign language (i.e. hand gestures).</p>
<p><b>GESTURE RECOGNITION</b></p>
<p>
Sign language of differently abled people is mostly composed of hand gestures. Gesture recognition is a
technique that uses the concepts of computer vison which is used for the interaction between human
and computer or it can be for any automation implementation purpose. Further converting these gestures
to text and speech so that it can be easily understood by others.
</p>
<p><b>MODEL</b></p>
<P>
Model for gesture recognition was trained for the following techniques:
<ul>
<li>Basic Convolutional Neural Networks(CNNs)</li>
<li>SVM(Support Vector Machines)</li>
<li>Object Path Tracking for handwritten text recognition</li>
<li>Long Short Term Memory(LSTM)</li>
<li>Tacotron(GRU+RNN) for text-to-speech conversion</li>
</ul>
</P>
<p><b>WORKFLOW</b></p>
<P>
<ul>
<li>The cameras capture the gestures and store it in a database. </li>
<li>The model is trained using convolutional neural network uses the gesture data
in database with phrases corresponding to the given gesture. </li>
<li>If the sign signal from the feed matches the trained gesture, the phrase is shown as text on the screen. </li>
<li>This text is transferred as string and converted to speech using suitable API in mp3 format.</li>
</ul>
</P>
<div class="image">
<img src="images/GISA/flowchart.jpg">
</div>
<p><b>RESULT</b></p>
<P>
<ul>
<li>Accuracy of 100% was obtained on numeric(0-9) gestures.</li>
<li>Accuracy of 90% was obtained on alphabet gestures trained for 10 letters(a,g,h,l,o,q,v,w,y,z)</li>
</ul>
</P>
<div class="image">
<img src="images/GISA/3.png">
</div>
</div>
</body>
<script src="js/jquery.min.js"></script>
<script src="js/bootstrap.min.js"></script>
</html>