Design of Hologram App Using Real Time 3-D Live Video Streaming
Design of Hologram App Using Real Time 3-D Live Video Streaming
Volume 6, Issue 6, June – 2021 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
Design of Hologram App using Real Time 3-D Live
Video Streaming
Amita Agnihotri, Geetakshi Srivastava
Department of Electronics and Communication Engineering
Inderprastha Engineering College, Ghaziabad, Uttar Pradesh, India
Abstract:- The propose projected system will stream The objective of this paper is to give more human
the input 2D video footage from webcam of the device elements to the conventional presentations, conferences or
into a 3D hologram while also monitoring the gesture any public event by incorporating the use of hologram. What
of the user to start or stop some processes like zoom we see on our computer and mobile screen is the 2-
in/out and stopping the stream, of which the gesture dimensional version of the world and our project aims to
recognition and control will be performed by Open improve that by converting it into a more interactive and user
CV. The stream will be available globally via twitch friendly 3-dimensional look.
platform along with OBS and the output audio and
video setup will be supported by a Raspberry Pi II. METHODOLOGY
beneath the holographic Prism. This setup will be
useful for more interactive and dynamic A. Block Diagram:
presentations, conferences and product A Computer, chosen to be a Raspberry Pi handles the
advertisements. positional input from the capacitive sensor array (treating it
like a HID and reading through a USB serial port) and will
Keywords:- Open CV, Gesture Recognition, Gesture map appropriate 3D object projections to the 2D, LCD
Control, Hologram, Raspberry Pi, Holographic Prism, screen. The aforementioned conversion will be done via
3D Live Streaming. standard graphics libraries (i.e., Open GL ES) onboard [2].
This will also be running basic program logic.
I. INTRODUCTION
As human beings, we have a tendency to identify and
interact with 3-dimensional objects more profusely. While
there are systems of Augmented and Virtual reality are
presents but in order to make them portable, they require
complex wearable which limit the user mobility. There are
also the services like Skype that can connect two individuals
from across the world but lack interaction modification with
the real time feed. Our 3-dimensional live streaming setup
combines the best of both worlds while providing an
innovative approach for display while also having the
advantages of real time video manipulation [1].
In this paper we have designed a system that converts
the 2- dimensional webcam stream from a device into a 3-
dimensional footage. The initial webcam footage will be fed
to a program using the OpenCV libraries implemented by
Python.
The OpenCV will be responsible for recording the
stream, gesture recognition as well as the gesture control. Fig 1. Block Diagram of Raspberry Pi
The output footage will then be fed to a software called OBS
for streaming the footage globally on a streaming platform, B. Hardware Diagram
which will also handle the audio input of the stream. The It represents the basic block diagram of the 3D
resultant video output will be projected on to the holographic Holographic Display Technology. It works on the
prism via an assembly of screens and a holographic prism principle of varying voltages between the two IR sensor
supported by the Raspberry Pi Platform and audio output will and receiver pairs.
be played over a server Icecast 2.
IJISRT21JUN381 www.ijisrt.com 233
Volume 6, Issue 6, June – 2021 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
Fig 2. Hardware Diagram of Holographic Display
The gesture inputs are processed by the
microcontroller (Atmega 328P) and the output is fed to
the Raspberry Pi board which processes the action to be
taken according to the given gesture. In this way we can
easily navigate through the videos without any delays.
The LCD display is used to provide part live videos to the
projector in order to get the desired 3D hologram.
This paper is analysing a frame which is constructed
to project images and videos in 3D state. A gesture
interface circuit is designed using IR sensors and
Fig 3. Flow chart for gesture control
comparators (LM2576) which is a cost effective
alternative to ready-made gesture interface boards which
A frame is constructed to project image in 3D state
are again, bulky and costly[1]. It works on the principle of
using a clear pyramid frame in an accurately designed 3D
varying voltages between the two IR sensor and receiver
reflective state. A gesture sensing board is used for raspberry
pairs [2].
pi to detect the gestures by user and then use it to forward or
rewind previous projections without even touching the panel
The gesture inputs are processed by the
[4].
microcontroller (Atmega 328P) and the output is fed to
the Raspberry Pi board which processes the action to be
In this way an efficiently 3D holographic display
taken according to the given gesture [2]. In this way easy
system with gesture interface controller is successfully
navigation can be achieved through the videos without
designed.
any delays.
IV. COMPONENTS DESCRIPTION
III. SYSTEM FLOW CHART
A. HOLOGRAPHIC PRISM:
Hologram makers, render 3D projections whether it’s
The holographic prism is a glass prism of
inside a glass tube or suspended in thin air. 3D multi
following dimensions as shown in figure 4. The prism
dimensional images enable users to interact with content in a
will be placed on top of thw screen architecture to reflect
totally unique way from a 360-degree seeing point. The way
the image that is being transmitted which will give the
to the operation of holographic projectors is the 3D image.
height element to the traditional 2-dimensional projection
and incorporate the feel of 3D.
A holographic projector utilizes part illuminations
reflected together from multiple viewing angles of the
subject in a combined form to reproduce a picture of the
subject in a 3D state.
The presented system can produce holographic
projections created through anticipated picture by refraction
through the interference design, losing barely any light, and
working with substantially more productivity. It is using a
raspberry pi controller-based system to achieve such
holographic projections.
A display is used to provide part live videos to the
projector setup in order to get the desired 3D hologram [3]. Fig 4. Dimension of the prism.
IJISRT21JUN381 www.ijisrt.com 234
Volume 6, Issue 6, June – 2021 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
Resistant to intense light: Most Holographic displays on When combine both the holographic prism and
the market require a dark room in order to project holographic video the output will look like this:
holograms. The Holographic Theater, instead, guarantees an
image that it’s clearly visible in a wide variety of
environments, being resistant to natural and intense light.
High resolution: It has high resolution that clearly
defines the 3-Dimensional view.
B. Hologram Pyramid:
The Hologram Pyramid is a technology that permits
you to see and make pictures from your telephone that
seem to coast above it with the hallucination of a 3D
holographic picture.
C. Holographic Spinning Mirror Technique:
Spinning mirror systems generate a different view Fig 6. Final 3- Dimensional Result
to each viewer depending on the angle of vision that
takes over the screen. It is used to build interactive 3D Holograms are the technological marvel that had
holo-graphics and autostereoscopic to multiple and always have been the one to become a visual feast to
simultaneous viewers around the screen. everyone. As various authors proposed various
implementation on generating holograms and
D. The Pepper’s Ghost Effect: implementing them. We came across some references
The basic gadget utilized to arrange the delusion is from various papers and based on it, our concept of the
an optical pillar splitter worked backward to consolidate holographic app is made. The multimedia technologies
two pictures towards the crowd's perspective. The pillar have a great potential to support learning and teaching as
splitter component is normally a huge, level sheet of the 3D images allow the student to understand the
common glass. certain topic easily and intuitively.
The picture of one scene is reflected from the glass To improve the presentation of teaching material in
surface towards the watchers, and the picture of a the classroom, the holographic pyramid is used to let the
subsequent scene is transmitted through the glass. The digital content to be shared in a group of people easily
stage lighting is controlled to specifically enlighten the without the use of glasses and wearable devices.
scenes, however not simply the glass, which is However, there are also some issues and challenges
imperceptible to onlookers. founding the current scenario.
E. Fan Type Hologram: The screen which causes difficulty for the user to
3D multi dimensional image fan show, 3D impact view the content on the screen as the current AR
picture and video are delivered by turning drove fans. It application is displayed in a small screen of a
can help shop proprietors spread and offer promoting Smartphone where not many information can be
content productively. displayed on. To view the virtual objects, present on the
device’s screen, users also need to always hold their
F. Holographic video: Smartphone or tablets and target their devices to an
To create a real time holographic video, we need a image targe Socially separated user experience AR
video which will be recorded and streamed on our video technologies are only available for only one user to view
streaming setup which will implement the use of green the AR object at a time.
screen and a streaming service. The video will then be
cloned and joined in the form shown below: This problem makes human-computer interaction
difficult and hard to share digital content. The
application of holographic pyramid is static and support
for exhibition displays only, where user cannot interact
with the holographic display. Although there is some
effort being made to improve the interactivity of
holographic display, for example, the addition of a
tracking sensor that allows the user to interact with the
3D objects using hand gestures. Besides that, in
Smartphone are used for the interaction.
FIG 5. L AYOUT OF IMAGES TO CREATE A HOLOGRAPHIC In this paper, we have proposed 3D output
VIDEO
generating systems taking input from Kinect 2.0 sensor
for sensing the user and the skeleton movements made
IJISRT21JUN381 www.ijisrt.com 235
Volume 6, Issue 6, June – 2021 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
by the users are tracked and the gesture made in thin air
is processed and the required action is performed.
It is an excellent innovative idea for gesture
controlling over the traditional methods used today.
Although the framework is defined precisely, sensitivity
and area defined for gesture movements are the two
critical areas to be controlled according to the system
requirements.
V. PROPOSED IMPLEMENTATION
System Specifications Fig 7. Holographic layout
Hardware Specification
Full HD Android Display
Speaker
Minimum 2Gb Ram
Uninterrupted Power Supply
Beam Splitter Glass
Metallic Outer Rig (Stand)
Connectors
Black Frame
Fig 8. Hologram Projection Pyramid
Software Specification
Android 4.1(Jelly Bean) or Higher The display projects the video from the app and the
video in the sceneis reflected on the reflective surface at
1. Hologram Layout: an angle of 45 degrees so that it shows an holographic
The holographic projection without any medium is video in it.
a technological advancement which is yet to be
Implemented. From its origin, the hologram that is 3. Full Holographic Display:
generated always based upon some sort of medium to This defined the hardware which are implemented
Projects the holograms. as shown in figure below. Inside this block consists of
android display with the app installed in it. The display
As, everyone in the world uses some sort of android act as a holographic projector with an app helps in
devices like Smartphone or tablet or even TVs, android creating holograms. The metallic rig acts as a stand with
had been impacting every industry. Our idea is to black frame forms the outer surface with a single
develop an app that converts the normal video call app viewport which helps in viewing holograms with more
into a holographic video call app. accuracy. As the black outer frame blocks the outer
atmosphere lights entering inside.
This app combines the concept of video call with
hologram. The app looks like a normal video call app. VI. FUTURE SCOPE
On the sender’s side, the sender selects the person CAR Driver Training at 200 mph with Future
whom he/she wants to contact. As the received side, Technology of Holographic Projection; the projected
video appears natural on the holographic display when image would be ahead of the car to allow the driver to
users are viewing through the Pyramid Prism in single get use to corner, turns, drafting and driving next to
view point. other cars.
The app made specifically converts the live video Modeling Holographic Projection to Study
call into a four directional video structure so that a 3D Hurricanes and projecting these in the classrooms for
Holographic form in the receiver side based on the weather modification scientists to study. To practice
layout shown in Figure 7. Public Speaking in Virtual Reality, project the crowd in
front and getting used to talking in front of very large
2. Hologram Projection Pyramid: groups.
The holographic display is created by implementing
the Projection Pyramid as shown in figure 8. This
technique requires a combination of two main hardware
an android display that is placed bottom with the
projection pyramid placed on top of it.
IJISRT21JUN381 www.ijisrt.com 236
Volume 6, Issue 6, June – 2021 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
VII. CONCLUSIONS
Hologram is the technology of the future and with
the means of our project we want to contribute our part
in the building a better world for coming generations.
Our project has the potential to replace the age-old video
conferencing and live chats by using the futuristic and
innovative use of hologram, not only in meetings,
presentation and conferences it can also be useful in the
Fig 9. Full Holographic Display
field of 3D entertainment which is growing day by day.
Holographic Companions, when people go off to
We have used recorded videos of high quality and
work, their children and elderly parents can have a
adjusted its resolution according to the aspects of the
holographic human friend, to keep company [5].
display system used. The Raspberry Pi controls the
Holographic Projection and Accident Recreation in
interfacing and processing of user input along with the
Virtual Reality to determine what happened and prevent
microcontroller.
it in the future and enable engineers to examine the
The gesture controller board responds to be given
accident and to recognize the part failures thereby
hand gesture precisely and processes the output instantly
coming up with preventive methods in the future
by switching between the videos. This technology is
designs. Hang Gliding Training using Holographic
sizable and is feasible in comparison to other methods
Projections, learning to fly a hang glider is a dangerous
such as use of hollow table, RGB projectors, etc.
task and VR holographic simulation would be another
great application.
The use of holographic elements could be the future
of Augmented Reality applications without using bulky
The Real world uses of hologram application are
AR helmets.
endless. It ranges from Live stage shows to Military and
space application. In 2012, Snoop Dogg closed out his
REFERENCES
headlining set by bringing out a “hologram” of the
rapper Tupac Shakur which is astonishing as the rapper
[1]. Akshay Ratan, “Holography - Working Principle and
died in 1996. These kind of holograms helps in making a
Applications”, DOI: 10.13140/RG.2.1.2688.4649,
fantasy to reality.
April 2015.
[2]. Raspberry Pi: A Comprehensive Beginner's Guide to
In Marketing, the holograms help in making
Setup, Programming (Concepts and Techniques) and
advertising more realistic approach as it helps in
Developing Cool Raspberry Pi Projects by Joe Grant,
attractive more people and helps in reaching business at
ISBN-13 978-1071276136, June 2019.
greater heights. Holograms in Gaming makes simulation
[3]. Muhammad Ismail, Mat Isham, Farhan Mohamed,
like experience without need of additional gadgets.
Yusman Azimi Yusoff Mohd Khalid, Mokhtar,Bazli
Education field will be more impactful as holographic
Tomi,Ali , IEEE Conference on e-Learning, e-
teaching helps in students to understand the concept
Management and e-Services, 2017.
more in depth gaining knowledge faster and easier [6].
[4]. Shanil Anushka Fernando and Chunki Yen, “Model-
The 3D experience is easily replaced when the
Free 3D Interaction with Rotation and Swipe Gestures
holograms came into practice in terms of Entertainment
Using Kinect”,3rd International Conference on
field. Training like driving a car or accident test in car
Information Science and Control Engineering,
are easily simulated by holograms as it produces far
Guwahati, 2016.
more greater results than just numerical data. Medical
[5]. Anjali Jayaraj, Greeshma Deepak, Priyanka Kamila,
practices from surgery to scientific experiments are more
“3D Holographic Display with Gesture Controller”,
sophisticated and more accuracy of practices are done.
International Journal of Engineering Science and
Computing, April 2019.
Communication using holograms are greatly
[6]. Jinwoong Kim,Yongjun, Lim,Keehoon, Hong,Hayan
improved and helps in communicating as they are in
Kim, Joonku Hahn and Young-ju Kim “Electronic
person. Military and space applications from stealth on
Tabletop Holographic Display: Design,
enemy borders to establishing a civilization on other
Implementation, and Evaluation” article, Applied
planets are achieved using holographic technology
Science, 2019.
without spending a lot of budgets on it. From Star Wars
to Avengers End Game, all sci-fi movies have some kind
of holographic communication in it. As the development
of holographic technology, makes this into reality.
