1. Introduction Microsoft HoloLens, known under development as Proj Project ect Baraboo Baraboo,, is a pair of
mixed reality head-mounted smartglasses developed and manufactured by Microsoft. HoloLens is essentially a holographic computer built into a headset that lets you see, hear and interact with holograms within an environment such as a living room or an office space. It is based on Augmented reality, Augmented reality A!" is a live direct or indirect view of a physical, real-world environment whose elements are augmented or supplemented" by computer-generated sensory input such as sound, video, graphics or #$% data. &he history of augmented reality can be traced back to '(() and work undertaken by Professor Tom Tom Caudell as part of a neural systems pro*ect at +oeing. &his pro*ect was
focuse focused d upo upon n findin finding g new ways ways to help help the company companys s engine engineeri ering ng proces processs and involved the use of virtual reality. Augmented reality is the blending of virtual reality and real life, as developers can create images within applications that blend in with contents in the real world. ith A!, users are able to interact with virtual contents in the real world, and are able to distinguish between the two.
irtual !eality or irtual /nvironments is a computer simulated environment that give givess the the user user the the expe experi rien ence ce of bein being g pres presen entt in that that envi enviro ronm nment ent.. It is a 01imensional computer generated environment. ! provides the effects of a concrete existe existence nce without without actual actually ly having having a concret concretee existe existence. nce. ! not only only provid provides es immersions of vision but also of sound and tactile feedback. feedback . +asically, ! ! is a theory based on the human desire to escape the real world boundaries and this is done by embracing the cyber world. It is a new form of human machine interaction that is beyond keyboard, mouse or even touch screen for that matter. It is a means by b y which one can interact with full visual immersion.
2. 3D Holographic Technology Holography is a diffraction-based coherent imaging techni2ue in which a complex three-dimensional ob*ect can be reproduced from a flat, two-dimensional screen with a complex transparency representing amplitude and phase values. It is commonly agreed that real-time holography is the ne plus ultra art and science of visuali3ing fast temp tempor oral ally ly chang changin ing g 0-1 0-1 scen scenes es.. &h &hee inte integr grat atio ion n of the the real real-t -tim imee or elect electro ro-holographic principle into display technology is one of the most promising but also challenging developments for the future consumer display and & market. 4nly holography allows the reconstruction of natural-looking 0-1 scenes, and therefore provides observers with a completely comfortable viewing experience. A HoloLens will use holographic holographic technology to pro*ect pro*ect large-scal large-scale, e, high-resolut high-resolution ion images images onto onto a variet variety y of diffe different rent surfaces surfaces,, at diffe different rent focal distan distances ces,, from from a relati relatively vely smallsmall-sca scale le pro*ec pro*ectio tion n device device.. &o underst understand and the technol technology ogy used used in HoloLens, we must understand the term 5Hologram6, and the process of making and pro*ecting holograms. Holography is a techni2ue that allows the light scattered from an ob*ect to be recorded and later reconstructed. &he techni2ue to optically store, retrieve, and process information. &he holograms preserve the 0-1 information of a holographed sub*ect, which helps to pro*ect 01 images.
2.1. Holograms A hologram is a physical component or device that stores information about the holographic holographic image. 7or example example a hologram hologram can be a grating recorded recorded on a piece of film. It is especially useful to be able to record a full image of an ob*ect in a short exposure if the ob*ect or space changes in time. Holos means 8whole9 and graphein means 8writing9. Holography is a techni2ue that is used to display ob*ects or scenes in three dimensions. &hese 01 images are called Holograms. A $hotographic record produced by illuminating the ob*ect with coherent coheren t light as from a laser" and, without using lenses, exposing a film to light reflected from this ob*ect and to a direct beam
of coherent light. hen interference patterns on the film are illuminated by the coherent light a three-dimensional image is produced.
3. Advantages of Holographic Projection &he interest in 01 viewing is not new. &he public has embraced this experience since at least the days of stereoscopes, at the turn of the last century. :ew excitement, interest, and enthusiasm then came with the 01 movie cra3e in the middle of the last century, followed by the fascinations of holography, and most recently the advent of virtual reality. !ecent developments in computers and computer graphics have made spatial 01 images more practical and accessible. ;odern three-dimensional 9019" display technologies are increasingly popular and practical not only in computer graphics, but in other diverse environments and technologies as well. A concurrent continuing need is for such practical autostereoscopic 01 displays that can also accommodate multiple viewers independently and simultaneously. A particular advantage would be afforded if the need could be fulfilled to provide such simultaneous viewing in which each viewer could be presented with a uni2uely customi3ed autostereoscopic 01 image that could be entirely different from that being viewed simultaneously by any of the other viewers present, all within the same viewing environment, and all with complete freedom of movement therein. A high resolution three dimensional recording of an ob*ect. Another feature is that these are glasses free 01 display. &his 01 technology can accommodate multiple viewers independently and simultaneously, which is an advantage no other 01 technology can show. &he 01 holographic technology does not need a pro*ection screen. &he pro*ections are pro*ected into midair, so the limitations of screen are not applicable for 01 holographic display.
3.1. icrosoft Holo!ens HoloLens is essentially a holographic computer built into a headset that lets you see, hear, and interact with holograms within an environment such as a living room or an office space. ;icrosoft has built the headset without the need to be wirelessly
connected to a $<, and has used high-definition lenses and spatial sound technology to create that immersive, interactive holographic experience. &he HoloLens comes with semitransparent holographic lenses which generate multidimensional full-colour holograms. &hat means its not going to be pro*ecting images into a room that everyone can see. Its cutting edge stuff, but its not 2uite that advanced yet. +asically HoloLens is a high-tech computer system that can be wearable and works according to your gestures with hands, eyes, etc.
Fig. 3.1 (HoloLens)
As seen in above fig. 0.', &hat is actual picture of wearable augmented reality from ;icrosoft named by HoloLens. &his is the first holographic computer which is running on indows '). It is completely unattached as no wires, phones or computers needed, it is a computer itself. &he premier device for indows Holographic, Microsoft HoloLens is a smart-glasses headset that is a cordless, self-contained indows ') computer. It uses various sensors, a high-definition stereoscopic 01 optical head-mounted display, and spatial sound to allow for augmented reality applications, with a natural user interface that
the user interacts with through ga3e, voice, and hand gestures.
)'?, but was conceived earlier as the original pitch made in late >))@ for what would become the inect technology platform. It was introduced with operating systems, such as Android, i4% and 4% B on April ?, >)'C. ;icrosoft has targeted HoloLens for release =in the indows ') timeframe,= with the ;icrosoft HoloLens 1evelopment /dition to begin shipping ;arch 0), >)'C, ;icrosoft has not set a time frame for consumer availability of HoloLens, with HoloLens chief inventor Alex ipman stating that HoloLens will have a consumer release only when the market is ready for it.
". #or$ing of Holo!ens ;icrosoft hololens has user interface so it takes voice, ga3e and gestures as input command. &han internal computer works on input command. :ow pro*ection of hologram, for pro*ection hololens use the HD/ head up display" method two nanopro*ector located at each side of head and semi transparent visor which reflect the image as light on users eye. ;icrosoft explains the holographic element in this wayE 8&he key to a great holographic experience holograms that are light point rich, i.e. have a high holographic density, and are pinned or anchored to the world around you. &o achieve this, HoloLens has been designed for optimal holographic density of >.? radiants. &he more radiant and light points there are, the brighter and richer the holograms become.9 e here divide it in three parts to make easy to understand, in one of them we study the ma*or hardware parts of it, and specification than we will move to the real world example of augmented reality based HoloLens.
".1. Parts of Holo!ens It have a ma*or six parts those are bone of this product Camera, Computer, Lenses, Vent, Sensor, Buttons. Let us study them one by oneE %amera & &he pro*ect HoloLens depth camera has a field of vision that spans '>) by
'>) degree, so it can sense what your hands are doing even when they are nearly outstreached. %omputer & HoloLens is not *ust a visor connected to a computer, it is a computer on
its own. HoloLens contain <$D, battery, #$D and first of its kind H$D holographic processing unit". 'F sensors flood the brain of the device with terabyte of data every seconds. !enses & ;icrosoft HoloLens has two display. &hey are transparent so that wearer
can see the real world behind virtual ob*ect. &o create pro*ect HoloLens image, light
particles bounce around millions of times in the so called light engine of the device. &hen the photons enter the two lensesone for each eye", where they ricochet between layers of glasses before finally hitting of wearer eye. 'ent & &he device is more powerful than a laptop but won6t overheat- warm air flows
to the sides, where it vents up and out. (ensor & %ensor track where the wearer is looking and ad*ust the display. ;otion
sensor detect wearers movement. &he sensor can also see wearers hands, the hands are an input systemE user can interact with whatever he sees by *ust touching it. earer also give gesture as input sensor enables the tracking of user movement. )uttons & 4n the right side buttons allow user to ad*ust the volume and to control the
contrast of the hologram.
".2. (pecification of Holo!ens *ptics
Fig. 4.2.1. Optical view of HoloLens
%ee through holographic lenses aveguides"
> H1 'CE( light engines.
Automatic pupillary distance calibration.
Holographic !esolution E >.0 total light points.
Holographic 1ensityE G >.? radiants lights point per radian".
(ensors
Fig. 4.2.2. Sensors of HoloLens
' I;D
environment understanding cameras
' depth camera
' >;$ photo H1 video camera
;ixed reality capture
microphones
' ambient light sensor
Human +nderstanding
%patial sound
#a3e tracking
#esture input
oice support
Input , *utput , %onnectivity
+uilt-in speakers
Audio 0.?mm *ack
olume updown
+rightness updown
$ower button
+attery status L/1s
i-7i F)>.''ac
;icro D%+ >.)
+luetooth .' L/
Po-er
+attery Life >-0 hours of active use Dp to > weeks of standby time 7ully functional when charging
$assively cooled no fans"
Processors
Fig. 4.2.3. Motherboar of HoloLens
Intel 0> bit architecture with &$; >.) support
#eight
?@(g
emory
C#+ 7lash
>#+ !A;
".3. eal/life -or$ing of Holo!ens &he HoloLens comes with semitransparent holographic lenses which generate multidimensional full-colour holograms. &hat means its not going to be pro*ecting images into a room that everyone can see. Its cutting edge stuff, but its not 2uite that advanced yet. In much the same way as #oogles ill-fated #lass experiment, the HoloLens will inter*ect virtual elements onto your vision. &hat means its different to virtual reality headsets such as the H&< ive, 4culus !ift, and $laystation !. &hese ! headsets immerse you in a fully simulated world, whereas the HoloLens uses the real world as a canvas on which to overlay virtual elements. ;icrosoft explains the holographic element in this wayE =&he key to a great holographic experience is holograms that are light point rich, i.e. have a high holographic density, and are pinned or anchored to the world around you. &o achieve this, HoloLens has been designed for optimal holographic density of >.? radiants. &he more radiants and light points there are, the brighter and richer the holograms become.= Dnlike #oogle #lass then, ;icrosofts A! headset will create virtual 01 models that, thanks to the HoloLens various cameras and sensors, interact with the environment youre in. &he in-built speakers that sit above your ears create sound based upon where each hologram is in relation to your position, making for an even more immersive experience.
#hat -ill you 0e a0le to do -ith Holo!ens 7rom the sounds of it, 2uite a lot. ;icrosoft presented some of the most interesting potential uses in a video, which you can see above. Among the most interesting, HoloLens will be able to let you view and interact with work pro*ects such as assembling 01 models, play games like ;inecraft, video chat with hologram versions of %kype contacts, and even watch live content.
An on-stage demonstration further emphasised the ability to create 01 ob*ects, from assembling to choosing the colours, all using simple gestures that looks v ery Intel !eal%ense.
Fig. 4.3.1. !la"ing #inecraft ga#e.
4ne of the most fascinating uses, at least for the folks at :A%A, which collaborated with ;icrosoft in the making of HoloLens, is the potential to control the ;ars rover )'? +uild developer conference, we got to see other ways HoloLens could be used. &he company treating us to demos of physiology students exploring the human anatomy, a !aspberry $i powered robot with HoloLens support, and how
architects can use the augmented reality elements to help construct buildings with indows ') at the core. +ut what about gaming with HoloLensJ ell ;icrosoft is doing that as well and the first example of what its calling mixed reality gaming was demonstrated at ;icrosofts /0 >)'? press conference. Having snapped up ;inecraft-maker ;o*ang for a cool K>.? billion, the first ;inecraft game designed for Hololens lets you pro*ect maps onto a physical table simply by saying the words, create world. &hen with your hands, you can play with items and characters. &his can be done all while another player is immersed in the ;inecraft world from a ;icrosoft %urface tablet. At a indows ') event late last year, ;icrosoft showed off a brand new demo known as $ro*ect B-!ay, which showcases mixed reality technology. An unknown wearer took to the stage wearing the HoloLens and 2uickly donned a wearable hologram, in the form of some kind of space blaster. He shot through one of the walls on the stage a few times, but then suddenly a crack started to appear and a mechanic alien burst through it. &he robots themselves know where the walls and furniture are in your space, meaning the gameplay is tailored to you. &heres options to change your weapons using voice commands and theres a tonne of different enemies that youll come up against.
Fig. 4.3.2. HoloLens !ro$ect %&'a".
&heres clearly some exciting possibilities here and we cant wait to see what else ;icrosoft has planned on the gaming front. In late ;arch >)'C, an impressive video showcasing holoportation appeared online. &he ;icrosoft research video below" demonstrated how its possible to use the HoloLens to teleport a 01 version of yourself into another HoloLens wearers field of view. 4f course, the whole thing re2uires multiple cameras in order to work, so youre still a long way from chatting to virtual versions of your mates in your living room. +ut the video was another example of how innovative ;icrosofts headset has the potential to be. Along with the launch of the HoloLens developer edition came news of the first confirmed games and apps for the headset. ;icrosoft confirmed that the dev kit would come with seven pre-installed A! experiences. 4n the app side, theres Holo%tudio, %kype, and Holo&our, while games include 7ragments, oung
In ;arch >)'C, ;icrosoft showed off a seriously cool new app called Actiongram, which it plans to launch in the summer. &he storytelling app will allow developers to create videos featuring holographic effects for use with the headset.
Fig. 4.3.3 Holographic platfor#
. Advantages of Holo!ens
/asy to wear and use.
%ensitive and responsive to the presence of people.
Hololens can be used in army battlefield, where detailed instruction can be given to the untrained person in the midest of combat.
A spectacle based computer to reside directly
4n your eyes rather than your pocket.
. Dis/advantages of Holo!ens
It may lead to accident while driving.
$rivacy of people may break due to new glasses.
4. Augmented eality Augmented reality A!" is a live direct or indirect view of a physical, real-world environment whose elements are augmented or supplemented" by computergenerated sensory input such as sound, video, graphics or #$% data. It is related to a more general concept called mediated reality, in which a view of reality is modified possibly even diminished rather than augmented" by a computer. As a result, the technology functions by enhancing one6s current perception of reality. +y contrast, virtual reality replaces the real world with a simulated one. Augmentation is conventionally in real-time and in semantic context with environmental elements, such as sports scores on & during a match. ith the help of advanced A! technology e.g. adding computer vision and ob*ect recognition" the information about the surrounding real world of the user becomes interactive and digitally manipulable. Information about the environment and its ob*ects is overlaid on the real world. &his information can be virtual or real, e.g. seeing other real sensed or measured information such as electromagnetic radio waves overlaid in exact alignment with where they actually are in space. Augmented reality brings out the components of the digital world into a persons perceived real world. 4ne example is an A! Helmet for construction workers which displays information about the construction sites.
4.1. Different from 'irtual eality. 4ne of the biggest confusions in the world of augmented reality is the difference between augmented reality and virtual reality. +oth are earning a lot of media attention and are promising tremendous growth. %o what is the difference between virtual reality vs. augmented realityJ
#hat is 'irtual eality irtual reality !" is an artificial, computer-generated simulation or recreation of a real life environment or situation. It immerses the user by making them feel like they
are experiencing the simulated reality firsthand, primarily by stimulating their vision and hearing.
Fig .1. la" with *irt+al 'ealit" gaget (Faceboo,-s Oc+l+s)
! is typically achieved by wearing a headset like 7acebook6s 4culus e2uipped with the technology, and is used prominently in two different waysE
&o create and enhance an imaginary reality for gaming, entertainment, and play %uch as video and computer games, or 01 movies, head mounted display".
&o enhance training for real life environments by creating a simulation of reality where people can practice beforehand %uch as flight simulators for pilots". irtual reality is possible through a coding language known as !;L irtual !eality ;odeling Language" which can be used to create a series of images, and specify what types of interactions are possible for them.
#hat is Augmented eality
Augmented
reality A!" is a
technology that layers computer-generated
enhancements atop an existing reality in order to make it more meaningful through the ability to interact with it. A! is developed into apps and used on mobile devices to blend digital components into the real world in such a way that they enhance one another, but can also be told apart easily. A! technology is 2uickly coming into the mainstream. It is used to display score overlays on telecasted sports games and pop out 01 emails, photos or text messages on mobile devices. Leaders of the tech industry are also using A! to do ama3ing and revolutionary things with holograms and motion activated commands.
Augmented eality vs. 'irtual eality Augmented reality and virtual reality are inverse reflections of one in another with what each technology seeks to accomplish and deliver for the user. irtual reality offers a digital recreation of a real life setting, while augmented reality delivers virtual elements as an overlay to the real world.
5. 6uture (cope of Holo!ens HoloLens is the product to enhance the virtual reality or augmented reality in real world, it is the new way to visuali3e our work, new way to collaborate and explore, the vary new way to create what we imagine. HoloLens is a new world to connect, create and explore like never before. &here are various uses and scopes for HoloLens, some of them can be categories in ma*or three lines belowE
isual diagrams would actually show up in space around the user indicating exactly what you need to do next.
&his application could even extend to the battlefield, where detailed medical instructions could be given to untrained personnel in the midst of combat.
$in holograms to physical ob*ects so user can si3e and scale them in each angle and with gestures do all new creation.
7. %onclusion &he premier device for indows Holographic, Microsoft HoloLens is a smart-glasses headset that is cordless, self-contained indows ') computer. It uses advance sensors, a high-definition stereoscopic 01 optical head-mounted display, and spatial sound to allow to augmented reality applications, with a nature user interface that the user interact with trough ga3e, voice and hand gestures that gives you ways to go beyond the screen, so see your world as a canvas, and gives you more natural way to interact. HoloLens is a thing where you can connect, create and explore like never before,
advanced optics, build in speakers, spatial sound gives you the new augmented or virtual world over real world. ithout bumping to walls you can watch :et7lix, play ;inecraft, use Auto
18. eferences '. Pandher, urmeet Singh !" March "#$%&. =;icrosoft HoloLens $reordersE $rice, %pecs 4f &he Augmented !eality Headset.= The Bitbag. !thebitbag.com& >. =;icrosoft Hololens hardware=. Microsoft . !etrieved ' ;ay >)'?. microsoft.com"
0. ;icrosoft HoloLens - Here are the full processor, storage and !A; specs, 'indo(s Central , ;ay >, >)'C windowscentral.com"
. Terr) M)erson, *le+ ipman, -eff orris, Sat)a adella !"$ -anuar) "#$/&. 'indo(s $#0 The e+t Chapter. Microsoft. 12ent occurs at #$03%0/3. !etrieved !2imeo.com&
?. Microsoft HoloLens0 Partner Spotlight (ith Case 'estern 4eser2e 5ni2ersit). Microsoft. 6 -ul) "#$/. !etrieved ( Nuly >)'?.
C. = Halo / headlines greatest holiday games lineup in Bbox history=. Microsoft e(s Center. Microsoft. $/ -une "#$/. !etrieved '? Nune >)'?. !ne(s.microsoft.com&
@. Sat)a adella, Lorraine Bardeen, 7an McCulloch !$3 -ul) "#$/&. 8ur journe) together. 12ent occurs at 9"09". !etrieved '? Nuly >)'?. !2imeo.com&
F. =Announcing the ;icrosoft HoloLens %hare our Idea campaign=. Building *pps for 'indo(s. Microsoft. $ 7ecember "#$/. !etrieved '@ 7ebruary >)'C. !blog.microsoft.com&
(. =1evelopment overview=. 'indo(s 7e2 Center. Microsoft . !etrieved ' ;arch >)'C. !de2.microsoft.com&
'). =#estures=. 'indo(s 7e2 Center . !etrieved @ ;arch >)'C. !de2.microsoft.com&
''. Microsoft HoloLens0 'hat is a hologram:. Microsoft. "; )'C. !)outube.com&
'>. 8;icrosoft
HoloLens
hardware9.
;icrosoft
retrieved
'
;ay
!de2.microsoft.com&
'0. 8;icrosoft HoloLens9. 4fficial ikipedia articles. !(i=ipedia.org&
'. 81ocuments on HoloLens9. Individual documentations on %cribd. !scribd.com&
'?. Images source E Microsoft.com
>)'?.