Are you curious about superimposition and haptic communication? Don’t know what smart glasses are? What is Augmented Reality and Virtual Reality? Don’t understand all these digital trends? But want to catch up? … Don’t worry, breathe, stay calm. We are here to help you.

So you’ve heard something about AR / VR / MR and would like to know more. For most people, this is still rather an abstract and exotic technology and it is often consider as a science fiction in Hollywood movies. Animated holograms, interactive displays and virtual 3D models. In fact, all these things are already exist.

Real environment modified with computer objects you can found in different areas, starting from aviation to games. Most often, we just don’t realize it as users. Have you tried to catch Pokemon in recent years or install furniture in your room through the IKEA app? This is an AR, and it has even more potential uses. The technology is still under development, and many engineers and technology companies all around the world are working to improve it.

What is Augmented Reality?

Augmented reality is a technology that expands our physical world by adding layers of digital information to it. Unlike virtual reality (VR), AR does not create whole artificial environments to replace the real by virtual one. AR appears under direct view of the existing environment and adds to it sounds, videos, graphics.

A look at the physical real-world with superimposed computer images, which thereby changes the perception of reality, is the AR.

The term itself was introduced back in 1990 and one of the first commercial uses was television and military. With the development of the Internet and smartphones, AR has launched its second wave of popularity and is now linked to the interactive concept. 3D models are directly projected onto physical things or connected together in real time. Various augmented reality apps are affecting our habits, social life and the entertainment industry.

AR applications typically overlay digital animation on a special marker or using GPS on smartphones to find precise location. The supplement takes place in real time and in the context of the environment. For example, the imposition of results on live sports.

There are 4 types of augmented reality today:

• markerless AR
• marker-based AR
• projection-based AR
• superimposition-based AR

A brief history of AR

AR in the 1960s. In 1968, Ivan Sutherland and Bob Sprull created the first head-mounted display and called it the “The Sword of Damocles”. Obviously, it was a rude device that displayed primitive computer graphics.

AR in the 1970s. In 1975, Myron Krueger created Videoplace, an augmented reality laboratory. The scientist predicted the interaction of digital things through human movements. This concept was later used for certain projectors, camcorders and screen silhouettes.

AR in the 1980s. In 1980, Steve Mann developed the first laptop called the EyeTap, designed to wear it in front of the eyes. It recorded the scene to superimposed effects on it, and showed it to a user who could also play with his head movement. In 1987, Douglas George and Robert Morris developed a prototype of a heads-up display. He displayed astronomical data over the real sky.

AR in the 1990s. The year 1990 was marked by the appearence of the term “augmented reality”. The first definition came from Thomas Cowell and David Mizell, Boeing researchers. In 1992, Louis Rosenberg of the United States Air Force created an AR system called “Virtual Fixtures”. In 1999, a team of scientists led by Frank Delgado and Mike Abernathy tested new navigation software that generated runway and street data using helicopter video.

AR in the 2000s. In 2000, Japanese scientist Hirokazu Kato developed and published the ARToolKit – open source SDK. He was later set up to work with Adobe. In 2004, Trimble Navigation introduced an external helmet-mounted AR system. In 2008, Wikitude created the AR Travel Guide for Android mobile devices.

AR today. In 2013, Google made a beta test of Google Glass – with Internet connection via Bluetooth. In 2015, Microsoft introduced two completely new technologies: Windows Holographic and HoloLens (AR glasses with many HD hologram sensors). In 2016, Niantic launched the Pokemon Go mobile game. The app blew up gaming industry and earned $ 2 million in just one week.

How augmented reality works.

A certain range of data (images, animation, videos, 3D models) can be used for AR, and people will see the result in both natural and synthetic light. In addition, users are aware that they are in the real world, which is simply augmented by a computer, unlike virtual reality (VR).

AR can be displayed on different devices: screens, glasses, handheld devices, mobile phones, head-up displays. It includes technologies such as S.L.A.M. (Simultaneous localization and mapping), depth tracking (sensor data that calculates distance to objects), and the following components:

• Cameras and sensors. They collect user engagement data and submit it for processing. Cameras on the devices scan the environment, and with the help of this information the device finds physical objects and generates 3D models. These can be special purpose cameras, such as Microsoft Hololens, or regular smartphone cameras for photos and videos.
• Processing. Ultimately, AR devices should act as small computers as modern smartphones already do. Similarly, they require a processor, GPU, flash memory, RAM, Bluetooth / WiFi, GPS, etc. to be able to measure speed, angle, direction, orientation in space.
• Projection. It works by means of a miniature projector on the headsets AR, which receives data from the sensors, processes them and displays images or 3D models on the surface for viewing. In fact, the use of projections in AR has not yet been fully developed so that it can be used in a commercial environment: goods or services.
• Reflection. Some AR devices have mirrors that help the human eye view virtual images. Some have an array of small curved mirrors and some have a double-sided mirror that reflects light from the user’s camera and eyes. The purpose of such display trajectories is to align the image correctly.

Types of augmented reality:

• Marker-based AR. This type connected with image recognition, because in this case a special visual object is required and a camera to scan it. It can be anything from a printed QR code to special characters. In some cases, the AR also calculates the position and orientation of the marker to place the content. In this way, the marker initiates digital animations for viewing by the user, and as a result the images are transforming into 3D models.
• Markerless AR. Based on augmented reality, which uses GPS, compass, gyro and accelerometer to provide data based on the user’s location. This data then determines what AR content you find or receive in a particular place. With smartphones, this type of AR typically creates maps and directions, as well as information about nearby businesses. Apps include events and information, pop-up ads, navigation support.
• Projection-based AR. This type uses the projection of synthetic light on physical surfaces, and in some cases allows you to interact with it. These are the holograms that we’ve all seen in fantasy films such as Star Wars. Technology determines user interaction with projection based on changes in projection display.
• Superimposition-based AR. In this case, the original or partial replacement of the original image by augmented. Object recognition plays a key role here, without which the whole concept is simply impossible. We’ve all seen an example of superimposed augmented reality in the IKEA Catalog application, which allows users to place virtual furniture items from catalog in their rooms.

Augmented Reality Devices

Many modern devices already support AR. From smartphones and tablets to special gadgets like Google Glass or handheld devices. And these technologies continue to evolve. For processing and projection, AR device and hardware, first of all, use sensors, cameras, accelerometer, gyroscope, digital compass, GPS, processor, displays.

Gadgets that are suitable for augmented reality use fall into the following categories:

• Mobile devices (smartphones and tablets) are the most affordable and suitable for AR applications – starting from games and entertainment to business analytics, sports and social networks.
  Specialty AR devices are designed solely to augment reality. One example is head-up display (HUD) – sending data to a transparent display directly into the user’s view. Initially introduced to train military pilots, these devices were used in civil aviation, automotive industry, sports, etc.
• AR Glasses (or Smart Glasses) – Google Glass, Meta 2 Glasses, Laster See-Thru, Laforge AR Glasses, and more. All these devices are capable of displaying messages from your smartphone, helping conveyor workers, using hands-free content, etc.
• AR contact lenses (or smart lenses) have taken augmented reality technology one step further. Manufacturers such as Samsung and Sony have announced the development of AR lenses. Samsung is working on lenses as a smartphone accessory, while Sony designs lenses as separate devices (with features such as photography and data storage).
• Virtual retinal displays (VRD). These devices create images by projecting laser light into a person’s eye, seeking bright, high-contrast images and resolution. These systems have yet to be adapted for practical use.

Ways to use AR technology

Augmented reality can complement our daily activities in many ways. Games are one of the most popular uses of AR apps. New AR games are enhancing user-friendly features for players, some of them even promoting a more active lifestyle (Pockemon Go, Ingress). Playgrounds move from virtual spheres to real life, and players actually perform certain actions in the physical world. AR in retail can affect customer engagement and retention, as well as brand awareness and increased sales. Some features can also help customers make their purchases based on the provision of 3D models of any size or color. The real estate market can also take advantage of augmented reality through three-dimensional tours of apartments and homes.