How Project Aria going to change everyday life : Facebook’s Wearable AR

Sinan Thahir
5 min readSep 18, 2020

“ Augmented Reality — Enhancing flow of everyday life ”

Courtesy : Project Aria

Facebook’s Full AR glasses are much away from reaching to our hands, but had started there road-test mapping with Cluster of sensors or to particularly say a ‘Sensory array’ debut research device in Seattle and the San Francisco Bay Area. A group of 100 Facebook employees and others getting hands on these, testing and for the thrive for data collection. The company announced the news Wednesday at its virtual Facebook Connect conference.

So what is this PROJECT ARIA ?

With Project Aria, Facebook’s Reality Labs is trying to vision a future device free flow into the everyday life expect for the pair of glasses. these are not just the ordinary glasses, but a Augmented Reality Wearable. As Facebook says these pair of glasses adds a 3D layer of useful, relevant and meaningful information on top of our physical world. they projects out examples like- “Imagine calling a friend and chatting with their lifelike avatar across the table. Imagine a digital assistant smart enough to detect road hazards, offer up stats during a business meeting, or even help you hear better in a noisy environment”. It paves the way for doing the everyday task at a better way and opens up an entirely new way of moving through the world.

Company’s Chief Scientist, Andrew Bosworth, provides an up-close look into Project Aria

Oculus Quest 2 an advanced stand-alone VR headset, is one of the Facebook’s Current Immersive Product on the market. But there AR ambition are going much a further way; The company is looking forward in creating a spatial scan of the real word called Live Map which will in-turn creates a better relation with people and other objects, giving a sense to the device.

But Facebook’s Reality Lab envisions to provide a better connectivity with no look downs to your devices. They are looking to a world where the device itself disappears in to the flow of life. Thus Project Aria is a new research project that will help us build the first generation of wearable AR devices.

Facebook CEO, Zuckerberg’s view on Project Aria.

Facebook says “To actually build glasses flexible enough to work for most face shapes and sizes, and create the software to support them, we still need several generations of breakthroughs, like systems to enhance audio and visual input, contextualized AI, and a lightweight frame to house it all”.

A visionary research tool !

Facebook puts into light that ‘The Project Aria glasses are not a consumer product, nor are they a prototype’ but a step into the future step in AR efforts. They are looking forward for a research device that will help us understand how to build the software and hardware necessary for AR glasses.

Exploded View Project Aria research wearable

The Project Aria glasses use sensors to capture video and audio from the wearer’s point of view, as well as eye movement and location data to help our engineers and programmers figure out how AR glasses can work in practice.but that information will be held on-device and not be seen by Facebook researchers before blurring the data of faces and sensitive information like car license plates.

Facebook plans to train an AI Assistant adapted for the glasses usage through the smart spatial audio technology. they also plans in refining the Livemaps; which will provide a 3D array of data and be a backbone for navigation through these glasses.They are practically improving the concept of embodied AI through these glasses.

As the first test run is set offed, Project Aria glasses are initially be made available to a limited group of Facebook employees and contractors in the United States, trained in both where and when to use the device, and where and when not to. Project Aria is most definitely not an actual pair of smartglasses. It’s a “sensor array” for those future glasses. Facebook’s post on Aria says it will have “the full sensor suite used in VR headsets for spatial awareness,” adding, “they also compute location from GPS, take high-res pictures, and capture multichannel audio and eye images”. But the intersection of the real world and the data-collecting challenges smartglasses pose sounds like an extremely tricky problem.

Privacy Matters !

Facebook is promising to take care with data on the glasses. The testers are reportedly being instructed on how to use these devices responsibly. But the glasses will be tested lots of public spaces. In privately owned public places they’re supposed to get consent before recording. The data being recorded is encrypted and then Facebook uses a “secure ingestion system to upload data from the devices to a separate, designated storage space, accessible only to researchers with approved access.”

Photo by Glen Carrie on Unsplash

Public-collected data will “not be used to inform the ads people see across Facebook’s apps,” Facebook’s Project Aria privacy guidelines say. But that also suggests that, eventually, information on AR headsets could be used to target ads. It would be dealt with in the near AR future amidst not now.

You can view the privacy policy guidelines by Facebook on clicking here.

Facebook’s Challenges !

Photo by Morning Brew on Unsplash

Facebook say’s “The biggest initial challenge they are facing is to finding a way to take all of the existing sensors necessary to make AR work, and fitting them on a pair of glasses that participants could actually wear.” not only the design specification but also a more number of problem to be solved like Heat dissipated from micro-computers used, better wireless connectivity provision, light weight frames, better battery life to run all day long, a framework for storing and indexing your virtual objects( virtual co-ordinates ) placed by the user to another user’s view, preparing a well developed navigation which see’s better and understand the surroundings ; as a wearable, the contrast ratio correction as moving from sun to dark workplaces, varying focal lengths suitable for various peoples, better field view even with the 3D layer infographics . As Bosworth says “This is a playground of challenging problems” , yes purely a many number solution is yet need to be founded.

Looking Toward the Future

Facebook in one hand is really looking for providing an evolutionary research in AR — making a better flow in the everyday life. Though the privacy matters are really a complicated weird line, if it is from Facebook. However the Facebook’s view “for a world with fewer devices and more time spent enjoying moments with family and friends, where opportunity is defined by passions, not geography or circumstance” sounds like a better tomorrow .

For more details about Project Aria, Click here

Don’t forget to Clap and respond if you liked !

--

--

Sinan Thahir

2023 and still alive, spreading sheets, ppt and tables