Qualcomm’s XR (eXtended Reality) is mobile future
Extended Reality, or “XR” is not a new term. It’s an umbrella term already in use that encapsulates AR, VR and everything in between, and we like it. XR isn’t only a set of technologies but it’s also used to describe new market verticals within industrial manufacturing, healthcare education, military, engineering, retail, marketing & advertising, and emergency services.
Our vision for next wave of XR glasses is that they’re much more sleek and light weight, that are in some cases specific to certain jobs or functions. Let’s take a look at the example of the sort of functionality one would expect from XR glasses designed for “first responders”. We think they’ll contain a tremendous amount of processing, connectivity and sensors, built with new optics and projection technologies within a durable, display that can switch from being completely opaque to nearly completely transparent.
Such a headset might be equipped with very bright LED lights on the front so that first responders will never need a flashlight. It’d have many cameras, for eye, head and hand-motion tracking with a variety of passive and active cameras with fisheye lenses, recording and sensing objects even outside of your view. Connectivity will be multimode with 5G support, with full access to mission critical cloud services, and the ability for the headquarters to see and record useful information There will be other talks at AWE about these markets; the focus of this presentation will be discussing some of the multidisciplinary technical challenges that we need to solve together for this relatively new market to reach its full potential
- Firstly, we think they’ll be comfortable, and built with new optics and projection technologies within a durable, semitransparent AR display.
- They’ll have many cameras, for eye, head and hand motion tracking with a variety of passive and active cameras with fisheye lenses, recording and sensing objects even outside of your view
- There will be many other types of sensors too, some of which are already in today’s smartphones but some will be new for AR glasses like these.
- Connectivity will be multimode with 5G support, with full access to mission critical cloud services, and the ability for the headquarters to see and record useful information
- They may have optoelectronic night vision imaging sensors to help see in the dark.
- We suspect that they could also act as binoculars when useful to do so, by utilizing several different telephoto lenses on the front of the glasses and enlarging that view in a manner that’s perhaps in similar way that zoom camera viewfinder works on smartphones.
- It may be possible to see floor layouts and track your position in a building for easy navigation.
- Such glasses may contain microphones that are able to detect sounds better than the human ear, and alert you when necessary.
- They may also be able to detect a foreign language and translate it real time for high quality audio playback using bone conduction transducers and directional speakers
- Night vision through infrared camera
- Heat vision through infrared camera
- See something far away with a telephoto lens
- See poisonous gas or flammable materials through environmental sensors
- See through walls, floor layouts, your position in a building through computer vision and downloading data. Automatic navigation for the safest route in dangerous areas or to find the electric panel.
- Know exactly where you are with motion tracking and VIO through fisheye camera.
- SOS light or beacon
- Detect a baby crying or to real-time translate another language with mics
- Monitor your own health through pulse sensors
- Share what you see back to headquarters with RGB cameras
- LED lights on the front to help you see out.