With AR, Apple’s Measure app could get fast, automated measurements

With AR, Apple’s Measure app could get fast, automated measurements

The Measure app on iPhone became useful, and more accurate, once LiDAR was introduced. Now Apple has been researching bringing its Apple AR technology to make it faster and more accurate.

Apple is looking to add Apple AR technology to the Measure app on iPhone, making it more accurate and automatically annotating objects with their measurements.

In the future, pointing your iPhone camera at an object could automatically get you an on-screen notification of its measurements. It will do it through AR, and it will do it in part through Machine Learning on different types of objects.

Watch the Latest from AppleInsider TV

“Automatic measurements based on object classification,” is a newly-revealed patent application. It’s concerned with how to determine which object you’re interested in, then how measure it accurately.

The patent application is particularly broad, including “devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment.” The detail generated is based on a whole series of different sensors and measurements to do with “depth data and light intensity image data.”

“ generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation,” says Apple, “classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.”

First, AR will determine what object you’re interested in. The patent application doesn’t dwell on precisely how that determination is made. Still, you can infer that it’s similar to how Portrait mode recognizes you’re focusing on the person in the foreground.

“The generation of object detection and object measurements is facilitated in some implementations using semantically-labelled 3D representations of a physical environment,” says the patent application. “Some implementations perform semantic segmentation and labeling of 3D point clouds of a physical environment.” However it determines what you are and are not interested in measuring, this future Measure app may use “multiple, different techniques.”

“In some implementations, an object is measured by first generating a 3D bounding box for the object based on the depth data,” says Apple, “refining the bounding box using various neural networks and refining algorithms described herein.” A bounding box could start by determining the basic width, height, and depth of an object. Then the Measure app goes further by attempting to classify the object, for instance, whether it’s a chair or a TV set.

“ object is measured using different types of measurements for different object types using machine learning techniques (e.g., neural networks),” says Apple. “ types of measurements may include a seat height for chairs, a display diameter for TVs, a table diameter for round tables, a table length for rectangular tables, and the like.” Machine Learning is already able to recognize and classify objects, even from flat images. Mac image editors such as Pixelmator Pro use it to automatically label layers, for instance.

The News Highlights

  • With AR, Apple’s Measure app could get fast, automated measurements
  • Check the latest update on Security news
  • .

Disclaimer: If you need to edit or update this news from compsmag then kindly contact us Learn more

For Latest News Follow us on Google News


Latest Headlines
  • Show all
  • Trending News
  • Popular By week
Singer Kelly Price breaks the silence after her disappearance, says she almost died from Covid
Singer Kelly Price breaks the silence after her disappearance, says she almost died from Covid
She said in the TMZ interview that she had the coronavirus for more than a week before she was hospitalized. “I wasn’t feeling so well last night. … It has ...
Recap of the Surface Event & More
Recap of the Surface Event & More
We recapped the week’s Surface news and talked about our hands-on impressions of the Surface Laptop Studio and the new Surface Duo 2. We also answered your ...
Zebra Medical Vision Obtains FDA Authorization for Tool to Detect Cardiovascular Disease
Zebra Medical Vision Obtains FDA Authorization for Tool to Detect Cardiovascular Disease
“Zebra-Med’s population health solutions have already demonstrated great value in identifying patients at risk for major osteoporotic ...
The best Apple offers from around the web for Memorial Day
The best Apple offers from around the web for Memorial Day
Here’s one way to make this weekend memorable: An incredible Memorial Day sale on Apple products that’ll allow you to get yourself something special and save ...
Idaho Falls couple start business for customers to connect over coffee and crafts
Idaho Falls couple start business for customers to connect over coffee and crafts
Brandi Erickson of Idaho Falls owns AR Workshop and The Nice Spot, two separate businesses located at 395 Lindsay Boulevard. A local woman celebrates the ...
Leaders of Tonga and the Solomon Islands have had phone conversations with Xi
Leaders of Tonga and the Solomon Islands have had phone conversations with Xi
In his call with King Tupou VI, Xi said China would continue to carry out agricultural and technical cooperation projects in Tonga. He is also promising to ...
Kuo: Redesigned MacBook Air With Apple Silicon to Enter Mass Production in Third Quarter of 2022
Kuo: Redesigned MacBook Air With Apple Silicon to Enter Mass Production in Third Quarter of 2022
Kuo in a note to investors on Monday predicts Apple’s next-generation MacBook Air to enter mass production late in the second quarter or early in the third ...
Vigil Marks 44 Lives Lost for COVID in Brown County |  News, Sports, Jobs
Vigil Marks 44 Lives Lost for COVID in Brown County | News, Sports, Jobs
The vigil also honored all Minnesota lives lost to COVID with a poster board. The board contained a small drawing of a candle to represent every COVID death in ...
Release date for the new GI Joe game for PS5, Xbox One, PC, and more
Release date for the new GI Joe game for PS5, Xbox One, PC, and more
The new GI Joe game will apparently be a full “AAA” (i.e. big budget) third-person action-adventure, being made by a new Raleigh-Durham studio set up by ...
A big-budget G.I. Joe game is in the works at Wizards of the Coast
A big-budget G.I. Joe game is in the works at Wizards of the Coast
The job ads call it a “AAA 3rd Person Action/Adventure game”, as well as confirming it will be multi-platform. Qualifications mentioned in the listings for ...
Show next
Compsmag - Latest News from tech, business and health
Logo