Apple Collecting Data to Improve Augmented Reality Location Accuracy in Maps

With the launch of iOS 17.2, Apple has outlined the Maps-related data that it is collecting in order to improve the augmented reality location function. In a new support document, Apple says that it is aiming to bolster the speed and accuracy of augmented reality features in the Maps app.

apple maps 3d feature
When using augmented reality features in Maps, including immersive walking directions or the refine location option, Apple collects information on "feature points" that represent the shape and appearance of stationary objects like buildings. The data does not include photos or images, and the feature points collected are not readable by a person.

According to Apple, Maps uses on-device machine learning to compare feature points to Apple Maps reference data that is sent to the iPhone. The camera filters out moving objects like people and vehicles, with Apple collecting just the feature points of stationary objects.

The comparison between the feature points and the ‌Apple Maps‌ reference data allows Maps to pinpoint a user location and provide detailed walking directions with AR context. Using either the AR Walking directions or Refine Location refreshes Apple's reference data to improve augmented reality accuracy.

Data that Apple collects is encrypted and not associated with an individual user or Apple ID. Apple also uses on-device machine learning to add "noise" to the feature points data to add irregular variations that prevent any "unlikely" attempt to use feature points to reconstruct an image from the data.

According to Apple, only an "extremely sophisticated attacker" that has access to the company's encoding system would be able to recreate an image from feature points, but because the data is encrypted and limited only to Apple, "an attack and recreation are extremely unlikely."

The use of AR data can be disabled to prevent Apple from collecting it. The "Improve AR Location Accuracy" toggle can be accessed in the Settings app by going to Privacy and Security and then tapping on Analytics and Improvements.

Top Rated Comments

ignatius345 Avatar
1 day ago at 03:08 pm
This is all great, but Maps is just sorely lacking in current business and point of interest information. I'm an enthusiastic user of Maps for navigation, but I end up looking up places in Google Maps quite frequently because Apple Maps has such spotty data. I hope Apple buys up or develops a really good database of this stuff and keeps it current because it's the one area in which Google Maps still has a huge advantage.
Score: 17 Votes (Like | Disagree)
jimbobb24 Avatar
1 day ago at 03:00 pm
Just let people collaborate with iPhones to scan the entire outside and then stich it together. All the people with IR and cameras can just wave their phones around when they go somewhere and boom the data will be done in no time.
Score: 9 Votes (Like | Disagree)
klasma Avatar
1 day ago at 03:12 pm

"an attack and recreation are extremely unlikely."
So you’re saying there’s a chance. ;)
Score: 8 Votes (Like | Disagree)
RealE Avatar
1 day ago at 03:17 pm

Just let people collaborate with iPhones to scan the entire outside and then stich it together. All the people with IR and cameras can just wave their phones around when they go somewhere and boom the data will be done in no time.
It would be nice for Apple to offer a crowd-sourced improvement of Maps.

You already can add public images to locations on Maps but it isn't a very easy or obvious process. That base of crowd-sourced images and reviews is what gives Google Maps an edge in certain cases.
Score: 7 Votes (Like | Disagree)
Boy261 Avatar
15 hours ago at 12:33 am
Dont know how USA is at the moment but europe maps are absolute garbage. Need to improve the overall data first in here, a lot of stuff is non existing or is in the wrong place. i mean you would think they should be better if they are partnered with tom tom.

The route to your destiny is sometimes wrong, making it longer, just a mess since ios 6, though much better than back then thats for sure, but i cant see them equaling or overtaking google in the next 5 years at least. Had good times with google maps native app back then, good data and good and smooth app just like apple maps.


Unfortunately, Apple has always shown little interest in community or collaborative matters, which is why Google Maps is more 'rich' in content than Apple Maps.
This is also a reason why they lack. In USA it would have a big impact, iphones are a solid 50% of the market. Here in europe less but it would still make a big difference.

Just the other day i went to a supermarket on my street with google directions but the supermarket was wrong placed ( rare to see but it also happens ) changed it in 1 minute. Fun thing google tracks and tells you how many people have searched that specific supermarket since you change it, 70k people already searched and it just took 1 person to do it, helped that many.

Not saying people have to basically work for them, but little changes here and there are usefull. Though at the state apple maps is now you basically would have to work for them for the map to be in order. Apple just needs to get it right.
Score: 6 Votes (Like | Disagree)
noraa Avatar
21 hours ago at 06:00 pm

What happens on your iPhone, stays on your iPhone

Yeah right. My take: if it was going to collect information either way might as well use Google Maps
Good job on not actually reading the article ?
Score: 6 Votes (Like | Disagree)

Popular Stories

ios stolen device protection

iOS 17.3 Beta Adds New Stolen Device Protection Feature to iPhone

Tuesday December 12, 2023 10:20 am PST by
The first iOS 17.3 beta rolling out to developers today includes a new "Stolen Device Protection" feature that is designed to add an additional layer of security in the event someone has stolen your iPhone and also obtained the device's passcode. Earlier this year, The Wall Street Journal's Joanna Stern and Nicole Nguyen reported about instances of thieves spying on a victim's iPhone...
New iOS 17

Apple Releases iOS 17.2 With Journal App and More

Monday December 11, 2023 10:01 am PST by
Apple today released iOS 17.2 and iPadOS 17.2, the second major updates to the iOS 17 and iPadOS 17 operating systems that came out in September. The new software comes over a month after Apple released iOS 17.1 and iPadOS 17.1, updates that brought new AirDrop, StandBy, and Apple Music features. iOS 17.2 and iPadOS 17.2 can be downloaded on eligible iPhones and iPads over-the-air by going...
Apple TV 2022 Feature Blue

Apple Releases tvOS 17.2 With Revamped Apple TV App

Monday December 11, 2023 9:58 am PST by
Apple today released tvOS 17.2, the second major update to the tvOS 17 operating system that came out in September 2023. tvOS 17.2 comes more than a month after tvOS 17.1, an update that expanded the availability of the Enhanced Dialogue feature. tvOS 17.2 can be downloaded using the Settings app on the ‌Apple TV‌. Go to System > Software Update to get the new software. ‌Apple TV‌...
iPhone 16 Side Feature

iPhone 16 Pro Rumored to Have These 12 New Features

Monday December 11, 2023 10:46 am PST by
While the iPhone 16 Pro and iPhone 16 Pro Max are still over nine months away from launching, there are already several rumors about the devices. Below, we have recapped new features and changes expected for the devices so far. These are some of the key changes rumored for the iPhone 16 Pro models as of December 2023:Larger displays: The iPhone 16 Pro and iPhone 16 Pro Max will be equipped...
iOS 17

33 New Things Your iPhone Can Do in iOS 17.2

Tuesday December 12, 2023 1:57 am PST by
Apple has made available for download its major end-of-year iPhone software update, iOS 17.2, featuring a large number of features and changes that users have been anticipating for quite a while. Below, we've listed 33 new things that your iPhone can do once you've installed the update. Check Settings ➝ General ➝ Software Update on your device to get downloading. 1. Help You Keep a Daily ...
iPhone 16 Mock Back 1

iPhone 16 Early Prototypes: What Apple's Next-Generation iPhone Will Look Like

Tuesday December 12, 2023 3:07 pm PST by
With the launch of the iPhone 15, Apple introduced design changes like a curved frame and a frosted glass back. Information acquired by MacRumors suggests that Apple's next-generation iPhone 16 will build on these updates with modifications to the buttons and the camera layout. We have details on early pre-production designs for the iPhone 16, including a look at the variants and hardware...
CarPlay Phone Call

GM Says It's Nixing CarPlay to Make Drivers Safer

Tuesday December 12, 2023 1:47 pm PST by
Earlier this year, General Motors (GM) announced plans to phase out Apple's CarPlay and Android Auto in its future electric vehicles, with the company instead relying on an infotainment system co-developed with Google. This has not been a popular decision with iPhone users, and today, GM provided some additional insight into the decision in a discussion with MotorTrend. According to Tim...
macos sonoma feature purple green

Apple Releases macOS Sonoma 14.2 With Enhanced AutoFill, New Widgets, Apple Music Updates and More

Monday December 11, 2023 10:00 am PST by
Apple today released macOS Sonoma 14.2, the second major update to the macOS Sonoma operating system that initially came out in late September. macOS Sonoma 14.2 comes six weeks after the launch of macOS Sonoma 14.1. The ‌‌macOS Sonoma 14.2‌ update can be downloaded for free on all eligible Macs using the Software Update section of System Settings. Apple has also released macOS 13.6.3...