Craig Federighi today announced ARKit 2 at WWDC 2018, which will give developers access to improved face tracking, realistic rendering, 3D object detection, persistent experiences, and shared experiences. The company gave a demo of two users sharing a virtual environment using ARKit 2, playing on a table with wooden toys and trying to knock down the other player's objects.

Apple says that ARKit 2 is a more powerful platform than the original ARKit, since it can allow multiple users to play a game or collaborate on projects together. There is also support for a "spectator mode" so that friends and family can see AR gameplay from another iOS device without participating.

arkit 2 lego
With "persistent AR," you'll be able to leave virtual objects in the real world and come back to them later. For example, you can start a puzzle on a table and come back to it another day and discover it in the same state that you left it.

ARKit 2 also extends support for image detection and tracking, making it possible to detect 3D objects like toys or sculptures, and adds the ability to automatically apply reflections of the real world onto AR objects. This makes the AR experience an even more realistic mix of the virtual and real world.

One of the notable demos at WWDC this year saw Apple bring Martin Sanders, Director of Innovation at LEGO, on stage to demonstrate a new LEGO AR iOS app that will integrate with ARKit 2 features and connect to physical LEGO sets. An entire LEGO city was shown off in the demo, allowing users to build objects, place characters, go on quests, open sets to see inside, and play with friends in the same world.

Up to four friends can play in the same set on four different iOS devices, and notably all of the virtual aspects of the LEGO AR app will be connected to physical LEGO sets. "We can save our entire world back into our physical set, and pick up where we left off later," Sanders said.

In other augmented reality news, Apple has created its own measuring app called "Measure," which can provide the dimensions of objects automatically. The company also collaborated with Pixar to create a new open file format called usdz, which enables AR experiences in many apps, like Messages and Mail.

All of these advanced ARKit 2 features will be available when iOS 12 launches this fall.

Top Rated Comments

DJTaurus Avatar
72 months ago
Is it just me or was the physical part of that Lego game completely useless?
Completely useless, gimicky and waste of time.
Score: 2 Votes (Like | Disagree)

Popular Stories

ios stolen device protection

iOS 17.3 Beta Adds New Stolen Device Protection Feature to iPhone

Tuesday December 12, 2023 10:20 am PST by
The first iOS 17.3 beta rolling out to developers today includes a new "Stolen Device Protection" feature that is designed to add an additional layer of security in the event someone has stolen your iPhone and also obtained the device's passcode. Earlier this year, The Wall Street Journal's Joanna Stern and Nicole Nguyen reported about instances of thieves spying on a victim's iPhone...
iOS 17

33 New Things Your iPhone Can Do in iOS 17.2

Tuesday December 12, 2023 1:57 am PST by
Apple has made available for download its major end-of-year iPhone software update, iOS 17.2, featuring a large number of features and changes that users have been anticipating for quite a while. Below, we've listed 33 new things that your iPhone can do once you've installed the update. Check Settings ➝ General ➝ Software Update on your device to get downloading. 1. Help You Keep a Daily ...
iPhone 16 Mock Back 1

iPhone 16 Early Prototypes: What Apple's Next-Generation iPhone Will Look Like

Tuesday December 12, 2023 3:07 pm PST by
With the launch of the iPhone 15, Apple introduced design changes like a curved frame and a frosted glass back. Information acquired by MacRumors suggests that Apple's next-generation iPhone 16 will build on these updates with modifications to the buttons and the camera layout. We have details on early pre-production designs for the iPhone 16, including a look at the variants and hardware...
CarPlay Phone Call

GM Says It's Nixing CarPlay to Make Drivers Safer

Tuesday December 12, 2023 1:47 pm PST by
Earlier this year, General Motors (GM) announced plans to phase out Apple's CarPlay and Android Auto in its future electric vehicles, with the company instead relying on an infotainment system co-developed with Google. This has not been a popular decision with iPhone users, and today, GM provided some additional insight into the decision in a discussion with MotorTrend. According to Tim...
iPhone 16 Side Feature

iPhone 16 Pro Rumored to Have These 12 New Features

Monday December 11, 2023 10:46 am PST by
While the iPhone 16 Pro and iPhone 16 Pro Max are still over nine months away from launching, there are already several rumors about the devices. Below, we have recapped new features and changes expected for the devices so far. These are some of the key changes rumored for the iPhone 16 Pro models as of December 2023:Larger displays: The iPhone 16 Pro and iPhone 16 Pro Max will be equipped...
Apple TV 2022 Feature Blue

Apple Releases tvOS 17.2 With Revamped Apple TV App

Monday December 11, 2023 9:58 am PST by
Apple today released tvOS 17.2, the second major update to the tvOS 17 operating system that came out in September 2023. tvOS 17.2 comes more than a month after tvOS 17.1, an update that expanded the availability of the Enhanced Dialogue feature. tvOS 17.2 can be downloaded using the Settings app on the ‌Apple TV‌. Go to System > Software Update to get the new software. ‌Apple TV‌...
maxresdefault

Top Five Features in macOS Sonoma 14.2

Wednesday December 13, 2023 3:21 pm PST by
When Apple releases new software, iOS updates tend to get most of the attention, and there are sometimes useful new features in Mac updates that go under the radar. That's the case with macOS Sonoma 14.2. It doesn't have flashy features like the Journal app that came in iOS 17.2, but there are a number of useful improvements that make it worth installing. Subscribe to the MacRumors YouTube ...