Apple and the Metaverse: Everything We Know So Far

DecryptОпубліковано о 2022-10-15Востаннє оновлено о 2022-10-15

Анотація

Apple’s mixed reality headset is reportedly on the horizon, but will its immersive vision tie into the Web3 metaverse?

Tech giants see huge opportunity in the metaverse—the name given to a future, more immersive vision of the internet with potential real-world ties. Facebook parent Meta has bet big on the prospect, as its rebrand suggests, while Microsoft has both teamed with Meta and acquired a major game publisher as it builds momentum in the space.

What about Apple?

The iPhone and Mac maker has famously taken a unique approach to hardware and software design, even incorporating that “Think Different” ethos into its marketing. As the metaverse takes shape through new hardware and online worlds—some of which will be built with interoperable Web3 tech like NFTs—Apple may again take its own path.

Reports suggest that Apple will begin its entry into the metaverse with a pricey headset that bridges the gap between virtual environments and digitally enhanced real-world use. Can Apple take the metaverse mainstream as it has with so many past gadgets? Here’s what we know so far.

What is Apple building?

Apple’s augmented reality (AR) ambitions have been tracked by tech media for years as the firm reportedly has been building in that direction since 2015. The latest reports suggest that Apple will begin with a high-end mixed reality headset that offers both virtual reality (VR) and AR functionality, with ambitions to release other AR-specific hardware further in the future.

Bloomberg reports that Apple’s first headset is expected sometime in 2023 and may be called the Reality One or Reality Pro, based on trademark filings believed to be tied to Apple. It’s expected to be a premium device that will sell for upwards of $3,000—although noted Apple analyst Ming-Chi Kuo has pegged a price in the $2,000-$2,500 range.

In either case, it would be a notable increase over Meta’s new Quest Pro mixed reality headset, which sells for $1,500. Still, Meta’s headset offers a glimpse of the types of experiences that are possible with a mixed reality headset that can overlay digital content atop a user’s full-color, real world view—and the more lifelike interactions potentially enabled by the tech.

On one hand, it’s a fully-loaded VR headset that can access online social platforms (like Meta’s own Horizon Worlds) and play immersive games. On the other hand, mixed reality functions can be used for interacting with digital screens and models while still seeing the real world, or creating art and music with digital tools alongside physical collaborators.

Apple’s first headset will reportedly use a powerful M2 processor from the firm’s Macs and feature a wider array of cameras and sensors—including ones that can accurately recreate users’ leg movements, which Meta is still figuring out. The Information reports that retina scanners will enable biometric security for logging in, making payments, and more.

Other potential features mentioned in reports include an external screen to show the wearer’s facial expressions—a potential drain on battery life—plus custom, snap-on prescription lenses for glasses wearers to use. However, nothing has been confirmed by Apple at this point, and some reported features may not make the first device (or even later ones).

The metaverse won’t be limited to VR and AR headsets. There are already early Web3 metaverse games and applications that live on computers and mobile devices, and that will likely continue to be the case as more metaverse platforms pop up and overlap with each other, creating a more immersive, experiential internet at scale.

But mixed reality headsets are considered a key stepping stone towards that future, and what many believe will be the best way to experience metaverse worlds. After all, such headsets can amplify immersion and more naturally capture the nuances and interactions of wearers, all while retaining a link to the real world—potentially the best of both scenarios.

Such hardware is useless without compelling software, however, and Apple knows well the need for a smooth marriage of the two. Apple is reportedly developing a RealityOS operating system, per Bloomberg, along with experiential versions of apps like Maps and FaceTime, as well as avenues to consume media and games and collaborate with other wearers.

Whether Apple’s vision for mixed reality experiences and immersive online interactions matches the efforts of other builders remains to be seen, but it’s very likely that Apple will not embrace the buzzy “metaverse” term itself. Apple always uses its own unique branding—and, besides, CEO Tim Cook says he’s not a fan of the word.

"I always think it's important that people understand what something is,” Cook told Dutch outlet Bright in September. “And I'm really not sure the average person can tell you what the metaverse is."

But Cook is bullish on augmented and mixed reality tech, and the potential use cases there, telling the publication, “I think AR is a profound technology that will affect everything. Imagine suddenly being able to teach with AR and demonstrate things that way. Or medically, and so on. Like I said, we are really going to look back and think about how we once lived without AR."

What about Web3 and interoperability?

Web3 enthusiasts want to see a metaverse that’s built on open-source blockchain technology, uses NFTs to represent ownership of digital assets, and is spread across interoperable platforms that users can hop between and still utilize all of their digital stuff.

Given that, there’s been fear of centralized tech giants trying to muscle in and steer the direction of the future internet towards a direction that they can control. Interestingly, however, Meta CEO Mark Zuckerberg said that he believes an “open, interoperable” metaverse is “better for everyone,” and said that Meta will work alongside other builders far and wide.

While that’s not an explicit embrace of Web3 tech, or an acknowledgement that Meta will build a truly open metaverse platform, it is a more permissive tone than many have come to expect from the company in the past. Will Apple follow suit and build its own metaverse apps and experiences with a similar mindset?

History suggests otherwise. Apple is arguably the biggest purveyor of the “walled garden” closed ecosystem, with its locked-down iOS platform and App Store model that takes a sizable cut from developers’ app and content sales.

That’s riled up rivals like Fortnite maker Epic Games, which is waging legal battles against Apple and Google in the hopes of opening up its app ecosystems. In November 2021, Epic Games CEO Tim Sweeney said that “no company can own” the metaverse, and Epic itself is making significant moves in that arena while also not using Web3 tech itself.

Recent evidence also suggests that Apple isn’t keen on letting Web3 technology disrupt its immensely profitable business model. Apple lets App Store developers sell NFTs through their iOS apps, but still takes a 30% cut of all sales—several times more than any leading NFT marketplace. That poses a sizable challenge to many current Web3 distribution models.

But Apple isn’t necessarily anti-crypto. Many notable crypto exchanges and wallet makers have iOS apps that let users spend their cryptocurrency from an iPhone. Cook has said in the past that Apple is “looking at” cryptocurrency, plus said he owns cryptocurrency and has been interested “for a while.” Apple has also listed job openings with crypto experience required.

All of that amounts to a decidedly murky outlook on Apple embracing a Web3-centric, open metaverse. Apple may well choose to build the metaverse its own way, apart from the rest of the industry, but it's unclear if that model will continue to bear fruit in the future as Web3 adoption grows and open platforms rise in prominence.

Zuckerberg, at least, is convinced that Apple is making its own play towards the metaverse. In response to an employee question in July 2022, per a transcript seen by The Verge, the Meta CEO said that it and Apple are in a “​​very deep, philosophical competition about what direction th

Пов'язані матеріали

The Computing Power Dilemma in the Sino-US AI Rivalry

The Sino-US AI rivalry faces a fundamental bottleneck: the widening compute power gap. While Chinese AI chip companies have seen investment surges, their current focus remains largely on the less demanding inference market. The real challenge lies in the high-end training chip sector, crucial for developing cutting-edge large language models (LLMs), where Nvidia holds a near-monopoly. The compute disparity is stark. US tech giants like Meta, Google, and xAI command massive GPU clusters, enabling them to train trillion-parameter models rapidly. Estimates suggest US data center count and total compute capacity significantly outstrip China's. This "brute force" advantage allows for faster model iteration and exploration of larger parameter scales, with top US models reportedly leading their Chinese counterparts by 8 to 15 months. Chinese alternatives, such as Huawei's Ascend and others from companies like Moore Thread and Biren, are emerging. They show promise in inference and some training scenarios, closing the performance gap with mid-range Nvidia products. However, the core hurdle extends beyond raw chip performance to the entrenched software ecosystem, exemplified by Nvidia's CUDA platform. The path forward involves "walking on two legs": navigating import restrictions while heavily investing in the domestic chip industry. Though still in a catch-up phase, China's vast market, talent pool, and capital are fostering progress. The ultimate test is whether Chinese firms can build a competitive hardware-software ecosystem to power the next generation of AI.

marsbit8 хв тому

The Computing Power Dilemma in the Sino-US AI Rivalry

marsbit8 хв тому

He Kaiming's Team's New Work: After Deleting VAE and Private Data, Text-to-Image Generation Becomes Even Stronger

KaiMing He's team introduces **MiniT2I**, a minimalist text-to-image (T2I) model that challenges the complexity of mainstream approaches. It eliminates components commonly considered essential: the VAE encoder-decoder, AdaLN conditioning mechanisms, auxiliary losses, private training data, and post-training alignment stages like RL/DPO. Instead, it uses a pure flow-matching objective trained directly on RGB pixels. The model employs a simplified **MM-JiT** Transformer architecture. It removes AdaLN blocks for conditioning and instead prepends two lightweight text adapter blocks to a standard pre-norm Transformer, allowing frozen T5 text features to adapt to the denoiser. Training follows a two-stage, LLM-like paradigm using only public datasets: pre-training on LLaVA-recaptioned CC12M for coverage, followed by fine-tuning on ~120k high-quality image-text pairs. With just 258M parameters (B/16), MiniT2I achieves competitive scores (0.87 on GenEval, 84.2 on DPG-Bench), outperforming larger pixel-space models. Scaling to 912M parameters (L/16) yields results comparable to SD3-Medium (~2B parameters) in style, composition, and imagination, though it lags in text rendering and named entities due to public data limitations. Key advantages include lower computational cost (~570 GFLOPs vs. ~1379 for latent models) and architectural simplicity. Acknowledged limitations include patch boundary artifacts in pixel space, side effects of high CFG scales, resolution ceilings for sequences longer than 1024 tokens, and the aforementioned data bottlenecks. The work demonstrates that high-performance T2I generation is possible with a radically simplified, publicly reproducible baseline.

marsbit12 хв тому

He Kaiming's Team's New Work: After Deleting VAE and Private Data, Text-to-Image Generation Becomes Even Stronger

marsbit12 хв тому

The Insurance Industry Faces Its Biggest Competitor: Are Prediction Markets the "Barbarians at the Gate"?

The insurance industry, long a stable "ballast" in the economy, may face a significant challenge from the rise of prediction markets, which are beginning to function as a new form of risk hedging and insurance. Platforms like Kalshi and Polymarket are demonstrating their utility in areas traditionally dominated by insurers. Examples include Kalshi's partnership with sports insurance broker Game Point Capital to offer more cost-effective hedging for NBA team performance bonuses, and Polymarket's collaboration with real estate platform Parcl, allowing users to hedge against housing price fluctuations in major US cities. A New York bar also used Kalshi to hedge a marketing promotion tied to an NBA game outcome, highlighting prediction markets' potential for small business risk management. These markets offer advantages over traditional insurance and sports betting in transparency, liquidity, and flexibility. They allow information monetization across a wider range of events, act as neutral platforms rather than direct counterparties, and provide clearer pricing. A historical precedent is the "Mattress Mack" marketing campaigns, which used sports betting for large-scale customer refunds, but prediction markets offer a more systematic and accessible model. Experts like SIG CEO Jeff Yass see their potential for efficient, parameter-based risk sharing, such as for weather-related property damage. However, challenges remain, including liquidity issues, unclear regulatory boundaries, and potential manipulation of event outcomes. Despite these hurdles, prediction markets represent a growing competitive force for both traditional gambling platforms and segments of the insurance industry.

marsbit13 хв тому

The Insurance Industry Faces Its Biggest Competitor: Are Prediction Markets the "Barbarians at the Gate"?

marsbit13 хв тому

Insurance Industry Faces Its Biggest Competitor: Are Prediction Markets the 'Barbarians at the Gate'?

"Insurance Industry Faces New Rival: Are Prediction Markets the 'Barbarians at the Gate'?" Prediction markets, exemplified by platforms like Kalshi and Polymarket, are emerging as potential disruptors to the traditional insurance industry by offering alternative risk-hedging mechanisms. These markets allow users to bet on specific event outcomes, effectively creating a form of customizable, on-demand insurance. Key examples highlight this shift. In sports, Kalshi partnered with insurance broker Game Point Capital to provide NBA teams with more affordable options to hedge performance bonuses compared to traditional insurers. In real estate, Polymarket's collaboration with Parcl lets users speculate on city-specific housing price indices, allowing homeowners to hedge against price drops or buyers against price increases. Furthermore, businesses like a New York bar have used Kalshi to hedge marketing promotions (e.g., offering free drinks if a team wins), framing the transaction explicitly as placing a "hedge." The article argues prediction markets offer advantages over traditional insurance and even sports betting in transparency, liquidity, and flexibility. They provide a wider range of event coverage, act as neutral platforms rather than counterparties, and offer clearer pricing. The piece cites historical precedents like large "refund promotion" hedges by businesses using sportsbooks but notes prediction markets modernize the concept. However, challenges remain for widespread adoption as an insurance alternative, including limited liquidity in some markets, unclear regulatory status, and potential vulnerabilities in event resolution mechanisms. Despite these hurdles, prediction markets are positioning themselves as new tools for risk management, directly challenging certain segments of the conventional insurance landscape.

Odaily星球日报19 хв тому

Insurance Industry Faces Its Biggest Competitor: Are Prediction Markets the 'Barbarians at the Gate'?

Odaily星球日报19 хв тому

Торгівля

Спот
Ф'ючерси
活动图片