News Report Technology
February 16, 2023

Apple’s Patent Suggests Stylus Pencil as a Controller for Playing VR Games Through its Mixed Reality Headset

In Brief

Apple has filed a patent application for a new version of the Apple Pencil that would allow it to serve as a controller for VR gaming and apps in a mixed-reality environment.

The patent details how the Pencil’s touch surface and sensors would detect user inputs for moving objects or characters within a game.

The company has previously patented unique methods for interfacing with VR, including using a set of Apple Watches as controllers within the virtual world.

Apple’s Patent Suggests Stylus Pencil as a Controller for Playing VR Games Through its Mixed Reality Headset

The US Patent and Trademark Office recently released an Apple patent application to enhance Mixed Reality headset (Reality Pro), iPad, and Mac user interfaces. The patent envisions a future version of the Apple Pencil, resembling Stylus, that could serve as a controller for VR gaming and apps, allowing users to manage interactions with virtual agents or physical objects.

In the patent example, a user holds an Apple Pencil as a gaming controller to move objects or a character in a game called “Virtual Agent.” The Pencil can be gestured in many different ways, tapped, rolled, twirled, flicked, and swiped on its touch surface to control a VR game. The control device has sensors that detect user inputs through touch and feel on the touch-sensitive surface.

Apple’s Patent Suggests Stylus Pencil as a Controller for Playing VR Games Through Reality Pro Headset

Apple explains how to use eye or gaze tracking to control the movement of objects within a game or extended reality (XR) environment. Patent FIG. 5A depicts the first part of a content delivery system, while FIG. 5C shows the other part. FIG. 5B displays sample data structures. Patently Apple summarized this in one picture.

reality pro apple patent
Source: Patently Apple

Should the company choose to implement the idea, users who already own a Stylus might be able to avoid purchasing additional controllers for the Reality Pro headset (if the pencil in the patent is Stylus). Besides, the tech giant previously patented other methods for interfacing with virtual reality. As shown in one of its documents, the company proposes using a set of Apple Watches as controllers within the metaverse.

According to the image below and a patent from last summer, Apple Watches can track hand gestures and contact points on the palms using electrodes. This allows users to control their Apple AR/VR headset display.

Apple’s Patent Suggests Stylus Pencil as a Controller for Playing VR Games Through Reality Pro Headset
Source: Patently Apple

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on [email protected].

More articles
Agne Cimerman
Agne Cimerman

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on [email protected].

Hot Stories
Join Our Newsletter.
Latest News

From Ripple to The Big Green DAO: How Cryptocurrency Projects Contribute to Charity

Let's explore initiatives harnessing the potential of digital currencies for charitable causes.

Know More

AlphaFold 3, Med-Gemini, and others: The Way AI Transforms Healthcare in 2024

AI manifests in various ways in healthcare, from uncovering new genetic correlations to empowering robotic surgical systems ...

Know More
Read More
Read more
HyveDA Unveils X Committee In Partnership With Lido, Lists wstETH As First Collateral
News Report Technology
HyveDA Unveils X Committee In Partnership With Lido, Lists wstETH As First Collateral
November 21, 2024
Bitfinex: Bitcoin Jumps 39.5% In Nine Days, Indicating Surge In Investor Interest
News Report Technology
Bitfinex: Bitcoin Jumps 39.5% In Nine Days, Indicating Surge In Investor Interest
November 21, 2024
The Rise of the UAE as a Strategic Hub for Web3 Gaming Innovation and International Collaboration
Opinion Lifestyle Markets Technology
The Rise of the UAE as a Strategic Hub for Web3 Gaming Innovation and International Collaboration
November 21, 2024
Bybit Launches Gold & FX Treasure Hunt Competition, Offering Real Gold Rewards
News Report Technology
Bybit Launches Gold & FX Treasure Hunt Competition, Offering Real Gold Rewards
November 21, 2024