Core77

Sign In / Join Now

Topics
- Core77 Guides
- Product Design
- Tools
- Furniture
- Technology
- Process
- Lifestyle
- Business
- News
- Transportation
- Education
- Impact
- Reference
- Video
Sign Up For Our Newsletter
Subscribe
Features
- Features
- Designing Women
- Getting Hired
- Design Files
- True I.D. Stories
- In the Details
- Photo Galleries
- Bizarre Inventions
- Questionnaire
- Hand Tool School
- Tools & Craft
Awards
- Awards
- 2021 Design Awards;
- 2020 Core77 Design Awards Results;
Careers
- Careers
- Design Jobs;
- Talent Search;
- Design Salaries;
Firms
- Firms
- Search Firms;
- Firm Projects
Forums
- Forums
- General Discussion
- Students & Schools
- Design Employment
- Sketching
- Software & Technology
- All Forums
More...
- About Us
- Contact Us
- Advertise
- About
- Terms of Use
My Account
- My Account
- Sign In / Join Now
Follow Us
- )
- m
- Y
- '
- S
Search
e

Core77 is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Sony System for Using Any Object, Including a Banana, as a Game Controller

This could usher in a newgeneration of DIY controller designs

By Rain Noe - March 11

While Sony's PS5 comes with controllers of their own design, they're speculating that one day users might like to create their own. Their U.S. Patent #1910975.0, published last month, calls for "a system for generating video game inputs" using any old "passive non-luminous object being held by a user." To the company's thinking, anything that isn't shiny or emitting light could be used. The example cited in the patent is a banana.

So how would this work? Via a camera and projector (mounting location TBD), and software. The camera detects the object and its contours:

The software detects the user's fingers and where they obscure the object, while using machine learning to work out a rough centerline of the object to help place it in space:

Machine learning also helps to determine the object's centerpoint:

The projector shines virtual buttons onto the object's surface, tracking with the object as it's moved:

When users press the buttons, the camera and software register this as a click; when the user tilts, turns or rotates the object, that movement in relation to the object's centerline and centerpoint is translated into motive instructions for whatever the on-screen action is.

It's an intriguing idea and I'd love to see a bunch of people carving blue foam to create their personally ideal ergonomic shapes. Someone would open an Etsy shop for sure.

o

Favorite
Q

Comment
&

Sony System for Using Any Object, Including a Banana, as a Game Controller

Share your thoughts

Rain Noe

I’m a lapsed industrial designer. I was born in NYC and figured I’d die there, but a few years ago I abandoned New York to live on a farm in the countryside with my wife. We have six dogs.