Nintendo Apply For Quality of Life Patent
Nintendo Co., Ltd. have applied for an information processing patent (商願2020-072800) in Japan, which intends to motivate a user to continuously measure health information, including the user’s sleep patterns.
The calculating information process of the user’s sleep takes place over 15 steps (listed below) via a game application connecting with the information processing system which includes a sensor, terminal system (with display device), and a server capable of communicating with the terminal device via a network.
The base device (pictured below) is installed in the user’s home where-as the mobile terminal is fully portable. The base device can also charge the mobile terminal when connected with communication between both mobile and base devices also able to be performed by a communication method via a network such as a LAN or the Internet.
A Doppler sensor is included in the base device which detects biological information such as respiration and pulse, in addition to the user’s body movement.
The base device also includes a projector that projects an image on a wall surface (including a ceiling) or a screen. Such images could be to prompt the user to fall asleep or wake up, or to display an image that shows the sleep evaluation result when the user wakes up in the morning.
Further, the base device also includes a camera, speaker, and control unit. The control unit has a CPU and a memory, and can also transmit the information detected by the Doppler sensor to the mobile terminal.
The application also makes note that the base device may include an environment sensor, a display, an omnidirectional speaker, a light source, and / or an odour generating device.
Calculation of the user’s health information also takes into account the fatigue level and energy level, in addition to the aforementioned sleep index. Part or all of this health information is transmitted from the terminal system to the server. In addition, the mobile terminal stores the calculated health information in its own storage unit.
Progress of the game story in the game application is based on the results of the user’s health information. The terminal system enables the user to measure their health information as if playing a game, and as a result, the user is more motivated to continuously perform the above-mentioned action, and to measure their health information. The game process is mainly executed while the user is awake. A mini-game button (Alarm Game) is also included with its contents described as “arbitrary” and can be, for example, a puzzle game, a quiz game, or where the user performs calculations.
The mobile terminal also calculates the user’s activity information when awake, indicating the distance traveled, the time, and / or the travel method based on the position information. In addition, the mobile terminal calculates the activity information based on facts such as if the user is at work etc.
The environmental information on the mobile terminal is calculated based on the environmental sensor information detected by the environmental sensor such as acquiring information based on the environment of the user.
In addition, the emotion information is calculated based on images captured by the camera and / or the voice detected by the microphone where the mobile terminal captures the face of the user with the camera, determining the facial expression of the user, and calculating their emotion information from it. It may indicate just a positive emotion or a negative emotion. The voice of the user is received in a similar way, by the mobile terminal’s microphone, with the emotion information calculated by taking into account intensity, tempo, intonation, and the like, and also takes into account pattern changes, for example, anger, joy, and sadness.
It’s unknown whether this 61 page patent application is part of the QoL brand which Nintendo reiterated last year is still under development, but this is not related to Pokémon Sleep, which Nintendo stated is owned by The Pokémon Company.
Yurie Hattori and Masahiro Kondo are listed as the inventors. The filing date was September 24, 2019, with the application published today (May 14, 2020).
Health information calculation
(1) Time from going to bed to going to sleep
(2) Time from waking up to getting out of bed
(3) Proportion of time during which sleep is in a deep state in the period from falling asleep to a predetermined time
(4) Proportion of time during which sleep is in a light state in the period from waking to a predetermined time before
(5) REM sleep cycle
(6) Ratio of REM sleep time and non-REM sleep time
(7) Sleep time
(8) Difference between ideal sleep onset time and actual sleep onset time
(9) Difference between ideal waking time and actual waking time
(10) The number of wakings
(11) Timing of mid-wake
(12) Time of mid-wake
(13) Number of times turning over
(14) Size of snoring
(15) Sleeping environment
The select images above include (i) an example of the external appearance of the terminal system (with both base device and mobile terminal), (ii) a game image displayed on the mobile terminal when the user is awake, (iii) a diagram showing an example of a detailed display image, (iv) a game image when the user leaves the bed, (v) a game image when the user enters the bed, (vi) an example of a replay game image, and (vii) an image where the user can recognise the goodness or badness of the health information by the number of fish objects.
Thanks to anon for help with the above. The full application can be found at this link.