Turn high-efficiency, high-reliability and low-power consumption system platforms into reality
With the dramatic improvements in sensor technology, there is a growing need to capture real space with high accuracy and apply it to infrastructure projects such as construction and civil engineering, as well as entertainment technologies such as AR and VR. To satisfy these demands, Sony is aiming to build a digital twin platform that aggregates the 3D data acquired from edge devices with open geospatial data to virtually reproduce real space. The data collected on this platform will be accumulated with metadata tagged by spatio-temporal AI analysis so that future simulations and predictions can be conducted. Furthermore, by sharing and visualizing data in real time through the virtual space, it will be possible to grasp and interact with real space from anywhere in a variety of scenarios, including DX in the infrastructure field.
In 2001, Sony attained a world-first by developing and implementing embedded Linux as a common operating system for various AV equipments. This enabled us to improve the efficiency of our software development and enhance the functionality of our devices. We are currently developing system software that will allow us to realize new categories of products and services through the use of robotics technology and other technologies. Our goal is to develop system reliability, system security and real-time technologies, and to combine open-source Linux kernel, middleware and the proprietary technologies. These technologies will be integrated into embedded Linux systems. We are also developing technologies to enable seamless integration between embedded Linux and the cloud, which is central to IoT devices. We are also actively contributing to OSS communities including ROS.
We are developing a system that remotely delivers reality and a real-time experience to contribute to Sony’s diverse business portfolio. The Remote System consist of (1) a Wireless System that controls not only radio access technology but also codecs and transport according to fluctuations in the network quality, (2) a Network System that improves the quality of the connection from the client to the cloud via cellular networks and the Internet, and (3) a Cloud system that enables advanced data processing such as 3D rendering, and behavior planning in the cloud while optimally orchestrating Edge/Cloud computing resources for each scenario. We are closely collaborating with the related business units in order to resolve practical challenges.
To realize a sustainable society, it is more important to constantly watch over things on Earth, detect signs of abnormal changes, and prevent them before they occur, rather than to deal with environmental problems after they occur. To achieve this, we need devices and networks that can function in mountainous and coastal areas that are not serviced by conventional communications and power-supply infrastructures. We need to be able to collect sensed data in the cloud, analyze the signs, and then feed them back to the population. To this end, Sony will comprehensively develop ultra-low-power edge AI processors, system software, edge AI development tools, ultra-wide-area sensing networks, and predictive analytics in the cloud. We will then configure a platform that we will provide at low cost. This will contribute to the prevention of environmental destruction, the detection of signs of disasters being caused by climate change, and the improvement of productivity in the agriculture and livestock industries.
The XR System technology produces 3D images and sounds as if they actually existed in the physical world, by using information sensed from real-world space and human postures in real time. It enables mixed-reality experiences that seamlessly connect the virtual and physical worlds. We are developing high-accuracy, low-latency 3D rendering technologies to attain realism, low-latency and low-power-consumption technologies for application to highly portable systems, and an SDK technology that provides a high-performance application development environment that is tightly integrated into game engines. Through the development of these technologies, we will provide new KANDO experiences that fuse the virtual and physical worlds in entertainment and professional applications.
People are spending more and more time online, connected to virtual worlds and metaverses. The security of personal data and the verification of identity are critical to safe and personalized experiences in these environments. At the same time, we are constantly reading how personal data has been stolen or misused. This further emphasizes the significance of secure digital identity systems. At Sony we are developing technologies for managing our digital identities in the online and virtual worlds, thus providing excellent convenience while maintaining a high level of security.
Beyond the hype attached to blockchain technologies, the decentralization and democratization of information can have genuine and profound impacts on the fabric of our society and how business ecosystems are built. At Sony, we are working on decentralized solutions that will give users control over their digital identities and personal data – and how this information is shared with different parties. We are also developing decentralized solutions for improving operational flows within the music industry, helping artists to manage their creative rights and royalty payments.