Sony City Osaki

Sony Group Corporation

4 weeks between August 24 and September 25

You may be involved in the following roles:
A：
Conduct applied research and development of generative AI technologies in the entertainment domain (Film, Games, Anime).
① Video Generation AI (Live-action, CG, Anime)

• Development of applied technologies for video generation AI practical for film production

② Image Generation AI (Anime)

• Design and implementation of image generation models and production workflows specialized for Anime production

③ Script analysis and video generation technologies to improve production efficiency and expand creativity in the visual business

B：
(1) Image recognition
Multimodal video/image understanding using Vision+Language and foundation models. Arbitrary object detection and recognition, Raw image recognition, quantization, and pruning for H/W optimization.
(2) Human body recognition
Face, Body, and Hand recognition including detection, identification, pose estimation and segmentation. We have commercialized many products such as cameras, robots, smartphones, and TVs.
(3) Creation AI for entertainment
Motion generation for 3DCG characters. Motion generation via multimodal information such as voice & music(facial expressions and whole body). We have a track record of deploying them to Anime production workflow. Motion transfer among arbitrary character models, Semantic understanding of motion, and its similarity
(4) Core AI
Arbitrary problem solving with Reinforcement Learning, Genetic Algorithms, and Bayesian optimization. Includes Motion filter/generation to make motion physically plausible, including developments of the simulation environment

C：
Research and development of speech and language understanding/generation technologies for game, music, movies and anime. Speech recognition, speech synthesis, large language model and its application to downstream tasks like machine translation etc.

Experiences and skills that can be utilized in A's work：
【Required Skills and Experience】

• Experience using deep learning frameworks (e.g., PyTorch)
• Coding ability using Python

【Preferred Skills and Experience】

• English proficiency to read research papers and replicate experiments, along with implementation skills
• Experience writing research papers (presentation at academic conferences is highly desirable)
• Experience in image/video generation for creative fields such as anime, film, games, and VFX
• Experience using creative tools (Blender, Maya, 3ds Max, Adobe CC, etc.)
• Strong passion for the anime and entertainment industries

Experiences and skills that can be utilized in B's work：

• Expertise in Machine Learning, including Deep Learning, Reinforcement Learning
• Programming skills in C,C++,Python and DNN frameworks

【Preferrable to have experiences on below】

• Machine Learning for image recognition/understanding.
• Fuencly in English for reading and understanding academic papers.
• Deep Learning framework, compression techniques (Quantization, Pruning, Distillation, etc.)
• 3DCG, Geometries、 LLM&VLM, donwstream task implementation on foundation models.
• Motion generation w.r.t. physics, kinematics (forward/inverse)
• Music/Voice feature alignment to Motion or Image/Video

Experiences and skills that can be utilized in C's work：

• Expertise in machine learning, , reinforcement learning, and statistical learning
• Programming skills in C/C++/Python/MATLAB and DNN frameworks

【You may be interested in any of the following】

• Experience of developing speech, and language processing technologies.
• Applying machine learning to speech, and language processing fields.
• English and Mathematical literacy for understanding academic papers.

Sony City Osaki

Sony Group Corporation

August 24 to September 18

As an engineer, you will be assinged to develop of applied technologies to pave the way for new businesses in Content Creation and Interactive Entertainment.
Specifically this includes
①Technology to support immersive experiences for Location Based Entertainment
②Development of application software and cloud solutions for animation production
③Immersive Live Technology

• Development of production, distribution, and operation technologies for interactive live content leveraging real-time rendering on game engine and audience behavior and emotion through sensing.

Person who has one or more of below

• AI technology application development skills (Large-Scale Language Model, Image/Video Generation)
• Computer system, Software programming and design skills (C++/C#, Java, JavaScript/TypeScript, Unity, Unreal Engine, Python, etc.)
• Ability to rapidly prototype using client applications, web applications, OSS, open platforms, etc.
• Ability to develop AWS/Azure cloud systems
• Multimodal integration development skills (CG, motion/animation, voice synthesis, etc.)
• Experience in developing AI model learning datasets, and experience in designing and implementing AI system evaluation
• Knowledge of CG animation and experience using 3D CG production tools
• Expertise in cloud system and communication protocol for metaverse and or game
• Expertise in event design that takes user experience into consideration
• Knowledge and experience in user interface, interaction, and usability
• Expertise in cognitive science, psychology, sensory engineering, and design thinking

Sony City Shinagawa/Sony City Osaki

Sony Group Corporation

2 to 4 weeks between August 24 and September 18

You may be involved in the following roles:
A：One of the following tasks is assumed:
①Software architecture development for sensing and autonomous/automated flight, driving, and behaviors:

• Surrounding space, terrain, and environment recognition using combinations of multiple image sensors
• AI and compute processing in edge devices and the cloud
• System software development aiming to realize real-time physical control

② Technology development and quality improvement for embedded Linux in Sony products

• Improvement and optimization of Linux kernel, device driver, and system configuration to speed up startup and improve real-time performance
• Development of basic technologies for building a Linux distribution that combines OSS
• Development of technologies to enhance security for Linux (Containers, access control, etc.)

B：Interns will participate in one of the following R&D projects, based on their experience and interests.
Through technologies such as digital twin, cloud computing, blockchain, and security, we aim to create new value in the entertainment domain.
①Digital Twin Creation
Development of 3D world generation and cloud platform technologies for content creation

• Development of high-precision 3D world generation using spatiotemporal data and generative AI
• Development of cloud platform technologies to integrate and manage open GIS data and proprietary 3D world data

② Web3 / Blockchain
Development of blockchain platform technologies to securely and transparently manage and utilize content and rights information

• Development of blockchain platforms for IP management of music, video, animation, and other content
• Development of technologies to record and verify content rights, usage history, and transaction history

③ Security
Development of security technologies that support content protection and safe AI utilization

• Development of next-generation watermarking and fingerprinting technologies to detect and prevent unauthorized content use and support monetization
• Development of AI security technologies to enable safe AI utilization across Sony Group

Experiences and skills that can be utilized in A's work：
* Common skills for ①~②

• Ability to read English papers and technical documents
• Computer Science degree or equivalent knowledge and experience
• Experience in software development using general purpose programming languages (Go, C++/Rust, Java, etc.)

* Skills and experience required for each business area ① - ② (at least one is expected)
①Software architecture development for sensing and autonomous control

• 5 years or more experience in one or more programming languages
• Experience in debugging and troubleshooting software on a fairly large scale
• Experience in actively and voluntarily implementing your ideas in some form and making proposals
• Experience in optimizing CPU, GPU, DSP, NPU and memory optimization
• Experience in implementing and debugging low-layer (OS kernel, drivers, compilers, memory allocators, schedulers, inter-processor communication mechanism, virtualization, etc.) software
• Experience in practical programming in five or more programming languages (Including scripting and assembly languages)
• Experience in programming in two or more of the following areas: Operating system, implementation of programming language processing systems, robotics software (Algorithms, support systems, MW), algorithms using image input, and machine learning
• Experience in system development using the cloud or network, and experience in using cloud native technologies such as eBPF and WebAssembly

② Technology development and quality improvement for embedded Linux in Sony products

• Experience in customizing Linux kernels and developing device drivers for embedded devices
• Specialized knowledge and interest in OSS and various technical elements (Processor architecture, storage, networking, virtualization, etc.) required for Linux development for embedded devices
• Knowledge, development experience and interest in OSS acceleration, bug fixing and optimization
• Experience in contributing to OSS
• An interest in adopting, combining and customizing cutting-edge software technologies and developing new technologies and applications
• An interest in git, Jenkins, GitLab and other DevOps components

Experiences and skills that can be utilized in B's work：
① Digital Twin Creation

• Programming skills in C/C++, Python, JavaScript, or similar languages
• Knowledge of or interest in 3DCG, AI development, or GIS

② Web3 / Blockchain

• Interest in blockchain and DApp application development
• Interest in IP management systems and content rights management technologies
• Programming skills in Python, JavaScript, C++, Java, or similar languages
• Knowledge or experience with OSS and cloud systems

③ Security

• Knowledge of or interest in technologies such as watermarking, fingerprinting, and AI security
• Programming skills in Python, JavaScript, C++, Java, or similar languages
• Knowledge or experience with OSS and cloud systems

Sony City Shinagawa

Sony Group Corporation

2 to 4 weeks between August 24 and September 18

The role is security analyst at the GSIRT SOC team. GSIRT is our frontline to protect the Sony Group from any envolving cyber threat. In this position, you analyze the attack and consider how to cope with the attack. You collaborate with not only Tokyo team, but also global teams all over the world. This internship program offers the opportunity to learn the forensic investigation skill then aiming to close the incident ticket from start to end.

【Required skills and experiences】
Japanese N1 level
Has the experience working as IT related work or studying IT
Has strong will to pursuit as the Cyber Security especially Incident Response analyst