The OPPO AI Center’s latest research paper was officially selected for the International Joint Conference on Artificial Intelligence (ICJAI) 2024. Moreover, OPPO also made a grand appearance with multiple cutting-edge AI innovations and features.
OPPO – IJCAI 2024
Innovative Zero-Shot Framework Brings a New Revolution to the Field of Text-to-Image Video Generation
At the IJCAI 2024 conference, OPPO AI Center’s latest research paper, “Zero-shot High-fidelity and Pose-controllable Character Animation”, was prominently featured, showcasing the company’s extensive tech expertise and continuous advancement in the AI field.
Currently, in the I2V (Image-to-Video) domain, the most common issues are inconsistent character appearances and poor detail retention. This requires vast amounts of video data for training and consuming computational resources.
To address these, the AI Center introduced PoseAnimate, an innovative zero-shot I2V framework. PoseAnimate leverages pose information to control the animation’s movements while maintaining scene content consistency.
The framework achieves its goals through three key modules:
- Pose-Aware Control Module (PACM) – integrates various pose signals into text embeddings to retain content irrelevant to the character and ensure precise alignment of movements
- Dual Consistency Attention Module (DCAM) – enhances temporal consistency, preserving character identity and intricate background details
- Mask-Guided Decoupling Module (MGDM) – improves the fidelity of generated videos by decoupling characters from the background
The OPPO team also proposed the Pose Alignment Transition Algorithm (PATA) to ensure alignment and smooth transitions of character poses. Experimental results demonstrate that PoseAnimate significantly outperforms existing advanced training methods in character consistency and detail fidelity, maintaining high temporal consistency throughout the generated animations.
Moreover, Dr. Yang Zhenyu from OPPO AI Center was invited to give a presentation at the IJCAI 2024 conference on “Generative IA for smartphone: Challenges, Opportunities and Practice of OPPO”. He shared OPPO’s practical experience with AI industry partners and academia, contributing to the global exploration of how the next generation of smartphones can responsibly and efficiently integrate AI technology.
Accelerating the Application of Generative AI Technology
The smartphone industry is entering a new era of AI phones with the rapid development of generative AI technology.
OPPO is dedicated to integrating cutting-edge AI technology into its products, delivering a smarter and more convenient mobile life experience for users.
This year, the company launched the Find X7 series and the Reno12 series 5G AI phones, showcasing its prowess in the mobile AI field. At the same time, it is accelerating the global democratization of AI Phones, aiming to bring generative AI features across its entire smartphone lineup for 50 million users within the year.
OPPO established a robust AI Center and engaged in deep collaborations with leading global tech companies, such as Google, Microsoft, and MediaTek. OPPO is committed to exploring hybrid (on-device and cloud) mobile AI technologies, driving innovative applications of AI on mobile devices.
Moreover, the company frequently participates in top-tier international IA conferences, sharing its latest AI research findings, maintaining close communication with the AI academic community, and continuously leading the industry’s development direction.
Looking ahead, the company will continue to prioritize user-driven, persistently exploring innovative applications of AI technology, to provide users with ultimate AI phone experience.
For more information, visit the official website.
Ram found his love and appreciation for writing in 2015 having started in the gaming and esports sphere for GG Network. He would then transition to focus more on the world of tech which has also began his journey into learning more about this world. That said though, he still has the mentality of "as long as it works" for his personal gadgets.
