Welcome to CO/AI

We slow AI down so you can speed up

Our mission is to make 1,000,000 people AI Literate

Aiming to break down complex subjects into digestible takeaways. The newsletter for people who don’t know where to start.

Today’s Letter:

The Future of Video Conferencing (4 min)

Researchers Unveil Groundbreaking AI for Realistic 3D Video Calls with just your Webcam…

The Big Picture:

Redefining Video Conferencing: NVIDIA and UCSD researchers have developed an AI system transforming 2D webcam footage into realistic 3D avatars, potentially revolutionizing video calls. This 'neural 3D lifting' creates detailed avatars from any angle, offering an immersive telepresence.

• From 2D to 3D: Using AI overcomes traditional barriers by inferring 3D facial geometry from 2D video, making 3D conferencing more accessible and practical.

• Enhancing Remote Interaction: The technology includes intelligent eye gaze correction for natural eye contact, enhancing the realism and intimacy of virtual meetings.

Why It Matters:

• Accessibility and Adoption: This breakthrough simplifies the creation of 3D avatars, making high-fidelity 3D video conferencing possible with just a standard webcam, potentially integrating into mainstream video calling apps.

• Creative and Personalized Communication: The technology allows users to choose between photorealistic or stylized avatars, adding a layer of personal expression and creativity.

• Implications for Display Technology: Demonstrations using light field displays show the potential for room-scale 3D telepresence, pointing to future demand for advanced consumer 3D displays (like holograms).

Thinking Critically:

• Realism vs. Practicality: While AI-generated 3D avatars mark a significant advancement, they may not yet fully replicate the depth of in-person communication, such as microexpressions and body language.

• 2D Dominance and Hardware Limitations: The widespread adoption of 3D video calling might be hampered by the current dominance of 2D calling and the need for specialized hardware.

Ultimately, the research from NVIDIA and UCSD represents a significant step towards more natural and immersive remote communication, with AI at the forefront of transforming how we interact in the digital realm.

Read The Full Study Here: