Need Help: Accessing User Media (Camera/Microphone) in Google Meet for Educational Analytics

Context & What We’ve Built Successfully
We’re building an educational behavioral analytics platform that captures student engagement data during online classes. We have a working solution with Zoom that we’re trying to replicate for Google Meet.

Our Current Zoom Implementation (Working):

  • Embed Zoom SDK directly in our web application
  • Students join meetings through our embedded interface
  • Access getUserMedia() API since we control the parent application
  • Capture video/audio frames using HTML5 Canvas
  • Run TensorFlow.js models in browser for real-time analytics
  • Teachers use our Zoom marketplace app for additional controls

The Google Meet Challenge
We’re trying to achieve the same functionality with Google Meet but hitting several roadblocks:

  • Google Meet API - Cannot embed in iframe, requires separate tab Google
  • Meet Add-ons SDK - Can create side panels and main stage apps, but they run in iframes with no getUserMedia() access
  • Google Meet Live Streaming API - Unclear if it provides individual participant video streams

Questions for the Community

  1. Has anyone successfully embedded Google Meet in their own application? What approach did you use?
  2. Alternative approaches for accessing participant media in Google Meet sessions?
  3. Google Meet Live Streaming API experiences - does it provide individual participant streams or just a composite?
  4. Workarounds for iframe limitations in Meet Add-ons - any creative solutions?

Has anyone solved similar challenges? Any insights on Google Meet’s limitations vs. alternatives would be incredibly helpful. We’re open to completely different approaches if Google Meet isn’t the right path - just need Google Meet parity

Thanks in advance for any guidance!