jfinn
/
jitsi_app_c0
Beobachten 1
Favorisieren 0
Fork 0
Code Issues 0 Pull-Requests 0 Releases 0 Wiki Aktivität
Du kannst nicht mehr als 25 Themen auswählen Themen müssen mit entweder einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.
8387 Commits
2 Branches
Struktur: 11202595bd
Branches Tags
${ item.name }
Erstelle Branch ${ searchTerm }
von „11202595bd“
${ noResults }
jitsi_app_c0/react/features/stream-effects/virtual-background/vendor
tudordan7 194d357005 feat(virtual-backgrounds) add virtual background support vor 4 Jahren
..
models feat(virtual-backgrounds) add virtual background support vor 4 Jahren
tflite feat(virtual-backgrounds) add virtual background support vor 4 Jahren
README.md feat(virtual-backgrounds) add virtual background support vor 4 Jahren

README.md

Virtual Background on stream effects

Inspired from https://ai.googleblog.com/2020/10/background-features-in-google-meet.html and https://github.com/Volcomix/virtual-background.git

Canvas 2D + CPU

This rendering pipeline is pretty much the same as for BodyPix. It relies on Canvas compositing properties to blend rendering layers according to the segmentation mask.

Interactions with TFLite inference tool are executed on CPU to convert from UInt8 to Float32 for the model input and to apply softmax on the model output.

The framerate is higher and the quality looks better than BodyPix

SIMD and non-SIMD

How to test on SIMD:

  1. Go to chrome://flags/
  2. Search for SIMD flag
  3. Enable WebAssembly SIMD support(Enables support for the WebAssembly SIMD proposal).
  4. Reopen Google Chrome

More details: