jfinn
/
jvc0
Suivre 1
Ajouter aux favoris 0
Bifurcation 0
Code Tickets 0 Demandes d'ajout 0 Versions 0 Wiki Activité
Vous ne pouvez pas sélectionner plus de 25 sujets Les noms de sujets doivent commencer par une lettre ou un nombre, peuvent contenir des tirets ('-') et peuvent comporter jusqu'à 35 caractères.
10338 Révisions
4 Branches
Aborescence: 009588a3d8
Branches Tags
${ item.name }
Créer la branche ${ searchTerm }
de '009588a3d8'
${ noResults }
jvc0/react/features/stream-effects/virtual-background/vendor
Roshan Pulapura 09441c2632
feat(virtual-backgrounds) use new Open Source model 		il y a 4 ans
..
models feat(virtual-backgrounds) use new Open Source model il y a 4 ans
tflite feat(virtual-backgrounds) add virtual background support il y a 4 ans
README.md feat(virtual-backgrounds) use new Open Source model il y a 4 ans

README.md

Virtual Background on stream effects

From https://google.github.io/mediapipe/solutions/models.html#selfie-segmentation

Canvas 2D + CPU

This rendering pipeline is pretty much the same as for BodyPix. It relies on Canvas compositing properties to blend rendering layers according to the segmentation mask.

Interactions with TFLite inference tool are executed on CPU to convert from UInt8 to Float32 for the model input and to apply softmax on the model output.

The framerate is higher and the quality looks better than BodyPix

SIMD and non-SIMD

How to test on SIMD:

  1. Go to chrome://flags/
  2. Search for SIMD flag
  3. Enable WebAssembly SIMD support(Enables support for the WebAssembly SIMD proposal).
  4. Reopen Google Chrome

More details: