First Public Working Draft: MediaStreamTrack Insertable Media Processing using Streams

Author(s) and publish date

Published:

Diagram illustrating where Insertable Media Processing fits into the media pipeline, allowing to process video after its gets decoded and before it gets e.g. rendered; processing can be done with JavaScript, WebAssembly, WebGPU or WebNN

The Web Real-Time Communications Working Group has published a First Public Working Draft of MediaStreamTrack Insertable Media Processing using Streams. This JavaScript API allows to process raw video, either before it gets encoded or after it gets decoded, e.g. to add effects such as background blur to real-time video.

It builds on WebCodecs to expose the bytes that a video processing program needs to operate on. An earlier version of the API is available in Chromium, with demos that illustrate its usage.

Related RSS feed

Subscribe to our news feed