The code in recv function is based on PIL.

video_processor_factory: VideoProcessorBase instance classĬlass VideoProcessor(VideoProcessorBase): def _init_(self): self.style = 'color' def recv(self, frame): img = frame.to_image() # image processing code here return av.om_image(img) webrtc_streamer(key='vpf', video_processor_factory=VideoProcessor).

Then, instantiate the class and pass in the following parameters: You should call all the image processing method within this callback. The frame is an instance of av.VideoFrame.

recv: a callback method which receives and returns a frame.

init: any initialization code should be placed here.Once you are done with it, let’s create a VideoProcessor class which inherits from VideoProcessorBase with the following functions: It will render the following user interface at the left of your web application: In this case, I have set just a single task for this application. task_list = with st.sidebar: st.title('Task Selection') task_name = st.selectbox('Select your tasks:', task_list) st.title(task_name) Next, add the following code which will create a sidebar for task selection.

st.set_page_config(page_title='Streamlit WebRTC Demo', page_icon='🤖') Sidebar You can set the title and icon of the webpage by calling set_page_config function. On the other hand, threading provides thread-safety when accessing/passing variables in a callback. It will be used to construct a frame from a PIL.Image or a numpy array. ImportĪdd the following import statement at the top of the file: import streamlit as st from streamlit_webrtc import webrtc_streamer, VideoProcessorBase, RTCConfiguration import av import threadingĪv contains Pythonic bindings for FFmpeg’s libraries. Required when connecting to a TURN server.In the same working directory, create a new file called app.py. The configuration object also support the username andĬredentials properties for securing the access to the server. TURN server has the hostname and is running on Snippet illustrates a sample configuration for a RTCPeerConnection where the RTCConfiguration for your client application to use it. Once you have a TURN server available online, all you need is the correct Self-hosted applications (like the open-source COTURN project) and as cloud There are currently several options for TURN servers available online, both as The term stands for Traversal Using Relay NAT,Īnd it is a protocol for relaying network traffic. Traffic between peers, since a direct socket is often not possible between theĬlients (unless they reside on the same local network).

For most WebRTC applications to function a server is required for relaying the

Webrtc turn config