Hardware streams can be added to a device's configuration to automatically ingest data from linux device files on the robot. Ingesting video streams from USB and IP cameras are supported.
To add a hardware telemetry stream,
- Open the Formant sidebar using the button in the top left of the screen
- Select Settings ⇒ Devices ⇒ Click on the device name
- Click the "Telemetry" tab
- Click "Add stream"
- Choose "Hardware"
For USB devices, you can simply enter the path to the linux device file. Choices will be auto-populated by a dropdown if Formant can detect one or more. Once configured, the Formant agent will automatically read the image stream from the selected USB camera, encode it to H264, and ingest it as a video stream.
IP cameras are cameras on your local network that you can connect to using RTSP or RTMP to get a video stream.
The general format of an RTSP URI of an IP camera is:
rtsp://admin:[email protected]:554/H264 rtsp://admin:[email protected]:2600/H264 rtsp://192.168.0.123:554/H264?user=admin&pass=123456 rtsp://admin:[email protected]:2600/Streaming?Channel=1
For RTMP streaming, use rtmp://:/steam/live
Some RTSP streams are mpeg-4 or jpeg. In these cases, Formant needs to decode them and re-encode them into H264. Toggle this switch to ON if the video needs to be encoded.
Our frontend decoder only supports constrained-baseline or baseline H264 encoding “Profiles”. Some IP cameras let you change to baseline profile, but some are locked to main or high. If we detect that your camera is streaming the wrong profile, we decode it, and re-encode it with the correct profile.
Some RTSP IP cameras support ONVIF Protocol. ONVIF supports discovery and Formant will populate the dropdown menu with discovered cameras on the device's network. If you are selecting a ONVIF camera from the menu, ensure Supports ONVIF is checked.
Please note that ONVIF does not apply to RTMP streams.
To add audio to a video stream, select an audio device from the audio hardware devices dropdown.
Updated about 1 year ago