---
updatedAt: 2025-11-11T01:46:33.000Z
agentTools:
  projectIndex: https://docs.formant.io/llms.txt
---

# Set up real-time connections

Teleoperation and real-time displays and controls are driven by real-time connections with your device. Before you can design a functional real-time or teleoperation interface, you'll have to configure these connections.

This guide will teach you how to configure real-time connections with your device for real-time observability and teleoperation.

# Prerequisite: Create a device

Before you can configure a device's real-time connections, you must first add it to Formant. For more information, see [Create a device](https://docs.formant.io/docs/getting-started-create-a-device).

# Step 1: Navigate to real-time connections settings

1. In Formant, in the upper-left corner, open the menu and click on the device you want to configure.
2. In the upper-right corner, click the **three dots >> Configure device**.
3. Click on the **Real-time Connections** tab.

# Step 2: Set up real-time connections

Add real-time connections to the data sources you want to receive from, or send to, your robot.

> 📘 `Connection` field
>
> For all real-time connections, the `Connection` field is the user-friendly label for that particular connection.

The following connections can be made:

<Table align={["left","left","left"]}>
  <thead>
    <tr>
      <th>
        Real-time connection
      </th>

      <th>
        Description
      </th>

      <th>
        Available connection types
      </th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td>
        Video/image
      </td>

      <td>
        Image or video stream with optional encoding.  

        See below for a description of video encoding settings.
      </td>

      <td>
        API, ROS topic, hardware
      </td>
    </tr>

    <tr>
      <td>
        Twist
      </td>

      <td>
        For joystick control.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Boolean to device
      </td>

      <td>
        For button control from teleoperation UI to device.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Bitset
      </td>

      <td>
        Real-time bitset stream.
      </td>

      <td>
        API
      </td>
    </tr>

    <tr>
      <td>
        Numeric
      </td>

      <td>
        Real-time numeric stream.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        JSON string
      </td>

      <td>
        Real-time JSON stream.
      </td>

      <td>
        API
      </td>
    </tr>

    <tr>
      <td>
        Text from device
      </td>

      <td>
        Real-time text stream from your device to the teleoperation interface.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Text to device
      </td>

      <td>
        Real-time text stream from the teleoperation interface to your device.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Map
      </td>

      <td>
        Not currently used.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Location
      </td>

      <td>
        Real-time GPS stream.
      </td>

      <td>
        API, ROS topic
      </td>
    </tr>

    <tr>
      <td>
        Numeric set
      </td>

      <td>
        Real-time numeric set stream.
      </td>

      <td>
        API
      </td>
    </tr>
  </tbody>
</Table>

### Video encoding settings

The following properites are available for configuration for image and video streams:

| Property                                        | Description                                                                                                                                   |
| :---------------------------------------------- | :-------------------------------------------------------------------------------------------------------------------------------------------- |
| ROS version                                     | The ROS version of the node publishing the topic.                                                                                             |
| Enable encoding (`CompressedImage` topics only) | If set to **YES**, Formant will encode the incoming image stream to `H.264`. `Image` streams are encoded to `H.264` by default.               |
| Video quality (encoded streams only)            | Choose the resolution of the encoded video stream. Higher video quality will use more data.                                                   |
| Bitrate                                         | Desired bitrate of your video stream. If left blank, the agent will automatically determine the ideal bitrate for the selected video quality. |
| Disable adaptive quality                        | If disabled, Formant will keep the video quality consistent throughout poor network conditions.                                               |
| Clock Overlay                                   | If set to **YES**, Formant will overlay a clock in the lower-right corner of your video stream.                                               |

> 📘 Video encoding in detail
>
> For a deeper dive on video encoding, and a discussion of the relationship between bitrate, quality, and performance, see [Video encoding with the Formant agent](https://docs.formant.io/docs/video-encoding).

Once you've configured your real-time connections, click **Save** to apply your changes.

<Callout icon="👋" theme="default">
  ### If you notice an issue with this page or need help, please reach out to us! Use the 'Did this page help you?' buttons below, or get in contact with our Customer Success team via the Intercom messenger in the bottom-right corner of this page, or at [support@formant.io](mailto:support@formant.io).
</Callout>