Onboard Video Processing Explained

Uncrewed aerial vehicles (UAVs) are playing an increasingly critical role in the Intelligence, Surveillance, and Reconnaissance (ISR) missions that take place across complex landscapes around the globe. Whether the ISR mission is a military operation or an effort by border control agents or search-and-rescue teams, UAVs increase the situational awareness that leads to timely and effective decision-making in situations where the stakes are high. What makes uncrewed systems such a crucial tool for achieving an in-field advantage? Developed to carry a wide variety of payloads, UAVs facilitate the gathering and transmission of accurate data to key human actors in real or near-real time for a distinct in-field advantage.

Optical gimbal cameras are often the payload of choice for ISR missions. With a multitude of sensors (color and IR), laser pointers and range finders, geolocation capabilities, image stabilization, optical and digital zoom, and real-time data transmission, these cameras are ideal for a real-time data exchange that provides critical information to decision-makers in the field.  

Automated Tracking to Support the Operator and the Mission

Endurance flight times for small UAV can reach upwards of 20 hours, which means long shifts for the operator to monitor live footage—a mentally taxing endeavor. Two real-time data transmission features that can ease this burden and support those leading the mission are Moving Target Indicator and Object Tracking.

A Moving Target Indicator (MTI) is a comprehensive software function that uses onboarding image processing for data that is transmitted to the ground control station. By clearly differentiating between a moving target and background clutter, MTI provides the human decision-maker with clearer and more actionable intel. When using this feature, the operator is able to select modes such as “large object MTI” or “small object MTI” to more easily spot objects of varying sizes during an ISR mission. In either mode, these objects will not drift out of the UAV’s sights even when the angle or loitering position changes.

Large object MTI specifically helps the operator detect vehicles, drones, planes, and human targets. During a fast-paced mission, this data gives the operator a vital edge. User friendly and quick to respond, large object MTI can be easily switched to “tracking mode” on the indicated object while also continuing to observe and track other moving objects in the frame. This unique ability to toggle between multiple objects allows the operator to focus on the main target without losing coverage on additional moving objects that may provide essential intelligence.

 Small object MTI, on the other hand, assists the operator in challenging environments where the terrain is homogenous (for example, a dense forest), thus making it more difficult for a human operator to detect small or slow-moving targets. This feature automatically extracts valuable intelligence from the video stream in real time, allowing the operator to locate objects in a landscape that is complex or otherwise challenging. Small object MTI helps the operator review images at a much faster rate, allowing for swift yet accurate judgment calls that are crucial to mission success. This feature is especially beneficial in search-and-rescue missions where every passing second could be the difference between life and death. Once the target is located, the operator can zoom in to activate automatic object tracking and relay critical information to the rest of the team.

Whether the ISR  objective is executing military surveillance, locating missing persons during a natural disaster, or monitoring suspicious activity on a national border, payload cameras with Moving Target Indicator and Object Tracking features are not merely the human operator’s “eyes in the sky”—they are an advanced tool that improves situational awareness and accurate data transmission at a speed that can save lives and increase the likelihood of mission success. Edge Autonomy is committed to robust innovations that allow teams to share data and communicate more effectively, thereby improving the outcome of ISR missions in a variety of environments. Interested in the advanced optical gimbal cameras in Edge Autonomy’s Octopus line of ISR systems? Learn more about our cutting-edge solutions here.

All high performance long-range gimbals today have an onboard video processor and there are many good reasons for that. The onboard processor is a dedicated hardware processor which receives the video stream from the sensors inside the gimbal, processes the video and sends it to the datalinks. Here is a list of the key functions that the processor performs:

  • Software Stabilization of the video stream
  • Encoding of the video stream, usually to H.264 / H.265 format. After this, the video can be sent through an IP datalink
  • Object tracking. Video processor steers the gimbal to maintain the object of interest inside the video frame, even if the object is moving and the aircraft platform is moving. Scene steering is similar function, but the entire scene is kept in the video frame. Scene steering is useful when the object of interest is stationary, for example when surveillance is being done on a building.
  • Roll Correction of the video corrects the disturbances in the roll axis.
  • Moving Target Indication or MTI – this is an advanced functionality that is only available with the newest generation of high performance miniature gimbals.

There are several additional image processing functions that improve the usability of the gimbal:

  • Overlays on the video
  • Digital zoom
  • Video & Snapshot recording to internal flash drive
  • Multi camera presentation, such as picture-in-picture or image blending

What is an onboard processor?

The onboard processor is a piece of hardware, a miniature computer. In the newest generations of gimbals the onboard video processor is integrated inside the gimbal and is not noticeable from the outside. The older technology uses image processors that are external to the gimbal and essentially is a separate electronics box.

The most capable gimbals user integrated processors to deliver key benefits:

  • the smallest system size
  • the ability to access the digital video stream directly from the sensor without the need to transmit it through gimbal rotary joints
  • a more cost-effective solution since there’s no need to manufacture extra wiring harnesses and enclosures

Gimbals using external image processors generally have the following limitations that user / potential users should be aware of:

  • the requirement for additional electronics enclosures
  • an increase in the quantity of wiring
  • an increase in weight resulting in less overall payload capacity
  • a need to transmit video over the rotary joint
  • potential limitations in the type of data transmitted

Overall, these items combine to increase the price, both initially and over time, due to increase due to more parts, an increase in maintenance cost due to the complexity, and a corresponding need for greater and more skilled labor.

Apply for an Opportunity

Name(Required)
Email(Required)
In which country you are interested to work in?(Required)
Please indicate which position you're applying for:
Drop files here or
Max. file size: 50 MB.
    Consent(Required)
    This field is for validation purposes and should be left unchanged.