Accelerated GStreamer User Guide

`
ACCELERATED GSTREAMER
USER GUIDE
DA_07303-4.0 | March 18, 2019
Release 32.1
DOCUMENT CHANGE HISTORY
DA_07303-4.0
Version Date Authors Description of Change
v1.0 01 May 2015 NVIDIA Initial release.
v1.1 30 Jun 2015 mzensius Added rotation and scaling commands, other
new content.
v1.2 03 Nov 2015 emilyh Changes for 23.1
v1.3 19 Nov 2015 mzensius Added note for display export.
Updated gst-nvivafilter sample pipelines.
v1.4 17 Dec 2015 hlang Updated steps to build gstreamer manually.
v1.5 08 Jan 2016 kstone Added nvvidconv interpolation method.
v1.5 29 Jan 2016 hlang Additional syntax changes for 23.2 release
v2.0 11 May 2016 mzensius Minor change to nvgstcapture options.
v3.0 11 Aug 2016 mzensius Versioned for 24.2 release. GStreamer-0.10
content removed. Also Adds Video Cropping
example, interpolation methods for video
scaling, EGLStream producer example, and an
EGL Image transform example.
v3.1 06 Oct 2016 mzensius Minor updates to video encoder features.
v3.1.1 21 Nov 2016 mzensius Changed title of document.
V3.2 12 Jan 2017 mzensius Adds H.264/H.265 encoder documentation.
Also corrects the GStreamer-1.0 installation
procedure.
3.2 03 Mar 2017 hlang Update date/moniker for L4T 27.1 release. No
other updates.
3.3 13 Jul 2017 mzensius Minor edit to command syntax, and update of
date/moniker for L4T 28.1 release.
3.4 01 Dec 2017 mzensius Includes support for NVIDIA® Jetson™ TX1,
previously documented elsewhere. Also
includes Overlay Sink information, and
formatting enhancements.
3.5 23 Feb 2018 kstone Added support for the nvarguscamerasrc

plugin. Corrected erroneous path. Reformatted
commands for line breaks.
3.5 28 Feb 2018 hlang Update the GStreamer installation and setup
table to add nvcompositor.
Accelerated GStreamer User Guide DA_07303-4.0 | ii

3.6 20 April 2018 kstone Added prerequisites for Video Composition.
3.7 23 July 2018 jsachs Add steps to be performed when testing
Wayland based GST plugin, playing video, or
running Wayland based apps on Wayland
display server.
3.8 29 August 2018 jsachs Updates for L4T release 31 & GStreamer
version 1.14.
3.9 2 November 2018 Jsachs Updates for L4T release 31.1. Jetson TX1 and
TX2 not supported.
4.0 18 March 2019 jsachs Updates for L4T release 32.1. Jetson™ TX2 and
Jetson Nano™ supported.
Accelerated GStreamer User Guide DA_07303-4.0 | iii

TABLE OF CONTENTS
Accelerated GStreamer User Guide ...................................................1

GStreamer-1.0 Installation and Setup........................................................ 1
Decode Examples ............................................................................... 4
Audio Decode Examples Using gst-launch-1.0............................................ 4
Video Decode Examples Using gst-launch-1.0............................................ 5
Video Decode Using gst-omx ............................................................ 5
Video Decode Using gst-v4l2 ............................................................ 7
Image Decode Examples Using gst-launch-1.0 ........................................... 8
Encode Examples................................................................................ 8
Audio Encode Examples Using gst-launch-1.0 ............................................ 8
Video Encode Examples Using gst-launch-1.0 ............................................ 9
Video Encode Using gst-omx ............................................................ 9
Video Encode Using gst-v4l2 ........................................................... 10
Image Encode Examples Using gst-launch-1.0 .......................................... 12
Supported H.264/H.265/VP8/VP9 Encoder Features with GStreamer-1.0 .......... 12
Features Supported Using gst-omx .................................................... 12
Features Supported Using gst-v4l2 .................................................... 17
Camera Capture with GStreamer-1.0 ....................................................... 23
Video Playback with GStreamer-1.0......................................................... 24
Video Format Conversion with GStreamer-1.0............................................. 27
raw-yuv Input Formats ..................................................................... 27
raw-yuv Output Formats ................................................................... 28
NVIDIA Input and Output Formats ........................................................... 28
Video Scaling with GStreamer-1.0 ........................................................... 29
raw-yuv Input Formats ..................................................................... 29
raw-yuv Output Formats ................................................................... 30
NVIDIA Input and Output Formats ........................................................ 30
Video Cropping with GStreamer-1.0 ........................................................ 32
Video Transcode with GStreamer-1.0 ....................................................... 32
CUDA Video Post-Processing with GStreamer-1.0 ......................................... 37
gst-videocuda ................................................................................ 37
gst-nvivafilter ................................................................................ 38
Video Rotation with GStreamer-1.0 ......................................................... 39
Video Composition with GStreamer-1.0 .................................................... 41
Interpolation Methods for Video Scaling .................................................... 42
EGLStream Producer Example................................................................ 43
EGL Image Transform Example............................................................... 43
Accelerated GStreamer User Guide DA_07303-4.0 | iv

GStreamer Build Instructions ......................................................... 45
Nvgstcapture-1.0 Reference .......................................................... 48

Command Line Switches ...................................................................... 48
CSI Camera Supported Resolutions .......................................................... 51
CSI Camera Runtime Commands ............................................................. 51
USB Camera Runtime Commands ............................................................ 52
Notes ............................................................................................. 53
nvgstplayer-1.0 Reference ............................................................ 55

nvgstplayer Command Line Switches........................................................ 55
nvgstplayer Runtime Commands ............................................................. 57
Video Encoder Features ............................................................... 59
Supported Cameras ..................................................................... 61

CSI Cameras ..................................................................................... 61
USB 2.0 Cameras ............................................................................... 61
Industrial Camera Details ..................................................................... 61
Accelerated GStreamer User Guide DA_07303-4.0 | v

ACCELERATED GSTREAMER USER GUIDE
This document is a user guide for the GStreamer version 1.0 based accelerated solution
included in NVIDIA® Tegra® Linux Driver Package (L4T) for NVIDIA® Jetson AGX
Xavier™ devices.
Note References to GStreamer version 1.0 apply to GStreamer version

1.14.
GSTREAMER-1.0 INSTALLATION AND SETUP

This section describes how to install and configure GStreamer.
To install GStreamer-1.0
 Install GStreamer-1.0 on the platform with the following commands:
sudo add-apt-repository universe

sudo add-apt-repository multiverse
sudo apt-get update
sudo apt-get install gstreamer1.0-tools gstreamer1.0-alsa \
gstreamer1.0-plugins-base gstreamer1.0-plugins-good \
gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly \
gstreamer1.0-libav
sudo apt-get install libgstreamer1.0-dev \
libgstreamer-plugins-base1.0-dev \
libgstreamer-plugins-good1.0-dev \
libgstreamer-plugins-bad1.0-dev
Accelerated GStreamer User Guide DA_07303-4.0| 1

Accelerated GStreamer User Guide
To check the GStreamer-1.0 version

 Check the GStreamer-1.0 version with the following command:
gst-inspect-1.0 --version
GStreamer-1.0 Plugin Reference
Note The gst-omx plugin is deprecated in Linux for Tegra (L4T) Release 32.1.
Use the gst-v4l2 plugin instead.
GStreamer version 1.0 includes the following gst-omx video decoders:

Video Decoder Description
omxh265dec OpenMAX IL H.265 Video decoder
omxh264dec OpenMAX IL H.264 Video decoder
omxmpeg4videodec OpenMAX IL MPEG4 Video decoder
omxmpeg2videodec OpenMAX IL MPEG2 Video decoder
omxvp8dec OpenMAX IL VP8 Video decoder
omxvp9dec OpenMAX IL VP9 video decoder
GStreamer version 1.0 includes the following gst-v4l2 video decoders:

Video Encoders Description
V4L2 H.265 Video decoder
V4L2 H.264 Video decoder
V4L2 VP8 video decoder
nvv4l2decoder
V4L2 VP9 video decoder
V4L2 MPEG4 video decoder
V4L2 MPEG2 video decoder
GStreamer version 1.0 includes the following gst-omx video encoders:

omxh264enc OpenMAX IL H.264/AVC video encoder
omxh265enc OpenMAX IL H.265/AVC video encoder
OpenMAX IL VP8 video encoder (supported with NVIDIA®
omxvp8enc Jetson™ TX2/TX2i and NVIDIA® Jetson Nano™; not supported
with NVIDIA® Jetson AGX Xavier™)
OpenMAX IL VP9 video encoder (supported with Jetson TX2
omxvp9enc
and Jetson AGX Xavier; not supported with Jetson Nano)
GStreamer version 1.0 includes the following gst-v4l2 video encoders:
Accelerated GStreamer User Guide DA_07303-4.0 | 2


nvv4l2h264enc V4l2 H.264 video encoder
nvv4l2h265enc V4l2 H.265 video encoder
V4l2 VP8 video encoder (supported with Jetson TX2/TX2i and
nvv4l2vp8enc
Jetson Nano; not supported with Jetson AGX Xavier)
V4l2 VP9 video encoder (supported with Jetson AGX Xavier and
nvv4l2vp9enc
Jetson; not supported with Jetson Nano)
GStreamer version 1.0 includes the following gst-omx video sink:

Video Sink Description
nvoverlaysink OpenMAX IL videosink element
GStreamer version 1.0 includes the following EGL image video sink:
EGL/GLES videosink element, both the X11 and
nveglglessink
Wayland backends
nv3dsink EGL/GLES videosink element
GStreamer version 1.0 includes the following DRM video sink:

nvdrmvideosink DRM videosink element
Note The nvoverlaysink plugin is deprecated in L4T Release 32.1.

Use nvdrmvideosink and nv3dsink instead for render pipelines
with gst-v4l2 decoder.
GStreamer version 1.0 includes the following proprietary NVIDIA plugins:

NVIDIA Proprietary Plugin Description
nvarguscamerasrc Camera plugin for ARGUS API
nvvidconv Video format conversion & scaling
nvcompositor Video compositor
Acts as GStreamer Source Component, accepts
nveglstreamsrc
EGLStream from EGLStream producer
Video Sink Component. Accepts YUV-I420 format and
nvvideosink
produces EGLStream (RGBA)
Video transform element for NVMM to EGLimage
nvegltransform
(supported with nveglglessink only)
GStreamer version 1.0 includes the following libjpeg based JPEG image video
encode/decode plugins:

JPEG Description
nvjpegenc JPEG encoder element
nvjpegdec JPEG decoder element
Note Execute this command on the target before starting the video
decode pipeline using gst-launch or nvgstplayer.
export DISPLAY=:0
Start the X server with xinit &, if it is not already running.
DECODE EXAMPLES
The examples in this section show how you can perform audio and video decode with
GStreamer.
Note GStreamer version 0.10 support is deprecated in Linux for Tegra

(L4T) Release 24.2. Use of GStreamer version 1.0 is recommended
for development.
Audio Decode Examples Using gst-launch-1.0

The following examples show how you can perform audio decode using GStreamer-1.0.
AAC Decode (OSS Software Decode)
gst-launch-1.0 filesrc location=<filename.mp4> ! \

qtdemux name=demux demux.audio_0 ! \
queue ! avdec_aac ! audioconvert ! alsasink -e
AMR-WB Decode (OSS Software Decode)

qtdemux name=demux demux.audio_0 ! queue ! avdec_amrwb ! \
audioconvert ! alsasink -e
AMR-NB Decode (OSS Software Decode)

qtdemux name=demux demux.audio_0 ! queue ! avdec_amrnb ! \
audioconvert ! alsasink -e

MP3 Decode (OSS Software Decode)
gst-launch-1.0 filesrc location=<filename.mp3> ! mpegaudioparse ! \

avdec_mp3 ! audioconvert ! alsasink -e
Note To route audio over HDMI, set the alsasink property device as
follows:
hw:Tegra,3
Video Decode Examples Using gst-launch-1.0

The following examples show how you can perform video decode on GStreamer-1.0.
Video Decode Using gst-omx

The following examples show how you can perform video decode using the gst-omx
plugin on GStreamer-1.0.
H.264 Decode (NVIDIA Accelerated Decode)

qtdemux name=demux demux.video_0 ! queue ! h264parse ! omxh264dec ! \
nveglglessink -e

qtdemux name=demux demux.video_0 ! queue ! h265parse ! omxh265dec ! \
nvoverlaysink -e
10-bit H.265 Decode (NVIDIA Accelerated Decode)
gst-launch-1.0 filesrc location=<filename_10bit.mkv> ! \

matroskademux ! h265parse ! omxh265dec ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! \
nvoverlaysink -e

matroskademux ! h265parse ! omxh265dec ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! \
nvoverlaysink -e

Note For decode use cases with low memory allocation requirements (e.g. on
Jetson Nano), use the enable-low-outbuffer property of the gst-
omx decoder plugin.
For an example, see the pipeline below.

qtdemux ! h265parse ! omxh265dec enable-low-outbuffer=1 ! \
'video/x- raw(memory:NVMM), format=(string)NV12' ! fakesink sync=1 -e
Note To enable max perf mode, use the disable-dvfs property of the gst-
omx decoder plugin. Expect increased power consumption in max perf
mode.

qtdemux ! h265parse ! omxh265dec disable-dvfs=1 ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! fakesink sync=1 -e
VP8 Decode (NVIDIA Accelerated Decode)

qtdemux name=demux demux.video_0 ! queue ! omxvp8dec ! \
nvoverlaysink -e
Note If the primary display is NOT used to render video, use the display-
id property of nvoverlaysink.
For example, refer to the pipeline below.

qtdemux name=demux demux.video_0 ! queue ! omxvp8dec ! \
nvoverlaysink display-id=1 -e

matroskademux name=demux demux.video_0 ! queue ! omxvp9dec ! \

MPEG-4 Decode (NVIDIA Accelerated Decode)

qtdemux name=demux demux.video_0 ! queue ! mpeg4videoparse ! \
omxmpeg4videodec ! nveglglessink -e
gst-launch-1.0 filesrc location=<filename.ts> ! \

tsdemux name=demux demux.video_0 ! queue ! mpegvideoparse ! \
omxmpeg2videodec ! nveglglessink -e
Video Decode Using gst-v4l2

The following examples show how you can perform video decode using gst-v4l2 plugin
on GStreamer-1.0.
gst-launch-1.0 filesrc location=<filename_h264.mp4> ! \

qtdemux ! queue ! h264parse ! nvv4l2decoder ! nv3dsink -e
Note To enable max perf mode, use the enable-max-performance property

of the gst-v4l2 decoder plugin. Expect increased power consumption in
max perf mode.

qtdemux ! queue ! h264parse ! nvv4l2decoder \
enable-max-performance=1 ! nv3dsink -e


matroskademux ! queue ! h265parse ! nvv4l2decoder ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! nv3dsink -e


matroskademux ! queue ! h265parse ! nvv4l2decoder ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! nv3dsink -e
gst-launch-1.0 filesrc location=<filename_vp9.mkv> ! \

matroskademux ! queue ! nvv4l2decoder ! nv3dsink -e
gst-launch-1.0 filesrc location=<filename_vp8.mkv> ! \

matroskademux ! queue ! nvv4l2decoder ! nv3dsink -e
gst-launch-1.0 filesrc location=<filename_mpeg4.mp4> ! \

qtdemux ! queue ! mpeg4videoparse ! nvv4l2decoder ! nv3dsink -e
gst-launch-1.0 filesrc location=<filename_mpeg2.ts> ! \

tsdemux ! queue ! mpegvideoparse ! nvv4l2decoder ! nv3dsink -e
Image Decode Examples Using gst-launch-1.0

The following examples show how you can perform JPEG decode on GStreamer-1.0.
gst-launch-1.0 filesrc location=<filename.jpg> ! nvjpegdec ! \

imagefreeze ! xvimagesink -e
ENCODE EXAMPLES
The examples in this section show how you can perform audio and video encode with
GStreamer.
Audio Encode Examples Using gst-launch-1.0

The following examples show how you can perform audio encode on GStreamer-1.0.

AAC Encode (OSS Software Encode)
gst-launch-1.0 audiotestsrc ! \
'audio/x-raw, format=(string)S16LE,
layout=(string)interleaved, rate=(int)44100, channels=(int)2' ! \
voaacenc ! qtmux ! filesink location=test.mp4 -e
AMR-WB Encode (OSS Software Encode)
gst-launch-1.0 audiotestsrc ! \
'audio/x-raw, format=(string)S16LE, layout=(string)interleaved, \
rate=(int)16000, channels=(int)1' ! voamrwbenc ! qtmux ! \
filesink location=test.mp4 -e
Video Encode Examples Using gst-launch-1.0

The following examples show how you can perform video encode with GStreamer-1.0.
Video Encode Using gst-omx

The following examples show how you can perform video encode using the gst-omx
plugin with GStreamer-1.0.
H.264 Encode (NVIDIA Accelerated Encode)
gst-launch-1.0 videotestsrc ! \
'video/x-raw, format=(string)I420, width=(int)640, \
height=(int)480' ! omxh264enc ! \
'video/x-h264, stream-format=(string)byte-stream' ! h264parse ! \
qtmux ! filesink location=test.mp4 -e
height=(int)480' ! omxh265enc ! filesink location=test.h265 -e
10-bit H.265 Encode (NVIDIA Accelerated Encode)
gst-launch-1.0 nvarguscamerasrc ! \
'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, \
format=(string)NV12, framerate=(fraction)30/1' ! \
nvvidconv ! 'video/x-raw(memory:NVMM), format=(string)I420_10LE' !
omxh265enc ! matroskamux ! filesink location=test_10bit.mkv -e

VP8 Encode (NVIDIA Accelerated, Supported with Jetson TX2/TX2i and

Jetson Nano)
height=(int)480' ! omxvp8enc ! matroskamux ! \
filesink location=test.mkv -e
VP9 Encode (NVIDIA Accelerated, Supported with Jetson TX2 and Jetson
AGX Xavier)
height=(int)480' ! omxvp9enc ! matroskamux ! \
filesink location=test.mkv -e
MPEG-4 Encode (OSS Software Encode)
height=(int)480' ! avenc_mpeg4 ! qtmux ! \
H.263 Encode (OSS Software Encode)
height=(int)576' ! avenc_h263 ! qtmux ! filesink location=test.mp4 -e
Video Encode Using gst-v4l2

The following examples show how you can perform video encode using gst-v4l2 plugin
with GStreamer-1.0.
format=(string)NV12, framerate=(fraction)30/1' ! nvv4l2h264enc ! \
bitrate-8000000 ! h264parse ! qtmux ! filesink \
location=<filename_h264.mp4> -e
Note To enable max perf mode, use the maxperf-enable property of the
gst-v4l2 encoder plugin. Expect increased power consumption in
max perf mode.

format=(string)NV12, framerate=(fraction)30/1' ! nvv4l2h264enc \
maxperf-enable=1 bitrate=8000000 ! h264parse ! qtmux ! filesink \
bitrate=8000000 ! h265parse ! qtmux ! filesink \
VP9 Encode (NVIDIA Accelerated Encode)
format=(string)NV12, framerate=(fraction)30/1' ! nvv4l2vp9enc \
bitrate=8000000 ! matroskamux ! filesink \
location=<filename_vp9.mkv> -e
VP9 Encode with IVF Headers (NVIDIA Accelerated Encode)
enable-headers=1 bitrate=8000000 ! filesink \
location=<filename_vp9.vp9> -e
VP8 Encode (NVIDIA Accelerated Encode)
bitrate=8000000 ! matroskamux ! filesink \
location=<filename_vp8.mkv> -e

VP8 Encode with IVF Headers (NVIDIA Accelerated Encode)
enable-headers=1 bitrate=8000000 ! filesink \
location=<filename_vp8.vp8> -e
Image Encode Examples Using gst-launch-1.0

The following examples show how you can perform JPEG encode on GStreamer-1.0 .
Image Encode
gst-launch-1.0 videotestsrc num-buffers=1 ! \

'video/x-raw, width=(int)640, height=(int)480, \
format=(string)I420' ! nvjpegenc ! filesink location=test.jpg -e
Supported H.264/H.265/VP8/VP9 Encoder Features with

GStreamer-1.0
This section describes example gst-launch-1.0 usage for features supported by the
NVIDIA accelerated H.264/H.265/VP8/VP9 encoders.
Features Supported Using gst-omx

NVIDIA accelerated H.264/H.265/VP8/VP9 gst-omx encoders.
Note Display detailed information on omxh264enc or omxh265enc encoder

properties with the gst-inspect-1.0 [omxh264enc |
omxh265enc | omxvp8enc | omxvp9enc] command.
Set I-Frame Interval

format=(string)I420' ! omxh264enc iframeinterval=100 ! qtmux ! \
Set Temporal-Tradeoff (Rate at Which the Encoder Should Drop Frames)


format=(string)I420' ! omxh264enc temporal-tradeoff=1 ! qtmux ! \

Configuring temporal tradeoff causes the encoder to intentionally, periodically, drop

input frames. The following modes are supported:
Mode Description
0 Disable
1 Drop 1 in 5 frames
Set Rate Control Mode

format=(string)I420' ! omxh264enc control-rate=1 ! qtmux ! \
The following modes are supported:

Mode Description
0 Disable
1 Variable bit rate
2 Constant bit rate
Variable bit rate with frame skip. The encoder skips
3
frames as necessary to meet the target bit rate.
4 Constant bit rate with frame skip
Set Peak Bitrate
gst-launch-1.0 videotestsrc num-buffers=200 is-live=true ! \

'video/x-raw,width=1280,height=720,format=I420' ! \
omxh264enc bitrate=6000000 peak-bitrate=6500000 ! qtmux ! \
It takes effect only in variable bit rate(control-rate=1) mode. By default, the value is
configured as (1.2*bitrate).

Set Quantization Range for I, P and B Frame

The format for the range is the following:
"<I_range>:<P_range>:<B_range>"
Where <I_range>, <P_range> and <B_range> are each expressed as hyphenated

values, as shown in the following example:

format=(string)I420' ! \
omxh264enc qp-range="10,30:10,35:10,35" ! qtmux ! \
The range of B frames does not take effect if the number of B frames is 0.
Set Hardware Preset Level

format=(string)I420' ! omxh264enc preset-level=0 ! qtmux ! \

Mode Description
0 UltraFastPreset
FastPreset
Only Integer Pixel (integer-pel) block motion is
1 estimated. For I/P macroblock mode decision, only
Intra 16 x 16 cost is compared with Inter modes costs.
Supports Intra 16 x 16 and Intra 4 x 4 modes.
MediumPreset
Supports up to Half Pixel (half-pel) block motion
2 estimation. For an I/P macroblock mode decision, only
Intra 16 x 16 cost is compared with Inter modes costs.
Supports Intra 16 x 16 and Intra 4 x 4 modes.
SlowPreset
Supports up to Quarter Pixel (Qpel) block motion
3 estimation. For an I/P macroblock mode decision, Intra
4 x 4 as well as Intra 16 x 16 cost is compared with
Inter modes costs. Supports Intra 16 x 16 and Intra 4 x
4 modes.

Set Profile

format=(string)I420' ! omxh264enc profile=8 ! qtmux ! \
From omxh264enc, the following profiles are supported:

Profile Description
1 Baseline profile
2 Main profile
8 High profile
Set Level
gst-launch-1.0 videotestsrc num-buffers=200 is-live=true ! \

'video/x-raw, format=(string)I420, width=(int)256, height=(int)256, \
framerate=(fraction)30/1' ! omxh264enc bitrate=40000 !\
'video/x-h264, level=(string)2.2' ! qtmux ! \
filesink location= test.mp4 -e
From omxh264enc, the following levels are supported: 1, 1b, 1.2, 1.3, 2, 2.1,
2.2, 3, 3.1, 3.2, 4, 4.1, 4.2, 5, 5.1, and 5.2.
From omxh265enc, the following levels are supported: main1, main2, main2.1,
main3, main3.1, main4, main4.1, main5, high1, high2, high2.1,
high3, high3.1, high4, high4.1, and high5.
Set Number of B Frames Between Two Reference Frames

format=(string)I420' ! omxh264enc num-B-Frames=2 ! qtmux ! \
Note B-frame-encoding is not supported with omxh265enc.
Insert SPS and PPS at IDR

format=(string)I420' ! omxh264enc insert-sps-pps=1 ! qtmux ! \

If enabled, a sequence parameter set (SPS) and a picture parameter set (PPS) are inserted
before each IDR frame in the H.264/H.265 stream.
Enable Two-Pass CBR

format=(string)I420' ! omxh264enc EnableTwopassCBR=1
control-rate=2 ! qtmux ! filesink location=test.mp4 -e
Two-pass CBR must be enabled along with constant bit rate (control-rate=2).
Set Virtual Buffer Size

format=(string)I420' ! omxh264enc vbv-size=10 ! qtmux ! \
If the buffer size of decoder or network bandwidth is limited, configuring virtual buffer
size can cause video stream generation to correspond to the limitations according to the
following formula:
virtual buffer size = vbv-size * (bitrate/fps)
Enable Stringent Bitrate
gst-launch-1.0 nvarguscamerasrc num-buffers=200 ! \

'video/x-raw(memory:NVMM),width=1920,height=1080,
format=(string)NV12' ! \
omxh264enc control-rate=2 vbv-size=1 EnableTwopassCBR=true \
EnableStringentBitrate=true ! qtmux ! filesink location=test.mp4 -e
Stringent Bitrate must be enabled along with constant bit rate (control-rate=2), two-pass
CBR being enabled, and virtual buffer size being set.
Slice-Header-Spacing with Spacing in Terms of MB

omxh264enc slice-header-spacing=200 bit-packetization=0 ! \

The parameter bit-packetization=0 configures the network abstraction layer

(NAL) packet as macroblock (MB)-based, and slice-header-spacing=200
configures each NAL packet as 200 MB at maximum.
Slice Header Spacing with Spacing in Terms of Number of Bits

omxh264enc slice-header-spacing=1024 bit-packetization=1 ! \
qtmux ! filesink location=test1.mp4 -e

(NAL) packet as size-based, and slice-header-spacing=1024 configures each NAL
packet as 1024 bytes at maximum.
Features Supported Using gst-v4l2

NVIDIA accelerated H.264/H.265/VP8/VP9 gst-v4l2 encoders.
Note Display detailed information on the nvv4l2h264enc, nvv4l2h265enc,

or nvv4l2vp9enc encoder property with the gst-inspect-1.0
[nvv4l2h264enc | nvv4l2h265enc | nvv4l2vp8enc |
nvv4l2vp9enc] command.
Set I-Frame Interval (Supported with H.264/H.265/VP9 Encode)

format=(string)I420, framerate=(fraction)30/1' ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)I420' ! nvv4l2h264enc \
iframeinterval=100 ! h264parse ! qtmux ! filesink \
This property sets encoding Intra Frame occurrence frequency.

Set Rate Control Mode and Bitrate (Supported with H.264/H.265/VP9

Encode)

control-rate=0 bitrate=30000000 ! h264parse ! qtmux ! filesink \
location=<filename_h264_VBR.mp4> -e

control-rate=1 bitrate=30000000 ! h264parse ! qtmux ! filesink \
location=<filename_h264_CBR.mp4> -e

Mode Description
0 Variable bit rate (VBR)
1 Constant bit rate (CBR)
Set Quantization Range for I, P and B frame (Supported with H.264/H.265

Encode)

ratecontrol-enable=0 quant-i-frames=30 quant-p-frames=30 \
quant-b-frames=30 num-B-Frames=1 ! filesink \
location=<filename_h264.264> -e
The range of B frames does not take effect if the number of B frames is 0.
Set Hardware Preset Level (Supported with H.264/H.265/VP9 Encode)

preset-level=4 MeasureEncoderLatency=1 ! 'video/x-h264, \
stream-format=(string)byte-stream, alignment=(string)au' ! \
filesink location=<filename_h264.264> -e

Mode Description
0 DisablePreset
1 UltraFastPreset
FastPreset
Only Integer Pixel (integer-pel) block motion is
2 estimated. For I/P macroblock mode decisions, only
Intra 16×16 cost is compared with intermode costs.
Supports intra 16×16 and intra 4×4 modes.
MediumPreset
Supports up to Half Pixel (half-pel) block motion
3 estimation. For I/P macroblock mode decisions, only
Intra 16×16 cost is compared with intermode costs.
Supports intra 16×16 and intra 4×4 modes.
SlowPreset
Supports up to Quarter Pixel (Qpel) block motion
4 estimation. For I/P macroblock mode decisions, intra
4×4 as well as intra 16×16 cost is compared with
intermode costs. Supports intra 16×16 and intra 4×4
modes.
Set Profile (Supported with H.264 Encode)

profile=0 ! 'video/x-h264, stream-format=(string)byte-stream, \
alignment=(string)au' ! filesink location=<filename_h264.264> -e
The following profiles are supported:

Profile Description
0 Baseline profile
2 Main profile
4 High profile
Insert SPS and PPS at IDR (Supported with H.264 Encode)

insert-sps-pps=1 ! \
'video/x-h264, stream-format=(string)byte-stream, \

If enabled, a sequence parameter set (SPS) and a picture parameter set (PPS) are inserted
before each IDR frame in the H.264 stream.
Enable Two-Pass CBR (Supported with H.264/H.265 Encode)

control-rate=1 bitrate=10000000 EnableTwopassCBR=1 ! \
'video/x-h264, stream-format=(string)byte-stream, \
Two-pass CBR must be enabled along with constant bit rate (control-rate=1).
Note For multi-instance encode with two-pass CBR enabled, enable max perf
mode by using the maxperf-enable property of the gst-v4l2 encoder
to achieve best performance. Expect increased power consumption in
max perf mode.
Slice-Header-Spacing with Spacing in Terms of MB (Supported with

H.264/H.265 Encode)

slice-header-spacing=8 bit-packetization=0 ! 'video/x-h264, \

(NAL) packet as macroblock (MB)-based, and slice-header-spacing=8 configures
each NAL packet as 8 MB at maximum.
Slice Header Spacing with Spacing in Terms of Number of Bits (Supported

with H.264/H.265 Encode)

slice-header-spacing=1400 bit-packetization=1 ! 'video/x-h264, \


(NAL) packet as size-based, and slice-header-spacing=1400 configures each NAL
packet as 1400 bytes at maximum.
Enable Cabac-Entropy-Coding (Supported with H.264 Encode for Main or

High Profile)

profile=2 cabac-entropy-coding=1 ! 'video/x-h264, \
The following entropy coding types are supported:

Entropy Coding Type Description
0 CAVLC
1 CABAC
Set Number of B Frames Between Two Reference Frames (Supported with

H.264 Encode)

num-B-Frames=1 ! 'video/x-h264, stream-format=(string)byte-stream, \
This property sets the number of B frames between two reference frames.
Note For multi-instance encode with num-B-Frames=2, enable max perf

mode by specifying the maxperf-enable property of the gst-v4l2
encoder for best performance. Expect increased power consumption
in max perf mode.

Set qp-range (Supported with H.264/H.265 Encode)

qp-range="24,24:28,28:30,30" num-B-Frames=1 ! 'video/x-h264, \
stream-format=(string)byte-stream, alignment=(string)au' ! filesink \
location=<filename_h264.264> -e
This property sets qunatization range for P, I and B frames.
Enable MVBufferMeta (Supported with H.264/H.265 Encode)

EnableMVBufferMeta=1 ! 'video/x-h264, \
This property enables motion vector metadata for encoding.
Insert AUD (Supported with H.264/H.265 Encode)

insert-aud=1 ! 'video/x-h264, stream-format=(string)byte-stream, \
This property inserts an H.264/H.265 Access Unit Delimiter (AUD).
Insert VUI (Supported with H.264/H.265 Encode)

insert-vui=1 ! 'video/x-h264, stream-format=(string)byte-stream, \
This property inserts H.264/H.265 Video Usability Information (VUI) in SPS.

CAMERA CAPTURE WITH GSTREAMER-1.0

For nvgstcapture-1.0 usage information enter the following command:
nvgstcapture-1.0 --help
Note nvgstcapture-1.0 application default only supports ARGUS API using

nvarguscamerasrc plugin. Legacy nvcamerasrc plugin support is
deprecated.
For more information, see Nvgstcapture-1.0 Option Reference in this guide.
Capture using nvarguscamerasrc and preview display with overlaysink:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM), \

width=(int)1920, height=(int)1080, format=(string)NV12, \
framerate=(fraction)30/1' ! nvoverlaysink -e
Note For multi-instance encode with num-B-Frames=2, enable max perf

mode by specifying the maxperf-enable property of the gst-v4l2
encoder for best performance. Expect increased power consumption
in max perf mode.
gst-launch-1.0 nvarguscamerasrc maxperf=1 ! \

control-rate=1 bitrate=8000000 ! 'video/x-h265, \
stream-format=(string)byte-stream' ! h265parse ! qtmux ! filesink \
location=test.mp4 -e
The nvgstcapture-1.0 application uses the v4l2src plugin to capture still images
and video.
The following table shows USB camera support.

USB Camera Support Feature
Preview display
YUV Image capture (VGA, 640 x 480)
Video capture (480p, 720p, H.264/H.265/VP8/VP9 encode)

raw-yuv Capture (I420 Format) and Preview Display with xvimagesink
gst-launch-1.0 v4l2src device="/dev/video0" ! \

"video/x-raw, width=640, height=480, format=(string)YUY2" ! \
xvimagesink -e
VIDEO PLAYBACK WITH GSTREAMER-1.0

For nvgstplayer-1.0 usage information enter the following command:
nvgstplayer-1.0 --help
Video can be output to HD displays using the HDMI connector on the platform. The
GStreamer-1.0 application supports currently the following video sinks:
Note The nvoverlaysink plugin is deprecated in L4T Release 32.1. Use the
nvdrmvideosink plugin for development.
Overlay Sink (Video playback on overlay in full-screen mode)

qtdemux name=demux ! h264parse ! omxh264dec ! nvoverlaysink -e
Overlay Sink (Video playback using overlay parameters)
The following steps are required to use the “overlay” property on

Note: Jetson-TX2.
1. Set win_mask with the following commands:
# sudo -s
# cd /sys/class/graphics/fb0
# echo 4 > blank // Blanks monitor for changing
# // display setting.
# echo 0x0 > device/win_mask
# // Clears current window setting.
# // window setting.
# echo 0x3f > device/win_mask
# // Assigns all 6 overlay windows
# // in display controller to
# // display 0 (fb0).
# echo 0 > blank // Unblank display.
2. Stop X11 using following command:
$ sudo systemctl stop gdm
$ sudo loginctl terminate-seat seat0

For more introduction about the overlay windows in the display

controller, please refer to the TX2 Technical Reference Manual
(TRM).
To use all 6 overlays X11 must be disabled, since it occupies one
window. Disabling X11 also helps avoid memory bandwidth contention
when using a non X11 overlay.
gst-launch-1.0 filesrc location=<filename_1080p.mp4> ! \

qtdemux ! h264parse ! omxh264dec \
nvoverlaysink overlay-x=100 overlay-y=100 overlay-w=640 \
overlay-h=480 overlay=1 \
overlay-depth=0 & gst-launch-1.0 filesrc \
location=<filename_1080p.mp4> ! qtdemux ! h264parse ! omxh264dec ! \
overlay-h=480 overlay=2 overlay-depth=1 -e

qtdemux ! h264parse ! omxh264dec \
overlay-h=480 overlay=1 overlay-depth=2 & gst-launch-1.0 filesrc \
location=<filename_1080p.mp4> ! qtdemux ! h264parse ! omxh264dec ! \
overlay-h=480 overlay=2 overlay-depth=1 -e
nveglglessink (Windowed video playback, NVIDIA EGL/GLES videosink

using default X11 backend)
Use the following command to start the GStreamer pipeline using nveglglesink with
the default X11 backend:

qtdemux name=demux ! h264parse ! omxh264dec ! nveglglessink -e
This nvgstplayer-1.0 application supports specific window position and dimensions for
windowed playback:
nvgstplayer-1.0 -i <filename> --window-x=300 --window-y=300 \

--window-width=500 --window-height=500
nveglglessink (Windowed video playback, NVIDIA EGL/GLES videosink

using Wayland backend)
You can also use nveglglsink with the Wayland backend, instead of the default X11
backend.

Ubuntu 16.04 does not support the Wayland display server. That is, there is no UI
support to switch to Wayland from Xorg. You must start the Wayland server (Weston)
using the target’s shell before performing any Weston based operation.
To start Weston:
The following steps are required before you first run the GStreamer pipeline with the
Wayland backend. They are not required on subsequent runs.
1. Stop the display manager:
sudo systemctl stop gdm

sudo loginctl terminate-seat seat0
2. Unset the DISPLAY environment variable:
unset DISPLAY
3. Create a temporary xdg directory:
mkdir /tmp/xdg
chmod 700 /tmp/xdg
4. Start the Weston compositor:
sudo XDG_RUNTIME_DIR=/tmp/xdg weston --idle-time=0 &
To run the GStreamer pipeline with the Wayland backend:
Use the following command to start the GStreamer pipeline using nveglglesink with
the Wayland backend:
sudo XDG_RUNTIME_DIR=/tmp/xdg gst-launch-1.0 filesrc \

location=<filename.mp4> ! qtdemux name=demux ! h264parse ! \
omxh264dec ! nveglglessink winsys=wayland
DRM Video Sink (Video playback using DRM)

This sink element uses DRM to render video on connected displays.
1. Stop the display manager:
sudo systemctl stop gdm

sudo loginctl terminate-seat seat0

2. Enter this command to start the GStreamer pipeline using nvdrmvideosink:

qtdemux! queue ! h264parse !nvv4l2decoder ! nvdrmvideosink -e
Properties
nvdrmvideosink supports the following properties:

Property name Description
conn_id Set connector ID for display.
plane_id Set plane ID.
set_mode Set default mode (resolution) for playback.
The following command illustrates the use of these properties:

qtdemux! queue ! h264parse ! ! nvv4l2decoder ! nvdrmvideosink \
conn_id=0 plane_id=1 set_mode=0 -e
nv3dsink Video Sink (Video playback using 3D graphics API)

This video sink element works with NVMM buffers and renders using the 3D graphics
rendering API. It performs better than nveglglessink with NVMM buffers.
The following command starts the gstreamer pipeline using nv3dsink:

VIDEO FORMAT CONVERSION WITH GSTREAMER-1.0

The NVIDIA proprietary nvvidconv GStreamer-1.0 plugin allows conversion between
OSS (raw) video formats and NVIDIA video formats. The nvvidconv plugin currently
supports the format conversions described in this section
raw-yuv Input Formats

Currently nvvidconv supports the I420, UYVY, YUY2, YVYU, NV12, BGRx, and RGBA
raw-yuv input formats.
 Using the gst-omx encoder:

gst-launch-1.0 videotestsrc ! 'video/x-raw, format=(string)UYVY, \

width=(int)1280, height=(int)720' ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)I420’ ! omxh264enc ! \
Using the gst-v4l2 encoder:

gst-launch-1.0 videotestsrc ! 'video/x-raw, format=(string)UYVY, \
width=(int)1280, height=(int)720' ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)I420’ ! \
nvv4l2h264enc ! 'video/x-h264, \
stream-format=(string)byte-stream' ! h264parse ! \
raw-yuv Output Formats

raw-yuv output formats.
 Using the gst-omx decoder:
gst-launch-1.0 filesrc location=640x480_30p.mp4 ! qtdemux ! queue !

\
h264parse ! omxh264dec ! nvvidconv ! \
'video/x-raw, format=(string)UYVY' ! videoconvert ! xvimagesink -e
 Using the gst-v4l2 decoder:
gst-launch-1.0 filesrc location=640x480_30p.mp4 ! qtdemux ! \

queue ! h264parse ! nvv4l2decoder ! nvvidconv ! \
'video/x-raw, format=(string)UYVY' ! videoconvert ! xvimagesink -e
NVIDIA INPUT AND OUTPUT FORMATS

Currently e supports NVIDIA input and output formats for format conversion as
described in the following table:
Input Format Output Format
NV12 NV12
I420
I420
I420_10LE
I420_10LE
I420_12LE
P010_10LE
UYVY UYVY
YUY2 YUY2


YVYU YVYU
BGRx BGRx
RGBA RGBA
Uses these commands to convert between NVIDIA formats:

'video/x-raw(memory:NVMM), format=(string)RGBA' ! nvoverlaysink -e

h264parse ! nvv4l2decoder ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)RGBA' ! nvdrmvideosink -e
format=(string)NV12, framerate=(fraction)30/1' ! nvvidconv ! \
'video/x-raw(memory:NVMM), format=(string)I420’ ! omxh264enc ! \
'video/x-raw(memory:NVMM), format=(string)I420’ ! nvv4l2h264enc ! \
h264parse ! qtmux ! filesink location=test.mp4 -e
VIDEO SCALING WITH GSTREAMER-1.0

The NVIDIA proprietary nvvidconv GStreamer-1.0 plugin also allows you to perform
video scaling. The nvvidconv plugin currently supports scaling with the format
conversions described in this section.
raw-yuv Input Formats

raw-yuv input formats for scaling.
 Using the gst-omx encoder:

height=(int)720' ! nvvidconv ! \
format=(string)I420' ! omxh264enc ! \
 Using the gst-v4l2 encoder:
height=(int)720' ! nvvidconv ! \
format=(string)I420' ! nvv4l2h264enc ! \
raw-yuv Output Formats

raw-yuv output formats for scaling.
gst-launch-1.0 filesrc location=1280x720_30p.mp4 ! qtdemux ! queue !

\
'video/x-raw, format=(string)I420, width=640, height=480' ! \
xvimagesink -e

queue ! h264parse ! nvv4l2decoder ! nvvidconv ! \
'video/x-raw, format=(string)I420, width=640, height=480' ! \
xvimagesink -e
NVIDIA Input and Output Formats

Currently nvvidconv supports the NVIDIA input and output formats for scaling
described in the following table:

NV12 NV12


I420
I420_10LE I420
I420_12LE I420_10LE
P010_10LE
UYVY UYVY
YUY2 YUY2
YVYU YVYU
BGRx BGRx
RGBA RGBA
To scale between NVIDIA formats

 Using the gst-omx pipeline:

format=(string)NV12' ! nvoverlaysink -e

format=(string)NV12' ! nv3dsink -e

format=(string)RGBA' ! nvoverlaysink -e

format=(string)NV12' ! nvdrmvideosink -e


format=(string)NV12’ ! omxh264enc ! \
 Using the gst-v4l2 encoder:
format=(string)NV12’ ! nvv4l2h264enc ! h264parse ! \
VIDEO CROPPING WITH GSTREAMER-1.0

video cropping.
To crop video
gst-launch-1.0 filesrc location=<filename_1080p.mp4> ! qtdemux ! \

h264parse ! omxh264dec ! \
nvvidconv left=400 right=1520 top=200 bottom=880 ! \

h264parse ! nvv4l2decoder ! \
nvvidconv left=400 right=1520 top=200 bottom=880 ! nv3dsink -e
VIDEO TRANSCODE WITH GSTREAMER-1.0

You can perform video transcoding between the following video formats.
H.264 Decode to VP9 Encode (NVIDIA Accelerated Decode to NVIDIA-

Accelerated Encode)

qtdemux name=demux demux.video_0 ! queue ! h264parse ! omxh264dec
! \

omxvp9enc bitrate=20000000 ! matroskamux name=mux ! \

filesink location=<Transcoded_filename.mkv> -e
 Using the gst-v4l2 pipeline:

h264parse ! nvv4l2decoder ! \
nvvidconv left=400 right=1520 top=200 bottom=880 ! nv3dsink -e

Accelerated Encode)
 Using the gst-omx-pipeline:

qtdemux name=demux demux.video_0 ! queue ! h265parse ! \
omxh265dec ! omxvp9enc bitrate=20000000 ! matroskamux name=mux ! \

qtdemux name=demux demux.video_0 ! queue ! h265parse !
nvv4l2decoder \ ! nvv4l2vp9enc bitrate=20000000 ! queue !
matroskamux name=mux ! \
VP8 Decode to H.264 Encode (NVIDIA Accelerated Decode to NVIDIA-

Accelerated Encode)
gst-launch-1.0 filesrc location=<filename.webm> ! \

omxh264enc bitrate=20000000 ! qtmux name=mux ! \
filesink location=<Transcoded_filename.mp4> -e
gst-launch-1.0 filesrc location=<filename.mebm> ! \

matroskademux name=demux demux.video_0 ! queue ! nvv4l2decoder ! \
nvv4l2h264enc bitrate=20000000 ! h264parse ! queue ! \
qtmux name=mux \ ! filesink location=<Transcoded_filename.mp4> -e

VP9 Decode to H.265 Encode (NVIDIA Accelerated Decode to NVIDIA-

Accelerated Encode)

omxh265enc bitrate=20000000 ! qtmux name=mux ! \

nvv4l2h265enc bitrate=20000000 ! h265parse ! queue ! \
qtmux name=mux \ ! filesink location=<Transcoded_filename.mp4> -e
MPEG-4 Decode to VP9 Encode (NVIDIA Accelerated Decode to NVIDIA-

Accelerated Encode)

omxmpeg4videodec ! omxvp9enc bitrate=20000000 ! matroskamux \
name=mux ! filesink location=<Transcoded_filename.mkv> -e

nvv4l2decoder ! nvv4l2vp9enc bitrate=20000000 ! queue ! \
matroskamux \ name=mux ! filesink \
location=<Transcoded_filename.mkv> -e
MPEG-4 Decode to H.264 Encode (NVIDIA Accelerated Decode to NVIDIA-

Accelerated Encode)

omxmpeg4videodec ! omxh264enc bitrate=20000000 ! \
qtmux name=mux ! filesink location=<Transcoded_filename.mp4> -e


nvv4l2decoder ! nvv4l2h264enc bitrate=20000000 ! h264parse ! \
queue ! qtmux name=mux ! filesink \
location=<Transcoded_filename.mp4> -e

Accelerated Encode)

omxh264dec ! omxvp8enc bitrate=20000000 ! queue ! \

nvv4l2decoder \ ! nvv4l2vp8enc bitrate=20000000 ! queue ! \

Accelerated Encode)

omxh265dec ! \ omxvp8enc bitrate=20000000 ! queue ! \

nvv4l2decoder \ ! nvv4l2vp8enc bitrate=20000000 ! queue ! \

VP8 Decode to MPEG-4 Encode (NVIDIA Accelerated Decode to OSS

Software Encode)
gst-launch-1.0 filesrc location=<filename.mkv> ! \

nvvidconv ! avenc_mpeg4 bitrate=4000000 ! queue ! \

nvvidconv ! avenc_mpeg4 bitrate=4000000 ! queue ! \
VP9 Decode to MPEG-4 Encode (NVIDIA Accelerated Decode to OSS

Software Encode)

nvvidconv ! avenc_mpeg4 bitrate=4000000 ! qtmux name=mux ! \

nvvidconv ! avenc_mpeg4 bitrate=4000000 ! qtmux name=mux ! \
H.264 Decode to Theora Encode (NVIDIA Accelerated Decode to OSS

Software Encode)

omxh264dec ! nvvidconv ! theoraenc bitrate=4000000 ! \
oggmux name=mux ! filesink location=<Transcoded_filename.ogg> -e


nvv4l2decoder \ ! nvvidconv ! theoraenc bitrate=4000000 ! \
oggmux name=mux ! filesink location=<Transcoded_filename.ogg> -e
H.264 Decode to H.263 Encode (NVIDIA Accelerated Decode to OSS

Software Encode)

omxh264dec ! nvvidconv ! \
format=(string)I420' ! avenc_h263 bitrate=4000000 ! qtmux ! \

nvv4l2decoder \ ! nvvidconv ! \
format=(string)I420' ! avenc_h263 bitrate=4000000 ! qtmux ! \
CUDA VIDEO POST-PROCESSING WITH GSTREAMER-

1.0
This section describes GStreamer-1.0 plugins for NVIDIA® CUDA® post-processing
operations.
gst-videocuda
This GStreamer-1.0 plugin performs CUDA post-processing operations on decoder-
provided EGL images and render video using nveglglessink.
The following are sample pipeline creation and application usage commands.

Sample decode pipeline
gst-launch-1.0 filesrc location=<filename_h264_1080p.mp4> ! \

qtdemux name=demux ! h264parse ! omxh264dec ! videocuda !\
nveglglessink max-lateness=-1 -e
Sample decode command
nvgstplayer-1.0 -i <filename_h264_1080p.mp4> --svd="omxh264dec" \

--svc="videocuda" --svs="nveglglessink # max-lateness=-1" \
--disable-vnative --no-audio --window-x=0 --window-y=0 \
--window-width=960 --window-height=540
gst-nvivafilter
This NVIDIA proprietary GStreamer-1.0 plugin performs pre/post and CUDA post-
processing operations on CSI camera captured or decoded frames, and renders video
using overlay video sink or video encode.
Sample decode pipeline

 Using the gst-omx-decoder:
gst-launch-1.0 filesrc location=<filename.mp4> ! qtdemux ! \

h264parse ! omxh264dec ! nvivafilter cuda-process=true \
customer-lib-name="libnvsample_cudaprocess.so" ! \
'video/x-raw(memory:NVMM), format=(string)NV12' ! nvoverlaysink -e
gst-launch-1.0 filesrc location=<filename.mp4> ! qtdemux ! queue ! \

h264parse ! nvv4l2decoder ! nvivafilter cuda-process=true \
'video/x-raw(memory:NVMM), format=(string)NV12' ! nvdrmvideosink -
e
Sample CSI Camera pipeline
nvivafilter cuda-process=true \
'video/x-raw(memory:NVMM), format=(string)NV12' ! nvoverlaysink -e

Note See the nvsample_cudaprocess_src.tbz2 package for the

libnvsample_cudaprocess.so library sources. A sample CUDA
implementation of libnvsample_cudaprocess.so can be replaced by
a custom CUDA implementation.
VIDEO ROTATION WITH GSTREAMER-1.0

video rotation operations.
The following table shows the supported values for the nvvidconv flip-method
property.
Flip Method Property value

Identity - no rotation (default) 0
Counterclockwise - 90 degrees 1
Rotate - 180 degrees 2
Clockwise - 90 degrees 3
Horizontal flip 4
Upper right diagonal flip 5
Vertical flip 6
Upper-left diagonal 7
Note Get information on the nvvidconv flip-method property with the

gst-inspect-1.0 nvvidconv command.
To rotate video 90 degrees counterclockwise

To rotate video 90 degrees in a counterclockwise direction, enter the following
command.
 With the gst-omx-decoder:

qtdemux name=demux ! h264parse ! omxh264dec ! \
nvvidconv flip-method=1 ! \
'video/x-raw(memory:NVMM), format=(string)I420' ! nvoverlaysink -e

 With the gst-v4l2 decoder:

qtdemux name=demux ! h264parse ! nvv4l2decoder ! \
'video/x-raw(memory:NVMM), format=(string)I420' ! \
nvdrmvideosink -e
To rotate video 90 degrees clockwise

To rotate video 90 degrees in a clockwise direction, enter the following command:
gst-launch-1.0 filesrc location=<filename.mp4> ! qtdemux name=demux ! \

h264parse ! omxh264dec ! nvvidconv flip-method=3 ! \
'video/x-raw(memory:NVMM), format=(string)I420’ ! \
omxh264enc ! qtmux ! filesink location=test.mp4 -e
To rotate 180 degrees

To rotate video 180 degrees, enter the following command:
gst-launch-1.0 nvarguscamerasrc! \
'video/x-raw(memory:NVMM), format=(string)I420' ! nvoverlaysink -e
To scale and rotate video 90 degrees counterclockwise

To scale and rotate video 90 degrees counterclockwise, enter the following command:
 Using the gst-omx-decoder:

h264parse ! omxh264dec ! nvvidconv flip-method=1 ! \
format=(string)I420' ! nvoverlaysink -e

h264parse ! nvv4l2decoder ! nvvidconv flip-method=1 ! \
format=(string)I420' ! nvdrmvideosink -e

To scale and rotate video 90 degrees clockwise

To scale and rotate video 90 degrees clockwise, enter the following command:
nvvidconv flip-method=3 ! 'video/x-raw(memory:NVMM), \
width=(int)480, height=(int)640, format=(string)I420' ! \
nvoverlaysink -e
To scale and rotate video 180 degrees

To scale and rotate video 180 degrees, enter the following command:

qtdemux ! h264parse ! omxh264dec ! nvvidconv flip-method=2 ! \
format=(string)I420' ! nvoverlaysink -e

qtdemux ! h264parse ! nvv4l2decoder ! nvvidconv flip-method=2 ! \
format=(string)I420' ! nvdrmvideosink -e
VIDEO COMPOSITION WITH GSTREAMER-1.0

With the NVIDIA proprietary nvcompositor GStreamer-1.0 plugin, you can perform
video composition operations on gst-omx video decoded streams.
Note nvcompositor supports video decode (gst-omx) with the overlay

render pipeline for gst-1.14.
Prerequisites
 Install the following dependent GStreamer package.
$ sudo apt-get install gstreamer1.0-plugins-bad

 Clear the registry cache file, in case there is an issue with gst-inspect-1.0
nvcompositor.
$ rm .cache/gstreamer-1.0/registry.aarch64.bin
To composite different formats decoded streams

Enter the following command:
gst-launch-1.0 nvcompositor \
name=comp sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 \
sink_0::height=1080 sink_1::xpos=0 sink_1::ypos=0 \
sink_1::width=1600 sink_1::height=1024 sink_2::xpos=0 \
sink_2::ypos=0 sink_2::width=1366 sink_2::height=768 \
sink_3::xpos=0 sink_3::ypos=0 sink_3::width=1024 \
sink_3::height=576 ! nvoverlaysink display-id=1 \
filesrc location=<filename_h264_1080p_30fps.mp4> ! qtdemux ! \
h264parse ! omxh264dec ! comp. filesrc \
location=< filename_h265_1080p_30fps.mp4> ! qtdemux ! h265parse ! \
omxh265dec ! comp. filesrc \
location=< filename_vp8_1080p_30fps.webm> matroskademux ! \
omxvp8dec ! \
comp. filesrc location=<filename_vp9_1080p_30fps.webm> ! \
matroskademux ! omxvp9dec ! comp. -e
INTERPOLATION METHODS FOR VIDEO SCALING

The NVIDIA proprietary nvvidconv GStreamer-1.0 plugin allows you to choose the
interpolation method used for scaling.
The following table shows the supported values for the nvvidconv
interpolation-method property.
Interpolation Method Property Value

Nearest 0
Bilinear 1
5-tap 2
10-tap 3
Smart (default) 4
Nicest 5
Note Get information on the nvvidconv interpolation-method property

with the gst-inspect-1.0 nvvidconv command.

To use bilinear interpolation method for scaling

gst-launch-1.0 filesrc location=<filename_1080p.mp4>! \

qtdemux name=demux ! h264parse ! omxh264dec ! \
nvvidconv interpolation-method=1 ! \
'video/x-raw(memory:NVMM), format=(string)I420, width=1280, \
height=720' ! nvoverlaysink -e
gst-launch-1.0 filesrc location=<filename_1080p.mp4>! \

qtdemux name=demux ! h264parse ! nvv4l2decoder ! \
nvvidconv interpolation-method=1 ! \
'video/x-raw(memory:NVMM), format=(string)I420, width=1280, \
height=720' ! nvdrmvideosink -e
EGLSTREAM PRODUCER EXAMPLE

The NVIDIA-proprietary nveglstreamsrc and nvvideosink GStreamer-1.0 plugins allow
simulation of an EGLStream producer pipeline (for preview only.)
To simulate an EGLStream producer pipeline

nvgstcapture-1.0 --camsrc=3
EGL IMAGE TRANSFORM EXAMPLE

The NVIDIA proprietary nvegltransform GStreamer-1.0 plugin allows simulation of an
EGLImage transform pipeline.

To simulate an EGL Image transform pipeline


qtdemux ! h264parse ! omxh264dec ! nvvidconv ! \
format=(string)NV12' ! nvegltransform ! nveglglessink -e

qtdemux ! h264parse ! nvv4l2decoder ! nvegltransform !
nveglglessink -e

GSTREAMER BUILD INSTRUCTIONS
This release contains the gst-install script to install a specific GStreamer version.
This section provides a procedure for building current versions of GStreamer.
To build GStreamer using gst-install

1. Execute the following command:
gst-install [--prefix=<install_path>] [--version=<version>]
Where <install_path> is the location where you are installing GStreamer and
<version> is the GStreamer version. For example:
gst-install --prefix=/home/ubuntu/gst-1.15.2 --version=1.15.2
2. Export environment variables with the following command:
export LD_LIBRARY_PATH=<install_path>/lib/aarch64-linux-gnu
export PATH=<install_path>/bin:$PATH
Where <install_path> is the location where you are installing GStreamer. For
example:
export LD_LIBRARY_PATH=/home/ubuntu/gst-1.15.2/lib/aarch64-linux-gnu
export PATH=/home/ubuntu/gst-1.15.2/bin:$PATH

GStreamer Build Instructions
To build GStreamer manually

1. Download the latest version of gstreamer available at:
http://gstreamer.freedesktop.org/src/
The following are the files you need from version 1.15.2:
● gstreamer-1.15.2.tar.xz
● gst-plugins-base-1.15.2.tar.xz
● gst-plugins-good-1.15.2.tar.xz
● gst-plugins-bad-1.15.2.tar.xz
● gst-plugins-ugly-1.15.2.tar.xz
2. Install needed packages with the following command:
sudo apt-get install build-essential dpkg-dev flex bison \

autotools-dev automake liborc-dev autopoint libtool \
gtk-doc-tools libgstreamer1.0-dev
3. In the ~/ directory, create a gst_<version> directory, where <version> is the

version number of gstreamer you are building.
4. Copy the downloaded tar.xz files to the gst_<version> directory.
5. Uncompress the tar.xz files in the gst_<version> directory.
6. Set the PKG_CONFIG_PATH environment variable with the following command:
export PKG_CONFIG_PATH=/home/ubuntu/gst_1.15.2/out/lib/pkgconfig
7. Build gstreamer (in this example, gstreamer-1.15.2) with the following commands:
./configure --prefix=/home/ubuntu/gst_1.15.2/out
make
make install
8. Build gst-plugins-base-1. 15.2 with the following commands:
sudo apt-get install libxv-dev libasound2-dev libtheora-dev \

libogg-dev libvorbis-dev
make
make install
9. Build gst-plugins-good-1.15.2 with the following commands:
sudo apt-get install libbz2-dev libv4l-dev libvpx-dev \

libjack-jackd2-dev libsoup2.4-dev libpulse-dev

GStreamer Build Instructions
make
make install
10. Obtain and build gst-plugins-bad-1.15.2 with the following commands:
sudo apt-get install faad libfaad-dev libfaac-dev

make
make install
11. Obtain and build gst-plugins-ugly-1.15.2 with the following commands:
sudo apt-get install libx264-dev libmad0-dev

make
make install
12. Set the LD_LIBRARY_PATH environment variable with the following command:
export LD_LIBRARY_PATH=/home/ubuntu/gst_1.15.2/out/lib/
13. Copy the nvidia gstreamer-1.0 libraries to the gst_1.15.2 plugin directory
using the following command:
cd /usr/lib/aarch64-linux-gnu/gstreamer-1.0/
cp libgstnv* libgstomx.so \
~/gst_1.15.2/out/lib/gstreamer-1.0/
The nvidia gstreamer-1.0 libraries include:
libgstnvarguscamera.so
libgstnvcompositor.so
libgstnvdrmvideosink.so
libgstnveglglessink.so
libgstnveglstreamsrc.so
libgstnvegltransform.so
libgstnvivafilter.so
libgstnvjpeg.so
libgstnvtee.so
libgstnvvidconv.so
libgstnvvideo4linux2.so
libgstnvvideocuda.so
libgstnvvideosink.so
libgstnvvideosinks.so
libgstomx.so

NVGSTCAPTURE-1.0 REFERENCE
This section describes the nvgstcapture-1.0 application.
Note: By default, the nvgstcapture-1.0 application only supports the ARGUS

API using the nvarguscamerasrc plugin. The legacy nvcamerasrc plugin
is no longer supported.
COMMAND LINE SWITCHES

The nvgstcapture-1.0 application can display information about its own command line
switches. To display command line switch information, run the application with one of
these command line switches:
“Help” Command Line Switches
Option Description
-h Show help switches.
--help
--help-all Show all help switches.
--help-gst Show GStreamer switches.
This table describes the application’s other command-line switches.

Other Command Line Switches
Notes
Option Description Examples
--prev_res Preview width and height. Range: 2 to 8 (3840x2160)
--prev_res=3
--cus-prev-res Custom preview width and --cus-prev-res=1920x1080
height for CSI only.

Nvgstcapture-1.0 Reference

Notes
--image_res Image width and height, Range: 2 to 12 (5632x4224)
--image_res=3
--video-res Video width and height. Range: 2 to 9 (3896x2192)
--video-res=3
--camsrc Camera source to use 0=V4L2
1=csi[default]
2=videotest
3=eglstream
-m, --mode Capture mode. 1-Still
2-Video
-v, --video_enc Video encoder type. 0=h264[HW]
1=vp8[HW, not supported on
Jetson AGX Xavier]
2=h265[HW]
3=vp9[HW]
-p, --hw-enc-path Framework Type. 0=OMX
1=V4L2
-b, --enc-bitrate Video encoding Bit-rate (in --enc-bitrate=4000000
bytes)
--enc-controlrate Video encoding bit-rate 0 = Disable
control method. 1 = variable (Default)
2 = constant
--enc-controlrate=1
--enc-EnableTwopassCBR Enable two pass CBR while 0 = Disable
encoding. 1 = Enable
--enc-EnableTwopassCBR=1
--enc-profile Video encoder profile (only for 0-Baseline
H.264). 1-Main
2-High
-j, --image_enc Image encoder type. 0-jpeg_SW[jpegenc]
1-jpeg_HW[nvjpegenc]
-k, --file_type Container file type. 0-MP4
1-3GP
2-MKV
--file-name Captured file name.
nvcamtest is used by default.
--color-format Color format to use. 0=I420
1=NV12[For CSI only and
default for CSI]
2=YUY2[For V4L2 only, default
for V4L2]
--orientation Camera sensor orientation
value.


Notes
--eglConfig EGL window Coordinates --eglConfig="50 100"
(x_pos y_pos) in that order.
-w, --whitebalance Capture whitebalance value.
--timeout Capture timeout value.
--saturation Camera saturation value.
--sensor-id Camera Sensor ID value.
--display-id [For nvoverlaysink only]
Display ID value.
--overlayConfig Overlay Configuration Options --overlayConfig="0, 0, 0, 1280,
index and coordinates in 720"
(index, x_pos, y_pos, width,
height) order.
--cap-dev-node Video capture device node. 0=/dev/video0[default]
1=/dev/video1
2=/dev/video2
--cap-dev-node=0
--svs [For USB] (=) chain for video
preview.
[For CSI only] use
nvoverlaysink or
nvdrmvideosink.
--exposuretimerange Property to adjust exposure --exposuretimerange="34000
time range in nanoseconds. 358733000"
--gainrange Property to adjust gain range --gainrange="1 16
--ispdigitalgainrange Property to adjust digital gain --ispdigitalgainrange="1 8"
range. Range value from 1 to 256
--aelock Enable AE Lock. Default is disabled.
--awblock Enable AWB Lock. Default is disabled.
--exposurecompensation Property to adjust exposure Range value from -2.0 to 2.0.
compensation. --exposurecompensation=0.5
--aeantibanding Property to set the auto Range value from 0 to 3.
exposure antibanding mode. --aeantibanding=2
--tnr-mode Property to select temporal --tnr-mode=2
noise reduction mode.
--tnr-strength Property to adjust temporal --tnr-strength=0.5
noise reduction strength.
--ee-mode Property to select edge --ee-mode=2
enhancement mode.
--ee-strength Property to adjust edge --ee-strength=0.5
enhancement strength.

CSI CAMERA SUPPORTED RESOLUTIONS

CSI camera supports the following image resolutions for Nvarguscamera:
 640x480
 1280x720
 1920x1080
 2104x1560
 2592x1944
 2616x1472
 3840x2160
 3896x2192
 4208x3120
 5632x3168
 5632x4224
CSI CAMERA RUNTIME COMMANDS

Options for Nvarguscamera
CSI camera runtime commands options for Nvarguscamera are described in the
following table.
Command Description Notes

h Help —
q Quit —
mo:<value> Set capture mode 1-image
2-video
gmo Get capture mode —
so:<val> Set sensor orientation 0-none
1-Rotate counter-clockwise 90
degrees
2-Rotate 180 degrees
3-Rotate clockwise 90 degrees
gso Get sensor orientation —
wb:<value> Set white balance mode 0-off
1-auto
2-incandescent
3-fluorescent
4-warm-fluorescent
5-daylight
6-cloudy-daylight
7-twilight
8-shade
9-manual


gwb Get white balance mode —
st:<value> Set saturation 0-2, e.g., st:1.25
gst Get saturation —
j Capture one image. —
jx<delay> Capture after a delay of —
<delay>, e.g., jx5000 to
capture after a 5-second
delay
j:<value> Capture <count> number of —
images in succession, e.g., j:6
to capture 6 images.
0 Stop recording video —
1 Start recording video —
2 Video snapshot (while —
recording video)
gpcr Get preview resolution —
gicr Get image capture resolution —
gvcr Get video capture resolution —
USB CAMERA RUNTIME COMMANDS

USB Camera Runtime Commands
USB camera runtime commands are described in the following table.

h Help —
q Quit —
mo:<value> Set capture mode 1-image
2-video
gmo Get capture mode —
j Capture one image. —
jx<delay> Capture after a delay of —
<delay>, e.g., jx5000 to
capture after a 5-second
delay
j:<value> Capture <count> number of —
images in succession, e.g., j:6
to capture 6 images.
1 Start recording video —
0 Stop recording video —


pcr:<value> Set preview resolution 0-176x144
1-320x240
2-640x480
3-1280x720
gpcr Get preview resolution —
gicr Get image capture resolution —
gvcr Get video capture resolution —
br:<value> Set encoding bit rate (in e.g., br:4000000
bytes)
gbr Get encoding bit rate —
cdn:<value> Set capture device node 0-/dev/video0
1-/dev/video1
2-/dev/video2
gcdn Get capture device node —
Runtime Video Encoder Configuration Options

The following table describes runtime video encoder configuration options supported
for Nvarguscamera.

br:<val> Sets encoding bit-rate (in Example: br:4000000
bytes)
gbr Gets encoding bit-rate (in —
bytes)
ep:<val> Sets encoding profile (for Example: ep:1
H.264 only) (0): Baseline
(1): Main
(2): High
gep Gets encoding profile (for —
H.264 only)
Enter ’f’ Forces IDR frame on video —
encoder (for H.264 only)
NOTES
 The nvgstcapture-1.0 application generates image and video output files in the same
directory as the application itself.
 Filenames for image and video content are in the formats, respectively:
● nvcamtest_<pid>_<sensor_id>_<counter>.jpg
● nvcamtest_<pid>_<sensor_id>_<counter>.mp4
Where:

● <pid> is the process ID.

● <sensor_id> is the sensor ID.
● <counter> is a counter starting from 0 every time you run the application.
Rename or move files between runs to avoid overwriting results you want to save.
 The nvgstcapture-1.0 application supports native capture(video only) mode by
default.
 Advance features, like setting zoom, brightness, exposure, and whitebalance levels,
are not supported for USB camera.

NVGSTPLAYER-1.0 REFERENCE
This section describes the operation of the the nvgstplayer-1.0 application.
NVGSTPLAYER COMMAND LINE SWITCHES

Note: To list supported options, enter the command:
nvgstplayer-1.0 --help
This table describes nvgstplayer-1.0 command-line switches:

Switch Description
-u <path> Path of the file containing the URIs.
--urifile <path>
-I <uri> Input URI.
--uri <uri>
-e <path> Element(s) (Properties) file.
--elemfile <path>
-x Command sequence expression.
--cxpr
-n <n> Number of times to play the media.
--loop <n>
-c <n> If a stream has multiple audio tracks, specifies the track
--audio-track <n> number to play.
-v <n> If a stream has multiple video tracks, specifies the track

--video-track <n> number to play.
-a <seconds> Start of the segment in media in seconds.

--start <seconds>

nvgstplayer-1.0 Reference
Switch Description
-d <seconds> Play duration of the segment in media in seconds.
--duration <seconds>
--no-sync Disable AV sync.
--disable-dpms Unconditionally disable DPMS/ScreenBlanking during
operation; re-enable on exit.
--stealth Operate in stealth mode, staying alive even when no
media is playing.
--bg Operate in background mode, ignoring keyboard input.
--use-playbin Use Playbin.
--no-audio Disable audio.
--no-video Disable video.
--disable-anative Disable native audio rendering.
--disable-vnative Disable native video rendering.
--use-buffering Use buffering.
-l <percent> Low threshold for buffering to start, in percent.
--low-percent <percent>
-j <percent> High threshold for buffering to finish, in percent.
--high-percent <percent>
--loop-forever Play the URI(s) in an endless loop.
-t <seconds> Maximum time in queue, in seconds (0=automatic).
--max-size-time <seconds>
-y <n> Maximum amount of memory in the queue, in bytes
--max-size-bytes <n> (0=automatic).
-b <n> Maximum number of buffers in the queue (0=automatic).

--max-size-buffers <n>
--window-x <n> X coordinate for player window (for non-overlay
rendering).
--window-y <n> Y coordinate for player window (for non-overlay
rendering).
--window-width <n> Window width (for non-overlay rendering).
--window-height <n> Window height (for non-overlay rendering).
--disable-fullscreen Play video in non-full-screen mode (for
nveglglessink).
-k <seconds> Image display time, in seconds.
--image-display-time <seconds>
--show-tags Shows tags (metadata), if available.
--stats Shows stream statistics, if enabled.
--stats-file File to dump stream statistics, if enabled.

Switch Description
--svd (=) chain for video decoding.
--sad (=) chain for audio decoding.
--svc (=) chain for video postprocessing.
--sac (=) chain for audio postprocessing.
--svs (=) chain for video rendering.
--sas (=) chain for audio rendering.
--shttp (=) chain for http source.
--srtsp (=) chain for rtsp source.
--sudp (=) chain for udp source.
--sfsrc (=) chain for file source.
NVGSTPLAYER RUNTIME COMMANDS

This table describes nvgstplayer runtime commands.
Description
Command Example
h Help
q Quit
Up Arrow Go to next track.
]
c Restart current track.
Down Arrow Go to previous track.
[
spos Query for position (time from start).
sdur Query for duration.
s<n> Seek to <n> seconds from start.
e.g. s5.120
v<pct> Seek to <pct> percent of the duration.
e.g. v54
f<val> Shift <n> seconds relative to current position.
e.g. f23.901
Left Arrow Seek backward 10 seconds.
<
Right Arrow Seek forward 10 seconds.
>

Description
Command Example
p Pause playback.
r Start/resume playback.
z Stop playback.
i:<uri> Enter a single URI.

VIDEO ENCODER FEATURES
The GStreamer-1.0-based gst-omx video encoders support the following features,

respectively:
Video Encoder Feature H264enc H265enc Vp8enc Vp9enc
profile (Baseline / Main / High)  (all)  (Main)  
level   — —
bitrate    
peak bitrate   — —
stringent bitrate   — —
insert-spsppsatidr    
control-rate    
iframeinterval    
qp-range    
temporal-tradeoff    
bit-packetization    
preset-level    
low-latency    
slice-header spacing   — —
force-IDR    
vbv-size    
sliceintrarefreshenable   — —
sliceintrarefreshinterval   — —
EnableTwoPassCBR    
num-B-Frames  — — —

Video Encoder Features
The GStreamer-1.0-based gst-v4l2 video encoders support the following features,

respectively :
Video Encoder Feature H264enc H265enc Vp8enc Vp9enc
profile (Baseline / Main / High)  (all)  (Main)  
control-rate    
bitrate    
insert-spsppsatidr  — — —
profile  — — —
quantization range for I, P and B
  — —
frame
iframeinterval    
qp-range   — —
bit-packetization   — —
preset-level    
slice-header spacing   — —
force-IDR    
EnableTwoPassCBR   — —
Enable cabac-entropy-coding  — — —
Enable MVBufferMeta   — —
Insert aud   — —
Insert vui   — —
num-B-Frames  — — —

SUPPORTED CAMERAS
This section describes the supported cameras.
CSI CAMERAS
 NVIDIA® Jetson Nano™, NVIDIA® Jetson AGX Xavier™, and NVIDIA® Jetson™
TX2 can capture camera images via CSI interface.
 Jetson Nano, Jetson AGX Xavier, and Jetson TX2 all support both YUV and RAW
Bayer capture data.
 GStreamer supports simultaneous capture from multiple CSI cameras. Suppoert is
validated using the nvgstcapture application.
 Capture is validated for SDR, PWL HDR and DOL HDR modes for various sensors
using the nvgstcapture application.
USB 2.0 CAMERAS

The following camera has been validated on Tegra platforms running L4T with USB 2.0
ports. This camera is UVC compliant.
 Logitech C920
http://www.logitech.com/en-in/product/hd-pro-webcam-c920
INDUSTRIAL CAMERA DETAILS

The following USB 3.0 industrial camera is validated on Jetson AGX Xavier under L4T:
 See3CAM_CU130

Supported Cameras
http://www.e-consystems.com/UltraHD-USB-Camera.asp
● USB 3.0
● UVC compliant
● 3840 x 2160 at 30 FPS | 4224 x 3156 at 13 FPS
● Purpose - Embedded Navigation
● Test using the nvgstcapture app.
● Issues encountered:
― FPS cannot be fixed. Changes based on exposure.
― FPS cannot be changed. Needs payment to vendor to get the support added
to their firmware.

Notice
ALL NVIDIA DESIGN SPECIFICATIONS, REFERENCE BOARDS, FILES, DRAWINGS, DIAGNOSTICS, LISTS, AND OTHER
DOCUMENTS (TOGETHER AND SEPARATELY, "MATERIALS") ARE BEING PROVIDED "AS IS." NVIDIA MAKES NO
WARRANTIES, EXPRESS, IMPLIED, STATUTORY, OR OTHERWISE WITH RESPECT TO THE MATERIALS, AND ALL
EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY
OR CONDITION OF TITLE, MERCHANTABILITY, SATISFACTORY QUALITY, FITNESS FOR A PARTICULAR PURPOSE
AND NON-INFRINGEMENT, ARE HEREBY EXCLUDED TO THE MAXIMUM EXTENT PERMITTED BY LAW.
Information furnished is believed to be accurate and reliable. However, NVIDIA Corporation assumes no
responsibility for the consequences of use of such information or for any infringement of patents or other rights
of third parties that may result from its use. No license is granted by implication or otherwise under any patent
or patent rights of NVIDIA Corporation. Specifications mentioned in this publication are subject to change
without notice. This publication supersedes and replaces all information previously supplied. NVIDIA
Corporation products are not authorized for use as critical components in life support devices or systems
without express written approval of NVIDIA Corporation.
Trademarks
NVIDIA, the NVIDIA logo, CUDA, Jetson, Nano, AGX Xavier, TX2, TX1, and Tegra are trademarks or registered
trademarks of NVIDIA Corporation in the United States and other countries. Other company and product names
may be trademarks of the respective companies with which they are associated.
Copyright© 2015−2019 NVIDIA Corporation. All rights reserved.
www.nvidia.com

Accelerated GStreamer User Guide

Uploaded by

Copyright:

Available Formats

Accelerated GStreamer User Guide

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Accelerated GStreamer User Guide

Uploaded by

Copyright:

Available Formats

`

DA_07303-4.0 | March 18, 2019

3.5 23 Feb 2018 kstone Added support for the nvarguscamerasrc

Accelerated GStreamer User Guide DA_07303-4.0 | ii

Accelerated GStreamer User Guide DA_07303-4.0 | iii

Accelerated GStreamer User Guide ...................................................1

Accelerated GStreamer User Guide DA_07303-4.0 | iv

Nvgstcapture-1.0 Reference .......................................................... 48

nvgstplayer-1.0 Reference ............................................................ 55

Video Encoder Features ............................................................... 59

Supported Cameras ..................................................................... 61

Accelerated GStreamer User Guide DA_07303-4.0 | v

Note References to GStreamer version 1.0 apply to GStreamer version

GSTREAMER-1.0 INSTALLATION AND SETUP

sudo add-apt-repository universe

Accelerated GStreamer User Guide DA_07303-4.0| 1

To check the GStreamer-1.0 version

GStreamer-1.0 Plugin Reference

GStreamer version 1.0 includes the following gst-omx video decoders:

GStreamer version 1.0 includes the following gst-v4l2 video decoders:

GStreamer version 1.0 includes the following gst-omx video encoders:

GStreamer version 1.0 includes the following gst-v4l2 video encoders:

Accelerated GStreamer User Guide DA_07303-4.0 | 2

Video Encoders Description

GStreamer version 1.0 includes the following gst-omx video sink:

GStreamer version 1.0 includes the following DRM video sink:

Note The nvoverlaysink plugin is deprecated in L4T Release 32.1.

GStreamer version 1.0 includes the following proprietary NVIDIA plugins:

Accelerated GStreamer User Guide DA_07303-4.0 | 3

Note GStreamer version 0.10 support is deprecated in Linux for Tegra

Audio Decode Examples Using gst-launch-1.0

AAC Decode (OSS Software Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

AMR-WB Decode (OSS Software Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

AMR-NB Decode (OSS Software Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

Accelerated GStreamer User Guide DA_07303-4.0 | 4

MP3 Decode (OSS Software Decode)

gst-launch-1.0 filesrc location=<filename.mp3> ! mpegaudioparse ! \

Video Decode Examples Using gst-launch-1.0

Video Decode Using gst-omx

H.264 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

H.265 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

10-bit H.265 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename_10bit.mkv> ! \

12-bit H.265 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename_12bit.mkv> ! \

Accelerated GStreamer User Guide DA_07303-4.0 | 5

gst-launch-1.0 filesrc location=<filename.mp4> ! \

gst-launch-1.0 filesrc location=<filename.mp4> ! \

VP8 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

gst-launch-1.0 filesrc location=<filename.mp4> ! \

VP9 Decode (NVIDIA Accelerated Decode)

gst-launch-1.0 filesrc location=<filename.mp4> ! \

Accelerated GStreamer User Guide DA_07303-4.0 | 6