OpenVX Programming Guide

OpenVX Programming Guide presents definitive information on OpenVX 1.2 and 1.3, the Neural Network and other extensions, along with the OpenVX Safety Critical standard. This book gives a high-level overview of the openVX standard, its design principles and the overall structure. Sections cover computer vision functions and the graph API, providing examples of usage for the majority of functions. It is intended both for the first time user of OpenVX as well as a reference for experienced OpenVX developers.

• Helps readers understand the OpenVX standard and gain insights on why various options are chosen
• Enables users to instantly start developing efficient OpenVX code
• Presents design principles and how to use them to create robust code

Engineers developing products with a component of computer vision and intelligence in areas such as automotive safety, video surveillance, computational photography, autonomous mobile robots and drones. Computer Engineering students and researchers

1. Introduction

• What is OpenVX and why do we need it?
• How portable is OpenVX
• Graph API with opaque memory model
• OpenVX vs. OpenCV and OpenCL
• What you should know before reading this book

2. Build your first OpenVX program

• With Immediate Mode API
• With Graph API

3. Using the Graph API to write efficient portable code

• Node parameters
• Graph parameters
• Execution model
• Asynchronous execution
• Control flow
• User kernels and nodes
• Examples

4. Building an OpenVX graph

• Linking nodes
• Graph verification
• Parameter validation
• What can be changed at runtime?
• Examples

5. Deploying an OpenVX graph to a target platform

• Exporting and importing objects
• The XML schema extension
• Immutable graphs

6. Basic image transformations

• Data objects: image, matrix
• Convolution
• Region of interest
• Border modes
• Undistortion with Remap
• Image filtering example
• Virtual objects
• Filter stacking example

7. Background subtraction and object detection

• Threshold
• Distribution
• User kernels
• Object detection example

8. Computational photography

• LUT
• Pyramid
• Example

9. Efficient data input/output

• Import an image to OpenVX
• Import a video stream to OpenVX
• Accessing OpenVX data

10. Tracking

• Data structures: keypoint, array
• Delay object
• Optical flow example

11. Use OpenVX for deep neural networks

• Neural Network Extension
• Tensor objects
• How to import a network into OpenVX
• Examples

12. OpenVX safety critical applications

• Feature subsets
• Determinism

13. Using OpenVX with other vision frameworks

• General remarks
• OpenCL
• OpenCV

14. Making the most of your OpenVX code

• Using OpenVX debugging capabilities to understand what is going on
• Profiling your OpenVX code
• Optimization tips