Issue about plugins when converting onnx to tensorrt

[rsj007]

Hi, oreo-lp
I have compiled plugins as you guided. But when I convert an onnx model to tensorrt, it meets the problem.
I used two plugins "scatterND" and "GridSampler". But maybe only one is recognized. Can you tell me how to solve this?

`
/usr/src/tensorrt/bin/trtexec --onnx=adcp_1248_384_dynamic.onnx --saveEngine=adcp_engine.trt --explicitBatch --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/GridSamplerPlugin.so --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/ScatterND.so

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=adcp_1248_384_dynamic.onnx --saveEngine=adcp_engine.trt --explicitBatch --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/GridSamplerPlugin.so --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/ScatterND.so
[10/25/2021-19:44:21] [I] === Model Options ===
[10/25/2021-19:44:21] [I] Format: ONNX
[10/25/2021-19:44:21] [I] Model: adcp_1248_384_dynamic.onnx
[10/25/2021-19:44:21] [I] Output:
[10/25/2021-19:44:21] [I] === Build Options ===
[10/25/2021-19:44:21] [I] Max batch: explicit
[10/25/2021-19:44:21] [I] Workspace: 16 MB
[10/25/2021-19:44:21] [I] minTiming: 1
[10/25/2021-19:44:21] [I] avgTiming: 8
[10/25/2021-19:44:21] [I] Precision: FP32
[10/25/2021-19:44:21] [I] Calibration:
[10/25/2021-19:44:21] [I] Safe mode: Disabled
[10/25/2021-19:44:21] [I] Save engine: adcp_engine.trt
[10/25/2021-19:44:21] [I] Load engine:
[10/25/2021-19:44:21] [I] Builder Cache: Enabled
[10/25/2021-19:44:21] [I] NVTX verbosity: 0
[10/25/2021-19:44:21] [I] Inputs format: fp32:CHW
[10/25/2021-19:44:21] [I] Outputs format: fp32:CHW
[10/25/2021-19:44:21] [I] Input build shapes: model
[10/25/2021-19:44:21] [I] Input calibration shapes: model
[10/25/2021-19:44:21] [I] === System Options ===
[10/25/2021-19:44:21] [I] Device: 0
[10/25/2021-19:44:21] [I] DLACore:
[10/25/2021-19:44:21] [I] Plugins: /home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/ScatterND.so /home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/GridSamplerPlugin.so
[10/25/2021-19:44:21] [I] === Inference Options ===
[10/25/2021-19:44:21] [I] Batch: Explicit
[10/25/2021-19:44:21] [I] Input inference shapes: model
[10/25/2021-19:44:21] [I] Iterations: 10
[10/25/2021-19:44:21] [I] Duration: 3s (+ 200ms warm up)
[10/25/2021-19:44:21] [I] Sleep time: 0ms
[10/25/2021-19:44:21] [I] Streams: 1
[10/25/2021-19:44:21] [I] ExposeDMA: Disabled
[10/25/2021-19:44:21] [I] Spin-wait: Disabled
[10/25/2021-19:44:21] [I] Multithreading: Disabled
[10/25/2021-19:44:21] [I] CUDA Graph: Disabled
[10/25/2021-19:44:21] [I] Skip inference: Disabled
[10/25/2021-19:44:21] [I] Inputs:
[10/25/2021-19:44:21] [I] === Reporting Options ===
[10/25/2021-19:44:21] [I] Verbose: Disabled
[10/25/2021-19:44:21] [I] Averages: 10 inferences
[10/25/2021-19:44:21] [I] Percentile: 99
[10/25/2021-19:44:21] [I] Dump output: Disabled
[10/25/2021-19:44:21] [I] Profile: Disabled
[10/25/2021-19:44:21] [I] Export timing to JSON file:
[10/25/2021-19:44:21] [I] Export output to JSON file:
[10/25/2021-19:44:21] [I] Export profile to JSON file:
[10/25/2021-19:44:21] [I]
[10/25/2021-19:44:21] [I] Loading supplied plugin library: /home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/ScatterND.so
[10/25/2021-19:44:21] [I] Loading supplied plugin library: /home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/GridSamplerPlugin.so

Input filename: adcp_1248_384_dynamic.onnx
ONNX IR version: 0.0.6
Opset version: 11
Producer name: pytorch
Producer version: 1.6
Domain:
Model version: 0
Doc string:

[10/25/2021-19:44:29] [I] [TRT] builtin_op_importers.cpp:3676: Successfully created plugin: ScatterND
[10/25/2021-19:44:29] [I] [TRT] ModelImporter.cpp:135: No importer registered for op: GridSampler. Attempting to import as plugin.
[10/25/2021-19:44:29] [I] [TRT] builtin_op_importers.cpp:3659: Searching for plugin: GridSampler, plugin_version: 1, plugin_namespace:
[10/25/2021-19:44:29] [E] [TRT] INVALID_ARGUMENT: getPluginCreator could not find plugin GridSampler version 1
ERROR: builtin_op_importers.cpp:3661 In function importFallbackPluginImporter:
[8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/25/2021-19:44:29] [E] Failed to parse onnx file
[10/25/2021-19:44:29] [E] Parsing model failed
[10/25/2021-19:44:29] [E] Engine creation failed
[10/25/2021-19:44:29] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=adcp_1248_384_dynamic.onnx --saveEngine=adcp_engine.trt --explicitBatch --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/GridSamplerPlugin.so --plugins=/home/nvidia/Project/tensorrt_third/AlphaPose_TRT-master/build/ScatterND.so
`