You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using the openVino execution provider, I notice a very nice speed up compared to the default CPU execution provider. Great.
But I also see a much longer session creation time.
See those numbers from onnxruntime_perf_test:
CPU: Average inference time cost: 76.676 ms
OpenVino: Average inference time cost: 37.3379 ms
CPU: Session creation time cost: 0.0344839 s
OpenVino: Session creation time cost: 1.92375 s
Are those high session creation times expected?
Are there ways to reduce that time?
ep:OpenVINOissues related to OpenVINO execution provider
1 participant
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
When using the openVino execution provider, I notice a very nice speed up compared to the default CPU execution provider. Great.
But I also see a much longer session creation time.
See those numbers from
onnxruntime_perf_test
:Are those high session creation times expected?
Are there ways to reduce that time?
Thanks
Harald
Beta Was this translation helpful? Give feedback.
All reactions