Regenerate ONNX models

yolo_nas_pose_l_fp16.onnx.best.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:5a88cce7911337fa5283e63dca004d66fef580a25ee5c322aad72f974c1259e3
-size 57159395

yolo_nas_pose_l_fp16.onnx.best.engine.err

@@ -1,364 +0,0 @@
-[12/28/2023-17:15:27] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-17:15:27] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-17:15:27] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
-[12/28/2023-17:48:46] [W] [TRT] Tactic Device request: 4720MB Available: 2777MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:47] [W] [TRT] Tactic Device request: 4720MB Available: 2777MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:47] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:47] [W] [TRT] Tactic Device request: 4720MB Available: 2777MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:47] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:52] [W] [TRT] Tactic Device request: 4706MB Available: 2784MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4706 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:53] [W] [TRT] Tactic Device request: 4706MB Available: 2784MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:53] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4706 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:57] [W] [TRT] Tactic Device request: 4711MB Available: 2755MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:58] [W] [TRT] Tactic Device request: 4711MB Available: 2755MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:58] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:48:59] [W] [TRT] Tactic Device request: 4711MB Available: 2755MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:48:59] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:04] [W] [TRT] Tactic Device request: 4702MB Available: 2754MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:04] [W] [TRT] Tactic Device request: 4702MB Available: 2755MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:08] [W] [TRT] Tactic Device request: 4711MB Available: 2711MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:09] [W] [TRT] Tactic Device request: 4711MB Available: 2711MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:09] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:09] [W] [TRT] Tactic Device request: 4711MB Available: 2711MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:10] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:15] [W] [TRT] Tactic Device request: 4702MB Available: 2710MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:49:15] [W] [TRT] Tactic Device request: 4702MB Available: 2710MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:49:15] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:56:52] [W] [TRT] Tactic Device request: 4711MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:56:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:56:52] [W] [TRT] Tactic Device request: 4711MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:56:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:56:52] [W] [TRT] Tactic Device request: 4711MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:56:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:56:54] [W] [TRT] Tactic Device request: 4701MB Available: 2406MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:56:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:56:54] [W] [TRT] Tactic Device request: 4701MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:56:54] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:57:13] [W] [TRT] Tactic Device request: 6275MB Available: 2406MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:57:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:57:13] [W] [TRT] Tactic Device request: 6275MB Available: 2406MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:57:13] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:57:13] [W] [TRT] Tactic Device request: 6275MB Available: 2406MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:57:13] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:57:15] [W] [TRT] Tactic Device request: 6270MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:57:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:57:15] [W] [TRT] Tactic Device request: 6270MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:57:15] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:00] [W] [TRT] Tactic Device request: 7056MB Available: 2739MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:00] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:01] [W] [TRT] Tactic Device request: 7056MB Available: 2738MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:01] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:01] [W] [TRT] Tactic Device request: 7056MB Available: 2738MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:01] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:03] [W] [TRT] Tactic Device request: 7050MB Available: 2738MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:03] [W] [TRT] Tactic Device request: 7050MB Available: 2739MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:03] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:23] [W] [TRT] Tactic Device request: 6354MB Available: 2732MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:24] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:24] [W] [TRT] Tactic Device request: 6354MB Available: 2731MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:24] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:24] [W] [TRT] Tactic Device request: 6354MB Available: 2732MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:24] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:26] [W] [TRT] Tactic Device request: 6351MB Available: 2732MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:08:26] [W] [TRT] Tactic Device request: 6351MB Available: 2732MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:08:26] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:23:59] [W] [TRT] Tactic Device request: 6540MB Available: 2641MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:23:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:23:59] [W] [TRT] Tactic Device request: 6540MB Available: 2641MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:23:59] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:23:59] [W] [TRT] Tactic Device request: 6540MB Available: 2641MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:23:59] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:24:01] [W] [TRT] Tactic Device request: 6538MB Available: 2642MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:24:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6538 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:24:01] [W] [TRT] Tactic Device request: 6538MB Available: 2641MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:24:01] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6538 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:32:34] [W] [TRT] Tactic Device request: 2457MB Available: 2443MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:32:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:32:34] [W] [TRT] Tactic Device request: 2457MB Available: 2444MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:32:34] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:32:34] [W] [TRT] Tactic Device request: 2457MB Available: 2444MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:32:34] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:32:35] [W] [TRT] Tactic Device request: 2456MB Available: 2444MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:32:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:32:35] [W] [TRT] Tactic Device request: 2456MB Available: 2444MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:32:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:33:03] [W] [TRT] Tactic Device request: 3587MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:33:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:33:03] [W] [TRT] Tactic Device request: 3587MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:33:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:33:03] [W] [TRT] Tactic Device request: 3587MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:33:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:33:04] [W] [TRT] Tactic Device request: 3585MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:33:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:33:04] [W] [TRT] Tactic Device request: 3585MB Available: 2405MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:33:04] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:49] [W] [TRT] Tactic Device request: 3556MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:49] [W] [TRT] Tactic Device request: 3556MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:49] [W] [TRT] Tactic Device request: 3556MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:49] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:50] [W] [TRT] Tactic Device request: 3551MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:50] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:50] [W] [TRT] Tactic Device request: 3551MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:50] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:52] [W] [TRT] Tactic Device request: 3140MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:52] [W] [TRT] Tactic Device request: 3140MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:52] [W] [TRT] Tactic Device request: 3140MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:53] [W] [TRT] Tactic Device request: 3136MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3136 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:45:53] [W] [TRT] Tactic Device request: 3136MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:45:53] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3136 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:51] [W] [TRT] Tactic Device request: 3161MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:51] [W] [TRT] Tactic Device request: 3161MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:51] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:51] [W] [TRT] Tactic Device request: 3161MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:51] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:52] [W] [TRT] Tactic Device request: 3156MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3156 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:52] [W] [TRT] Tactic Device request: 3156MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:52] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3156 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:59] [W] [TRT] Tactic Device request: 4189MB Available: 2022MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:57:59] [W] [TRT] Tactic Device request: 4189MB Available: 2015MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:57:59] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:00] [W] [TRT] Tactic Device request: 4189MB Available: 2016MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:00] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:04] [W] [TRT] Tactic Device request: 4183MB Available: 2018MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4183 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:04] [W] [TRT] Tactic Device request: 4183MB Available: 2017MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4183 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:08] [W] [TRT] Tactic Device request: 4186MB Available: 2017MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:08] [W] [TRT] Tactic Device request: 4186MB Available: 2015MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:08] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:09] [W] [TRT] Tactic Device request: 4186MB Available: 2016MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:09] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:13] [W] [TRT] Tactic Device request: 4182MB Available: 2016MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4182 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-18:58:13] [W] [TRT] Tactic Device request: 4182MB Available: 2015MB. Device memory is insufficient to use tactic.
-[12/28/2023-18:58:13] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4182 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:10:51] [W] [TRT] Tactic Device request: 4764MB Available: 1955MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:10:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:10:52] [W] [TRT] Tactic Device request: 4764MB Available: 1953MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:10:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:10:52] [W] [TRT] Tactic Device request: 4764MB Available: 1953MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:10:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:10:53] [W] [TRT] Tactic Device request: 4761MB Available: 1954MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:10:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4761 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:10:53] [W] [TRT] Tactic Device request: 4761MB Available: 1954MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:10:53] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4761 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:02] [W] [TRT] Tactic Device request: 4244MB Available: 1769MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:02] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:03] [W] [TRT] Tactic Device request: 4244MB Available: 1768MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:03] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:04] [W] [TRT] Tactic Device request: 4244MB Available: 1775MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:04] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:09] [W] [TRT] Tactic Device request: 4240MB Available: 1773MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4240 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:09] [W] [TRT] Tactic Device request: 4240MB Available: 1771MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:09] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4240 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:14] [W] [TRT] Tactic Device request: 4241MB Available: 1774MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:15] [W] [TRT] Tactic Device request: 4241MB Available: 1772MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:15] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:16] [W] [TRT] Tactic Device request: 4241MB Available: 1770MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:16] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:21] [W] [TRT] Tactic Device request: 4239MB Available: 1769MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4239 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:11:22] [W] [TRT] Tactic Device request: 4239MB Available: 1768MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:11:22] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4239 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:07] [W] [TRT] Tactic Device request: 1638MB Available: 1546MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1638 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:07] [W] [TRT] Tactic Device request: 1638MB Available: 1546MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:07] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1638 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:08] [W] [TRT] Tactic Device request: 1637MB Available: 1557MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:08] [W] [TRT] Tactic Device request: 1637MB Available: 1557MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:08] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:10] [W] [TRT] Tactic Device request: 3270MB Available: 1560MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:10] [W] [TRT] Tactic Device request: 3270MB Available: 1560MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:10] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:10] [W] [TRT] Tactic Device request: 3270MB Available: 1560MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:10] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:12] [W] [TRT] Tactic Device request: 3269MB Available: 1558MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3269 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:12] [W] [TRT] Tactic Device request: 3269MB Available: 1558MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:12] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3269 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:15] [W] [TRT] Tactic Device request: 4377MB Available: 1563MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:15] [W] [TRT] Tactic Device request: 2185MB Available: 1563MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:15] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:16] [W] [TRT] Tactic Device request: 4377MB Available: 1563MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:16] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:16] [W] [TRT] Tactic Device request: 2185MB Available: 1563MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:16] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:16] [W] [TRT] Tactic Device request: 4377MB Available: 1561MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:16] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:16] [W] [TRT] Tactic Device request: 2185MB Available: 1561MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:16] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:22] [W] [TRT] Tactic Device request: 4375MB Available: 1748MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:22] [W] [TRT] Tactic Device request: 2183MB Available: 1748MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:22] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:22] [W] [TRT] Tactic Device request: 4375MB Available: 1748MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:22] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:22] [W] [TRT] Tactic Device request: 2183MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:22] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:29] [W] [TRT] Tactic Device request: 4376MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:29] [W] [TRT] Tactic Device request: 2184MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:29] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:29] [W] [TRT] Tactic Device request: 4376MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:29] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:29] [W] [TRT] Tactic Device request: 2184MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:29] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:30] [W] [TRT] Tactic Device request: 4376MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:30] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:30] [W] [TRT] Tactic Device request: 2184MB Available: 1746MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:30] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:36] [W] [TRT] Tactic Device request: 4375MB Available: 1750MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:36] [W] [TRT] Tactic Device request: 2183MB Available: 1750MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:36] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:36] [W] [TRT] Tactic Device request: 4375MB Available: 1750MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:36] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:25:36] [W] [TRT] Tactic Device request: 2183MB Available: 1750MB. Device memory is insufficient to use tactic.
-[12/28/2023-19:25:36] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-19:26:56] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-19:26:56] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-19:26:56] [W] * GPU compute time is unstable, with coefficient of variance = 6.77541%.
-[12/28/2023-19:26:56] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp16.onnx.best.engine.log

@@ -1,331 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.best.engine
-[12/28/2023-17:15:16] [I] === Model Options ===
-[12/28/2023-17:15:16] [I] Format: ONNX
-[12/28/2023-17:15:16] [I] Model: yolo_nas_pose_l_fp16.onnx
-[12/28/2023-17:15:16] [I] Output:
-[12/28/2023-17:15:16] [I] === Build Options ===
-[12/28/2023-17:15:16] [I] Max batch: explicit batch
-[12/28/2023-17:15:16] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-17:15:16] [I] minTiming: 1
-[12/28/2023-17:15:16] [I] avgTiming: 8
-[12/28/2023-17:15:16] [I] Precision: FP32+FP16+INT8
-[12/28/2023-17:15:16] [I] LayerPrecisions: 
-[12/28/2023-17:15:16] [I] Calibration: Dynamic
-[12/28/2023-17:15:16] [I] Refit: Disabled
-[12/28/2023-17:15:16] [I] Sparsity: Disabled
-[12/28/2023-17:15:16] [I] Safe mode: Disabled
-[12/28/2023-17:15:16] [I] DirectIO mode: Disabled
-[12/28/2023-17:15:16] [I] Restricted mode: Disabled
-[12/28/2023-17:15:16] [I] Build only: Disabled
-[12/28/2023-17:15:16] [I] Save engine: yolo_nas_pose_l_fp16.onnx.best.engine
-[12/28/2023-17:15:16] [I] Load engine: 
-[12/28/2023-17:15:16] [I] Profiling verbosity: 0
-[12/28/2023-17:15:16] [I] Tactic sources: Using default tactic sources
-[12/28/2023-17:15:16] [I] timingCacheMode: local
-[12/28/2023-17:15:16] [I] timingCacheFile: 
-[12/28/2023-17:15:16] [I] Heuristic: Disabled
-[12/28/2023-17:15:16] [I] Preview Features: Use default preview flags.
-[12/28/2023-17:15:16] [I] Input(s)s format: fp32:CHW
-[12/28/2023-17:15:16] [I] Output(s)s format: fp32:CHW
-[12/28/2023-17:15:16] [I] Input build shapes: model
-[12/28/2023-17:15:16] [I] Input calibration shapes: model
-[12/28/2023-17:15:16] [I] === System Options ===
-[12/28/2023-17:15:16] [I] Device: 0
-[12/28/2023-17:15:16] [I] DLACore: 
-[12/28/2023-17:15:16] [I] Plugins:
-[12/28/2023-17:15:16] [I] === Inference Options ===
-[12/28/2023-17:15:16] [I] Batch: Explicit
-[12/28/2023-17:15:16] [I] Input inference shapes: model
-[12/28/2023-17:15:16] [I] Iterations: 10
-[12/28/2023-17:15:16] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-17:15:16] [I] Sleep time: 0ms
-[12/28/2023-17:15:16] [I] Idle time: 0ms
-[12/28/2023-17:15:16] [I] Streams: 1
-[12/28/2023-17:15:16] [I] ExposeDMA: Disabled
-[12/28/2023-17:15:16] [I] Data transfers: Enabled
-[12/28/2023-17:15:16] [I] Spin-wait: Disabled
-[12/28/2023-17:15:16] [I] Multithreading: Disabled
-[12/28/2023-17:15:16] [I] CUDA Graph: Disabled
-[12/28/2023-17:15:16] [I] Separate profiling: Disabled
-[12/28/2023-17:15:16] [I] Time Deserialize: Disabled
-[12/28/2023-17:15:16] [I] Time Refit: Disabled
-[12/28/2023-17:15:16] [I] NVTX verbosity: 0
-[12/28/2023-17:15:16] [I] Persistent Cache Ratio: 0
-[12/28/2023-17:15:16] [I] Inputs:
-[12/28/2023-17:15:16] [I] === Reporting Options ===
-[12/28/2023-17:15:16] [I] Verbose: Disabled
-[12/28/2023-17:15:16] [I] Averages: 100 inferences
-[12/28/2023-17:15:16] [I] Percentiles: 90,95,99
-[12/28/2023-17:15:16] [I] Dump refittable layers:Disabled
-[12/28/2023-17:15:16] [I] Dump output: Disabled
-[12/28/2023-17:15:16] [I] Profile: Disabled
-[12/28/2023-17:15:16] [I] Export timing to JSON file: 
-[12/28/2023-17:15:16] [I] Export output to JSON file: 
-[12/28/2023-17:15:16] [I] Export profile to JSON file: 
-[12/28/2023-17:15:16] [I] 
-[12/28/2023-17:15:16] [I] === Device Information ===
-[12/28/2023-17:15:16] [I] Selected Device: Orin
-[12/28/2023-17:15:16] [I] Compute Capability: 8.7
-[12/28/2023-17:15:16] [I] SMs: 8
-[12/28/2023-17:15:16] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-17:15:16] [I] Device Global Memory: 7471 MiB
-[12/28/2023-17:15:16] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-17:15:16] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-17:15:16] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-17:15:16] [I] 
-[12/28/2023-17:15:16] [I] TensorRT version: 8.5.2
-[12/28/2023-17:15:21] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2974 (MiB)
-[12/28/2023-17:15:25] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +286, now: CPU 574, GPU 3278 (MiB)
-[12/28/2023-17:15:25] [I] Start parsing network model
-[12/28/2023-17:15:27] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-17:15:27] [I] [TRT] Input filename:   yolo_nas_pose_l_fp16.onnx
-[12/28/2023-17:15:27] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-17:15:27] [I] [TRT] Opset version:    17
-[12/28/2023-17:15:27] [I] [TRT] Producer name:    pytorch
-[12/28/2023-17:15:27] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-17:15:27] [I] [TRT] Domain:           
-[12/28/2023-17:15:27] [I] [TRT] Model version:    0
-[12/28/2023-17:15:27] [I] [TRT] Doc string:       
-[12/28/2023-17:15:27] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-17:15:27] [I] Finish parsing network model
-[12/28/2023-17:15:28] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-17:15:28] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 458) [Constant]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 459) [Constant]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 460) [Constant]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1...cast_boxes_to_fp32]}
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 462) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-17:15:28] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-17:15:40] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +308, now: CPU 1231, GPU 3787 (MiB)
-[12/28/2023-17:15:42] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +72, now: CPU 1314, GPU 3859 (MiB)
-[12/28/2023-17:15:42] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-19:26:12] [I] [TRT] Total Activation Memory: 7966500352
-[12/28/2023-19:26:12] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-19:26:29] [I] [TRT] Total Host Persistent Memory: 330912
-[12/28/2023-19:26:29] [I] [TRT] Total Device Persistent Memory: 656384
-[12/28/2023-19:26:29] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-19:26:29] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 79 MiB, GPU 2398 MiB
-[12/28/2023-19:26:29] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 176 steps to complete.
-[12/28/2023-19:26:29] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 96.1396ms to assign 14 blocks to 176 nodes requiring 149010944 bytes.
-[12/28/2023-19:26:29] [I] [TRT] Total Activation Memory: 149010944
-[12/28/2023-19:26:38] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -17, now: CPU 1718, GPU 5578 (MiB)
-[12/28/2023-19:26:38] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +52, GPU +64, now: CPU 52, GPU 64 (MiB)
-[12/28/2023-19:26:39] [I] Engine built in 7882.87 sec.
-[12/28/2023-19:26:40] [I] [TRT] Loaded engine size: 54 MiB
-[12/28/2023-19:26:41] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1299, GPU 5193 (MiB)
-[12/28/2023-19:26:41] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +52, now: CPU 0, GPU 52 (MiB)
-[12/28/2023-19:26:41] [I] Engine deserialized in 0.300217 sec.
-[12/28/2023-19:26:41] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1300, GPU 5193 (MiB)
-[12/28/2023-19:26:41] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +143, now: CPU 0, GPU 195 (MiB)
-[12/28/2023-19:26:41] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-19:26:41] [I] Using random values for input onnx::Cast_0
-[12/28/2023-19:26:41] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-19:26:41] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-19:26:41] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-19:26:41] [I] Starting inference
-[12/28/2023-19:26:56] [I] Warmup completed 6 queries over 200 ms
-[12/28/2023-19:26:56] [I] Timing trace has 703 queries over 15.0461 s
-[12/28/2023-19:26:56] [I] 
-[12/28/2023-19:26:56] [I] === Trace details ===
-[12/28/2023-19:26:56] [I] Trace averages of 100 runs:
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 20.9395 ms - Host latency: 21.0535 ms (enqueue 21.0062 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 21.1664 ms - Host latency: 21.2792 ms (enqueue 21.2275 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 21.3262 ms - Host latency: 21.4444 ms (enqueue 21.3939 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 21.3667 ms - Host latency: 21.4831 ms (enqueue 21.4306 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 21.2193 ms - Host latency: 21.3339 ms (enqueue 21.2934 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 21.8831 ms - Host latency: 22.0036 ms (enqueue 21.9394 ms)
-[12/28/2023-19:26:56] [I] Average on 100 runs - GPU latency: 20.8839 ms - Host latency: 20.9973 ms (enqueue 20.9568 ms)
-[12/28/2023-19:26:56] [I] 
-[12/28/2023-19:26:56] [I] === Performance summary ===
-[12/28/2023-19:26:56] [I] Throughput: 46.7231 qps
-[12/28/2023-19:26:56] [I] Latency: min = 19.8525 ms, max = 30.6865 ms, mean = 21.368 ms, median = 21.1562 ms, percentile(90%) = 22.2715 ms, percentile(95%) = 23.1201 ms, percentile(99%) = 28.8721 ms
-[12/28/2023-19:26:56] [I] Enqueue Time: min = 19.8208 ms, max = 30.626 ms, mean = 21.3184 ms, median = 21.1201 ms, percentile(90%) = 22.2363 ms, percentile(95%) = 23.2373 ms, percentile(99%) = 28.8086 ms
-[12/28/2023-19:26:56] [I] H2D Latency: min = 0.0810547 ms, max = 0.134766 ms, mean = 0.0972954 ms, median = 0.0981445 ms, percentile(90%) = 0.100098 ms, percentile(95%) = 0.100586 ms, percentile(99%) = 0.111328 ms
-[12/28/2023-19:26:56] [I] GPU Compute Time: min = 19.7407 ms, max = 30.5723 ms, mean = 21.2522 ms, median = 21.042 ms, percentile(90%) = 22.1533 ms, percentile(95%) = 23.0203 ms, percentile(99%) = 28.7578 ms
-[12/28/2023-19:26:56] [I] D2H Latency: min = 0.00390625 ms, max = 0.0776367 ms, mean = 0.0184049 ms, median = 0.0155029 ms, percentile(90%) = 0.0283203 ms, percentile(95%) = 0.0302734 ms, percentile(99%) = 0.046875 ms
-[12/28/2023-19:26:56] [I] Total Host Walltime: 15.0461 s
-[12/28/2023-19:26:56] [I] Total GPU Compute Time: 14.9403 s
-[12/28/2023-19:26:56] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-19:26:56] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.best.engine

yolo_nas_pose_l_fp16.onnx.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-16:09:44] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-16:09:44] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-16:09:45] [E] Error[4]: [network.cpp::validate::2925] Error Code 4: Internal Error (fp16 precision has been set for a layer or layer output, but fp16 is not configured in the builder)
-[12/28/2023-16:09:45] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-16:09:45] [E] Engine could not be created from network
-[12/28/2023-16:09:45] [E] Building engine failed
-[12/28/2023-16:09:45] [E] Failed to create engine from model or file.
-[12/28/2023-16:09:45] [E] Engine set up failed

yolo_nas_pose_l_fp16.onnx.engine.log

@@ -1,91 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.engine
-[12/28/2023-16:09:34] [I] === Model Options ===
-[12/28/2023-16:09:34] [I] Format: ONNX
-[12/28/2023-16:09:34] [I] Model: yolo_nas_pose_l_fp16.onnx
-[12/28/2023-16:09:34] [I] Output:
-[12/28/2023-16:09:34] [I] === Build Options ===
-[12/28/2023-16:09:34] [I] Max batch: explicit batch
-[12/28/2023-16:09:34] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-16:09:34] [I] minTiming: 1
-[12/28/2023-16:09:34] [I] avgTiming: 8
-[12/28/2023-16:09:34] [I] Precision: FP32
-[12/28/2023-16:09:34] [I] LayerPrecisions: 
-[12/28/2023-16:09:34] [I] Calibration: 
-[12/28/2023-16:09:34] [I] Refit: Disabled
-[12/28/2023-16:09:34] [I] Sparsity: Disabled
-[12/28/2023-16:09:34] [I] Safe mode: Disabled
-[12/28/2023-16:09:34] [I] DirectIO mode: Disabled
-[12/28/2023-16:09:34] [I] Restricted mode: Disabled
-[12/28/2023-16:09:34] [I] Build only: Disabled
-[12/28/2023-16:09:34] [I] Save engine: yolo_nas_pose_l_fp16.onnx.engine
-[12/28/2023-16:09:34] [I] Load engine: 
-[12/28/2023-16:09:34] [I] Profiling verbosity: 0
-[12/28/2023-16:09:34] [I] Tactic sources: Using default tactic sources
-[12/28/2023-16:09:34] [I] timingCacheMode: local
-[12/28/2023-16:09:34] [I] timingCacheFile: 
-[12/28/2023-16:09:34] [I] Heuristic: Disabled
-[12/28/2023-16:09:34] [I] Preview Features: Use default preview flags.
-[12/28/2023-16:09:34] [I] Input(s)s format: fp32:CHW
-[12/28/2023-16:09:34] [I] Output(s)s format: fp32:CHW
-[12/28/2023-16:09:34] [I] Input build shapes: model
-[12/28/2023-16:09:34] [I] Input calibration shapes: model
-[12/28/2023-16:09:34] [I] === System Options ===
-[12/28/2023-16:09:34] [I] Device: 0
-[12/28/2023-16:09:34] [I] DLACore: 
-[12/28/2023-16:09:34] [I] Plugins:
-[12/28/2023-16:09:34] [I] === Inference Options ===
-[12/28/2023-16:09:34] [I] Batch: Explicit
-[12/28/2023-16:09:34] [I] Input inference shapes: model
-[12/28/2023-16:09:34] [I] Iterations: 10
-[12/28/2023-16:09:34] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-16:09:34] [I] Sleep time: 0ms
-[12/28/2023-16:09:34] [I] Idle time: 0ms
-[12/28/2023-16:09:34] [I] Streams: 1
-[12/28/2023-16:09:34] [I] ExposeDMA: Disabled
-[12/28/2023-16:09:34] [I] Data transfers: Enabled
-[12/28/2023-16:09:34] [I] Spin-wait: Disabled
-[12/28/2023-16:09:34] [I] Multithreading: Disabled
-[12/28/2023-16:09:34] [I] CUDA Graph: Disabled
-[12/28/2023-16:09:34] [I] Separate profiling: Disabled
-[12/28/2023-16:09:34] [I] Time Deserialize: Disabled
-[12/28/2023-16:09:34] [I] Time Refit: Disabled
-[12/28/2023-16:09:34] [I] NVTX verbosity: 0
-[12/28/2023-16:09:34] [I] Persistent Cache Ratio: 0
-[12/28/2023-16:09:34] [I] Inputs:
-[12/28/2023-16:09:34] [I] === Reporting Options ===
-[12/28/2023-16:09:34] [I] Verbose: Disabled
-[12/28/2023-16:09:34] [I] Averages: 100 inferences
-[12/28/2023-16:09:34] [I] Percentiles: 90,95,99
-[12/28/2023-16:09:34] [I] Dump refittable layers:Disabled
-[12/28/2023-16:09:34] [I] Dump output: Disabled
-[12/28/2023-16:09:34] [I] Profile: Disabled
-[12/28/2023-16:09:34] [I] Export timing to JSON file: 
-[12/28/2023-16:09:34] [I] Export output to JSON file: 
-[12/28/2023-16:09:34] [I] Export profile to JSON file: 
-[12/28/2023-16:09:34] [I] 
-[12/28/2023-16:09:34] [I] === Device Information ===
-[12/28/2023-16:09:34] [I] Selected Device: Orin
-[12/28/2023-16:09:34] [I] Compute Capability: 8.7
-[12/28/2023-16:09:34] [I] SMs: 8
-[12/28/2023-16:09:34] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-16:09:34] [I] Device Global Memory: 7471 MiB
-[12/28/2023-16:09:34] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-16:09:34] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-16:09:34] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-16:09:34] [I] 
-[12/28/2023-16:09:34] [I] TensorRT version: 8.5.2
-[12/28/2023-16:09:39] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2974 (MiB)
-[12/28/2023-16:09:43] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +283, now: CPU 574, GPU 3281 (MiB)
-[12/28/2023-16:09:43] [I] Start parsing network model
-[12/28/2023-16:09:44] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-16:09:44] [I] [TRT] Input filename:   yolo_nas_pose_l_fp16.onnx
-[12/28/2023-16:09:44] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-16:09:44] [I] [TRT] Opset version:    17
-[12/28/2023-16:09:44] [I] [TRT] Producer name:    pytorch
-[12/28/2023-16:09:44] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-16:09:44] [I] [TRT] Domain:           
-[12/28/2023-16:09:44] [I] [TRT] Model version:    0
-[12/28/2023-16:09:44] [I] [TRT] Doc string:       
-[12/28/2023-16:09:44] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-16:09:45] [I] Finish parsing network model
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.engine

yolo_nas_pose_l_fp16.onnx.fp16.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:467ff31eefb68768b955df2011c89f375ab57c09a32840d671def8b3ad75de34
-size 110752021

yolo_nas_pose_l_fp16.onnx.fp16.engine.err

@@ -1,423 +0,0 @@
-[12/28/2023-16:09:49] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-16:09:49] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-16:15:22] [W] [TRT] Tactic Device request: 4720MB Available: 3156MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:23] [W] [TRT] Tactic Device request: 4720MB Available: 3155MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:23] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:23] [W] [TRT] Tactic Device request: 4720MB Available: 3155MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:23] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:29] [W] [TRT] Tactic Device request: 4706MB Available: 3154MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4706 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:29] [W] [TRT] Tactic Device request: 4706MB Available: 3155MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4706 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:32] [W] [TRT] Tactic Device request: 4711MB Available: 3148MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:32] [W] [TRT] Tactic Device request: 4711MB Available: 3147MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:32] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:33] [W] [TRT] Tactic Device request: 4711MB Available: 3146MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:33] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:38] [W] [TRT] Tactic Device request: 4702MB Available: 3147MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:38] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:15:38] [W] [TRT] Tactic Device request: 4702MB Available: 3147MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:15:39] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:16] [W] [TRT] Tactic Device request: 4711MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:16] [W] [TRT] Tactic Device request: 4711MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:16] [W] [TRT] Tactic Device request: 4711MB Available: 3038MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:16] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:18] [W] [TRT] Tactic Device request: 4701MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:18] [W] [TRT] Tactic Device request: 4701MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:18] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:33] [W] [TRT] Tactic Device request: 6275MB Available: 3038MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:33] [W] [TRT] Tactic Device request: 6275MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:33] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:33] [W] [TRT] Tactic Device request: 6275MB Available: 3038MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:33] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:35] [W] [TRT] Tactic Device request: 6270MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:20:35] [W] [TRT] Tactic Device request: 6270MB Available: 3039MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:20:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:09] [W] [TRT] Tactic Device request: 7056MB Available: 2339MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:09] [W] [TRT] Tactic Device request: 7056MB Available: 2340MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:09] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:09] [W] [TRT] Tactic Device request: 7056MB Available: 2340MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:09] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:11] [W] [TRT] Tactic Device request: 7050MB Available: 2338MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:11] [W] [TRT] Tactic Device request: 7050MB Available: 2338MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:11] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:27] [W] [TRT] Tactic Device request: 6354MB Available: 2340MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:27] [W] [TRT] Tactic Device request: 6354MB Available: 2338MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:28] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:28] [W] [TRT] Tactic Device request: 6354MB Available: 2339MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:28] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:29] [W] [TRT] Tactic Device request: 6351MB Available: 2341MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:27:29] [W] [TRT] Tactic Device request: 6351MB Available: 2341MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:27:29] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:16] [W] [TRT] Tactic Device request: 2394MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:16] [W] [TRT] Tactic Device request: 2394MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:16] [W] [TRT] Tactic Device request: 2394MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:16] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:17] [W] [TRT] Tactic Device request: 2392MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:17] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:17] [W] [TRT] Tactic Device request: 2392MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:17] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:17] [W] [TRT] Tactic Device request: 2392MB Available: 2304MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:17] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:18] [W] [TRT] Tactic Device request: 2391MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:18] [W] [TRT] Tactic Device request: 2391MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:18] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:18] [W] [TRT] Tactic Device request: 2390MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:18] [W] [TRT] Tactic Device request: 2390MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:18] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:32] [W] [TRT] Tactic Device request: 6540MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:32] [W] [TRT] Tactic Device request: 6540MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:33] [W] [TRT] Tactic Device request: 6540MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:33] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:34] [W] [TRT] Tactic Device request: 6538MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6538 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:35] [W] [TRT] Tactic Device request: 6538MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6538 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:36] [W] [TRT] Tactic Device request: 2191MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:37] [W] [TRT] Tactic Device request: 2191MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:37] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2191 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:38] [W] [TRT] Tactic Device request: 2191MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:38] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:42] [W] [TRT] Tactic Device request: 2190MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:43] [W] [TRT] Tactic Device request: 2190MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:45] [W] [TRT] Tactic Device request: 2190MB Available: 2130MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:46] [W] [TRT] Tactic Device request: 2190MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:46] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:47] [W] [TRT] Tactic Device request: 2190MB Available: 2127MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:47] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:51] [W] [TRT] Tactic Device request: 2190MB Available: 2127MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:36:52] [W] [TRT] Tactic Device request: 2190MB Available: 2126MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:36:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:41:41] [W] [TRT] Tactic Device request: 2457MB Available: 2417MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:41:41] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:41:42] [W] [TRT] Tactic Device request: 2457MB Available: 2417MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:41:42] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:41:42] [W] [TRT] Tactic Device request: 2457MB Available: 2417MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:41:42] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:41:43] [W] [TRT] Tactic Device request: 2456MB Available: 2418MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:41:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:41:43] [W] [TRT] Tactic Device request: 2456MB Available: 2418MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:41:43] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:42:04] [W] [TRT] Tactic Device request: 3587MB Available: 2216MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:42:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:42:04] [W] [TRT] Tactic Device request: 3587MB Available: 2216MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:42:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:42:04] [W] [TRT] Tactic Device request: 3587MB Available: 2217MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:42:04] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:42:06] [W] [TRT] Tactic Device request: 3585MB Available: 2233MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:42:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:42:06] [W] [TRT] Tactic Device request: 3585MB Available: 2233MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:42:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:44] [W] [TRT] Tactic Device request: 3556MB Available: 1928MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:44] [W] [TRT] Tactic Device request: 3556MB Available: 1928MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:44] [W] [TRT] Tactic Device request: 3556MB Available: 1928MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:44] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:45] [W] [TRT] Tactic Device request: 3551MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:45] [W] [TRT] Tactic Device request: 3551MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:45] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:46] [W] [TRT] Tactic Device request: 3140MB Available: 1930MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:46] [W] [TRT] Tactic Device request: 3140MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:46] [W] [TRT] Tactic Device request: 3140MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:47] [W] [TRT] Tactic Device request: 3136MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3136 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:49:48] [W] [TRT] Tactic Device request: 3136MB Available: 1929MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:49:48] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3136 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:56:57] [W] [TRT] Tactic Device request: 3161MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:56:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:56:57] [W] [TRT] Tactic Device request: 3161MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:56:57] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:56:57] [W] [TRT] Tactic Device request: 3161MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:56:57] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:56:58] [W] [TRT] Tactic Device request: 3156MB Available: 2195MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:56:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3156 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:56:58] [W] [TRT] Tactic Device request: 3156MB Available: 2195MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:56:58] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3156 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:03] [W] [TRT] Tactic Device request: 4189MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:03] [W] [TRT] Tactic Device request: 4189MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:03] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:04] [W] [TRT] Tactic Device request: 4189MB Available: 2193MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:04] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:08] [W] [TRT] Tactic Device request: 4183MB Available: 2193MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4183 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:08] [W] [TRT] Tactic Device request: 4183MB Available: 2193MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:08] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4183 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:10] [W] [TRT] Tactic Device request: 4186MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:11] [W] [TRT] Tactic Device request: 4186MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:11] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:11] [W] [TRT] Tactic Device request: 4186MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:11] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:15] [W] [TRT] Tactic Device request: 4182MB Available: 2193MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4182 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:57:16] [W] [TRT] Tactic Device request: 4182MB Available: 2194MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:57:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4182 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:02] [W] [TRT] Tactic Device request: 4764MB Available: 2303MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:02] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:02] [W] [TRT] Tactic Device request: 4764MB Available: 2303MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:02] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:02] [W] [TRT] Tactic Device request: 4764MB Available: 2303MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:02] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:04] [W] [TRT] Tactic Device request: 4761MB Available: 2316MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4761 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:04] [W] [TRT] Tactic Device request: 4761MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:04] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4761 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:10] [W] [TRT] Tactic Device request: 4244MB Available: 2261MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:11] [W] [TRT] Tactic Device request: 4244MB Available: 1947MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:11] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:12] [W] [TRT] Tactic Device request: 4244MB Available: 1942MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:12] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:17] [W] [TRT] Tactic Device request: 4240MB Available: 1944MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:17] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4240 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:17] [W] [TRT] Tactic Device request: 4240MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:17] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4240 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:20] [W] [TRT] Tactic Device request: 4241MB Available: 1926MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:21] [W] [TRT] Tactic Device request: 4241MB Available: 1894MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:21] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:22] [W] [TRT] Tactic Device request: 4241MB Available: 1891MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:22] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:27] [W] [TRT] Tactic Device request: 4239MB Available: 1889MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4239 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:05:27] [W] [TRT] Tactic Device request: 4239MB Available: 1877MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:05:27] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4239 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:06:08] [W] [TRT] Tactic Device request: 1637MB Available: 1622MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:06:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:06:08] [W] [TRT] Tactic Device request: 1637MB Available: 1622MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:06:08] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:06:08] [W] [TRT] Tactic Device request: 1637MB Available: 1622MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:06:08] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:06:09] [W] [TRT] Tactic Device request: 1636MB Available: 1622MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:06:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1636 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:06:09] [W] [TRT] Tactic Device request: 1636MB Available: 1622MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:06:09] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1636 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:44] [W] [TRT] Tactic Device request: 1638MB Available: 1488MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1638 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:44] [W] [TRT] Tactic Device request: 1638MB Available: 1488MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:44] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1638 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:44] [W] [TRT] Tactic Device request: 1637MB Available: 1489MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:45] [W] [TRT] Tactic Device request: 1637MB Available: 1489MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:45] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:46] [W] [TRT] Tactic Device request: 3270MB Available: 1488MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:46] [W] [TRT] Tactic Device request: 3270MB Available: 1488MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:46] [W] [TRT] Tactic Device request: 3270MB Available: 1488MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:47] [W] [TRT] Tactic Device request: 3269MB Available: 1519MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3269 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:47] [W] [TRT] Tactic Device request: 3269MB Available: 1518MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:47] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3269 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:50] [W] [TRT] Tactic Device request: 4377MB Available: 1700MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:50] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:50] [W] [TRT] Tactic Device request: 2185MB Available: 1700MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:50] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:50] [W] [TRT] Tactic Device request: 4377MB Available: 1700MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:50] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:50] [W] [TRT] Tactic Device request: 2185MB Available: 1699MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:50] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:51] [W] [TRT] Tactic Device request: 4377MB Available: 1699MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:51] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:51] [W] [TRT] Tactic Device request: 2185MB Available: 1699MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:51] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:56] [W] [TRT] Tactic Device request: 4375MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:56] [W] [TRT] Tactic Device request: 2183MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:57] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:57] [W] [TRT] Tactic Device request: 4375MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:57] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:13:57] [W] [TRT] Tactic Device request: 2183MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:13:57] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 4376MB Available: 1823MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 2184MB Available: 1823MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 4376MB Available: 1823MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 2184MB Available: 1823MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 4376MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:01] [W] [TRT] Tactic Device request: 2184MB Available: 1823MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:01] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:07] [W] [TRT] Tactic Device request: 4375MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:07] [W] [TRT] Tactic Device request: 2183MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:07] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:07] [W] [TRT] Tactic Device request: 4375MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:14:07] [W] [TRT] Tactic Device request: 2183MB Available: 1821MB. Device memory is insufficient to use tactic.
-[12/28/2023-17:14:07] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-17:15:12] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-17:15:12] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-17:15:12] [W] * GPU compute time is unstable, with coefficient of variance = 5.39183%.
-[12/28/2023-17:15:12] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp16.onnx.fp16.engine.log

@@ -1,328 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.fp16.engine
-[12/28/2023-16:09:46] [I] === Model Options ===
-[12/28/2023-16:09:46] [I] Format: ONNX
-[12/28/2023-16:09:46] [I] Model: yolo_nas_pose_l_fp16.onnx
-[12/28/2023-16:09:46] [I] Output:
-[12/28/2023-16:09:46] [I] === Build Options ===
-[12/28/2023-16:09:46] [I] Max batch: explicit batch
-[12/28/2023-16:09:46] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-16:09:46] [I] minTiming: 1
-[12/28/2023-16:09:46] [I] avgTiming: 8
-[12/28/2023-16:09:46] [I] Precision: FP32+FP16
-[12/28/2023-16:09:46] [I] LayerPrecisions: 
-[12/28/2023-16:09:46] [I] Calibration: 
-[12/28/2023-16:09:46] [I] Refit: Disabled
-[12/28/2023-16:09:46] [I] Sparsity: Disabled
-[12/28/2023-16:09:46] [I] Safe mode: Disabled
-[12/28/2023-16:09:46] [I] DirectIO mode: Disabled
-[12/28/2023-16:09:46] [I] Restricted mode: Disabled
-[12/28/2023-16:09:46] [I] Build only: Disabled
-[12/28/2023-16:09:46] [I] Save engine: yolo_nas_pose_l_fp16.onnx.fp16.engine
-[12/28/2023-16:09:46] [I] Load engine: 
-[12/28/2023-16:09:46] [I] Profiling verbosity: 0
-[12/28/2023-16:09:46] [I] Tactic sources: Using default tactic sources
-[12/28/2023-16:09:46] [I] timingCacheMode: local
-[12/28/2023-16:09:46] [I] timingCacheFile: 
-[12/28/2023-16:09:46] [I] Heuristic: Disabled
-[12/28/2023-16:09:46] [I] Preview Features: Use default preview flags.
-[12/28/2023-16:09:46] [I] Input(s)s format: fp32:CHW
-[12/28/2023-16:09:46] [I] Output(s)s format: fp32:CHW
-[12/28/2023-16:09:46] [I] Input build shapes: model
-[12/28/2023-16:09:46] [I] Input calibration shapes: model
-[12/28/2023-16:09:46] [I] === System Options ===
-[12/28/2023-16:09:46] [I] Device: 0
-[12/28/2023-16:09:46] [I] DLACore: 
-[12/28/2023-16:09:46] [I] Plugins:
-[12/28/2023-16:09:46] [I] === Inference Options ===
-[12/28/2023-16:09:46] [I] Batch: Explicit
-[12/28/2023-16:09:46] [I] Input inference shapes: model
-[12/28/2023-16:09:46] [I] Iterations: 10
-[12/28/2023-16:09:46] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-16:09:46] [I] Sleep time: 0ms
-[12/28/2023-16:09:46] [I] Idle time: 0ms
-[12/28/2023-16:09:46] [I] Streams: 1
-[12/28/2023-16:09:46] [I] ExposeDMA: Disabled
-[12/28/2023-16:09:46] [I] Data transfers: Enabled
-[12/28/2023-16:09:46] [I] Spin-wait: Disabled
-[12/28/2023-16:09:46] [I] Multithreading: Disabled
-[12/28/2023-16:09:46] [I] CUDA Graph: Disabled
-[12/28/2023-16:09:46] [I] Separate profiling: Disabled
-[12/28/2023-16:09:46] [I] Time Deserialize: Disabled
-[12/28/2023-16:09:46] [I] Time Refit: Disabled
-[12/28/2023-16:09:46] [I] NVTX verbosity: 0
-[12/28/2023-16:09:46] [I] Persistent Cache Ratio: 0
-[12/28/2023-16:09:46] [I] Inputs:
-[12/28/2023-16:09:46] [I] === Reporting Options ===
-[12/28/2023-16:09:46] [I] Verbose: Disabled
-[12/28/2023-16:09:46] [I] Averages: 100 inferences
-[12/28/2023-16:09:46] [I] Percentiles: 90,95,99
-[12/28/2023-16:09:46] [I] Dump refittable layers:Disabled
-[12/28/2023-16:09:46] [I] Dump output: Disabled
-[12/28/2023-16:09:46] [I] Profile: Disabled
-[12/28/2023-16:09:46] [I] Export timing to JSON file: 
-[12/28/2023-16:09:46] [I] Export output to JSON file: 
-[12/28/2023-16:09:46] [I] Export profile to JSON file: 
-[12/28/2023-16:09:46] [I] 
-[12/28/2023-16:09:46] [I] === Device Information ===
-[12/28/2023-16:09:46] [I] Selected Device: Orin
-[12/28/2023-16:09:46] [I] Compute Capability: 8.7
-[12/28/2023-16:09:46] [I] SMs: 8
-[12/28/2023-16:09:46] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-16:09:46] [I] Device Global Memory: 7471 MiB
-[12/28/2023-16:09:46] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-16:09:46] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-16:09:46] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-16:09:46] [I] 
-[12/28/2023-16:09:46] [I] TensorRT version: 8.5.2
-[12/28/2023-16:09:46] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2974 (MiB)
-[12/28/2023-16:09:49] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +283, now: CPU 574, GPU 3280 (MiB)
-[12/28/2023-16:09:49] [I] Start parsing network model
-[12/28/2023-16:09:49] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-16:09:49] [I] [TRT] Input filename:   yolo_nas_pose_l_fp16.onnx
-[12/28/2023-16:09:49] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-16:09:49] [I] [TRT] Opset version:    17
-[12/28/2023-16:09:49] [I] [TRT] Producer name:    pytorch
-[12/28/2023-16:09:49] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-16:09:49] [I] [TRT] Domain:           
-[12/28/2023-16:09:49] [I] [TRT] Model version:    0
-[12/28/2023-16:09:49] [I] [TRT] Doc string:       
-[12/28/2023-16:09:49] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-16:09:49] [I] Finish parsing network model
-[12/28/2023-16:09:50] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-16:09:50] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 458) [Constant]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 459) [Constant]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 460) [Constant]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1...cast_boxes_to_fp32]}
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 462) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-16:09:50] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-16:10:01] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +353, now: CPU 1231, GPU 3827 (MiB)
-[12/28/2023-16:10:03] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +82, GPU +65, now: CPU 1313, GPU 3892 (MiB)
-[12/28/2023-16:10:03] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-17:14:35] [I] [TRT] Total Activation Memory: 8058785792
-[12/28/2023-17:14:35] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-17:14:49] [I] [TRT] Total Host Persistent Memory: 387328
-[12/28/2023-17:14:49] [I] [TRT] Total Device Persistent Memory: 51712
-[12/28/2023-17:14:49] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-17:14:49] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 69 MiB, GPU 2131 MiB
-[12/28/2023-17:14:49] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 196 steps to complete.
-[12/28/2023-17:14:49] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 90.8216ms to assign 13 blocks to 196 nodes requiring 160489472 bytes.
-[12/28/2023-17:14:49] [I] [TRT] Total Activation Memory: 160489472
-[12/28/2023-17:14:55] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -16, now: CPU 1661, GPU 5679 (MiB)
-[12/28/2023-17:14:55] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +16, GPU +128, now: CPU 16, GPU 128 (MiB)
-[12/28/2023-17:14:55] [I] Engine built in 3909.9 sec.
-[12/28/2023-17:14:56] [I] [TRT] Loaded engine size: 105 MiB
-[12/28/2023-17:14:56] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1347, GPU 5281 (MiB)
-[12/28/2023-17:14:56] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +103, now: CPU 0, GPU 103 (MiB)
-[12/28/2023-17:14:56] [I] Engine deserialized in 0.281193 sec.
-[12/28/2023-17:14:56] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -1, now: CPU 1348, GPU 5280 (MiB)
-[12/28/2023-17:14:56] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +154, now: CPU 0, GPU 257 (MiB)
-[12/28/2023-17:14:56] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-17:14:56] [I] Using random values for input onnx::Cast_0
-[12/28/2023-17:14:56] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-17:14:56] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-17:14:56] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-17:14:56] [I] Starting inference
-[12/28/2023-17:15:12] [I] Warmup completed 1 queries over 200 ms
-[12/28/2023-17:15:12] [I] Timing trace has 446 queries over 15.0628 s
-[12/28/2023-17:15:12] [I] 
-[12/28/2023-17:15:12] [I] === Trace details ===
-[12/28/2023-17:15:12] [I] Trace averages of 100 runs:
-[12/28/2023-17:15:12] [I] Average on 100 runs - GPU latency: 33.8846 ms - Host latency: 34.0014 ms (enqueue 33.9409 ms)
-[12/28/2023-17:15:12] [I] Average on 100 runs - GPU latency: 33.6823 ms - Host latency: 33.7942 ms (enqueue 33.7436 ms)
-[12/28/2023-17:15:12] [I] Average on 100 runs - GPU latency: 33.5307 ms - Host latency: 33.6433 ms (enqueue 33.5802 ms)
-[12/28/2023-17:15:12] [I] Average on 100 runs - GPU latency: 33.377 ms - Host latency: 33.4884 ms (enqueue 33.4514 ms)
-[12/28/2023-17:15:12] [I] 
-[12/28/2023-17:15:12] [I] === Performance summary ===
-[12/28/2023-17:15:12] [I] Throughput: 29.6093 qps
-[12/28/2023-17:15:12] [I] Latency: min = 31.7529 ms, max = 44.1514 ms, mean = 33.7469 ms, median = 33.4268 ms, percentile(90%) = 34.5583 ms, percentile(95%) = 37.8339 ms, percentile(99%) = 42.0027 ms
-[12/28/2023-17:15:12] [I] Enqueue Time: min = 31.7227 ms, max = 44.1133 ms, mean = 33.6924 ms, median = 33.4424 ms, percentile(90%) = 34.3545 ms, percentile(95%) = 37.7542 ms, percentile(99%) = 41.9526 ms
-[12/28/2023-17:15:12] [I] H2D Latency: min = 0.0800781 ms, max = 0.114746 ms, mean = 0.0954138 ms, median = 0.0969238 ms, percentile(90%) = 0.100098 ms, percentile(95%) = 0.100586 ms, percentile(99%) = 0.103027 ms
-[12/28/2023-17:15:12] [I] GPU Compute Time: min = 31.6406 ms, max = 44.0381 ms, mean = 33.6343 ms, median = 33.311 ms, percentile(90%) = 34.4478 ms, percentile(95%) = 37.7091 ms, percentile(99%) = 41.8918 ms
-[12/28/2023-17:15:12] [I] D2H Latency: min = 0.00292969 ms, max = 0.0541992 ms, mean = 0.017179 ms, median = 0.0146484 ms, percentile(90%) = 0.0290527 ms, percentile(95%) = 0.0314941 ms, percentile(99%) = 0.0361328 ms
-[12/28/2023-17:15:12] [I] Total Host Walltime: 15.0628 s
-[12/28/2023-17:15:12] [I] Total GPU Compute Time: 15.0009 s
-[12/28/2023-17:15:12] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-17:15:12] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.fp16.engine

yolo_nas_pose_l_fp16.onnx.int8.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-19:27:13] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-19:27:13] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-19:27:13] [E] Error[4]: [network.cpp::validate::2925] Error Code 4: Internal Error (fp16 precision has been set for a layer or layer output, but fp16 is not configured in the builder)
-[12/28/2023-19:27:13] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-19:27:13] [E] Engine could not be created from network
-[12/28/2023-19:27:13] [E] Building engine failed
-[12/28/2023-19:27:13] [E] Failed to create engine from model or file.
-[12/28/2023-19:27:13] [E] Engine set up failed

yolo_nas_pose_l_fp16.onnx.int8.engine.log

@@ -1,92 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.int8.engine
-[12/28/2023-19:27:02] [I] === Model Options ===
-[12/28/2023-19:27:02] [I] Format: ONNX
-[12/28/2023-19:27:02] [I] Model: yolo_nas_pose_l_fp16.onnx
-[12/28/2023-19:27:02] [I] Output:
-[12/28/2023-19:27:02] [I] === Build Options ===
-[12/28/2023-19:27:02] [I] Max batch: explicit batch
-[12/28/2023-19:27:02] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-19:27:02] [I] minTiming: 1
-[12/28/2023-19:27:02] [I] avgTiming: 8
-[12/28/2023-19:27:02] [I] Precision: FP32+INT8
-[12/28/2023-19:27:02] [I] LayerPrecisions: 
-[12/28/2023-19:27:02] [I] Calibration: Dynamic
-[12/28/2023-19:27:02] [I] Refit: Disabled
-[12/28/2023-19:27:02] [I] Sparsity: Disabled
-[12/28/2023-19:27:02] [I] Safe mode: Disabled
-[12/28/2023-19:27:02] [I] DirectIO mode: Disabled
-[12/28/2023-19:27:02] [I] Restricted mode: Disabled
-[12/28/2023-19:27:02] [I] Build only: Disabled
-[12/28/2023-19:27:02] [I] Save engine: yolo_nas_pose_l_fp16.onnx.int8.engine
-[12/28/2023-19:27:02] [I] Load engine: 
-[12/28/2023-19:27:02] [I] Profiling verbosity: 0
-[12/28/2023-19:27:02] [I] Tactic sources: Using default tactic sources
-[12/28/2023-19:27:02] [I] timingCacheMode: local
-[12/28/2023-19:27:02] [I] timingCacheFile: 
-[12/28/2023-19:27:02] [I] Heuristic: Disabled
-[12/28/2023-19:27:02] [I] Preview Features: Use default preview flags.
-[12/28/2023-19:27:02] [I] Input(s)s format: fp32:CHW
-[12/28/2023-19:27:02] [I] Output(s)s format: fp32:CHW
-[12/28/2023-19:27:02] [I] Input build shapes: model
-[12/28/2023-19:27:02] [I] Input calibration shapes: model
-[12/28/2023-19:27:02] [I] === System Options ===
-[12/28/2023-19:27:02] [I] Device: 0
-[12/28/2023-19:27:02] [I] DLACore: 
-[12/28/2023-19:27:02] [I] Plugins:
-[12/28/2023-19:27:02] [I] === Inference Options ===
-[12/28/2023-19:27:02] [I] Batch: Explicit
-[12/28/2023-19:27:02] [I] Input inference shapes: model
-[12/28/2023-19:27:02] [I] Iterations: 10
-[12/28/2023-19:27:02] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-19:27:02] [I] Sleep time: 0ms
-[12/28/2023-19:27:02] [I] Idle time: 0ms
-[12/28/2023-19:27:02] [I] Streams: 1
-[12/28/2023-19:27:02] [I] ExposeDMA: Disabled
-[12/28/2023-19:27:02] [I] Data transfers: Enabled
-[12/28/2023-19:27:02] [I] Spin-wait: Disabled
-[12/28/2023-19:27:02] [I] Multithreading: Disabled
-[12/28/2023-19:27:02] [I] CUDA Graph: Disabled
-[12/28/2023-19:27:02] [I] Separate profiling: Disabled
-[12/28/2023-19:27:02] [I] Time Deserialize: Disabled
-[12/28/2023-19:27:02] [I] Time Refit: Disabled
-[12/28/2023-19:27:02] [I] NVTX verbosity: 0
-[12/28/2023-19:27:02] [I] Persistent Cache Ratio: 0
-[12/28/2023-19:27:02] [I] Inputs:
-[12/28/2023-19:27:02] [I] === Reporting Options ===
-[12/28/2023-19:27:02] [I] Verbose: Disabled
-[12/28/2023-19:27:02] [I] Averages: 100 inferences
-[12/28/2023-19:27:02] [I] Percentiles: 90,95,99
-[12/28/2023-19:27:02] [I] Dump refittable layers:Disabled
-[12/28/2023-19:27:02] [I] Dump output: Disabled
-[12/28/2023-19:27:02] [I] Profile: Disabled
-[12/28/2023-19:27:02] [I] Export timing to JSON file: 
-[12/28/2023-19:27:02] [I] Export output to JSON file: 
-[12/28/2023-19:27:02] [I] Export profile to JSON file: 
-[12/28/2023-19:27:02] [I] 
-[12/28/2023-19:27:02] [I] === Device Information ===
-[12/28/2023-19:27:02] [I] Selected Device: Orin
-[12/28/2023-19:27:02] [I] Compute Capability: 8.7
-[12/28/2023-19:27:02] [I] SMs: 8
-[12/28/2023-19:27:02] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-19:27:02] [I] Device Global Memory: 7471 MiB
-[12/28/2023-19:27:02] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-19:27:02] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-19:27:02] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-19:27:02] [I] 
-[12/28/2023-19:27:02] [I] TensorRT version: 8.5.2
-[12/28/2023-19:27:07] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2837 (MiB)
-[12/28/2023-19:27:11] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +285, now: CPU 574, GPU 3142 (MiB)
-[12/28/2023-19:27:11] [I] Start parsing network model
-[12/28/2023-19:27:12] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:12] [I] [TRT] Input filename:   yolo_nas_pose_l_fp16.onnx
-[12/28/2023-19:27:12] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-19:27:12] [I] [TRT] Opset version:    17
-[12/28/2023-19:27:12] [I] [TRT] Producer name:    pytorch
-[12/28/2023-19:27:12] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-19:27:12] [I] [TRT] Domain:           
-[12/28/2023-19:27:12] [I] [TRT] Model version:    0
-[12/28/2023-19:27:12] [I] [TRT] Doc string:       
-[12/28/2023-19:27:12] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:13] [I] Finish parsing network model
-[12/28/2023-19:27:13] [I] FP32 and INT8 precisions have been specified - more performance might be enabled by additionally specifying --fp16 or --best
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp16.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp16.onnx.int8.engine

yolo_nas_pose_l_fp32.onnx.best.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:dea7e820c1d67f86f3b4c5749752351cb53d4f31886b72214b78d0621b27957f
-size 57142878

yolo_nas_pose_l_fp32.onnx.best.engine.err

@@ -1,504 +0,0 @@
-[12/28/2023-12:58:51] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-12:58:51] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-12:58:51] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
-[12/28/2023-13:32:07] [W] [TRT] Tactic Device request: 4720MB Available: 2945MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:07] [W] [TRT] Tactic Device request: 4720MB Available: 2943MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:07] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:08] [W] [TRT] Tactic Device request: 4720MB Available: 2943MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:08] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:13] [W] [TRT] Tactic Device request: 4706MB Available: 2945MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4706 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:14] [W] [TRT] Tactic Device request: 4706MB Available: 2944MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:14] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4706 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:18] [W] [TRT] Tactic Device request: 4711MB Available: 2921MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:19] [W] [TRT] Tactic Device request: 4711MB Available: 2920MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:19] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:19] [W] [TRT] Tactic Device request: 4711MB Available: 2919MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:19] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:24] [W] [TRT] Tactic Device request: 4702MB Available: 2920MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:24] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:25] [W] [TRT] Tactic Device request: 4702MB Available: 2921MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:25] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:29] [W] [TRT] Tactic Device request: 4711MB Available: 2875MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:30] [W] [TRT] Tactic Device request: 4711MB Available: 2875MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:30] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:30] [W] [TRT] Tactic Device request: 4711MB Available: 2874MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:30] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:35] [W] [TRT] Tactic Device request: 4702MB Available: 2874MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:32:36] [W] [TRT] Tactic Device request: 4702MB Available: 2874MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:32:36] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:10] [W] [TRT] Tactic Device request: 4711MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:10] [W] [TRT] Tactic Device request: 4711MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:11] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:11] [W] [TRT] Tactic Device request: 4711MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:11] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:13] [W] [TRT] Tactic Device request: 4701MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:13] [W] [TRT] Tactic Device request: 4701MB Available: 2316MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:13] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:32] [W] [TRT] Tactic Device request: 6275MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:32] [W] [TRT] Tactic Device request: 6275MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:32] [W] [TRT] Tactic Device request: 6275MB Available: 2317MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:34] [W] [TRT] Tactic Device request: 6270MB Available: 2318MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:40:34] [W] [TRT] Tactic Device request: 6270MB Available: 2318MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:40:34] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:21] [W] [TRT] Tactic Device request: 7056MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:21] [W] [TRT] Tactic Device request: 7056MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:21] [W] [TRT] Tactic Device request: 7056MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:21] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:23] [W] [TRT] Tactic Device request: 7050MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:23] [W] [TRT] Tactic Device request: 7050MB Available: 2079MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:23] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:44] [W] [TRT] Tactic Device request: 6354MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:45] [W] [TRT] Tactic Device request: 6354MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:45] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:45] [W] [TRT] Tactic Device request: 6354MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:45] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:47] [W] [TRT] Tactic Device request: 6351MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:47] [W] [TRT] Tactic Device request: 6351MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:47] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:49] [W] [TRT] Tactic Device request: 2127MB Available: 2079MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2127 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:50] [W] [TRT] Tactic Device request: 2127MB Available: 2078MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:50] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2127 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:50] [W] [TRT] Tactic Device request: 2127MB Available: 2078MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:50] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2127 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:53] [W] [TRT] Tactic Device request: 2124MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:53] [W] [TRT] Tactic Device request: 2124MB Available: 2072MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:53] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:56] [W] [TRT] Tactic Device request: 2125MB Available: 2070MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:56] [W] [TRT] Tactic Device request: 2125MB Available: 2052MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:56] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2125 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:57] [W] [TRT] Tactic Device request: 2125MB Available: 2052MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:57] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:51:59] [W] [TRT] Tactic Device request: 2124MB Available: 2053MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:51:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:00] [W] [TRT] Tactic Device request: 2124MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:00] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:02] [W] [TRT] Tactic Device request: 2125MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:02] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:03] [W] [TRT] Tactic Device request: 2125MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:03] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2125 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:03] [W] [TRT] Tactic Device request: 2125MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:03] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:06] [W] [TRT] Tactic Device request: 2124MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-13:52:06] [W] [TRT] Tactic Device request: 2124MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-13:52:06] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:20] [W] [TRT] Tactic Device request: 2394MB Available: 1765MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:20] [W] [TRT] Tactic Device request: 2394MB Available: 1764MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:20] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:20] [W] [TRT] Tactic Device request: 2394MB Available: 1764MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:20] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:21] [W] [TRT] Tactic Device request: 2392MB Available: 1765MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:21] [W] [TRT] Tactic Device request: 2392MB Available: 1764MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:21] [W] [TRT] Tactic Device request: 2392MB Available: 1764MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:21] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:22] [W] [TRT] Tactic Device request: 2391MB Available: 1764MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:23] [W] [TRT] Tactic Device request: 2391MB Available: 1763MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:23] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:23] [W] [TRT] Tactic Device request: 2390MB Available: 1763MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:23] [W] [TRT] Tactic Device request: 2390MB Available: 1763MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:23] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:41] [W] [TRT] Tactic Device request: 6540MB Available: 1782MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:41] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:41] [W] [TRT] Tactic Device request: 6540MB Available: 1781MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:41] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:42] [W] [TRT] Tactic Device request: 6540MB Available: 1781MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:42] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:44] [W] [TRT] Tactic Device request: 6538MB Available: 1781MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6538 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:44] [W] [TRT] Tactic Device request: 6538MB Available: 1781MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:44] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6538 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:47] [W] [TRT] Tactic Device request: 2191MB Available: 1783MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:48] [W] [TRT] Tactic Device request: 2191MB Available: 1783MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:48] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2191 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:48] [W] [TRT] Tactic Device request: 2191MB Available: 1782MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:49] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:52] [W] [TRT] Tactic Device request: 2190MB Available: 1779MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:53] [W] [TRT] Tactic Device request: 2190MB Available: 1779MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:53] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:57] [W] [TRT] Tactic Device request: 2190MB Available: 1780MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:58] [W] [TRT] Tactic Device request: 2190MB Available: 1778MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:58] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:06:59] [W] [TRT] Tactic Device request: 2190MB Available: 1775MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:06:59] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:03] [W] [TRT] Tactic Device request: 2190MB Available: 1778MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:03] [W] [TRT] Tactic Device request: 2190MB Available: 1777MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:08] [W] [TRT] Tactic Device request: 2190MB Available: 1778MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:09] [W] [TRT] Tactic Device request: 2190MB Available: 1779MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:09] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:09] [W] [TRT] Tactic Device request: 2190MB Available: 1778MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:09] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:13] [W] [TRT] Tactic Device request: 2190MB Available: 1778MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:07:14] [W] [TRT] Tactic Device request: 2190MB Available: 1776MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:07:14] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:03] [W] [TRT] Tactic Device request: 2457MB Available: 2222MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:03] [W] [TRT] Tactic Device request: 2457MB Available: 2222MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:03] [W] [TRT] Tactic Device request: 2457MB Available: 2222MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:05] [W] [TRT] Tactic Device request: 2456MB Available: 2224MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:05] [W] [TRT] Tactic Device request: 2456MB Available: 2224MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:05] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:32] [W] [TRT] Tactic Device request: 3587MB Available: 1846MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:32] [W] [TRT] Tactic Device request: 3587MB Available: 1846MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:32] [W] [TRT] Tactic Device request: 3587MB Available: 1846MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:33] [W] [TRT] Tactic Device request: 3585MB Available: 1846MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:15:34] [W] [TRT] Tactic Device request: 3585MB Available: 1846MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:15:34] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:21] [W] [TRT] Tactic Device request: 3556MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:21] [W] [TRT] Tactic Device request: 3556MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:22] [W] [TRT] Tactic Device request: 3556MB Available: 1714MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:22] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:23] [W] [TRT] Tactic Device request: 3551MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:23] [W] [TRT] Tactic Device request: 3551MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:23] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:25] [W] [TRT] Tactic Device request: 3140MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:25] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:25] [W] [TRT] Tactic Device request: 3140MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:25] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:25] [W] [TRT] Tactic Device request: 3140MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:25] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:26] [W] [TRT] Tactic Device request: 3136MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3136 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:28:26] [W] [TRT] Tactic Device request: 3136MB Available: 1715MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:28:26] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3136 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:35] [W] [TRT] Tactic Device request: 3161MB Available: 2110MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:36] [W] [TRT] Tactic Device request: 3161MB Available: 2110MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:36] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:36] [W] [TRT] Tactic Device request: 3161MB Available: 2110MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:36] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:37] [W] [TRT] Tactic Device request: 3156MB Available: 2109MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3156 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:37] [W] [TRT] Tactic Device request: 3156MB Available: 2109MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:37] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3156 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:43] [W] [TRT] Tactic Device request: 4189MB Available: 2109MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:44] [W] [TRT] Tactic Device request: 4189MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:44] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:44] [W] [TRT] Tactic Device request: 4189MB Available: 2087MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:44] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:49] [W] [TRT] Tactic Device request: 4183MB Available: 2085MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4183 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:49] [W] [TRT] Tactic Device request: 4183MB Available: 2082MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4183 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:52] [W] [TRT] Tactic Device request: 4186MB Available: 2082MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:53] [W] [TRT] Tactic Device request: 4186MB Available: 2061MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:53] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:53] [W] [TRT] Tactic Device request: 4186MB Available: 2060MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:53] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:57] [W] [TRT] Tactic Device request: 4182MB Available: 2059MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4182 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:40:58] [W] [TRT] Tactic Device request: 4182MB Available: 2054MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:40:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4182 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:46] [W] [TRT] Tactic Device request: 4764MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:46] [W] [TRT] Tactic Device request: 4764MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:46] [W] [TRT] Tactic Device request: 4764MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:48] [W] [TRT] Tactic Device request: 4761MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4761 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:48] [W] [TRT] Tactic Device request: 4761MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:48] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4761 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:56] [W] [TRT] Tactic Device request: 4244MB Available: 1833MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:57] [W] [TRT] Tactic Device request: 4244MB Available: 1504MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:57] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:53:58] [W] [TRT] Tactic Device request: 4244MB Available: 1500MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:53:58] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:03] [W] [TRT] Tactic Device request: 4240MB Available: 1498MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4240 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:03] [W] [TRT] Tactic Device request: 4240MB Available: 1494MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4240 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:08] [W] [TRT] Tactic Device request: 4241MB Available: 1553MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:09] [W] [TRT] Tactic Device request: 4241MB Available: 1514MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:09] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:10] [W] [TRT] Tactic Device request: 4241MB Available: 1508MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:10] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:14] [W] [TRT] Tactic Device request: 4239MB Available: 1510MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4239 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:54:15] [W] [TRT] Tactic Device request: 4239MB Available: 1496MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:54:15] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4239 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:55:04] [W] [TRT] Tactic Device request: 1637MB Available: 1234MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:55:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:55:04] [W] [TRT] Tactic Device request: 1637MB Available: 1234MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:55:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:55:04] [W] [TRT] Tactic Device request: 1637MB Available: 1234MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:55:04] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:55:05] [W] [TRT] Tactic Device request: 1636MB Available: 1268MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:55:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1636 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-14:55:05] [W] [TRT] Tactic Device request: 1636MB Available: 1268MB. Device memory is insufficient to use tactic.
-[12/28/2023-14:55:05] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1636 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:11] [W] [TRT] Tactic Device request: 1638MB Available: 1062MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:12] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1638 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:12] [W] [TRT] Tactic Device request: 1638MB Available: 1063MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:12] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1638 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:14] [W] [TRT] Tactic Device request: 1637MB Available: 1065MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:14] [W] [TRT] Tactic Device request: 1637MB Available: 1065MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:14] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:16] [W] [TRT] Tactic Device request: 3270MB Available: 1064MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:17] [W] [TRT] Tactic Device request: 3270MB Available: 1064MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:17] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:17] [W] [TRT] Tactic Device request: 3270MB Available: 1064MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:17] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:18] [W] [TRT] Tactic Device request: 3269MB Available: 1063MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3269 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:19] [W] [TRT] Tactic Device request: 3269MB Available: 1063MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:19] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3269 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:22] [W] [TRT] Tactic Device request: 4377MB Available: 1060MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:22] [W] [TRT] Tactic Device request: 2185MB Available: 1060MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:22] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:23] [W] [TRT] Tactic Device request: 4377MB Available: 1061MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:23] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:23] [W] [TRT] Tactic Device request: 2185MB Available: 1061MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:23] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:23] [W] [TRT] Tactic Device request: 4377MB Available: 1060MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:23] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:23] [W] [TRT] Tactic Device request: 2185MB Available: 1060MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:23] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:29] [W] [TRT] Tactic Device request: 4375MB Available: 1059MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:29] [W] [TRT] Tactic Device request: 2183MB Available: 1059MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:29] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:29] [W] [TRT] Tactic Device request: 4375MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:29] [W] [TRT] Tactic Device request: 2183MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:29] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:36] [W] [TRT] Tactic Device request: 4376MB Available: 1050MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:36] [W] [TRT] Tactic Device request: 2184MB Available: 1049MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:36] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:36] [W] [TRT] Tactic Device request: 4376MB Available: 1037MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:36] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:36] [W] [TRT] Tactic Device request: 2184MB Available: 1037MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:36] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:37] [W] [TRT] Tactic Device request: 4376MB Available: 1036MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:37] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:37] [W] [TRT] Tactic Device request: 2184MB Available: 1036MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:37] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:42] [W] [TRT] Tactic Device request: 4375MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:42] [W] [TRT] Tactic Device request: 2183MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:42] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:43] [W] [TRT] Tactic Device request: 4375MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:08:43] [W] [TRT] Tactic Device request: 2183MB Available: 1058MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:08:43] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:09:47] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
-[12/28/2023-15:09:47] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
-[12/28/2023-15:09:47] [W] [TRT] Check verbose logs for the list of affected weights.
-[12/28/2023-15:09:47] [W] [TRT] - 114 weights are affected by this issue: Detected subnormal FP16 values.
-[12/28/2023-15:09:47] [W] [TRT] - 40 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
-[12/28/2023-15:10:04] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-15:10:04] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-15:10:04] [W] * GPU compute time is unstable, with coefficient of variance = 7.00146%.
-[12/28/2023-15:10:04] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp32.onnx.best.engine.log

@@ -1,331 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.best.engine
-[12/28/2023-12:58:38] [I] === Model Options ===
-[12/28/2023-12:58:38] [I] Format: ONNX
-[12/28/2023-12:58:38] [I] Model: yolo_nas_pose_l_fp32.onnx
-[12/28/2023-12:58:38] [I] Output:
-[12/28/2023-12:58:38] [I] === Build Options ===
-[12/28/2023-12:58:38] [I] Max batch: explicit batch
-[12/28/2023-12:58:38] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-12:58:38] [I] minTiming: 1
-[12/28/2023-12:58:38] [I] avgTiming: 8
-[12/28/2023-12:58:38] [I] Precision: FP32+FP16+INT8
-[12/28/2023-12:58:38] [I] LayerPrecisions: 
-[12/28/2023-12:58:38] [I] Calibration: Dynamic
-[12/28/2023-12:58:38] [I] Refit: Disabled
-[12/28/2023-12:58:38] [I] Sparsity: Disabled
-[12/28/2023-12:58:38] [I] Safe mode: Disabled
-[12/28/2023-12:58:38] [I] DirectIO mode: Disabled
-[12/28/2023-12:58:38] [I] Restricted mode: Disabled
-[12/28/2023-12:58:38] [I] Build only: Disabled
-[12/28/2023-12:58:38] [I] Save engine: yolo_nas_pose_l_fp32.onnx.best.engine
-[12/28/2023-12:58:38] [I] Load engine: 
-[12/28/2023-12:58:38] [I] Profiling verbosity: 0
-[12/28/2023-12:58:38] [I] Tactic sources: Using default tactic sources
-[12/28/2023-12:58:38] [I] timingCacheMode: local
-[12/28/2023-12:58:38] [I] timingCacheFile: 
-[12/28/2023-12:58:38] [I] Heuristic: Disabled
-[12/28/2023-12:58:38] [I] Preview Features: Use default preview flags.
-[12/28/2023-12:58:38] [I] Input(s)s format: fp32:CHW
-[12/28/2023-12:58:38] [I] Output(s)s format: fp32:CHW
-[12/28/2023-12:58:38] [I] Input build shapes: model
-[12/28/2023-12:58:38] [I] Input calibration shapes: model
-[12/28/2023-12:58:38] [I] === System Options ===
-[12/28/2023-12:58:38] [I] Device: 0
-[12/28/2023-12:58:38] [I] DLACore: 
-[12/28/2023-12:58:38] [I] Plugins:
-[12/28/2023-12:58:38] [I] === Inference Options ===
-[12/28/2023-12:58:38] [I] Batch: Explicit
-[12/28/2023-12:58:38] [I] Input inference shapes: model
-[12/28/2023-12:58:38] [I] Iterations: 10
-[12/28/2023-12:58:38] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-12:58:38] [I] Sleep time: 0ms
-[12/28/2023-12:58:38] [I] Idle time: 0ms
-[12/28/2023-12:58:38] [I] Streams: 1
-[12/28/2023-12:58:38] [I] ExposeDMA: Disabled
-[12/28/2023-12:58:38] [I] Data transfers: Enabled
-[12/28/2023-12:58:38] [I] Spin-wait: Disabled
-[12/28/2023-12:58:38] [I] Multithreading: Disabled
-[12/28/2023-12:58:38] [I] CUDA Graph: Disabled
-[12/28/2023-12:58:38] [I] Separate profiling: Disabled
-[12/28/2023-12:58:38] [I] Time Deserialize: Disabled
-[12/28/2023-12:58:38] [I] Time Refit: Disabled
-[12/28/2023-12:58:38] [I] NVTX verbosity: 0
-[12/28/2023-12:58:38] [I] Persistent Cache Ratio: 0
-[12/28/2023-12:58:38] [I] Inputs:
-[12/28/2023-12:58:38] [I] === Reporting Options ===
-[12/28/2023-12:58:38] [I] Verbose: Disabled
-[12/28/2023-12:58:38] [I] Averages: 100 inferences
-[12/28/2023-12:58:38] [I] Percentiles: 90,95,99
-[12/28/2023-12:58:38] [I] Dump refittable layers:Disabled
-[12/28/2023-12:58:38] [I] Dump output: Disabled
-[12/28/2023-12:58:38] [I] Profile: Disabled
-[12/28/2023-12:58:38] [I] Export timing to JSON file: 
-[12/28/2023-12:58:38] [I] Export output to JSON file: 
-[12/28/2023-12:58:38] [I] Export profile to JSON file: 
-[12/28/2023-12:58:38] [I] 
-[12/28/2023-12:58:38] [I] === Device Information ===
-[12/28/2023-12:58:38] [I] Selected Device: Orin
-[12/28/2023-12:58:38] [I] Compute Capability: 8.7
-[12/28/2023-12:58:38] [I] SMs: 8
-[12/28/2023-12:58:38] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-12:58:38] [I] Device Global Memory: 7471 MiB
-[12/28/2023-12:58:38] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-12:58:38] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-12:58:38] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-12:58:38] [I] 
-[12/28/2023-12:58:38] [I] TensorRT version: 8.5.2
-[12/28/2023-12:58:43] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3010 (MiB)
-[12/28/2023-12:58:48] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +283, now: CPU 574, GPU 3313 (MiB)
-[12/28/2023-12:58:48] [I] Start parsing network model
-[12/28/2023-12:58:51] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-12:58:51] [I] [TRT] Input filename:   yolo_nas_pose_l_fp32.onnx
-[12/28/2023-12:58:51] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-12:58:51] [I] [TRT] Opset version:    17
-[12/28/2023-12:58:51] [I] [TRT] Producer name:    pytorch
-[12/28/2023-12:58:51] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-12:58:51] [I] [TRT] Domain:           
-[12/28/2023-12:58:51] [I] [TRT] Model version:    0
-[12/28/2023-12:58:51] [I] [TRT] Doc string:       
-[12/28/2023-12:58:51] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-12:58:51] [I] Finish parsing network model
-[12/28/2023-12:58:52] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-12:58:52] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 455) [Constant]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 456) [Constant]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 457) [Constant]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 459) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-12:58:52] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-12:59:03] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +411, now: CPU 1351, GPU 3918 (MiB)
-[12/28/2023-12:59:05] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +82, GPU +80, now: CPU 1433, GPU 3998 (MiB)
-[12/28/2023-12:59:05] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-15:09:20] [I] [TRT] Total Activation Memory: 7964877312
-[12/28/2023-15:09:20] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-15:09:38] [I] [TRT] Total Host Persistent Memory: 331680
-[12/28/2023-15:09:38] [I] [TRT] Total Device Persistent Memory: 38912
-[12/28/2023-15:09:38] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-15:09:38] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 88 MiB, GPU 2110 MiB
-[12/28/2023-15:09:38] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 176 steps to complete.
-[12/28/2023-15:09:38] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 114.49ms to assign 14 blocks to 176 nodes requiring 147384320 bytes.
-[12/28/2023-15:09:38] [I] [TRT] Total Activation Memory: 147384320
-[12/28/2023-15:09:47] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -15, now: CPU 1838, GPU 5747 (MiB)
-[12/28/2023-15:09:47] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +53, GPU +64, now: CPU 53, GPU 64 (MiB)
-[12/28/2023-15:09:48] [I] Engine built in 7870.12 sec.
-[12/28/2023-15:09:48] [I] [TRT] Loaded engine size: 54 MiB
-[12/28/2023-15:09:48] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1299, GPU 5509 (MiB)
-[12/28/2023-15:09:48] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +52, now: CPU 0, GPU 52 (MiB)
-[12/28/2023-15:09:48] [I] Engine deserialized in 0.136755 sec.
-[12/28/2023-15:09:48] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1300, GPU 5509 (MiB)
-[12/28/2023-15:09:48] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +140, now: CPU 0, GPU 192 (MiB)
-[12/28/2023-15:09:48] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-15:09:48] [I] Using random values for input onnx::Cast_0
-[12/28/2023-15:09:48] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-15:09:48] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-15:09:48] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-15:09:48] [I] Starting inference
-[12/28/2023-15:10:04] [I] Warmup completed 2 queries over 200 ms
-[12/28/2023-15:10:04] [I] Timing trace has 712 queries over 15.0201 s
-[12/28/2023-15:10:04] [I] 
-[12/28/2023-15:10:04] [I] === Trace details ===
-[12/28/2023-15:10:04] [I] Trace averages of 100 runs:
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 21.1141 ms - Host latency: 21.2281 ms (enqueue 21.1848 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 21.2938 ms - Host latency: 21.4086 ms (enqueue 21.3535 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 20.5876 ms - Host latency: 20.6987 ms (enqueue 20.679 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 20.9284 ms - Host latency: 21.0399 ms (enqueue 20.9968 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 21.3846 ms - Host latency: 21.5023 ms (enqueue 21.4432 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 20.5315 ms - Host latency: 20.6422 ms (enqueue 20.6192 ms)
-[12/28/2023-15:10:04] [I] Average on 100 runs - GPU latency: 20.7566 ms - Host latency: 20.8657 ms (enqueue 20.8177 ms)
-[12/28/2023-15:10:04] [I] 
-[12/28/2023-15:10:04] [I] === Performance summary ===
-[12/28/2023-15:10:04] [I] Throughput: 47.4032 qps
-[12/28/2023-15:10:04] [I] Latency: min = 19.6377 ms, max = 32.405 ms, mean = 21.0632 ms, median = 20.583 ms, percentile(90%) = 21.897 ms, percentile(95%) = 23.0127 ms, percentile(99%) = 29.6182 ms
-[12/28/2023-15:10:04] [I] Enqueue Time: min = 19.6035 ms, max = 33.8328 ms, mean = 21.0211 ms, median = 20.5366 ms, percentile(90%) = 21.8384 ms, percentile(95%) = 22.998 ms, percentile(99%) = 29.0708 ms
-[12/28/2023-15:10:04] [I] H2D Latency: min = 0.0800781 ms, max = 0.128906 ms, mean = 0.0964459 ms, median = 0.097168 ms, percentile(90%) = 0.0991211 ms, percentile(95%) = 0.0996094 ms, percentile(99%) = 0.110474 ms
-[12/28/2023-15:10:04] [I] GPU Compute Time: min = 19.5264 ms, max = 32.2937 ms, mean = 20.9506 ms, median = 20.4727 ms, percentile(90%) = 21.7739 ms, percentile(95%) = 22.8984 ms, percentile(99%) = 29.5049 ms
-[12/28/2023-15:10:04] [I] D2H Latency: min = 0.00341797 ms, max = 0.0615234 ms, mean = 0.0161761 ms, median = 0.0136719 ms, percentile(90%) = 0.0258789 ms, percentile(95%) = 0.0273438 ms, percentile(99%) = 0.03125 ms
-[12/28/2023-15:10:04] [I] Total Host Walltime: 15.0201 s
-[12/28/2023-15:10:04] [I] Total GPU Compute Time: 14.9168 s
-[12/28/2023-15:10:04] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-15:10:04] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.best.engine

yolo_nas_pose_l_fp32.onnx.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:41ae49ee96e19ad3d8bfede2728e2c7fb331aa5a1d99fc7b5e139b10ec687299
-size 219687473

yolo_nas_pose_l_fp32.onnx.engine.err

@@ -1,237 +0,0 @@
-[12/28/2023-11:29:23] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-11:29:23] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-11:30:52] [W] [TRT] Tactic Device request: 4720MB Available: 2387MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:30:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:30:53] [W] [TRT] Tactic Device request: 4720MB Available: 2388MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:30:53] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:30:54] [W] [TRT] Tactic Device request: 4720MB Available: 2389MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:30:54] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:30:59] [W] [TRT] Tactic Device request: 4711MB Available: 2388MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:30:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:31:00] [W] [TRT] Tactic Device request: 4711MB Available: 2388MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:31:00] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:31:00] [W] [TRT] Tactic Device request: 4711MB Available: 2389MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:31:00] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:39] [W] [TRT] Tactic Device request: 4711MB Available: 2349MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:39] [W] [TRT] Tactic Device request: 4711MB Available: 2348MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:39] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:39] [W] [TRT] Tactic Device request: 4711MB Available: 2349MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:39] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:51] [W] [TRT] Tactic Device request: 6275MB Available: 2347MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:51] [W] [TRT] Tactic Device request: 6275MB Available: 2348MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:51] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:32:51] [W] [TRT] Tactic Device request: 6275MB Available: 2350MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:32:51] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:14] [W] [TRT] Tactic Device request: 7056MB Available: 2331MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:14] [W] [TRT] Tactic Device request: 7056MB Available: 2330MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:14] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:15] [W] [TRT] Tactic Device request: 7056MB Available: 2330MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:15] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:27] [W] [TRT] Tactic Device request: 6354MB Available: 2331MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:27] [W] [TRT] Tactic Device request: 6354MB Available: 2331MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:27] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:35:27] [W] [TRT] Tactic Device request: 6354MB Available: 2331MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:35:27] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:31] [W] [TRT] Tactic Device request: 2394MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:31] [W] [TRT] Tactic Device request: 2394MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:31] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:31] [W] [TRT] Tactic Device request: 2394MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:31] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:32] [W] [TRT] Tactic Device request: 2392MB Available: 2272MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:32] [W] [TRT] Tactic Device request: 2392MB Available: 2272MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:32] [W] [TRT] Tactic Device request: 2392MB Available: 2272MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:41] [W] [TRT] Tactic Device request: 6540MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:41] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:42] [W] [TRT] Tactic Device request: 6540MB Available: 2262MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:42] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:42] [W] [TRT] Tactic Device request: 6540MB Available: 2262MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:42] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:46] [W] [TRT] Tactic Device request: 2191MB Available: 2163MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:46] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2191 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:47] [W] [TRT] Tactic Device request: 2191MB Available: 2160MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:47] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:51] [W] [TRT] Tactic Device request: 2190MB Available: 2161MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:52] [W] [TRT] Tactic Device request: 2190MB Available: 2161MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:52] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:38:53] [W] [TRT] Tactic Device request: 2190MB Available: 2161MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:38:53] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:32] [W] [TRT] Tactic Device request: 2457MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:32] [W] [TRT] Tactic Device request: 2457MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:32] [W] [TRT] Tactic Device request: 2457MB Available: 2131MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:46] [W] [TRT] Tactic Device request: 3587MB Available: 2158MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:46] [W] [TRT] Tactic Device request: 3587MB Available: 2158MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:40:46] [W] [TRT] Tactic Device request: 3587MB Available: 2158MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:40:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:23] [W] [TRT] Tactic Device request: 3556MB Available: 2179MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:23] [W] [TRT] Tactic Device request: 3556MB Available: 2179MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:23] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:23] [W] [TRT] Tactic Device request: 3556MB Available: 2179MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:23] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:24] [W] [TRT] Tactic Device request: 3140MB Available: 2178MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:24] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:24] [W] [TRT] Tactic Device request: 3140MB Available: 2178MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:24] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:43:24] [W] [TRT] Tactic Device request: 3140MB Available: 2178MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:43:24] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:43] [W] [TRT] Tactic Device request: 3161MB Available: 2140MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:43] [W] [TRT] Tactic Device request: 3161MB Available: 2140MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:43] [W] [TRT] Tactic Device request: 3161MB Available: 2140MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:46] [W] [TRT] Tactic Device request: 4189MB Available: 2138MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:47] [W] [TRT] Tactic Device request: 4189MB Available: 2138MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:47] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:47] [W] [TRT] Tactic Device request: 4189MB Available: 2140MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:47] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:51] [W] [TRT] Tactic Device request: 4186MB Available: 2139MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:52] [W] [TRT] Tactic Device request: 4186MB Available: 2139MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:52] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:45:52] [W] [TRT] Tactic Device request: 4186MB Available: 2138MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:45:52] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:34] [W] [TRT] Tactic Device request: 4764MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:34] [W] [TRT] Tactic Device request: 4764MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:34] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:34] [W] [TRT] Tactic Device request: 4764MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:34] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:39] [W] [TRT] Tactic Device request: 4244MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:40] [W] [TRT] Tactic Device request: 4244MB Available: 2081MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:40] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:41] [W] [TRT] Tactic Device request: 4244MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:41] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:46] [W] [TRT] Tactic Device request: 4241MB Available: 2082MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:47] [W] [TRT] Tactic Device request: 4241MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:47] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:48:48] [W] [TRT] Tactic Device request: 4241MB Available: 2080MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:48:48] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:51:58] [W] [TRT] Tactic Device request: 3270MB Available: 2043MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:51:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:51:58] [W] [TRT] Tactic Device request: 3270MB Available: 2043MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:51:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:51:58] [W] [TRT] Tactic Device request: 3270MB Available: 2043MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:51:58] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:01] [W] [TRT] Tactic Device request: 4377MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:01] [W] [TRT] Tactic Device request: 2185MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:01] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:01] [W] [TRT] Tactic Device request: 4377MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:01] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:01] [W] [TRT] Tactic Device request: 2185MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:01] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:02] [W] [TRT] Tactic Device request: 4377MB Available: 2039MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:02] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:02] [W] [TRT] Tactic Device request: 2185MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:02] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 4376MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 2184MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 4376MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 2184MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 4376MB Available: 2037MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:09] [W] [TRT] Tactic Device request: 2184MB Available: 2038MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:52:09] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:52:51] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-11:52:51] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-11:52:51] [W] * GPU compute time is unstable, with coefficient of variance = 4.81745%.
-[12/28/2023-11:52:51] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp32.onnx.engine.log

@@ -1,326 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.engine
-[12/28/2023-11:29:16] [I] === Model Options ===
-[12/28/2023-11:29:16] [I] Format: ONNX
-[12/28/2023-11:29:16] [I] Model: yolo_nas_pose_l_fp32.onnx
-[12/28/2023-11:29:16] [I] Output:
-[12/28/2023-11:29:16] [I] === Build Options ===
-[12/28/2023-11:29:16] [I] Max batch: explicit batch
-[12/28/2023-11:29:16] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-11:29:16] [I] minTiming: 1
-[12/28/2023-11:29:16] [I] avgTiming: 8
-[12/28/2023-11:29:16] [I] Precision: FP32
-[12/28/2023-11:29:16] [I] LayerPrecisions: 
-[12/28/2023-11:29:16] [I] Calibration: 
-[12/28/2023-11:29:16] [I] Refit: Disabled
-[12/28/2023-11:29:16] [I] Sparsity: Disabled
-[12/28/2023-11:29:16] [I] Safe mode: Disabled
-[12/28/2023-11:29:16] [I] DirectIO mode: Disabled
-[12/28/2023-11:29:16] [I] Restricted mode: Disabled
-[12/28/2023-11:29:16] [I] Build only: Disabled
-[12/28/2023-11:29:16] [I] Save engine: yolo_nas_pose_l_fp32.onnx.engine
-[12/28/2023-11:29:16] [I] Load engine: 
-[12/28/2023-11:29:16] [I] Profiling verbosity: 0
-[12/28/2023-11:29:16] [I] Tactic sources: Using default tactic sources
-[12/28/2023-11:29:16] [I] timingCacheMode: local
-[12/28/2023-11:29:16] [I] timingCacheFile: 
-[12/28/2023-11:29:16] [I] Heuristic: Disabled
-[12/28/2023-11:29:16] [I] Preview Features: Use default preview flags.
-[12/28/2023-11:29:16] [I] Input(s)s format: fp32:CHW
-[12/28/2023-11:29:16] [I] Output(s)s format: fp32:CHW
-[12/28/2023-11:29:16] [I] Input build shapes: model
-[12/28/2023-11:29:16] [I] Input calibration shapes: model
-[12/28/2023-11:29:16] [I] === System Options ===
-[12/28/2023-11:29:16] [I] Device: 0
-[12/28/2023-11:29:16] [I] DLACore: 
-[12/28/2023-11:29:16] [I] Plugins:
-[12/28/2023-11:29:16] [I] === Inference Options ===
-[12/28/2023-11:29:16] [I] Batch: Explicit
-[12/28/2023-11:29:16] [I] Input inference shapes: model
-[12/28/2023-11:29:16] [I] Iterations: 10
-[12/28/2023-11:29:16] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-11:29:16] [I] Sleep time: 0ms
-[12/28/2023-11:29:16] [I] Idle time: 0ms
-[12/28/2023-11:29:16] [I] Streams: 1
-[12/28/2023-11:29:16] [I] ExposeDMA: Disabled
-[12/28/2023-11:29:16] [I] Data transfers: Enabled
-[12/28/2023-11:29:16] [I] Spin-wait: Disabled
-[12/28/2023-11:29:16] [I] Multithreading: Disabled
-[12/28/2023-11:29:16] [I] CUDA Graph: Disabled
-[12/28/2023-11:29:16] [I] Separate profiling: Disabled
-[12/28/2023-11:29:16] [I] Time Deserialize: Disabled
-[12/28/2023-11:29:16] [I] Time Refit: Disabled
-[12/28/2023-11:29:16] [I] NVTX verbosity: 0
-[12/28/2023-11:29:16] [I] Persistent Cache Ratio: 0
-[12/28/2023-11:29:16] [I] Inputs:
-[12/28/2023-11:29:16] [I] === Reporting Options ===
-[12/28/2023-11:29:16] [I] Verbose: Disabled
-[12/28/2023-11:29:16] [I] Averages: 100 inferences
-[12/28/2023-11:29:16] [I] Percentiles: 90,95,99
-[12/28/2023-11:29:16] [I] Dump refittable layers:Disabled
-[12/28/2023-11:29:16] [I] Dump output: Disabled
-[12/28/2023-11:29:16] [I] Profile: Disabled
-[12/28/2023-11:29:16] [I] Export timing to JSON file: 
-[12/28/2023-11:29:16] [I] Export output to JSON file: 
-[12/28/2023-11:29:16] [I] Export profile to JSON file: 
-[12/28/2023-11:29:16] [I] 
-[12/28/2023-11:29:16] [I] === Device Information ===
-[12/28/2023-11:29:16] [I] Selected Device: Orin
-[12/28/2023-11:29:16] [I] Compute Capability: 8.7
-[12/28/2023-11:29:16] [I] SMs: 8
-[12/28/2023-11:29:16] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-11:29:16] [I] Device Global Memory: 7471 MiB
-[12/28/2023-11:29:16] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-11:29:16] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-11:29:16] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-11:29:16] [I] 
-[12/28/2023-11:29:16] [I] TensorRT version: 8.5.2
-[12/28/2023-11:29:17] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3132 (MiB)
-[12/28/2023-11:29:20] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +424, now: CPU 574, GPU 3573 (MiB)
-[12/28/2023-11:29:20] [I] Start parsing network model
-[12/28/2023-11:29:23] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-11:29:23] [I] [TRT] Input filename:   yolo_nas_pose_l_fp32.onnx
-[12/28/2023-11:29:23] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-11:29:23] [I] [TRT] Opset version:    17
-[12/28/2023-11:29:23] [I] [TRT] Producer name:    pytorch
-[12/28/2023-11:29:23] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-11:29:23] [I] [TRT] Domain:           
-[12/28/2023-11:29:23] [I] [TRT] Model version:    0
-[12/28/2023-11:29:23] [I] [TRT] Doc string:       
-[12/28/2023-11:29:23] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-11:29:23] [I] Finish parsing network model
-[12/28/2023-11:29:23] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-11:29:23] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 455) [Constant]
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 456) [Constant]
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 457) [Constant]
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-11:29:23] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 459) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-11:29:24] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-11:29:25] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +763, now: CPU 1350, GPU 4631 (MiB)
-[12/28/2023-11:29:25] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +131, now: CPU 1433, GPU 4762 (MiB)
-[12/28/2023-11:29:25] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-11:52:24] [I] [TRT] Total Activation Memory: 8308511744
-[12/28/2023-11:52:24] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-11:52:32] [I] [TRT] Total Host Persistent Memory: 380944
-[12/28/2023-11:52:32] [I] [TRT] Total Device Persistent Memory: 656384
-[12/28/2023-11:52:32] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-11:52:32] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 49 MiB, GPU 2207 MiB
-[12/28/2023-11:52:32] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 216 steps to complete.
-[12/28/2023-11:52:32] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 108.365ms to assign 15 blocks to 216 nodes requiring 188319232 bytes.
-[12/28/2023-11:52:32] [I] [TRT] Total Activation Memory: 188319232
-[12/28/2023-11:52:34] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1778, GPU 5584 (MiB)
-[12/28/2023-11:52:34] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +31, GPU +256, now: CPU 31, GPU 256 (MiB)
-[12/28/2023-11:52:35] [I] Engine built in 1398.12 sec.
-[12/28/2023-11:52:35] [I] [TRT] Loaded engine size: 209 MiB
-[12/28/2023-11:52:36] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1451, GPU 4904 (MiB)
-[12/28/2023-11:52:36] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +208, now: CPU 0, GPU 208 (MiB)
-[12/28/2023-11:52:36] [I] Engine deserialized in 0.328264 sec.
-[12/28/2023-11:52:36] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1451, GPU 4904 (MiB)
-[12/28/2023-11:52:36] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +180, now: CPU 0, GPU 388 (MiB)
-[12/28/2023-11:52:36] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-11:52:36] [I] Using random values for input onnx::Cast_0
-[12/28/2023-11:52:36] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-11:52:36] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-11:52:36] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-11:52:36] [I] Starting inference
-[12/28/2023-11:52:51] [I] Warmup completed 3 queries over 200 ms
-[12/28/2023-11:52:51] [I] Timing trace has 228 queries over 15.134 s
-[12/28/2023-11:52:51] [I] 
-[12/28/2023-11:52:51] [I] === Trace details ===
-[12/28/2023-11:52:51] [I] Trace averages of 100 runs:
-[12/28/2023-11:52:51] [I] Average on 100 runs - GPU latency: 66.5633 ms - Host latency: 66.6799 ms (enqueue 66.6144 ms)
-[12/28/2023-11:52:51] [I] Average on 100 runs - GPU latency: 65.9454 ms - Host latency: 66.065 ms (enqueue 66.0061 ms)
-[12/28/2023-11:52:51] [I] 
-[12/28/2023-11:52:51] [I] === Performance summary ===
-[12/28/2023-11:52:51] [I] Throughput: 15.0654 qps
-[12/28/2023-11:52:51] [I] Latency: min = 63.8037 ms, max = 84.0011 ms, mean = 66.3393 ms, median = 65.521 ms, percentile(90%) = 67.4297 ms, percentile(95%) = 76.3467 ms, percentile(99%) = 78.6501 ms
-[12/28/2023-11:52:51] [I] Enqueue Time: min = 63.7715 ms, max = 83.9532 ms, mean = 66.2756 ms, median = 65.4399 ms, percentile(90%) = 68.3887 ms, percentile(95%) = 76.9697 ms, percentile(99%) = 78.6002 ms
-[12/28/2023-11:52:51] [I] H2D Latency: min = 0.081543 ms, max = 0.12793 ms, mean = 0.0942483 ms, median = 0.0947266 ms, percentile(90%) = 0.0976562 ms, percentile(95%) = 0.0986328 ms, percentile(99%) = 0.112305 ms
-[12/28/2023-11:52:51] [I] GPU Compute Time: min = 63.6914 ms, max = 83.8763 ms, mean = 66.222 ms, median = 65.4058 ms, percentile(90%) = 67.313 ms, percentile(95%) = 76.2305 ms, percentile(99%) = 78.5333 ms
-[12/28/2023-11:52:51] [I] D2H Latency: min = 0.00390625 ms, max = 0.0869141 ms, mean = 0.023145 ms, median = 0.0244141 ms, percentile(90%) = 0.0336914 ms, percentile(95%) = 0.0390625 ms, percentile(99%) = 0.0546875 ms
-[12/28/2023-11:52:51] [I] Total Host Walltime: 15.134 s
-[12/28/2023-11:52:51] [I] Total GPU Compute Time: 15.0986 s
-[12/28/2023-11:52:51] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-11:52:51] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.engine

yolo_nas_pose_l_fp32.onnx.fp16.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:3274fec20ea219c10bcdf044022eedcd2ced07cc929ad0b5f08c625d5fdf12b4
-size 110783531

yolo_nas_pose_l_fp32.onnx.fp16.engine.err

@@ -1,401 +0,0 @@
-[12/28/2023-11:53:03] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-11:53:03] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-11:58:20] [W] [TRT] Tactic Device request: 4720MB Available: 2406MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:20] [W] [TRT] Tactic Device request: 4720MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:20] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:21] [W] [TRT] Tactic Device request: 4720MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:21] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:27] [W] [TRT] Tactic Device request: 4706MB Available: 2408MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4706 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:27] [W] [TRT] Tactic Device request: 4706MB Available: 2408MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:28] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4706 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:30] [W] [TRT] Tactic Device request: 4711MB Available: 2408MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:30] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:31] [W] [TRT] Tactic Device request: 4711MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:31] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:32] [W] [TRT] Tactic Device request: 4711MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:32] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:37] [W] [TRT] Tactic Device request: 4702MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4702 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-11:58:38] [W] [TRT] Tactic Device request: 4702MB Available: 2407MB. Device memory is insufficient to use tactic.
-[12/28/2023-11:58:38] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4702 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:21] [W] [TRT] Tactic Device request: 4711MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:21] [W] [TRT] Tactic Device request: 4711MB Available: 2282MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:21] [W] [TRT] Tactic Device request: 4711MB Available: 2282MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:21] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:23] [W] [TRT] Tactic Device request: 4701MB Available: 2281MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:23] [W] [TRT] Tactic Device request: 4701MB Available: 2281MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:23] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:40] [W] [TRT] Tactic Device request: 6275MB Available: 2278MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:41] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:41] [W] [TRT] Tactic Device request: 6275MB Available: 2277MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:41] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:41] [W] [TRT] Tactic Device request: 6275MB Available: 2278MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:41] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:43] [W] [TRT] Tactic Device request: 6270MB Available: 2276MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:03:43] [W] [TRT] Tactic Device request: 6270MB Available: 2276MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:03:43] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:19] [W] [TRT] Tactic Device request: 7056MB Available: 2319MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:19] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:19] [W] [TRT] Tactic Device request: 7056MB Available: 2319MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:19] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:19] [W] [TRT] Tactic Device request: 7056MB Available: 2319MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:19] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:21] [W] [TRT] Tactic Device request: 7050MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:21] [W] [TRT] Tactic Device request: 7050MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:21] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:37] [W] [TRT] Tactic Device request: 6354MB Available: 2321MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:38] [W] [TRT] Tactic Device request: 6354MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:38] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:38] [W] [TRT] Tactic Device request: 6354MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:38] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:39] [W] [TRT] Tactic Device request: 6351MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:10:39] [W] [TRT] Tactic Device request: 6351MB Available: 2320MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:10:39] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:26] [W] [TRT] Tactic Device request: 2394MB Available: 2151MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:26] [W] [TRT] Tactic Device request: 2394MB Available: 2151MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:26] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:26] [W] [TRT] Tactic Device request: 2394MB Available: 2151MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:26] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:27] [W] [TRT] Tactic Device request: 2392MB Available: 2151MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:27] [W] [TRT] Tactic Device request: 2392MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:27] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:27] [W] [TRT] Tactic Device request: 2392MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:27] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:28] [W] [TRT] Tactic Device request: 2391MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:28] [W] [TRT] Tactic Device request: 2391MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:28] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:28] [W] [TRT] Tactic Device request: 2390MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:29] [W] [TRT] Tactic Device request: 2390MB Available: 2150MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:29] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:43] [W] [TRT] Tactic Device request: 6540MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:43] [W] [TRT] Tactic Device request: 6540MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:43] [W] [TRT] Tactic Device request: 6540MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:45] [W] [TRT] Tactic Device request: 6538MB Available: 2121MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6538 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:45] [W] [TRT] Tactic Device request: 6538MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:45] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6538 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:47] [W] [TRT] Tactic Device request: 2191MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:48] [W] [TRT] Tactic Device request: 2191MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:48] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2191 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:49] [W] [TRT] Tactic Device request: 2191MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:49] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:52] [W] [TRT] Tactic Device request: 2190MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:53] [W] [TRT] Tactic Device request: 2190MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:53] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:56] [W] [TRT] Tactic Device request: 2190MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:57] [W] [TRT] Tactic Device request: 2190MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:57] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:19:58] [W] [TRT] Tactic Device request: 2190MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:19:58] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:20:02] [W] [TRT] Tactic Device request: 2190MB Available: 2125MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:20:02] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:20:02] [W] [TRT] Tactic Device request: 2190MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:20:02] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:24:51] [W] [TRT] Tactic Device request: 2457MB Available: 2244MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:24:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:24:52] [W] [TRT] Tactic Device request: 2457MB Available: 2244MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:24:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:24:52] [W] [TRT] Tactic Device request: 2457MB Available: 2244MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:24:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:24:53] [W] [TRT] Tactic Device request: 2456MB Available: 2245MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:24:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:24:53] [W] [TRT] Tactic Device request: 2456MB Available: 2245MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:24:53] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:25:14] [W] [TRT] Tactic Device request: 3587MB Available: 2175MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:25:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:25:14] [W] [TRT] Tactic Device request: 3587MB Available: 2176MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:25:14] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:25:14] [W] [TRT] Tactic Device request: 3587MB Available: 2176MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:25:15] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:25:16] [W] [TRT] Tactic Device request: 3585MB Available: 2176MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:25:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:25:16] [W] [TRT] Tactic Device request: 3585MB Available: 2176MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:25:16] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:54] [W] [TRT] Tactic Device request: 3556MB Available: 2050MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:54] [W] [TRT] Tactic Device request: 3556MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:54] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:54] [W] [TRT] Tactic Device request: 3556MB Available: 2049MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:54] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:55] [W] [TRT] Tactic Device request: 3551MB Available: 2050MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:55] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:55] [W] [TRT] Tactic Device request: 3551MB Available: 2050MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:55] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:56] [W] [TRT] Tactic Device request: 3140MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:56] [W] [TRT] Tactic Device request: 3140MB Available: 2050MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:56] [W] [TRT] Tactic Device request: 3140MB Available: 2050MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:56] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:57] [W] [TRT] Tactic Device request: 3136MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3136 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:32:57] [W] [TRT] Tactic Device request: 3136MB Available: 2051MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:32:57] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3136 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:09] [W] [TRT] Tactic Device request: 3161MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:09] [W] [TRT] Tactic Device request: 3161MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:09] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:09] [W] [TRT] Tactic Device request: 3161MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:09] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:10] [W] [TRT] Tactic Device request: 3156MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3156 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:10] [W] [TRT] Tactic Device request: 3156MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:10] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3156 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:14] [W] [TRT] Tactic Device request: 4189MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:15] [W] [TRT] Tactic Device request: 4189MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:15] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:15] [W] [TRT] Tactic Device request: 4189MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:15] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:19] [W] [TRT] Tactic Device request: 4183MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4183 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:20] [W] [TRT] Tactic Device request: 4183MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:20] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4183 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:22] [W] [TRT] Tactic Device request: 4186MB Available: 2255MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:22] [W] [TRT] Tactic Device request: 4186MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:22] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:23] [W] [TRT] Tactic Device request: 4186MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:23] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:27] [W] [TRT] Tactic Device request: 4182MB Available: 2254MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4182 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:40:27] [W] [TRT] Tactic Device request: 4182MB Available: 2253MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:40:27] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4182 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:15] [W] [TRT] Tactic Device request: 4764MB Available: 2271MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:15] [W] [TRT] Tactic Device request: 4764MB Available: 2271MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:15] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:15] [W] [TRT] Tactic Device request: 4764MB Available: 2269MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:15] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:17] [W] [TRT] Tactic Device request: 4761MB Available: 2268MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:17] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4761 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:17] [W] [TRT] Tactic Device request: 4761MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:17] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4761 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:23] [W] [TRT] Tactic Device request: 4244MB Available: 2235MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:24] [W] [TRT] Tactic Device request: 4244MB Available: 1911MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:24] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:24] [W] [TRT] Tactic Device request: 4244MB Available: 1909MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:25] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:29] [W] [TRT] Tactic Device request: 4240MB Available: 1905MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4240 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:30] [W] [TRT] Tactic Device request: 4240MB Available: 1896MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:30] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4240 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:33] [W] [TRT] Tactic Device request: 4241MB Available: 1892MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:34] [W] [TRT] Tactic Device request: 4241MB Available: 1864MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:34] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:35] [W] [TRT] Tactic Device request: 4241MB Available: 1860MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:35] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:39] [W] [TRT] Tactic Device request: 4239MB Available: 1857MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4239 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:48:40] [W] [TRT] Tactic Device request: 4239MB Available: 1845MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:48:40] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4239 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:07] [W] [TRT] Tactic Device request: 3270MB Available: 1684MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:07] [W] [TRT] Tactic Device request: 3270MB Available: 1684MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:07] [W] [TRT] Tactic Device request: 3270MB Available: 1684MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:07] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:08] [W] [TRT] Tactic Device request: 3269MB Available: 1684MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3269 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:09] [W] [TRT] Tactic Device request: 3269MB Available: 1684MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:09] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3269 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:11] [W] [TRT] Tactic Device request: 4377MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:11] [W] [TRT] Tactic Device request: 2185MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:11] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:11] [W] [TRT] Tactic Device request: 4377MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:11] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:11] [W] [TRT] Tactic Device request: 2185MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:11] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:12] [W] [TRT] Tactic Device request: 4377MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:12] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:12] [W] [TRT] Tactic Device request: 2185MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:12] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:17] [W] [TRT] Tactic Device request: 4375MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:17] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:18] [W] [TRT] Tactic Device request: 2183MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:18] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:18] [W] [TRT] Tactic Device request: 4375MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:18] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:18] [W] [TRT] Tactic Device request: 2183MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:18] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:22] [W] [TRT] Tactic Device request: 4376MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:22] [W] [TRT] Tactic Device request: 2184MB Available: 1680MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:22] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:22] [W] [TRT] Tactic Device request: 4376MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:22] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:22] [W] [TRT] Tactic Device request: 2184MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:22] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:23] [W] [TRT] Tactic Device request: 4376MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:23] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:23] [W] [TRT] Tactic Device request: 2184MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:23] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:28] [W] [TRT] Tactic Device request: 4375MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4375 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:28] [W] [TRT] Tactic Device request: 2183MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:28] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2183 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:29] [W] [TRT] Tactic Device request: 4375MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4375 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:57:29] [W] [TRT] Tactic Device request: 2183MB Available: 1679MB. Device memory is insufficient to use tactic.
-[12/28/2023-12:57:29] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2183 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-12:58:16] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
-[12/28/2023-12:58:16] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
-[12/28/2023-12:58:16] [W] [TRT] Check verbose logs for the list of affected weights.
-[12/28/2023-12:58:16] [W] [TRT] - 114 weights are affected by this issue: Detected subnormal FP16 values.
-[12/28/2023-12:58:16] [W] [TRT] - 40 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
-[12/28/2023-12:58:33] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-12:58:33] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-12:58:33] [W] * GPU compute time is unstable, with coefficient of variance = 5.80641%.
-[12/28/2023-12:58:33] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp32.onnx.fp16.engine.log

@@ -1,328 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.fp16.engine
-[12/28/2023-11:52:55] [I] === Model Options ===
-[12/28/2023-11:52:55] [I] Format: ONNX
-[12/28/2023-11:52:55] [I] Model: yolo_nas_pose_l_fp32.onnx
-[12/28/2023-11:52:55] [I] Output:
-[12/28/2023-11:52:55] [I] === Build Options ===
-[12/28/2023-11:52:55] [I] Max batch: explicit batch
-[12/28/2023-11:52:55] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-11:52:55] [I] minTiming: 1
-[12/28/2023-11:52:55] [I] avgTiming: 8
-[12/28/2023-11:52:55] [I] Precision: FP32+FP16
-[12/28/2023-11:52:55] [I] LayerPrecisions: 
-[12/28/2023-11:52:55] [I] Calibration: 
-[12/28/2023-11:52:55] [I] Refit: Disabled
-[12/28/2023-11:52:55] [I] Sparsity: Disabled
-[12/28/2023-11:52:55] [I] Safe mode: Disabled
-[12/28/2023-11:52:55] [I] DirectIO mode: Disabled
-[12/28/2023-11:52:55] [I] Restricted mode: Disabled
-[12/28/2023-11:52:55] [I] Build only: Disabled
-[12/28/2023-11:52:55] [I] Save engine: yolo_nas_pose_l_fp32.onnx.fp16.engine
-[12/28/2023-11:52:55] [I] Load engine: 
-[12/28/2023-11:52:55] [I] Profiling verbosity: 0
-[12/28/2023-11:52:55] [I] Tactic sources: Using default tactic sources
-[12/28/2023-11:52:55] [I] timingCacheMode: local
-[12/28/2023-11:52:55] [I] timingCacheFile: 
-[12/28/2023-11:52:55] [I] Heuristic: Disabled
-[12/28/2023-11:52:55] [I] Preview Features: Use default preview flags.
-[12/28/2023-11:52:55] [I] Input(s)s format: fp32:CHW
-[12/28/2023-11:52:55] [I] Output(s)s format: fp32:CHW
-[12/28/2023-11:52:55] [I] Input build shapes: model
-[12/28/2023-11:52:55] [I] Input calibration shapes: model
-[12/28/2023-11:52:55] [I] === System Options ===
-[12/28/2023-11:52:55] [I] Device: 0
-[12/28/2023-11:52:55] [I] DLACore: 
-[12/28/2023-11:52:55] [I] Plugins:
-[12/28/2023-11:52:55] [I] === Inference Options ===
-[12/28/2023-11:52:55] [I] Batch: Explicit
-[12/28/2023-11:52:55] [I] Input inference shapes: model
-[12/28/2023-11:52:55] [I] Iterations: 10
-[12/28/2023-11:52:55] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-11:52:55] [I] Sleep time: 0ms
-[12/28/2023-11:52:55] [I] Idle time: 0ms
-[12/28/2023-11:52:55] [I] Streams: 1
-[12/28/2023-11:52:55] [I] ExposeDMA: Disabled
-[12/28/2023-11:52:55] [I] Data transfers: Enabled
-[12/28/2023-11:52:55] [I] Spin-wait: Disabled
-[12/28/2023-11:52:55] [I] Multithreading: Disabled
-[12/28/2023-11:52:55] [I] CUDA Graph: Disabled
-[12/28/2023-11:52:55] [I] Separate profiling: Disabled
-[12/28/2023-11:52:55] [I] Time Deserialize: Disabled
-[12/28/2023-11:52:55] [I] Time Refit: Disabled
-[12/28/2023-11:52:55] [I] NVTX verbosity: 0
-[12/28/2023-11:52:55] [I] Persistent Cache Ratio: 0
-[12/28/2023-11:52:55] [I] Inputs:
-[12/28/2023-11:52:55] [I] === Reporting Options ===
-[12/28/2023-11:52:55] [I] Verbose: Disabled
-[12/28/2023-11:52:55] [I] Averages: 100 inferences
-[12/28/2023-11:52:55] [I] Percentiles: 90,95,99
-[12/28/2023-11:52:55] [I] Dump refittable layers:Disabled
-[12/28/2023-11:52:55] [I] Dump output: Disabled
-[12/28/2023-11:52:55] [I] Profile: Disabled
-[12/28/2023-11:52:55] [I] Export timing to JSON file: 
-[12/28/2023-11:52:55] [I] Export output to JSON file: 
-[12/28/2023-11:52:55] [I] Export profile to JSON file: 
-[12/28/2023-11:52:55] [I] 
-[12/28/2023-11:52:55] [I] === Device Information ===
-[12/28/2023-11:52:55] [I] Selected Device: Orin
-[12/28/2023-11:52:55] [I] Compute Capability: 8.7
-[12/28/2023-11:52:55] [I] SMs: 8
-[12/28/2023-11:52:55] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-11:52:55] [I] Device Global Memory: 7471 MiB
-[12/28/2023-11:52:55] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-11:52:55] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-11:52:55] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-11:52:55] [I] 
-[12/28/2023-11:52:55] [I] TensorRT version: 8.5.2
-[12/28/2023-11:52:56] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3001 (MiB)
-[12/28/2023-11:52:59] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +283, now: CPU 574, GPU 3306 (MiB)
-[12/28/2023-11:52:59] [I] Start parsing network model
-[12/28/2023-11:53:02] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-11:53:02] [I] [TRT] Input filename:   yolo_nas_pose_l_fp32.onnx
-[12/28/2023-11:53:02] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-11:53:02] [I] [TRT] Opset version:    17
-[12/28/2023-11:53:02] [I] [TRT] Producer name:    pytorch
-[12/28/2023-11:53:02] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-11:53:02] [I] [TRT] Domain:           
-[12/28/2023-11:53:02] [I] [TRT] Model version:    0
-[12/28/2023-11:53:02] [I] [TRT] Doc string:       
-[12/28/2023-11:53:02] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-11:53:03] [I] Finish parsing network model
-[12/28/2023-11:53:04] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-11:53:04] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 455) [Constant]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 456) [Constant]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 457) [Constant]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 459) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-11:53:04] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-11:53:10] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +444, now: CPU 1350, GPU 4042 (MiB)
-[12/28/2023-11:53:11] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +74, now: CPU 1433, GPU 4116 (MiB)
-[12/28/2023-11:53:11] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-12:57:56] [I] [TRT] Total Activation Memory: 8060146176
-[12/28/2023-12:57:56] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-12:58:10] [I] [TRT] Total Host Persistent Memory: 376864
-[12/28/2023-12:58:10] [I] [TRT] Total Device Persistent Memory: 61440
-[12/28/2023-12:58:10] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-12:58:10] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 139 MiB, GPU 2131 MiB
-[12/28/2023-12:58:10] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 209 steps to complete.
-[12/28/2023-12:58:10] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 267.621ms to assign 16 blocks to 209 nodes requiring 160521216 bytes.
-[12/28/2023-12:58:10] [I] [TRT] Total Activation Memory: 160521216
-[12/28/2023-12:58:16] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +0, now: CPU 1885, GPU 5668 (MiB)
-[12/28/2023-12:58:16] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +104, GPU +128, now: CPU 104, GPU 128 (MiB)
-[12/28/2023-12:58:17] [I] Engine built in 3922.11 sec.
-[12/28/2023-12:58:17] [I] [TRT] Loaded engine size: 105 MiB
-[12/28/2023-12:58:18] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1347, GPU 5215 (MiB)
-[12/28/2023-12:58:18] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +103, now: CPU 0, GPU 103 (MiB)
-[12/28/2023-12:58:18] [I] Engine deserialized in 0.277587 sec.
-[12/28/2023-12:58:18] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1348, GPU 5215 (MiB)
-[12/28/2023-12:58:18] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +154, now: CPU 0, GPU 257 (MiB)
-[12/28/2023-12:58:18] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-12:58:18] [I] Using random values for input onnx::Cast_0
-[12/28/2023-12:58:18] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-12:58:18] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-12:58:18] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-12:58:18] [I] Starting inference
-[12/28/2023-12:58:33] [I] Warmup completed 2 queries over 200 ms
-[12/28/2023-12:58:33] [I] Timing trace has 437 queries over 15.0687 s
-[12/28/2023-12:58:33] [I] 
-[12/28/2023-12:58:33] [I] === Trace details ===
-[12/28/2023-12:58:33] [I] Trace averages of 100 runs:
-[12/28/2023-12:58:33] [I] Average on 100 runs - GPU latency: 34.2122 ms - Host latency: 34.3209 ms (enqueue 34.261 ms)
-[12/28/2023-12:58:33] [I] Average on 100 runs - GPU latency: 34.6286 ms - Host latency: 34.7419 ms (enqueue 34.6733 ms)
-[12/28/2023-12:58:33] [I] Average on 100 runs - GPU latency: 34.32 ms - Host latency: 34.4264 ms (enqueue 34.3737 ms)
-[12/28/2023-12:58:33] [I] Average on 100 runs - GPU latency: 34.1213 ms - Host latency: 34.2258 ms (enqueue 34.1666 ms)
-[12/28/2023-12:58:33] [I] 
-[12/28/2023-12:58:33] [I] === Performance summary ===
-[12/28/2023-12:58:33] [I] Throughput: 29.0005 qps
-[12/28/2023-12:58:33] [I] Latency: min = 32.0405 ms, max = 46.5195 ms, mean = 34.4576 ms, median = 34.021 ms, percentile(90%) = 35.2378 ms, percentile(95%) = 37.8905 ms, percentile(99%) = 44.1553 ms
-[12/28/2023-12:58:33] [I] Enqueue Time: min = 32.0081 ms, max = 46.4473 ms, mean = 34.3937 ms, median = 33.9883 ms, percentile(90%) = 35.166 ms, percentile(95%) = 37.6458 ms, percentile(99%) = 44.0703 ms
-[12/28/2023-12:58:33] [I] H2D Latency: min = 0.0800781 ms, max = 0.119629 ms, mean = 0.0890405 ms, median = 0.0893555 ms, percentile(90%) = 0.0913086 ms, percentile(95%) = 0.0917969 ms, percentile(99%) = 0.103516 ms
-[12/28/2023-12:58:33] [I] GPU Compute Time: min = 31.9365 ms, max = 46.3989 ms, mean = 34.3493 ms, median = 33.9121 ms, percentile(90%) = 35.1299 ms, percentile(95%) = 37.7999 ms, percentile(99%) = 44.0645 ms
-[12/28/2023-12:58:33] [I] D2H Latency: min = 0.00292969 ms, max = 0.0566406 ms, mean = 0.0192997 ms, median = 0.0175781 ms, percentile(90%) = 0.0292969 ms, percentile(95%) = 0.03125 ms, percentile(99%) = 0.0371094 ms
-[12/28/2023-12:58:33] [I] Total Host Walltime: 15.0687 s
-[12/28/2023-12:58:33] [I] Total GPU Compute Time: 15.0106 s
-[12/28/2023-12:58:33] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-12:58:33] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.fp16.engine

yolo_nas_pose_l_fp32.onnx.int8.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:48058cfe18fb0bfcfbf2822e4ac65f9801a49f738a3d6718eff46f2237aeee33
-size 57073047

yolo_nas_pose_l_fp32.onnx.int8.engine.err

@@ -1,256 +0,0 @@
-[12/28/2023-15:10:20] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-15:10:20] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-15:10:21] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
-[12/28/2023-15:17:13] [W] [TRT] Tactic Device request: 4720MB Available: 2708MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:14] [W] [TRT] Tactic Device request: 4720MB Available: 2708MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:14] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4720 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:14] [W] [TRT] Tactic Device request: 4720MB Available: 2707MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:14] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4720 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:21] [W] [TRT] Tactic Device request: 4711MB Available: 2698MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:22] [W] [TRT] Tactic Device request: 4711MB Available: 2697MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:22] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:22] [W] [TRT] Tactic Device request: 4711MB Available: 2702MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:22] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:29] [W] [TRT] Tactic Device request: 4711MB Available: 2688MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:30] [W] [TRT] Tactic Device request: 4711MB Available: 2689MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:30] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:17:30] [W] [TRT] Tactic Device request: 4711MB Available: 2689MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:17:30] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:24] [W] [TRT] Tactic Device request: 4711MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:24] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:24] [W] [TRT] Tactic Device request: 4711MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:24] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:24] [W] [TRT] Tactic Device request: 4711MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:24] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:39] [W] [TRT] Tactic Device request: 6275MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:39] [W] [TRT] Tactic Device request: 6275MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:39] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:21:39] [W] [TRT] Tactic Device request: 6275MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:21:39] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:20] [W] [TRT] Tactic Device request: 7056MB Available: 2259MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:20] [W] [TRT] Tactic Device request: 7056MB Available: 2257MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:20] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:20] [W] [TRT] Tactic Device request: 7056MB Available: 2257MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:20] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:36] [W] [TRT] Tactic Device request: 6354MB Available: 2258MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:36] [W] [TRT] Tactic Device request: 6354MB Available: 2258MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:36] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:27:36] [W] [TRT] Tactic Device request: 6354MB Available: 2258MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:27:36] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:28] [W] [TRT] Tactic Device request: 2394MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:28] [W] [TRT] Tactic Device request: 2394MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:28] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:28] [W] [TRT] Tactic Device request: 2394MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:28] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:29] [W] [TRT] Tactic Device request: 2392MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:29] [W] [TRT] Tactic Device request: 2392MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:29] [W] [TRT] Tactic Device request: 2392MB Available: 2120MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:29] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:42] [W] [TRT] Tactic Device request: 6540MB Available: 2103MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:42] [W] [TRT] Tactic Device request: 6540MB Available: 2103MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:42] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6540 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:42] [W] [TRT] Tactic Device request: 6540MB Available: 2103MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:42] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6540 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:46] [W] [TRT] Tactic Device request: 2191MB Available: 2103MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:47] [W] [TRT] Tactic Device request: 2191MB Available: 2102MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:47] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2191 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:48] [W] [TRT] Tactic Device request: 2191MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:48] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2191 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:53] [W] [TRT] Tactic Device request: 2190MB Available: 2102MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:54] [W] [TRT] Tactic Device request: 2190MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:54] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:35:55] [W] [TRT] Tactic Device request: 2190MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:35:55] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:36:01] [W] [TRT] Tactic Device request: 2190MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:36:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:36:02] [W] [TRT] Tactic Device request: 2190MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:36:02] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2190 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:36:03] [W] [TRT] Tactic Device request: 2190MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:36:03] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2190 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:40:03] [W] [TRT] Tactic Device request: 2457MB Available: 2339MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:40:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:40:03] [W] [TRT] Tactic Device request: 2457MB Available: 2339MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:40:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:40:23] [W] [TRT] Tactic Device request: 3587MB Available: 2337MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:40:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:40:23] [W] [TRT] Tactic Device request: 3587MB Available: 2337MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:40:23] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:40:23] [W] [TRT] Tactic Device request: 3587MB Available: 2337MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:40:23] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:03] [W] [TRT] Tactic Device request: 3556MB Available: 2223MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:03] [W] [TRT] Tactic Device request: 3556MB Available: 2223MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:03] [W] [TRT] Tactic Device request: 3556MB Available: 2223MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:05] [W] [TRT] Tactic Device request: 3140MB Available: 2192MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:05] [W] [TRT] Tactic Device request: 3140MB Available: 2191MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3140 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:47:06] [W] [TRT] Tactic Device request: 3140MB Available: 2191MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:47:06] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3140 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:21] [W] [TRT] Tactic Device request: 3161MB Available: 2119MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:21] [W] [TRT] Tactic Device request: 3161MB Available: 2119MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3161 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:21] [W] [TRT] Tactic Device request: 3161MB Available: 2119MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:21] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3161 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:26] [W] [TRT] Tactic Device request: 4189MB Available: 2117MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:27] [W] [TRT] Tactic Device request: 4189MB Available: 2101MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:27] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4189 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:27] [W] [TRT] Tactic Device request: 4189MB Available: 2101MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:27] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4189 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:33] [W] [TRT] Tactic Device request: 4186MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:33] [W] [TRT] Tactic Device request: 4186MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:33] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4186 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-15:53:33] [W] [TRT] Tactic Device request: 4186MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-15:53:34] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4186 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:19] [W] [TRT] Tactic Device request: 4764MB Available: 2172MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:19] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:19] [W] [TRT] Tactic Device request: 4764MB Available: 2170MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:19] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4764 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:19] [W] [TRT] Tactic Device request: 4764MB Available: 2170MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:19] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4764 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:26] [W] [TRT] Tactic Device request: 4244MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:27] [W] [TRT] Tactic Device request: 4244MB Available: 1979MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:27] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4244 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:28] [W] [TRT] Tactic Device request: 4244MB Available: 1979MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:28] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4244 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:35] [W] [TRT] Tactic Device request: 4241MB Available: 1980MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:36] [W] [TRT] Tactic Device request: 4241MB Available: 1980MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:36] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4241 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:00:37] [W] [TRT] Tactic Device request: 4241MB Available: 1979MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:00:37] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4241 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:17] [W] [TRT] Tactic Device request: 3270MB Available: 1808MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:17] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:17] [W] [TRT] Tactic Device request: 3270MB Available: 1808MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:17] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:17] [W] [TRT] Tactic Device request: 3270MB Available: 1808MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:17] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3270 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:21] [W] [TRT] Tactic Device request: 4377MB Available: 1804MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:21] [W] [TRT] Tactic Device request: 2185MB Available: 1804MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:21] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:21] [W] [TRT] Tactic Device request: 4377MB Available: 1804MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:21] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4377 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:21] [W] [TRT] Tactic Device request: 2185MB Available: 1804MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:21] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2185 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:22] [W] [TRT] Tactic Device request: 4377MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:22] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4377 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:22] [W] [TRT] Tactic Device request: 2185MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:22] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2185 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:31] [W] [TRT] Tactic Device request: 4376MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:31] [W] [TRT] Tactic Device request: 2184MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:31] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:31] [W] [TRT] Tactic Device request: 4376MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:31] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4376 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:31] [W] [TRT] Tactic Device request: 2184MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:31] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 2184 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:32] [W] [TRT] Tactic Device request: 4376MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:32] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4376 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:08:32] [W] [TRT] Tactic Device request: 2184MB Available: 1803MB. Device memory is insufficient to use tactic.
-[12/28/2023-16:08:32] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 2184 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-16:09:30] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-16:09:30] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-16:09:30] [W] * GPU compute time is unstable, with coefficient of variance = 6.6527%.
-[12/28/2023-16:09:30] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_fp32.onnx.int8.engine.log

@@ -1,332 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.int8.engine
-[12/28/2023-15:10:07] [I] === Model Options ===
-[12/28/2023-15:10:07] [I] Format: ONNX
-[12/28/2023-15:10:07] [I] Model: yolo_nas_pose_l_fp32.onnx
-[12/28/2023-15:10:07] [I] Output:
-[12/28/2023-15:10:07] [I] === Build Options ===
-[12/28/2023-15:10:07] [I] Max batch: explicit batch
-[12/28/2023-15:10:07] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-15:10:07] [I] minTiming: 1
-[12/28/2023-15:10:07] [I] avgTiming: 8
-[12/28/2023-15:10:07] [I] Precision: FP32+INT8
-[12/28/2023-15:10:07] [I] LayerPrecisions: 
-[12/28/2023-15:10:07] [I] Calibration: Dynamic
-[12/28/2023-15:10:07] [I] Refit: Disabled
-[12/28/2023-15:10:07] [I] Sparsity: Disabled
-[12/28/2023-15:10:07] [I] Safe mode: Disabled
-[12/28/2023-15:10:07] [I] DirectIO mode: Disabled
-[12/28/2023-15:10:07] [I] Restricted mode: Disabled
-[12/28/2023-15:10:07] [I] Build only: Disabled
-[12/28/2023-15:10:07] [I] Save engine: yolo_nas_pose_l_fp32.onnx.int8.engine
-[12/28/2023-15:10:07] [I] Load engine: 
-[12/28/2023-15:10:07] [I] Profiling verbosity: 0
-[12/28/2023-15:10:07] [I] Tactic sources: Using default tactic sources
-[12/28/2023-15:10:07] [I] timingCacheMode: local
-[12/28/2023-15:10:07] [I] timingCacheFile: 
-[12/28/2023-15:10:07] [I] Heuristic: Disabled
-[12/28/2023-15:10:07] [I] Preview Features: Use default preview flags.
-[12/28/2023-15:10:07] [I] Input(s)s format: fp32:CHW
-[12/28/2023-15:10:07] [I] Output(s)s format: fp32:CHW
-[12/28/2023-15:10:07] [I] Input build shapes: model
-[12/28/2023-15:10:07] [I] Input calibration shapes: model
-[12/28/2023-15:10:07] [I] === System Options ===
-[12/28/2023-15:10:07] [I] Device: 0
-[12/28/2023-15:10:07] [I] DLACore: 
-[12/28/2023-15:10:07] [I] Plugins:
-[12/28/2023-15:10:07] [I] === Inference Options ===
-[12/28/2023-15:10:07] [I] Batch: Explicit
-[12/28/2023-15:10:07] [I] Input inference shapes: model
-[12/28/2023-15:10:07] [I] Iterations: 10
-[12/28/2023-15:10:07] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-15:10:07] [I] Sleep time: 0ms
-[12/28/2023-15:10:07] [I] Idle time: 0ms
-[12/28/2023-15:10:07] [I] Streams: 1
-[12/28/2023-15:10:07] [I] ExposeDMA: Disabled
-[12/28/2023-15:10:07] [I] Data transfers: Enabled
-[12/28/2023-15:10:07] [I] Spin-wait: Disabled
-[12/28/2023-15:10:07] [I] Multithreading: Disabled
-[12/28/2023-15:10:07] [I] CUDA Graph: Disabled
-[12/28/2023-15:10:07] [I] Separate profiling: Disabled
-[12/28/2023-15:10:07] [I] Time Deserialize: Disabled
-[12/28/2023-15:10:07] [I] Time Refit: Disabled
-[12/28/2023-15:10:07] [I] NVTX verbosity: 0
-[12/28/2023-15:10:07] [I] Persistent Cache Ratio: 0
-[12/28/2023-15:10:07] [I] Inputs:
-[12/28/2023-15:10:07] [I] === Reporting Options ===
-[12/28/2023-15:10:07] [I] Verbose: Disabled
-[12/28/2023-15:10:07] [I] Averages: 100 inferences
-[12/28/2023-15:10:07] [I] Percentiles: 90,95,99
-[12/28/2023-15:10:07] [I] Dump refittable layers:Disabled
-[12/28/2023-15:10:07] [I] Dump output: Disabled
-[12/28/2023-15:10:07] [I] Profile: Disabled
-[12/28/2023-15:10:07] [I] Export timing to JSON file: 
-[12/28/2023-15:10:07] [I] Export output to JSON file: 
-[12/28/2023-15:10:07] [I] Export profile to JSON file: 
-[12/28/2023-15:10:07] [I] 
-[12/28/2023-15:10:07] [I] === Device Information ===
-[12/28/2023-15:10:07] [I] Selected Device: Orin
-[12/28/2023-15:10:07] [I] Compute Capability: 8.7
-[12/28/2023-15:10:07] [I] SMs: 8
-[12/28/2023-15:10:07] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-15:10:07] [I] Device Global Memory: 7471 MiB
-[12/28/2023-15:10:07] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-15:10:07] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-15:10:07] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-15:10:07] [I] 
-[12/28/2023-15:10:07] [I] TensorRT version: 8.5.2
-[12/28/2023-15:10:12] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3019 (MiB)
-[12/28/2023-15:10:17] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +286, now: CPU 574, GPU 3326 (MiB)
-[12/28/2023-15:10:17] [I] Start parsing network model
-[12/28/2023-15:10:20] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-15:10:20] [I] [TRT] Input filename:   yolo_nas_pose_l_fp32.onnx
-[12/28/2023-15:10:20] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-15:10:20] [I] [TRT] Opset version:    17
-[12/28/2023-15:10:20] [I] [TRT] Producer name:    pytorch
-[12/28/2023-15:10:20] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-15:10:20] [I] [TRT] Domain:           
-[12/28/2023-15:10:20] [I] [TRT] Model version:    0
-[12/28/2023-15:10:20] [I] [TRT] Doc string:       
-[12/28/2023-15:10:20] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-15:10:21] [I] Finish parsing network model
-[12/28/2023-15:10:21] [I] FP32 and INT8 precisions have been specified - more performance might be enabled by additionally specifying --fp16 or --best
-[12/28/2023-15:10:21] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-15:10:21] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 455) [Constant]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 456) [Constant]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 457) [Constant]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 187) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 195) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 224) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 232) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 240) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 271) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 294) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 302) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 310) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 341) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 364) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 372) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 380) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 459) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-15:10:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-15:10:35] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +335, now: CPU 1351, GPU 3954 (MiB)
-[12/28/2023-15:10:37] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +82, GPU +63, now: CPU 1433, GPU 4017 (MiB)
-[12/28/2023-15:10:37] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-16:08:54] [I] [TRT] Total Activation Memory: 7959592448
-[12/28/2023-16:08:54] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-16:09:08] [I] [TRT] Total Host Persistent Memory: 331808
-[12/28/2023-16:09:08] [I] [TRT] Total Device Persistent Memory: 38912
-[12/28/2023-16:09:08] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-16:09:08] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 88 MiB, GPU 2461 MiB
-[12/28/2023-16:09:08] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 160 steps to complete.
-[12/28/2023-16:09:08] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 55.0722ms to assign 13 blocks to 160 nodes requiring 147361280 bytes.
-[12/28/2023-16:09:08] [I] [TRT] Total Activation Memory: 147361280
-[12/28/2023-16:09:13] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -1, now: CPU 1835, GPU 5360 (MiB)
-[12/28/2023-16:09:13] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +52, GPU +64, now: CPU 52, GPU 64 (MiB)
-[12/28/2023-16:09:14] [I] Engine built in 3546.25 sec.
-[12/28/2023-16:09:14] [I] [TRT] Loaded engine size: 54 MiB
-[12/28/2023-16:09:15] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1299, GPU 5007 (MiB)
-[12/28/2023-16:09:15] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +52, now: CPU 0, GPU 52 (MiB)
-[12/28/2023-16:09:15] [I] Engine deserialized in 0.128069 sec.
-[12/28/2023-16:09:15] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +0, now: CPU 1300, GPU 5007 (MiB)
-[12/28/2023-16:09:15] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +140, now: CPU 0, GPU 192 (MiB)
-[12/28/2023-16:09:15] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-16:09:15] [I] Using random values for input onnx::Cast_0
-[12/28/2023-16:09:15] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-16:09:15] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-16:09:15] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-16:09:15] [I] Starting inference
-[12/28/2023-16:09:30] [I] Warmup completed 3 queries over 200 ms
-[12/28/2023-16:09:30] [I] Timing trace has 720 queries over 15.0291 s
-[12/28/2023-16:09:30] [I] 
-[12/28/2023-16:09:30] [I] === Trace details ===
-[12/28/2023-16:09:30] [I] Trace averages of 100 runs:
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.9331 ms - Host latency: 21.0491 ms (enqueue 20.9849 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.3949 ms - Host latency: 20.5041 ms (enqueue 20.4581 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.9551 ms - Host latency: 21.0733 ms (enqueue 21.0198 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.8394 ms - Host latency: 20.9537 ms (enqueue 20.8945 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.4666 ms - Host latency: 20.5773 ms (enqueue 20.5432 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.689 ms - Host latency: 20.8023 ms (enqueue 20.7502 ms)
-[12/28/2023-16:09:30] [I] Average on 100 runs - GPU latency: 20.7472 ms - Host latency: 20.8614 ms (enqueue 20.8134 ms)
-[12/28/2023-16:09:30] [I] 
-[12/28/2023-16:09:30] [I] === Performance summary ===
-[12/28/2023-16:09:30] [I] Throughput: 47.9071 qps
-[12/28/2023-16:09:30] [I] Latency: min = 19.4119 ms, max = 30.8398 ms, mean = 20.8421 ms, median = 20.7168 ms, percentile(90%) = 21.5566 ms, percentile(95%) = 22.2598 ms, percentile(99%) = 28.5723 ms
-[12/28/2023-16:09:30] [I] Enqueue Time: min = 19.3838 ms, max = 30.7852 ms, mean = 20.7908 ms, median = 20.6725 ms, percentile(90%) = 21.4995 ms, percentile(95%) = 22.1094 ms, percentile(99%) = 28.5068 ms
-[12/28/2023-16:09:30] [I] H2D Latency: min = 0.0800781 ms, max = 0.133301 ms, mean = 0.0950138 ms, median = 0.0957031 ms, percentile(90%) = 0.0981445 ms, percentile(95%) = 0.0986328 ms, percentile(99%) = 0.0996094 ms
-[12/28/2023-16:09:30] [I] GPU Compute Time: min = 19.304 ms, max = 30.7158 ms, mean = 20.7286 ms, median = 20.5989 ms, percentile(90%) = 21.4419 ms, percentile(95%) = 22.1621 ms, percentile(99%) = 28.4521 ms
-[12/28/2023-16:09:30] [I] D2H Latency: min = 0.00292969 ms, max = 0.0688477 ms, mean = 0.0184459 ms, median = 0.0166016 ms, percentile(90%) = 0.0273438 ms, percentile(95%) = 0.0288086 ms, percentile(99%) = 0.0444336 ms
-[12/28/2023-16:09:30] [I] Total Host Walltime: 15.0291 s
-[12/28/2023-16:09:30] [I] Total GPU Compute Time: 14.9246 s
-[12/28/2023-16:09:30] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-16:09:30] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_fp32.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_fp32.onnx.int8.engine

yolo_nas_pose_l_int8.onnx.best.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:23bee9f331f0da470fb3b6d1e4244127e7648c848e5cf9265fbeea5a15c2204d
-size 57380810

yolo_nas_pose_l_int8.onnx.best.engine.err

@@ -1,7 +0,0 @@
-[01/04/2024-16:29:12] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[01/04/2024-16:29:12] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[01/04/2024-16:29:16] [W] [TRT] Calibrator won't be used in explicit precision mode. Use quantization aware training to generate network with Quantize/Dequantize nodes.
-[01/04/2024-17:18:11] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[01/04/2024-17:18:11] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[01/04/2024-17:18:11] [W] * GPU compute time is unstable, with coefficient of variance = 2.14899%.
-[01/04/2024-17:18:11] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_int8.onnx.best.engine.log

@@ -1,362 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.best.engine
-[01/04/2024-16:29:06] [I] === Model Options ===
-[01/04/2024-16:29:06] [I] Format: ONNX
-[01/04/2024-16:29:06] [I] Model: yolo_nas_pose_l_int8.onnx
-[01/04/2024-16:29:06] [I] Output:
-[01/04/2024-16:29:06] [I] === Build Options ===
-[01/04/2024-16:29:06] [I] Max batch: explicit batch
-[01/04/2024-16:29:06] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[01/04/2024-16:29:06] [I] minTiming: 1
-[01/04/2024-16:29:06] [I] avgTiming: 8
-[01/04/2024-16:29:06] [I] Precision: FP32+FP16+INT8
-[01/04/2024-16:29:06] [I] LayerPrecisions: 
-[01/04/2024-16:29:06] [I] Calibration: Dynamic
-[01/04/2024-16:29:06] [I] Refit: Disabled
-[01/04/2024-16:29:06] [I] Sparsity: Disabled
-[01/04/2024-16:29:06] [I] Safe mode: Disabled
-[01/04/2024-16:29:06] [I] DirectIO mode: Disabled
-[01/04/2024-16:29:06] [I] Restricted mode: Disabled
-[01/04/2024-16:29:06] [I] Build only: Disabled
-[01/04/2024-16:29:06] [I] Save engine: yolo_nas_pose_l_int8.onnx.best.engine
-[01/04/2024-16:29:06] [I] Load engine: 
-[01/04/2024-16:29:06] [I] Profiling verbosity: 0
-[01/04/2024-16:29:06] [I] Tactic sources: Using default tactic sources
-[01/04/2024-16:29:06] [I] timingCacheMode: local
-[01/04/2024-16:29:06] [I] timingCacheFile: 
-[01/04/2024-16:29:06] [I] Heuristic: Disabled
-[01/04/2024-16:29:06] [I] Preview Features: Use default preview flags.
-[01/04/2024-16:29:06] [I] Input(s)s format: fp32:CHW
-[01/04/2024-16:29:06] [I] Output(s)s format: fp32:CHW
-[01/04/2024-16:29:06] [I] Input build shapes: model
-[01/04/2024-16:29:06] [I] Input calibration shapes: model
-[01/04/2024-16:29:06] [I] === System Options ===
-[01/04/2024-16:29:06] [I] Device: 0
-[01/04/2024-16:29:06] [I] DLACore: 
-[01/04/2024-16:29:06] [I] Plugins:
-[01/04/2024-16:29:06] [I] === Inference Options ===
-[01/04/2024-16:29:06] [I] Batch: Explicit
-[01/04/2024-16:29:06] [I] Input inference shapes: model
-[01/04/2024-16:29:06] [I] Iterations: 10
-[01/04/2024-16:29:06] [I] Duration: 15s (+ 200ms warm up)
-[01/04/2024-16:29:06] [I] Sleep time: 0ms
-[01/04/2024-16:29:06] [I] Idle time: 0ms
-[01/04/2024-16:29:06] [I] Streams: 1
-[01/04/2024-16:29:06] [I] ExposeDMA: Disabled
-[01/04/2024-16:29:06] [I] Data transfers: Enabled
-[01/04/2024-16:29:06] [I] Spin-wait: Disabled
-[01/04/2024-16:29:06] [I] Multithreading: Disabled
-[01/04/2024-16:29:06] [I] CUDA Graph: Disabled
-[01/04/2024-16:29:06] [I] Separate profiling: Disabled
-[01/04/2024-16:29:06] [I] Time Deserialize: Disabled
-[01/04/2024-16:29:06] [I] Time Refit: Disabled
-[01/04/2024-16:29:06] [I] NVTX verbosity: 0
-[01/04/2024-16:29:06] [I] Persistent Cache Ratio: 0
-[01/04/2024-16:29:06] [I] Inputs:
-[01/04/2024-16:29:06] [I] === Reporting Options ===
-[01/04/2024-16:29:06] [I] Verbose: Disabled
-[01/04/2024-16:29:06] [I] Averages: 100 inferences
-[01/04/2024-16:29:06] [I] Percentiles: 90,95,99
-[01/04/2024-16:29:06] [I] Dump refittable layers:Disabled
-[01/04/2024-16:29:06] [I] Dump output: Disabled
-[01/04/2024-16:29:06] [I] Profile: Disabled
-[01/04/2024-16:29:06] [I] Export timing to JSON file: 
-[01/04/2024-16:29:06] [I] Export output to JSON file: 
-[01/04/2024-16:29:06] [I] Export profile to JSON file: 
-[01/04/2024-16:29:06] [I] 
-[01/04/2024-16:29:06] [I] === Device Information ===
-[01/04/2024-16:29:06] [I] Selected Device: Orin
-[01/04/2024-16:29:06] [I] Compute Capability: 8.7
-[01/04/2024-16:29:06] [I] SMs: 8
-[01/04/2024-16:29:06] [I] Compute Clock Rate: 0.624 GHz
-[01/04/2024-16:29:06] [I] Device Global Memory: 7471 MiB
-[01/04/2024-16:29:06] [I] Shared Memory per SM: 164 KiB
-[01/04/2024-16:29:06] [I] Memory Bus Width: 128 bits (ECC disabled)
-[01/04/2024-16:29:06] [I] Memory Clock Rate: 0.624 GHz
-[01/04/2024-16:29:06] [I] 
-[01/04/2024-16:29:06] [I] TensorRT version: 8.5.2
-[01/04/2024-16:29:06] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3855 (MiB)
-[01/04/2024-16:29:09] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +283, now: CPU 574, GPU 4159 (MiB)
-[01/04/2024-16:29:09] [I] Start parsing network model
-[01/04/2024-16:29:12] [I] [TRT] ----------------------------------------------------------------
-[01/04/2024-16:29:12] [I] [TRT] Input filename:   yolo_nas_pose_l_int8.onnx
-[01/04/2024-16:29:12] [I] [TRT] ONNX IR version:  0.0.8
-[01/04/2024-16:29:12] [I] [TRT] Opset version:    17
-[01/04/2024-16:29:12] [I] [TRT] Producer name:    pytorch
-[01/04/2024-16:29:12] [I] [TRT] Producer version: 2.1.2
-[01/04/2024-16:29:12] [I] [TRT] Domain:           
-[01/04/2024-16:29:12] [I] [TRT] Model version:    0
-[01/04/2024-16:29:12] [I] [TRT] Doc string:       
-[01/04/2024-16:29:12] [I] [TRT] ----------------------------------------------------------------
-[01/04/2024-16:29:16] [I] Finish parsing network model
-[01/04/2024-16:29:21] [I] [TRT] ---------- Layers Running on DLA ----------
-[01/04/2024-16:29:21] [I] [TRT] ---------- Layers Running on GPU ----------
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1420) [Constant]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1421) [Constant]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1422) [Constant]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stem/conv/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stem.conv.rbr_reparam.weight + /model/backbone/stem/conv/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stem/conv/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.downsample.rbr_reparam.weight + /model/backbone/stage1/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/downsample/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv2.conv.weight + /model/backbone/stage1/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv1.conv.weight + /model/backbone/stage1/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 557) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 573) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv3.conv.weight + /model/backbone/stage1/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.reduce_skip2.conv.weight + /model/neck/neck2/reduce_skip2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_skip2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.downsample.rbr_reparam.weight + /model/backbone/stage2/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/downsample/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.downsample.conv.weight + /model/neck/neck2/downsample/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/downsample/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv2.conv.weight + /model/backbone/stage2/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv1.conv.weight + /model/backbone/stage2/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 620) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 636) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 652) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_2
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv3.conv.weight + /model/backbone/stage2/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_skip2.conv.weight + /model/neck/neck1/reduce_skip2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_skip2/conv/Conv || model.neck.neck2.reduce_skip1.conv.weight + /model/neck/neck2/reduce_skip1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_skip1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.downsample.rbr_reparam.weight + /model/backbone/stage3/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/downsample/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.downsample.conv.weight + /model/neck/neck1/downsample/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/downsample/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv2.conv.weight + /model/backbone/stage3/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv1.conv.weight + /model/backbone/stage3/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 702) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 718) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 734) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 750) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.4.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.4.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 766) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_4
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_3
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_2
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv3.conv.weight + /model/backbone/stage3/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_skip1.conv.weight + /model/neck/neck1/reduce_skip1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_skip1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.downsample.rbr_reparam.weight + /model/backbone/stage4/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/downsample/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv2.conv.weight + /model/backbone/stage4/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv1.conv.weight + /model/backbone/stage4/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 807) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 823) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv3.conv.weight + /model/backbone/stage4/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.context_module.cv1.conv.weight + /model/backbone/context_module/cv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/context_module/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/m.2/MaxPool_output_0 copy
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.context_module.cv2.conv.weight + /model/backbone/context_module/cv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/context_module/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.conv.conv.weight + /model/neck/neck1/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/conv/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/upsample/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] DECONVOLUTION: model.neck.neck1.upsample.weight + /model/neck/neck1/upsample/_weight_quantizer/QuantizeLinear + /model/neck/neck1/upsample/ConvTranspose
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_after_concat.conv.weight + /model/neck/neck1/reduce_after_concat/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_after_concat/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv2.conv.weight + /model/neck/neck1/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv1.conv.weight + /model/neck/neck1/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 888) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 904) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 920) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 936) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv3.conv.weight + /model/neck/neck1/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.conv.conv.weight + /model/neck/neck2/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/conv/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/upsample/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] DECONVOLUTION: model.neck.neck2.upsample.weight + /model/neck/neck2/upsample/_weight_quantizer/QuantizeLinear + /model/neck/neck2/upsample/ConvTranspose
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/Concat_/model/neck/neck2/reduce_skip1/act/Relu_output_0_clone_1 copy
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.reduce_after_concat.conv.weight + /model/neck/neck2/reduce_after_concat/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_after_concat/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv2.conv.weight + /model/neck/neck2/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv1.conv.weight + /model/neck/neck2/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 985) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1001) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1017) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1033) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv3.conv.weight + /model/neck/neck2/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.bbox_stem.seq.conv.weight + /model/heads/head1/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/bbox_stem/seq/conv/Conv || model.heads.head1.pose_stem.seq.conv.weight + /model/heads/head1/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_stem/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.conv.conv.weight + /model/neck/neck3/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/conv/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.reg_convs.0.seq.conv.weight + /model/heads/head1/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head1.cls_convs.0.seq.conv.weight + /model/heads/head1/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_convs.0.seq.conv.weight + /model/heads/head1/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv1/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.cls_pred.weight + /model/heads/head1/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/cls_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.reg_pred.weight + /model/heads/head1/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/reg_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_convs.1.seq.conv.weight + /model/heads/head1/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv2.conv.weight + /model/neck/neck3/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv1.conv.weight + /model/neck/neck3/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_pred.weight + /model/heads/head1/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.0.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.0.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 1099) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.1.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.1.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1140) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.2.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.2.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1156) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.3.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.3.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1172) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv3.conv.weight + /model/neck/neck3/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_stem.seq.conv.weight + /model/heads/head2/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_stem/seq/conv/Conv || model.heads.head2.bbox_stem.seq.conv.weight + /model/heads/head2/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/bbox_stem/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.conv.conv.weight + /model/neck/neck4/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/conv/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.reg_convs.0.seq.conv.weight + /model/heads/head2/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head2.cls_convs.0.seq.conv.weight + /model/heads/head2/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_convs.0.seq.conv.weight + /model/heads/head2/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv1/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.cls_pred.weight + /model/heads/head2/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/cls_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.reg_pred.weight + /model/heads/head2/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/reg_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_convs.1.seq.conv.weight + /model/heads/head2/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv2.conv.weight + /model/neck/neck4/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv1.conv.weight + /model/neck/neck4/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_pred.weight + /model/heads/head2/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.0.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.0.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 1238) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.1.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.1.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1279) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.2.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.2.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1295) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.3.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.3.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1311) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv3.conv.weight + /model/neck/neck4/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv3/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.bbox_stem.seq.conv.weight + /model/heads/head3/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/bbox_stem/seq/conv/Conv || model.heads.head3.pose_stem.seq.conv.weight + /model/heads/head3/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_stem/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.reg_convs.0.seq.conv.weight + /model/heads/head3/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head3.cls_convs.0.seq.conv.weight + /model/heads/head3/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.0.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.cls_pred.weight + /model/heads/head3/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/cls_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.reg_pred.weight + /model/heads/head3/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/reg_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.1.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.2.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.2/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_pred.weight + /model/heads/head3/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_pred/Conv
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] NMS: batched_nms_274
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 1424) [NMS]_1_output[DevicetoShapeHostCopy]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[01/04/2024-16:29:21] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[01/04/2024-16:29:23] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +709, now: CPU 1532, GPU 5277 (MiB)
-[01/04/2024-16:29:23] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +122, now: CPU 1615, GPU 5399 (MiB)
-[01/04/2024-16:29:23] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[01/04/2024-17:17:36] [I] [TRT] Total Activation Memory: 7995617792
-[01/04/2024-17:17:36] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[01/04/2024-17:17:49] [I] [TRT] Total Host Persistent Memory: 355104
-[01/04/2024-17:17:49] [I] [TRT] Total Device Persistent Memory: 38912
-[01/04/2024-17:17:49] [I] [TRT] Total Scratch Memory: 134217728
-[01/04/2024-17:17:49] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 264 MiB, GPU 454 MiB
-[01/04/2024-17:17:49] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 193 steps to complete.
-[01/04/2024-17:17:49] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 64.2907ms to assign 14 blocks to 193 nodes requiring 156760576 bytes.
-[01/04/2024-17:17:49] [I] [TRT] Total Activation Memory: 156760576
-[01/04/2024-17:17:54] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 2004, GPU 6256 (MiB)
-[01/04/2024-17:17:54] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +52, GPU +64, now: CPU 52, GPU 64 (MiB)
-[01/04/2024-17:17:55] [I] Engine built in 2929.02 sec.
-[01/04/2024-17:17:56] [I] [TRT] Loaded engine size: 54 MiB
-[01/04/2024-17:17:56] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1289, GPU 6081 (MiB)
-[01/04/2024-17:17:56] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +52, now: CPU 0, GPU 52 (MiB)
-[01/04/2024-17:17:56] [I] Engine deserialized in 0.231092 sec.
-[01/04/2024-17:17:56] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +0, now: CPU 1290, GPU 6081 (MiB)
-[01/04/2024-17:17:56] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +150, now: CPU 0, GPU 202 (MiB)
-[01/04/2024-17:17:56] [I] Setting persistentCacheLimit to 0 bytes.
-[01/04/2024-17:17:56] [I] Using random values for input onnx::Cast_0
-[01/04/2024-17:17:56] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[01/04/2024-17:17:56] [I] Using random values for output graph2_flat_predictions
-[01/04/2024-17:17:56] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[01/04/2024-17:17:56] [I] Starting inference
-[01/04/2024-17:18:11] [I] Warmup completed 1 queries over 200 ms
-[01/04/2024-17:18:11] [I] Timing trace has 558 queries over 15.0626 s
-[01/04/2024-17:18:11] [I] 
-[01/04/2024-17:18:11] [I] === Trace details ===
-[01/04/2024-17:18:11] [I] Trace averages of 100 runs:
-[01/04/2024-17:18:11] [I] Average on 100 runs - GPU latency: 26.7701 ms - Host latency: 26.8828 ms (enqueue 26.8497 ms)
-[01/04/2024-17:18:11] [I] Average on 100 runs - GPU latency: 26.6869 ms - Host latency: 26.7991 ms (enqueue 26.7651 ms)
-[01/04/2024-17:18:11] [I] Average on 100 runs - GPU latency: 27.379 ms - Host latency: 27.4948 ms (enqueue 27.4419 ms)
-[01/04/2024-17:18:11] [I] Average on 100 runs - GPU latency: 26.705 ms - Host latency: 26.8182 ms (enqueue 26.7798 ms)
-[01/04/2024-17:18:11] [I] Average on 100 runs - GPU latency: 26.7381 ms - Host latency: 26.8502 ms (enqueue 26.8217 ms)
-[01/04/2024-17:18:11] [I] 
-[01/04/2024-17:18:11] [I] === Performance summary ===
-[01/04/2024-17:18:11] [I] Throughput: 37.0454 qps
-[01/04/2024-17:18:11] [I] Latency: min = 24.9771 ms, max = 29.9172 ms, mean = 26.961 ms, median = 26.9275 ms, percentile(90%) = 27.7314 ms, percentile(95%) = 27.9893 ms, percentile(99%) = 28.6138 ms
-[01/04/2024-17:18:11] [I] Enqueue Time: min = 24.9473 ms, max = 29.8674 ms, mean = 26.9238 ms, median = 26.8907 ms, percentile(90%) = 27.6934 ms, percentile(95%) = 27.9502 ms, percentile(99%) = 28.5469 ms
-[01/04/2024-17:18:11] [I] H2D Latency: min = 0.0820312 ms, max = 0.104492 ms, mean = 0.0971751 ms, median = 0.0976562 ms, percentile(90%) = 0.098877 ms, percentile(95%) = 0.0996094 ms, percentile(99%) = 0.100586 ms
-[01/04/2024-17:18:11] [I] GPU Compute Time: min = 24.8701 ms, max = 29.8003 ms, mean = 26.8479 ms, median = 26.8156 ms, percentile(90%) = 27.6133 ms, percentile(95%) = 27.876 ms, percentile(99%) = 28.4907 ms
-[01/04/2024-17:18:11] [I] D2H Latency: min = 0.00292969 ms, max = 0.0761719 ms, mean = 0.0158822 ms, median = 0.0136719 ms, percentile(90%) = 0.0253906 ms, percentile(95%) = 0.0273438 ms, percentile(99%) = 0.0361328 ms
-[01/04/2024-17:18:11] [I] Total Host Walltime: 15.0626 s
-[01/04/2024-17:18:11] [I] Total GPU Compute Time: 14.9811 s
-[01/04/2024-17:18:11] [I] Explanations of the performance metrics are printed in the verbose logs.
-[01/04/2024-17:18:11] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.best.engine

yolo_nas_pose_l_int8.onnx.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-19:27:20] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-19:27:20] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-19:27:24] [E] Error[4]: [network.cpp::validate::2922] Error Code 4: Internal Error (Int8 precision has been set for a layer or layer output, but int8 is not configured in the builder)
-[12/28/2023-19:27:24] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-19:27:24] [E] Engine could not be created from network
-[12/28/2023-19:27:24] [E] Building engine failed
-[12/28/2023-19:27:24] [E] Failed to create engine from model or file.
-[12/28/2023-19:27:24] [E] Engine set up failed

yolo_nas_pose_l_int8.onnx.engine.log

@@ -1,91 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.engine
-[12/28/2023-19:27:14] [I] === Model Options ===
-[12/28/2023-19:27:14] [I] Format: ONNX
-[12/28/2023-19:27:14] [I] Model: yolo_nas_pose_l_int8.onnx
-[12/28/2023-19:27:14] [I] Output:
-[12/28/2023-19:27:14] [I] === Build Options ===
-[12/28/2023-19:27:14] [I] Max batch: explicit batch
-[12/28/2023-19:27:14] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-19:27:14] [I] minTiming: 1
-[12/28/2023-19:27:14] [I] avgTiming: 8
-[12/28/2023-19:27:14] [I] Precision: FP32
-[12/28/2023-19:27:14] [I] LayerPrecisions: 
-[12/28/2023-19:27:14] [I] Calibration: 
-[12/28/2023-19:27:14] [I] Refit: Disabled
-[12/28/2023-19:27:14] [I] Sparsity: Disabled
-[12/28/2023-19:27:14] [I] Safe mode: Disabled
-[12/28/2023-19:27:14] [I] DirectIO mode: Disabled
-[12/28/2023-19:27:14] [I] Restricted mode: Disabled
-[12/28/2023-19:27:14] [I] Build only: Disabled
-[12/28/2023-19:27:14] [I] Save engine: yolo_nas_pose_l_int8.onnx.engine
-[12/28/2023-19:27:14] [I] Load engine: 
-[12/28/2023-19:27:14] [I] Profiling verbosity: 0
-[12/28/2023-19:27:14] [I] Tactic sources: Using default tactic sources
-[12/28/2023-19:27:14] [I] timingCacheMode: local
-[12/28/2023-19:27:14] [I] timingCacheFile: 
-[12/28/2023-19:27:14] [I] Heuristic: Disabled
-[12/28/2023-19:27:14] [I] Preview Features: Use default preview flags.
-[12/28/2023-19:27:14] [I] Input(s)s format: fp32:CHW
-[12/28/2023-19:27:14] [I] Output(s)s format: fp32:CHW
-[12/28/2023-19:27:14] [I] Input build shapes: model
-[12/28/2023-19:27:14] [I] Input calibration shapes: model
-[12/28/2023-19:27:14] [I] === System Options ===
-[12/28/2023-19:27:14] [I] Device: 0
-[12/28/2023-19:27:14] [I] DLACore: 
-[12/28/2023-19:27:14] [I] Plugins:
-[12/28/2023-19:27:14] [I] === Inference Options ===
-[12/28/2023-19:27:14] [I] Batch: Explicit
-[12/28/2023-19:27:14] [I] Input inference shapes: model
-[12/28/2023-19:27:14] [I] Iterations: 10
-[12/28/2023-19:27:14] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-19:27:14] [I] Sleep time: 0ms
-[12/28/2023-19:27:14] [I] Idle time: 0ms
-[12/28/2023-19:27:14] [I] Streams: 1
-[12/28/2023-19:27:14] [I] ExposeDMA: Disabled
-[12/28/2023-19:27:14] [I] Data transfers: Enabled
-[12/28/2023-19:27:14] [I] Spin-wait: Disabled
-[12/28/2023-19:27:14] [I] Multithreading: Disabled
-[12/28/2023-19:27:14] [I] CUDA Graph: Disabled
-[12/28/2023-19:27:14] [I] Separate profiling: Disabled
-[12/28/2023-19:27:14] [I] Time Deserialize: Disabled
-[12/28/2023-19:27:14] [I] Time Refit: Disabled
-[12/28/2023-19:27:14] [I] NVTX verbosity: 0
-[12/28/2023-19:27:14] [I] Persistent Cache Ratio: 0
-[12/28/2023-19:27:14] [I] Inputs:
-[12/28/2023-19:27:14] [I] === Reporting Options ===
-[12/28/2023-19:27:14] [I] Verbose: Disabled
-[12/28/2023-19:27:14] [I] Averages: 100 inferences
-[12/28/2023-19:27:14] [I] Percentiles: 90,95,99
-[12/28/2023-19:27:14] [I] Dump refittable layers:Disabled
-[12/28/2023-19:27:14] [I] Dump output: Disabled
-[12/28/2023-19:27:14] [I] Profile: Disabled
-[12/28/2023-19:27:14] [I] Export timing to JSON file: 
-[12/28/2023-19:27:14] [I] Export output to JSON file: 
-[12/28/2023-19:27:14] [I] Export profile to JSON file: 
-[12/28/2023-19:27:14] [I] 
-[12/28/2023-19:27:14] [I] === Device Information ===
-[12/28/2023-19:27:14] [I] Selected Device: Orin
-[12/28/2023-19:27:14] [I] Compute Capability: 8.7
-[12/28/2023-19:27:14] [I] SMs: 8
-[12/28/2023-19:27:14] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-19:27:14] [I] Device Global Memory: 7471 MiB
-[12/28/2023-19:27:14] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-19:27:14] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-19:27:14] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-19:27:14] [I] 
-[12/28/2023-19:27:14] [I] TensorRT version: 8.5.2
-[12/28/2023-19:27:14] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2835 (MiB)
-[12/28/2023-19:27:17] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +286, now: CPU 574, GPU 3142 (MiB)
-[12/28/2023-19:27:17] [I] Start parsing network model
-[12/28/2023-19:27:20] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:20] [I] [TRT] Input filename:   yolo_nas_pose_l_int8.onnx
-[12/28/2023-19:27:20] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-19:27:20] [I] [TRT] Opset version:    17
-[12/28/2023-19:27:20] [I] [TRT] Producer name:    pytorch
-[12/28/2023-19:27:20] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-19:27:20] [I] [TRT] Domain:           
-[12/28/2023-19:27:20] [I] [TRT] Model version:    0
-[12/28/2023-19:27:20] [I] [TRT] Doc string:       
-[12/28/2023-19:27:20] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:24] [I] Finish parsing network model
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.engine

yolo_nas_pose_l_int8.onnx.fp16.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-19:27:29] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-19:27:29] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-19:27:33] [E] Error[4]: [network.cpp::validate::2922] Error Code 4: Internal Error (Int8 precision has been set for a layer or layer output, but int8 is not configured in the builder)
-[12/28/2023-19:27:33] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-19:27:33] [E] Engine could not be created from network
-[12/28/2023-19:27:33] [E] Building engine failed
-[12/28/2023-19:27:33] [E] Failed to create engine from model or file.
-[12/28/2023-19:27:33] [E] Engine set up failed

yolo_nas_pose_l_int8.onnx.fp16.engine.log

@@ -1,91 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.fp16.engine
-[12/28/2023-19:27:25] [I] === Model Options ===
-[12/28/2023-19:27:25] [I] Format: ONNX
-[12/28/2023-19:27:25] [I] Model: yolo_nas_pose_l_int8.onnx
-[12/28/2023-19:27:25] [I] Output:
-[12/28/2023-19:27:25] [I] === Build Options ===
-[12/28/2023-19:27:25] [I] Max batch: explicit batch
-[12/28/2023-19:27:25] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-19:27:25] [I] minTiming: 1
-[12/28/2023-19:27:25] [I] avgTiming: 8
-[12/28/2023-19:27:25] [I] Precision: FP32+FP16
-[12/28/2023-19:27:25] [I] LayerPrecisions: 
-[12/28/2023-19:27:25] [I] Calibration: 
-[12/28/2023-19:27:25] [I] Refit: Disabled
-[12/28/2023-19:27:25] [I] Sparsity: Disabled
-[12/28/2023-19:27:25] [I] Safe mode: Disabled
-[12/28/2023-19:27:25] [I] DirectIO mode: Disabled
-[12/28/2023-19:27:25] [I] Restricted mode: Disabled
-[12/28/2023-19:27:25] [I] Build only: Disabled
-[12/28/2023-19:27:25] [I] Save engine: yolo_nas_pose_l_int8.onnx.fp16.engine
-[12/28/2023-19:27:25] [I] Load engine: 
-[12/28/2023-19:27:25] [I] Profiling verbosity: 0
-[12/28/2023-19:27:25] [I] Tactic sources: Using default tactic sources
-[12/28/2023-19:27:25] [I] timingCacheMode: local
-[12/28/2023-19:27:25] [I] timingCacheFile: 
-[12/28/2023-19:27:25] [I] Heuristic: Disabled
-[12/28/2023-19:27:25] [I] Preview Features: Use default preview flags.
-[12/28/2023-19:27:25] [I] Input(s)s format: fp32:CHW
-[12/28/2023-19:27:25] [I] Output(s)s format: fp32:CHW
-[12/28/2023-19:27:25] [I] Input build shapes: model
-[12/28/2023-19:27:25] [I] Input calibration shapes: model
-[12/28/2023-19:27:25] [I] === System Options ===
-[12/28/2023-19:27:25] [I] Device: 0
-[12/28/2023-19:27:25] [I] DLACore: 
-[12/28/2023-19:27:25] [I] Plugins:
-[12/28/2023-19:27:25] [I] === Inference Options ===
-[12/28/2023-19:27:25] [I] Batch: Explicit
-[12/28/2023-19:27:25] [I] Input inference shapes: model
-[12/28/2023-19:27:25] [I] Iterations: 10
-[12/28/2023-19:27:25] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-19:27:25] [I] Sleep time: 0ms
-[12/28/2023-19:27:25] [I] Idle time: 0ms
-[12/28/2023-19:27:25] [I] Streams: 1
-[12/28/2023-19:27:25] [I] ExposeDMA: Disabled
-[12/28/2023-19:27:25] [I] Data transfers: Enabled
-[12/28/2023-19:27:25] [I] Spin-wait: Disabled
-[12/28/2023-19:27:25] [I] Multithreading: Disabled
-[12/28/2023-19:27:25] [I] CUDA Graph: Disabled
-[12/28/2023-19:27:25] [I] Separate profiling: Disabled
-[12/28/2023-19:27:25] [I] Time Deserialize: Disabled
-[12/28/2023-19:27:25] [I] Time Refit: Disabled
-[12/28/2023-19:27:25] [I] NVTX verbosity: 0
-[12/28/2023-19:27:25] [I] Persistent Cache Ratio: 0
-[12/28/2023-19:27:25] [I] Inputs:
-[12/28/2023-19:27:25] [I] === Reporting Options ===
-[12/28/2023-19:27:25] [I] Verbose: Disabled
-[12/28/2023-19:27:25] [I] Averages: 100 inferences
-[12/28/2023-19:27:25] [I] Percentiles: 90,95,99
-[12/28/2023-19:27:25] [I] Dump refittable layers:Disabled
-[12/28/2023-19:27:25] [I] Dump output: Disabled
-[12/28/2023-19:27:25] [I] Profile: Disabled
-[12/28/2023-19:27:25] [I] Export timing to JSON file: 
-[12/28/2023-19:27:25] [I] Export output to JSON file: 
-[12/28/2023-19:27:25] [I] Export profile to JSON file: 
-[12/28/2023-19:27:25] [I] 
-[12/28/2023-19:27:25] [I] === Device Information ===
-[12/28/2023-19:27:25] [I] Selected Device: Orin
-[12/28/2023-19:27:25] [I] Compute Capability: 8.7
-[12/28/2023-19:27:25] [I] SMs: 8
-[12/28/2023-19:27:25] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-19:27:25] [I] Device Global Memory: 7471 MiB
-[12/28/2023-19:27:25] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-19:27:25] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-19:27:25] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-19:27:25] [I] 
-[12/28/2023-19:27:25] [I] TensorRT version: 8.5.2
-[12/28/2023-19:27:26] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2833 (MiB)
-[12/28/2023-19:27:28] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +284, now: CPU 574, GPU 3139 (MiB)
-[12/28/2023-19:27:28] [I] Start parsing network model
-[12/28/2023-19:27:29] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:29] [I] [TRT] Input filename:   yolo_nas_pose_l_int8.onnx
-[12/28/2023-19:27:29] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-19:27:29] [I] [TRT] Opset version:    17
-[12/28/2023-19:27:29] [I] [TRT] Producer name:    pytorch
-[12/28/2023-19:27:29] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-19:27:29] [I] [TRT] Domain:           
-[12/28/2023-19:27:29] [I] [TRT] Model version:    0
-[12/28/2023-19:27:29] [I] [TRT] Doc string:       
-[12/28/2023-19:27:29] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-19:27:33] [I] Finish parsing network model
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.fp16.engine

yolo_nas_pose_l_int8.onnx.int8.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:f0e0b6cf94d6d65e68c969cd873afeffe71477632d733e3a4f8a9d1d9242fa72
-size 57416931

yolo_nas_pose_l_int8.onnx.int8.engine.err

@@ -1,7 +0,0 @@
-[01/04/2024-17:18:28] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[01/04/2024-17:18:28] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[01/04/2024-17:18:32] [W] [TRT] Calibrator won't be used in explicit precision mode. Use quantization aware training to generate network with Quantize/Dequantize nodes.
-[01/04/2024-17:33:32] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[01/04/2024-17:33:32] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[01/04/2024-17:33:32] [W] * GPU compute time is unstable, with coefficient of variance = 9.56431%.
-[01/04/2024-17:33:32] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_l_int8.onnx.int8.engine.log

@@ -1,362 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.int8.engine
-[01/04/2024-17:18:16] [I] === Model Options ===
-[01/04/2024-17:18:16] [I] Format: ONNX
-[01/04/2024-17:18:16] [I] Model: yolo_nas_pose_l_int8.onnx
-[01/04/2024-17:18:16] [I] Output:
-[01/04/2024-17:18:16] [I] === Build Options ===
-[01/04/2024-17:18:16] [I] Max batch: explicit batch
-[01/04/2024-17:18:16] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[01/04/2024-17:18:16] [I] minTiming: 1
-[01/04/2024-17:18:16] [I] avgTiming: 8
-[01/04/2024-17:18:16] [I] Precision: FP32+INT8
-[01/04/2024-17:18:16] [I] LayerPrecisions: 
-[01/04/2024-17:18:16] [I] Calibration: Dynamic
-[01/04/2024-17:18:16] [I] Refit: Disabled
-[01/04/2024-17:18:16] [I] Sparsity: Disabled
-[01/04/2024-17:18:16] [I] Safe mode: Disabled
-[01/04/2024-17:18:16] [I] DirectIO mode: Disabled
-[01/04/2024-17:18:16] [I] Restricted mode: Disabled
-[01/04/2024-17:18:16] [I] Build only: Disabled
-[01/04/2024-17:18:16] [I] Save engine: yolo_nas_pose_l_int8.onnx.int8.engine
-[01/04/2024-17:18:16] [I] Load engine: 
-[01/04/2024-17:18:16] [I] Profiling verbosity: 0
-[01/04/2024-17:18:16] [I] Tactic sources: Using default tactic sources
-[01/04/2024-17:18:16] [I] timingCacheMode: local
-[01/04/2024-17:18:16] [I] timingCacheFile: 
-[01/04/2024-17:18:16] [I] Heuristic: Disabled
-[01/04/2024-17:18:16] [I] Preview Features: Use default preview flags.
-[01/04/2024-17:18:16] [I] Input(s)s format: fp32:CHW
-[01/04/2024-17:18:16] [I] Output(s)s format: fp32:CHW
-[01/04/2024-17:18:16] [I] Input build shapes: model
-[01/04/2024-17:18:16] [I] Input calibration shapes: model
-[01/04/2024-17:18:16] [I] === System Options ===
-[01/04/2024-17:18:16] [I] Device: 0
-[01/04/2024-17:18:16] [I] DLACore: 
-[01/04/2024-17:18:16] [I] Plugins:
-[01/04/2024-17:18:16] [I] === Inference Options ===
-[01/04/2024-17:18:16] [I] Batch: Explicit
-[01/04/2024-17:18:16] [I] Input inference shapes: model
-[01/04/2024-17:18:16] [I] Iterations: 10
-[01/04/2024-17:18:16] [I] Duration: 15s (+ 200ms warm up)
-[01/04/2024-17:18:16] [I] Sleep time: 0ms
-[01/04/2024-17:18:16] [I] Idle time: 0ms
-[01/04/2024-17:18:16] [I] Streams: 1
-[01/04/2024-17:18:16] [I] ExposeDMA: Disabled
-[01/04/2024-17:18:16] [I] Data transfers: Enabled
-[01/04/2024-17:18:16] [I] Spin-wait: Disabled
-[01/04/2024-17:18:16] [I] Multithreading: Disabled
-[01/04/2024-17:18:16] [I] CUDA Graph: Disabled
-[01/04/2024-17:18:16] [I] Separate profiling: Disabled
-[01/04/2024-17:18:16] [I] Time Deserialize: Disabled
-[01/04/2024-17:18:16] [I] Time Refit: Disabled
-[01/04/2024-17:18:16] [I] NVTX verbosity: 0
-[01/04/2024-17:18:16] [I] Persistent Cache Ratio: 0
-[01/04/2024-17:18:16] [I] Inputs:
-[01/04/2024-17:18:16] [I] === Reporting Options ===
-[01/04/2024-17:18:16] [I] Verbose: Disabled
-[01/04/2024-17:18:16] [I] Averages: 100 inferences
-[01/04/2024-17:18:16] [I] Percentiles: 90,95,99
-[01/04/2024-17:18:16] [I] Dump refittable layers:Disabled
-[01/04/2024-17:18:16] [I] Dump output: Disabled
-[01/04/2024-17:18:16] [I] Profile: Disabled
-[01/04/2024-17:18:16] [I] Export timing to JSON file: 
-[01/04/2024-17:18:16] [I] Export output to JSON file: 
-[01/04/2024-17:18:16] [I] Export profile to JSON file: 
-[01/04/2024-17:18:16] [I] 
-[01/04/2024-17:18:16] [I] === Device Information ===
-[01/04/2024-17:18:16] [I] Selected Device: Orin
-[01/04/2024-17:18:16] [I] Compute Capability: 8.7
-[01/04/2024-17:18:16] [I] SMs: 8
-[01/04/2024-17:18:16] [I] Compute Clock Rate: 0.624 GHz
-[01/04/2024-17:18:16] [I] Device Global Memory: 7471 MiB
-[01/04/2024-17:18:16] [I] Shared Memory per SM: 164 KiB
-[01/04/2024-17:18:16] [I] Memory Bus Width: 128 bits (ECC disabled)
-[01/04/2024-17:18:16] [I] Memory Clock Rate: 0.624 GHz
-[01/04/2024-17:18:16] [I] 
-[01/04/2024-17:18:16] [I] TensorRT version: 8.5.2
-[01/04/2024-17:18:21] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3806 (MiB)
-[01/04/2024-17:18:25] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +286, now: CPU 574, GPU 4109 (MiB)
-[01/04/2024-17:18:25] [I] Start parsing network model
-[01/04/2024-17:18:28] [I] [TRT] ----------------------------------------------------------------
-[01/04/2024-17:18:28] [I] [TRT] Input filename:   yolo_nas_pose_l_int8.onnx
-[01/04/2024-17:18:28] [I] [TRT] ONNX IR version:  0.0.8
-[01/04/2024-17:18:28] [I] [TRT] Opset version:    17
-[01/04/2024-17:18:28] [I] [TRT] Producer name:    pytorch
-[01/04/2024-17:18:28] [I] [TRT] Producer version: 2.1.2
-[01/04/2024-17:18:28] [I] [TRT] Domain:           
-[01/04/2024-17:18:28] [I] [TRT] Model version:    0
-[01/04/2024-17:18:28] [I] [TRT] Doc string:       
-[01/04/2024-17:18:28] [I] [TRT] ----------------------------------------------------------------
-[01/04/2024-17:18:32] [I] Finish parsing network model
-[01/04/2024-17:18:32] [I] FP32 and INT8 precisions have been specified - more performance might be enabled by additionally specifying --fp16 or --best
-[01/04/2024-17:18:37] [I] [TRT] ---------- Layers Running on DLA ----------
-[01/04/2024-17:18:37] [I] [TRT] ---------- Layers Running on GPU ----------
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1420) [Constant]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1421) [Constant]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 1422) [Constant]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stem/conv/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stem.conv.rbr_reparam.weight + /model/backbone/stem/conv/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stem/conv/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.downsample.rbr_reparam.weight + /model/backbone/stage1/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/downsample/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv2.conv.weight + /model/backbone/stage1/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv1.conv.weight + /model/backbone/stage1/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 557) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 573) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage1.blocks.conv3.conv.weight + /model/backbone/stage1/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage1/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.reduce_skip2.conv.weight + /model/neck/neck2/reduce_skip2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_skip2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.downsample.rbr_reparam.weight + /model/backbone/stage2/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/downsample/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.downsample.conv.weight + /model/neck/neck2/downsample/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/downsample/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv2.conv.weight + /model/backbone/stage2/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv1.conv.weight + /model/backbone/stage2/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 620) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 636) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 652) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_2
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage2.blocks.conv3.conv.weight + /model/backbone/stage2/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage2/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_skip2.conv.weight + /model/neck/neck1/reduce_skip2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_skip2/conv/Conv || model.neck.neck2.reduce_skip1.conv.weight + /model/neck/neck2/reduce_skip1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_skip1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.downsample.rbr_reparam.weight + /model/backbone/stage3/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/downsample/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.downsample.conv.weight + /model/neck/neck1/downsample/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/downsample/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv2.conv.weight + /model/backbone/stage3/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv1.conv.weight + /model/backbone/stage3/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 702) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 718) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 734) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 750) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.4.cv1.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.bottlenecks.4.cv2.rbr_reparam.weight + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 766) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_4
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_3
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_2
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage3.blocks.conv3.conv.weight + /model/backbone/stage3/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage3/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_skip1.conv.weight + /model/neck/neck1/reduce_skip1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_skip1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.downsample.rbr_reparam.weight + /model/backbone/stage4/downsample/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/downsample/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv2.conv.weight + /model/backbone/stage4/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv1.conv.weight + /model/backbone/stage4/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 807) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 823) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv3/conv/_input_quantizer/QuantizeLinear_clone_0
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.stage4.blocks.conv3.conv.weight + /model/backbone/stage4/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/backbone/stage4/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.context_module.cv1.conv.weight + /model/backbone/context_module/cv1/conv/_weight_quantizer/QuantizeLinear + /model/backbone/context_module/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/m.2/MaxPool_output_0 copy
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.backbone.context_module.cv2.conv.weight + /model/backbone/context_module/cv2/conv/_weight_quantizer/QuantizeLinear + /model/backbone/context_module/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.conv.conv.weight + /model/neck/neck1/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/conv/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/upsample/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] DECONVOLUTION: model.neck.neck1.upsample.weight + /model/neck/neck1/upsample/_weight_quantizer/QuantizeLinear + /model/neck/neck1/upsample/ConvTranspose
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.reduce_after_concat.conv.weight + /model/neck/neck1/reduce_after_concat/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/reduce_after_concat/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv2.conv.weight + /model/neck/neck1/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv1.conv.weight + /model/neck/neck1/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 888) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 904) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.2.alpha + (Unnamed Layer* 920) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.3.alpha + (Unnamed Layer* 936) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck1.blocks.conv3.conv.weight + /model/neck/neck1/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck1/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.conv.conv.weight + /model/neck/neck2/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/conv/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/upsample/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] DECONVOLUTION: model.neck.neck2.upsample.weight + /model/neck/neck2/upsample/_weight_quantizer/QuantizeLinear + /model/neck/neck2/upsample/ConvTranspose
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/Concat_/model/neck/neck2/reduce_skip1/act/Relu_output_0_clone_1 copy
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.reduce_after_concat.conv.weight + /model/neck/neck2/reduce_after_concat/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/reduce_after_concat/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv2.conv.weight + /model/neck/neck2/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv1.conv.weight + /model/neck/neck2/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.0.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.0.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 985) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.1.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.1.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1001) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.2.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.2.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1017) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.3.cv1.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.bottlenecks.3.cv2.rbr_reparam.weight + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1033) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck2.blocks.conv3.conv.weight + /model/neck/neck2/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck2/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.bbox_stem.seq.conv.weight + /model/heads/head1/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/bbox_stem/seq/conv/Conv || model.heads.head1.pose_stem.seq.conv.weight + /model/heads/head1/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_stem/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.conv.conv.weight + /model/neck/neck3/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/conv/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.reg_convs.0.seq.conv.weight + /model/heads/head1/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head1.cls_convs.0.seq.conv.weight + /model/heads/head1/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_convs.0.seq.conv.weight + /model/heads/head1/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv1/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.cls_pred.weight + /model/heads/head1/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/cls_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.reg_pred.weight + /model/heads/head1/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/reg_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_convs.1.seq.conv.weight + /model/heads/head1/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv2.conv.weight + /model/neck/neck3/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv1.conv.weight + /model/neck/neck3/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head1.pose_pred.weight + /model/heads/head1/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head1/pose_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.0.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.0.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 1099) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.1.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.1.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1140) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.2.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.2.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1156) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.3.cv1.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.bottlenecks.3.cv2.conv.weight + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1172) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck3.blocks.conv3.conv.weight + /model/neck/neck3/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck3/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_stem.seq.conv.weight + /model/heads/head2/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_stem/seq/conv/Conv || model.heads.head2.bbox_stem.seq.conv.weight + /model/heads/head2/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/bbox_stem/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.conv.conv.weight + /model/neck/neck4/conv/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/conv/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.reg_convs.0.seq.conv.weight + /model/heads/head2/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head2.cls_convs.0.seq.conv.weight + /model/heads/head2/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_convs.0.seq.conv.weight + /model/heads/head2/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv1/conv/_input_quantizer/QuantizeLinear_clone_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.cls_pred.weight + /model/heads/head2/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/cls_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.reg_pred.weight + /model/heads/head2/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/reg_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_convs.1.seq.conv.weight + /model/heads/head2/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv2.conv.weight + /model/neck/neck4/blocks/conv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv1.conv.weight + /model/neck/neck4/blocks/conv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head2.pose_pred.weight + /model/heads/head2/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head2/pose_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.0.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.0.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 1238) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.1.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.1.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 1279) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.2.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.2.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 1295) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/_input_quantizer/QuantizeLinear
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.3.cv1.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv1/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.bottlenecks.3.cv2.conv.weight + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/cv2/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.3.alpha + (Unnamed Layer* 1311) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.3/Add)
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.neck.neck4.blocks.conv3.conv.weight + /model/neck/neck4/blocks/conv3/conv/_weight_quantizer/QuantizeLinear + /model/neck/neck4/blocks/conv3/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.bbox_stem.seq.conv.weight + /model/heads/head3/bbox_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/bbox_stem/seq/conv/Conv || model.heads.head3.pose_stem.seq.conv.weight + /model/heads/head3/pose_stem/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_stem/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.reg_convs.0.seq.conv.weight + /model/heads/head3/reg_convs/reg_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv || model.heads.head3.cls_convs.0.seq.conv.weight + /model/heads/head3/cls_convs/cls_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.0.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.0/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.cls_pred.weight + /model/heads/head3/cls_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/cls_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.reg_pred.weight + /model/heads/head3/reg_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/reg_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.1.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.1/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_convs.2.seq.conv.weight + /model/heads/head3/pose_convs/pose_convs.2/seq/conv/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: model.heads.head3.pose_pred.weight + /model/heads/head3/pose_pred/_weight_quantizer/QuantizeLinear + /model/heads/head3/pose_pred/Conv
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] NMS: batched_nms_274
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 1424) [NMS]_1_output[DevicetoShapeHostCopy]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[01/04/2024-17:18:37] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[01/04/2024-17:18:52] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +482, now: CPU 1532, GPU 4985 (MiB)
-[01/04/2024-17:18:54] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU -45, now: CPU 1615, GPU 4940 (MiB)
-[01/04/2024-17:18:54] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[01/04/2024-17:33:03] [I] [TRT] Total Activation Memory: 8078602752
-[01/04/2024-17:33:04] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[01/04/2024-17:33:13] [I] [TRT] Total Host Persistent Memory: 354080
-[01/04/2024-17:33:13] [I] [TRT] Total Device Persistent Memory: 38912
-[01/04/2024-17:33:13] [I] [TRT] Total Scratch Memory: 134217728
-[01/04/2024-17:33:13] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 264 MiB, GPU 132 MiB
-[01/04/2024-17:33:13] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 199 steps to complete.
-[01/04/2024-17:33:13] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 76.2715ms to assign 13 blocks to 199 nodes requiring 184909824 bytes.
-[01/04/2024-17:33:13] [I] [TRT] Total Activation Memory: 184909824
-[01/04/2024-17:33:14] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -14, now: CPU 2002, GPU 5644 (MiB)
-[01/04/2024-17:33:15] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +52, GPU +64, now: CPU 52, GPU 64 (MiB)
-[01/04/2024-17:33:15] [I] Engine built in 899.271 sec.
-[01/04/2024-17:33:16] [I] [TRT] Loaded engine size: 54 MiB
-[01/04/2024-17:33:16] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +0, now: CPU 1289, GPU 5584 (MiB)
-[01/04/2024-17:33:16] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +52, now: CPU 0, GPU 52 (MiB)
-[01/04/2024-17:33:16] [I] Engine deserialized in 0.111801 sec.
-[01/04/2024-17:33:16] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1289, GPU 5584 (MiB)
-[01/04/2024-17:33:17] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +176, now: CPU 0, GPU 228 (MiB)
-[01/04/2024-17:33:17] [I] Setting persistentCacheLimit to 0 bytes.
-[01/04/2024-17:33:17] [I] Using random values for input onnx::Cast_0
-[01/04/2024-17:33:17] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[01/04/2024-17:33:17] [I] Using random values for output graph2_flat_predictions
-[01/04/2024-17:33:17] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[01/04/2024-17:33:17] [I] Starting inference
-[01/04/2024-17:33:32] [I] Warmup completed 2 queries over 200 ms
-[01/04/2024-17:33:32] [I] Timing trace has 455 queries over 15.0615 s
-[01/04/2024-17:33:32] [I] 
-[01/04/2024-17:33:32] [I] === Trace details ===
-[01/04/2024-17:33:32] [I] Trace averages of 100 runs:
-[01/04/2024-17:33:32] [I] Average on 100 runs - GPU latency: 32.9605 ms - Host latency: 33.0762 ms (enqueue 33.0077 ms)
-[01/04/2024-17:33:32] [I] Average on 100 runs - GPU latency: 33.0537 ms - Host latency: 33.1675 ms (enqueue 33.0924 ms)
-[01/04/2024-17:33:32] [I] Average on 100 runs - GPU latency: 32.1268 ms - Host latency: 32.2425 ms (enqueue 32.2062 ms)
-[01/04/2024-17:33:32] [I] Average on 100 runs - GPU latency: 33.0024 ms - Host latency: 33.1156 ms (enqueue 33.0402 ms)
-[01/04/2024-17:33:32] [I] 
-[01/04/2024-17:33:32] [I] === Performance summary ===
-[01/04/2024-17:33:32] [I] Throughput: 30.2094 qps
-[01/04/2024-17:33:32] [I] Latency: min = 30.0195 ms, max = 71.332 ms, mean = 33.0655 ms, median = 32.4204 ms, percentile(90%) = 34.8018 ms, percentile(95%) = 36.6191 ms, percentile(99%) = 46.4575 ms
-[01/04/2024-17:33:32] [I] Enqueue Time: min = 29.9561 ms, max = 71.791 ms, mean = 33.0028 ms, median = 32.3359 ms, percentile(90%) = 34.7646 ms, percentile(95%) = 36.8098 ms, percentile(99%) = 46.7935 ms
-[01/04/2024-17:33:32] [I] H2D Latency: min = 0.0839844 ms, max = 0.121582 ms, mean = 0.0949238 ms, median = 0.0944824 ms, percentile(90%) = 0.105469 ms, percentile(95%) = 0.108398 ms, percentile(99%) = 0.112305 ms
-[01/04/2024-17:33:32] [I] GPU Compute Time: min = 29.9189 ms, max = 71.2129 ms, mean = 32.9512 ms, median = 32.2991 ms, percentile(90%) = 34.6904 ms, percentile(95%) = 36.4971 ms, percentile(99%) = 46.3633 ms
-[01/04/2024-17:33:32] [I] D2H Latency: min = 0.00292969 ms, max = 0.0634766 ms, mean = 0.0193735 ms, median = 0.0205078 ms, percentile(90%) = 0.0307617 ms, percentile(95%) = 0.0344238 ms, percentile(99%) = 0.0463867 ms
-[01/04/2024-17:33:32] [I] Total Host Walltime: 15.0615 s
-[01/04/2024-17:33:32] [I] Total GPU Compute Time: 14.9928 s
-[01/04/2024-17:33:32] [I] Explanations of the performance metrics are printed in the verbose logs.
-[01/04/2024-17:33:32] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_l_int8.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_l_int8.onnx.int8.engine

yolo_nas_pose_m_fp16.onnx.best.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:d694deef0e1f970fb285d669185a1984b38cb587324b7c380b896a02794431ae
-size 41498155

yolo_nas_pose_m_fp16.onnx.best.engine.err

@@ -1,406 +0,0 @@
-[12/28/2023-08:45:30] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-08:45:30] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-08:45:30] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
-[12/28/2023-09:13:06] [W] [TRT] Tactic Device request: 6262MB Available: 3108MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:13:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:13:07] [W] [TRT] Tactic Device request: 6262MB Available: 3107MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:13:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6262 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:13:07] [W] [TRT] Tactic Device request: 6262MB Available: 3106MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:13:07] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:13:09] [W] [TRT] Tactic Device request: 6251MB Available: 3131MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:13:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6251 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:13:09] [W] [TRT] Tactic Device request: 6251MB Available: 3131MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:13:09] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6251 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:25] [W] [TRT] Tactic Device request: 4711MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:25] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:25] [W] [TRT] Tactic Device request: 4711MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:26] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:26] [W] [TRT] Tactic Device request: 4711MB Available: 2437MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:26] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:27] [W] [TRT] Tactic Device request: 4701MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:27] [W] [TRT] Tactic Device request: 4701MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:27] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:47] [W] [TRT] Tactic Device request: 6275MB Available: 2435MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:47] [W] [TRT] Tactic Device request: 6275MB Available: 2435MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:47] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:47] [W] [TRT] Tactic Device request: 6275MB Available: 2435MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:47] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:49] [W] [TRT] Tactic Device request: 6270MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:21:49] [W] [TRT] Tactic Device request: 6270MB Available: 2436MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:21:49] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:33] [W] [TRT] Tactic Device request: 7056MB Available: 2270MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:33] [W] [TRT] Tactic Device request: 7056MB Available: 2270MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:33] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:33] [W] [TRT] Tactic Device request: 7056MB Available: 2270MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:33] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:35] [W] [TRT] Tactic Device request: 7050MB Available: 2269MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:35] [W] [TRT] Tactic Device request: 7050MB Available: 2269MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:56] [W] [TRT] Tactic Device request: 6354MB Available: 2266MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:56] [W] [TRT] Tactic Device request: 6354MB Available: 2266MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:56] [W] [TRT] Tactic Device request: 6354MB Available: 2267MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:56] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:58] [W] [TRT] Tactic Device request: 6351MB Available: 2267MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:32:58] [W] [TRT] Tactic Device request: 6351MB Available: 2267MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:32:58] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:49] [W] [TRT] Tactic Device request: 2394MB Available: 2107MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:50] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:50] [W] [TRT] Tactic Device request: 2394MB Available: 2107MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:50] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:50] [W] [TRT] Tactic Device request: 2392MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:50] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:51] [W] [TRT] Tactic Device request: 2392MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:51] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:51] [W] [TRT] Tactic Device request: 2392MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:51] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:52] [W] [TRT] Tactic Device request: 2391MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:52] [W] [TRT] Tactic Device request: 2391MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:52] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:52] [W] [TRT] Tactic Device request: 2390MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:47:52] [W] [TRT] Tactic Device request: 2390MB Available: 2105MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:47:52] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:48:10] [W] [TRT] Tactic Device request: 4906MB Available: 2087MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:48:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:48:10] [W] [TRT] Tactic Device request: 4906MB Available: 2087MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:48:10] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:48:10] [W] [TRT] Tactic Device request: 4906MB Available: 2087MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:48:10] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:48:12] [W] [TRT] Tactic Device request: 4905MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:48:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:48:12] [W] [TRT] Tactic Device request: 4905MB Available: 2088MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:48:12] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:12] [W] [TRT] Tactic Device request: 4906MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:12] [W] [TRT] Tactic Device request: 4906MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:12] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:12] [W] [TRT] Tactic Device request: 4906MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:12] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:13] [W] [TRT] Tactic Device request: 4905MB Available: 1977MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:14] [W] [TRT] Tactic Device request: 4905MB Available: 1977MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:14] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:16] [W] [TRT] Tactic Device request: 2457MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:16] [W] [TRT] Tactic Device request: 2457MB Available: 1977MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:16] [W] [TRT] Tactic Device request: 2457MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:16] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:18] [W] [TRT] Tactic Device request: 2456MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:18] [W] [TRT] Tactic Device request: 2456MB Available: 1978MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:18] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:46] [W] [TRT] Tactic Device request: 3587MB Available: 1952MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:46] [W] [TRT] Tactic Device request: 3587MB Available: 1952MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:46] [W] [TRT] Tactic Device request: 3587MB Available: 1952MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:47] [W] [TRT] Tactic Device request: 3585MB Available: 1951MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:47] [W] [TRT] Tactic Device request: 3585MB Available: 1951MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:47] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:49] [W] [TRT] Tactic Device request: 2385MB Available: 1949MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:49] [W] [TRT] Tactic Device request: 2385MB Available: 1949MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2385 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:49] [W] [TRT] Tactic Device request: 2385MB Available: 1949MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:49] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:50] [W] [TRT] Tactic Device request: 2384MB Available: 1950MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:50] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2384 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-09:56:50] [W] [TRT] Tactic Device request: 2384MB Available: 1950MB. Device memory is insufficient to use tactic.
-[12/28/2023-09:56:50] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2384 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:05:05] [W] [TRT] Tactic Device request: 3556MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:05:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:05:05] [W] [TRT] Tactic Device request: 3556MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:05:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:05:05] [W] [TRT] Tactic Device request: 3556MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:05:05] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:05:06] [W] [TRT] Tactic Device request: 3551MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:05:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:05:06] [W] [TRT] Tactic Device request: 3551MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:05:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:43] [W] [TRT] Tactic Device request: 2359MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:43] [W] [TRT] Tactic Device request: 2359MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:43] [W] [TRT] Tactic Device request: 2359MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:44] [W] [TRT] Tactic Device request: 2355MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2355 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:44] [W] [TRT] Tactic Device request: 2355MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:44] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2355 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:51] [W] [TRT] Tactic Device request: 2362MB Available: 1754MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:51] [W] [TRT] Tactic Device request: 2362MB Available: 1754MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:51] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2362 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:51] [W] [TRT] Tactic Device request: 2362MB Available: 1754MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:51] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:54] [W] [TRT] Tactic Device request: 2357MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2357 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:54] [W] [TRT] Tactic Device request: 2357MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:54] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2357 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:57] [W] [TRT] Tactic Device request: 2359MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:57] [W] [TRT] Tactic Device request: 2359MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:57] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:15:57] [W] [TRT] Tactic Device request: 2359MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:15:58] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:16:00] [W] [TRT] Tactic Device request: 2356MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:16:00] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2356 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:16:00] [W] [TRT] Tactic Device request: 2356MB Available: 1752MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:16:00] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2356 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:24:58] [W] [TRT] Tactic Device request: 3575MB Available: 2009MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:24:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:24:58] [W] [TRT] Tactic Device request: 3575MB Available: 2009MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:24:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3575 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:24:58] [W] [TRT] Tactic Device request: 3575MB Available: 2009MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:24:58] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:24:59] [W] [TRT] Tactic Device request: 3572MB Available: 2008MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:24:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3572 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:24:59] [W] [TRT] Tactic Device request: 3572MB Available: 2008MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:24:59] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3572 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:08] [W] [TRT] Tactic Device request: 2390MB Available: 1909MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:08] [W] [TRT] Tactic Device request: 2390MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:08] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:09] [W] [TRT] Tactic Device request: 2390MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:09] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:12] [W] [TRT] Tactic Device request: 2387MB Available: 1824MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2387 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:12] [W] [TRT] Tactic Device request: 2387MB Available: 1800MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:12] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2387 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:15] [W] [TRT] Tactic Device request: 2388MB Available: 1797MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:16] [W] [TRT] Tactic Device request: 2388MB Available: 1753MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:16] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2388 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:16] [W] [TRT] Tactic Device request: 2388MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:16] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:19] [W] [TRT] Tactic Device request: 2386MB Available: 1749MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:19] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2386 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:19] [W] [TRT] Tactic Device request: 2386MB Available: 1729MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:19] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2386 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:23] [W] [TRT] Tactic Device request: 4775MB Available: 1722MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:23] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:24] [W] [TRT] Tactic Device request: 4775MB Available: 1600MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:24] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4775 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:25] [W] [TRT] Tactic Device request: 4775MB Available: 1593MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:25] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:30] [W] [TRT] Tactic Device request: 4772MB Available: 1593MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:30] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4772 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:31] [W] [TRT] Tactic Device request: 4772MB Available: 1591MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:31] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4772 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:36] [W] [TRT] Tactic Device request: 4774MB Available: 1593MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:37] [W] [TRT] Tactic Device request: 4774MB Available: 1592MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:37] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:38] [W] [TRT] Tactic Device request: 4774MB Available: 1593MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:38] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:43] [W] [TRT] Tactic Device request: 4771MB Available: 1592MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:44] [W] [TRT] Tactic Device request: 4771MB Available: 1592MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:48] [W] [TRT] Tactic Device request: 1637MB Available: 1594MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:49] [W] [TRT] Tactic Device request: 1637MB Available: 1594MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:49] [W] [TRT] Tactic Device request: 1637MB Available: 1594MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:49] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:50] [W] [TRT] Tactic Device request: 1636MB Available: 1592MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:50] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1636 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:25:50] [W] [TRT] Tactic Device request: 1636MB Available: 1592MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:25:50] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1636 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:26:03] [W] [TRT] Tactic Device request: 4774MB Available: 1593MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:26:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:26:04] [W] [TRT] Tactic Device request: 4774MB Available: 1591MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:26:04] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:26:05] [W] [TRT] Tactic Device request: 4774MB Available: 1589MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:26:05] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:26:10] [W] [TRT] Tactic Device request: 4771MB Available: 1591MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:26:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:26:11] [W] [TRT] Tactic Device request: 4771MB Available: 1588MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:26:11] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:30] [W] [TRT] Tactic Device request: 1638MB Available: 1396MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:30] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1638 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:30] [W] [TRT] Tactic Device request: 1638MB Available: 1396MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:30] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1638 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:31] [W] [TRT] Tactic Device request: 1637MB Available: 1395MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:31] [W] [TRT] Tactic Device request: 1637MB Available: 1396MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:31] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:33] [W] [TRT] Tactic Device request: 2454MB Available: 1396MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:33] [W] [TRT] Tactic Device request: 2454MB Available: 1396MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:33] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2454 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:33] [W] [TRT] Tactic Device request: 2454MB Available: 1397MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:33] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:34] [W] [TRT] Tactic Device request: 2453MB Available: 1397MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2453 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:34] [W] [TRT] Tactic Device request: 2453MB Available: 1397MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:34] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2453 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:37] [W] [TRT] Tactic Device request: 2463MB Available: 1427MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:38] [W] [TRT] Tactic Device request: 2463MB Available: 1390MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:38] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:39] [W] [TRT] Tactic Device request: 2463MB Available: 1388MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:39] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:43] [W] [TRT] Tactic Device request: 2462MB Available: 1596MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:44] [W] [TRT] Tactic Device request: 2462MB Available: 1379MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:49] [W] [TRT] Tactic Device request: 2463MB Available: 1378MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:49] [W] [TRT] Tactic Device request: 2463MB Available: 1376MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:49] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:50] [W] [TRT] Tactic Device request: 2463MB Available: 1376MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:50] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:54] [W] [TRT] Tactic Device request: 2462MB Available: 1375MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:36:55] [W] [TRT] Tactic Device request: 2462MB Available: 1375MB. Device memory is insufficient to use tactic.
-[12/28/2023-10:36:55] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-10:38:08] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-10:38:08] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-10:38:08] [W] * GPU compute time is unstable, with coefficient of variance = 7.66665%.
-[12/28/2023-10:38:08] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_m_fp16.onnx.best.engine.log

@@ -1,312 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.best.engine
-[12/28/2023-08:45:20] [I] === Model Options ===
-[12/28/2023-08:45:20] [I] Format: ONNX
-[12/28/2023-08:45:20] [I] Model: yolo_nas_pose_m_fp16.onnx
-[12/28/2023-08:45:20] [I] Output:
-[12/28/2023-08:45:20] [I] === Build Options ===
-[12/28/2023-08:45:20] [I] Max batch: explicit batch
-[12/28/2023-08:45:20] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-08:45:20] [I] minTiming: 1
-[12/28/2023-08:45:20] [I] avgTiming: 8
-[12/28/2023-08:45:20] [I] Precision: FP32+FP16+INT8
-[12/28/2023-08:45:20] [I] LayerPrecisions: 
-[12/28/2023-08:45:20] [I] Calibration: Dynamic
-[12/28/2023-08:45:20] [I] Refit: Disabled
-[12/28/2023-08:45:20] [I] Sparsity: Disabled
-[12/28/2023-08:45:20] [I] Safe mode: Disabled
-[12/28/2023-08:45:20] [I] DirectIO mode: Disabled
-[12/28/2023-08:45:20] [I] Restricted mode: Disabled
-[12/28/2023-08:45:20] [I] Build only: Disabled
-[12/28/2023-08:45:20] [I] Save engine: yolo_nas_pose_m_fp16.onnx.best.engine
-[12/28/2023-08:45:20] [I] Load engine: 
-[12/28/2023-08:45:20] [I] Profiling verbosity: 0
-[12/28/2023-08:45:20] [I] Tactic sources: Using default tactic sources
-[12/28/2023-08:45:20] [I] timingCacheMode: local
-[12/28/2023-08:45:20] [I] timingCacheFile: 
-[12/28/2023-08:45:20] [I] Heuristic: Disabled
-[12/28/2023-08:45:20] [I] Preview Features: Use default preview flags.
-[12/28/2023-08:45:20] [I] Input(s)s format: fp32:CHW
-[12/28/2023-08:45:20] [I] Output(s)s format: fp32:CHW
-[12/28/2023-08:45:20] [I] Input build shapes: model
-[12/28/2023-08:45:20] [I] Input calibration shapes: model
-[12/28/2023-08:45:20] [I] === System Options ===
-[12/28/2023-08:45:20] [I] Device: 0
-[12/28/2023-08:45:20] [I] DLACore: 
-[12/28/2023-08:45:20] [I] Plugins:
-[12/28/2023-08:45:20] [I] === Inference Options ===
-[12/28/2023-08:45:20] [I] Batch: Explicit
-[12/28/2023-08:45:20] [I] Input inference shapes: model
-[12/28/2023-08:45:20] [I] Iterations: 10
-[12/28/2023-08:45:20] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-08:45:20] [I] Sleep time: 0ms
-[12/28/2023-08:45:20] [I] Idle time: 0ms
-[12/28/2023-08:45:20] [I] Streams: 1
-[12/28/2023-08:45:20] [I] ExposeDMA: Disabled
-[12/28/2023-08:45:20] [I] Data transfers: Enabled
-[12/28/2023-08:45:20] [I] Spin-wait: Disabled
-[12/28/2023-08:45:20] [I] Multithreading: Disabled
-[12/28/2023-08:45:20] [I] CUDA Graph: Disabled
-[12/28/2023-08:45:20] [I] Separate profiling: Disabled
-[12/28/2023-08:45:20] [I] Time Deserialize: Disabled
-[12/28/2023-08:45:20] [I] Time Refit: Disabled
-[12/28/2023-08:45:20] [I] NVTX verbosity: 0
-[12/28/2023-08:45:20] [I] Persistent Cache Ratio: 0
-[12/28/2023-08:45:20] [I] Inputs:
-[12/28/2023-08:45:20] [I] === Reporting Options ===
-[12/28/2023-08:45:20] [I] Verbose: Disabled
-[12/28/2023-08:45:20] [I] Averages: 100 inferences
-[12/28/2023-08:45:20] [I] Percentiles: 90,95,99
-[12/28/2023-08:45:20] [I] Dump refittable layers:Disabled
-[12/28/2023-08:45:20] [I] Dump output: Disabled
-[12/28/2023-08:45:20] [I] Profile: Disabled
-[12/28/2023-08:45:20] [I] Export timing to JSON file: 
-[12/28/2023-08:45:20] [I] Export output to JSON file: 
-[12/28/2023-08:45:20] [I] Export profile to JSON file: 
-[12/28/2023-08:45:20] [I] 
-[12/28/2023-08:45:20] [I] === Device Information ===
-[12/28/2023-08:45:20] [I] Selected Device: Orin
-[12/28/2023-08:45:20] [I] Compute Capability: 8.7
-[12/28/2023-08:45:20] [I] SMs: 8
-[12/28/2023-08:45:20] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-08:45:20] [I] Device Global Memory: 7471 MiB
-[12/28/2023-08:45:20] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-08:45:20] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-08:45:20] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-08:45:20] [I] 
-[12/28/2023-08:45:20] [I] TensorRT version: 8.5.2
-[12/28/2023-08:45:24] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2980 (MiB)
-[12/28/2023-08:45:29] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +284, now: CPU 574, GPU 3286 (MiB)
-[12/28/2023-08:45:29] [I] Start parsing network model
-[12/28/2023-08:45:30] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-08:45:30] [I] [TRT] Input filename:   yolo_nas_pose_m_fp16.onnx
-[12/28/2023-08:45:30] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-08:45:30] [I] [TRT] Opset version:    17
-[12/28/2023-08:45:30] [I] [TRT] Producer name:    pytorch
-[12/28/2023-08:45:30] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-08:45:30] [I] [TRT] Domain:           
-[12/28/2023-08:45:30] [I] [TRT] Model version:    0
-[12/28/2023-08:45:30] [I] [TRT] Doc string:       
-[12/28/2023-08:45:30] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-08:45:30] [I] Finish parsing network model
-[12/28/2023-08:45:31] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-08:45:31] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 410) [Constant]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 411) [Constant]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 412) [Constant]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 200) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 208) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 247) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 270) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 301) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 324) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 332) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1...cast_boxes_to_fp32]}
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 414) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-08:45:31] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-08:45:44] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +400, now: CPU 1196, GPU 3820 (MiB)
-[12/28/2023-08:45:46] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +82, GPU +70, now: CPU 1278, GPU 3890 (MiB)
-[12/28/2023-08:45:46] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-10:37:30] [I] [TRT] Total Activation Memory: 7941309952
-[12/28/2023-10:37:30] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-10:37:43] [I] [TRT] Total Host Persistent Memory: 294816
-[12/28/2023-10:37:43] [I] [TRT] Total Device Persistent Memory: 38912
-[12/28/2023-10:37:43] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-10:37:43] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 54 MiB, GPU 2398 MiB
-[12/28/2023-10:37:43] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 157 steps to complete.
-[12/28/2023-10:37:43] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 76.003ms to assign 14 blocks to 157 nodes requiring 144914944 bytes.
-[12/28/2023-10:37:43] [I] [TRT] Total Activation Memory: 144914944
-[12/28/2023-10:37:50] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -1, now: CPU 1667, GPU 5526 (MiB)
-[12/28/2023-10:37:50] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +38, GPU +64, now: CPU 38, GPU 64 (MiB)
-[12/28/2023-10:37:51] [I] Engine built in 6750.81 sec.
-[12/28/2023-10:37:52] [I] [TRT] Loaded engine size: 39 MiB
-[12/28/2023-10:37:52] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1284, GPU 5348 (MiB)
-[12/28/2023-10:37:52] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +37, now: CPU 0, GPU 37 (MiB)
-[12/28/2023-10:37:52] [I] Engine deserialized in 0.265686 sec.
-[12/28/2023-10:37:52] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1284, GPU 5348 (MiB)
-[12/28/2023-10:37:52] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +138, now: CPU 0, GPU 175 (MiB)
-[12/28/2023-10:37:52] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-10:37:52] [I] Using random values for input onnx::Cast_0
-[12/28/2023-10:37:52] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-10:37:52] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-10:37:52] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-10:37:52] [I] Starting inference
-[12/28/2023-10:38:08] [I] Warmup completed 2 queries over 200 ms
-[12/28/2023-10:38:08] [I] Timing trace has 875 queries over 15.0204 s
-[12/28/2023-10:38:08] [I] 
-[12/28/2023-10:38:08] [I] === Trace details ===
-[12/28/2023-10:38:08] [I] Trace averages of 100 runs:
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 17.3015 ms - Host latency: 17.42 ms (enqueue 17.373 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 16.7848 ms - Host latency: 16.8974 ms (enqueue 16.8579 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 16.7202 ms - Host latency: 16.8311 ms (enqueue 16.7917 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 16.7189 ms - Host latency: 16.8301 ms (enqueue 16.7925 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 16.8722 ms - Host latency: 16.9814 ms (enqueue 16.939 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 17.0499 ms - Host latency: 17.165 ms (enqueue 17.1147 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 17.4353 ms - Host latency: 17.5548 ms (enqueue 17.5031 ms)
-[12/28/2023-10:38:08] [I] Average on 100 runs - GPU latency: 17.2635 ms - Host latency: 17.3821 ms (enqueue 17.328 ms)
-[12/28/2023-10:38:08] [I] 
-[12/28/2023-10:38:08] [I] === Performance summary ===
-[12/28/2023-10:38:08] [I] Throughput: 58.254 qps
-[12/28/2023-10:38:08] [I] Latency: min = 15.8867 ms, max = 26.5801 ms, mean = 17.1335 ms, median = 16.9814 ms, percentile(90%) = 17.8691 ms, percentile(95%) = 18.4963 ms, percentile(99%) = 24.3384 ms
-[12/28/2023-10:38:08] [I] Enqueue Time: min = 15.8533 ms, max = 26.5361 ms, mean = 17.0885 ms, median = 16.9271 ms, percentile(90%) = 17.8125 ms, percentile(95%) = 18.4688 ms, percentile(99%) = 23.7695 ms
-[12/28/2023-10:38:08] [I] H2D Latency: min = 0.0800781 ms, max = 0.148483 ms, mean = 0.0972059 ms, median = 0.0976562 ms, percentile(90%) = 0.100464 ms, percentile(95%) = 0.100586 ms, percentile(99%) = 0.110596 ms
-[12/28/2023-10:38:08] [I] GPU Compute Time: min = 15.7729 ms, max = 26.4624 ms, mean = 17.019 ms, median = 16.8655 ms, percentile(90%) = 17.7568 ms, percentile(95%) = 18.3837 ms, percentile(99%) = 24.2227 ms
-[12/28/2023-10:38:08] [I] D2H Latency: min = 0.00292969 ms, max = 0.0673828 ms, mean = 0.0172236 ms, median = 0.0146484 ms, percentile(90%) = 0.0263672 ms, percentile(95%) = 0.0283203 ms, percentile(99%) = 0.0407715 ms
-[12/28/2023-10:38:08] [I] Total Host Walltime: 15.0204 s
-[12/28/2023-10:38:08] [I] Total GPU Compute Time: 14.8917 s
-[12/28/2023-10:38:08] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-10:38:08] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.best.engine

yolo_nas_pose_m_fp16.onnx.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-07:47:56] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-07:47:56] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-07:47:57] [E] Error[4]: [network.cpp::validate::2925] Error Code 4: Internal Error (fp16 precision has been set for a layer or layer output, but fp16 is not configured in the builder)
-[12/28/2023-07:47:57] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-07:47:57] [E] Engine could not be created from network
-[12/28/2023-07:47:57] [E] Building engine failed
-[12/28/2023-07:47:57] [E] Failed to create engine from model or file.
-[12/28/2023-07:47:57] [E] Engine set up failed

yolo_nas_pose_m_fp16.onnx.engine.log

@@ -1,91 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.engine
-[12/28/2023-07:47:46] [I] === Model Options ===
-[12/28/2023-07:47:46] [I] Format: ONNX
-[12/28/2023-07:47:46] [I] Model: yolo_nas_pose_m_fp16.onnx
-[12/28/2023-07:47:46] [I] Output:
-[12/28/2023-07:47:46] [I] === Build Options ===
-[12/28/2023-07:47:46] [I] Max batch: explicit batch
-[12/28/2023-07:47:46] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-07:47:46] [I] minTiming: 1
-[12/28/2023-07:47:46] [I] avgTiming: 8
-[12/28/2023-07:47:46] [I] Precision: FP32
-[12/28/2023-07:47:46] [I] LayerPrecisions: 
-[12/28/2023-07:47:46] [I] Calibration: 
-[12/28/2023-07:47:46] [I] Refit: Disabled
-[12/28/2023-07:47:46] [I] Sparsity: Disabled
-[12/28/2023-07:47:46] [I] Safe mode: Disabled
-[12/28/2023-07:47:46] [I] DirectIO mode: Disabled
-[12/28/2023-07:47:46] [I] Restricted mode: Disabled
-[12/28/2023-07:47:46] [I] Build only: Disabled
-[12/28/2023-07:47:46] [I] Save engine: yolo_nas_pose_m_fp16.onnx.engine
-[12/28/2023-07:47:46] [I] Load engine: 
-[12/28/2023-07:47:46] [I] Profiling verbosity: 0
-[12/28/2023-07:47:46] [I] Tactic sources: Using default tactic sources
-[12/28/2023-07:47:46] [I] timingCacheMode: local
-[12/28/2023-07:47:46] [I] timingCacheFile: 
-[12/28/2023-07:47:46] [I] Heuristic: Disabled
-[12/28/2023-07:47:46] [I] Preview Features: Use default preview flags.
-[12/28/2023-07:47:46] [I] Input(s)s format: fp32:CHW
-[12/28/2023-07:47:46] [I] Output(s)s format: fp32:CHW
-[12/28/2023-07:47:46] [I] Input build shapes: model
-[12/28/2023-07:47:46] [I] Input calibration shapes: model
-[12/28/2023-07:47:46] [I] === System Options ===
-[12/28/2023-07:47:46] [I] Device: 0
-[12/28/2023-07:47:46] [I] DLACore: 
-[12/28/2023-07:47:46] [I] Plugins:
-[12/28/2023-07:47:46] [I] === Inference Options ===
-[12/28/2023-07:47:46] [I] Batch: Explicit
-[12/28/2023-07:47:46] [I] Input inference shapes: model
-[12/28/2023-07:47:46] [I] Iterations: 10
-[12/28/2023-07:47:46] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-07:47:46] [I] Sleep time: 0ms
-[12/28/2023-07:47:46] [I] Idle time: 0ms
-[12/28/2023-07:47:46] [I] Streams: 1
-[12/28/2023-07:47:46] [I] ExposeDMA: Disabled
-[12/28/2023-07:47:46] [I] Data transfers: Enabled
-[12/28/2023-07:47:46] [I] Spin-wait: Disabled
-[12/28/2023-07:47:46] [I] Multithreading: Disabled
-[12/28/2023-07:47:46] [I] CUDA Graph: Disabled
-[12/28/2023-07:47:46] [I] Separate profiling: Disabled
-[12/28/2023-07:47:46] [I] Time Deserialize: Disabled
-[12/28/2023-07:47:46] [I] Time Refit: Disabled
-[12/28/2023-07:47:46] [I] NVTX verbosity: 0
-[12/28/2023-07:47:46] [I] Persistent Cache Ratio: 0
-[12/28/2023-07:47:46] [I] Inputs:
-[12/28/2023-07:47:46] [I] === Reporting Options ===
-[12/28/2023-07:47:46] [I] Verbose: Disabled
-[12/28/2023-07:47:46] [I] Averages: 100 inferences
-[12/28/2023-07:47:46] [I] Percentiles: 90,95,99
-[12/28/2023-07:47:46] [I] Dump refittable layers:Disabled
-[12/28/2023-07:47:46] [I] Dump output: Disabled
-[12/28/2023-07:47:46] [I] Profile: Disabled
-[12/28/2023-07:47:46] [I] Export timing to JSON file: 
-[12/28/2023-07:47:46] [I] Export output to JSON file: 
-[12/28/2023-07:47:46] [I] Export profile to JSON file: 
-[12/28/2023-07:47:46] [I] 
-[12/28/2023-07:47:46] [I] === Device Information ===
-[12/28/2023-07:47:46] [I] Selected Device: Orin
-[12/28/2023-07:47:46] [I] Compute Capability: 8.7
-[12/28/2023-07:47:46] [I] SMs: 8
-[12/28/2023-07:47:46] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-07:47:46] [I] Device Global Memory: 7471 MiB
-[12/28/2023-07:47:46] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-07:47:46] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-07:47:46] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-07:47:46] [I] 
-[12/28/2023-07:47:46] [I] TensorRT version: 8.5.2
-[12/28/2023-07:47:51] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3024 (MiB)
-[12/28/2023-07:47:55] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +284, now: CPU 574, GPU 3327 (MiB)
-[12/28/2023-07:47:55] [I] Start parsing network model
-[12/28/2023-07:47:56] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-07:47:56] [I] [TRT] Input filename:   yolo_nas_pose_m_fp16.onnx
-[12/28/2023-07:47:56] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-07:47:56] [I] [TRT] Opset version:    17
-[12/28/2023-07:47:56] [I] [TRT] Producer name:    pytorch
-[12/28/2023-07:47:56] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-07:47:56] [I] [TRT] Domain:           
-[12/28/2023-07:47:56] [I] [TRT] Model version:    0
-[12/28/2023-07:47:56] [I] [TRT] Doc string:       
-[12/28/2023-07:47:56] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-07:47:57] [I] Finish parsing network model
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.engine

yolo_nas_pose_m_fp16.onnx.fp16.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:88b66cc2f44220a42e474a86ccc143cd0982f5549e47a979486545e1657fbbc8
-size 79706512

yolo_nas_pose_m_fp16.onnx.fp16.engine.err

@@ -1,348 +0,0 @@
-[12/28/2023-07:48:01] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-07:48:01] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-07:52:40] [W] [TRT] Tactic Device request: 6262MB Available: 3207MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:52:40] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:52:40] [W] [TRT] Tactic Device request: 6262MB Available: 3207MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:52:40] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6262 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:52:40] [W] [TRT] Tactic Device request: 6262MB Available: 3207MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:52:40] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:52:42] [W] [TRT] Tactic Device request: 6251MB Available: 3210MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:52:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6251 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:52:42] [W] [TRT] Tactic Device request: 6251MB Available: 3210MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:52:43] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6251 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:57:47] [W] [TRT] Tactic Device request: 4711MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:57:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:57:47] [W] [TRT] Tactic Device request: 4711MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:57:47] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:57:47] [W] [TRT] Tactic Device request: 4711MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:57:47] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:57:49] [W] [TRT] Tactic Device request: 4701MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:57:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:57:49] [W] [TRT] Tactic Device request: 4701MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:57:49] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:58:04] [W] [TRT] Tactic Device request: 6275MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:58:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:58:05] [W] [TRT] Tactic Device request: 6275MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:58:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:58:05] [W] [TRT] Tactic Device request: 6275MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:58:05] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:58:06] [W] [TRT] Tactic Device request: 6270MB Available: 2425MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:58:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-07:58:06] [W] [TRT] Tactic Device request: 6270MB Available: 2426MB. Device memory is insufficient to use tactic.
-[12/28/2023-07:58:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:38] [W] [TRT] Tactic Device request: 7056MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:38] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:38] [W] [TRT] Tactic Device request: 7056MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:38] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:38] [W] [TRT] Tactic Device request: 7056MB Available: 2302MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:38] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:40] [W] [TRT] Tactic Device request: 7050MB Available: 2302MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:40] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:40] [W] [TRT] Tactic Device request: 7050MB Available: 2302MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:40] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:56] [W] [TRT] Tactic Device request: 6354MB Available: 2299MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:56] [W] [TRT] Tactic Device request: 6354MB Available: 2299MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:57] [W] [TRT] Tactic Device request: 6354MB Available: 2308MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:57] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:58] [W] [TRT] Tactic Device request: 6351MB Available: 2305MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:04:58] [W] [TRT] Tactic Device request: 6351MB Available: 2306MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:04:58] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:43] [W] [TRT] Tactic Device request: 2394MB Available: 2369MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:43] [W] [TRT] Tactic Device request: 2394MB Available: 2369MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:44] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:44] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:44] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:44] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:45] [W] [TRT] Tactic Device request: 2391MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:45] [W] [TRT] Tactic Device request: 2391MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:45] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:45] [W] [TRT] Tactic Device request: 2390MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:45] [W] [TRT] Tactic Device request: 2390MB Available: 2365MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:45] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:59] [W] [TRT] Tactic Device request: 4906MB Available: 2349MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:13:59] [W] [TRT] Tactic Device request: 4906MB Available: 2348MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:13:59] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:14:00] [W] [TRT] Tactic Device request: 4906MB Available: 2349MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:14:00] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:14:01] [W] [TRT] Tactic Device request: 4905MB Available: 2337MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:14:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:14:01] [W] [TRT] Tactic Device request: 4905MB Available: 2336MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:14:01] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:18:56] [W] [TRT] Tactic Device request: 2457MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:18:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:18:56] [W] [TRT] Tactic Device request: 2457MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:18:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:18:56] [W] [TRT] Tactic Device request: 2457MB Available: 2273MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:18:56] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:18:57] [W] [TRT] Tactic Device request: 2456MB Available: 2272MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:18:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:18:57] [W] [TRT] Tactic Device request: 2456MB Available: 2272MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:18:57] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:19] [W] [TRT] Tactic Device request: 3587MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:19] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:19] [W] [TRT] Tactic Device request: 3587MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:19] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:19] [W] [TRT] Tactic Device request: 3587MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:19] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:20] [W] [TRT] Tactic Device request: 3585MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:20] [W] [TRT] Tactic Device request: 3585MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:20] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:21] [W] [TRT] Tactic Device request: 2385MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:21] [W] [TRT] Tactic Device request: 2385MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:21] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2385 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:21] [W] [TRT] Tactic Device request: 2385MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:21] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:22] [W] [TRT] Tactic Device request: 2384MB Available: 2262MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2384 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:19:22] [W] [TRT] Tactic Device request: 2384MB Available: 2262MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:19:22] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2384 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:24:28] [W] [TRT] Tactic Device request: 3556MB Available: 2243MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:24:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:24:28] [W] [TRT] Tactic Device request: 3556MB Available: 2243MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:24:28] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:24:28] [W] [TRT] Tactic Device request: 3556MB Available: 2243MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:24:28] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:24:29] [W] [TRT] Tactic Device request: 3551MB Available: 2243MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:24:30] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:24:30] [W] [TRT] Tactic Device request: 3551MB Available: 2243MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:24:30] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:02] [W] [TRT] Tactic Device request: 2359MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:02] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:02] [W] [TRT] Tactic Device request: 2359MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:02] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:02] [W] [TRT] Tactic Device request: 2359MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:02] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:03] [W] [TRT] Tactic Device request: 2355MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2355 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:03] [W] [TRT] Tactic Device request: 2355MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:03] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2355 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:07] [W] [TRT] Tactic Device request: 2362MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:08] [W] [TRT] Tactic Device request: 2362MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:08] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2362 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:08] [W] [TRT] Tactic Device request: 2362MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:08] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:10] [W] [TRT] Tactic Device request: 2357MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2357 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:11] [W] [TRT] Tactic Device request: 2357MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:11] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2357 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:12] [W] [TRT] Tactic Device request: 2359MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:13] [W] [TRT] Tactic Device request: 2359MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:13] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:13] [W] [TRT] Tactic Device request: 2359MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:13] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:15] [W] [TRT] Tactic Device request: 2356MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2356 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:31:16] [W] [TRT] Tactic Device request: 2356MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:31:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2356 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:36:53] [W] [TRT] Tactic Device request: 3575MB Available: 2474MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:36:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:36:53] [W] [TRT] Tactic Device request: 3575MB Available: 2475MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:36:53] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3575 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:36:53] [W] [TRT] Tactic Device request: 3575MB Available: 2475MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:36:53] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:36:54] [W] [TRT] Tactic Device request: 3572MB Available: 2475MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:36:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3572 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:36:54] [W] [TRT] Tactic Device request: 3572MB Available: 2475MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:36:54] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3572 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:00] [W] [TRT] Tactic Device request: 2390MB Available: 2347MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:00] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:00] [W] [TRT] Tactic Device request: 2390MB Available: 2269MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:00] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:01] [W] [TRT] Tactic Device request: 2390MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:01] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:04] [W] [TRT] Tactic Device request: 2387MB Available: 2263MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2387 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:04] [W] [TRT] Tactic Device request: 2387MB Available: 2239MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2387 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:06] [W] [TRT] Tactic Device request: 2388MB Available: 2234MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:07] [W] [TRT] Tactic Device request: 2388MB Available: 2205MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:07] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2388 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:07] [W] [TRT] Tactic Device request: 2388MB Available: 2203MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:07] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:10] [W] [TRT] Tactic Device request: 2386MB Available: 2203MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2386 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:10] [W] [TRT] Tactic Device request: 2386MB Available: 2176MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:10] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2386 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:13] [W] [TRT] Tactic Device request: 4775MB Available: 2174MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:13] [W] [TRT] Tactic Device request: 4775MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:13] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4775 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:14] [W] [TRT] Tactic Device request: 4775MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:14] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:19] [W] [TRT] Tactic Device request: 4772MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:19] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4772 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:20] [W] [TRT] Tactic Device request: 4772MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:20] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4772 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:24] [W] [TRT] Tactic Device request: 4774MB Available: 2033MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:24] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:25] [W] [TRT] Tactic Device request: 4774MB Available: 2033MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:25] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:26] [W] [TRT] Tactic Device request: 4774MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:26] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:31] [W] [TRT] Tactic Device request: 4771MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:37:31] [W] [TRT] Tactic Device request: 4771MB Available: 2034MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:37:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:43:58] [W] [TRT] Tactic Device request: 2454MB Available: 1908MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:43:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:43:58] [W] [TRT] Tactic Device request: 2454MB Available: 1908MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:43:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2454 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:43:58] [W] [TRT] Tactic Device request: 2454MB Available: 1907MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:43:58] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:43:59] [W] [TRT] Tactic Device request: 2453MB Available: 1907MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:43:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2453 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:43:59] [W] [TRT] Tactic Device request: 2453MB Available: 1906MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:43:59] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2453 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:01] [W] [TRT] Tactic Device request: 2463MB Available: 1901MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:02] [W] [TRT] Tactic Device request: 2463MB Available: 1909MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:02] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:03] [W] [TRT] Tactic Device request: 2463MB Available: 1910MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:03] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:07] [W] [TRT] Tactic Device request: 2462MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:07] [W] [TRT] Tactic Device request: 2462MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:10] [W] [TRT] Tactic Device request: 2463MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:11] [W] [TRT] Tactic Device request: 2463MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:11] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:12] [W] [TRT] Tactic Device request: 2463MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:12] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:16] [W] [TRT] Tactic Device request: 2462MB Available: 1899MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:44:17] [W] [TRT] Tactic Device request: 2462MB Available: 1898MB. Device memory is insufficient to use tactic.
-[12/28/2023-08:44:17] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-08:45:16] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-08:45:16] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-08:45:16] [W] * GPU compute time is unstable, with coefficient of variance = 2.78032%.
-[12/28/2023-08:45:16] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_m_fp16.onnx.fp16.engine.log

@@ -1,309 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.fp16.engine
-[12/28/2023-07:47:57] [I] === Model Options ===
-[12/28/2023-07:47:57] [I] Format: ONNX
-[12/28/2023-07:47:57] [I] Model: yolo_nas_pose_m_fp16.onnx
-[12/28/2023-07:47:57] [I] Output:
-[12/28/2023-07:47:57] [I] === Build Options ===
-[12/28/2023-07:47:57] [I] Max batch: explicit batch
-[12/28/2023-07:47:57] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-07:47:57] [I] minTiming: 1
-[12/28/2023-07:47:57] [I] avgTiming: 8
-[12/28/2023-07:47:57] [I] Precision: FP32+FP16
-[12/28/2023-07:47:57] [I] LayerPrecisions: 
-[12/28/2023-07:47:57] [I] Calibration: 
-[12/28/2023-07:47:57] [I] Refit: Disabled
-[12/28/2023-07:47:57] [I] Sparsity: Disabled
-[12/28/2023-07:47:57] [I] Safe mode: Disabled
-[12/28/2023-07:47:57] [I] DirectIO mode: Disabled
-[12/28/2023-07:47:57] [I] Restricted mode: Disabled
-[12/28/2023-07:47:57] [I] Build only: Disabled
-[12/28/2023-07:47:57] [I] Save engine: yolo_nas_pose_m_fp16.onnx.fp16.engine
-[12/28/2023-07:47:57] [I] Load engine: 
-[12/28/2023-07:47:57] [I] Profiling verbosity: 0
-[12/28/2023-07:47:57] [I] Tactic sources: Using default tactic sources
-[12/28/2023-07:47:57] [I] timingCacheMode: local
-[12/28/2023-07:47:57] [I] timingCacheFile: 
-[12/28/2023-07:47:57] [I] Heuristic: Disabled
-[12/28/2023-07:47:57] [I] Preview Features: Use default preview flags.
-[12/28/2023-07:47:57] [I] Input(s)s format: fp32:CHW
-[12/28/2023-07:47:57] [I] Output(s)s format: fp32:CHW
-[12/28/2023-07:47:57] [I] Input build shapes: model
-[12/28/2023-07:47:57] [I] Input calibration shapes: model
-[12/28/2023-07:47:57] [I] === System Options ===
-[12/28/2023-07:47:57] [I] Device: 0
-[12/28/2023-07:47:57] [I] DLACore: 
-[12/28/2023-07:47:57] [I] Plugins:
-[12/28/2023-07:47:57] [I] === Inference Options ===
-[12/28/2023-07:47:57] [I] Batch: Explicit
-[12/28/2023-07:47:57] [I] Input inference shapes: model
-[12/28/2023-07:47:57] [I] Iterations: 10
-[12/28/2023-07:47:57] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-07:47:57] [I] Sleep time: 0ms
-[12/28/2023-07:47:57] [I] Idle time: 0ms
-[12/28/2023-07:47:57] [I] Streams: 1
-[12/28/2023-07:47:57] [I] ExposeDMA: Disabled
-[12/28/2023-07:47:57] [I] Data transfers: Enabled
-[12/28/2023-07:47:57] [I] Spin-wait: Disabled
-[12/28/2023-07:47:57] [I] Multithreading: Disabled
-[12/28/2023-07:47:57] [I] CUDA Graph: Disabled
-[12/28/2023-07:47:57] [I] Separate profiling: Disabled
-[12/28/2023-07:47:57] [I] Time Deserialize: Disabled
-[12/28/2023-07:47:57] [I] Time Refit: Disabled
-[12/28/2023-07:47:57] [I] NVTX verbosity: 0
-[12/28/2023-07:47:57] [I] Persistent Cache Ratio: 0
-[12/28/2023-07:47:57] [I] Inputs:
-[12/28/2023-07:47:57] [I] === Reporting Options ===
-[12/28/2023-07:47:57] [I] Verbose: Disabled
-[12/28/2023-07:47:57] [I] Averages: 100 inferences
-[12/28/2023-07:47:57] [I] Percentiles: 90,95,99
-[12/28/2023-07:47:57] [I] Dump refittable layers:Disabled
-[12/28/2023-07:47:57] [I] Dump output: Disabled
-[12/28/2023-07:47:57] [I] Profile: Disabled
-[12/28/2023-07:47:57] [I] Export timing to JSON file: 
-[12/28/2023-07:47:57] [I] Export output to JSON file: 
-[12/28/2023-07:47:57] [I] Export profile to JSON file: 
-[12/28/2023-07:47:57] [I] 
-[12/28/2023-07:47:57] [I] === Device Information ===
-[12/28/2023-07:47:57] [I] Selected Device: Orin
-[12/28/2023-07:47:57] [I] Compute Capability: 8.7
-[12/28/2023-07:47:57] [I] SMs: 8
-[12/28/2023-07:47:57] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-07:47:57] [I] Device Global Memory: 7471 MiB
-[12/28/2023-07:47:57] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-07:47:57] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-07:47:57] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-07:47:57] [I] 
-[12/28/2023-07:47:57] [I] TensorRT version: 8.5.2
-[12/28/2023-07:47:58] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3022 (MiB)
-[12/28/2023-07:48:00] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +284, now: CPU 574, GPU 3325 (MiB)
-[12/28/2023-07:48:00] [I] Start parsing network model
-[12/28/2023-07:48:01] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-07:48:01] [I] [TRT] Input filename:   yolo_nas_pose_m_fp16.onnx
-[12/28/2023-07:48:01] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-07:48:01] [I] [TRT] Opset version:    17
-[12/28/2023-07:48:01] [I] [TRT] Producer name:    pytorch
-[12/28/2023-07:48:01] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-07:48:01] [I] [TRT] Domain:           
-[12/28/2023-07:48:01] [I] [TRT] Model version:    0
-[12/28/2023-07:48:01] [I] [TRT] Doc string:       
-[12/28/2023-07:48:01] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-07:48:01] [I] Finish parsing network model
-[12/28/2023-07:48:01] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-07:48:01] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 410) [Constant]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 411) [Constant]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 412) [Constant]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 200) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 208) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 247) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 270) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 301) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 324) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 332) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1...cast_boxes_to_fp32]}
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 414) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-07:48:01] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-07:48:12] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +430, now: CPU 1195, GPU 3835 (MiB)
-[12/28/2023-07:48:14] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +64, now: CPU 1278, GPU 3899 (MiB)
-[12/28/2023-07:48:14] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-08:44:43] [I] [TRT] Total Activation Memory: 8017417728
-[12/28/2023-08:44:44] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-08:44:54] [I] [TRT] Total Host Persistent Memory: 330944
-[12/28/2023-08:44:54] [I] [TRT] Total Device Persistent Memory: 115712
-[12/28/2023-08:44:54] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-08:44:54] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 40 MiB, GPU 2398 MiB
-[12/28/2023-08:44:54] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 181 steps to complete.
-[12/28/2023-08:44:54] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 85.1996ms to assign 14 blocks to 181 nodes requiring 155574784 bytes.
-[12/28/2023-08:44:54] [I] [TRT] Total Activation Memory: 155574784
-[12/28/2023-08:44:59] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1625, GPU 5501 (MiB)
-[12/28/2023-08:44:59] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +10, GPU +128, now: CPU 10, GPU 128 (MiB)
-[12/28/2023-08:45:00] [I] Engine built in 3422.28 sec.
-[12/28/2023-08:45:00] [I] [TRT] Loaded engine size: 76 MiB
-[12/28/2023-08:45:00] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1317, GPU 5134 (MiB)
-[12/28/2023-08:45:00] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +74, now: CPU 0, GPU 74 (MiB)
-[12/28/2023-08:45:00] [I] Engine deserialized in 0.264761 sec.
-[12/28/2023-08:45:00] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1317, GPU 5134 (MiB)
-[12/28/2023-08:45:01] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +148, now: CPU 0, GPU 222 (MiB)
-[12/28/2023-08:45:01] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-08:45:01] [I] Using random values for input onnx::Cast_0
-[12/28/2023-08:45:01] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-08:45:01] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-08:45:01] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-08:45:01] [I] Starting inference
-[12/28/2023-08:45:16] [I] Warmup completed 2 queries over 200 ms
-[12/28/2023-08:45:16] [I] Timing trace has 569 queries over 15.0311 s
-[12/28/2023-08:45:16] [I] 
-[12/28/2023-08:45:16] [I] === Trace details ===
-[12/28/2023-08:45:16] [I] Trace averages of 100 runs:
-[12/28/2023-08:45:16] [I] Average on 100 runs - GPU latency: 26.4061 ms - Host latency: 26.5181 ms (enqueue 26.4696 ms)
-[12/28/2023-08:45:16] [I] Average on 100 runs - GPU latency: 26.2062 ms - Host latency: 26.3239 ms (enqueue 26.2673 ms)
-[12/28/2023-08:45:16] [I] Average on 100 runs - GPU latency: 26.2202 ms - Host latency: 26.3345 ms (enqueue 26.2829 ms)
-[12/28/2023-08:45:16] [I] Average on 100 runs - GPU latency: 26.1667 ms - Host latency: 26.2764 ms (enqueue 26.2337 ms)
-[12/28/2023-08:45:16] [I] Average on 100 runs - GPU latency: 26.4629 ms - Host latency: 26.5727 ms (enqueue 26.5274 ms)
-[12/28/2023-08:45:16] [I] 
-[12/28/2023-08:45:16] [I] === Performance summary ===
-[12/28/2023-08:45:16] [I] Throughput: 37.8547 qps
-[12/28/2023-08:45:16] [I] Latency: min = 25.1152 ms, max = 32.1547 ms, mean = 26.393 ms, median = 26.3442 ms, percentile(90%) = 27.0601 ms, percentile(95%) = 27.4189 ms, percentile(99%) = 29.4863 ms
-[12/28/2023-08:45:16] [I] Enqueue Time: min = 25.0762 ms, max = 32.1133 ms, mean = 26.3436 ms, median = 26.2896 ms, percentile(90%) = 26.9199 ms, percentile(95%) = 27.0813 ms, percentile(99%) = 29.4521 ms
-[12/28/2023-08:45:16] [I] H2D Latency: min = 0.0800781 ms, max = 0.117188 ms, mean = 0.0960489 ms, median = 0.097168 ms, percentile(90%) = 0.0996094 ms, percentile(95%) = 0.100098 ms, percentile(99%) = 0.101318 ms
-[12/28/2023-08:45:16] [I] GPU Compute Time: min = 25.0037 ms, max = 32.0377 ms, mean = 26.281 ms, median = 26.2241 ms, percentile(90%) = 26.9429 ms, percentile(95%) = 27.3164 ms, percentile(99%) = 29.3721 ms
-[12/28/2023-08:45:16] [I] D2H Latency: min = 0.00292969 ms, max = 0.0490723 ms, mean = 0.0159815 ms, median = 0.0146484 ms, percentile(90%) = 0.0253906 ms, percentile(95%) = 0.0271912 ms, percentile(99%) = 0.0324707 ms
-[12/28/2023-08:45:16] [I] Total Host Walltime: 15.0311 s
-[12/28/2023-08:45:16] [I] Total GPU Compute Time: 14.9539 s
-[12/28/2023-08:45:16] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-08:45:16] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --fp16 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.fp16.engine

yolo_nas_pose_m_fp16.onnx.int8.engine.err

@@ -1,8 +0,0 @@
-[12/28/2023-10:38:24] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-10:38:24] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-10:38:24] [E] Error[4]: [network.cpp::validate::2925] Error Code 4: Internal Error (fp16 precision has been set for a layer or layer output, but fp16 is not configured in the builder)
-[12/28/2023-10:38:24] [E] Error[2]: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
-[12/28/2023-10:38:24] [E] Engine could not be created from network
-[12/28/2023-10:38:24] [E] Building engine failed
-[12/28/2023-10:38:24] [E] Failed to create engine from model or file.
-[12/28/2023-10:38:24] [E] Engine set up failed

yolo_nas_pose_m_fp16.onnx.int8.engine.log

@@ -1,92 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.int8.engine
-[12/28/2023-10:38:12] [I] === Model Options ===
-[12/28/2023-10:38:12] [I] Format: ONNX
-[12/28/2023-10:38:12] [I] Model: yolo_nas_pose_m_fp16.onnx
-[12/28/2023-10:38:12] [I] Output:
-[12/28/2023-10:38:12] [I] === Build Options ===
-[12/28/2023-10:38:12] [I] Max batch: explicit batch
-[12/28/2023-10:38:12] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-10:38:12] [I] minTiming: 1
-[12/28/2023-10:38:12] [I] avgTiming: 8
-[12/28/2023-10:38:12] [I] Precision: FP32+INT8
-[12/28/2023-10:38:12] [I] LayerPrecisions: 
-[12/28/2023-10:38:12] [I] Calibration: Dynamic
-[12/28/2023-10:38:12] [I] Refit: Disabled
-[12/28/2023-10:38:12] [I] Sparsity: Disabled
-[12/28/2023-10:38:12] [I] Safe mode: Disabled
-[12/28/2023-10:38:12] [I] DirectIO mode: Disabled
-[12/28/2023-10:38:12] [I] Restricted mode: Disabled
-[12/28/2023-10:38:12] [I] Build only: Disabled
-[12/28/2023-10:38:12] [I] Save engine: yolo_nas_pose_m_fp16.onnx.int8.engine
-[12/28/2023-10:38:12] [I] Load engine: 
-[12/28/2023-10:38:12] [I] Profiling verbosity: 0
-[12/28/2023-10:38:12] [I] Tactic sources: Using default tactic sources
-[12/28/2023-10:38:12] [I] timingCacheMode: local
-[12/28/2023-10:38:12] [I] timingCacheFile: 
-[12/28/2023-10:38:12] [I] Heuristic: Disabled
-[12/28/2023-10:38:12] [I] Preview Features: Use default preview flags.
-[12/28/2023-10:38:12] [I] Input(s)s format: fp32:CHW
-[12/28/2023-10:38:12] [I] Output(s)s format: fp32:CHW
-[12/28/2023-10:38:12] [I] Input build shapes: model
-[12/28/2023-10:38:12] [I] Input calibration shapes: model
-[12/28/2023-10:38:12] [I] === System Options ===
-[12/28/2023-10:38:12] [I] Device: 0
-[12/28/2023-10:38:12] [I] DLACore: 
-[12/28/2023-10:38:12] [I] Plugins:
-[12/28/2023-10:38:12] [I] === Inference Options ===
-[12/28/2023-10:38:12] [I] Batch: Explicit
-[12/28/2023-10:38:12] [I] Input inference shapes: model
-[12/28/2023-10:38:12] [I] Iterations: 10
-[12/28/2023-10:38:12] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-10:38:12] [I] Sleep time: 0ms
-[12/28/2023-10:38:12] [I] Idle time: 0ms
-[12/28/2023-10:38:12] [I] Streams: 1
-[12/28/2023-10:38:12] [I] ExposeDMA: Disabled
-[12/28/2023-10:38:12] [I] Data transfers: Enabled
-[12/28/2023-10:38:12] [I] Spin-wait: Disabled
-[12/28/2023-10:38:12] [I] Multithreading: Disabled
-[12/28/2023-10:38:12] [I] CUDA Graph: Disabled
-[12/28/2023-10:38:12] [I] Separate profiling: Disabled
-[12/28/2023-10:38:12] [I] Time Deserialize: Disabled
-[12/28/2023-10:38:12] [I] Time Refit: Disabled
-[12/28/2023-10:38:12] [I] NVTX verbosity: 0
-[12/28/2023-10:38:12] [I] Persistent Cache Ratio: 0
-[12/28/2023-10:38:12] [I] Inputs:
-[12/28/2023-10:38:12] [I] === Reporting Options ===
-[12/28/2023-10:38:12] [I] Verbose: Disabled
-[12/28/2023-10:38:12] [I] Averages: 100 inferences
-[12/28/2023-10:38:12] [I] Percentiles: 90,95,99
-[12/28/2023-10:38:12] [I] Dump refittable layers:Disabled
-[12/28/2023-10:38:12] [I] Dump output: Disabled
-[12/28/2023-10:38:12] [I] Profile: Disabled
-[12/28/2023-10:38:12] [I] Export timing to JSON file: 
-[12/28/2023-10:38:12] [I] Export output to JSON file: 
-[12/28/2023-10:38:12] [I] Export profile to JSON file: 
-[12/28/2023-10:38:12] [I] 
-[12/28/2023-10:38:12] [I] === Device Information ===
-[12/28/2023-10:38:12] [I] Selected Device: Orin
-[12/28/2023-10:38:12] [I] Compute Capability: 8.7
-[12/28/2023-10:38:12] [I] SMs: 8
-[12/28/2023-10:38:12] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-10:38:12] [I] Device Global Memory: 7471 MiB
-[12/28/2023-10:38:12] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-10:38:12] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-10:38:12] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-10:38:12] [I] 
-[12/28/2023-10:38:12] [I] TensorRT version: 8.5.2
-[12/28/2023-10:38:18] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2980 (MiB)
-[12/28/2023-10:38:23] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +286, now: CPU 574, GPU 3285 (MiB)
-[12/28/2023-10:38:23] [I] Start parsing network model
-[12/28/2023-10:38:24] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-10:38:24] [I] [TRT] Input filename:   yolo_nas_pose_m_fp16.onnx
-[12/28/2023-10:38:24] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-10:38:24] [I] [TRT] Opset version:    17
-[12/28/2023-10:38:24] [I] [TRT] Producer name:    pytorch
-[12/28/2023-10:38:24] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-10:38:24] [I] [TRT] Domain:           
-[12/28/2023-10:38:24] [I] [TRT] Model version:    0
-[12/28/2023-10:38:24] [I] [TRT] Doc string:       
-[12/28/2023-10:38:24] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-10:38:24] [I] Finish parsing network model
-[12/28/2023-10:38:24] [I] FP32 and INT8 precisions have been specified - more performance might be enabled by additionally specifying --fp16 or --best
-&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp16.onnx --int8 --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp16.onnx.int8.engine

yolo_nas_pose_m_fp32.onnx.best.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:2aacf81075603bac1a47cc9877eee270592301a5238478d61a6d8b5f144825ad
-size 41362745

yolo_nas_pose_m_fp32.onnx.best.engine.err

@@ -1,495 +0,0 @@
-[12/28/2023-05:05:18] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-05:05:18] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-05:05:19] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
-[12/28/2023-05:32:46] [W] [TRT] Tactic Device request: 6262MB Available: 3151MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:32:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:32:46] [W] [TRT] Tactic Device request: 6262MB Available: 3152MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:32:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6262 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:32:47] [W] [TRT] Tactic Device request: 6262MB Available: 3152MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:32:47] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:32:49] [W] [TRT] Tactic Device request: 6251MB Available: 3152MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:32:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6251 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:32:49] [W] [TRT] Tactic Device request: 6251MB Available: 3152MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:32:49] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6251 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:04] [W] [TRT] Tactic Device request: 4711MB Available: 2293MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:04] [W] [TRT] Tactic Device request: 4711MB Available: 2293MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:04] [W] [TRT] Tactic Device request: 4711MB Available: 2293MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:04] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:06] [W] [TRT] Tactic Device request: 4701MB Available: 2293MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:06] [W] [TRT] Tactic Device request: 4701MB Available: 2293MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:25] [W] [TRT] Tactic Device request: 6275MB Available: 2292MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:25] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:26] [W] [TRT] Tactic Device request: 6275MB Available: 2292MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:26] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:26] [W] [TRT] Tactic Device request: 6275MB Available: 2292MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:26] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:27] [W] [TRT] Tactic Device request: 6270MB Available: 2292MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:41:27] [W] [TRT] Tactic Device request: 6270MB Available: 2292MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:41:27] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:11] [W] [TRT] Tactic Device request: 7056MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:11] [W] [TRT] Tactic Device request: 7056MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:11] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:12] [W] [TRT] Tactic Device request: 7056MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:12] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:13] [W] [TRT] Tactic Device request: 7050MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:14] [W] [TRT] Tactic Device request: 7050MB Available: 2128MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:14] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:34] [W] [TRT] Tactic Device request: 6354MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:35] [W] [TRT] Tactic Device request: 6354MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:35] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:35] [W] [TRT] Tactic Device request: 6354MB Available: 2127MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:35] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:37] [W] [TRT] Tactic Device request: 6351MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:37] [W] [TRT] Tactic Device request: 6351MB Available: 2129MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:37] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:41] [W] [TRT] Tactic Device request: 2127MB Available: 2101MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:41] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2127 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:42] [W] [TRT] Tactic Device request: 2127MB Available: 2101MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:42] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2127 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:44] [W] [TRT] Tactic Device request: 2124MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:45] [W] [TRT] Tactic Device request: 2124MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:45] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:48] [W] [TRT] Tactic Device request: 2125MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:48] [W] [TRT] Tactic Device request: 2125MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:48] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2125 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:48] [W] [TRT] Tactic Device request: 2125MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:49] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:51] [W] [TRT] Tactic Device request: 2124MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:51] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:51] [W] [TRT] Tactic Device request: 2124MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:51] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:54] [W] [TRT] Tactic Device request: 2125MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:55] [W] [TRT] Tactic Device request: 2125MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:55] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2125 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:55] [W] [TRT] Tactic Device request: 2125MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:55] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2125 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:57] [W] [TRT] Tactic Device request: 2124MB Available: 2099MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2124 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:52:58] [W] [TRT] Tactic Device request: 2124MB Available: 2100MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:52:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2124 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:08] [W] [TRT] Tactic Device request: 2394MB Available: 2002MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:08] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:08] [W] [TRT] Tactic Device request: 2394MB Available: 2001MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:08] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:09] [W] [TRT] Tactic Device request: 2392MB Available: 1999MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:09] [W] [TRT] Tactic Device request: 2392MB Available: 2000MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:09] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:09] [W] [TRT] Tactic Device request: 2392MB Available: 2000MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:09] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:10] [W] [TRT] Tactic Device request: 2391MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:11] [W] [TRT] Tactic Device request: 2391MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:11] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:11] [W] [TRT] Tactic Device request: 2390MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:11] [W] [TRT] Tactic Device request: 2390MB Available: 2018MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:11] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:28] [W] [TRT] Tactic Device request: 4906MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:28] [W] [TRT] Tactic Device request: 4906MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:28] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:28] [W] [TRT] Tactic Device request: 4906MB Available: 2020MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:28] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:30] [W] [TRT] Tactic Device request: 4905MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:30] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:07:30] [W] [TRT] Tactic Device request: 4905MB Available: 2021MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:07:30] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:33] [W] [TRT] Tactic Device request: 4906MB Available: 1883MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:33] [W] [TRT] Tactic Device request: 4906MB Available: 1894MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:33] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:33] [W] [TRT] Tactic Device request: 4906MB Available: 1894MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:33] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:34] [W] [TRT] Tactic Device request: 4905MB Available: 1887MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:34] [W] [TRT] Tactic Device request: 4905MB Available: 1887MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:37] [W] [TRT] Tactic Device request: 2457MB Available: 1889MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:37] [W] [TRT] Tactic Device request: 2457MB Available: 1889MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:37] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:37] [W] [TRT] Tactic Device request: 2457MB Available: 1888MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:37] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:38] [W] [TRT] Tactic Device request: 2456MB Available: 1888MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:38] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:15:38] [W] [TRT] Tactic Device request: 2456MB Available: 1888MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:15:38] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:06] [W] [TRT] Tactic Device request: 3587MB Available: 1811MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:06] [W] [TRT] Tactic Device request: 3587MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:06] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:06] [W] [TRT] Tactic Device request: 3587MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:06] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:08] [W] [TRT] Tactic Device request: 3585MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:08] [W] [TRT] Tactic Device request: 3585MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:08] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:10] [W] [TRT] Tactic Device request: 2385MB Available: 1811MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:10] [W] [TRT] Tactic Device request: 2385MB Available: 1811MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:10] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2385 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:10] [W] [TRT] Tactic Device request: 2385MB Available: 1811MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:10] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:11] [W] [TRT] Tactic Device request: 2384MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2384 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:16:11] [W] [TRT] Tactic Device request: 2384MB Available: 1810MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:16:11] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2384 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:24:26] [W] [TRT] Tactic Device request: 3556MB Available: 1659MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:24:26] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:24:26] [W] [TRT] Tactic Device request: 3556MB Available: 1659MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:24:26] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:24:27] [W] [TRT] Tactic Device request: 3556MB Available: 1659MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:24:27] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:24:28] [W] [TRT] Tactic Device request: 3551MB Available: 1659MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:24:28] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:24:28] [W] [TRT] Tactic Device request: 3551MB Available: 1659MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:24:28] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:52] [W] [TRT] Tactic Device request: 1581MB Available: 1492MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1581 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:52] [W] [TRT] Tactic Device request: 1581MB Available: 1492MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1581 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:53] [W] [TRT] Tactic Device request: 1579MB Available: 1493MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:53] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1579 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:53] [W] [TRT] Tactic Device request: 1579MB Available: 1493MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:53] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1579 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:54] [W] [TRT] Tactic Device request: 2359MB Available: 1494MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:55] [W] [TRT] Tactic Device request: 2359MB Available: 1494MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:55] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:55] [W] [TRT] Tactic Device request: 2359MB Available: 1493MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:55] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:56] [W] [TRT] Tactic Device request: 2355MB Available: 1494MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2355 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:34:56] [W] [TRT] Tactic Device request: 2355MB Available: 1494MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:34:56] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2355 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:03] [W] [TRT] Tactic Device request: 2362MB Available: 1565MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:03] [W] [TRT] Tactic Device request: 2362MB Available: 1564MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:03] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2362 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:03] [W] [TRT] Tactic Device request: 2362MB Available: 1564MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:03] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:06] [W] [TRT] Tactic Device request: 2357MB Available: 1724MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2357 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:06] [W] [TRT] Tactic Device request: 2357MB Available: 1723MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:06] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2357 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:09] [W] [TRT] Tactic Device request: 2359MB Available: 1742MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:09] [W] [TRT] Tactic Device request: 2359MB Available: 1742MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:09] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:10] [W] [TRT] Tactic Device request: 2359MB Available: 1741MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:10] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:12] [W] [TRT] Tactic Device request: 2356MB Available: 1743MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2356 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:35:12] [W] [TRT] Tactic Device request: 2356MB Available: 1743MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:35:13] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2356 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:04] [W] [TRT] Tactic Device request: 3575MB Available: 2161MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:04] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:04] [W] [TRT] Tactic Device request: 3575MB Available: 2161MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3575 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:04] [W] [TRT] Tactic Device request: 3575MB Available: 2162MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:04] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:05] [W] [TRT] Tactic Device request: 3572MB Available: 2160MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3572 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:06] [W] [TRT] Tactic Device request: 3572MB Available: 2160MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3572 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:14] [W] [TRT] Tactic Device request: 2390MB Available: 1984MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:14] [W] [TRT] Tactic Device request: 2390MB Available: 1901MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:14] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:15] [W] [TRT] Tactic Device request: 2390MB Available: 1897MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:15] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:18] [W] [TRT] Tactic Device request: 2387MB Available: 1895MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2387 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:18] [W] [TRT] Tactic Device request: 2387MB Available: 1878MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:18] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2387 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:21] [W] [TRT] Tactic Device request: 2388MB Available: 1869MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:21] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:22] [W] [TRT] Tactic Device request: 2388MB Available: 1826MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:22] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2388 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:22] [W] [TRT] Tactic Device request: 2388MB Available: 1822MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:22] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:25] [W] [TRT] Tactic Device request: 2386MB Available: 1820MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:25] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2386 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:25] [W] [TRT] Tactic Device request: 2386MB Available: 1796MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:25] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2386 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:29] [W] [TRT] Tactic Device request: 4775MB Available: 1792MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:30] [W] [TRT] Tactic Device request: 4775MB Available: 1460MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:30] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4775 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:31] [W] [TRT] Tactic Device request: 4775MB Available: 1452MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:31] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:36] [W] [TRT] Tactic Device request: 4772MB Available: 1450MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4772 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:36] [W] [TRT] Tactic Device request: 4772MB Available: 1402MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:36] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4772 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:42] [W] [TRT] Tactic Device request: 4774MB Available: 1429MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:42] [W] [TRT] Tactic Device request: 4774MB Available: 1387MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:42] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:43] [W] [TRT] Tactic Device request: 4774MB Available: 1382MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:43] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:48] [W] [TRT] Tactic Device request: 4771MB Available: 1378MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:49] [W] [TRT] Tactic Device request: 4771MB Available: 1372MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:54] [W] [TRT] Tactic Device request: 1637MB Available: 1372MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:54] [W] [TRT] Tactic Device request: 1637MB Available: 1372MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:54] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:54] [W] [TRT] Tactic Device request: 1637MB Available: 1372MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:54] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:55] [W] [TRT] Tactic Device request: 1636MB Available: 1372MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:55] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1636 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:44:55] [W] [TRT] Tactic Device request: 1636MB Available: 1371MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:44:55] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1636 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:45:07] [W] [TRT] Tactic Device request: 4774MB Available: 1354MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:45:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:45:08] [W] [TRT] Tactic Device request: 4774MB Available: 1364MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:45:08] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:45:09] [W] [TRT] Tactic Device request: 4774MB Available: 1364MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:45:09] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:45:14] [W] [TRT] Tactic Device request: 4771MB Available: 1366MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:45:14] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:45:15] [W] [TRT] Tactic Device request: 4771MB Available: 1377MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:45:15] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:29] [W] [TRT] Tactic Device request: 1638MB Available: 1160MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 1638 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:29] [W] [TRT] Tactic Device request: 1638MB Available: 1157MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:29] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 1638 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:29] [W] [TRT] Tactic Device request: 1637MB Available: 1155MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 1637 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:29] [W] [TRT] Tactic Device request: 1637MB Available: 1156MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:29] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 1637 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:31] [W] [TRT] Tactic Device request: 2454MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:31] [W] [TRT] Tactic Device request: 2454MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:31] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2454 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:32] [W] [TRT] Tactic Device request: 2454MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:33] [W] [TRT] Tactic Device request: 2453MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:33] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2453 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:33] [W] [TRT] Tactic Device request: 2453MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:33] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2453 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:35] [W] [TRT] Tactic Device request: 2463MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:35] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:35] [W] [TRT] Tactic Device request: 1231MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:35] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 1231 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:35] [W] [TRT] Tactic Device request: 2463MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:35] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:35] [W] [TRT] Tactic Device request: 1231MB Available: 1154MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:35] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 1231 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:36] [W] [TRT] Tactic Device request: 2463MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:36] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:36] [W] [TRT] Tactic Device request: 1231MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:36] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 1231 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:39] [W] [TRT] Tactic Device request: 2462MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:39] [W] [TRT] Tactic Device request: 1229MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:39] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 1229 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:39] [W] [TRT] Tactic Device request: 2462MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:39] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:39] [W] [TRT] Tactic Device request: 1229MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:39] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 1229 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:43] [W] [TRT] Tactic Device request: 2463MB Available: 1153MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:43] [W] [TRT] Tactic Device request: 1230MB Available: 1153MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:43] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 1230 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:43] [W] [TRT] Tactic Device request: 2463MB Available: 1153MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:44] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:44] [W] [TRT] Tactic Device request: 1230MB Available: 1153MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:44] [W] [TRT] Skipping tactic 10 due to insufficient memory on requested size of 1230 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:44] [W] [TRT] Tactic Device request: 2463MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:44] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:44] [W] [TRT] Tactic Device request: 1230MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:44] [W] [TRT] Skipping tactic 16 due to insufficient memory on requested size of 1230 detected for tactic 0x0000000000000075.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:47] [W] [TRT] Tactic Device request: 2462MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:47] [W] [TRT] Tactic Device request: 1229MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:47] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 1229 detected for tactic 0x0000000000000005.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:47] [W] [TRT] Tactic Device request: 2462MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:47] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:55:47] [W] [TRT] Tactic Device request: 1229MB Available: 1152MB. Device memory is insufficient to use tactic.
-[12/28/2023-06:55:47] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 1229 detected for tactic 0x000000000000003d.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-06:56:41] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
-[12/28/2023-06:56:41] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
-[12/28/2023-06:56:41] [W] [TRT] Check verbose logs for the list of affected weights.
-[12/28/2023-06:56:41] [W] [TRT] - 103 weights are affected by this issue: Detected subnormal FP16 values.
-[12/28/2023-06:56:41] [W] [TRT] - 33 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
-[12/28/2023-06:56:58] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-06:56:58] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-06:56:58] [W] * GPU compute time is unstable, with coefficient of variance = 4.26897%.
-[12/28/2023-06:56:58] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_m_fp32.onnx.best.engine.log

@@ -1,312 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp32.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp32.onnx.best.engine
-[12/28/2023-05:05:07] [I] === Model Options ===
-[12/28/2023-05:05:07] [I] Format: ONNX
-[12/28/2023-05:05:07] [I] Model: yolo_nas_pose_m_fp32.onnx
-[12/28/2023-05:05:07] [I] Output:
-[12/28/2023-05:05:07] [I] === Build Options ===
-[12/28/2023-05:05:07] [I] Max batch: explicit batch
-[12/28/2023-05:05:07] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-05:05:07] [I] minTiming: 1
-[12/28/2023-05:05:07] [I] avgTiming: 8
-[12/28/2023-05:05:07] [I] Precision: FP32+FP16+INT8
-[12/28/2023-05:05:07] [I] LayerPrecisions: 
-[12/28/2023-05:05:07] [I] Calibration: Dynamic
-[12/28/2023-05:05:07] [I] Refit: Disabled
-[12/28/2023-05:05:07] [I] Sparsity: Disabled
-[12/28/2023-05:05:07] [I] Safe mode: Disabled
-[12/28/2023-05:05:07] [I] DirectIO mode: Disabled
-[12/28/2023-05:05:07] [I] Restricted mode: Disabled
-[12/28/2023-05:05:07] [I] Build only: Disabled
-[12/28/2023-05:05:07] [I] Save engine: yolo_nas_pose_m_fp32.onnx.best.engine
-[12/28/2023-05:05:07] [I] Load engine: 
-[12/28/2023-05:05:07] [I] Profiling verbosity: 0
-[12/28/2023-05:05:07] [I] Tactic sources: Using default tactic sources
-[12/28/2023-05:05:07] [I] timingCacheMode: local
-[12/28/2023-05:05:07] [I] timingCacheFile: 
-[12/28/2023-05:05:07] [I] Heuristic: Disabled
-[12/28/2023-05:05:07] [I] Preview Features: Use default preview flags.
-[12/28/2023-05:05:07] [I] Input(s)s format: fp32:CHW
-[12/28/2023-05:05:07] [I] Output(s)s format: fp32:CHW
-[12/28/2023-05:05:07] [I] Input build shapes: model
-[12/28/2023-05:05:07] [I] Input calibration shapes: model
-[12/28/2023-05:05:07] [I] === System Options ===
-[12/28/2023-05:05:07] [I] Device: 0
-[12/28/2023-05:05:07] [I] DLACore: 
-[12/28/2023-05:05:07] [I] Plugins:
-[12/28/2023-05:05:07] [I] === Inference Options ===
-[12/28/2023-05:05:07] [I] Batch: Explicit
-[12/28/2023-05:05:07] [I] Input inference shapes: model
-[12/28/2023-05:05:07] [I] Iterations: 10
-[12/28/2023-05:05:07] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-05:05:07] [I] Sleep time: 0ms
-[12/28/2023-05:05:07] [I] Idle time: 0ms
-[12/28/2023-05:05:07] [I] Streams: 1
-[12/28/2023-05:05:07] [I] ExposeDMA: Disabled
-[12/28/2023-05:05:07] [I] Data transfers: Enabled
-[12/28/2023-05:05:07] [I] Spin-wait: Disabled
-[12/28/2023-05:05:07] [I] Multithreading: Disabled
-[12/28/2023-05:05:07] [I] CUDA Graph: Disabled
-[12/28/2023-05:05:07] [I] Separate profiling: Disabled
-[12/28/2023-05:05:07] [I] Time Deserialize: Disabled
-[12/28/2023-05:05:07] [I] Time Refit: Disabled
-[12/28/2023-05:05:07] [I] NVTX verbosity: 0
-[12/28/2023-05:05:07] [I] Persistent Cache Ratio: 0
-[12/28/2023-05:05:07] [I] Inputs:
-[12/28/2023-05:05:07] [I] === Reporting Options ===
-[12/28/2023-05:05:07] [I] Verbose: Disabled
-[12/28/2023-05:05:07] [I] Averages: 100 inferences
-[12/28/2023-05:05:07] [I] Percentiles: 90,95,99
-[12/28/2023-05:05:07] [I] Dump refittable layers:Disabled
-[12/28/2023-05:05:07] [I] Dump output: Disabled
-[12/28/2023-05:05:07] [I] Profile: Disabled
-[12/28/2023-05:05:07] [I] Export timing to JSON file: 
-[12/28/2023-05:05:07] [I] Export output to JSON file: 
-[12/28/2023-05:05:07] [I] Export profile to JSON file: 
-[12/28/2023-05:05:07] [I] 
-[12/28/2023-05:05:07] [I] === Device Information ===
-[12/28/2023-05:05:07] [I] Selected Device: Orin
-[12/28/2023-05:05:07] [I] Compute Capability: 8.7
-[12/28/2023-05:05:07] [I] SMs: 8
-[12/28/2023-05:05:07] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-05:05:07] [I] Device Global Memory: 7471 MiB
-[12/28/2023-05:05:07] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-05:05:07] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-05:05:07] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-05:05:07] [I] 
-[12/28/2023-05:05:07] [I] TensorRT version: 8.5.2
-[12/28/2023-05:05:12] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 2997 (MiB)
-[12/28/2023-05:05:16] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +284, now: CPU 574, GPU 3304 (MiB)
-[12/28/2023-05:05:16] [I] Start parsing network model
-[12/28/2023-05:05:18] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-05:05:18] [I] [TRT] Input filename:   yolo_nas_pose_m_fp32.onnx
-[12/28/2023-05:05:18] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-05:05:18] [I] [TRT] Opset version:    17
-[12/28/2023-05:05:18] [I] [TRT] Producer name:    pytorch
-[12/28/2023-05:05:18] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-05:05:18] [I] [TRT] Domain:           
-[12/28/2023-05:05:18] [I] [TRT] Model version:    0
-[12/28/2023-05:05:18] [I] [TRT] Doc string:       
-[12/28/2023-05:05:18] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-05:05:19] [I] Finish parsing network model
-[12/28/2023-05:05:19] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-05:05:19] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 407) [Constant]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 408) [Constant]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 409) [Constant]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 200) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 208) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 247) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 270) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 301) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 324) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 332) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 411) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-05:05:19] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-05:05:29] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +388, now: CPU 1280, GPU 3896 (MiB)
-[12/28/2023-05:05:30] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +81, now: CPU 1363, GPU 3977 (MiB)
-[12/28/2023-05:05:30] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-06:56:20] [I] [TRT] Total Activation Memory: 7941884416
-[12/28/2023-06:56:20] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-06:56:33] [I] [TRT] Total Host Persistent Memory: 294816
-[12/28/2023-06:56:33] [I] [TRT] Total Device Persistent Memory: 38912
-[12/28/2023-06:56:33] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-06:56:33] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 60 MiB, GPU 2398 MiB
-[12/28/2023-06:56:33] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 158 steps to complete.
-[12/28/2023-06:56:33] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 79.8205ms to assign 13 blocks to 158 nodes requiring 144903168 bytes.
-[12/28/2023-06:56:33] [I] [TRT] Total Activation Memory: 144903168
-[12/28/2023-06:56:41] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU -19, now: CPU 1751, GPU 5827 (MiB)
-[12/28/2023-06:56:41] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +38, GPU +64, now: CPU 38, GPU 64 (MiB)
-[12/28/2023-06:56:41] [I] Engine built in 6693.98 sec.
-[12/28/2023-06:56:42] [I] [TRT] Loaded engine size: 39 MiB
-[12/28/2023-06:56:43] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1283, GPU 5413 (MiB)
-[12/28/2023-06:56:43] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +37, now: CPU 0, GPU 37 (MiB)
-[12/28/2023-06:56:43] [I] Engine deserialized in 0.263232 sec.
-[12/28/2023-06:56:43] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1283, GPU 5413 (MiB)
-[12/28/2023-06:56:43] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +138, now: CPU 0, GPU 175 (MiB)
-[12/28/2023-06:56:43] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-06:56:43] [I] Using random values for input onnx::Cast_0
-[12/28/2023-06:56:43] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-06:56:43] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-06:56:43] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-06:56:43] [I] Starting inference
-[12/28/2023-06:56:58] [I] Warmup completed 2 queries over 200 ms
-[12/28/2023-06:56:58] [I] Timing trace has 872 queries over 15.0266 s
-[12/28/2023-06:56:58] [I] 
-[12/28/2023-06:56:58] [I] === Trace details ===
-[12/28/2023-06:56:58] [I] Trace averages of 100 runs:
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 17.3465 ms - Host latency: 17.467 ms (enqueue 17.4036 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 17.4154 ms - Host latency: 17.5365 ms (enqueue 17.4757 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 17.3679 ms - Host latency: 17.4875 ms (enqueue 17.4262 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 17.5258 ms - Host latency: 17.6474 ms (enqueue 17.5855 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 17.315 ms - Host latency: 17.4354 ms (enqueue 17.3775 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 16.9008 ms - Host latency: 17.0146 ms (enqueue 16.9691 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 16.5099 ms - Host latency: 16.6213 ms (enqueue 16.5847 ms)
-[12/28/2023-06:56:58] [I] Average on 100 runs - GPU latency: 16.4721 ms - Host latency: 16.5843 ms (enqueue 16.5453 ms)
-[12/28/2023-06:56:58] [I] 
-[12/28/2023-06:56:58] [I] === Performance summary ===
-[12/28/2023-06:56:58] [I] Throughput: 58.0306 qps
-[12/28/2023-06:56:58] [I] Latency: min = 15.9121 ms, max = 21.7354 ms, mean = 17.1982 ms, median = 17.2047 ms, percentile(90%) = 17.9839 ms, percentile(95%) = 18.5039 ms, percentile(99%) = 19.7083 ms
-[12/28/2023-06:56:58] [I] Enqueue Time: min = 15.8809 ms, max = 21.6855 ms, mean = 17.1468 ms, median = 17.1523 ms, percentile(90%) = 17.9199 ms, percentile(95%) = 18.2314 ms, percentile(99%) = 20.02 ms
-[12/28/2023-06:56:58] [I] H2D Latency: min = 0.0800781 ms, max = 0.153687 ms, mean = 0.0979622 ms, median = 0.0981445 ms, percentile(90%) = 0.100586 ms, percentile(95%) = 0.101562 ms, percentile(99%) = 0.110352 ms
-[12/28/2023-06:56:58] [I] GPU Compute Time: min = 15.8008 ms, max = 21.6191 ms, mean = 17.0811 ms, median = 17.0859 ms, percentile(90%) = 17.8599 ms, percentile(95%) = 18.3804 ms, percentile(99%) = 19.5974 ms
-[12/28/2023-06:56:58] [I] D2H Latency: min = 0.00292969 ms, max = 0.0549316 ms, mean = 0.019114 ms, median = 0.0200195 ms, percentile(90%) = 0.0280762 ms, percentile(95%) = 0.0292969 ms, percentile(99%) = 0.0395508 ms
-[12/28/2023-06:56:58] [I] Total Host Walltime: 15.0266 s
-[12/28/2023-06:56:58] [I] Total GPU Compute Time: 14.8947 s
-[12/28/2023-06:56:58] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-06:56:58] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp32.onnx --best --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp32.onnx.best.engine

yolo_nas_pose_m_fp32.onnx.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:ee50960125929065820108740b009a002d8e0a539c52faa537c2f9f875038893
-size 157910277

yolo_nas_pose_m_fp32.onnx.engine.err

@@ -1,213 +0,0 @@
-[12/28/2023-03:46:53] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-03:46:53] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-03:48:16] [W] [TRT] Tactic Device request: 6262MB Available: 2381MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:48:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:48:16] [W] [TRT] Tactic Device request: 6262MB Available: 2380MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:48:16] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6262 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:48:16] [W] [TRT] Tactic Device request: 6262MB Available: 2380MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:48:16] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:09] [W] [TRT] Tactic Device request: 4711MB Available: 2450MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:09] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:09] [W] [TRT] Tactic Device request: 4711MB Available: 2451MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:09] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:09] [W] [TRT] Tactic Device request: 4711MB Available: 2451MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:09] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:20] [W] [TRT] Tactic Device request: 6275MB Available: 2450MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:20] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:20] [W] [TRT] Tactic Device request: 6275MB Available: 2450MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:20] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:50:20] [W] [TRT] Tactic Device request: 6275MB Available: 2449MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:50:20] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:42] [W] [TRT] Tactic Device request: 7056MB Available: 2415MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:42] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:42] [W] [TRT] Tactic Device request: 7056MB Available: 2415MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:42] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:43] [W] [TRT] Tactic Device request: 7056MB Available: 2415MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:55] [W] [TRT] Tactic Device request: 6354MB Available: 2419MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:55] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:55] [W] [TRT] Tactic Device request: 6354MB Available: 2419MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:55] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:52:55] [W] [TRT] Tactic Device request: 6354MB Available: 2419MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:52:55] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:57] [W] [TRT] Tactic Device request: 2394MB Available: 2362MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:57] [W] [TRT] Tactic Device request: 2394MB Available: 2362MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:57] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:57] [W] [TRT] Tactic Device request: 2394MB Available: 2361MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:57] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:58] [W] [TRT] Tactic Device request: 2392MB Available: 2362MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:58] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:58] [W] [TRT] Tactic Device request: 2392MB Available: 2362MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:58] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:55:58] [W] [TRT] Tactic Device request: 2392MB Available: 2362MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:55:58] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:56:08] [W] [TRT] Tactic Device request: 4906MB Available: 2351MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:56:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:56:08] [W] [TRT] Tactic Device request: 4906MB Available: 2351MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:56:08] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:56:08] [W] [TRT] Tactic Device request: 4906MB Available: 2351MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:56:08] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:57:49] [W] [TRT] Tactic Device request: 2457MB Available: 2324MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:57:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:57:49] [W] [TRT] Tactic Device request: 2457MB Available: 2324MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:57:49] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:57:49] [W] [TRT] Tactic Device request: 2457MB Available: 2324MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:57:49] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:03] [W] [TRT] Tactic Device request: 3587MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:03] [W] [TRT] Tactic Device request: 3587MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:03] [W] [TRT] Tactic Device request: 3587MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:05] [W] [TRT] Tactic Device request: 2385MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:05] [W] [TRT] Tactic Device request: 2385MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2385 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:58:05] [W] [TRT] Tactic Device request: 2385MB Available: 2315MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:58:05] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:59:52] [W] [TRT] Tactic Device request: 3556MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:59:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:59:52] [W] [TRT] Tactic Device request: 3556MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:59:52] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-03:59:52] [W] [TRT] Tactic Device request: 3556MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-03:59:52] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:10] [W] [TRT] Tactic Device request: 2359MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:10] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:10] [W] [TRT] Tactic Device request: 2359MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:10] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:10] [W] [TRT] Tactic Device request: 2359MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:10] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:13] [W] [TRT] Tactic Device request: 2362MB Available: 2265MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:13] [W] [TRT] Tactic Device request: 2362MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:13] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2362 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:13] [W] [TRT] Tactic Device request: 2362MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:13] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:16] [W] [TRT] Tactic Device request: 2359MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:16] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:16] [W] [TRT] Tactic Device request: 2359MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:16] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:02:17] [W] [TRT] Tactic Device request: 2359MB Available: 2264MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:02:17] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:22] [W] [TRT] Tactic Device request: 3575MB Available: 2232MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:22] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:22] [W] [TRT] Tactic Device request: 3575MB Available: 2232MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:22] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3575 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:23] [W] [TRT] Tactic Device request: 3575MB Available: 2232MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:23] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:27] [W] [TRT] Tactic Device request: 2390MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:27] [W] [TRT] Tactic Device request: 2390MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:27] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:28] [W] [TRT] Tactic Device request: 2390MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:28] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:31] [W] [TRT] Tactic Device request: 2388MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:32] [W] [TRT] Tactic Device request: 2388MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:32] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2388 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:32] [W] [TRT] Tactic Device request: 2388MB Available: 2232MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:32] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:36] [W] [TRT] Tactic Device request: 4775MB Available: 2230MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:36] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:37] [W] [TRT] Tactic Device request: 4775MB Available: 2230MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:37] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4775 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:38] [W] [TRT] Tactic Device request: 4775MB Available: 2230MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:38] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:44] [W] [TRT] Tactic Device request: 4774MB Available: 2230MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:45] [W] [TRT] Tactic Device request: 4774MB Available: 2231MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:45] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:04:46] [W] [TRT] Tactic Device request: 4774MB Available: 2229MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:04:47] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:03] [W] [TRT] Tactic Device request: 2454MB Available: 2211MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:03] [W] [TRT] Tactic Device request: 2454MB Available: 2211MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:03] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2454 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:03] [W] [TRT] Tactic Device request: 2454MB Available: 2211MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:03] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:05] [W] [TRT] Tactic Device request: 2463MB Available: 2213MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:06] [W] [TRT] Tactic Device request: 2463MB Available: 2211MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:06] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:07] [W] [TRT] Tactic Device request: 2463MB Available: 2191MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:07] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:12] [W] [TRT] Tactic Device request: 2463MB Available: 2211MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:12] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:13] [W] [TRT] Tactic Device request: 2463MB Available: 2217MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:13] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:14] [W] [TRT] Tactic Device request: 2463MB Available: 2217MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:07:14] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:07:52] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-04:07:52] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-04:07:52] [W] * GPU compute time is unstable, with coefficient of variance = 1.7282%.
-[12/28/2023-04:07:52] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.

yolo_nas_pose_m_fp32.onnx.engine.log

@@ -1,306 +0,0 @@
-&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp32.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp32.onnx.engine
-[12/28/2023-03:46:47] [I] === Model Options ===
-[12/28/2023-03:46:47] [I] Format: ONNX
-[12/28/2023-03:46:47] [I] Model: yolo_nas_pose_m_fp32.onnx
-[12/28/2023-03:46:47] [I] Output:
-[12/28/2023-03:46:47] [I] === Build Options ===
-[12/28/2023-03:46:47] [I] Max batch: explicit batch
-[12/28/2023-03:46:47] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
-[12/28/2023-03:46:47] [I] minTiming: 1
-[12/28/2023-03:46:47] [I] avgTiming: 8
-[12/28/2023-03:46:47] [I] Precision: FP32
-[12/28/2023-03:46:47] [I] LayerPrecisions: 
-[12/28/2023-03:46:47] [I] Calibration: 
-[12/28/2023-03:46:47] [I] Refit: Disabled
-[12/28/2023-03:46:47] [I] Sparsity: Disabled
-[12/28/2023-03:46:47] [I] Safe mode: Disabled
-[12/28/2023-03:46:47] [I] DirectIO mode: Disabled
-[12/28/2023-03:46:47] [I] Restricted mode: Disabled
-[12/28/2023-03:46:47] [I] Build only: Disabled
-[12/28/2023-03:46:47] [I] Save engine: yolo_nas_pose_m_fp32.onnx.engine
-[12/28/2023-03:46:47] [I] Load engine: 
-[12/28/2023-03:46:47] [I] Profiling verbosity: 0
-[12/28/2023-03:46:47] [I] Tactic sources: Using default tactic sources
-[12/28/2023-03:46:47] [I] timingCacheMode: local
-[12/28/2023-03:46:47] [I] timingCacheFile: 
-[12/28/2023-03:46:47] [I] Heuristic: Disabled
-[12/28/2023-03:46:47] [I] Preview Features: Use default preview flags.
-[12/28/2023-03:46:47] [I] Input(s)s format: fp32:CHW
-[12/28/2023-03:46:47] [I] Output(s)s format: fp32:CHW
-[12/28/2023-03:46:47] [I] Input build shapes: model
-[12/28/2023-03:46:47] [I] Input calibration shapes: model
-[12/28/2023-03:46:47] [I] === System Options ===
-[12/28/2023-03:46:47] [I] Device: 0
-[12/28/2023-03:46:47] [I] DLACore: 
-[12/28/2023-03:46:47] [I] Plugins:
-[12/28/2023-03:46:47] [I] === Inference Options ===
-[12/28/2023-03:46:47] [I] Batch: Explicit
-[12/28/2023-03:46:47] [I] Input inference shapes: model
-[12/28/2023-03:46:47] [I] Iterations: 10
-[12/28/2023-03:46:47] [I] Duration: 15s (+ 200ms warm up)
-[12/28/2023-03:46:47] [I] Sleep time: 0ms
-[12/28/2023-03:46:47] [I] Idle time: 0ms
-[12/28/2023-03:46:47] [I] Streams: 1
-[12/28/2023-03:46:47] [I] ExposeDMA: Disabled
-[12/28/2023-03:46:47] [I] Data transfers: Enabled
-[12/28/2023-03:46:47] [I] Spin-wait: Disabled
-[12/28/2023-03:46:47] [I] Multithreading: Disabled
-[12/28/2023-03:46:47] [I] CUDA Graph: Disabled
-[12/28/2023-03:46:47] [I] Separate profiling: Disabled
-[12/28/2023-03:46:47] [I] Time Deserialize: Disabled
-[12/28/2023-03:46:47] [I] Time Refit: Disabled
-[12/28/2023-03:46:47] [I] NVTX verbosity: 0
-[12/28/2023-03:46:47] [I] Persistent Cache Ratio: 0
-[12/28/2023-03:46:47] [I] Inputs:
-[12/28/2023-03:46:47] [I] === Reporting Options ===
-[12/28/2023-03:46:47] [I] Verbose: Disabled
-[12/28/2023-03:46:47] [I] Averages: 100 inferences
-[12/28/2023-03:46:47] [I] Percentiles: 90,95,99
-[12/28/2023-03:46:47] [I] Dump refittable layers:Disabled
-[12/28/2023-03:46:47] [I] Dump output: Disabled
-[12/28/2023-03:46:47] [I] Profile: Disabled
-[12/28/2023-03:46:47] [I] Export timing to JSON file: 
-[12/28/2023-03:46:47] [I] Export output to JSON file: 
-[12/28/2023-03:46:47] [I] Export profile to JSON file: 
-[12/28/2023-03:46:47] [I] 
-[12/28/2023-03:46:47] [I] === Device Information ===
-[12/28/2023-03:46:47] [I] Selected Device: Orin
-[12/28/2023-03:46:47] [I] Compute Capability: 8.7
-[12/28/2023-03:46:47] [I] SMs: 8
-[12/28/2023-03:46:47] [I] Compute Clock Rate: 0.624 GHz
-[12/28/2023-03:46:47] [I] Device Global Memory: 7471 MiB
-[12/28/2023-03:46:47] [I] Shared Memory per SM: 164 KiB
-[12/28/2023-03:46:47] [I] Memory Bus Width: 128 bits (ECC disabled)
-[12/28/2023-03:46:47] [I] Memory Clock Rate: 0.624 GHz
-[12/28/2023-03:46:47] [I] 
-[12/28/2023-03:46:47] [I] TensorRT version: 8.5.2
-[12/28/2023-03:46:48] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 3179 (MiB)
-[12/28/2023-03:46:50] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +428, now: CPU 574, GPU 3629 (MiB)
-[12/28/2023-03:46:51] [I] Start parsing network model
-[12/28/2023-03:46:53] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-03:46:53] [I] [TRT] Input filename:   yolo_nas_pose_m_fp32.onnx
-[12/28/2023-03:46:53] [I] [TRT] ONNX IR version:  0.0.8
-[12/28/2023-03:46:53] [I] [TRT] Opset version:    17
-[12/28/2023-03:46:53] [I] [TRT] Producer name:    pytorch
-[12/28/2023-03:46:53] [I] [TRT] Producer version: 2.1.2
-[12/28/2023-03:46:53] [I] [TRT] Domain:           
-[12/28/2023-03:46:53] [I] [TRT] Model version:    0
-[12/28/2023-03:46:53] [I] [TRT] Doc string:       
-[12/28/2023-03:46:53] [I] [TRT] ----------------------------------------------------------------
-[12/28/2023-03:46:53] [I] Finish parsing network model
-[12/28/2023-03:46:53] [I] [TRT] ---------- Layers Running on DLA ----------
-[12/28/2023-03:46:53] [I] [TRT] ---------- Layers Running on GPU ----------
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation1]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/pre_process/pre_process.0/Cast.../pre_process/pre_process.2/Mul]}
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 407) [Constant]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 408) [Constant]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONSTANT: (Unnamed Layer* 409) [Constant]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stem/conv/rbr_reparam/Conv + /model/backbone/stem/conv/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/downsample/rbr_reparam/Conv + /model/backbone/stage1/downsample/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv2/conv/Conv + /model/backbone/stage1/blocks/conv2/act/Relu || /model/backbone/stage1/blocks/conv1/conv/Conv + /model/backbone/stage1/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 15) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 23) [Shuffle] + /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage1/blocks/conv3/conv/Conv + /model/backbone/stage1/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_skip2/conv/Conv + /model/neck/neck2/reduce_skip2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/downsample/rbr_reparam/Conv + /model/backbone/stage2/downsample/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/downsample/conv/Conv + /model/neck/neck2/downsample/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv2/conv/Conv + /model/backbone/stage2/blocks/conv2/act/Relu || /model/backbone/stage2/blocks/conv1/conv/Conv + /model/backbone/stage2/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 44) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 52) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 60) [Shuffle] + /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage2/blocks/conv3/conv/Conv + /model/backbone/stage2/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip2/conv/Conv + /model/neck/neck1/reduce_skip2/act/Relu || /model/neck/neck2/reduce_skip1/conv/Conv + /model/neck/neck2/reduce_skip1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/downsample/rbr_reparam/Conv + /model/backbone/stage3/downsample/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/downsample/conv/Conv + /model/neck/neck1/downsample/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv2/conv/Conv + /model/backbone/stage3/blocks/conv2/act/Relu || /model/backbone/stage3/blocks/conv1/conv/Conv + /model/backbone/stage3/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 83) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 91) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.2.alpha + (Unnamed Layer* 99) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.3.alpha + (Unnamed Layer* 107) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/rbr_reparam/Conv + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage3.blocks.bottlenecks.4.alpha + (Unnamed Layer* 115) [Shuffle] + /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Mul, /model/backbone/stage3/blocks/bottlenecks/bottlenecks.4/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv1/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.0/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.1/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.2/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/bottlenecks/bottlenecks.3/Add_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage3/blocks/conv3/conv/Conv + /model/backbone/stage3/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_skip1/conv/Conv + /model/neck/neck1/reduce_skip1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/downsample/rbr_reparam/Conv + /model/backbone/stage4/downsample/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv2/conv/Conv + /model/backbone/stage4/blocks/conv2/act/Relu || /model/backbone/stage4/blocks/conv1/conv/Conv + /model/backbone/stage4/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 134) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.backbone.stage4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 142) [Shuffle] + /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Mul, /model/backbone/stage4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/stage4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/stage4/blocks/conv3/conv/Conv + /model/backbone/stage4/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv1/conv/Conv + /model/backbone/context_module/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.2/MaxPool
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.1/MaxPool
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POOLING: /model/backbone/context_module/m.0/MaxPool
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/backbone/context_module/cv1/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/backbone/context_module/cv2/conv/Conv + /model/backbone/context_module/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/conv/conv/Conv + /model/neck/neck1/conv/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck1/upsample/ConvTranspose
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/reduce_after_concat/conv/Conv + /model/neck/neck1/reduce_after_concat/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv2/conv/Conv + /model/neck/neck1/blocks/conv2/act/Relu || /model/neck/neck1/blocks/conv1/conv/Conv + /model/neck/neck1/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.0.alpha + (Unnamed Layer* 171) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck1.blocks.bottlenecks.1.alpha + (Unnamed Layer* 179) [Shuffle] + /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck1/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/neck/neck1/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck1/blocks/conv3/conv/Conv + /model/neck/neck1/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/conv/conv/Conv + /model/neck/neck2/conv/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] DECONVOLUTION: /model/neck/neck2/upsample/ConvTranspose
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/reduce_skip1/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/reduce_after_concat/conv/Conv + /model/neck/neck2/reduce_after_concat/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv2/conv/Conv + /model/neck/neck2/blocks/conv2/act/Relu || /model/neck/neck2/blocks/conv1/conv/Conv + /model/neck/neck2/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.0.alpha + (Unnamed Layer* 200) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.1.alpha + (Unnamed Layer* 208) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv1/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/rbr_reparam/Conv + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/cv2/nonlinearity/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck2.blocks.bottlenecks.2.alpha + (Unnamed Layer* 216) [Shuffle] + /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck2/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/neck/neck2/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck2/blocks/conv3/conv/Conv + /model/neck/neck2/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/bbox_stem/seq/conv/Conv + /model/heads/head1/bbox_stem/seq/act/Relu || /model/heads/head1/pose_stem/seq/conv/Conv + /model/heads/head1/pose_stem/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/conv/conv/Conv + /model/neck/neck3/conv/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head1/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head1/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head1/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv2/conv/Conv + /model/neck/neck3/blocks/conv2/act/Relu || /model/neck/neck3/blocks/conv1/conv/Conv + /model/neck/neck3/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/cls_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/reg_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head1/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape + /model/heads/Transpose
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head1/pose_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.0.alpha + (Unnamed Layer* 247) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck3.blocks.bottlenecks.1.alpha + (Unnamed Layer* 270) [Shuffle] + /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck3/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/neck/neck3/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck3/blocks/conv3/conv/Conv + /model/neck/neck3/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_stem/seq/conv/Conv + /model/heads/head2/pose_stem/seq/act/Relu || /model/heads/head2/bbox_stem/seq/conv/Conv + /model/heads/head2/bbox_stem/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/conv/conv/Conv + /model/neck/neck4/conv/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head2/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head2/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head2/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv2/conv/Conv + /model/neck/neck4/blocks/conv2/act/Relu || /model/neck/neck4/blocks/conv1/conv/Conv + /model/neck/neck4/blocks/conv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/cls_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/reg_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head2/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_4 + /model/heads/Transpose_3
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head2/pose_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_1
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.0.alpha + (Unnamed Layer* 301) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.0/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_1
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.1.alpha + (Unnamed Layer* 324) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.1/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv1/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/conv/Conv + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/cv2/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] POINTWISE: PWN(model.neck.neck4.blocks.bottlenecks.2.alpha + (Unnamed Layer* 332) [Shuffle] + /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Mul, /model/neck/neck4/blocks/bottlenecks/bottlenecks.2/Add)
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] COPY: /model/neck/neck4/blocks/conv2/act/Relu_output_0 copy
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/neck/neck4/blocks/conv3/conv/Conv + /model/neck/neck4/blocks/conv3/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/bbox_stem/seq/conv/Conv + /model/heads/head3/bbox_stem/seq/act/Relu || /model/heads/head3/pose_stem/seq/conv/Conv + /model/heads/head3/pose_stem/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_convs/reg_convs.0/seq/conv/Conv + /model/heads/head3/reg_convs/reg_convs.0/seq/act/Relu || /model/heads/head3/cls_convs/cls_convs.0/seq/conv/Conv + /model/heads/head3/cls_convs/cls_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.0/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.0/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/cls_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/reg_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.1/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.1/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SHUFFLE: /model/heads/Reshape_8 + /model/heads/Transpose_6
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_convs/pose_convs.2/seq/conv/Conv + /model/heads/head3/pose_convs/pose_convs.2/seq/act/Relu
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] SOFTMAX: /model/heads/Softmax_2
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/head3/pose_pred/Conv
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] CONVOLUTION: /model/heads/Conv_2
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice_1.../post_process/Reshape_2]}
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] NMS: batched_nms_26
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] DEVICE_TO_SHAPE_HOST: (Unnamed Layer* 411) [NMS]_1_output[DevicetoShapeHostCopy]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation2]
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[/model/heads/head1/Slice...graph2_/Concat_5]}
-[12/28/2023-03:46:53] [I] [TRT] [GpuLayer] TRAIN_STATION: [trainStation3]
-[12/28/2023-03:46:55] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +715, now: CPU 1279, GPU 4619 (MiB)
-[12/28/2023-03:46:55] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +112, now: CPU 1362, GPU 4731 (MiB)
-[12/28/2023-03:46:55] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
-[12/28/2023-04:07:26] [I] [TRT] Total Activation Memory: 8204060160
-[12/28/2023-04:07:26] [I] [TRT] Detected 1 inputs and 1 output network tensors.
-[12/28/2023-04:07:32] [I] [TRT] Total Host Persistent Memory: 339472
-[12/28/2023-04:07:32] [I] [TRT] Total Device Persistent Memory: 41472
-[12/28/2023-04:07:32] [I] [TRT] Total Scratch Memory: 134217728
-[12/28/2023-04:07:32] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 30 MiB, GPU 2131 MiB
-[12/28/2023-04:07:32] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 192 steps to complete.
-[12/28/2023-04:07:32] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 116.441ms to assign 16 blocks to 192 nodes requiring 178505216 bytes.
-[12/28/2023-04:07:32] [I] [TRT] Total Activation Memory: 178505216
-[12/28/2023-04:07:34] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1706, GPU 5423 (MiB)
-[12/28/2023-04:07:34] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +20, GPU +256, now: CPU 20, GPU 256 (MiB)
-[12/28/2023-04:07:35] [I] Engine built in 1247.53 sec.
-[12/28/2023-04:07:36] [I] [TRT] Loaded engine size: 150 MiB
-[12/28/2023-04:07:36] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1392, GPU 4815 (MiB)
-[12/28/2023-04:07:36] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +148, now: CPU 0, GPU 148 (MiB)
-[12/28/2023-04:07:36] [I] Engine deserialized in 0.27583 sec.
-[12/28/2023-04:07:36] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1392, GPU 4815 (MiB)
-[12/28/2023-04:07:36] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +170, now: CPU 0, GPU 318 (MiB)
-[12/28/2023-04:07:36] [I] Setting persistentCacheLimit to 0 bytes.
-[12/28/2023-04:07:36] [I] Using random values for input onnx::Cast_0
-[12/28/2023-04:07:36] [I] Created input binding for onnx::Cast_0 with dimensions 1x3x640x640
-[12/28/2023-04:07:36] [I] Using random values for output graph2_flat_predictions
-[12/28/2023-04:07:36] [I] Created output binding for graph2_flat_predictions with dimensions -1x57
-[12/28/2023-04:07:36] [I] Starting inference
-[12/28/2023-04:07:52] [I] Warmup completed 4 queries over 200 ms
-[12/28/2023-04:07:52] [I] Timing trace has 286 queries over 15.0841 s
-[12/28/2023-04:07:52] [I] 
-[12/28/2023-04:07:52] [I] === Trace details ===
-[12/28/2023-04:07:52] [I] Trace averages of 100 runs:
-[12/28/2023-04:07:52] [I] Average on 100 runs - GPU latency: 52.6677 ms - Host latency: 52.7709 ms (enqueue 52.6762 ms)
-[12/28/2023-04:07:52] [I] Average on 100 runs - GPU latency: 52.6271 ms - Host latency: 52.7354 ms (enqueue 52.6689 ms)
-[12/28/2023-04:07:52] [I] 
-[12/28/2023-04:07:52] [I] === Performance summary ===
-[12/28/2023-04:07:52] [I] Throughput: 18.9603 qps
-[12/28/2023-04:07:52] [I] Latency: min = 50.0151 ms, max = 56.8789 ms, mean = 52.7465 ms, median = 52.6514 ms, percentile(90%) = 53.687 ms, percentile(95%) = 54.0391 ms, percentile(99%) = 56.5283 ms
-[12/28/2023-04:07:52] [I] Enqueue Time: min = 49.9697 ms, max = 57.2051 ms, mean = 52.6699 ms, median = 52.5957 ms, percentile(90%) = 53.8911 ms, percentile(95%) = 54.0244 ms, percentile(99%) = 56.3145 ms
-[12/28/2023-04:07:52] [I] H2D Latency: min = 0.0810547 ms, max = 0.110352 ms, mean = 0.0939393 ms, median = 0.097168 ms, percentile(90%) = 0.101562 ms, percentile(95%) = 0.101562 ms, percentile(99%) = 0.109375 ms
-[12/28/2023-04:07:52] [I] GPU Compute Time: min = 49.8867 ms, max = 56.7793 ms, mean = 52.6403 ms, median = 52.5444 ms, percentile(90%) = 53.5859 ms, percentile(95%) = 53.9502 ms, percentile(99%) = 56.4229 ms
-[12/28/2023-04:07:52] [I] D2H Latency: min = 0.00292969 ms, max = 0.0556641 ms, mean = 0.0122266 ms, median = 0.0126953 ms, percentile(90%) = 0.0205078 ms, percentile(95%) = 0.0234375 ms, percentile(99%) = 0.0366211 ms
-[12/28/2023-04:07:52] [I] Total Host Walltime: 15.0841 s
-[12/28/2023-04:07:52] [I] Total GPU Compute Time: 15.0551 s
-[12/28/2023-04:07:52] [I] Explanations of the performance metrics are printed in the verbose logs.
-[12/28/2023-04:07:52] [I] 
-&&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=yolo_nas_pose_m_fp32.onnx --avgRuns=100 --duration=15 --saveEngine=yolo_nas_pose_m_fp32.onnx.engine

yolo_nas_pose_m_fp32.onnx.fp16.engine

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:812d9036a993eb2f87be02d6a9490e6b4e756f5b04f960a44dfcec3ea9fff6a5
-size 79680845

yolo_nas_pose_m_fp32.onnx.fp16.engine.err

@@ -1,356 +0,0 @@
-[12/28/2023-04:08:05] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
-[12/28/2023-04:08:05] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
-[12/28/2023-04:12:32] [W] [TRT] Tactic Device request: 6262MB Available: 2837MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:12:32] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:12:32] [W] [TRT] Tactic Device request: 6262MB Available: 2836MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:12:32] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6262 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:12:32] [W] [TRT] Tactic Device request: 6262MB Available: 2836MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:12:32] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6262 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:12:34] [W] [TRT] Tactic Device request: 6251MB Available: 2835MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:12:34] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6251 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:12:35] [W] [TRT] Tactic Device request: 6251MB Available: 2835MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:12:35] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6251 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:37] [W] [TRT] Tactic Device request: 4711MB Available: 2387MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:37] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:37] [W] [TRT] Tactic Device request: 4711MB Available: 2387MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:37] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4711 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:37] [W] [TRT] Tactic Device request: 4711MB Available: 2387MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:37] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4711 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:39] [W] [TRT] Tactic Device request: 4701MB Available: 2386MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:39] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4701 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:39] [W] [TRT] Tactic Device request: 4701MB Available: 2386MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:39] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4701 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:54] [W] [TRT] Tactic Device request: 6275MB Available: 2383MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:54] [W] [TRT] Tactic Device request: 6275MB Available: 2383MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:54] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6275 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:54] [W] [TRT] Tactic Device request: 6275MB Available: 2383MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:54] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6275 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:56] [W] [TRT] Tactic Device request: 6270MB Available: 2384MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6270 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:17:56] [W] [TRT] Tactic Device request: 6270MB Available: 2384MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:17:56] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6270 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:25] [W] [TRT] Tactic Device request: 7056MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:25] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:25] [W] [TRT] Tactic Device request: 7056MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:25] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7056 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:25] [W] [TRT] Tactic Device request: 7056MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:25] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7056 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:27] [W] [TRT] Tactic Device request: 7050MB Available: 2284MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:27] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7050 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:27] [W] [TRT] Tactic Device request: 7050MB Available: 2284MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:27] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 7050 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:44] [W] [TRT] Tactic Device request: 6354MB Available: 2284MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:44] [W] [TRT] Tactic Device request: 6354MB Available: 2284MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:44] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 6354 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:44] [W] [TRT] Tactic Device request: 6354MB Available: 2284MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:44] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 6354 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:46] [W] [TRT] Tactic Device request: 6351MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 6351 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:24:46] [W] [TRT] Tactic Device request: 6351MB Available: 2283MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:24:46] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 6351 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:29] [W] [TRT] Tactic Device request: 2394MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:29] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:29] [W] [TRT] Tactic Device request: 2394MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:29] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2394 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:29] [W] [TRT] Tactic Device request: 2394MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:29] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2394 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:30] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:30] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:30] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:30] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2392 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:30] [W] [TRT] Tactic Device request: 2392MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:30] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2392 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:31] [W] [TRT] Tactic Device request: 2391MB Available: 2366MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2391 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:31] [W] [TRT] Tactic Device request: 2391MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:31] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2391 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:31] [W] [TRT] Tactic Device request: 2390MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:31] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:31] [W] [TRT] Tactic Device request: 2390MB Available: 2367MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:31] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:45] [W] [TRT] Tactic Device request: 4906MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:45] [W] [TRT] Tactic Device request: 4906MB Available: 2122MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:45] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4906 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:45] [W] [TRT] Tactic Device request: 4906MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:45] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 4906 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:47] [W] [TRT] Tactic Device request: 4905MB Available: 2125MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4905 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:33:47] [W] [TRT] Tactic Device request: 4905MB Available: 2123MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:33:47] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 4905 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:38:43] [W] [TRT] Tactic Device request: 2457MB Available: 2422MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:38:43] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:38:43] [W] [TRT] Tactic Device request: 2457MB Available: 2422MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:38:43] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2457 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:38:43] [W] [TRT] Tactic Device request: 2457MB Available: 2422MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:38:43] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2457 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:38:44] [W] [TRT] Tactic Device request: 2456MB Available: 2423MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:38:44] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2456 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:38:44] [W] [TRT] Tactic Device request: 2456MB Available: 2423MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:38:44] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2456 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:04] [W] [TRT] Tactic Device request: 3587MB Available: 2036MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:05] [W] [TRT] Tactic Device request: 3587MB Available: 2036MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3587 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:05] [W] [TRT] Tactic Device request: 3587MB Available: 2036MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:05] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3587 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:06] [W] [TRT] Tactic Device request: 3585MB Available: 2078MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3585 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:06] [W] [TRT] Tactic Device request: 3585MB Available: 2078MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:06] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3585 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:07] [W] [TRT] Tactic Device request: 2385MB Available: 2077MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:07] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:07] [W] [TRT] Tactic Device request: 2385MB Available: 2077MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2385 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:07] [W] [TRT] Tactic Device request: 2385MB Available: 2075MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:07] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2385 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:08] [W] [TRT] Tactic Device request: 2384MB Available: 2075MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:08] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2384 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:39:08] [W] [TRT] Tactic Device request: 2384MB Available: 2075MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:39:08] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2384 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:44:13] [W] [TRT] Tactic Device request: 3556MB Available: 1938MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:44:13] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:44:13] [W] [TRT] Tactic Device request: 3556MB Available: 1938MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:44:13] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3556 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:44:14] [W] [TRT] Tactic Device request: 3556MB Available: 1938MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:44:14] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3556 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:44:15] [W] [TRT] Tactic Device request: 3551MB Available: 1939MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:44:15] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3551 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:44:15] [W] [TRT] Tactic Device request: 3551MB Available: 1939MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:44:15] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3551 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:47] [W] [TRT] Tactic Device request: 2359MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:47] [W] [TRT] Tactic Device request: 2359MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:47] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:47] [W] [TRT] Tactic Device request: 2359MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:47] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:48] [W] [TRT] Tactic Device request: 2355MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:48] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2355 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:48] [W] [TRT] Tactic Device request: 2355MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:48] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2355 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:52] [W] [TRT] Tactic Device request: 2362MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:53] [W] [TRT] Tactic Device request: 2362MB Available: 2030MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:53] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2362 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:53] [W] [TRT] Tactic Device request: 2362MB Available: 2029MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:53] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2362 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:56] [W] [TRT] Tactic Device request: 2357MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2357 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:56] [W] [TRT] Tactic Device request: 2357MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2357 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:57] [W] [TRT] Tactic Device request: 2359MB Available: 2032MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:57] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:58] [W] [TRT] Tactic Device request: 2359MB Available: 2032MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:58] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2359 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:50:58] [W] [TRT] Tactic Device request: 2359MB Available: 2032MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:50:58] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2359 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:51:01] [W] [TRT] Tactic Device request: 2356MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:51:01] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2356 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:51:01] [W] [TRT] Tactic Device request: 2356MB Available: 2031MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:51:01] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2356 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:38] [W] [TRT] Tactic Device request: 3575MB Available: 1948MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:38] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:38] [W] [TRT] Tactic Device request: 3575MB Available: 1948MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:38] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 3575 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:38] [W] [TRT] Tactic Device request: 3575MB Available: 1948MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:39] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 3575 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:40] [W] [TRT] Tactic Device request: 3572MB Available: 1948MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:40] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 3572 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:40] [W] [TRT] Tactic Device request: 3572MB Available: 1948MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:40] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 3572 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:45] [W] [TRT] Tactic Device request: 2390MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:45] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:46] [W] [TRT] Tactic Device request: 2390MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:46] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2390 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:46] [W] [TRT] Tactic Device request: 2390MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:46] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2390 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:49] [W] [TRT] Tactic Device request: 2387MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2387 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:50] [W] [TRT] Tactic Device request: 2387MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:50] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2387 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:52] [W] [TRT] Tactic Device request: 2388MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:52] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:52] [W] [TRT] Tactic Device request: 2388MB Available: 1933MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:52] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2388 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:53] [W] [TRT] Tactic Device request: 2388MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:53] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2388 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:56] [W] [TRT] Tactic Device request: 2386MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:56] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2386 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:56] [W] [TRT] Tactic Device request: 2386MB Available: 1932MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:56] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2386 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:56:59] [W] [TRT] Tactic Device request: 4775MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:56:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:00] [W] [TRT] Tactic Device request: 4775MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:00] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4775 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:01] [W] [TRT] Tactic Device request: 4775MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:01] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4775 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:06] [W] [TRT] Tactic Device request: 4772MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:06] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4772 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:07] [W] [TRT] Tactic Device request: 4772MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:07] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4772 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:11] [W] [TRT] Tactic Device request: 4774MB Available: 1926MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:11] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:12] [W] [TRT] Tactic Device request: 4774MB Available: 1926MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:12] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 4774 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:13] [W] [TRT] Tactic Device request: 4774MB Available: 1933MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:13] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 4774 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:18] [W] [TRT] Tactic Device request: 4771MB Available: 1930MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 4771 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-04:57:19] [W] [TRT] Tactic Device request: 4771MB Available: 1931MB. Device memory is insufficient to use tactic.
-[12/28/2023-04:57:19] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 4771 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:46] [W] [TRT] Tactic Device request: 2454MB Available: 1885MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:46] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:46] [W] [TRT] Tactic Device request: 2454MB Available: 1885MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:46] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2454 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:46] [W] [TRT] Tactic Device request: 2454MB Available: 1885MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:46] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 2454 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:47] [W] [TRT] Tactic Device request: 2453MB Available: 1885MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:47] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2453 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:47] [W] [TRT] Tactic Device request: 2453MB Available: 1886MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:47] [W] [TRT] Skipping tactic 7 due to insufficient memory on requested size of 2453 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:49] [W] [TRT] Tactic Device request: 2463MB Available: 1884MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:49] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:50] [W] [TRT] Tactic Device request: 2463MB Available: 1884MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:50] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:51] [W] [TRT] Tactic Device request: 2463MB Available: 1882MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:51] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:55] [W] [TRT] Tactic Device request: 2462MB Available: 1882MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:55] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:55] [W] [TRT] Tactic Device request: 2462MB Available: 1883MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:55] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:03:59] [W] [TRT] Tactic Device request: 2463MB Available: 1881MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:03:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:04:00] [W] [TRT] Tactic Device request: 2463MB Available: 1881MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:04:00] [W] [TRT] Skipping tactic 9 due to insufficient memory on requested size of 2463 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:04:00] [W] [TRT] Tactic Device request: 2463MB Available: 1881MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:04:00] [W] [TRT] Skipping tactic 15 due to insufficient memory on requested size of 2463 detected for tactic 0x0000000000000074.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:04:05] [W] [TRT] Tactic Device request: 2462MB Available: 1874MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:04:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 2462 detected for tactic 0x0000000000000004.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:04:05] [W] [TRT] Tactic Device request: 2462MB Available: 1872MB. Device memory is insufficient to use tactic.
-[12/28/2023-05:04:05] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 2462 detected for tactic 0x000000000000003c.
-Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
-[12/28/2023-05:04:46] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
-[12/28/2023-05:04:46] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
-[12/28/2023-05:04:46] [W] [TRT] Check verbose logs for the list of affected weights.
-[12/28/2023-05:04:46] [W] [TRT] - 103 weights are affected by this issue: Detected subnormal FP16 values.
-[12/28/2023-05:04:46] [W] [TRT] - 33 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
-[12/28/2023-05:05:03] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
-[12/28/2023-05:05:03] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
-[12/28/2023-05:05:03] [W] * GPU compute time is unstable, with coefficient of variance = 3.46355%.
-[12/28/2023-05:05:03] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.