how this model supports dynamic batch using tensorRT?

[mmx110]

Thanks, It's a great project. How this model to support dynamic batch. I set the model input first dim -1, and change code to create engine of tensorRT with method of dynamic shape . but I get error " [executionContext.cpp::validateInputBindings::1838] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::validateInputBindings::1838, condition: profileMaxDims.d[i] >= dimensions.d[i]. Supplied binding dimension [2,512,512,3] for bindings[0] exceed min ~ max range at index 0, maximum dimension in profile is 1, minimum dimension in profile is 1, but supplied dimension is 2" during inference .

[bychen7]

@mmx110 Sorry for the delayed response, implementing dynamic batching requires making changes to the code. You can refer to
Working with Dynamic Shapes for guidance.