dynamic_batching 怎么设置呢 #2603

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

PC-god opened this issue Mar 26, 2025 · 0 comments

Assignees

PC-god commented Mar 26, 2025

温馨提示：根据社区不完全统计，按照模板提问，可以加快回复和解决问题的速度

环境

【FastDeploy版本】： registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-gpu-cuda11.4-trt8.5-21.10
【编译命令】
【系统平台】: centos
【硬件】：说明具体硬件型号，如 Nvidia GPU 3080TI， CUDA 11.2 CUDNN 8.3
【编译语言】： C++ / Python(3.7或3.8等）

问题日志及出现问题的操作流程

服务化，设置的config.pbtxt 设置了max_batch_size 和dynamic_batching，返回只有一个box

paddle-bot bot assigned juncaipeng

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment