[Cherry-Pick][CI] Sync develop fix and optimizations to 2.4(#6975)#7066

EmmonsCurse merged 2 commits intoPaddlePaddle:release/2.4PaddlePaddle/FastDeploy:release/2.4from

EmmonsCurse:ci_optimize_24_329EmmonsCurse/FastDeploy:ci_optimize_24_329Copy head branch name to clipboard