The ultrasonic-assisted extraction conditions of rape pollen polysaccharide were optimized by Box-Benhnken central composite design and response surface analysis based on the single factor experiment with ultrasonic power, extraction time, and the solvent/solid ratio as causal factors, and the extraction yield of polysaccharides as response value. The results showed that the optimum ultrasonic-assisted extraction conditions were as follows: ultrasonic power was 463 W, extraction time 20.5 min, and the solvent/solid ratio 22.7∶1 (mL/g). Under such conditions, the verification value of yield of polysaccharides was 5.28%, which was close to the predictive maximum yield of 5.30%. Ultrasonic technology can greatly improve the extraction yield of rape pollen polysaccharide.