Cadmium contamination and toxicity on plants and human health is a major problem in China. Safe rice production in Cd-contaminated alkaline soils, with acceptably low Cd levels and high yields, remains an important research challenge. To achieve this, a small-scale field experiment with seven different soil amendment materials was conducted to test their effects performance. Two best-performing materials were selected for the large-scale field experiment. Combinations of humic acid, foliar, and/or soil silicon fertilization and deep or shallow plowing were designed. It was found that the combination, including humic acid, soil and foliar silicate fertilization, and shallow plowing (5–10 cm), produced the most desirable results (the lowest soil bioavailable Cd, the lowest grain Cd concentrations, and the highest grain yield). Rice farmers are therefore recommended to implement this combination to attain high grain yield with low Cd concentrations in alkaline soils.