Lime application is the most effective agricultural practice for the reduction of cadmium (Cd) bioavailability in acid soils. This study was conducted to investigate the impact of continuous liming across five consecutive growing seasons on the remediation of Cd in acid paddy soils, as well as rice yield. Two rice cultivars, i.e., Zhuliangyou 819 and Xiangwanxian 12, were cultivated in Cd-contaminated paddy soil for five consecutive growing seasons from 2014 to 2018. The investigated lime levels were 0, 450, 900, 1350, 1800, 2250, 3000, and 3750 kg ha−1. Lime application significantly increased rice yield, soil pH, exchangeable soil Ca2+, and rice calcium (Ca) contents; besides, it reduced soil and rice Cd contents. The application of lime at the rate of 1350–2250 kg ha−1 significantly increased rice yield. Under continuous liming, rice yield obviously increased first and then decreased with the cumulative application of lime. The application of a cumulative lime amount of 18,000 kg ha−1 was identified as the critical transition point of soil pH, soil Cd, and rice Cd content. Application of lime up to or above 3000 kg ha−1 per season reduced Cd content in brown rice below 0.20 mg kg−1. The results suggest that the reduction in effective Cd content might be a result of the combined action of exchangeable soil Ca2+ and soil pH rather than being a direct effect of Ca2+. Therefore, acid Cd-contaminated paddy fields can realize the safe production of rice by the continuous application of an appropriate amount of lime.