Abstract: Soil moisture is an important variable to control water and energy exchange between land and atmosphere, while soil moisture automatic observation stations’ observation is the main mean to obtain soil moisture data. The accuracy of the data gained by automatic observation stations can directly affect its application effect, so it is of great significance to carry out the data evaluation for soil moisture automatic observation stations. Based on the soil moisture data of 129 automatic observation stations in Shandong Province of 2015-2016, we used the methods of precipitation infiltration, upper and lower data comparison and so on, developed the data evaluation program for the automatic observation stations in Shandong Province, and proposed the rectification measures upon the quality evaluation of the program. The results showed that most of the soil moisture automatic observation stations in Shandong Province had the problems of inaccurate measurement data for soil hydrological- physical characteristics, and unstable or breakdown soil moisture sensor, and very few observation stations have the problems with collectors.