In order to further improve the vegetation coverage and promote ecological restoration in the gravel mountainous areas of the Yellow River Basin, the top 4 tree species with the highest survival rate among 7 species of trees and shrubs were selected, including Picea crassifolia, as experimental tree species. The afforestation technology experiment of gravel mountainous areas was carried out for 4 tree species. By studying the effects of different water and soil moisture retention technologies on the growth indicators, soil moisture content, soil temperature, soil fertility, survival rate, and preservation rate of the 4 tree species, suitable afforestation technologies were screened for the region. The results indicated that land preparation measures could increase the moisture content in the soil. Water collection tray measure could increase the moisture and soil temperature of the surface soil layer. In order to increase the organic matter in the soil, it was necessary to combine other measures for fertilization in the gravel mountain afforestation. Fertilization+land preparation+water collection tray measures had a significant effect on arid afforestation in the gravel mountainous areas of the Yellow River Basin. This study could provide a reference for the ecological restoration and soil and water conservation of gravel mountainous areas in the Yellow River Basin.