Peanut yield and quality are seriously affected by pod rot pathogens worldwide, especially in China in recent years. The goals of this study are to analyze the structure of fungal communities of peanut pod rot in soil in three peanut cultivars and the correlation of pod rot with environmental variables using 454 pyrosequencing. A total of 46,723 internal transcribed spacer high-quality sequences were obtained and grouped into 1,706 operational taxonomic units at the 97% similarity cut-off level. The coverage, rank abundance, and the Chao 1 and Shannon diversity indices of the operational taxonomic units were analyzed. Members of the phylum Ascomycota were dominant, such as Fusarium, Chaetomium, Alternaria, and Sordariomycetes, followed by Basidiomycota. The results of the heatmap and redundancy analysis revealed significant variation in the composition of the fungal community among the three cultivar samples. The environmental conditions in different peanut cultivars may also influence on the structure of the fungal community. The results of this study suggest that the causal agent of peanut pod rot may be more complex, and cultivars and environmental conditions are both important contributors to the community structure of peanut pod rot fungi.