Fertility is an economically important trait in livestock. Poor fertility in dairy cattle can be due to loss-of-function variants affecting any essential gene that causes early embryonic mortality in homozygotes. To identify fertility-associated quantitative trait loci, we performed single-marker association analyses for 8 fertility traits in Holstein, Jersey, and Nordic Red Dairy cattle using imputed whole-genome sequence variants including SNPs, indels, and large deletion. We then performed stepwise selection of independent markers from GWAS loci using conditional and joint association analyses. From single-marker analyses for fertility traits, we reported genome-wide significant associations of 30,384 SNPs, 178 indels, and 3 deletions in Holstein; 23,481 SNPs, 189 indels, and 13 deletions in Nordic Red; and 17 SNPs in Jersey cattle. Conditional and joint association analyses identified 37 and 23 independent associations in Holstein and Nordic Red Dairy cattle, respectively. Fertility-associated GWAS loci were enriched for developmental and cellular processes (Gene Ontology enrichment, false discovery rate < 0.05). For these quantitative trait loci regions (top marker and 500 kb of surrounding regions), we proposed several candidate genes with functional annotations corresponding to embryonic lethality and various fertility-related phenotypes in mouse and cattle. The inclusion of these top markers in future releases of the custom SNP chip used for genomic evaluations will enable their validation in independent populations and improve the accuracy of genomic predictions.