Sure. But only to a point. If it looks laughably bad, then sure it probably doesnt bode well for the quality of the writing. But if the cover is fine/good enough but clearly not something that would come from a trad publishing house... That is when the cover might not be reflective of the work but still hold people, myself often included, back.