My best advice is to do some research on exactly the types of videos you will be making. Like, if you are doing videos about the best vacuum cleaners then do a search on YouTube for 'the best vacuum cleaners.' See what your competition is doing. You need to stand out from them. So yeah, your thumbnails should be 'better.' But standing out can also mean using a different style, different colors, different style imagery or text/no text.