Personally I would draw the globe in a super rough outline and then pick a country that looks good to you and draw that in only a slight bit more detail. Have a vague idea where you might want mountain ranges and maybe think only approximately about plate tectonics but not stress out too much about them. In the country put your mountain ranges down and think about where you might want hills. Then draw a regional map and now plot out the height of the regional map a little more thoroughly keeping the heights in line with your country maps mountains and hills. From there you can then pick out where your drainage basins will be and then put in the rivers.
From there you can do your encounter maps for telling the story. If you then need to expand your region then you have at least a consistent idea about where your mountains went and where the coastline will head off of the map.
It really depends on what your trying to get out of the map. For some people knowing the exact countries may be important to your story. You may need a set of mountains to block off a route across the map to aid in the story you are trying to tell. I think its a good idea to know roughly what is off of the map and whether the sea goes out a long way or there is another country which might send ships over into your encounter map area for example.
But for physical geography only the most picky geographers will know that there is any kind of problem with the shape of a world. Our world has places which would be almost unbelievable if just stated as fiction.
I think its important to make sure all your rivers travel down hill and that they don't loop back and do other crazy things. I think people would notice that. But whereabouts mountains form and other geographical features are much harder to declare unfit. Your rivers flowing down hill implies that you do need to know the heights over your map and that is much harder to back port from knowing where your rivers are and trying to construct hills and mountains to make their locations plausible.
Again, personally, only once I have the rivers, hills and coastlines I think about where populations may form and where roads connect them weaving around hills and going over rivers at their crossing points. Plus there is resource locations like mines, farming etc. Then its easier to build it out. If your fantasy then think about where monster types also might have their populations as well as men so that there may be areas where men do not want to linger. I.e. sticking a dragon down in an area would significantly alter the population centers.
Other people may do it differently however...