It'd be more fun and realistic to let you draft more players. The player pool is comically thin. You have 3 different rosters to fill out (plus class-A), and you're lucky to get 5 rounds to pick each year. You need more lifeblood than that for your organization.
Also, it'd be more fun and realistic if other teams actually valued their draft picks. Guys are constantly getting turned loose in free agency an offseason or two after being drafted because teams don't take player development seriously. And it ain't just teams cutting their losses after picking a bad player with no potential (although, with AAA, AA and Class-A to fill out, it'd be more realistic if they still kept the stinkers just to fill out their rosters with bodies). They let promising prospects walk plenty too.
Kind of takes away the fun of it when you know you could easily cherry pick promising young prospects by scooping them up even after missing out on them in the draft. There's no pressure to pick well when you get 2nd and 3rd chances at picking up most players anyway.
Plus, the draft classes are just terrible cosmetically. Players all seem to have the same stances and deliveries and equipment. So there's no individuality or personality to anybody coming in in the amateur draft, outside of maybe having an unusual name.