Learning discovery is a great idea but easily becomes a fucking horrible teaching method. In high school I had the distinct displeasure of being taught physics via discovery. The teacher, who hadn't previously taught physics, decided that we'd all just discover the laws of physics. My takeaway was that in order to discover, you need to have a foundation upon which to build. Otherwise, 99% of the time you're just a dickhead swinging a pendulum without a purpose.
Off the top of my head, I think students need a mix of memorization, reading/background, analysis, experimentation (with feedback), and discovery.