Problem is - most kids enjoy sports and that is how they find that active lifestyle. Yes, there are kids, who have not much chance to be good at sports - but there are also tons of kids who have no chance at being good at reading, math, foreign languages, science, music or art. You can't just eliminate teaching them, because some kids have difficulties.
And coordination is also a skill. Some will never be too good, like some will never be too good readers or in math, but even they do get better with exercise. And for those with considerable learning issues, there should be accommodations and IEPs. But that should not mean, that rest of the class is not getting challenges and education appropriate to them.
Kids who have trouble reading or doing basic math are bullied and teased too for that, unfortunately. And foreign language classes can be pure torture (my most humiliating school memories are from English class and trying to learn to pronounce th-sound, it doesn't exist in either of my native languages and gave me great deal of trouble and is still to this day far from accurate, when coming out of my mouth, and gave lots to laugh for my class mates. It took quite a long time before I felt confident when speaking English and not trying to avoid words with that sound.) We can't totally eliminate a fact, that some kids are better in math or PE than others, neither is it fair to stop teaching them, especially when it is common, that different kids excel in different things, but teaching methods should avoid unnecessary competition (why on earth there should be for example an honor roll or some silly valedictorian and class rank system??? Only to humiliate those, who do not do so well in academics) and humiliating teaching methods. When kids have to compete and loose repeatedly, only thing that happens, is that they give up and decide that whole thing is stupid (and feel bad of themselves.) That is how you get 0,25 miles in 20 minutes runners and kids not even bothering to try to do their math homework or answering in the test or declining to even take book out from their backpack in English class.