How are my college prospects?

You're doing more than enough. Colleges don't care if you play sports, they just want you to do something. It'd be ridiculous to demand that everyone do the same set of extracurriculars since not everyone has the same interests or abilities.