Quit college for cycling?

Finish the course, get a qualification (regardless of what it is), take time afterwards to do what you want.

^ This.

I took time out of my studies to push my snowboarding, after getting to a level that meant i wanted to enter some events. My heart drove this, and it made things very difficult to come back and get back into learning.