I think you should try some long MTB routes rather than “gravel”, you will find them much more stimulating, even if you can’t go quite as far in a day.
I have never experienced any of those minuses save going slower. Ride or train to trail, innit. You can add falling off more, tho, or “pushing the envelope”
I think you should try some long MTB routes rather than “gravel”, you will find them much more stimulating, even if you can’t go quite as far in a day.