Maybe an hour or two after being charged. 4 weeks after signing up for the trial, and as pointed out in their response, a week after they sent a reminder that the trial was ending...
You're bang to rights if they sent the mandatory reminder in time for you to cancel before they charged you. Consider it a lesson in the cost of being disorganised.
How long between the time you signed up and sending the nicely worded email?