Owning your own home

I was wondering more if it was feasibly that it could be fraud to avoid stamp duty? Does it happen to that extent?

Very unlikely. Would you exchange contracts at £400k with a promise your buyer would give you a brown bag with £80k in it afterwards? That's a big risk to help a buyer save £2400.