Single. I say always, they didn't at first and I rode brakeless in my youf (couple years ago)
They just got progressively worse when the cleats weren't even that worn. M540s were slightly better than the m520 though that might be coincidental since they're basically the same thing.
Were you using multi or single-release SPD cleats? Single-release are probably better for a fixxie skidder.