Banning robots

Mark Pilgrim blogged recently about his technique and rationale for banning 'bots on his site. It's a good resource for anyone else with bandwidth predicaments, but I think John Gruber's take on this is equally good.

Comments on this post are now closed.


I’m a software architect / developer / general IT wrangler specialising in web, mobile web and middleware using things like node.js, Java, C#, PHP, HTML5 and more.

Best described as a simpleton, but kindly. You can read more here.