This morning I was alerted to both shard databases burning at 100%, which should never happen in a right-sized configuration. After some checking around, the problem appeared to be bots indexing this site. That's great, we like bots! But Sitecore wasn't identifying these visits for what they were, and began processing them as Users, to be collected into the xDB. Here's a quick guide to keep these bots that slipped past detection at bay.

Read More