Technorati Improves Performance and Adds Languages

Posted on July 28, 2005

David Sifry, the founder and CEO of Technorati, writes on his blog that Technorati has launched a new language service on Technorati that lets users search by language as an additioal option. For example, if someone is searching for Harry Potter they can sort the search results to show only the ones written in a specific language such as Dutch, English, French, German, Japanese, Chinese or Spanish. David Sifry also says they are working on improving Technorati's performance as they try to keep up with the rapid growth. He says Technorati now receives more traffic in one week than they used to get in one month just four months ago:

So, we have been working really hard on performance and scalability improvements for the service. Just as the size of the blogosphere has been growing by leaps and bounds, and our traffic growth has been growing even faster. We just had another 40%+ growth in traffic this month - which makes this month the fourth month in a row of these kinds of traffic jumps. Basically, that means that we are now serving more traffic in a week than we did in a month just 4 months ago. So, we've been racking and stacking servers - over 200 now in our data center, and more coming each week, and we've been fixing bugs and making performance enhancements on the web site as well. Our median time from post to index is now under 5 minutes. That means that on average, we index your blog posts in under 5 minutes from when you post them to the web. All you have to do is make sure that your blog software sends us a ping.

Sifry also mentioned dealing with spam which is unfortunately going to be one of the biggest headaches for blog search engines. Spammers are always looking for easy ways to cheat by creating fake blogs and manipulating search algorithms.