Comments on: Does del.icio.us scale?

By: Themenmonat Tagging: 2. Aktuelle Trends, Probleme und offene Fragen | agenturblog.de

Sat, 24 Jun 2006 21:18:55 +0000

[...] Im August hat Philip Keller einen interessanten Artikel veröffentlicht, der der Frage nachgeht, wie skalierbar del.icio.us ist. Auch diese Frage wiederum in zweierlei Hinsicht – sowohl technisch, als auch inhaltlich. [...]

By: phred

phred — Mon, 12 Dec 2005 08:20:21 +0000

Chris: But flickr is a different case: With delicious, everyone can add tags (broad folksonomy). On flickr, just the photo uploader can (narrow folksonomy). I guess the data on delicious is much "broader" than that on flickr. You are right that it works. But I doubt that it is efficient. Just have a look at the performance measurement. I don't see a way to improve the performance.. The barrier is MySQL itself I suppose.

By: Chris L

Chris L — Sun, 11 Dec 2005 22:54:16 +0000

FYI, flickr does tag intersections just fine:
http://flickr.com/photos/fncll/tags/nome+whitealice

I see no good reason why MySQL couldn’t continue to work on del.icio.us…

By: Suttree » Elixir for Immortal Baboon

Suttree » Elixir for Immortal Baboon — Tue, 11 Oct 2005 14:33:39 +0000

[...] Most tellingly of all, the question of scalability is answered with a prediction that meta-sites will start to crop up, providing social bookmarking to specific areas of interest, like Millionsofgames.com does for casual games – http://www.pui.ch/phred/archives/2005/08/does-delicious-scale.html [...]

By: George Hotelling

George Hotelling — Sat, 10 Sep 2005 19:32:22 +0000

I think an excellent fix for the popular would be adding two new popular pages: 1 for each tag (or each tag and its related tags) instead of rigid "categories" and 1 for each person. The second one would find popular links from your inbox, and maybe go one more step and find all the popular links from the inboxes of the people in your inbox. Social clustering for social bookmarks. As for competition, Yahoo! has their version up, called My Web 2.0.

By: phred

phred — Sun, 04 Sep 2005 15:11:15 +0000

Otis: Looks very interesting! Maybe we all (45K users) should switch to Simpy and then watch how it performs? :-)

By: phred

phred — Fri, 02 Sep 2005 14:14:18 +0000

Ah by the way, when flickr has already been mentioned: Flickr has a very neat cluster engine. Have a look at their love cluster. Ah I'd love to see such clusters on delicious..

By: phred

phred — Fri, 02 Sep 2005 14:08:02 +0000

Getaclue: I fear it won’t. Have a look at my the performance tests. When reaching the 1 million marks in number of posts the performance breaks. There’s no way to avoid this, except taking an additional index/whatever into the mix.

Flickr is not based on tags. Tags are an addon there. On flickr there’s no possibility to make tag-intersecions IMHO. Tag intersections are the expensive queries. The “one-tag-queries” are quite cheap.

What do you mean with “staffed up”?
He already optimized indexing. He put in new servers. That didn’t help too much. Perhaps he needs even more servers.. but however: If you have much data then one query takes it’s time and you cannot limit this time in adding more servers.

Then, finally, on delicious you work with your bookmarks. I suppose, most users use delicious during their time working. When you work, you want fast tools. I suppose people are using flickr in a different way, namely in free time: It is not that important to have a fast site when you are browsing photos..

By: getaclue

getaclue — Fri, 02 Sep 2005 13:20:06 +0000

ever seen flickr? even before it got bought by yahoo, it had far more users than del.icio.us, had tags, and had great performance. del.icio.us/MySQL will scale fine performance-wise once Joshua has staffed up.

By: Otis Gospodnetic

Otis Gospodnetic — Thu, 01 Sep 2005 17:56:03 +0000

Re: use of Lucene - please see Simpy.