Re: [Strigi-devel] Indexers comparison



Op woensdag 17 januari 2007, schreef Michal Pryc:
> Hello,
>
> I am sending *small* comparison of the indexers. This might start some
> discussion on many aspects of the indexing tools, to get better ones.
>
> In the future it would be nice to see common search query standard, a
> lot of work have been done on it so far, but also common plugins for
> indexing would increase number of supported formats significantly, so we
> have plenty of work to do :-)
>
> On the xdg Mailing List At lists.freedesktop.org there are many
> discussions on the search query standard, I would recommend to join them
> if you are interested in the subject.

what i really think is wrong in this article is the view on cpu usage. the 
author (you, of course) seems to state it is bad to have a high cpu usage.

why do you want low cpu usage? what is it good for to only use a processor for 
70%?

unless, of course, some other process (the user) wants access. at that moment, 
you must ensure the user is not bothered by the indexing. that's why the gods 
(kernel developers) invented priority support in the kernel. just lower 
priority (assigning a positive nice value).

beagle is even misleading the 2.6.x kernel in making it believe it is a 
time-critical process, and not hogging resources (as it is, when indexing). 

the kernel will notice it doesn't use it's timeslices to the max, and increase 
it's priority dynamically, thus allowing the beagle daemon to interupt user 
processes! so beagle's way to lower cpu usage is actually making the 
situation worse.

all these daemons should implement support for the relatively new 'batch' 
priority in the linux kernel. a thread or process running at 'batch' priority 
can have all the cpu processing power it wants, UNLESS ANY OTHER PROCESS 
requests access to the cpu. thus, such a process finishes its work as quickly 
as possible (you'd want that) but NEVER EVER interupts a user's other 
processes and threads. i guess solaris has such a priority as well, and if it 
doesn't, just lower the priority (high nice value in the solaris kernel as 
wel?), that's a start.

Strigi has preliminary support for this, btw.

grtz

Jos

-- 
Disclaimer:

Alles wat ik doe denk en zeg is gebaseerd op het wereldbeeld wat ik nu heb. 
Ik ben niet verantwoordelijk voor wijzigingen van de wereld, of het beeld wat 
ik daarvan heb, noch voor de daaruit voortvloeiende gedragingen van mezelf. 
Alles wat ik zeg is aardig bedoeld, tenzij expliciet vermeld.

Attachment: pgp8sw8Tuo081.pgp
Description: PGP signature



[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]