DelphiFAQ Home Search:
General
    Databases (73)
    Linux (40)
    Outside the Cube (8793)
    Programming (679)
    Web publishing (65)
        about DelphiFAQ (14)
        JavaScript (31)
        perl CGI (3)
        VBScript (1)
        Web Hosting (8)
    Windows (430)

 
Exchange Links
 
About this site

Links to us


Website Monitoring

Book on

 

 

 General :: Web publishing
Information about web publishing, how to maintain, optimize and promote a web site.

Articles:

This list is sorted by recent document popularity (not total page views).
New documents will first appear at the bottom. Recommended links on this topic:
Featured Article

How to update a htdig search engine database

Question:

I use ht/dig from www.htdig.org to provide a search function on our web site. Every now and then, new pages appear on our site or existing ones get updated. How can the search engine's database get updated?

Answer:

You need to run the script rundig after each significant change. You can also add this command in your crontab table and schedule it for daily execution.

If you simply run rundig it will visit all pages it can find from the start page and rebuild the database completely. This process is called 'crawling' and 'indexing'.

The downside is that during this crawling / indexing your database is not available for search and users of your web site cannot use the search function.

The solution is parameter '-a' for the rundig script. This parameter makes rundig use alternate work files during the crawling and indexing (the alternate work files have an additional extension .work - your file list in the /htdig/db folder will temporarily look like this:

db.docdb
db.docdb.work
db.docs
db.docs.index
db.metaphone.db
db.soundex.db
db.wordlist
db.wordlist.work
db.words.db


Basically, a second copy of the database is built. This keeps the original files to be used by htsearch. After htdig and htmerge are done building the .work database files, rundig will move them into place, replacing the original files.

Read "How do I set up a cron job?" to see how to schedule rundig -a for daily execution.



Generated 0:02:03 on Apr 25, 2018		Most recent comments
2018-04-24 21:41:47:
by [hidden]
in Dating Scams
on Dating scammer Rhoda Naa from Accra, Ghana:
I have sent over thousands of dollars to this lady in hoping she would travel to the USA to be with me but she hadn't yet.
2018-04-24 21:32:40:
by anonymous
in Male Dating Scammers
on Dating scammer Eric Wilson:
Don't really know him, but I've heard horrible things. He is involved in so much...how can it be? He will promise you the world, tell you the things you want to hear, but it's like he doesn't even exi ... read more
2018-04-24 18:42:21:
by marts.capitalfinance@gmail.com
in Web publishing
on Getting started with CSS:
Sir,

We provide Loans,BG,SBLC,MTN,POF,LC,SKR Discounting,Project Funding,Letter of credit, and lots more for client all over the world.

Equally,we are ready to work with Brokers and ... read more
2018-04-24 17:45:57:
by anonymous
in Finances
on Well-respected bank offering Payday loans:

My husband was so smooth at hiding his infidelity so I had no proof for months, I was referred to some hacker and decided to give him a try.. the result was incredible because all my cheating hus ... read more
2018-04-24 13:39:51:
by paulharrison809@gmail.com
in Delphi
on The meaning of Runtime Error 217:
Hello Dear,

We issue All types of bank instruments such as BG/SBLC, BANK DRAFT, BCL, MT103 cash backed, MT103/202 cash wire, Bank Letter/Confirmation , MT799 block funds etc.

Issuing ... read more
2018-04-24 12:11:52:
by [hidden]
in Male Dating Scammers
on Dating scammer Micheal:
Chael, Mark Barrett, Logan is still at it. He is now in the Shippensburg, Pa area. His wife’s name is Kelli and they have children. They own a security firm in the area. His “wife” aka himself i ... read more
2018-04-22 23:34:54:
by Stroman leon15@gmail.com
in Dating Scams
on Dating scammer Amanda Smith from Ghana:
There a young lady that lives I Ghana she go by the name mercy willson her email address is daniellasare94@gmail.com . I have talk with for a while she says so love me and want to spend the rest of he ... read more
2018-04-22 14:26:05:
by anonymous
in Passwords
on Need password for encrypted RAR or ZIP archive:
please tell me the pasword of sniper elite my email is muiz0016@gmail.com

2018-04-22 03:40:49:
by anonymous
in Male Dating Scammers
on Dating scammer jack bruno:
Que bueno que busque la direccion de este tipo... Ya me parecia raro que sienta amor por recibir un mail. Nadie en su sano juicio lo hace.
Tengan cuidado!
2018-04-21 20:13:37:
by anonymous
in Male Dating Scammers
on Dating scammer Josh Kelly:
cuidado con el