Auto-Indexing WCDDL Internally

[CyberJ37]

Make a cron script to get downloads from your forum's DB daily, and make it start from where it stopped.

Will be way faster than crawling.

[Lock Down]

Why not just add title and topic id as most link sites do? You would not need urls unless you were trying to monitor for duplicates.

To add the title and topic id to a separate table all you would need it to create it and add a trigger to add a new record to the new table when an insert/update of the topic table is made. Very simple and google has a million examples.

By the way:

I would use topic id as key of new table and use replace rather than insert to add/update any records in that table.

[desiboy]

you can use curl to do this

[ddlshack]

Or just create a simple script which reads downloads directly from the database?