Periodic Updating

To enable periodic updating, change cron.php to match as follows:

#!/usr/bin/env php
<?php
define('AGE_LIMIT', 336); // Document contents expire after # hours

$working_dir = str_replace('cron.php', '', __FILE__);
chdir($working_dir);

require_once('inc/functions.php');
require_once('inc/database.php');
require_once('inc/document.php');
require_once('vendor/autoload.php');
require_once('inc/files.php');

header('Content-type: text/plain');

$site = db_dequeue();
$time = time();

while (!empty($site) && time() - $time < 20) { // Want to stay under the 30 limit for some servers?
  $document = new Document(get_url_contents($site));
  $document->path  = $site;
  db_create_document($document);
  echo 'Added: ' . $site . "\n";
  $site = db_dequeue();
}

// In case we didn't have time to insert the URL
if (!empty($site) && time() - $time < 20) {
  db_reenqueue($site);
}

// Reenqueue old documents
$ex_time = time() - (AGE_LIMIT * 3600);
db_old_docs($ex_time);

By default, it is setup to update websites that haven't been updated in over two weeks.

This is disabled by default to prevent BookMark'd from making a crazy number of requests to the same site.

I only suggest enabling this if you are using BookMark's to run a personal search engine on your own sites.