Script Index

/var/lib/sorcery/modules/url_handlers/url_http

=head1 SYNOPSIS Url handler functions for downloading http, https, and ftp urls =head1 DESCRIPTION This file contains functions for downloading and verifying http, https, and ftp urls. This file uses the "wget" program. =head1 COPYRIGHT Copyright 2002 by the Source Mage Team =head1 FUNCTIONS =over 4

function url_http_bucketize()

Parameters:

• None

Description

=item url_http_bucketize echoes the download handler - wget

function url_http_verify()

Parameters:

• None

Description

=item url_http_verify Verifies the specified http url. Returns true if the url exists OR if the url is an empty string.

function url_https_verify()

Parameters:

• None

Description

=item url_https_verify Verifies the specified https url. Returns true if the url exists OR if the url is an empty string.

function url_ftp_verify()

Parameters:

• None

Implementation note

wget --spider still downloads ftp files in full rather than just checking that the file is there. To get around this problem, we download the directory and see if the file is in the directory listing.

Description

=item url_ftp_verify Verifies the specified ftp url. Echos results of wget if file is not found.

function url_http_hostname()

Parameters:

• None

Description

=item url__hostname Gets the hostname out of the url

function url_http_netselect()

Parameters:

• None

Description

=item url__netselect Run netselect on the url, netselect understands these urls and we can take advantage of its multi-A record handling

function url_http_expand()

Parameters:

• $1: a list of urls

stdout

the expanded form of those urls

Description

expand a url to ALL of the mirrors we think may be related Take the url, find its hostname, if a file in $MIRRORS matches generate new urls from all the mirrors in the file, the original url is kept at the top of the list and not duplicated