1998-07-09 16:52:44 +00:00
|
|
|
|
/*-
|
2004-09-21 18:35:21 +00:00
|
|
|
|
* Copyright (c) 1998-2004 Dag-Erling Co<EFBFBD>dan Sm<EFBFBD>rgrav
|
1998-07-09 16:52:44 +00:00
|
|
|
|
* All rights reserved.
|
|
|
|
|
*
|
|
|
|
|
* Redistribution and use in source and binary forms, with or without
|
|
|
|
|
* modification, are permitted provided that the following conditions
|
|
|
|
|
* are met:
|
|
|
|
|
* 1. Redistributions of source code must retain the above copyright
|
|
|
|
|
* notice, this list of conditions and the following disclaimer
|
|
|
|
|
* in this position and unchanged.
|
|
|
|
|
* 2. Redistributions in binary form must reproduce the above copyright
|
|
|
|
|
* notice, this list of conditions and the following disclaimer in the
|
|
|
|
|
* documentation and/or other materials provided with the distribution.
|
|
|
|
|
* 3. The name of the author may not be used to endorse or promote products
|
|
|
|
|
* derived from this software without specific prior written permission
|
|
|
|
|
*
|
|
|
|
|
* THIS SOFTWARE IS PROVIDED BY THE AUTHOR ``AS IS'' AND ANY EXPRESS OR
|
|
|
|
|
* IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES
|
|
|
|
|
* OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED.
|
|
|
|
|
* IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT,
|
|
|
|
|
* INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT
|
|
|
|
|
* NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
|
|
|
|
|
* DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
|
|
|
|
|
* THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
|
|
|
* (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF
|
|
|
|
|
* THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
|
|
|
*/
|
|
|
|
|
|
2001-09-30 21:36:09 +00:00
|
|
|
|
#include <sys/cdefs.h>
|
|
|
|
|
__FBSDID("$FreeBSD$");
|
|
|
|
|
|
1998-12-16 10:24:55 +00:00
|
|
|
|
#include <sys/param.h>
|
Second of a series of cleanups to libfetch.
This commit introduces the following features:
a) the fetchStat*() functions, which return meta-information for a
document, such as size, modification time, etc.
b) the use of the com_err(3) facilities to report errors.
It also fixes a bunch of style bugs and a few logic bugs and somewhat
improves the man page.
Changed files, in alphabetical order:
Makefile:
Don't generate macros in {ftp,http}err.c.
Generate category fields for the error message lists.
Compile the error table.
Install fetch_err.h along with fetch.h.
common.c:
Remove the _netdb_errstring() macro, and add FETCH_ERR_NETDB to the
error code in the _netdb_seterr() macro.
Add categories to the _netdb_errlist table.
Report errors through the Common Error library.
common.h:
Add the DEBUG macros.
Add prototype for fetchConnect().
Remove the prototype for _fetch_errstring(), which is local to common.c
Add a categroy field to struct fetcherr, and define constants for
error categories.
Define macros for _{url,netdb,ftp,http}_seterr().
errors.et: (new file)
List error categories.
fetch.3:
Document the fetchStat*() functions.
Move the "unimplemented functionality" comments from NOTES to BUGS.
Document that applications which use libfetch must also use
libcom_err, and list existing error codes.
Undocument fetchLastErr{Code,String}.
Remove the (empty) DIAGNOSTICS section.
Mention Eugene Skepner in the AUTHORS section.
fetch.c:
Move the DEBUG macros to common.c
Add fetchStat() and fetchStatURL().
Generate error messages for URL parser errors, and fix a minor bug
in the parser.
Use 'struct url' instead of 'url_t'.
Remove fetchLastErr{Code,String}.
fetch.h:
Use 'struct url' instead of 'url_t', and remove the typedef.
Define struct url_stat (used by fetchStat()).
Add prototypes for fetchStat*().
Remove the declarations for fetchLastErr{Code,String}.
Include fetch_err.h.
fetch_err.et: (new file)
Error table for libfetch.
file.c:
Add fetchStatFile().
Use 'struct url' instead of 'url_t'.
ftp.c:
Add fetchStatFTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErrCode.
ftp.errors:
Add categories to all error messages.
http.c:
Add fetchStatHTTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErr{Code,Text}.
http.errors:
Add categories to all error messages.
Prompted by: jkh and Eugene Skepner
Numerous sugestions from: Garett Wollman and Eugene Skepner
1998-11-06 22:14:08 +00:00
|
|
|
|
#include <sys/stat.h>
|
1998-12-21 19:41:50 +00:00
|
|
|
|
|
|
|
|
|
#include <dirent.h>
|
1998-07-09 16:52:44 +00:00
|
|
|
|
#include <stdio.h>
|
|
|
|
|
#include <string.h>
|
|
|
|
|
|
|
|
|
|
#include "fetch.h"
|
Second of a series of cleanups to libfetch.
This commit introduces the following features:
a) the fetchStat*() functions, which return meta-information for a
document, such as size, modification time, etc.
b) the use of the com_err(3) facilities to report errors.
It also fixes a bunch of style bugs and a few logic bugs and somewhat
improves the man page.
Changed files, in alphabetical order:
Makefile:
Don't generate macros in {ftp,http}err.c.
Generate category fields for the error message lists.
Compile the error table.
Install fetch_err.h along with fetch.h.
common.c:
Remove the _netdb_errstring() macro, and add FETCH_ERR_NETDB to the
error code in the _netdb_seterr() macro.
Add categories to the _netdb_errlist table.
Report errors through the Common Error library.
common.h:
Add the DEBUG macros.
Add prototype for fetchConnect().
Remove the prototype for _fetch_errstring(), which is local to common.c
Add a categroy field to struct fetcherr, and define constants for
error categories.
Define macros for _{url,netdb,ftp,http}_seterr().
errors.et: (new file)
List error categories.
fetch.3:
Document the fetchStat*() functions.
Move the "unimplemented functionality" comments from NOTES to BUGS.
Document that applications which use libfetch must also use
libcom_err, and list existing error codes.
Undocument fetchLastErr{Code,String}.
Remove the (empty) DIAGNOSTICS section.
Mention Eugene Skepner in the AUTHORS section.
fetch.c:
Move the DEBUG macros to common.c
Add fetchStat() and fetchStatURL().
Generate error messages for URL parser errors, and fix a minor bug
in the parser.
Use 'struct url' instead of 'url_t'.
Remove fetchLastErr{Code,String}.
fetch.h:
Use 'struct url' instead of 'url_t', and remove the typedef.
Define struct url_stat (used by fetchStat()).
Add prototypes for fetchStat*().
Remove the declarations for fetchLastErr{Code,String}.
Include fetch_err.h.
fetch_err.et: (new file)
Error table for libfetch.
file.c:
Add fetchStatFile().
Use 'struct url' instead of 'url_t'.
ftp.c:
Add fetchStatFTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErrCode.
ftp.errors:
Add categories to all error messages.
http.c:
Add fetchStatHTTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErr{Code,Text}.
http.errors:
Add categories to all error messages.
Prompted by: jkh and Eugene Skepner
Numerous sugestions from: Garett Wollman and Eugene Skepner
1998-11-06 22:14:08 +00:00
|
|
|
|
#include "common.h"
|
1998-07-09 16:52:44 +00:00
|
|
|
|
|
|
|
|
|
FILE *
|
2001-04-24 00:06:21 +00:00
|
|
|
|
fetchXGetFile(struct url *u, struct url_stat *us, const char *flags)
|
1998-07-09 16:52:44 +00:00
|
|
|
|
{
|
2002-02-05 22:13:51 +00:00
|
|
|
|
FILE *f;
|
|
|
|
|
|
|
|
|
|
if (us && fetchStatFile(u, us, flags) == -1)
|
|
|
|
|
return (NULL);
|
|
|
|
|
|
|
|
|
|
f = fopen(u->doc, "r");
|
|
|
|
|
|
|
|
|
|
if (f == NULL)
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
|
|
|
|
|
if (u->offset && fseeko(f, u->offset, SEEK_SET) == -1) {
|
|
|
|
|
fclose(f);
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
return (f);
|
1998-07-09 16:52:44 +00:00
|
|
|
|
}
|
|
|
|
|
|
2000-07-17 21:25:00 +00:00
|
|
|
|
FILE *
|
2001-04-24 00:06:21 +00:00
|
|
|
|
fetchGetFile(struct url *u, const char *flags)
|
2000-07-17 21:25:00 +00:00
|
|
|
|
{
|
2002-02-05 22:13:51 +00:00
|
|
|
|
return (fetchXGetFile(u, NULL, flags));
|
2000-07-17 21:25:00 +00:00
|
|
|
|
}
|
|
|
|
|
|
1998-07-09 16:52:44 +00:00
|
|
|
|
FILE *
|
2001-04-24 00:06:21 +00:00
|
|
|
|
fetchPutFile(struct url *u, const char *flags)
|
1998-07-09 16:52:44 +00:00
|
|
|
|
{
|
2002-02-05 22:13:51 +00:00
|
|
|
|
FILE *f;
|
|
|
|
|
|
|
|
|
|
if (CHECK_FLAG('a'))
|
|
|
|
|
f = fopen(u->doc, "a");
|
|
|
|
|
else
|
|
|
|
|
f = fopen(u->doc, "w+");
|
|
|
|
|
|
|
|
|
|
if (f == NULL)
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
|
|
|
|
|
if (u->offset && fseeko(f, u->offset, SEEK_SET) == -1) {
|
|
|
|
|
fclose(f);
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
return (f);
|
Second of a series of cleanups to libfetch.
This commit introduces the following features:
a) the fetchStat*() functions, which return meta-information for a
document, such as size, modification time, etc.
b) the use of the com_err(3) facilities to report errors.
It also fixes a bunch of style bugs and a few logic bugs and somewhat
improves the man page.
Changed files, in alphabetical order:
Makefile:
Don't generate macros in {ftp,http}err.c.
Generate category fields for the error message lists.
Compile the error table.
Install fetch_err.h along with fetch.h.
common.c:
Remove the _netdb_errstring() macro, and add FETCH_ERR_NETDB to the
error code in the _netdb_seterr() macro.
Add categories to the _netdb_errlist table.
Report errors through the Common Error library.
common.h:
Add the DEBUG macros.
Add prototype for fetchConnect().
Remove the prototype for _fetch_errstring(), which is local to common.c
Add a categroy field to struct fetcherr, and define constants for
error categories.
Define macros for _{url,netdb,ftp,http}_seterr().
errors.et: (new file)
List error categories.
fetch.3:
Document the fetchStat*() functions.
Move the "unimplemented functionality" comments from NOTES to BUGS.
Document that applications which use libfetch must also use
libcom_err, and list existing error codes.
Undocument fetchLastErr{Code,String}.
Remove the (empty) DIAGNOSTICS section.
Mention Eugene Skepner in the AUTHORS section.
fetch.c:
Move the DEBUG macros to common.c
Add fetchStat() and fetchStatURL().
Generate error messages for URL parser errors, and fix a minor bug
in the parser.
Use 'struct url' instead of 'url_t'.
Remove fetchLastErr{Code,String}.
fetch.h:
Use 'struct url' instead of 'url_t', and remove the typedef.
Define struct url_stat (used by fetchStat()).
Add prototypes for fetchStat*().
Remove the declarations for fetchLastErr{Code,String}.
Include fetch_err.h.
fetch_err.et: (new file)
Error table for libfetch.
file.c:
Add fetchStatFile().
Use 'struct url' instead of 'url_t'.
ftp.c:
Add fetchStatFTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErrCode.
ftp.errors:
Add categories to all error messages.
http.c:
Add fetchStatHTTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErr{Code,Text}.
http.errors:
Add categories to all error messages.
Prompted by: jkh and Eugene Skepner
Numerous sugestions from: Garett Wollman and Eugene Skepner
1998-11-06 22:14:08 +00:00
|
|
|
|
}
|
|
|
|
|
|
1998-12-21 19:41:50 +00:00
|
|
|
|
static int
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_stat_file(const char *fn, struct url_stat *us)
|
Second of a series of cleanups to libfetch.
This commit introduces the following features:
a) the fetchStat*() functions, which return meta-information for a
document, such as size, modification time, etc.
b) the use of the com_err(3) facilities to report errors.
It also fixes a bunch of style bugs and a few logic bugs and somewhat
improves the man page.
Changed files, in alphabetical order:
Makefile:
Don't generate macros in {ftp,http}err.c.
Generate category fields for the error message lists.
Compile the error table.
Install fetch_err.h along with fetch.h.
common.c:
Remove the _netdb_errstring() macro, and add FETCH_ERR_NETDB to the
error code in the _netdb_seterr() macro.
Add categories to the _netdb_errlist table.
Report errors through the Common Error library.
common.h:
Add the DEBUG macros.
Add prototype for fetchConnect().
Remove the prototype for _fetch_errstring(), which is local to common.c
Add a categroy field to struct fetcherr, and define constants for
error categories.
Define macros for _{url,netdb,ftp,http}_seterr().
errors.et: (new file)
List error categories.
fetch.3:
Document the fetchStat*() functions.
Move the "unimplemented functionality" comments from NOTES to BUGS.
Document that applications which use libfetch must also use
libcom_err, and list existing error codes.
Undocument fetchLastErr{Code,String}.
Remove the (empty) DIAGNOSTICS section.
Mention Eugene Skepner in the AUTHORS section.
fetch.c:
Move the DEBUG macros to common.c
Add fetchStat() and fetchStatURL().
Generate error messages for URL parser errors, and fix a minor bug
in the parser.
Use 'struct url' instead of 'url_t'.
Remove fetchLastErr{Code,String}.
fetch.h:
Use 'struct url' instead of 'url_t', and remove the typedef.
Define struct url_stat (used by fetchStat()).
Add prototypes for fetchStat*().
Remove the declarations for fetchLastErr{Code,String}.
Include fetch_err.h.
fetch_err.et: (new file)
Error table for libfetch.
file.c:
Add fetchStatFile().
Use 'struct url' instead of 'url_t'.
ftp.c:
Add fetchStatFTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErrCode.
ftp.errors:
Add categories to all error messages.
http.c:
Add fetchStatHTTP().
Use 'struct url' instead of 'url_t'.
Don't use fetchLastErr{Code,Text}.
http.errors:
Add categories to all error messages.
Prompted by: jkh and Eugene Skepner
Numerous sugestions from: Garett Wollman and Eugene Skepner
1998-11-06 22:14:08 +00:00
|
|
|
|
{
|
2002-02-05 22:13:51 +00:00
|
|
|
|
struct stat sb;
|
|
|
|
|
|
|
|
|
|
us->size = -1;
|
|
|
|
|
us->atime = us->mtime = 0;
|
|
|
|
|
if (stat(fn, &sb) == -1) {
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
return (-1);
|
|
|
|
|
}
|
|
|
|
|
us->size = sb.st_size;
|
|
|
|
|
us->atime = sb.st_atime;
|
|
|
|
|
us->mtime = sb.st_mtime;
|
|
|
|
|
return (0);
|
1998-07-09 16:52:44 +00:00
|
|
|
|
}
|
1998-12-21 19:41:50 +00:00
|
|
|
|
|
|
|
|
|
int
|
2001-09-05 12:22:28 +00:00
|
|
|
|
fetchStatFile(struct url *u, struct url_stat *us, const char *flags __unused)
|
1998-12-21 19:41:50 +00:00
|
|
|
|
{
|
2007-12-14 10:26:58 +00:00
|
|
|
|
return (fetch_stat_file(u->doc, us));
|
1998-12-21 19:41:50 +00:00
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
struct url_ent *
|
2001-09-05 12:22:28 +00:00
|
|
|
|
fetchListFile(struct url *u, const char *flags __unused)
|
1998-12-21 19:41:50 +00:00
|
|
|
|
{
|
2002-02-05 22:13:51 +00:00
|
|
|
|
struct dirent *de;
|
|
|
|
|
struct url_stat us;
|
|
|
|
|
struct url_ent *ue;
|
|
|
|
|
int size, len;
|
|
|
|
|
char fn[PATH_MAX], *p;
|
|
|
|
|
DIR *dir;
|
|
|
|
|
int l;
|
|
|
|
|
|
|
|
|
|
if ((dir = opendir(u->doc)) == NULL) {
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_syserr();
|
2002-02-05 22:13:51 +00:00
|
|
|
|
return (NULL);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
ue = NULL;
|
2003-01-28 08:04:40 +00:00
|
|
|
|
strncpy(fn, u->doc, sizeof(fn) - 2);
|
|
|
|
|
fn[sizeof(fn) - 2] = 0;
|
2002-02-05 22:13:51 +00:00
|
|
|
|
strcat(fn, "/");
|
|
|
|
|
p = strchr(fn, 0);
|
2003-01-28 08:04:40 +00:00
|
|
|
|
l = sizeof(fn) - strlen(fn) - 1;
|
2002-02-05 22:13:51 +00:00
|
|
|
|
|
|
|
|
|
while ((de = readdir(dir)) != NULL) {
|
|
|
|
|
strncpy(p, de->d_name, l - 1);
|
|
|
|
|
p[l - 1] = 0;
|
2007-12-14 10:26:58 +00:00
|
|
|
|
if (fetch_stat_file(fn, &us) == -1)
|
2002-02-05 22:13:51 +00:00
|
|
|
|
/* should I return a partial result, or abort? */
|
|
|
|
|
break;
|
2007-12-14 10:26:58 +00:00
|
|
|
|
fetch_add_entry(&ue, &size, &len, de->d_name, &us);
|
2002-02-05 22:13:51 +00:00
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
return (ue);
|
1998-12-21 19:41:50 +00:00
|
|
|
|
}
|