8f9110f6a1
has been some bitrot and incorrect assumptions in the vfs_bio code. These problems have manifest themselves worse on NFS type filesystems, but can still affect local filesystems under certain circumstances. Most of the problems have involved mmap consistancy, and as a side-effect broke the vfs.ioopt code. This code might have been committed seperately, but almost everything is interrelated. 1) Allow (pmap_object_init_pt) prefaulting of buffer-busy pages that are fully valid. 2) Rather than deactivating erroneously read initial (header) pages in kern_exec, we now free them. 3) Fix the rundown of non-VMIO buffers that are in an inconsistent (missing vp) state. 4) Fix the disassociation of pages from buffers in brelse. The previous code had rotted and was faulty in a couple of important circumstances. 5) Remove a gratuitious buffer wakeup in vfs_vmio_release. 6) Remove a crufty and currently unused cluster mechanism for VBLK files in vfs_bio_awrite. When the code is functional, I'll add back a cleaner version. 7) The page busy count wakeups assocated with the buffer cache usage were incorrectly cleaned up in a previous commit by me. Revert to the original, correct version, but with a cleaner implementation. 8) The cluster read code now tries to keep data associated with buffers more aggressively (without breaking the heuristics) when it is presumed that the read data (buffers) will be soon needed. 9) Change to filesystem lockmgr locks so that they use LK_NOPAUSE. The delay loop waiting is not useful for filesystem locks, due to the length of the time intervals. 10) Correct and clean-up spec_getpages. 11) Implement a fully functional nfs_getpages, nfs_putpages. 12) Fix nfs_write so that modifications are coherent with the NFS data on the server disk (at least as well as NFS seems to allow.) 13) Properly support MS_INVALIDATE on NFS. 14) Properly pass down MS_INVALIDATE to lower levels of the VM code from vm_map_clean. 15) Better support the notion of pages being busy but valid, so that fewer in-transit waits occur. (use p->busy more for pageouts instead of PG_BUSY.) Since the page is fully valid, it is still usable for reads. 16) It is possible (in error) for cached pages to be busy. Make the page allocation code handle that case correctly. (It should probably be a printf or panic, but I want the system to handle coding errors robustly. I'll probably add a printf.) 17) Correct the design and usage of vm_page_sleep. It didn't handle consistancy problems very well, so make the design a little less lofty. After vm_page_sleep, if it ever blocked, it is still important to relookup the page (if the object generation count changed), and verify it's status (always.) 18) In vm_pageout.c, vm_pageout_clean had rotted, so clean that up. 19) Push the page busy for writes and VM_PROT_READ into vm_pageout_flush. 20) Fix vm_pager_put_pages and it's descendents to support an int flag instead of a boolean, so that we can pass down the invalidate bit.
213 lines
7.7 KiB
C
213 lines
7.7 KiB
C
/*
|
|
* Copyright (c) 1991, 1993
|
|
* The Regents of the University of California. All rights reserved.
|
|
*
|
|
* This code is derived from software contributed to Berkeley by
|
|
* The Mach Operating System project at Carnegie-Mellon University.
|
|
*
|
|
* Redistribution and use in source and binary forms, with or without
|
|
* modification, are permitted provided that the following conditions
|
|
* are met:
|
|
* 1. Redistributions of source code must retain the above copyright
|
|
* notice, this list of conditions and the following disclaimer.
|
|
* 2. Redistributions in binary form must reproduce the above copyright
|
|
* notice, this list of conditions and the following disclaimer in the
|
|
* documentation and/or other materials provided with the distribution.
|
|
* 3. All advertising materials mentioning features or use of this software
|
|
* must display the following acknowledgement:
|
|
* This product includes software developed by the University of
|
|
* California, Berkeley and its contributors.
|
|
* 4. Neither the name of the University nor the names of its contributors
|
|
* may be used to endorse or promote products derived from this software
|
|
* without specific prior written permission.
|
|
*
|
|
* THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS ``AS IS'' AND
|
|
* ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
* ARE DISCLAIMED. IN NO EVENT SHALL THE REGENTS OR CONTRIBUTORS BE LIABLE
|
|
* FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
* DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
* OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
* LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
* OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
* SUCH DAMAGE.
|
|
*
|
|
* from: @(#)vm_object.h 8.3 (Berkeley) 1/12/94
|
|
*
|
|
*
|
|
* Copyright (c) 1987, 1990 Carnegie-Mellon University.
|
|
* All rights reserved.
|
|
*
|
|
* Authors: Avadis Tevanian, Jr., Michael Wayne Young
|
|
*
|
|
* Permission to use, copy, modify and distribute this software and
|
|
* its documentation is hereby granted, provided that both the copyright
|
|
* notice and this permission notice appear in all copies of the
|
|
* software, derivative works or modified versions, and any portions
|
|
* thereof, and that both notices appear in supporting documentation.
|
|
*
|
|
* CARNEGIE MELLON ALLOWS FREE USE OF THIS SOFTWARE IN ITS "AS IS"
|
|
* CONDITION. CARNEGIE MELLON DISCLAIMS ANY LIABILITY OF ANY KIND
|
|
* FOR ANY DAMAGES WHATSOEVER RESULTING FROM THE USE OF THIS SOFTWARE.
|
|
*
|
|
* Carnegie Mellon requests users of this software to return to
|
|
*
|
|
* Software Distribution Coordinator or Software.Distribution@CS.CMU.EDU
|
|
* School of Computer Science
|
|
* Carnegie Mellon University
|
|
* Pittsburgh PA 15213-3890
|
|
*
|
|
* any improvements or extensions that they make and grant Carnegie the
|
|
* rights to redistribute these changes.
|
|
*
|
|
* $Id: vm_object.h,v 1.46 1998/02/25 03:55:52 dyson Exp $
|
|
*/
|
|
|
|
/*
|
|
* Virtual memory object module definitions.
|
|
*/
|
|
|
|
#ifndef _VM_OBJECT_
|
|
#define _VM_OBJECT_
|
|
|
|
#include <sys/queue.h>
|
|
|
|
enum obj_type { OBJT_DEFAULT, OBJT_SWAP, OBJT_VNODE, OBJT_DEVICE, OBJT_DEAD };
|
|
typedef enum obj_type objtype_t;
|
|
|
|
/*
|
|
* Types defined:
|
|
*
|
|
* vm_object_t Virtual memory object.
|
|
*/
|
|
|
|
struct vm_object {
|
|
TAILQ_ENTRY(vm_object) object_list; /* list of all objects */
|
|
TAILQ_HEAD(, vm_object) shadow_head; /* objects that this is a shadow for */
|
|
TAILQ_ENTRY(vm_object) shadow_list; /* chain of shadow objects */
|
|
TAILQ_HEAD(, vm_page) memq; /* list of resident pages */
|
|
int generation; /* generation ID */
|
|
objtype_t type; /* type of pager */
|
|
vm_size_t size; /* Object size */
|
|
int ref_count; /* How many refs?? */
|
|
int shadow_count; /* how many objects that this is a shadow for */
|
|
int pg_color; /* color of first page in obj */
|
|
u_short flags; /* see below */
|
|
u_short paging_in_progress; /* Paging (in or out) so don't collapse or destroy */
|
|
u_short behavior; /* see below */
|
|
int resident_page_count; /* number of resident pages */
|
|
int cache_count; /* number of cached pages */
|
|
int wire_count; /* number of wired pages */
|
|
vm_ooffset_t paging_offset; /* Offset into paging space */
|
|
struct vm_object *backing_object; /* object that I'm a shadow of */
|
|
vm_ooffset_t backing_object_offset;/* Offset in backing object */
|
|
vm_offset_t last_read; /* last read in object -- detect seq behavior */
|
|
vm_page_t page_hint; /* hint for last looked-up or allocated page */
|
|
TAILQ_ENTRY(vm_object) pager_object_list; /* list of all objects of this pager type */
|
|
void *handle;
|
|
union {
|
|
struct {
|
|
off_t vnp_size; /* Current size of file */
|
|
} vnp;
|
|
struct {
|
|
TAILQ_HEAD(, vm_page) devp_pglist; /* list of pages allocated */
|
|
} devp;
|
|
struct {
|
|
int swp_nblocks;
|
|
int swp_allocsize;
|
|
struct swblock *swp_blocks;
|
|
short swp_poip;
|
|
} swp;
|
|
} un_pager;
|
|
};
|
|
|
|
/*
|
|
* Flags
|
|
*/
|
|
#define OBJ_ACTIVE 0x0004 /* active objects */
|
|
#define OBJ_DEAD 0x0008 /* dead objects (during rundown) */
|
|
#define OBJ_PIPWNT 0x0040 /* paging in progress wanted */
|
|
#define OBJ_WRITEABLE 0x0080 /* object has been made writable */
|
|
#define OBJ_MIGHTBEDIRTY 0x0100 /* object might be dirty */
|
|
#define OBJ_CLEANING 0x0200
|
|
#define OBJ_OPT 0x1000 /* I/O optimization */
|
|
|
|
#define OBJ_NORMAL 0x0 /* default behavior */
|
|
#define OBJ_SEQUENTIAL 0x1 /* expect sequential accesses */
|
|
#define OBJ_RANDOM 0x2 /* expect random accesses */
|
|
|
|
#define IDX_TO_OFF(idx) (((vm_ooffset_t)(idx)) << PAGE_SHIFT)
|
|
#define OFF_TO_IDX(off) ((vm_pindex_t)(((vm_ooffset_t)(off)) >> PAGE_SHIFT))
|
|
|
|
#ifdef KERNEL
|
|
|
|
#define OBJPC_SYNC 0x1 /* sync I/O */
|
|
#define OBJPC_INVAL 0x2 /* invalidate */
|
|
|
|
TAILQ_HEAD(object_q, vm_object);
|
|
|
|
extern struct object_q vm_object_list; /* list of allocated objects */
|
|
|
|
/* lock for object list and count */
|
|
|
|
extern vm_object_t kernel_object; /* the single kernel object */
|
|
extern vm_object_t kmem_object;
|
|
|
|
#endif /* KERNEL */
|
|
|
|
#ifdef KERNEL
|
|
static __inline void
|
|
vm_object_pip_wakeup(vm_object_t object)
|
|
{
|
|
object->paging_in_progress--;
|
|
if ((object->flags & OBJ_PIPWNT) && object->paging_in_progress == 0) {
|
|
object->flags &= ~OBJ_PIPWNT;
|
|
wakeup(object);
|
|
}
|
|
}
|
|
|
|
static __inline void
|
|
vm_object_pip_sleep(vm_object_t object, char *waitid)
|
|
{
|
|
int s;
|
|
|
|
if (object->paging_in_progress) {
|
|
s = splvm();
|
|
if (object->paging_in_progress) {
|
|
object->flags |= OBJ_PIPWNT;
|
|
tsleep(object, PVM, waitid, 0);
|
|
}
|
|
splx(s);
|
|
}
|
|
}
|
|
|
|
static __inline void
|
|
vm_object_pip_wait(vm_object_t object, char *waitid)
|
|
{
|
|
while (object->paging_in_progress)
|
|
vm_object_pip_sleep(object, waitid);
|
|
}
|
|
|
|
vm_object_t vm_object_allocate __P((objtype_t, vm_size_t));
|
|
void _vm_object_allocate __P((objtype_t, vm_size_t, vm_object_t));
|
|
boolean_t vm_object_coalesce __P((vm_object_t, vm_pindex_t, vm_size_t, vm_size_t));
|
|
void vm_object_collapse __P((vm_object_t));
|
|
void vm_object_copy __P((vm_object_t, vm_pindex_t, vm_object_t *, vm_pindex_t *, boolean_t *));
|
|
void vm_object_deallocate __P((vm_object_t));
|
|
void vm_object_terminate __P((vm_object_t));
|
|
void vm_object_vndeallocate __P((vm_object_t));
|
|
void vm_object_init __P((void));
|
|
void vm_object_page_clean __P((vm_object_t, vm_pindex_t, vm_pindex_t, boolean_t));
|
|
void vm_object_page_remove __P((vm_object_t, vm_pindex_t, vm_pindex_t, boolean_t));
|
|
void vm_object_pmap_copy __P((vm_object_t, vm_pindex_t, vm_pindex_t));
|
|
void vm_object_pmap_copy_1 __P((vm_object_t, vm_pindex_t, vm_pindex_t));
|
|
void vm_object_pmap_remove __P((vm_object_t, vm_pindex_t, vm_pindex_t));
|
|
void vm_object_reference __P((vm_object_t));
|
|
void vm_object_shadow __P((vm_object_t *, vm_ooffset_t *, vm_size_t));
|
|
void vm_object_madvise __P((vm_object_t, vm_pindex_t, int, int));
|
|
void vm_object_init2 __P((void));
|
|
#endif /* KERNEL */
|
|
|
|
#endif /* _VM_OBJECT_ */
|