1995-12-27 10:49:19 +00:00
|
|
|
.\" $NetBSD: ccd.4,v 1.5 1995/10/09 06:09:09 thorpej Exp $
|
|
|
|
.\"
|
|
|
|
.\" Copyright (c) 1994 Jason Downs.
|
|
|
|
.\" Copyright (c) 1994, 1995 Jason R. Thorpe.
|
|
|
|
.\" All rights reserved.
|
|
|
|
.\"
|
|
|
|
.\" Redistribution and use in source and binary forms, with or without
|
|
|
|
.\" modification, are permitted provided that the following conditions
|
|
|
|
.\" are met:
|
|
|
|
.\" 1. Redistributions of source code must retain the above copyright
|
|
|
|
.\" notice, this list of conditions and the following disclaimer.
|
|
|
|
.\" 2. Redistributions in binary form must reproduce the above copyright
|
|
|
|
.\" notice, this list of conditions and the following disclaimer in the
|
|
|
|
.\" documentation and/or other materials provided with the distribution.
|
|
|
|
.\" 3. All advertising materials mentioning features or use of this software
|
|
|
|
.\" must display the following acknowledgement:
|
|
|
|
.\" This product includes software developed for the NetBSD Project
|
|
|
|
.\" by Jason Downs and Jason R. Thorpe.
|
|
|
|
.\" 4. Neither the name of the author nor the names of its contributors
|
|
|
|
.\" may be used to endorse or promote products derived from this software
|
|
|
|
.\" without specific prior written permission.
|
|
|
|
.\"
|
|
|
|
.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR ``AS IS'' AND ANY EXPRESS OR
|
|
|
|
.\" IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES
|
|
|
|
.\" OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED.
|
|
|
|
.\" IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT,
|
|
|
|
.\" INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING,
|
|
|
|
.\" BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
|
|
|
|
.\" LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED
|
|
|
|
.\" AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
|
|
|
|
.\" OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
|
|
.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
|
|
.\" SUCH DAMAGE.
|
|
|
|
.\"
|
1999-08-28 00:22:10 +00:00
|
|
|
.\" $FreeBSD$
|
1999-07-12 21:02:10 +00:00
|
|
|
.\"
|
1995-12-27 10:49:19 +00:00
|
|
|
.Dd August 9, 1995
|
|
|
|
.Dt CCD 4
|
2001-07-10 15:31:11 +00:00
|
|
|
.Os
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh NAME
|
|
|
|
.Nm ccd
|
2001-04-18 15:54:10 +00:00
|
|
|
.Nd Concatenated Disk driver
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh SYNOPSIS
|
2001-09-26 22:41:02 +00:00
|
|
|
.Cd "device ccd"
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh DESCRIPTION
|
|
|
|
The
|
|
|
|
.Nm
|
|
|
|
driver provides the capability of combining one or more disks/partitions
|
|
|
|
into one virtual disk.
|
|
|
|
.Pp
|
2002-05-29 14:11:17 +00:00
|
|
|
This document assumes that you are familiar with how to generate kernels,
|
2001-05-01 09:15:30 +00:00
|
|
|
how to properly configure disks and devices in a kernel
|
1995-12-27 10:49:19 +00:00
|
|
|
configuration file, and how to partition disks.
|
|
|
|
.Pp
|
2002-05-29 14:11:17 +00:00
|
|
|
In order to compile in support for the
|
|
|
|
.Nm ,
|
|
|
|
you must add a line similar
|
1995-12-27 10:49:19 +00:00
|
|
|
to the following to your kernel configuration file:
|
|
|
|
.Pp
|
2002-05-29 14:11:17 +00:00
|
|
|
.Dl "device ccd # concatenated disk devices"
|
|
|
|
.Pp
|
|
|
|
As of the
|
1999-09-25 17:11:54 +00:00
|
|
|
.Fx 3.0
|
|
|
|
release, you do not need to
|
2002-05-29 14:11:17 +00:00
|
|
|
configure your kernel with
|
|
|
|
.Nm
|
|
|
|
but may instead use it as a kernel loadable
|
|
|
|
module.
|
|
|
|
Simply running
|
|
|
|
.Xr ccdconfig 8
|
1999-09-23 10:04:25 +00:00
|
|
|
will load the module into the kernel.
|
1995-12-27 10:49:19 +00:00
|
|
|
.Pp
|
|
|
|
A
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
2002-05-29 14:11:17 +00:00
|
|
|
may be either serially concatenated or interleaved.
|
|
|
|
To serially
|
1997-01-25 02:10:43 +00:00
|
|
|
concatenate the partitions, specify the interleave factor of 0.
|
1999-09-23 10:04:25 +00:00
|
|
|
Note that mirroring may not be used with an interleave factor of 0.
|
1997-01-25 02:10:43 +00:00
|
|
|
.Pp
|
|
|
|
There is a run-time utility that is used for configuring
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm Ns s .
|
1997-01-25 02:10:43 +00:00
|
|
|
See
|
|
|
|
.Xr ccdconfig 8
|
|
|
|
for more information.
|
|
|
|
.Ss The Interleave Factor
|
|
|
|
If a
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1995-12-27 10:49:19 +00:00
|
|
|
is interleaved correctly, a
|
|
|
|
.Dq striping
|
1997-01-25 02:10:43 +00:00
|
|
|
effect is achieved, which can increase sequential read/write
|
2002-05-29 14:11:17 +00:00
|
|
|
performance.
|
|
|
|
The interleave factor is expressed in units of
|
|
|
|
.Dv DEV_BSIZE
|
|
|
|
(usually 512 bytes).
|
|
|
|
For large writes, the optimum interleave factor
|
1997-01-25 02:10:43 +00:00
|
|
|
is typically the size of a track, while for large reads, it is about a
|
2000-03-02 14:54:02 +00:00
|
|
|
quarter of a track.
|
|
|
|
(Note that this changes greatly depending on the
|
2002-05-29 14:11:17 +00:00
|
|
|
number and speed of disks.)
|
|
|
|
For instance, with eight 7,200 RPM drives
|
1997-01-25 02:10:43 +00:00
|
|
|
on two Fast-Wide SCSI buses, this translates to about 128 for writes
|
2002-05-29 14:11:17 +00:00
|
|
|
and 32 for reads.
|
|
|
|
A larger interleave tends to work better when the
|
1999-09-23 10:04:25 +00:00
|
|
|
disk is taking a multitasking load by localizing the file I/O from
|
2002-05-29 14:11:17 +00:00
|
|
|
any given process onto a single disk.
|
|
|
|
You lose sequential performance when
|
2001-05-01 09:15:30 +00:00
|
|
|
you do this, but sequential performance is not usually an issue with a
|
1999-09-23 10:04:25 +00:00
|
|
|
multitasking load.
|
|
|
|
.Pp
|
|
|
|
An interleave factor must be specified when using a mirroring configuration,
|
2004-07-03 18:29:24 +00:00
|
|
|
even when you have only two disks (i.e., the layout winds up being the same
|
2002-05-29 14:11:17 +00:00
|
|
|
no matter what the interleave factor).
|
|
|
|
The interleave factor will determine
|
1999-09-23 10:04:25 +00:00
|
|
|
how I/O is broken up, however, and a value 128 or greater is recommended.
|
|
|
|
.Pp
|
2002-05-29 14:11:17 +00:00
|
|
|
.Nm
|
|
|
|
has an option for a parity disk, but does not currently implement it.
|
1995-12-27 10:49:19 +00:00
|
|
|
.Pp
|
1997-01-25 02:10:43 +00:00
|
|
|
The best performance is achieved if all component disks have the same
|
2002-05-29 14:11:17 +00:00
|
|
|
geometry and size.
|
|
|
|
Optimum striping cannot occur with different
|
1995-12-27 10:49:19 +00:00
|
|
|
disk types.
|
|
|
|
.Pp
|
1997-01-25 02:10:43 +00:00
|
|
|
For random-access oriented workloads, such as news servers, a larger
|
2002-05-29 14:11:17 +00:00
|
|
|
interleave factor (e.g., 65,536) is more desirable.
|
|
|
|
Note that there
|
|
|
|
is not much
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
2002-05-29 14:11:17 +00:00
|
|
|
can do to speed up applications that are seek-time limited.
|
|
|
|
Larger
|
1997-01-25 02:10:43 +00:00
|
|
|
interleave factors will at least reduce the chance of having to seek
|
|
|
|
two disk-heads to read one directory or a file.
|
|
|
|
.Ss Disk Mirroring
|
|
|
|
You can configure the
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1997-01-25 02:10:43 +00:00
|
|
|
to
|
|
|
|
.Dq mirror
|
2002-05-29 14:11:17 +00:00
|
|
|
any even number of disks.
|
|
|
|
See
|
1995-12-27 10:49:19 +00:00
|
|
|
.Xr ccdconfig 8
|
2002-05-29 14:11:17 +00:00
|
|
|
for how to specify the necessary flags.
|
|
|
|
For example, if you have a
|
|
|
|
.Nm
|
1999-09-23 10:04:25 +00:00
|
|
|
configuration specifying four disks, the first two disks will be mirrored with
|
2002-05-29 14:11:17 +00:00
|
|
|
the second two disks.
|
|
|
|
A write will be run to both sides of
|
|
|
|
the mirror.
|
|
|
|
A read will be run to either side of the mirror depending
|
|
|
|
on what the driver believes to be most optimal.
|
|
|
|
If the read fails,
|
1999-09-23 10:04:25 +00:00
|
|
|
the driver will automatically attempt to read the same sector from the
|
2002-05-29 14:11:17 +00:00
|
|
|
other side of the mirror.
|
|
|
|
Currently
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
2002-05-30 23:48:00 +00:00
|
|
|
uses a dual seek zone model to optimize reads for a multi-tasking load
|
2002-12-24 16:52:31 +00:00
|
|
|
rather than a sequential load.
|
1999-09-23 10:04:25 +00:00
|
|
|
.Pp
|
|
|
|
In an event of a disk
|
1997-01-25 02:10:43 +00:00
|
|
|
failure, you can use
|
|
|
|
.Xr dd 1
|
|
|
|
to recover the failed disk.
|
|
|
|
.Pp
|
|
|
|
Note that a one-disk
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
2002-05-29 14:11:17 +00:00
|
|
|
is not the same as the original partition.
|
|
|
|
In particular, this means
|
2002-12-12 17:26:04 +00:00
|
|
|
if you have a file system on a two-disk mirrored
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1997-01-25 02:10:43 +00:00
|
|
|
and one of the disks fail, you cannot mount and use the remaining
|
|
|
|
partition as itself; you have to configure it as a one-disk
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm .
|
1999-09-23 10:04:25 +00:00
|
|
|
You cannot replace a disk in a mirrored
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1999-09-23 10:04:25 +00:00
|
|
|
partition without first backing up the partition, then replacing the disk,
|
|
|
|
then restoring the partition.
|
2006-04-14 09:20:25 +00:00
|
|
|
.Ss Linux Compatibility
|
|
|
|
The
|
|
|
|
.Tn Linux
|
|
|
|
compatibility mode does not try to read the label that
|
|
|
|
.Tn Linux Ns '
|
|
|
|
.Xr md 4
|
|
|
|
driver leaves on the raw devices.
|
|
|
|
You will have to give the order
|
|
|
|
of devices and the interleave factor on your own.
|
|
|
|
When in
|
|
|
|
.Tn Linux
|
|
|
|
compatibility mode,
|
|
|
|
.Nm
|
|
|
|
will convert the interleave factor from
|
|
|
|
.Tn Linux
|
|
|
|
terminology.
|
|
|
|
That means you give the same interleave factor that you
|
|
|
|
gave as chunk size in
|
|
|
|
.Tn Linux .
|
|
|
|
.Pp
|
|
|
|
If you have a
|
|
|
|
.Tn Linux
|
|
|
|
.Xr md 4
|
|
|
|
device in
|
|
|
|
.Dq legacy
|
|
|
|
mode, do not use the
|
|
|
|
.Dv CCDF_LINUX
|
|
|
|
flag in
|
2006-04-13 20:35:31 +00:00
|
|
|
.Xr ccdconfig 8 .
|
2006-04-14 09:20:25 +00:00
|
|
|
Use the
|
|
|
|
.Dv CCDF_NO_OFFSET
|
|
|
|
flag instead.
|
|
|
|
In that case you have to convert
|
|
|
|
the interleave factor on your own, usually it is
|
|
|
|
.Tn Linux Ns '
|
|
|
|
chunk size multiplied by two.
|
2006-04-13 20:35:31 +00:00
|
|
|
.Pp
|
2006-04-14 09:20:25 +00:00
|
|
|
Using a
|
|
|
|
.Tn Linux
|
|
|
|
RAID this way is potentially dangerous and can destroy
|
|
|
|
the data in there.
|
|
|
|
Since
|
|
|
|
.Fx
|
|
|
|
does not read the label used by
|
|
|
|
.Tn Linux ,
|
|
|
|
changes in
|
|
|
|
.Tn Linux
|
|
|
|
might invalidate the compatibility layer.
|
2006-04-13 20:35:31 +00:00
|
|
|
.Pp
|
|
|
|
However, using this is reasonably safe if you test the compatibility
|
2006-04-14 09:20:25 +00:00
|
|
|
before mounting a RAID read-write for the first time.
|
|
|
|
Just using
|
|
|
|
.Xr ccdconfig 8
|
|
|
|
without mounting does not write anything to the
|
|
|
|
.Tn Linux
|
|
|
|
RAID.
|
|
|
|
Then you do a
|
|
|
|
.Nm fsck.ext2fs Pq Pa ports/sysutils/e2fsprogs
|
|
|
|
on the
|
|
|
|
.Nm
|
|
|
|
device using the
|
|
|
|
.Fl n
|
|
|
|
flag.
|
|
|
|
You can mount the file system read-only to check files in there.
|
|
|
|
If all this works, it is unlikely that there is a problem with
|
|
|
|
.Nm .
|
|
|
|
Keep in mind that even when the
|
|
|
|
.Tn Linux
|
|
|
|
compatibility mode in
|
|
|
|
.Nm
|
|
|
|
is working correctly, bugs in
|
|
|
|
.Fx Ap s
|
|
|
|
.Nm ex2fs
|
|
|
|
implementation would still destroy
|
2006-04-13 20:35:31 +00:00
|
|
|
your data.
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh WARNINGS
|
|
|
|
If just one (or more) of the disks in a
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1995-12-27 10:49:19 +00:00
|
|
|
fails, the entire
|
2002-12-12 17:26:04 +00:00
|
|
|
file system will be lost unless you are mirroring the disks.
|
1999-09-23 10:04:25 +00:00
|
|
|
.Pp
|
|
|
|
If one of the disks in a mirror is lost, you should still
|
2002-05-29 14:11:17 +00:00
|
|
|
be able to back up your data.
|
|
|
|
If a write error occurs, however, data
|
|
|
|
read from that sector may be non-deterministic.
|
|
|
|
It may return the data
|
|
|
|
prior to the write or it may return the data that was written.
|
|
|
|
When a
|
1999-09-23 10:04:25 +00:00
|
|
|
write error occurs, you should recover and regenerate the data as soon
|
|
|
|
as possible.
|
|
|
|
.Pp
|
2001-05-01 09:15:30 +00:00
|
|
|
Changing the interleave or other parameters for a
|
2000-11-20 18:41:33 +00:00
|
|
|
.Nm
|
1999-09-23 10:04:25 +00:00
|
|
|
disk usually destroys whatever data previously existed on that disk.
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh FILES
|
2001-10-01 13:04:35 +00:00
|
|
|
.Bl -tag -width ".Pa /dev/ccd*"
|
|
|
|
.It Pa /dev/ccd*
|
|
|
|
.Nm
|
|
|
|
device special files
|
|
|
|
.El
|
1995-12-27 10:49:19 +00:00
|
|
|
.Sh SEE ALSO
|
1997-01-25 02:10:43 +00:00
|
|
|
.Xr dd 1 ,
|
1995-12-27 10:49:19 +00:00
|
|
|
.Xr ccdconfig 8 ,
|
|
|
|
.Xr config 8 ,
|
1996-11-07 04:10:55 +00:00
|
|
|
.Xr disklabel 8 ,
|
1995-12-27 10:49:19 +00:00
|
|
|
.Xr fsck 8 ,
|
|
|
|
.Xr mount 8 ,
|
1999-09-23 10:04:25 +00:00
|
|
|
.Xr newfs 8 ,
|
2000-11-15 16:00:07 +00:00
|
|
|
.Xr vinum 8
|
2005-01-21 08:36:40 +00:00
|
|
|
.Sh HISTORY
|
|
|
|
The concatenated disk driver was originally written at the University of
|
|
|
|
Utah.
|