6979 Commits

Author SHA1 Message Date
gjb
7b0fefdcb1 MFC r283673, r283674:
r283673:
  Sort configuration options for consistency with other boards.

 r283674:
  Export 'BOARDNAME' when differs from the KERNCONF.

Sponsored by:	The FreeBSD Foundation
2015-06-01 16:46:51 +00:00
gjb
444aa14df4 MFC r283573, r283574, r283575, r283576, r283580, r283593, r283618:
r283573:
  Remove a continuation on error, since the relevant behavior can
  only occur if a particular file exists.

 r283574:
  Set STAGE_TARGETS only if RELEASEDIR exists.

 r283575:
  Remove duplicate exists() sanity check.

 r283576:
  Reindent after previous commit.

 r283580:
  Use SVNREVISION and BUILDDATE if passed into the make(1)
  environment, fallback to trying to figure it out otherwise.

 r283593:
  Fix a typo in a comment.

 r283618:
  Invert the build date and svn revision to match the namimg
  convention that has been in use for a while.

Sponsored by:	The FreeBSD Foundation
2015-05-29 00:46:14 +00:00
gjb
14c563db5d MFC r283307:
Use mkimg(1) to create the i386 memstick images, similar to
 how is done for amd64.  The exception here is there is no
 EFI partition for i386.

Sponsored by:	The FreeBSD Foundation
2015-05-26 00:44:29 +00:00
gjb
e8dfad8565 MFC r282785, r282787, r282789, r282790, r282791, r282792, r282793,
r282794, r282795, r282796, r282797, r282798, r282799, r283265,
r283266, r283268, r283271, r283272, r283298, r283302:

 Add a new file, Makefile.mirrors, which is intended to replace
 a 474-line kludge of a shell script to pre-create the directory
 hierarchy on ftp-master.

 This is not in any way connected to the build, and there is no
 intention to do so.  This only intent here is to try to make
 things a little bit easier.

 Always use the 'make install' directory as the source for images.
 For RE purposes, we use the default (/R within the chroot), so
 this helps avoid copying files multiple times and xz(1)-compressing
 additional times when not needed.

 Fix staging virtual machine images for ftp propagation.

 This Makefile is not for general consumption.

Sponsored by:	The FreeBSD Foundation
2015-05-25 22:12:30 +00:00
gjb
e65a83355e MFC r283252:
Include the TARGET in the EC2 AMI name.

  Without this, AWS rejects subsequent image uploads of a different
  architecture because the name conflicts.

Sponsored by:	The FreeBSD Foundation
2015-05-24 02:15:18 +00:00
gjb
b1fc2fbae9 MFC r282500, r282693:
r282500:
  Add initial support for building RPI2 images.

  In release.sh, allow overriding buildenv_setup() before
  the handoff to arm/release.sh.

  Copy arm/RPI-B.conf -> arm/RPI2.conf, set UBOOT_PORT and
  the correct KERNEL, and add the buildenv_setup() override
  to install the sysutils/u-boot-rpi2 port/package.

  Copy tools/arm/crochet-RPI-B.conf -> tools/arm/crochet-RPI2.conf,
  and set the correct entries for the RaspberryPi2 board.

 r282693:
  Merge ^/projects/release-arm-redux into ^/head.

  Of note:

  - This commit adds native FreeBSD/arm release build support without
    requiring out-of-tree utilities.

  - Part of this merge removes the WANDBOARD-{SOLO,DUAL,QUAD} kernel
    configuration files, for which the IMX6 kernel configuration file
    should be used instead.

  - The resulting images have a 'freebsd' user (password 'freebsd'),
    to allow ssh(1) access when console access is not available (VGA
    or serial).  The default 'root' user password is set to 'root'.

  - The /etc/ttys file for arm images now enable both ttyv0 and ttyu0
    by default.

Note:  The RPI2 kernel configuration does not yet exist in stable/10,
however the merge conflicts needed to be properly resolved.
Additionally, SRCBRANCH has been set to base/stable/10 in the updated
arm configuration files as part of this commit.

Sponsored by:	The FreeBSD Foundation
2015-05-20 19:32:57 +00:00
gjb
677d1a06c2 MFC r282772:
Fix virtual machine disk format creating by passing VMFORMAT
  to mkimg(1)

PR:		200068
Sponsored by:	The FreeBSD Foundation
2015-05-14 04:21:04 +00:00
gjb
577cf5c11f Document EN-15:04 and EN-15:05.
Sponsored by:	The FreeBSD Foundation
2015-05-14 04:05:34 +00:00
gjb
b48d3ee8e0 MFC r282419, r282435:
r282419:
   Add logic to detect if the net/bsdec2-image-upload port needs
   to be installed. [1]

   For the cw-ec2-portinstall and ec2ami targets, touch the
   .TARGET file after completion to prevent duplicate invocations.

   Add cw-ec2-portinstall and ec2ami to CLEANFILES.

 r282435:
   Remove a debugging line that snuck in with the previous commit.

Sponsored by:	The FreeBSD Foundation
2015-05-08 02:21:29 +00:00
gjb
d230d48285 Update the last svn rev marker.
Sponsored by:	The FreeBSD Foundation
2015-05-05 15:48:25 +00:00
gjb
7bb01dc3ba Document r282278, wc(1) race when receiving SIGINFO fixed.
Sponsored by:	The FreeBSD Foundation
2015-05-05 15:16:38 +00:00
gjb
29249492ee MFC r282148:
Fix CROCHETBRANCH.

PR:		199760
Sponsored by:	The FreeBSD Foundation
2015-05-01 00:31:40 +00:00
gjb
64b7754f6b MFC r282116:
Add the cw-ec2-portinstall target to always install the
  net/bsdec2-image-upload port.

Sponsored by:	The FreeBSD Foundation
2015-04-30 00:35:45 +00:00
gjb
759d86de96 MFC r282112:
Fix a comment.

Sponsored by:	The FreeBSD Foundation
2015-04-30 00:34:41 +00:00
gjb
b59e42fc1b Document r282199, drm update to match Linux 3.8.13.
Sponsored by:	The FreeBSD Foundation
2015-04-29 16:15:38 +00:00
gjb
9b60b8a1a9 Document r280632, kern.osreldate now configurable jail(8) parameters.
Sponsored by:	The FreeBSD Foundation
2015-04-29 16:15:36 +00:00
gjb
f319ce52d0 Document r278608, bcm2835_cpufreq driver addition.
Sponsored by:	The FreeBSD Foundation
2015-04-29 16:15:34 +00:00
gjb
309cd7e69a Document r277592, file(1) update to version 5.22.
Sponsored by:	The FreeBSD Foundation
2015-04-29 16:15:32 +00:00
gjb
28cadbdcef Document r281255, devfs(5) read/write update timestamp
precision.

Sponsored by:	The FreeBSD Foundation
2015-04-28 21:58:11 +00:00
gjb
616b358cb6 Fix a whitespace nit.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:12:10 +00:00
gjb
f0e52a9e86 Update svn revision marker.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:12:08 +00:00
gjb
b1cc027581 Document r281957, hptnr(4) driver updated to version 1.1.1.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:12:05 +00:00
gjb
e66d470bac Document r281936, disallow ar(1) directory traversal.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:12:03 +00:00
gjb
a8eeb1fd3c Document r281843, GELI passphrase prompt support in loader.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:12:01 +00:00
gjb
24c15ce528 Document r281687, ACPI update to 20150410.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:59 +00:00
gjb
b6b2438e58 Document r281161, '-R' flag added to netstat(8).
Add Limelight Networks to sponsors.ent.

Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:56 +00:00
gjb
d03ffc1ba5 Document r281075, ACPICA update to version 20150204.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:54 +00:00
gjb
9ebde01b61 Document r281044, fix directory inclusion when '--one-file-system'
is specified.

Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:51 +00:00
gjb
a5430d204e Document r280392, make sure that setmode sets errno on failure.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:49 +00:00
gjb
87b6ee8e62 Document r280370, DSM TRIM support for virtual AHCI disks.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:47 +00:00
gjb
9784d9022b Document r280304, OpenSSL update to version 1.0.1m.
Sponsored by:	The FreeBSD Foundation
2015-04-28 18:11:45 +00:00
gjb
971f2aaa6e MFC r280299, r280840, r280846, r280879, r280881, r280884, r280928,
r281783, r281809, r281832:

 r280299 (cperciva):
  When creating VM images, copy the contents of the created filesystem
  into a new filesystem before packaging it into a disk image.  This
  prevents "remnants" of deleted files from showing up in the VM images,
  and reduces their compressed size (by about 10% for the cloudware
  images) as a result.

 r280840 (cperciva):
  Clean up filesystem unmounting in vmimage builds:
  - Remove vm_umount_base function which is currently unused.
  - Add umount_loop function which loops attempting to unmount one
    filesystem.
  - Replace calls to umount with calls to umount_loop.
  - Don't attempt to unmount ${DESTDIR}/dev if it isn't mounted.

  The looping is necessary because sometimes umount fails due to
  filesystems being busy.  The most common cause of such busyness is
  periodic(8) jobs running `find / ...`.

 r280846 (cperciva):
  Improve check for whether ${DESTDIR}/dev is mounted.

 r280879 (cperciva):
  Add bits for building EC2 disk images.

 r280881 (cperciva):
  Partially revert r278118 now that the required logic for deciding
  whether freebsd-update can be useful has moved into the
  firstboot_freebsd_update script.

 r280884 (cperciva):
  Fix pkg(8) command line in vm_extra_pre_umount().

 r280928 (cperciva):
  Add code for creating an EC2 AMI.

 r281783:
  When building VM disk images, vm_copy_base() uses tar(1) to copy
  the userland from one md(4)-mounted filesystem to a clean filesystem
  to prevent remnants of files that were added and removed from
  resulting in an unclean filesystem.  When newfs(8) creates the first
  filesystem with journaled soft-updates enabled, the /.sujournal file
  in the new filesystem cannot be overwritten by the /.sujournal in the
  original filesystem.

  To avoid this particular error case, do not enable journaled
  soft-updates when creating the md(4)-backed filesystems, and instead
  use tunefs(8) to enable journaled soft-updates after the new
  filesystem is populated in vm_copy_base().

  While here, fix a long standing bug where the build environment /boot
  files were used by mkimg(1) when creating the VM disk images by using
  the files in .OBJDIR.

 r281809:
  Simplify variable expansion in attempt to fix the vm-image build.

 r281832:
  Fix locating the /boot files.

Sponsored by:	The FreeBSD Foundation
2015-04-27 19:41:40 +00:00
gjb
5a1ef38103 Document SA-15:07, SA-15:08, SA-15:09.
Sponsored by:	The FreeBSD Foundation
2015-04-21 16:54:21 +00:00
gjb
fc210ded1f MFC r280861:
s/AutoSize/Growfs/ following upstream commit r761.

Sponsored by:	The FreeBSD Foundation
2015-04-08 22:02:15 +00:00
gjb
f771564270 Document removal of 10.1-RELEASE QCOW2 virtual machine disk
images from FTP, due to a crash-on-boot problem.

Requested by:	jhb (months ago), bapt (recently)
Approved by:	re (implicit)
Sponsored by:	The FreeBSD Foundation
2015-04-01 04:58:08 +00:00
gjb
92d4896ada MFC r280640:
Crochet sources moved to a new home; update accordingly.

Sponsored by:	The FreeBSD Foundation
2015-03-28 05:11:16 +00:00
gjb
024d3d32c2 Document SA-15:06.
Sponsored by:	The FreeBSD Foundation
2015-03-25 17:58:44 +00:00
gjb
8de40d0193 MFC r279249, r279250, r279257:
r279249:
  Add 'cloudware-install' target to handle copying cloud
  disk images to a directory within DESTDIR.

  Add CLOUDINSTALL variable to automatically generate the
  actual list of install targets.  While here, rename the
  cloud-specific names from 'vm-' to 'cw-' to avoid naming
  collisions.

  Add AZURE_DISK, GCE_DISK, and OPENSTACK_DISK output file
  variables.

  Add 'cloudware-install' to the 'install' target.

 r279250:
  Remove a stale comment.

 r279257:
  Add a CLOUDPACKAGE variable to contain a list of targets for
  post-install packaging cloud provider images.

  Add a 'gce-package.sh' script to generate the final output
  image ready for upload to the GCE platform.  Right now, this
  is the only image that has a specific output format (GNU-tar),
  and this implementation is expected to be temporary.

  This is not directly connected to the other release targets.

Sponsored by:	The FreeBSD Foundation
2015-03-03 02:46:59 +00:00
gjb
30ef228521 Document FreeBSD-EN-15:01.vt, FreeBSD-EN-15:02.openssl,
FreeBSD-EN-15:03.freebsd-update, FreeBSD-SA-15:04.igmp,
FreeBSD-SA-15:05.bind

Sponsored by:	The FreeBSD Foundation
2015-02-25 16:36:44 +00:00
gjb
af525877d1 Update commented last revision.
Sponsored by:	The FreeBSD Foundation
2015-02-20 20:33:43 +00:00
gjb
d7fe3fe354 Add 'Generic Storage' section.
Document r279002, r279055:
 ctld(8) update to control non-iSCSI CTL ports
 CTL LUN mapping rewrite

Sponsored by:	The FreeBSD Foundation
2015-02-20 20:30:04 +00:00
gjb
b60421a369 Document r277583, arc_meta_limit exposed via kstats.
Sponsored by:	The FreeBSD Foundation
2015-02-20 20:30:01 +00:00
gjb
31503f4494 Document r277434, fstyp(8) addition.
Sponsored by:	The FreeBSD Foundation
2015-02-20 20:29:59 +00:00
gjb
63bb400ac7 Document r278982, pmc callchain depths increased.
Sponsored by:	The FreeBSD Foundation
2015-02-20 18:06:33 +00:00
gjb
92782b6e3e MFC r277458, r277536, r277606, r277609, r277836, r277839,
r278118, r278119, r278206, r278502:

 r277458:
  Move virtual machine / cloud provider targets and
  options from release/Makefile to their own Makefile.

  Add glue to allow enabling building cloud provider VM images
  by default.

  Add a 'vm-cloudware' target, used to drive all targets in
  CLOUDTARGETS.

  Add examples for WITH_CLOUDWARE to release.conf.sample.
  Add WITH_CLOUDWARE evaluation to RELEASE_RMAKEFLAGS.

  Rewrite to consolidate VM image build scripts into one.

  Fix duplicated mkimg(1) call in vm_create_disk().

  Add primitive (untested) PowerPC/PowerPC64 VM image support.

  Note: As it is currently written, the /boot/pmbr and
  /boot/{gptboot,boot1.hfs} use the build host and not the
  target build.  Fixing this is likely going to be a hack in
  itself.

  mount(8) and umount(8) devfs(5) as needed.

  Change path for mk-vmimage.sh from ${TARGET}/ to scripts/ now that
  it is consolidated into one file.

  Fix paths for the base image and output disk image files.

  Set the boot partition type to 'apple-boot' for powerpc.

  In vm_install_base(), copy the host resolv.conf into the build
  chroot before attempting to do anything that requires working DNS
  (i.e., pkg bootstrap).

  In vm_extra_pre_umount(), remove the resolv.conf before the disk
  image is unmounted from the backing md(4).

  Silence errors when umounting the chroot's /dev, since it probably
  doesn't exist when we're running this.

  Unmount filesystems before attempting to destroy the md which
  holds them.

  Unmount filesystem and destroy md before we read the vnode from
  disk and package it into a disk image.  Otherwise we end up
  packaging an unclean filesystem.

  Merge duplicative vm-CLOUDTYPE targets before additional duplication
  gets added by the impending arrival of ec2 and gcloud.

  Add NOSWAP option which can be set by a vmimage.conf file to specify
  that no swap space should be created in the image.  This will be used
  by EC2 builds, since FreeBSD/EC2 allocates swap space on "ephemeral"
  disks which are physically attached to the Xen host node.

  In vm_extra_install_packages(), only bootstrap pkg(8) if
  VM_EXTRA_PACKAGES is empty.

  In vm_extra_pre_umount(), cleanup downloaded packages if pkg(8) was
  bootstrapped earlier.

  In vm_extra_install_base(), do not install waagent in the openstack
  image, because it is not used.  This appears to be a copy mistake.

  Remove vm_extra_install_base() from the openstack.conf entirely,
  since it does not need to be overridden.

  Enable password-less sudo for openstack images.

  Update the VM_EXTRA_PACKAGES list for the openstack images.

  Remove vm_extra_install_base() for the Azure image, now that the
  waagent exists in the ports tree.

  Add sysutils/azure-agent to the VM_EXTRA_PACKAGES list.

  In vm_extra_pre_umount(), remove the explicit pkg(8) install
  list, as dependencies are resolved by sysutils/azure-agent.

  Add a 'list-cloudware' target to print the list of supported CLOUDWARE
  values and a description.

  Add the AZURE_DESC and OPENSTACK_DESC descriptions.

  Update release(7)

  Add 'list-vmtargets' target, which produces a list of all supported
  VM and cloud provider images.

  Add VHD_DESC, VMDK_DESC, QCOW2_DESC, RAW_DESC image descriptions.

  Update release(7) to document the list-vmtargets target.

  Add initial support for the GCE (Google Compute Engine) cloud hosting
  provider image.

  Remove the console setting from rc.conf(5), which is not used there.
  While here, set console to include vidconsole in the loader.conf(5).

  Remove the pkg-clean(8) call from vm_extra_pre_umount() since the
  function is often overridden.

  Add vm_extra_pkg_rmcache() to call pkg-clean(8) to avoid duplicated
  code.

  Move resolv.conf(5) removal back to vm_extra_pre_umount() where it
  belongs.

  The GCE image needs resolv.conf(5) to exist (created as part of the
  image setup), so it cannot be removed.

  Comment the line that configures ttys(5) to 'off', which makes it
  impossible to test that the image boots.

  Add a note explaining why the line is commented, and not (yet) removed
  entirely.

  Move the 'install' bits that are specific to virtual machine images
  from the Makefile to Makefile.vm.

  Rename the 'install' target to 'release-install', and add a new
  'vm-install' target.

  Add a new 'install' target that invokes the new targets.

  Add WITH_CLOUDWARE to the list of make(1) variables for the release
  build.

  Remove hw.vga.textmode=1 from the VM image loader.conf, which was
  included during test builds and not intended to be included when
  merging this project branch back to head.

  Remove mk-azure.sh, which is no longer needed.

 r277536:
  Rename the 'release' target to 'real-release', and add two targets,
  'vm-release' and 'cloudware-release', that are invoked if
  WITH_VMIMAGES and WITH_CLOUDWARE are not empty.

  This fixes an issue where 'make release' would not build the cloud
  provider targets because CLOUDWARE was not yet set.

  Move the WITH_VMIMAGES and WITH_CLOUDWARE targets to Makefile.vm.

  Note: There is no 'cloudware-install' target yet, since some of the
  disk image names may need to be specific to the provider, so this is
  probably best handled by the build scripts.

 r277606:
  Provide a recipe of "true" for building the "release" target once
  its prerequisites are satisfied, in order to avoid having an implicit
  rule triggered by the presence of release.sh.

 r277609:
  When iterating through VMFORMATS, the VMBASE file is not removed
  or truncated to a zero-size file, which if used to create more
  than one disk image format, can result in accidental pollution of
  the target formatted disk image.

  Instead of using a single VMBASE image (vm.img, by default), use
  a single base file for each format, named as VMFORMAT.img, which
  produces VMBASE.VMFORMAT as the final formatted image.

 r277836:
  Rename the 'system' target to 'disc1', which is specific to the
  disc1.iso installer image.

  Replace 'system' with 'release' in CLEANFILES, and add 'disc1'
  to CLEANDIRS.

  Ensure the 'dvd' target depends on 'packagesystem'.

  Fix 'mini-memstick.img' prerequisite, which should be the 'bootonly'
  target, not 'disc1' (previously 'system').

  Use .TARGET as the target installation directory for the disc1.iso
  and bootonly.iso images, which now expand to 'disc1' and 'bootonly'
  respectively, mimicking the behavior of the 'dvd' target.

  Remove '@true' from the 'release' target, and instead use
  'touch ${.TARGET}' to prevent multiple iterations of
  'make release' from clobbering previously-built installer
  medium.

 r277839:
  Update release(7) to reflect renaming the 'system' target to 'disc1'.

 r278118:
  Move service_enable="YES" rc.conf(5) additions to VM_RC_LIST and
  deduplicate.

  Evaluate if firstboot_freebsd_update should be enabled based on
  UNAME_r, because it is not supported for the -CURRENT or -STABLE
  branches.

 r278119:
  Use ifconfig_DEFAULT="" instead of hard-coding vtnet(4)

 r278206:
  Bump copyright after r277458.

 r278502:
  In scripts/mk-vmimage.sh, prevent incorrect usage() by defaulting
  VMCONFIG to /dev/null, and additionally ensuring VMCONFIG is not
  a character device before it is sourced.

  While here, be sure to exit if usage() is called.

  This should effectively be no-op, but the usage() output was
  discovered while investigating a larger issue.

* Several changes local to stable/10 were needed in order to handle
  UEFI images that are specific to this branch.

Tested with:	stable/10@r278906
Sponsored by:	The FreeBSD Foundation
2015-02-19 03:57:47 +00:00
gjb
99687cf094 Document a failure case when using freebsd-update
to upgrade systems that use nss_ldap.

Sponsored by:	The FreeBSD Foundation
2015-02-06 19:44:26 +00:00
gjb
8800e37bec Reapply 'Open Issues' to the 10.1-RELEASE errata page,
which was only added to releng/10.1, not stable/10.

Sponsored by:	The FreeBSD Foundation
2015-02-05 16:31:49 +00:00
gjb
47d966effe Apply r278265 from head:
Security Advisory information is included on several
pages in the release notes.  Rather than duplicating
the information between various files, add two new
files to include in all pages that currently display
the information.

Sponsored by:	The FreeBSD Foundation
2015-02-05 16:28:18 +00:00
gjb
8599898fbb Add an entity to use to link to SAs and ENs.
Update the Security Advisories and Errata Notices
section to use the new entity.
Prefer https:// for other URLs.

Sponsored by:	The FreeBSD Foundation
2015-02-05 14:12:05 +00:00
gjb
35b84cbc9e Fill in the Security Advisories and Errata Notices sections.
Sponsored by:	The FreeBSD Foundation
2015-02-05 13:53:31 +00:00