CVS log for src/distrib/sets/sets.subr

Up to [cvs.NetBSD.org] / src / distrib / sets

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

sets.subr: Ensure compat32arches is defined too.

We don't run with `set -eu', but maybe we should and this will reduce
the effort to flip that on.

sets.subr: riscv 32-bit ABI is called `rv32', not `riscv32'.

Revert the duplication of compat set lists; do it another way.

1. Restore the compatdir and compatfile tags in base and debug.

   => compatdir marks directories that should have per-ABI compat
      subdirectories, like /usr/lib having /usr/lib/o32 and
      /usr/lib/64 on mips64.

   => compatfile marks files that have per-ABI versions in the
      nearest compatdir, like /usr/lib/o32/libc.so.12.221.

   This is the mechanism we use to avoid duplicating every library
   that has a compat version in multiple set lists.

2. Teach sets.subr to split the compatdir and compatfile entries out
   into separate sets for base and debug.

   The mechanism is to internally use:

   - a new tag `omitcompat' when processing base and debug, so we
     don't generate the per-ABI compat directories or per-ABI compat
     files under them;

   - a new tag `takecompat=${ABI}' when processing base32/64 and
     debug32/64, so we _do_ generate the per-ABI compat directories
     for ${ABI}.

     => On, e.g., mips64, base32 uses `takecompat=o32' and base64
        uses `takecompat=64'.

     => On, e.g., aarch64, base32 uses
        `takecompat=eabi,takecompat=eabihf', and there is no base64.

3. Record in sets.subr the list of `32' and `64' architectures for
   each port.

   This is maybe not the right place to put it, but it's also not
   clear that we want to keep exactly this division -- maybe it would
   be more sensible to just have per-ABI , e.g.:

   (aarch64) base-eabi, base-eabihf
   (amd64) base-i386
   (mips64) base-o32, base-64
   (mipsn64) base-o32, base-n32

   But I'll leave cleaning that up for another day.

4. Adjust some sets.  Mostly this commit shouldn't change what file
   go in what sets, but, e.g., on mips64, the following move from
   base32 to base64 as part of this change, which I think is
   appropriate:

   - /lib/64
   - /libexec/ld.elf_so-64
   - /usr/lib/64
   - /usr/libdata/debug/lib/64
   - /usr/libdata/debug/usr/lib/64
   - /usr/libexec/ld.elf_so-64

TBD: Remove ./lib and ./usr/lib from debug/mi; they're already in
base/mi.  Maybe move ./usr/libdata/debug to from base/mi to debug/mi.

This reverts most of the set list changes in:

https://mail-index.netbsd.org/source-changes/2024/04/09/msg150763.html

PR misc/58365

Move MIPS N64 compat out of {base,debug}32 into {base,debug}64

martin requested separation by ABI and it doesn't make much sense
to have 64-bit binaries in a set called 32.

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
  compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
  containing debug symbols for 32-bit compatiblity, previously included
  in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
  in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

distrib/sets/sets.subr: fix typo in comment

distrib/sets/sets.subr: remove trailing whitespace

Deprecate extsrc/, EXTSRCSRCDIR, MKEXTSRC

Remove support for building extsrc/:
1. Makefile: remove do-extsrc target.
2. build.sh: remove options -y and -Y extsrcdir.
3. distrib/sets: remove support for extsrc in various tools
   including the options -L ext and -y, and the extsrc sets.
4. doc/BUILDING.mdoc: remove docs for extsrc/, EXTSRCSRCDIR, MKEXTSRC (etc)
5. bsd.own.mk and various Makefiles: remove support for extsrc/,
   EXTSRCSRCDIR, MKEXTSRC.

As proposed on tech-kern and tech-userlevel on 2022-01-07
and followed up on 2022-08-21.

forgot one @CONFIG@

change CONFIG to @CONFIG@ to indicate substitution is going to happen.

don't match the empty pattern

Enable split-debug files for kernels. Enabled by default with MKDEBUG=yes.

Restore MKNOUVEAUFIRMWARE and MKRADEONFIRMWARE and make gpufw set unconditional

Simplifies logic.
Restoring MK* requested by mrg on tech-kern discussion
https://mail-index.netbsd.org/tech-kern/2021/09/25/msg027695.html

Move DRM-driver firmware from base to its own set, gpufw

This set is only installed on amd64,i386,evbarm.
This set is installed on minimal installs and on install media, in
case someone needs it for basic driver functionality.

Comments:
Switched to a single MK tunable for it - that is probably unneeded.

An upcoming DRM update will include even fatter firmware, and we'd
like to minimize the impact of it.

Reintroduce the support of MKCATPAGES

Requested by <mrg>

Remove the support for MKCATPAGES

It was optional since 1999 and disabled by default since 2012.

Proposed on tech-userlevel@.

Add HAVE_NVMM and use it to control the build of NVMM related components.
Defined to "yes" on amd64, "no" everywhere else.

Add HAVE_ACPI and HAVE_UEFI flags to bsd.own.mk and use them to
conditionally include ACPI and UEFI bits instead of relying on adhoc
MACHINE_ARCH tests.

Separate devicetree .dts -> .dtb building from kernel builds. They are now
part of a separate set, "dtb.tgz", and only built when MKDTB=yes. This
defaults to yes for earmv[67]* and aarch64, and no everywhere else.

Add support for debugging modules for multi-arch (xen etc.)

add more module sets.

Mostly merge changes from HEAD upto 20200411

Merge changes from current as of 20200406

Infrastructure for putting kernel+modules in /netbsd/kernel and
/netbsd/modules respectively instead of /netbsd and
/stand/<arch>/<version>/modules.  This is only supported for x86,
and is turned off by default. To try it, add KERNEL_DIR=yes in your
/mk.conf and install a system from that build.

Pull up following revision(s) (requested by maya in ticket #435):

	distrib/sets/maketars: revision 1.90
	usr.sbin/sysinst/arch/playstation2/md.h: revision 1.2
	usr.sbin/sysinst/arch/sandpoint/md.h: revision 1.3
	usr.sbin/sysinst/arch/evbppc/md.h: revision 1.3
	usr.sbin/sysinst/arch/hpcarm/md.h: revision 1.3
	usr.sbin/sysinst/arch/mvme68k/md.h: revision 1.3
	distrib/sun3/MakeInstTape: revision 1.3
	usr.sbin/sysinst/util.c: revision 1.33
	distrib/sets/lists/rescue/mi: revision 1.1
	distrib/sets/lists/base/rescue.sun2: file removal
	usr.sbin/sysinst/arch/zaurus/md.h: revision 1.3
	distrib/sets/lists/base/rescue.ad.m68k.shl: file removal
	distrib/sets/regpkgset: revision 1.13
	usr.sbin/sysinst/arch/i386/md.h: revision 1.7
	distrib/sets/lists/base/rescue.sparc: file removal
	distrib/notes/mvme68k/xfer: revision 1.19
	distrib/sets/sets.subr: revision 1.187
	distrib/common/bootimage/Makefile.bootimage: revision 1.22
	usr.sbin/sysinst/msg.mi.de: revision 1.16
	usr.sbin/sysinst/arch/atari/md.h: revision 1.3
	rescue/Makefile: revision 1.38
	distrib/sets/lists/base/rescue.macppc: file removal
	usr.sbin/sysinst/arch/arc/md.h: revision 1.4
	distrib/miniroot/install.sub: revision 1.49
	usr.sbin/sysinst/arch/acorn32/md.h: revision 1.3
	usr.sbin/sysinst/arch/x68k/md.h: revision 1.3
	usr.sbin/sysinst/arch/hpcmips/md.h: revision 1.3
	usr.sbin/sysinst/arch/bebox/md.h: revision 1.3
	usr.sbin/sysinst/arch/hpcsh/md.h: revision 1.2
	distrib/sets/lists/base/rescue.shark: file removal
	usr.sbin/sysinst/arch/emips/md.h: revision 1.5
	distrib/utils/embedded/mkimage: revision 1.70
	usr.sbin/sysinst/arch/shark/md.h: revision 1.3
	usr.sbin/sysinst/arch/pmax/md.h: revision 1.4
	usr.sbin/sysinst/arch/amiga/md.h: revision 1.4
	usr.sbin/sysinst/arch/hp300/md.h: revision 1.5
	rescue/list.ldconfig: file removal
	distrib/sets/lists/base/rescue.ad.m68k: file removal
	usr.sbin/sysinst/arch/prep/md.h: revision 1.4
	usr.sbin/sysinst/arch/cats/md.h: revision 1.4
	usr.sbin/sysinst/arch/amd64/md.h: revision 1.7
	usr.sbin/sysinst/msg.mi.es: revision 1.17
	usr.sbin/sysinst/msg.mi.fr: revision 1.20
	usr.sbin/sysinst/msg.mi.pl: revision 1.23
	distrib/sets/lists/base/rescue.i386: file removal
	usr.sbin/sysinst/arch/evbarm/md.h: revision 1.3
	distrib/sets/lists/base/rescue.vax: file removal
	distrib/amd64/uefi-installimage/Makefile.bootimage: revision 1.12
	usr.sbin/sysinst/arch/evbmips/md.h: revision 1.3
	distrib/sets/lists/base/rescue.mi: file removal
	distrib/sets/README: revision 1.14
	usr.sbin/sysinst/arch/sgimips/md.h: revision 1.4
	distrib/sets/lists/base/rescue.sparc64: file removal
	distrib/sets/lists/base/rescue.mi: revision 1.45
	distrib/sets/lists/base/rescue.mi: revision 1.46
	usr.sbin/sysinst/arch/ofppc/md.h: revision 1.4
	usr.sbin/sysinst/arch/cobalt/md.h: revision 1.4
	distrib/sets/lists/base/rescue.ad.arm: file removal
	distrib/sets/lists/base/rescue.mac68k: file removal
	usr.sbin/sysinst/defs.h: revision 1.45
	usr.sbin/sysinst/arch/landisk/md.h: revision 1.2
	distrib/notes/atari/xfer: revision 1.17
	etc/Makefile: revision 1.441
	usr.sbin/sysinst/msg.mi.en: revision 1.22
	distrib/sun2/MakeInstTape: revision 1.2

Remove ldconfig from /rescue, and mark it MI obsolete.
- ldconfig in netbsd refers to a.out binaries only. We've been ELF-only
  since NetBSD 2.0 or so, and having it in /rescue served little purpose
  even before that, as /rescue is standalone.
- Using MI obsolete to avoid the need for MD set lists where ldconfig
  is the sole entry

Mark /rescue/edlabel as MI-obsolete, so we can remove all remaining MD
rescue set list files.

Split out /rescue to its own set and adapt installers/images to add it.

This is meant to make updates safer: if something goes wrong with updating
base, we still have the old, standalone /rescue to recover from.

Split out /rescue to its own set and adapt installers/images to add it.

This is meant to make updates safer: if something goes wrong with updating
base, we still have the old, standalone /rescue to recover from.

Sync with HEAD

enable EGL and glamor.  partly from maya@.

for x86 and evbarm:
- install headers and libEGL
- install xorg-server glamoregl component
- link xorg drivers against gbm/egl

bonus fix:
- fix some wrongly marked compatx11file files


build tested on shark, sgimips, evbarm64-el, amd64 and i386.
run tested on radeon, intel and nvidia on amd64, including
'modesetting' driver on amd64.  however, my systems disable
it due to llvmpipe so i'm not sure what is happening.

convert make's HAVE_MESA_VER into mesa_ver for set lists

Sync with HEAD, resolve some conflicts

Pull up following revision(s) (requested by nakayama in ticket #747):

	distrib/sets/sets.subr: revision 1.184

Handle compatdir first whether making obsolete lists or not, to
make obsolete lists including compat directory (eg. ./usr/lib/i386)
properly.

Handle compatdir first whether making obsolete lists or not, to
make obsolete lists including compat directory (eg. ./usr/lib/i386)
properly.

add openssl to the list of selectable variables for sets and fix the sets.

When we ask make about MACHINE_CPU and TARGET_ENDIANNESS make sure we
use the right bsd.*.mk files.

Ignore MAKEFLAGS for snippet makefiles.
(more important than MAKEVERBOSE probably.)

Ignore MAKEVERBOSE for snippet makefiles.

Sync with HEAD

Sync with HEAD

Document sets programmatically instead of keeping a list that constantly is
out of date.

xorg_server_ver doesn't depend upon xorg_server though it probably could.
fixes build isses with header files being missing.

XXX: with no server, they shouldn't be useful, so fix this properly by
not installing them once it is verified to work properly.

support xorg_server_ver define, currently settable to 110 (1.10.x)
or 118 (1.18.x).

Give up and use TOOL_SED again.

Fix SED issue differently.

document CTF

remove the xfree86 reachover makefiles and the vast majority of
the support in the rest of the source tree.

X11 sets could use some cleaning up perhaps (just deletion, as
we've never really marked the old X11R6 as obsolete for native
xorg using platforms so far either.)

Add nocompatmodules keyword to stop the expanding of a kmod to compatmodules.
Use for compat_netbsd32 on mips

Need debug sets if ${MKDEBUGLIB} != "no"

Add MKCOMPATX11 knob for making X11 compat libraries.

add pigzgzip to comment

Don't add duplicate compat paths

Fix spurious wantedness of compat, compattests, kmod, and compatmodules
keywords.  Be more consistent in names.

Rework a little.  test MKCOMPATMODULES for KMOD entry autogeneration.

Using archdirs.mk in compat, automagically generate compat entries for
files tagged with compatfile relative to directories tagged with compatdir.
This also applies to compattestsdirs and compattestsfile when
MKCOMPAT != "no" and MKCOMPATTESTS != "no".
Using archdirs.mk in sys/modules/arch, set list entries are automatically
create for all the other defined variants in ARCHDIR_SUBDIR (if any).
This should cut down on set lists getting out-of-sync a lot.

Build both xf86-video-radeon drivers for amd64 and i386, just build the
old one for other ports.

Pull up following revision(s) (requested by mrg in ticket #575):
	distrib/sets/mkvars.mk: revision 1.16
	distrib/sets/sets.subr: revision 1.163
	distrib/sets/lists/xdebug/md.amd64: revision 1.11
	distrib/sets/lists/xdebug/md.i386: revision 1.12
	distrib/sets/lists/xserver/md.amd64: revision 1.76
	distrib/sets/lists/xserver/md.i386: revision 1.95
	external/mit/xorg/server/drivers/Makefile: revision 1.64
	external/mit/xorg/server/drivers/xf86-video-radeon-kms/Makefile: revision 1.1
	share/mk/bsd.README: revision 1.338
	share/mk/bsd.own.mk: revision 1.844
add build framework to choose between xf86-video-ati 6.x (UMS/KMS)
and 7.x (KMS only), and switch x86 to the latest (KMS only) version.
(if someone can make x86 install both radeon_drv.so.[67] and leave
the default symlink to .7, that would be nice.  renaming it so that
it's easier to choose via xorg.conf is a little more tricky..)

Pull up following revision(s) (requested by mrg in ticket #559):
	distrib/sets/lists/xdebug/md.amd64: revision 1.10
	distrib/sets/lists/xdebug/md.i386: revision 1.11
	distrib/sets/lists/xdebug/shl.mi: revision 1.18 via patch
	distrib/sets/lists/xserver/md.amd64: revision 1.75
	distrib/sets/lists/xserver/md.i386: revision 1.94
	distrib/sets/lists/xserver/mi: revision 1.35
	distrib/sets/sets.subr: revision 1.162
	external/mit/xorg/lib/Makefile: revision 1.31
	external/mit/xorg/lib/dri7/Makefile: revision 1.1
	external/mit/xorg/lib/dri7/dri.mk: revision 1.1
	external/mit/xorg/lib/dri7/libglsl7.mk: revision 1.1
	external/mit/xorg/lib/dri7/libmesa/Makefile: revision 1.1
	external/mit/xorg/lib/dri7/libmesa7.mk: revision 1.1
	external/mit/xorg/lib/dri7/r300/Makefile: revision 1.1
	share/mk/bsd.own.mk: revision 1.841
sets.subr: support machine=<xxx>, machine_arch=<xxx>, machine_cpu=<xxx> tags.
dri7: build Mesa 7 r300_dri.so for x86 platforms.

add build framework to choose between xf86-video-ati 6.x (UMS/KMS)
and 7.x (KMS only), and switch x86 to the latest (KMS only) version.

(if someone can make x86 install both radeon_drv.so.[67] and leave
the default symlink to .7, that would be nice.  renaming it so that
it's easier to choose via xorg.conf is a little more tricky..)

sets.subr:
	support machine=<xxx>, machine_arch=<xxx>, machine_cpu=<xxx> tags.

dri7: build Mesa 7 r300_dri.so for x86 platforms.

List missing compatmodules keyword in the comment.

Rebase to HEAD as of a few days ago.

sync with head.

for a reference, the tree before this commit was tagged
as yamt-pagecache-tag8.

this commit was splitted into small chunks to avoid
a limitation of cvs.  ("Protocol error: too many arguments")

Update for libgcc->libgcc_eh change.

HAVE_GDB can trigger a false positive if MKGDB=no so add a check for it
like we do for HAVE_GCC.

Adjust trigger variable for unwind.h to follow changes in libc.

Mark all _pic.a archive files with the 'picinstall' flag.

This fixes checkflist with MKPICINSTALL=no.

ok christos@.

Rename USE_LIBGCC to HAVE_LIBGCC and retry using it as flag on unwind.h.

Invert logic to try to fix the !clang case.

Include compiler-rt and libunwind in libc for Clang/x86 builds.

Hook up initial build infrastructure for LLDB. Update LLVM/Clang
snapshot to r191390 for some required changed. Re-enable static analyzer
in Clang.

Add conditional entry for lld.

resync from head

rename (new) xorg_drivers to xorg_server -- platforms that build the
actual Xorg server (aka "xfree86 server").

move the list of these platforms from xorg-server/Makefile.common to
bsd.own.mk, so that we can access it easily in distrib.

this should fix most of the current build failures.

add support for MKXORG_DRIVERS/xorg_drivers keyword, and use it to
mark the xf86-input-mouse files not all platforms use.

The "gcc" keyword in the set lists is used both as boolean and as list
filter. Skip the HAVE_GCC variables when adding it as boolean, so that
MKGCC=no actually skips the "gcc" entries.

Explicitly make MKSOFTFLOAT a mkvar.
Add support for endian={1234,4321}
Add EABI flag for ARM.

Introduce MKLIBSTDCXX, defaulting to yes.

Add build glue for libc++.

Add infrastructure for building MCLinker.

resync with head

Add the MKKYUA knob.

MKKYUA defaults to no and will remain as such until the import is complete
and validated.

This knob does not currently have any effects on the build as nothing relies
on it yet.  Upcoming imports and changes in this area will all be guarded by
this flag.

Follow the change from HAS_SSP to HAVE_SSP.

sync with head

- add xdebug set
- document debug better
- fix previous debug fallout.

Add a new "debug" set that gets built when ${MKDEBUG} is set. On evbarm:
-rw-r--r--  1 root  src   35806068 Jan 16 10:47 base.tgz
-rw-r--r--  1 root  src   57374069 Jan 16 10:48 comp.tgz
-rw-r--r--  1 root  src  101286193 Jan 16 10:49 debug.tgz
...
This allows always building the debugging code and libraries but not
installing it (although now it is placed in the default sets if ${MKDEBUG}
is set

sync with (a bit old) head

Resync to 2012-11-19 00:00:00 UTC

Document sljit.

add TPM sets.

sync with netbsd-6-0-RELEASE.

sync with head

Pull up following revision(s) (requested by spz in ticket #557):
distrib/sets/lists/base/ad.mips64eb		1.94-1.95 via patch
distrib/sets/lists/base/ad.mips64el		1.93-1.94 via patch
distrib/sets/lists/base/md.amd64		1.169-1.170 via patch
distrib/sets/lists/base/md.sparc64		1.159-1.160 via patch
distrib/sets/lists/base/shl.mi			1.629,1.630,1.632 via patch
distrib/sets/lists/comp/ad.mips64eb		1.81-1.82 via patch
distrib/sets/lists/comp/ad.mips64el		1.821.83 via patch
distrib/sets/lists/comp/md.amd64		1.168-1.169 via patch
distrib/sets/lists/comp/md.sparc64		1.150-1.151 via patch
distrib/sets/lists/comp/mi			1.1769 via patch
distrib/sets/lists/comp/shl.mi			1.226-1.227 via patch
distrib/sets/lists/tests/mi			1.477 via patch
distrib/sets/sets.subr				1.137 via patch
etc/Makefile					1.397 via patch
share/man/man5/mk.conf.5			1.60 via patch
share/mk/bsd.README				1.297 via patch
share/mk/bsd.own.mk				1.700 via patch
tests/crypto/libcrypto/Makefile			patch
tests/crypto/libcrypto/t_ciphers.sh		1.4 via patch
tests/crypto/libcrypto/t_hashes.sh		1.2 via patch
tests/crypto/libcrypto/idea/Makefile		patch
tests/crypto/libcrypto/mdc2/Makefile		patch
usr.sbin/racoon/Makefile			1.25 via patch

	Clean up MKCRYPTO_IDEA and MKCRYPTO_MDC2 removal, so that
	a tree with MKCRYPTO_RC5=yes actually builds.
	[spz, ticket #557]

The "iso" directory never made it into this file, but now
that "iso" is "images", document it here for the edification of
folks browsing the download directories.
add crypto shared libraries
mark idea and mdc2 libraries obsolete.
remove mdc2 and idea handling
MKCRYPTO_{IDEA,MDC2} is no more
MKCRYPTO_IDEA is no more
no more CRYPTO_{IDEA,MDC2}
more MKCRYPTO_IDEA and MKCRYPTO_MDC2 removal (resp, adjustment to IDEA and
MBC2 now always being included)
MKCRYPTO_RC5 now builds shared libs, add the missing files to sets

adjust for MKRUMP = no

more MKCRYPTO_IDEA and MKCRYPTO_MDC2 removal (resp, adjustment to IDEA and
MBC2 now always being included)
MKCRYPTO_RC5 now builds shared libs, add the missing files to sets

sync with head

Pull up following revision(s) (requested by christos in ticket #6):
	distrib/sets/sets.subr: revision 1.136
	share/mk/bsd.kmodule.mk: revision 1.34
	sys/conf/osrelease.sh: revision 1.122
Add new -k (for kernel modules) flag to return MM.99.pp for current and MM.mm
for the release branch.
use osrelease -k to avoid that the path is 6.0_BETA
use osrelease.sh -k instead of hand-rolled logic.

use osrelease.sh -k instead of hand-rolled logic.

Import the new apropos/whatis.

This code has been developed by Abhinav Upadhyay as part of Google's Summer
of Code 2011. It uses libmandoc to parse man pages and builds a Full
Text Index in a SQLite database. The combination of indexing the full
manual page, filtering out stop words and ranking individual matches
based on the section gives a much improved user experience.

The old makewhatis and friends are kept under MKMAKEMANDB=no for now.

Fix support for negative keywords: the keyword is prefixed directly with
! without space, so that the splitting works as expected. Adjust entries
for bsdgrep.

Back out ticket #1681 - needs to be rethought, was causing build failures.

Back out ticket #1681 - needs to be rethought, was causing build failures.

Back out ticket #1681 - needs to be rethought, causing build problems.

Pull up following revision(s) (requested by jmcneill in ticket #1681):
	distrib/sets/sets.subr: revision 1.133
	sys/conf/osrelease.sh: revision 1.116
	sys/conf/osrelease.sh: revision 1.117
try to match sys/kern/kern_module.c module path logic: for release branches,
use X.Y version (instead of eg. X.Y.0_PATCH or X.Y_STABLE) and for -current use
X.Y.Z.
ok zafer@
Add -n option to print major and minor version, e.g. 5.99 on -current.
Describe new -n option in a comment; improve description of -m option.

Pull up following revision(s) (requested by jmcneill in ticket #1681):
	distrib/sets/sets.subr: revision 1.133
	sys/conf/osrelease.sh: revision 1.116
	sys/conf/osrelease.sh: revision 1.117
try to match sys/kern/kern_module.c module path logic: for release branches,
use X.Y version (instead of eg. X.Y.0_PATCH or X.Y_STABLE) and for -current use
X.Y.Z.
ok zafer@
Add -n option to print major and minor version, e.g. 5.99 on -current.
Describe new -n option in a comment; improve description of -m option.

Pull up following revision(s) (requested by jmcneill in ticket #1681):
	distrib/sets/sets.subr: revision 1.133
	sys/conf/osrelease.sh: revision 1.116
	sys/conf/osrelease.sh: revision 1.117
try to match sys/kern/kern_module.c module path logic: for release branches,
use X.Y version (instead of eg. X.Y.0_PATCH or X.Y_STABLE) and for -current use
X.Y.Z.
ok zafer@
Add -n option to print major and minor version, e.g. 5.99 on -current.
Describe new -n option in a comment; improve description of -m option.

try to match sys/kern/kern_module.c module path logic: for release branches,
use X.Y version (instead of eg. X.Y.0_PATCH or X.Y_STABLE) and for -current use X.Y.Z.
ok zafer@

simplify PCC inclusion; MKPCCDMDS is not really required

Mention MKPERFUSE keyword here, too. I have forgot to commit this file before.

Replace gnugrep keyword with ! bsdgrep

Add MKBSDGREP switch for easy testing of the GNU grep
replacement/alternative.

Sync with HEAD

Add LLVM and clang build system.  It is enabled by MKLLVM=yes.
Upstream sources can be fetched by running "make checkout" in
src/external/bsd/llvm, they will be properly imported once the
integration and missing features are sorted out.

Add a method to a whiteout an entry thereby allowing a md/ad file to remove
a file from the set lists.

Use this for md.evbppc which doesn't build some module tests.

Introduce the "ssp" attribute derived from HAS_SSP from <bsd.sys.mk>.
Use it to flag entries which should only be included if the target platform
supports SSP.  Fixes the build for a bunch of architectures.

Make tests set generation optional, skipped for MKATF=no build.

- always install pigz.  hooary!
- kill MKPIGZ.
- add MKPIGZGZIP.  if it is "no", then only install pigz as pigz.  if it is
  not "no", don't install mrgzip, install pigz as gzip.

in all cases, the z* scripts.


i don't like the name MKPIGZGZIP so if anyone has a better name, feel free
to replace it.  i don't care enough since killing the ugly name is just
more incentive to get pigz doing .bz2, .Z and .z.

add some infrastructure to build pigz instead of gzip.  you can test
this out if you set MKPIGZ=yes, but you'll end up with a /usr/bin/gzip
that doesn't support bzip2, compress or pack.

"dtrace,zfs" means "MKDTRACE=yes" *and* "MKZFS=yes" which is not what
we want. Invent a flag "solaris" which is the or of those two flags.

Add DTrace to sets.

add note of "pcc" and "pcccmds" attributes

In addition to setting module=no if ${MKKMOD} is "no", also
set kmod=no.  This should get evbppc building correctly again.

s/sed/${SED}/; s/xargs/${XARGS}/

Clean up debug knobs.

Factor out print_set_files() printing raw set list entries out of
list_set_files().  While here kill a useless-use-of-cat.

We don't need to check ${MACHINE_ARCH} == "m68000" if we use shlib or not.
Because such a knowledge is concentrated in bsd.own.mk and passed to as
${MKPIC}.  Tested by build.sh -m sun2 distribution sets.

Move the test for evbppc out of sets.subr and into bsd.own.mk, to
decide whether to make kernel modules: set MKKMOD to no for evbppc.
Use this in etc/Makefile to decide whether to do the "modules"
obsolete sets.  Move the ./var/db/obsolete/modules entry from the
"mi" to the "module.mi" file set.

Fixes the build for evbppc.

Discussed with uebayasi@

list_set_lists() - Share code of handling *.ad.* set lists.

Indent.

Refactor list_set_lists using more functions.

Replace many "if [ -f $x ]; then echo $x; fi" instances with function.

Prefix mkvars.mk with ${rundir}/, so that the scripts from this
dir using sets.subr can be run from another directory, as is done
e.g. during "make release" via the mksums script.

OK'ed by uebayasi@

Move make variable extraction & conversion logic from here-documented make
-f- command to an isolated makefile.  The list of non-_MKVARS.* variables
are concentrated there.

No functional changes.

Move the list of non-_MKVARS.* make variables from .for code to MKEXTRAVARS.
List one variable in one line for readability.  No functional changes.

Put MKMANZ back and unbreak its installation.

Add print_mkvars make target for debug.

MKZFS is properly set in bsd.own.mk now; remove it from MKEXTRAVARS.

Add MKZFS to MKEXTRAVARS just to make sure.

Put ${MKXORG} back to MKVARS.  It doesn't exist in bsd.own.mk but used here
to generate th set list keywork "xorg" in list_set_files().  Hopefully fix
some of reported build failures.

Oops.  Remove debug echo again.

Convert make variables ${_MKVARS.yes} / ${_MKVARS.no} to environments
${_MKVARS_yes} / ${_MKVARS_no} to make sure assignments done right both in
make and shell.

Extract important make variables not listed in ${_MKVARS.*}.

Patches from Lloyd Parkes in PR 41684, plus my changes:
* ${HOSTNAME} is special to bash, so rename the variable to HOSTNAME_CMD.
* Don't use "cd -".
* Don't use only comments in the else part of an if statement.

Add EXTSRCS to the list of syspkgs aware variables.  Remove debug code.

Pass the correct ${MKVARS} equivalent value to list_set_files().

XXX list_set_files() needs to be rewritten.

Quote variable values from make in case it has spaces.  Remove debug print.

Fix previous; don't forget extra vars other than MK*.

Don't hardcode the list of MK* variables but use ${_MKVARS.yes} and
${_MKVARS.no} provided by bsd.own.mk.

There's no point in adding _PKGTOOLS_VER=$(${PKG_CREATE} -V)
to any syspkg +BUILD_INFO files, since we don't use the pkg_* tools
to create syspkgs.  Also remove the definition of PKG_CREATE
from sets.subr, since nothing uses it now.

Support "extsrc", externally added programs and libraries.  Users can write
their own reach-overs, cross-build, install, and get set files just like base
and X11 / X.org.  (These sets are not included as TNF releases.)

Fix MKKMOD=no builds:  in sets.subr, if $MKKMOD == no, leave the
modules set out of the list of NetBSD set lists, nlists.  If
$MKKMOD == no, do not install modules tests.

Always respect MKBINUTILS=no, MKGCC=no, and MKGDB=no by filtering
entries binutils=N, gcc=N, or gdb=N from the set list.

Add MKZFS file so building a release works for others, too.

Multicast DNS ("Bonjour") support, based on Apple's mDNSResponder.

Rename MKBFD to MKBINUTILS and support HAVE_BINUTILS for set lists. This
makes {MK,HAVE_}BINUTILS consistent with {MK,HAVE_}{GCC,GDB}.

Allow MKBFD to defines MKBINUTILS as a backwards compatibility hook.

Update the sets lists and add conditionals for lib{bfd,opcodes}.

Create a modules.tgz set and move kernel modules into it.

Teach it about MKATF, MKCXX, and MKGROFF

Let us use MKKMOD=yes to leave the kernel modules out of the
distribution.

fix the prior change to add MKX11FONTS support.

Sync with HEAD.

Third (and last) commit. See http://mail-index.netbsd.org/source-changes/2009/05/13/msg221222.html

Pull up following revision(s) (requested by apb in ticket #677):
	distrib/sets/sets.subr: revision 1.83
Print debug messages only when MAKEVERBOSE >= 3, not when
it is >= 2.  MAKEVERBOSE=2 is the default, and the messages
are too noisy.

Print debug messages only when MAKEVERBOSE >= 3, not when
it is >= 2.  MAKEVERBOSE=2 is teh default, and the messages
are too noisy.

Pull up following revision(s) (requested by apb in ticket #659):
	distrib/sets/sets.subr: revision 1.82
All non-error messages printed to stderr by makeplist must begin with
"DEBUG:", or else regpkg assumes that they are error messages.  Make the
verbose messages printed by the list_set_files function follow that
convention.  Fixes PR 41077 from Lloyd Parkes.

All non-error messages printed to stderr by makeplist must begin with
"DEBUG:", or else regpkg assumes that they are error messages.  Make the
verbose messages printed by the list_set_files function follow that
convention.  Fixes PR 41077 from Lloyd Parkes.

Revert path of modules back to "/stand".

Change path to kernel modules from "/stand" to "/kernel".
Needs to go in before 5.0.  Proposed on <tech-kern>.

MKSENDMAIL is no longer used.

Apply patch, requested by pooka in ticket 259:
	distrib/sets/sets.subr			patch
	distrib/sets/lists/base/lkm.mi		patch
	distrib/sets/lists/base/md.amd64	patch
	distrib/sets/lists/base/md.sparc64	patch
	distrib/sets/lists/base/mi		patch
	distrib/sets/lists/base/shl.elf		patch
	distrib/sets/lists/base/shl.mi		patch
	distrib/sets/lists/comp/md.amd64	patch
	distrib/sets/lists/comp/md.sparc64	patch
	distrib/sets/lists/comp/mi		patch
	distrib/sets/lists/comp/shl.mi		patch
	distrib/sets/lists/man/mi		patch
	lib/Makefile				patch
	share/man/man5/mk.conf.5		patch
	share/mk/bsd.README			patch
	share/mk/bsd.own.mk			patch
	sys/lkm/vfs/Makefile			patch
	usr.sbin/Makefile			patch
Now that MKPUFFS is default, kill it as advertised.
While there, give puffs and refuse files sensible syspkg entries.

Put the lvm/MKLVM glue into the sets subroutines

Reorganize lists for MD modules:
- move MD module files from md.* into separate module.* lists
- make those module lists per MACHINE_CPU or MACHINE_ARCH,
  rather than per MACHINE

Tested on several ports.

XXX maybe we should also move usr/tests/modules/k_helper/k_helper.kmod
XXX from lists/tests/mi to lists/tests/module.mi and disable it on evbppc.

- rename set list lkm.mi -> module.mi
- move obsolete lists of usr/lkm files to mi

Pull up following revision(s) (requested by mrg in ticket #64):
	share/mk/bsd.README: revision 1.238
	distrib/sets/sets.subr: revision 1.73
fix a couple of minor errors picked up by he@.  thanks!

Pull up following revision(s) (requested by mrg in ticket #64):
	distrib/sets/Makefile: revision 1.64
	external/mit/xorg/server/Makefile: revision 1.5
	share/mk/bsd.README: revision 1.237
	BUILDING: revision 1.79
	share/mk/bsd.x11.mk: revision 1.71
	share/mk/bsd.own.mk: revision 1.544
	usr.bin/ssh/Makefile.inc: revision 1.18
	distrib/sets/sets.subr: revision 1.72
	share/man/man5/mk.conf.5: revision 1.42
	doc/BUILDING.mdoc: revision 1.68
	etc/Makefile: revision 1.360
	Makefile: revision 1.263
- retire MKXORG from public use
- introduce X11FLAVOUR to choose src/x11 vs src/external/mit/xorg
  for the X11 to build if MKX11=yes is set.  it takes the values
  of either Xorg or XFree86.
- default to Xorg on alpha, i386, macppc, shark, sparc and sparc64
- remove MKXORG_WITH_XSRC_XSERVER, unused and never useful

Now that MKPUFFS is default, kill it as advertised.
While there, give puffs and refuse files sensible syspkg entries.

Remove LKMs and switch to the module framework, pass 1.

Proposed on tech-kern@.

fix a couple of minor errors picked up by he@.  thanks!

- retire MKXORG from public use
- introduce X11FLAVOUR to choose src/x11 vs src/external/mit/xorg
  for the X11 to build if MKX11=yes is set.  it takes the values
  of either Xorg or XFree86.
- default to Xorg on alpha, i386, macppc, shark, sparc and sparc64
- remove MKXORG_WITH_XSRC_XSERVER, unused and never useful

support MKCRYPTO.

Sync with HEAD.

Sync with HEAD.

Sync with wrstuden-revivesa-base-2.

Remove set lists for the non-cross-compiled ("vendor provided") build of
XFree86; we've used our src/x11 framework for four years.

add debuglib keyword. per rtr

Add support for MKHTML and MKXORG enabling "html" and "xorg" keywords
(respectively).

MKXORG also sets x11_version as per MKX11.
(Eventually we'll deprecate the non cross-build X11 sets and remove
the need for the x11_version variable here)

Support dynamicroot keyword, keyed off MKDYNAMICROOT!=no.
Sort some entries.
Document some keywords.

Per discussion on tech-userlevel@, do not compile and install nvi
if MKNVI=no.

The default is MKNVI=yes, so that this amounts to no change for
most users, but the default may change.

Sync w/ -current. 34 merge conflicts to follow.

sync with head

Sync with HEAD.

When MAKEVERBOSE >= 2 (or if unset, by default), let list_set_files()
echo all the set list component file names to stderr, so they end
up in the build log.  This is to make it slightly easier to find
a suitable file to fix when the set lists need fixing.

Discussed with lukem.

Export NETBSDSRCDIR from make, and use it to point at
sys/conf/osrelease.sh, so that the script is found when building
with -O is given to build.sh.

Discussed with lukem.

OpenLDAP client libraries, utilities, and relevant manual pages.

Install kernel modules into the proper locations, taking machine and
kernel version into account.

Use HOST_SH.

Recognise @MODULEDIR@ as a keyword in setlists.

sync with HEAD

Support negated build-time options in the lists.  I need this to disable
some files when the modular option (not yet committed) is enabled.

file sets.subr was added on branch mjf-devfs on 2008-02-09 19:30:12 +0000

Support negated build-time options in the lists.  I need this to disable
some files when the modular option (not yet committed) is enabled.

sync with HEAD

Remove MKUUCP from MKVARS; uucp is not in src any longer.

Add the tests.tgz set

This adds a new tests.tgz set to releases which includes all the tests
for the system.  It is important to note that this set does not rely on
comp.tgz: a user of the system can run the tests without having the
development tools installed, which can be useful in a production machine.

Pull up following revision(s) (requested by apb in ticket #491):
	distrib/sets/regpkg: revision 1.15
	tools/gcc/mknative.common: revision 1.9
	distrib/sets/sets.subr: revision 1.56
	distrib/sets/regpkgset: revision 1.9
	build.sh: revision 1.161 via patch
Whenever we try to parse the output from make, run make with the -B
flag.  This ensures that -j<N> isn't accidentally inherited from the
environment, because the "--- foo ---" headers printed with -j<N> would
interfere with parsing the output.

Whenever we try to parse the output from make, run make with the -B
flag.  This ensures that -j<N> isn't accidentally inherited from the
environment, because the "--- foo ---" headers printed with -j<N> would
interfere with parsing the output.

if MKPUFFS=yes is given, build & install mount_psshfs (default: no)

more uucp removal

Implement MKDEBUG:
	If "no", don't build and install separate debugging symbols
	into /usr/libdata/debug.
	Default: no

* Provide new keywords:
	gcc=<n>			<n> = value of ${HAVE_GCC}
	gdb=<n>			<n> = value of ${HAVE_GDB}

* Support extra keywords on lines with "obsolete" keywords to allow
  keyword-specific obsolete files.
  (Primarily intended for use with gcc=<n> and gdb=<n>, although
  it could be use for other items).

* Use the above features to collapse the gcc.* and gcc4.* lists into
  the appropriate set lists.

* Deprecate the tc.* lists as all platforms are either HAVE_GCC=3 or HAVE_GCC=4.

* Update set lists for HAVE_GDB=6.

add support for MKISCSI=no.

As pointed out by Izumi and Tsutsui and Valeriy Ushakov, these should
properly be .ad. files, not .md. files.

Use the gcc4 md list.

retire HAVE_GCC3/HAVE_GCC4 and introduce HAVE_GCC that is set to 2, 3 or 4.

Goodbye KerberosIV

Use TARGET_ENDIANNESS (from bsd.endian.mk) to decide whether
to add "-E B" or "-E L" options to ${db_opts}.

Approved by christos.

Add cheap implementations of basename and dirname,
using builtin printf, or using echo if printf is not a
shell builtin.

Reviewed by agc

Add shell variables for several additional host tools,
required by the new versions of regpkgset and regpkg.

Add shell variables defined in sets.subr for almost all commands used
by scripts in distrib/sets/*.  This is intended to be useful when cross
building.  Only trivial commands like echo, cat, and rm are excluded
from this treatment.

While I am here, make ${MTREE} and ${DB} follow the pattern used by most
other such variables.

Reviewed by agc.

Move default values for several shell variables into sets.subr.

Reviewed by agc

Add support for following keywords in sets lists, based on mk.conf(5) vars:
	use_inet6		${USE_INET6} != no
	use_kerberos		${USE_KERBEROS} != no
	use_yp			${USE_YP} != no

Pull up revision 1.40 (requested by jmc in ticket #114):
Add "MKX11" flag. We need it for the X11 obsolete lists in the "base" set.

Add "MKX11" flag. We need it for the X11 obsolete lists in the "base" set.

Add MKIPFILTER; if set to no, don't build and install the ipf(4) programs,
headers and LKM.

Add MKPF; if set to no, don't build and install the pf(4) programs,
headers, LKM and spamd.

Both options default to yes, so nothing changed in the default build.

Reviewed by lukem.

Support ${MKINET6} == "no".

Don't build libpam and associated bits if the target platform doesn't
support shared libraries (sun2 and evbsh5 at it would seem), or if the
user has specified MKPIC=no.  Also introduce a new tag to the set lists
("pam"), so that the non-shlib ports can once again complete a release
build.

Discussed with christos and lukem.

Add MKGCCCMDS/gcccmds

EOL of XFree86 3.3.6, approved by core@NetBSD.org

Make all the sets scripts work even when not run from the directory that
they reside in.
Change any uses of dirname to use shell variable substitution instead.

Add support for building/install just cat pages (via MANINSTALL=catpages) in
the sets. Originally from PR#24949. Tested w. all combinations of MANINSTALL

Allow MKGDB=no to override inclusion of records with the 'gdb' keyword.

Restructure MKPIC tests so that stlib always gets set first based on
OBJECT_FMT and then MKPIC/arch tests can set shlib=no if they need to.

Recognize when MKPIC=no and then set shlib=no

sh3 ports have shlibs now in the gcc3 world.

Implement `xetc' set to contain configuration that may be changed by
the end-user that we don't want to overwrite when extracting the
other X sets.

Merge xmisc into xbase; xmisc only contained "ssh-askpass", and the other
stuff from xsrc/local/programs was already in xbase.

Merge "xcontrib" into "xbase".
It was already merged in the XFree86 4.x source anyway, and it doesn't
make senses to keep some programs in a separate set just because they
used to be built from a separate directory in XFree86 3.x.

Support MKUUCP=no.
Fix the syspkgs for cu (now in uucp) and tip (now in util)

Support MKSHARE=no

Support MKDOC=no MKINFO=no MKNLS=no

Add support for:
	MKCATPAGES=no
	MKMAN=no
	MKMANZ=yes

Add ".man" (from "man") and ".cat" (from "catpages") to indicate files
that will automatically be treated as having a ".gz" extension if
MKMANZ != no.  (This simplifies the MKMANZ!=no support...)

support MKBFD=no

If MKX11 != no, set x11_version="" and ignore USE_XF86_4.

support MKCVS=no

Support MKCRYPTO=no

Support MKPROFILE=no

Support MKSKEY=no.

support MKYP=no

support MKHESIOD=no

Support MKCRYPTO_IDEA=yes, MKCRYPTO_MDC2=yes, MKCRYPTO_RC5=yes.
Resolves [install/18136].

support postfix keyword (${MKPOSTFIX} != no).
tweak code to make it easier to add new keywords based on MKxxx vars.

rename all the <bsd.own.mk> derived variables to uppercase, and export
them to the environment.

Add support for rescue.ad.<cpu>.shl which appears to have been missed

Significant overhaul of how the sets are used:

* Add an optional third field to the sets file which is a list of
  comma separated keywords that control if the line is printed.
  Currently supported keywords
	kerberos4	${MKKERBEROS4} != no
	kerberos	${MKKERBEROS} != no
	lint		${MKLINT} != no
	obsolete	${obsolete} != 0.
			In this case, non obsolete files are not printed.
  (This will allow future support for builds with variables such as
  MKHESIOD and MKYP set to "no".)

* Use sh(1)'s getopts where appropriate, and otherwise cleanup the
  various scripts.

* Move defaults for sets.subr from sets.defaults into sets.subr.
  Move replicated code for determining stuff such as shlibs type
  from various scripts into sets.subr.

* Merge the obsolete.*, krb.*, krb4.* and lint.* into the appropriate
  main lists with the relevant third field keyword(s).

minor sh KNF

Fix the checkflist for builds without Kerberos 4 (MKKERBEROS4=no)
and without Kerberos 4 & 5 (MKKERBEROS=no). Previously checkflist
complained of missing files.

* move kerberos- and kerberos 4-only files into new flists,
  distrib/sets/lists/*/krb.*

* make the flist generators grok MKKERBEROS{,4} variables

* fix Makefiles which treat MKKERBEROS=no as MKKERBEROS5=no.
  9 out of 10 experts agree that it is ludicrous to build w/
  KERBEROS4 and w/o KERBEROS5.

* fix header files, also, which treat MKKERBEROS=no as MKKERBEROS5=no.

* omit some Kerberos-only subdirectories from the build as
  MKKERBEROS{,4} indicate

(I acknowledge the sentiment that flists are the wrong way to go,
and that the makefiles should produce the metalog directly.  That
sounds to me like the right way to go, but I am not prepared to do
revamp all the makefiles.  While my approach is expedient, it fits
painlessly within the current build architecture until we are
delivered from flist purgatory, and it does not postpone our
delivery. Fair enough?)

Use $have_gcc3 rather than $use_tools_toolchain,
which isn't set by sets.defaults.

Factor duplicated code for setting variables such as machine_cpu
and machine_arch to their defaults into sets.defaults, and source
it at the top of each script.

Also, to be consistent with variable naming, s/arch/machine_arch/.

sets.defaults introduces two new variables, krb and krb4, which
will affect whether Kerberos- or Kerberos IV-only files are put
into the set lists.

Alphabetize environment, again.

Alphabetize environment docs.

add initial support for gcc3

For System Packages, two new utilities, a subroutine library, and
a new list:

sets.subr -- The set-listing code that is common to makeplist,
	     makeflist, and regpkg has moved here.

syspkgdeps -- Compute naive dependencies for system packages based
	      on directory containment. I.e., if package A contains
	      path /p/q, and package B contains path /p, then B is
	      considered a dependency of A. As Jim Wise remarks,
	      this is not quite right: system-package dependencies
	      should indicate a functional dependency. Nevertheless,
	      these naive dependencies protect us from orphaning
	      files when pkg_delete'ing system packages.

culldeps -- Helper for syspkgdeps. Removes redundant dependencies
	    from a dependencies table.  Essentially does the opposite
	    of a transitive closure on a dependencies table: if
	    the table contains A depends-on B, B depends-on C, and
	    A depends-on C, then A depends-on C is removed because
	    it can be derived from the prior two dependencies.

deps -- Dependencies computed by syspkgdeps.