Annotation of src/UPDATING, Revision 1.187
1.187 ! dholland 1: $NetBSD: UPDATING,v 1.186 2009/01/11 03:31:12 christos Exp $
1.1 abs 2:
1.123 jmc 3: This file (UPDATING) is intended to be a brief reference to recent
4: changes that might cause problems in the build process, and a guide for
5: what to do if something doesn't work.
1.1 abs 6:
1.123 jmc 7: For a more detailed description of the recommended way to build NetBSD
8: using build.sh, see the BUILDING file.
9:
10: Note that much of the advice in this UPDATING file was written before
11: build.sh existed. Nevertheless, the advice here may be useful for
12: working around specific problems with build.sh.
13:
14: See also: BUILDING, build.sh, Makefile.
1.1 abs 15:
16: Recent changes:
17: ^^^^^^^^^^^^^^^
1.138 lukem 18:
1.184 christos 19: 20090110:
20: time_t and dev_t have been bumped to 64 bit quantities. To upgrade:
21: 1. Make sure your kernel has COMPAT_50 in it. Build and install.
22: 2. make sure build.sh completes and the binaries in a chroot work
23: before installing.
24: 3. If you don't use build.sh and you build directly to root, and
1.187 ! dholland 25: your build breaks in the middle, don't despair. Make sure headers
1.184 christos 26: are installed properly, and start building libraries first libc
27: and libutil, install them and then continue building all the
28: libraries in src/lib and src/gnu/lib and install them. Once
29: the new libraries are installed, you can restart the build.
30: 4. If you compile packages and you notice link time warnings,
31: you'll need to bump them and rebuild them.
1.186 christos 32: 5. Next time you run pwd_mkdb with the new binary, the file
33: will be upgraded and it will not be backwards compatible.
34: 6. The utmpx/wtmpx files have been versioned, and there is
35: a heuristic for utmp. You are better off removing the
36: old files after upgrading.
1.185 jmcneill 37:
1.183 pgoyette 38: 20081219:
39: config(1) has been updated, and one of the files it creates -
40: swapnetbsd.o - has changed format. You need to rebuild config
41: (done automatically by build.sh) and then you need to rerun
42: config on all kernel configuration files before rebuilding those
43: kernels.
44:
1.181 cube 45: 20081205:
46: If you build with MKX11=no, you should remove /etc/rc.d/xdm and
47: /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
48: set and will appear as extra files for MKX11=no update builds.
1.178 lukem 49:
1.179 tsutsui 50: 20081122:
1.182 tsutsui 51: On i386, various kernel options(4) in GENERIC including
1.180 wiz 52: file systems have been disabled and moved into kernel modules.
53: Before trying a new GENERIC kernel, you have to prepare the
1.179 tsutsui 54: following files as well as a new GENERIC kernel:
55:
56: - build and install kernel modules from src/sys/modules
57:
58: - install the latest bootloader, which will load a module
1.180 wiz 59: for the file system from which the kernel is loaded automatically
1.179 tsutsui 60:
1.180 wiz 61: If you have to load your kernel from a file system which is not of
62: the same type as the root file system, you have to load the necessary
63: file system module manually on the boot prompt or in the boot.cfg file.
1.179 tsutsui 64:
1.178 lukem 65: 20080827:
66: If you built and installed a libc from sources between
67: 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
68: which results in false errors reported by lint(1).
69: Since this breaks the libc build itself, manual help is
1.180 wiz 70: needed -- lint must be disabled temporarily, e.g.:
1.178 lukem 71: $ (cd lib/libc && make MKLINT=no dependall install)
72:
1.177 christos 73: 20080813:
74: MKDEBUG build was broken because the .depend files did not know
75: about .go files. You need to remove all .depend files and rebuild.
76:
1.175 simonb 77: 20080731:
78: WAPBL (metadata journaling support) has been added, but at this
79: time isn't backwards compatible with pre-WAPBL aware kernels
80: and userland (fsck_ffs in particular). Please make sure you
81: don't use a journaled filesystem with an older kernel/userland,
1.176 simonb 82: especially an uncleanly mounted journaled filesystem. WAPBL
83: also requires the super block to be in the UFS2 format. You
84: can use fsck_ffs -c 4 to update the superblock format.
1.175 simonb 85:
1.174 lukem 86: 20080721:
87: Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
88: isn't defined.
89:
1.173 freza 90: 20080531:
91: The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
92: from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
93: utility needs to be rebuilt and reinstalled as older binaries
94: won't work correctly. The following sequence of commands:
95:
96: $ (cd sys/sys/ && nbmake-$arch includes)
97: $ (cd sbin/drvctl/ && nbmake-$arch clean)
98: $ (cd sbin/drvctl/ && nbmake-$arch all)
99:
100: leaves new drvctl utility in sbin/drvctl build directory.
101:
1.172 lukem 102: 20080503:
103: The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
104:
1.171 he 105: 20080521:
106: For a while, unprivileged UPDATE builds would fail to
107: succeed at the checkflist stage, complaining that
108: ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
109: problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
110: If you already hit this problem, update the .mk file,
111: remove ${DESTDIR}/stand/<arch>, and re-run the build.
112:
1.174 lukem 113: 20080303:
114: Linker warnings are now fatal if $WARNS>0.
115:
1.170 christos 116: 20080126:
117: The posix_fadvise system call has been changed from an assembly
118: stub, to a c file that calls an assembly stub. You need to
119: 'rm -f posix_fadvise.* .depend' in the libc build directory to
120: avoid using the old assembly stub.
121:
1.168 joerg 122: 20071209:
123: The acpiec(4) driver has been split into two attachments. If you
124: get ACPI errors before the attachment, please update your kernel
1.169 wiz 125: configuration file appropriately or see GENERIC for more details.
1.168 joerg 126:
1.166 xtraeme 127: 20071115:
128: The it(4) driver has been renamed to itesio(4) and the old port
129: argument specified in the kernel configuration file is not valid
130: anymore. The itesio(4) driver now uses the Super I/O address port
131: rather than the EC address port. Please update your kernel
1.167 wiz 132: configuration file appropriately or see GENERIC for more details.
1.166 xtraeme 133:
1.165 jmmv 134: 20071028:
135: The pccons(4) driver has been removed from the NetBSD/shark port.
136: You need to update any custom kernel configuration file you have
137: to remove any references to pccons (which includes removing the
138: now useless XSERVER option) and replace them with the correct
139: entries for the wscons driver. See the GENERIC configuration file
140: for more details.
141:
1.164 gdt 142: 20070913:
143: A latent bug in dhclient/dhcpd that caused it to be unable to
144: enumerate interfaces was fixed. The bug began to cause
145: problems after 20070911 when the kernel's SIOCGIFCONF
146: implementation was repaired. From 20070529 to 20070911 racoon
147: could not enumerate interfaces. (These are noted because
148: normal kernel/userspace version matching hygiene is not
149: sufficient to avoid this problem.) Ensure that both kernel
150: and userland are from after 20070913.
151:
1.163 joerg 152: 20070703:
153: nbinstall has been renamed as it calls the target specific and
154: the logic to pass down STRIP from mk been removed. This forces
155: a re-installation of tools.
156:
1.161 dsl 157: 20070422:
158: The way OS emulations lookup filenames inside the emulation root
159: has been changed. Rather than modify the pathname (and copy back
160: to userspace) namei() and lookup() directly check the emulation
161: root. One side effect is that absolute symlinks inside the emulated
1.167 wiz 162: root file system will be relative to that file system - unless they
1.161 dsl 163: start /../ this is useful when the emulated root is a real install
164: that has such links.
165: This might affect symlinks that have been added to reference outside
166: the emulated root.
167:
1.160 jmcneill 168: 20070412:
169: The pckbc driver on sgimips IP32 has been removed. Use macekbc
170: instead. See the GENERIC32_IP3x kernel configuration for an
171: example.
172:
1.159 gdt 173: 20070319:
174: src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
175: on many platforms due to incorrect flags settings. If you
176: updated and built after about 20070315, do "nbmake-$arch
177: cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
178: rebuild of object files that might have been built
179: incorrectly, and ensure that you have at least
180: src/lib/libc/Makefile 1.130.
181:
1.158 dbj 182: 20070210:
183: src/sys/sys/{sa.h,savar.h} were removed.
184: find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
185: | xargs egrep -l '/sa.h|/savar.h' | xargs rm
186: will allow dependencies on those files to get get rebuilt
187:
1.157 apb 188: 20070209:
189: The threading model was changed when the newlock2 branch
190: was merged to NetBSD-current. If you boot with a new
191: kernel (version 4.99.10), then you also need a new pthread
192: library (/usr/lib/libpthread.so.0.7). If you boot with
193: an old kernel, then you need the old pthread library
194: (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
195: the pthread library in sync, old threaded applications should
196: continue to work with an old or new kernel. Note that named(8)
197: is the only threaded application in the base system.
198:
1.154 he 199: 20061214:
200: Following the move of string_to_flags() and flags_to_string()
201: from the bin/ls/ sources to libutil, users doing UPDATE builds
202: will need to do a "make cleandir" in
203: tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
204: bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
1.156 he 205: usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
206: as the installation images in distrib/
1.154 he 207: in order to excise stale references to the old stat_flags.h header
208: file in the ls sources -- stat_flags.h has been removed.
209:
1.152 christos 210: 20061108:
211: The configure script used in the src/tools/gcc compiler has been
212: changed to indicate that our libc has ssp support built-in and
213: does not depend on -lssp and -lssp-nonshared. You'll need to
214: make clean in src/tools/gcc first to rebuild the compiler.
215:
1.151 rpaulo 216: 20061009:
217: The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
218: available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
219:
1.150 bjh21 220: 20060814:
221: The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
222: withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
223: kernel configuration for an example. X servers from the last
224: few years should cope.
225:
1.149 christos 226: 20060703:
227: MPACPI is no more. We always configure PCI interrupts using ACPI
228: if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
229: to ACPI_SCANPCI. Thanks to work from fvdl.
230:
1.148 dogcow 231: 20060627:
232: socket(2) has changed, and its system call has been versioned.
233: For userlands with the old version of socket(2), make sure that
234: your kernel has 'options COMPAT_30' set, or else 'bad system call'
235: errors will result.
236:
1.1 abs 237: Hints for a more successful build:
238: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1.123 jmc 239: Use build.sh, but do not use its "expert mode":
1.132 jmmv 240: This will automatically build the tools in the
1.123 jmc 241: correct order, and it will keep the tools and the
242: new build products from interfering with the running
243: system. This will allow you to ignore most of the
244: other advice in this file.
1.2 mrg 245: Build a new kernel first:
246: This makes sure that any new system calls or features
247: expected by the new userland will be present. This
248: helps to avoid critical errors when upgrading.
1.1 abs 249: Use object directories:
250: This helps to keep stale object
251: files from polluting the build if a Makefile "forgets"
252: about one. It also makes it easier to clean up after
253: a build. It's also necessary if you want to use the
254: same source tree for multiple machines.
1.123 jmc 255: To use object directories with build.sh:
256: a) invoke build.sh with the "-M" or "-O" options.
257: To use object directories without using build.sh:
1.1 abs 258: a) cd /usr/src ; make cleandir
1.2 mrg 259: b) Add "OBJMACHINE=yes" to /etc/mk.conf
260: c) Add "MKOBJDIRS=yes" to /etc/mk.conf
1.1 abs 261: d) cd /usr/src ; make build
1.2 mrg 262: Note that running "make obj" in a directory will create
263: in obj.$MACHINE directory.
1.1 abs 264: Build to a DESTDIR:
1.123 jmc 265: This helps to keep old installed files (especially libraries)
266: from interfering with the new build.
267: To build to a DESTDIR with build.sh, use the "-D" option.
268: To build to a DESTDIR without using build.sh, set the DESTDIR
269: environment variable before running make build. It should be
270: set to the pathname of an initially empty directory.
271: Problems: if you do not use build.sh, you might need to
272: update critical utilities without using DESTDIR since
273: nothing is executed from what is installed in DESTDIR.
274: (See critical utils, below.)
1.1 abs 275: Build often:
276: This keeps critical utilities current enough to not choke
277: on any other part of the source tree that depends on up to
1.123 jmc 278: date functionality. If you use build.sh, you should not have
279: this problem.
1.1 abs 280:
281: What to do if things don't work:
282: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
283: When things don't work there is usually a few things that commonly
284: should be done.
285: 1) make includes
286: This should be done automatically by make build.
287: 2) cd share/mk && make install
288: Again, automatically done by make build.
289:
290: Failsafe rebuild of a small part of the tree:
291: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
292: To make sure you rebuild something correctly you want to do
293: something like the following:
294: 1) Make sure the includes and .mk files are up to date.
295: 2) Make sure any program used to build the particular
296: utility is up to date. (yacc, lex, etc...)
297: 3) cd ...path/to/util...
298: make cleandir
299: rm ...all obj directories...
300: make cleandir # yes, again
301: make obj
302: make depend && make
303:
304: Failsafe rebuild of the entire tree:
305: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
306: If you really want to make sure the source tree is clean and
1.2 mrg 307: ready for a build try the following. Note that sourcing /etc/mk.conf
308: (a make(1) Makefile) in this manner is not right, and will not work
309: for anyone who uses any make(1) features in /etc/mk.conf.
1.1 abs 310:
311: ---cut here---
312: #!/bin/sh
313: . /etc/mk.conf
314:
1.58 lukem 315: if [ -z $NETBSDSRCDIR ] ; then
316: NETBSDSRCDIR=/usr/src
1.1 abs 317: fi
1.58 lukem 318: if [ \! -d $NETBSDSRCDIR ] ; then
1.1 abs 319: echo Unable to find sources
320: exit 1
321: fi
1.58 lukem 322: find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
1.1 abs 323:
324: if [ -z $BSDOBJDIR ] ; then
325: BSDOBJDIR=/usr/obj
326: fi
327: if [ -d $BSDOBJDIR ] ; then
328: rm -rf $BSDOBJDIR
329: fi
330:
1.58 lukem 331: cd $NETBSDSRCDIR && make cleandir
1.1 abs 332:
333: ---cut here---
334:
335: Critical utilities:
336: ^^^^^^^^^^^^^^^^^^^
1.3 itojun 337: usr.bin/compile_et
1.1 abs 338: usr.bin/make
339: usr.bin/yacc
340: usr.bin/lex
1.11 lukem 341: usr.bin/xlint
1.142 drochner 342: usr.bin/config
1.1 abs 343:
1.34 simonb 344: Other problems and possible solutions:
1.1 abs 345: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
346: Symptom:Complaints involving a Makefile.
1.17 erh 347: Fix: Rebuild usr.bin/make:
348: cd usr.bin/make && make && make install
1.111 simonb 349: Or, a failsafe method if that doesn't work:
1.17 erh 350: cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
351:
1.1 abs 352: Fix: Make sure .mk files are up to date.
353: cd share/mk && make install
1.2 mrg 354:
355: Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
1.142 drochner 356: Fix: Rebuild usr.bin/config
1.1 abs 357:
358: Symptom:
359: Fix: Rebuild usr.bin/yacc
360:
361: Symptom:
362: Fix: Rebuild usr.bin/lex
363:
364: Symptom:
365: Fix: rm /usr/lib/libbfd.a
1.4 itojun 366:
367: Symptom:Obsolete intermediate files are used during compilation
368: Fix: Try the following sequence of commands in the directory in question.
369: make cleandir; rm `make print-objdir`; make cleandir; make obj
370: (If you built the tree without "make obj" in the past, obsolete files
371: may remain. The command tries to clean everything up)
1.5 wiz 372:
373: Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
374: Fix: Rebuild and install usr.bin/menuc
1.12 itojun 375:
376: Symptom:mklocale not found during build in share/locale/ctype
377: Fix: Build and install usr.bin/mklocale
1.13 dogcow 378:
1.86 kleink 379: Symptom:undefined reference to `__assert13' or `__unsetenv13'
1.13 dogcow 380: Fix: Rebuild and install lib/libc
381:
1.142 drochner 382: Symptom:usr.bin/config fails to build.
1.19 cgd 383: Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
1.13 dogcow 384:
1.19 cgd 385: Symptom:undefined reference to `getprogname' or `setprogname'
386: Fix: Rebuild and install lib/libc
1.24 abs 387:
388: Symptom:lint does not understand the '-X' option
389: Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
CVSweb <webmaster@jp.NetBSD.org>