Annotation of src/UPDATING, Revision 1.215
1.215 ! mrg 1: $NetBSD: UPDATING,v 1.214 2010/06/09 17:29:15 dholland Exp $
1.1 abs 2:
1.123 jmc 3: This file (UPDATING) is intended to be a brief reference to recent
4: changes that might cause problems in the build process, and a guide for
5: what to do if something doesn't work.
1.1 abs 6:
1.123 jmc 7: For a more detailed description of the recommended way to build NetBSD
8: using build.sh, see the BUILDING file.
9:
10: Note that much of the advice in this UPDATING file was written before
11: build.sh existed. Nevertheless, the advice here may be useful for
12: working around specific problems with build.sh.
13:
14: See also: BUILDING, build.sh, Makefile.
1.1 abs 15:
16: Recent changes:
17: ^^^^^^^^^^^^^^^
1.138 lukem 18:
1.215 ! mrg 19: 20101119:
! 20: Recent Xorg updates in xsrc/external/mit/ may cause various build
! 21: or run-time problems. Delete your entire DESTDIR and OBJDIR if you
! 22: have any build problems with xsrc, or problems with mismatched
! 23: versions between xorg-server and drivers.
! 24:
1.213 jmmv 25: 20100604:
26: The update of ATF to 0.9 causes old tests written in shell to fail
27: unless they are rebuilt. If you are building with MKUPDATE=yes,
28: you need to clean the src/external/bsd/atf/tests/ and the src/tests/
29: trees by hand.
30:
1.211 tnozaki 31: 20100522:
1.212 mrg 32: Recent Xorg updates in xsrc/external/mit/ will cause various build
33: problems. Delete your entire DESTDIR and OBJDIR if you have any
34: build problems with xsrc.
35:
36: 20100522:
1.211 tnozaki 37: private section of <ctype.h> was splitted, and now mklocale(1)
1.214 dholland 38: include ctype_local.h, so you have to make cleandir in tools/mklocale.
1.211 tnozaki 39:
1.210 christos 40: 20100520:
41: The location of the xkb compiled descriptions has changed. Please
42: remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR.
43:
1.209 njoly 44: 20100222:
45: The shared objects file extension has been changed from .so to
46: .pico, in order to avoid conflicts with shared libraries names
47: libXX.so. All now stale regular .so files can be removed from
48: your object directories.
49:
1.208 roy 50: 20100204:
51: The termcap database has been removed from the sources,
52: but has not been marked obsolete so it is not removed
53: from the system when upgrading.
54: As such, you will need to remove them from your object
55: and destination directories.
56:
1.203 dyoung 57: 20091101:
1.205 dholland 58: After updating, it may be necessary to make the 'cleandir'
59: target in src/tools/yacc/ and in src/usr.bin/yacc/ before a
60: 'build.sh -u tools' or 'build.sh -u distribution'. Ditto
61: src/tools/lex/ and src/usr.bin/lex/.
1.203 dyoung 62:
1.202 mrg 63: 20091001:
1.206 dholland 64: On amd64 you must rebuild tools (to get the new binutils)
65: before building a kernel, or the build fails on cpufunc.S.
66:
67: 20091001:
1.202 mrg 68: An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
69: symlink, failing the build. Delete the link, and the subdir
70: it is in, and retry your build.
71:
1.201 dsl 72: 20090718:
73: libc build changed so that strchr() provides the extra entry
74: point for index(). Update build of libc.a (and libc_pic.a)
75: may fail because the archive contains the unwanted index.o.
76: (Similarly for strrchr() and rindex().)
77:
1.198 mrg 78: 20090709:
79: Native Xorg was upgraded again. Builds will probably fail again
80: without a clean objdir, at least for src/external/mit/xorg.
81:
1.197 mrg 82: 20090616:
83: Native Xorg was upgraded. Builds will need a clean objdir for
84: src/external/mit/xorg. Upgrading a system from sets will not
85: work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
86: subdirectory has been changed into a file, and this needs to
87: be manually "rm -r"'ed before installing xbase.tgz.
88:
1.195 perry 89: 20090501:
90: Several new functions were added to string.h/libc, and this
91: can cause autoconf problems during the tool build for people
92: who fail to clean out their tools objects properly. If you
93: note messages about stpcpy, stpncpy or strnlen accompanying a
94: failure during the tool build, clean out all your tools
95: objects and start again.
96:
1.194 mrg 97: 20090325:
98: The i386 port was switched to i486 default toolchain. This requires
99: cleaning your src/tools directory and $TOOLDIR and rebuilding them.
100:
1.192 skrll 101: 20090126:
1.207 mbalmer 102: The __posix_fadvise50 system call changed assembly stub type. You
103: need to 'rm -f __posix_fadvise50.*' in the libc build directory
104: to avoid using the old assembly stub.
1.192 skrll 105:
1.191 joerg 106: 20090202:
107: pkg_install now depends on the pkgdb cache for automatic conflict
108: detection. It is recommented to rebuild the cache with
109: ``pkg_admin rebuild''.
110:
1.184 christos 111: 20090110:
112: time_t and dev_t have been bumped to 64 bit quantities. To upgrade:
113: 1. Make sure your kernel has COMPAT_50 in it. Build and install.
1.188 christos 114: This is needed even in the MODULAR kernel because there is
115: conditionally compiled code in rtsock.c.
1.184 christos 116: 2. make sure build.sh completes and the binaries in a chroot work
117: before installing.
118: 3. If you don't use build.sh and you build directly to root, and
1.187 dholland 119: your build breaks in the middle, don't despair. Make sure headers
1.184 christos 120: are installed properly, and start building libraries first libc
121: and libutil, install them and then continue building all the
122: libraries in src/lib and src/gnu/lib and install them. Once
123: the new libraries are installed, you can restart the build.
124: 4. If you compile packages and you notice link time warnings,
1.189 hubertf 125: rebuild the required packages to update their shared libraries.
126: Any package you rebuild will require rebuilding all the packages
127: that depend on it.
1.186 christos 128: 5. Next time you run pwd_mkdb with the new binary, the file
129: will be upgraded and it will not be backwards compatible.
1.190 apb 130: 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
131: lastlogx(5)) have been versioned, and there is a heuristic
132: for utmp. You are better off removing the old files after
133: upgrading. The automated clearing of /var/run during
134: boot, and the automated rotating of files in /var/log by
135: newsyslog(8), may mean that you do not have to remove the
136: files manually.
137: 7. The optional accounting file (/var/account/acct, see
138: accton(8)) has not been versioned, and will need to be
139: removed. The automatic rotation of the accounting file by
140: /etc/daily limits the bad consequences of failure to remove
141: the file.
1.196 dholland 142: 8. Application software that writes time_t to binary files on
143: disk will break or need attention. Most notably: if you are
144: using PostgreSQL < 8.4, you need to dump your databases,
145: rebuild PostgreSQL with the new time_t, then restore.
1.185 jmcneill 146:
1.183 pgoyette 147: 20081219:
148: config(1) has been updated, and one of the files it creates -
149: swapnetbsd.o - has changed format. You need to rebuild config
150: (done automatically by build.sh) and then you need to rerun
151: config on all kernel configuration files before rebuilding those
152: kernels.
153:
1.181 cube 154: 20081205:
155: If you build with MKX11=no, you should remove /etc/rc.d/xdm and
156: /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
157: set and will appear as extra files for MKX11=no update builds.
1.178 lukem 158:
1.179 tsutsui 159: 20081122:
1.182 tsutsui 160: On i386, various kernel options(4) in GENERIC including
1.180 wiz 161: file systems have been disabled and moved into kernel modules.
162: Before trying a new GENERIC kernel, you have to prepare the
1.179 tsutsui 163: following files as well as a new GENERIC kernel:
164:
165: - build and install kernel modules from src/sys/modules
166:
167: - install the latest bootloader, which will load a module
1.180 wiz 168: for the file system from which the kernel is loaded automatically
1.179 tsutsui 169:
1.180 wiz 170: If you have to load your kernel from a file system which is not of
171: the same type as the root file system, you have to load the necessary
172: file system module manually on the boot prompt or in the boot.cfg file.
1.179 tsutsui 173:
1.178 lukem 174: 20080827:
175: If you built and installed a libc from sources between
176: 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
177: which results in false errors reported by lint(1).
178: Since this breaks the libc build itself, manual help is
1.180 wiz 179: needed -- lint must be disabled temporarily, e.g.:
1.178 lukem 180: $ (cd lib/libc && make MKLINT=no dependall install)
181:
1.177 christos 182: 20080813:
183: MKDEBUG build was broken because the .depend files did not know
184: about .go files. You need to remove all .depend files and rebuild.
185:
1.200 dholland 186: 20080802:
187: A regression in binary compatibility for pthread_mutex_t has
188: been fixed. Unfortunately, the price is breaking compatibility
189: for -current.
190:
191: Threaded programs (using libpthread) and C++ programs (using
192: libstdc++) compiled after 20070907 and before 20080802 need to
193: be recompiled.
194:
195: One way to find affected pkgsrc packages:
196:
197: $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
198: $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
199:
1.175 simonb 200: 20080731:
201: WAPBL (metadata journaling support) has been added, but at this
202: time isn't backwards compatible with pre-WAPBL aware kernels
203: and userland (fsck_ffs in particular). Please make sure you
204: don't use a journaled filesystem with an older kernel/userland,
1.176 simonb 205: especially an uncleanly mounted journaled filesystem. WAPBL
206: also requires the super block to be in the UFS2 format. You
207: can use fsck_ffs -c 4 to update the superblock format.
1.175 simonb 208:
1.174 lukem 209: 20080721:
210: Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
211: isn't defined.
212:
1.173 freza 213: 20080531:
214: The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
215: from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
216: utility needs to be rebuilt and reinstalled as older binaries
217: won't work correctly. The following sequence of commands:
218:
219: $ (cd sys/sys/ && nbmake-$arch includes)
220: $ (cd sbin/drvctl/ && nbmake-$arch clean)
221: $ (cd sbin/drvctl/ && nbmake-$arch all)
222:
223: leaves new drvctl utility in sbin/drvctl build directory.
224:
1.172 lukem 225: 20080503:
226: The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
227:
1.171 he 228: 20080521:
229: For a while, unprivileged UPDATE builds would fail to
230: succeed at the checkflist stage, complaining that
231: ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
232: problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
233: If you already hit this problem, update the .mk file,
234: remove ${DESTDIR}/stand/<arch>, and re-run the build.
235:
1.174 lukem 236: 20080303:
237: Linker warnings are now fatal if $WARNS>0.
238:
1.170 christos 239: 20080126:
240: The posix_fadvise system call has been changed from an assembly
241: stub, to a c file that calls an assembly stub. You need to
242: 'rm -f posix_fadvise.* .depend' in the libc build directory to
243: avoid using the old assembly stub.
244:
1.168 joerg 245: 20071209:
246: The acpiec(4) driver has been split into two attachments. If you
247: get ACPI errors before the attachment, please update your kernel
1.169 wiz 248: configuration file appropriately or see GENERIC for more details.
1.168 joerg 249:
1.166 xtraeme 250: 20071115:
251: The it(4) driver has been renamed to itesio(4) and the old port
252: argument specified in the kernel configuration file is not valid
253: anymore. The itesio(4) driver now uses the Super I/O address port
254: rather than the EC address port. Please update your kernel
1.167 wiz 255: configuration file appropriately or see GENERIC for more details.
1.166 xtraeme 256:
1.165 jmmv 257: 20071028:
258: The pccons(4) driver has been removed from the NetBSD/shark port.
259: You need to update any custom kernel configuration file you have
260: to remove any references to pccons (which includes removing the
261: now useless XSERVER option) and replace them with the correct
262: entries for the wscons driver. See the GENERIC configuration file
263: for more details.
264:
1.164 gdt 265: 20070913:
266: A latent bug in dhclient/dhcpd that caused it to be unable to
267: enumerate interfaces was fixed. The bug began to cause
268: problems after 20070911 when the kernel's SIOCGIFCONF
269: implementation was repaired. From 20070529 to 20070911 racoon
270: could not enumerate interfaces. (These are noted because
271: normal kernel/userspace version matching hygiene is not
272: sufficient to avoid this problem.) Ensure that both kernel
273: and userland are from after 20070913.
274:
1.163 joerg 275: 20070703:
1.199 dholland 276: nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It
277: calls the target-specific strip program, and the logic to pass
278: down STRIP from make has been removed. This requires a
279: re-installation of tools.
1.163 joerg 280:
1.161 dsl 281: 20070422:
282: The way OS emulations lookup filenames inside the emulation root
283: has been changed. Rather than modify the pathname (and copy back
284: to userspace) namei() and lookup() directly check the emulation
285: root. One side effect is that absolute symlinks inside the emulated
1.167 wiz 286: root file system will be relative to that file system - unless they
1.161 dsl 287: start /../ this is useful when the emulated root is a real install
288: that has such links.
289: This might affect symlinks that have been added to reference outside
290: the emulated root.
291:
1.160 jmcneill 292: 20070412:
293: The pckbc driver on sgimips IP32 has been removed. Use macekbc
294: instead. See the GENERIC32_IP3x kernel configuration for an
295: example.
296:
1.159 gdt 297: 20070319:
298: src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
299: on many platforms due to incorrect flags settings. If you
300: updated and built after about 20070315, do "nbmake-$arch
301: cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
302: rebuild of object files that might have been built
303: incorrectly, and ensure that you have at least
304: src/lib/libc/Makefile 1.130.
305:
1.158 dbj 306: 20070210:
307: src/sys/sys/{sa.h,savar.h} were removed.
308: find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
309: | xargs egrep -l '/sa.h|/savar.h' | xargs rm
310: will allow dependencies on those files to get get rebuilt
311:
1.157 apb 312: 20070209:
313: The threading model was changed when the newlock2 branch
314: was merged to NetBSD-current. If you boot with a new
315: kernel (version 4.99.10), then you also need a new pthread
316: library (/usr/lib/libpthread.so.0.7). If you boot with
317: an old kernel, then you need the old pthread library
318: (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
319: the pthread library in sync, old threaded applications should
320: continue to work with an old or new kernel. Note that named(8)
321: is the only threaded application in the base system.
322:
1.154 he 323: 20061214:
324: Following the move of string_to_flags() and flags_to_string()
325: from the bin/ls/ sources to libutil, users doing UPDATE builds
326: will need to do a "make cleandir" in
327: tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
328: bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
1.156 he 329: usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
330: as the installation images in distrib/
1.154 he 331: in order to excise stale references to the old stat_flags.h header
332: file in the ls sources -- stat_flags.h has been removed.
333:
1.152 christos 334: 20061108:
335: The configure script used in the src/tools/gcc compiler has been
336: changed to indicate that our libc has ssp support built-in and
337: does not depend on -lssp and -lssp-nonshared. You'll need to
338: make clean in src/tools/gcc first to rebuild the compiler.
339:
1.151 rpaulo 340: 20061009:
341: The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
342: available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
343:
1.150 bjh21 344: 20060814:
345: The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
346: withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
347: kernel configuration for an example. X servers from the last
348: few years should cope.
349:
1.149 christos 350: 20060703:
351: MPACPI is no more. We always configure PCI interrupts using ACPI
352: if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
353: to ACPI_SCANPCI. Thanks to work from fvdl.
354:
1.148 dogcow 355: 20060627:
356: socket(2) has changed, and its system call has been versioned.
357: For userlands with the old version of socket(2), make sure that
358: your kernel has 'options COMPAT_30' set, or else 'bad system call'
359: errors will result.
360:
1.1 abs 361: Hints for a more successful build:
362: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1.123 jmc 363: Use build.sh, but do not use its "expert mode":
1.132 jmmv 364: This will automatically build the tools in the
1.123 jmc 365: correct order, and it will keep the tools and the
366: new build products from interfering with the running
367: system. This will allow you to ignore most of the
368: other advice in this file.
1.2 mrg 369: Build a new kernel first:
370: This makes sure that any new system calls or features
371: expected by the new userland will be present. This
372: helps to avoid critical errors when upgrading.
1.1 abs 373: Use object directories:
374: This helps to keep stale object
375: files from polluting the build if a Makefile "forgets"
376: about one. It also makes it easier to clean up after
377: a build. It's also necessary if you want to use the
378: same source tree for multiple machines.
1.123 jmc 379: To use object directories with build.sh:
380: a) invoke build.sh with the "-M" or "-O" options.
381: To use object directories without using build.sh:
1.1 abs 382: a) cd /usr/src ; make cleandir
1.2 mrg 383: b) Add "OBJMACHINE=yes" to /etc/mk.conf
384: c) Add "MKOBJDIRS=yes" to /etc/mk.conf
1.1 abs 385: d) cd /usr/src ; make build
1.2 mrg 386: Note that running "make obj" in a directory will create
387: in obj.$MACHINE directory.
1.1 abs 388: Build to a DESTDIR:
1.123 jmc 389: This helps to keep old installed files (especially libraries)
390: from interfering with the new build.
391: To build to a DESTDIR with build.sh, use the "-D" option.
392: To build to a DESTDIR without using build.sh, set the DESTDIR
393: environment variable before running make build. It should be
394: set to the pathname of an initially empty directory.
395: Problems: if you do not use build.sh, you might need to
396: update critical utilities without using DESTDIR since
397: nothing is executed from what is installed in DESTDIR.
398: (See critical utils, below.)
1.1 abs 399: Build often:
400: This keeps critical utilities current enough to not choke
401: on any other part of the source tree that depends on up to
1.123 jmc 402: date functionality. If you use build.sh, you should not have
403: this problem.
1.1 abs 404:
405: What to do if things don't work:
406: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
407: When things don't work there is usually a few things that commonly
408: should be done.
409: 1) make includes
410: This should be done automatically by make build.
411: 2) cd share/mk && make install
412: Again, automatically done by make build.
413:
414: Failsafe rebuild of a small part of the tree:
415: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
416: To make sure you rebuild something correctly you want to do
417: something like the following:
418: 1) Make sure the includes and .mk files are up to date.
419: 2) Make sure any program used to build the particular
420: utility is up to date. (yacc, lex, etc...)
421: 3) cd ...path/to/util...
422: make cleandir
423: rm ...all obj directories...
424: make cleandir # yes, again
425: make obj
426: make depend && make
427:
428: Failsafe rebuild of the entire tree:
429: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
430: If you really want to make sure the source tree is clean and
1.2 mrg 431: ready for a build try the following. Note that sourcing /etc/mk.conf
432: (a make(1) Makefile) in this manner is not right, and will not work
433: for anyone who uses any make(1) features in /etc/mk.conf.
1.1 abs 434:
435: ---cut here---
436: #!/bin/sh
437: . /etc/mk.conf
438:
1.58 lukem 439: if [ -z $NETBSDSRCDIR ] ; then
440: NETBSDSRCDIR=/usr/src
1.1 abs 441: fi
1.58 lukem 442: if [ \! -d $NETBSDSRCDIR ] ; then
1.1 abs 443: echo Unable to find sources
444: exit 1
445: fi
1.58 lukem 446: find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
1.1 abs 447:
448: if [ -z $BSDOBJDIR ] ; then
449: BSDOBJDIR=/usr/obj
450: fi
451: if [ -d $BSDOBJDIR ] ; then
452: rm -rf $BSDOBJDIR
453: fi
454:
1.58 lukem 455: cd $NETBSDSRCDIR && make cleandir
1.1 abs 456:
457: ---cut here---
458:
459: Critical utilities:
460: ^^^^^^^^^^^^^^^^^^^
1.3 itojun 461: usr.bin/compile_et
1.1 abs 462: usr.bin/make
463: usr.bin/yacc
464: usr.bin/lex
1.11 lukem 465: usr.bin/xlint
1.142 drochner 466: usr.bin/config
1.1 abs 467:
1.34 simonb 468: Other problems and possible solutions:
1.1 abs 469: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
470: Symptom:Complaints involving a Makefile.
1.17 erh 471: Fix: Rebuild usr.bin/make:
472: cd usr.bin/make && make && make install
1.111 simonb 473: Or, a failsafe method if that doesn't work:
1.17 erh 474: cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
475:
1.1 abs 476: Fix: Make sure .mk files are up to date.
477: cd share/mk && make install
1.2 mrg 478:
479: Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
1.142 drochner 480: Fix: Rebuild usr.bin/config
1.1 abs 481:
482: Symptom:
483: Fix: Rebuild usr.bin/yacc
484:
485: Symptom:
486: Fix: Rebuild usr.bin/lex
487:
488: Symptom:
489: Fix: rm /usr/lib/libbfd.a
1.4 itojun 490:
491: Symptom:Obsolete intermediate files are used during compilation
492: Fix: Try the following sequence of commands in the directory in question.
493: make cleandir; rm `make print-objdir`; make cleandir; make obj
494: (If you built the tree without "make obj" in the past, obsolete files
495: may remain. The command tries to clean everything up)
1.5 wiz 496:
1.207 mbalmer 497: Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible
498: pointer type
1.5 wiz 499: Fix: Rebuild and install usr.bin/menuc
1.12 itojun 500:
501: Symptom:mklocale not found during build in share/locale/ctype
502: Fix: Build and install usr.bin/mklocale
1.13 dogcow 503:
1.86 kleink 504: Symptom:undefined reference to `__assert13' or `__unsetenv13'
1.13 dogcow 505: Fix: Rebuild and install lib/libc
506:
1.142 drochner 507: Symptom:usr.bin/config fails to build.
1.19 cgd 508: Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
1.13 dogcow 509:
1.19 cgd 510: Symptom:undefined reference to `getprogname' or `setprogname'
511: Fix: Rebuild and install lib/libc
1.24 abs 512:
513: Symptom:lint does not understand the '-X' option
514: Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
CVSweb <webmaster@jp.NetBSD.org>
![[BACK]](/icons/back.gif){kind=icon}
Return to UPDATING CVS log ![[TXT]](/icons/text.gif){kind=icon}
![[DIR]](/icons/dir.gif){kind=icon}
Up to [cvs.NetBSD.org] / src