Annotation of src/UPDATING, Revision 1.79
1.79 ! wiz 1: $NetBSD: UPDATING,v 1.78 2002/12/04 12:50:43 lukem Exp $
1.1 abs 2:
3: This file is intended to be a brief introduction to the build
4: process and a reference on what to do if something doesn't work.
5:
6: For a more detailed description see Makefile.
7:
8: Recent changes:
9: ^^^^^^^^^^^^^^^
1.78 lukem 10:
11: 20021130:
12: fparseln(3) moved from libutil to libc.
13: If building to DESTDIR=/, reinstall the includes
14: and rebuild libc:
15: make includes
16: make do-lib-libc
17: If using build.sh, "cd tools/compat && make clean"
18: before rebuilding the tools.
1.77 lukem 19:
20: 20021126:
21: The mk.conf(5) variable SYS_INCLUDE has been deprecated,
22: including the optional "SYS_INCLUDE=symlinks" support.
23: All header files, including <sys/*.h> are copied into
24: /usr/include.
1.76 thorpej 25:
26: 20021121:
27: The C run-time support files crtbegin.o and crtend.o
28: (and their companions crtbeginS.o and crtendS.o) were
29: split up, with new crti.o and crtn.o files resulting.
30: This means that libtool needs to be rebuilt once the
31: new libraries are installed. The process of rebuilding
32: libtool will cause it to automatically notice the new
33: required files, but it *must* be rebuilt in order to
34: do this.
35:
36: An out-of-date libtool will result in shared libraries
37: which lack _init() and _fini() routines, which means that
38: their global contructors/destructors will not be invoked.
1.75 thorpej 39:
40: 20021121:
41: A bug related to how ARM ELF objects were tagged has been
42: corrected.
43:
44: NetBSD ARM ELF uses the soft-VFP floating point model by
45: default. However, the assembler lacked support for marking
46: objects as using the VFP floating point format, and the
1.79 ! wiz 47: compiler was not properly passing the flag indicating "soft-VFP"
1.75 thorpej 48: to the assembler.
49:
50: Unfortunately, this means that the linker will now consider
51: old (i.e. not marked "softvfp") NetBSD ARM ELF objects to be
52: incompatible with new (properly marked) objects.
53:
54: The problem will only manifest itself if you attempt to compile
55: a new program using the fixed toolchain, and link that program
56: against old libraries which do not have the proper "softvfp"
57: markings. ALL OF YOUR EXISTING BINARIES AND SHARED LIBRARIES
58: WILL CONTINUE TO WORK PROPERLY.
59:
60: The only work-around for the problem is to recompile all of
61: the libraries on the system. The easiest way to do this for
1.79 ! wiz 62: system libraries is to install a binary snapshot; they are
1.75 thorpej 63: generally available on releng.netbsd.org. Any packages you
64: have installed which supply libraries will have to be recompiled
65: if you wish to link new programs against those libraries.
66:
67: If you have questions about this matter, please contact
68: port-arm@netbsd.org.
1.73 provos 69:
70: 20021011:
71: Systrace has been improved to support privilege elevation.
72: Updating the kernel requires the userland part of systrace
1.79 ! wiz 73: to be rebuilt.
1.72 thorpej 74:
75: 20021010:
76: The config(8) grammar was changed to allow options to register
77: dependencies on attributes, as well as other options. Users
78: must update and reinstall usr.sbin/config before building a new
79: kernel.
1.70 thorpej 80:
81: 20021009:
82: A new attribute dependency syntax was introduced to config(8),
83: which is now used by the SCSI configuration description. Users
1.71 wiz 84: must update and reinstall usr.sbin/config before building a new
1.70 thorpej 85: kernel.
1.69 thorpej 86:
87: 20021003:
88: Several changes have been made to the autoconfiguration
89: framework. Users must update and reinstall usr.sbin/config
90: before building a new kernel.
1.74 jschauma 91:
92: 20021001:
93: The i386mp branch has been merged. To compile a kernel, users
94: will need to add the option 'cpu* at mainbus?' to their configuration
95: file. Multiprocessor kernels will need
96: ioapic* at mainbus? apid ?
97: options MULTIPROCESSOR
98: options COM_MPLOCK
1.68 lukem 99:
100: 20020922:
101: MKDYNAMICROOT=yes enabled by default, which means that
102: certain shared libraries are installed into /lib, the shared
103: linker is installed into /libexec, and all programs in /bin
104: and /sbin are dynamically linked.
105: If you do not use "make build", you should ensure that
106: you have the libraries and shared linker in the new locations,
107: with:
108: make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so
1.67 lukem 109:
110: 20020917:
111: USE_NEW_TOOLCHAIN has been replaced with:
112: - TOOLCHAIN_MISSING -- set to "yes" on platforms for which
113: there is no working in-tree toolchain (hppa, ns32k, sh5,
114: x86_64).
115: - EXTERNAL_TOOLCHAIN -- if defined by the user, points to the
1.79 ! wiz 116: root of an external toolchain (e.g. /usr/local/gnu). This
1.67 lukem 117: enables the cross-build framework even for TOOLCHAIN_MISSING
118: platforms.
1.66 gehenna 119:
120: 20020906:
121: gehenna-devsw has been merged into the trunk. Need to update and
1.79 ! wiz 122: reinstall usr.sbin/config before building the kernel.
1.65 lukem 123:
124: 20020822:
125: Crunched rescue tools (contents of /bin and /sbin, plus others)
126: are now provided in /rescue.
127:
128: To ensure that these are built statically linked (no matter
129: what the setting of LDSTATIC is), use a crunchgen(1) built
130: from sources newer than 20020820 (see the next entry).
131:
132: 20020820:
133: crunchgen(1) changed to ensure that the generated program
134: is statically linked.
135:
136: Solution: update and reinstall usr.bin/crunch
1.61 itojun 137:
138: 20020515:
139: sshd user/group has been added. Need to hand add this in, or sshd
140: will not let you log in (with default, or UsePrivlegeSeparation=yes)
141:
142: Add the following into /etc/group:
143:
144: sshd:*:16:
145:
146: and the following to /etc/master.passwd (via vipw):
147:
1.63 enami 148: sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin
1.61 itojun 149:
1.79 ! wiz 150: Also /var/chroot/sshd directory needs to be present (digged as part of
! 151: the build process).
1.60 sommerfe 152:
153: 20020426:
154: NBUILDJOBS obsoleted in favor of just using -j.
1.59 lukem 155:
156: 20020426:
157: etc/postinstall added, which performs various checks for
158: configuration file updates and changes, and can fix most of
159: the problems identified.
160: This should make it much easier to upgrade a system's
161: configuration from earlier systems (as far back as NetBSD 1.5).
1.56 lukem 162:
163: 20020320:
1.79 ! wiz 164: <bsd.lib.mk> needs a new install(1) for its "-a cmd" support.
! 165: Build and install at usr.bin/xinstall before the build.
1.56 lukem 166:
1.55 itojun 167: 20020319:
1.79 ! wiz 168: Raw IPv6 socket now makes strict checking for sa_family and sa_len
! 169: on send(2) operation. Be sure to have sbin/rtsol and usr.sbin/rtsold
1.55 itojun 170: newer than November 2001 when you upgrade the kernel.
171:
1.54 itojun 172: 20020311:
173: ssh configuration files were moved from /etc to /etc/ssh. Beware
174: if you restart your machine from remote. Note that sshd.conf needs
175: to be changed (due to the use of "/etc" inside).
176:
177: 20020223:
1.53 matt 178: Users of the VAX port will need to rebuild and install gas
179: so it deal with the now present register prefix used in all
180: the VAX assembly files.
181:
1.50 itojun 182: 20020118:
183: ntpd user/group has been added. Need to hand add this in or builds
184: will break as mtree aborts early.
185:
186: Add the following into /etc/group:
187:
188: ntpd:*:15:
189:
190: and the following to /etc/master.passwd (via vipw):
191:
192: ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin
193:
1.49 jmc 194: 20011207:
195: If you're attempting to build a snapshot on sparc64 and are getting
196: reloc errors from the toolchain groff binary this means your native
197: toolchain has some broken C++ bits.
198:
199: To fix:
200:
201: Build a new toolchain (i.e. build.sh -t)
202: Use the new toolchain to build and install natively (i.e. /usr/lib)
203:
204: gnu/lib/libgcc
1.51 pooka 205: gnu/lib/libstdc++
1.49 jmc 206:
207: After this a snapshot will be able to be built.
208:
1.47 jmc 209: 20011201:
210: In order for a sparc64 build to work you must have a working awk. If
211: you've built and installed a system with the new toolchain up to this
1.52 wiz 212: point you do not have a working awk as its ability to do floating
1.47 jmc 213: point is broken.
214:
215: To build:
216:
217: remake and install gnu/lib/libgcc
218: remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links
1.48 jmc 219: against the new libgcc.a)
1.47 jmc 220:
1.46 thorpej 221: 20011128:
222: Kernel config information was changed to use defflag in
223: the various "files" files. Bug fixes to config(8) are
224: required in order for this to work properly. Make sure
225: to build and install in usr.sbin/config before attempting
226: to build a new kernel.
227:
1.45 yamt 228: 20011030:
229: libc/locale/wcstod.c now needs new lint(1). Update lint(1)
230: before building libc.
1.43 mason 231:
1.44 tv 232: 20011029:
233: The new document BUILDING.mdoc (view with nroff | more, or
234: see pre-generated .txt and .html versions) describes the build
235: procedure in great detail. BUILDING, and the USE_NEW_TOOLCHAIN
236: build process, are intended in the long run to replace this
237: manual update log.
238:
239: Users building a USE_NEW_TOOLCHAIN system should read the
240: BUILDING document for caveats. Generally, BUILDING supersedes
241: UPDATING for these systems, as tool updating is taken care of
242: by the new build system.
1.42 perry 243:
244: 20011028:
245: src/etc/Makefile now needs install to be able to handle
246: symlinks that point to nowhere. A bug in install that
247: prevented this was corrected.
248:
249: Solution: update and reinstall usr.bin/xinstall
250: Better Solution: Use the new toolchain and it will just work
251: for you.
1.40 lukem 252:
253: 20011006:
254: /etc/mtree/NetBSD.dist has been updated to take advantage of
255: absolute path support added to mtree(8). Older mtree(8)s don't
256: understand the format.
257:
258: Solution: update and reinstall usr.sbin/mtree
1.39 jmc 259:
260: 20011004:
261: Crunchgen has been updated to work via reach-over makefiles. Updating
262: is suggested before running a snapshot build
1.36 tv 263:
1.35 thorpej 264: 20010915:
265: The new "ubcperf" code committed by Chuck Silvers removed
266: a header file, uvm/uvm_vnode.h. There may be stale .depend
267: files that still reference this file.
268:
269: Solution: "make cleandir && make dependall" in affected
270: directories.
1.31 enami 271:
272: 20010803:
273: grep.info is now built from grep.texi using makeinfo. Since it
274: requires makeinfo v4.0, you need to install new texinfo before
275: building gnu/usr.bin/grep. To install new texinfo, please follow
276: the instruction described in 20010726 entry.
1.30 enami 277:
1.64 sommerfe 278: 20010803:
1.41 wiz 279: (i386 only): i386 kernel now uses new instructions like
280: `fxsave' which old gas doesn't understand. To build the
1.64 sommerfe 281: kernel successfully, you need to build and install a new toolchain,
282: (i.e., build.sh -t) or (temporarily) comment out "options I686_CPU"
283: from your kernel configuration until you rebuild your userland.
284: See 20011029 above and BUILDING file in this directory for more information.
285: [updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled]
1.29 bjh21 286:
287: 20010731:
288: Bootloader update on ELF platforms. DDB in kernels from before
289: this will be unable to read symbol tables provided by newer
290: bootloaders.
1.27 assar 291:
292: 20010726:
293: Texinfo was updated to 4.0. To avoid failures when trying to
1.28 assar 294: build the included texinfo files, do:
295:
296: cd src/gnu/usr.bin/texinfo
297: make MKINFO=no dependall install
1.25 thorpej 298:
299: 20010718:
300: Enabled correct .init/.fini processing in crt0. The way this
301: was done was to change a -I directive to cc(1), which means
302: make(1) will have a stale dependency (it will be checking the
303: timestamp on the wrong "dot_init.h").
304:
305: The symptom you will see is that new programs die with SIGSEGV
306: if you have a stale dependency.
307:
308: Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so
309: before starting your build.
1.26 thorpej 310:
311: 20010628:
312: A construct was added to uvm_page.h that uncovered a bug
313: in lint(1). If you get a warning/error about a non-portable
314: bitfield, update your lint(1) before proceeding.
1.21 jmc 315:
316: 20010226:
1.22 jmc 317: Added named user/group to system. Need to hand add this in or builds
1.21 jmc 318: will break as mtree aborts early.
319:
320: To work around add by hand:
321:
322: named:*:14:
323:
1.22 jmc 324: to /etc/group and add:
325:
326: named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin
327:
328: to master.passwd (use vipw for instance if doing by hand).
329:
330: Now a make build should progress.
1.18 jmc 331:
332: 20010219:
1.52 wiz 333: get/setprogname() added. Any hostprogs that may use this will need
1.20 jmc 334: to be bootstrapped manually until the host system is current.
1.18 jmc 335:
336: Known problems: sys/arch/macppc/stand/fixcoff
1.19 cgd 337: usr.sbin/config (adding -DMAKE_BOOTSTRAP to
338: CFLAGS and rebuilding should work)
1.20 jmc 339: usr.sbin/mdsetimage - Build a static copy if
340: building a snapshot before fully bootstrapped.
1.15 christos 341:
342: 20010204:
343: prepare the code to compile with stricter gcc flags. in
344: particular start eliminating redundant declarations. Yacc
345: needs to be installed before make build.
1.10 christos 346:
347: 20010114:
348: introduce .if commands(target) in make(1). You need to
349: bring everything up-to-date first, then without installing
1.23 tron 350: anything make and install in usr.bin/make, then proceed
1.10 christos 351: with make build.
1.9 sommerfe 352:
353: 20010101:
354: bsd.subdir.mk committed 20001230 had a bug which caused
355: afterinstall targets to run too soon; update again.
1.8 sommerfe 356:
357: 20001230:
358: New share/mk files needed to support .WAIT in SUBDIR variables.
359: If you get make errors,
360: (cd share/mk; make install)
361: Also, PRINTOBJDIR has changed and is now used more heavily.
1.6 ad 362:
363: 20001019:
1.7 ad 364: The `ca' device driver has been replaced by `ld'; although the
1.6 ad 365: major and minor numbers haven't changed, you should update your /dev
366: directory.
1.1 abs 367:
1.4 itojun 368: 20000929:
369: The following make directives are obsoleted.
370: MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA
371: By default, RSA is built into libcrypto. IDEA and RC5 will not be
1.16 wiz 372: built into libcrypto. By using MKCRYPTO_{RC5,IDEA}, you can build
1.4 itojun 373: additional library libcrypto_{idea,rc5}.
1.1 abs 374:
375:
376: Hints for a more successful build:
377: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1.2 mrg 378: Build a new kernel first:
379: This makes sure that any new system calls or features
380: expected by the new userland will be present. This
381: helps to avoid critical errors when upgrading.
1.1 abs 382: Use object directories:
383: This helps to keep stale object
384: files from polluting the build if a Makefile "forgets"
385: about one. It also makes it easier to clean up after
386: a build. It's also necessary if you want to use the
387: same source tree for multiple machines.
388: To use object directories:
389: a) cd /usr/src ; make cleandir
1.2 mrg 390: b) Add "OBJMACHINE=yes" to /etc/mk.conf
391: c) Add "MKOBJDIRS=yes" to /etc/mk.conf
1.1 abs 392: d) cd /usr/src ; make build
1.2 mrg 393: Note that running "make obj" in a directory will create
394: in obj.$MACHINE directory.
1.1 abs 395: Build to a DESTDIR:
396: This helps to keep old
397: installed files (especially libraries) from interfering
398: with the new build.
399: To build to a DESTDIR, set the DESTDIR environment
1.2 mrg 400: variable before running make build. It should be set to
401: the pathname of an initially empty directory.
1.1 abs 402: Problems: you might need to update critical utilities
403: without using DESTDIR since nothing is executed
404: from what is installed in DESTDIR.
405: (See critical utils, below)
406: Build often:
407: This keeps critical utilities current enough to not choke
408: on any other part of the source tree that depends on up to
409: date functionality.
410:
411: What to do if things don't work:
412: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
413: When things don't work there is usually a few things that commonly
414: should be done.
415: 1) make includes
416: This should be done automatically by make build.
417: 2) cd share/mk && make install
418: Again, automatically done by make build.
419:
420: Failsafe rebuild of a small part of the tree:
421: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
422: To make sure you rebuild something correctly you want to do
423: something like the following:
424: 1) Make sure the includes and .mk files are up to date.
425: 2) Make sure any program used to build the particular
426: utility is up to date. (yacc, lex, etc...)
427: 3) cd ...path/to/util...
428: make cleandir
429: rm ...all obj directories...
430: make cleandir # yes, again
431: make obj
432: make depend && make
433:
434: Failsafe rebuild of the entire tree:
435: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
436: If you really want to make sure the source tree is clean and
1.2 mrg 437: ready for a build try the following. Note that sourcing /etc/mk.conf
438: (a make(1) Makefile) in this manner is not right, and will not work
439: for anyone who uses any make(1) features in /etc/mk.conf.
1.1 abs 440:
441: ---cut here---
442: #!/bin/sh
443: . /etc/mk.conf
444:
1.58 lukem 445: if [ -z $NETBSDSRCDIR ] ; then
446: NETBSDSRCDIR=/usr/src
1.1 abs 447: fi
1.58 lukem 448: if [ \! -d $NETBSDSRCDIR ] ; then
1.1 abs 449: echo Unable to find sources
450: exit 1
451: fi
1.58 lukem 452: find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
1.1 abs 453:
454: if [ -z $BSDOBJDIR ] ; then
455: BSDOBJDIR=/usr/obj
456: fi
457: if [ -d $BSDOBJDIR ] ; then
458: rm -rf $BSDOBJDIR
459: fi
460:
1.58 lukem 461: cd $NETBSDSRCDIR && make cleandir
1.1 abs 462:
463: ---cut here---
464:
465: Critical utilities:
466: ^^^^^^^^^^^^^^^^^^^
467: gnu/usr.bin/egcs
1.3 itojun 468: usr.bin/compile_et
1.1 abs 469: usr.bin/make
470: usr.bin/yacc
471: usr.bin/lex
1.11 lukem 472: usr.bin/xlint
1.2 mrg 473: usr.sbin/config
1.1 abs 474:
1.34 simonb 475: Other problems and possible solutions:
1.1 abs 476: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
477: Symptom:Unreasonable compiler errors.
478: Fix: Rebuild gnu/usr.bin/egcs
479:
480: Symptom:Complaints involving a Makefile.
1.17 erh 481: Fix: Rebuild usr.bin/make:
482: cd usr.bin/make && make && make install
483: Or, a failsafe method if that doesn't work:
484: cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
485:
1.1 abs 486: Fix: Make sure .mk files are up to date.
487: cd share/mk && make install
1.2 mrg 488:
489: Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
490: Fix: Rebuild usr.sbin/config
1.1 abs 491:
492: Symptom:
493: Fix: Rebuild usr.bin/yacc
494:
495: Symptom:
496: Fix: Rebuild usr.bin/lex
497:
498: Symptom:
499: Fix: rm /usr/lib/libbfd.a
1.4 itojun 500:
501: Symptom:Obsolete intermediate files are used during compilation
502: Fix: Try the following sequence of commands in the directory in question.
503: make cleandir; rm `make print-objdir`; make cleandir; make obj
504: (If you built the tree without "make obj" in the past, obsolete files
505: may remain. The command tries to clean everything up)
1.5 wiz 506:
507: Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
508: Fix: Rebuild and install usr.bin/menuc
1.12 itojun 509:
510: Symptom:mklocale not found during build in share/locale/ctype
511: Fix: Build and install usr.bin/mklocale
1.13 dogcow 512:
513: Symptom:undefined reference to `__assert13'
514: Fix: Rebuild and install lib/libc
515:
1.19 cgd 516: Symptom:usr.sbin/config fails to build.
517: Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
1.13 dogcow 518:
1.19 cgd 519: Symptom:undefined reference to `getprogname' or `setprogname'
520: Fix: Rebuild and install lib/libc
1.24 abs 521:
522: Symptom:lint does not understand the '-X' option
523: Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
CVSweb <webmaster@jp.NetBSD.org>