[BACK]Return to UPDATING CVS log [TXT][DIR] Up to [cvs.NetBSD.org] / src

Annotation of src/UPDATING, Revision 1.202

1.202   ! mrg         1: $NetBSD: UPDATING,v 1.201 2009/07/18 09:50:32 dsl Exp $
1.1       abs         2:
1.123     jmc         3: This file (UPDATING) is intended to be a brief reference to recent
                      4: changes that might cause problems in the build process, and a guide for
                      5: what to do if something doesn't work.
1.1       abs         6:
1.123     jmc         7: For a more detailed description of the recommended way to build NetBSD
                      8: using build.sh, see the BUILDING file.
                      9:
                     10: Note that much of the advice in this UPDATING file was written before
                     11: build.sh existed.  Nevertheless, the advice here may be useful for
                     12: working around specific problems with build.sh.
                     13:
                     14: See also: BUILDING, build.sh, Makefile.
1.1       abs        15:
                     16: Recent changes:
                     17: ^^^^^^^^^^^^^^^
1.138     lukem      18:
1.202   ! mrg        19: 20091001:
        !            20:        An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
        !            21:        symlink, failing the build.  Delete the link, and the subdir
        !            22:        it is in, and retry your build.
        !            23:
1.201     dsl        24: 20090718:
                     25:        libc build changed so that strchr() provides the extra entry
                     26:        point for index(). Update build of libc.a (and libc_pic.a)
                     27:        may fail because the archive contains the unwanted index.o.
                     28:        (Similarly for strrchr() and rindex().)
                     29:
1.198     mrg        30: 20090709:
                     31:        Native Xorg was upgraded again.  Builds will probably fail again
                     32:        without a clean objdir, at least for src/external/mit/xorg.
                     33:
1.197     mrg        34: 20090616:
                     35:        Native Xorg was upgraded.  Builds will need a clean objdir for
                     36:        src/external/mit/xorg.  Upgrading a system from sets will not
                     37:        work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
                     38:        subdirectory has been changed into a file, and this needs to
                     39:        be manually "rm -r"'ed before installing xbase.tgz.
                     40:
1.195     perry      41: 20090501:
                     42:        Several new functions were added to string.h/libc, and this
                     43:        can cause autoconf problems during the tool build for people
                     44:        who fail to clean out their tools objects properly. If you
                     45:        note messages about stpcpy, stpncpy or strnlen accompanying a
                     46:        failure during the tool build, clean out all your tools
                     47:        objects and start again.
                     48:
1.194     mrg        49: 20090325:
                     50:        The i386 port was switched to i486 default toolchain.  This requires
                     51:        cleaning your src/tools directory and $TOOLDIR and rebuilding them.
                     52:
1.192     skrll      53: 20090126:
1.193     skrll      54:        The __posix_fadvise50 system call changed assembly stub type. You need to
                     55:        'rm -f __posix_fadvise50.*' in the libc build directory to avoid using
1.192     skrll      56:        the old assembly stub.
                     57:
1.191     joerg      58: 20090202:
                     59:        pkg_install now depends on the pkgdb cache for automatic conflict
                     60:        detection.  It is recommented to rebuild the cache with
                     61:        ``pkg_admin rebuild''.
                     62:
1.184     christos   63: 20090110:
                     64:        time_t and dev_t have been bumped to 64 bit quantities. To upgrade:
                     65:        1. Make sure your kernel has COMPAT_50 in it. Build and install.
1.188     christos   66:           This is needed even in the MODULAR kernel because there is
                     67:           conditionally compiled code in rtsock.c.
1.184     christos   68:        2. make sure build.sh completes and the binaries in a chroot work
                     69:           before installing.
                     70:        3. If you don't use build.sh and you build directly to root, and
1.187     dholland   71:           your build breaks in the middle, don't despair. Make sure headers
1.184     christos   72:           are installed properly, and start building libraries first libc
                     73:           and libutil, install them and then continue building all the
                     74:           libraries in src/lib and src/gnu/lib and install them. Once
                     75:           the new libraries are installed, you can restart the build.
                     76:        4. If you compile packages and you notice link time warnings,
1.189     hubertf    77:           rebuild the required packages to update their shared libraries.
                     78:           Any package you rebuild will require rebuilding all the packages
                     79:           that depend on it.
1.186     christos   80:        5. Next time you run pwd_mkdb with the new binary, the file
                     81:           will be upgraded and it will not be backwards compatible.
1.190     apb        82:        6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
                     83:           lastlogx(5)) have been versioned, and there is a heuristic
                     84:           for utmp. You are better off removing the old files after
                     85:           upgrading.  The automated clearing of /var/run during
                     86:           boot, and the automated rotating of files in /var/log by
                     87:           newsyslog(8), may mean that you do not have to remove the
                     88:           files manually.
                     89:        7. The optional accounting file (/var/account/acct, see
                     90:           accton(8)) has not been versioned, and will need to be
                     91:           removed.  The automatic rotation of the accounting file by
                     92:           /etc/daily limits the bad consequences of failure to remove
                     93:           the file.
1.196     dholland   94:        8. Application software that writes time_t to binary files on
                     95:           disk will break or need attention. Most notably: if you are
                     96:           using PostgreSQL < 8.4, you need to dump your databases,
                     97:           rebuild PostgreSQL with the new time_t, then restore.
1.185     jmcneill   98:
1.183     pgoyette   99: 20081219:
                    100:        config(1) has been updated, and one of the files it creates -
                    101:        swapnetbsd.o - has changed format.  You need to rebuild config
                    102:        (done automatically by build.sh) and then you need to rerun
                    103:        config on all kernel configuration files before rebuilding those
                    104:        kernels.
                    105:
1.181     cube      106: 20081205:
                    107:        If you build with MKX11=no, you should remove /etc/rc.d/xdm and
                    108:        /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
                    109:        set and will appear as extra files for MKX11=no update builds.
1.178     lukem     110:
1.179     tsutsui   111: 20081122:
1.182     tsutsui   112:        On i386, various kernel options(4) in GENERIC including
1.180     wiz       113:        file systems have been disabled and moved into kernel modules.
                    114:        Before trying a new GENERIC kernel, you have to prepare the
1.179     tsutsui   115:        following files as well as a new GENERIC kernel:
                    116:
                    117:        - build and install kernel modules from src/sys/modules
                    118:
                    119:        - install the latest bootloader, which will load a module
1.180     wiz       120:          for the file system from which the kernel is loaded automatically
1.179     tsutsui   121:
1.180     wiz       122:        If you have to load your kernel from a file system which is not of
                    123:        the same type as the root file system, you have to load the necessary
                    124:        file system module manually on the boot prompt or in the boot.cfg file.
1.179     tsutsui   125:
1.178     lukem     126: 20080827:
                    127:        If you built and installed a libc from sources between
                    128:        2008/08/20 and 2008/08/26 you got a broken strtouq(3)
                    129:        which results in false errors reported by lint(1).
                    130:        Since this breaks the libc build itself, manual help is
1.180     wiz       131:        needed -- lint must be disabled temporarily, e.g.:
1.178     lukem     132:          $ (cd lib/libc && make MKLINT=no dependall install)
                    133:
1.177     christos  134: 20080813:
                    135:        MKDEBUG build was broken because the .depend files did not know
                    136:        about .go files. You need to remove all .depend files and rebuild.
                    137:
1.200     dholland  138: 20080802:
                    139:        A regression in binary compatibility for pthread_mutex_t has
                    140:        been fixed. Unfortunately, the price is breaking compatibility
                    141:        for -current.
                    142:
                    143:        Threaded programs (using libpthread) and C++ programs (using
                    144:        libstdc++) compiled after 20070907 and before 20080802 need to
                    145:        be recompiled.
                    146:
                    147:        One way to find affected pkgsrc packages:
                    148:
                    149:          $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
                    150:          $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
                    151:
1.175     simonb    152: 20080731:
                    153:        WAPBL (metadata journaling support) has been added, but at this
                    154:        time isn't backwards compatible with pre-WAPBL aware kernels
                    155:        and userland (fsck_ffs in particular).  Please make sure you
                    156:        don't use a journaled filesystem with an older kernel/userland,
1.176     simonb    157:        especially an uncleanly mounted journaled filesystem.  WAPBL
                    158:        also requires the super block to be in the UFS2 format.  You
                    159:        can use fsck_ffs -c 4 to update the superblock format.
1.175     simonb    160:
1.174     lukem     161: 20080721:
                    162:        Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
                    163:        isn't defined.
                    164:
1.173     freza     165: 20080531:
                    166:        The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
                    167:        from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
                    168:        utility needs to be rebuilt and reinstalled as older binaries
                    169:        won't work correctly. The following sequence of commands:
                    170:
                    171:          $ (cd sys/sys/ && nbmake-$arch includes)
                    172:          $ (cd sbin/drvctl/ && nbmake-$arch clean)
                    173:          $ (cd sbin/drvctl/ && nbmake-$arch all)
                    174:
                    175:        leaves new drvctl utility in sbin/drvctl build directory.
                    176:
1.172     lukem     177: 20080503:
                    178:        The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
                    179:
1.171     he        180: 20080521:
                    181:        For a while, unprivileged UPDATE builds would fail to
                    182:        succeed at the checkflist stage, complaining that
                    183:        ${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
                    184:        problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
                    185:        If you already hit this problem, update the .mk file,
                    186:        remove ${DESTDIR}/stand/<arch>, and re-run the build.
                    187:
1.174     lukem     188: 20080303:
                    189:        Linker warnings are now fatal if $WARNS>0.
                    190:
1.170     christos  191: 20080126:
                    192:        The posix_fadvise system call has been changed from an assembly
                    193:        stub, to a c file that calls an assembly stub. You need to
                    194:        'rm -f posix_fadvise.* .depend' in the libc build directory to
                    195:        avoid using the old assembly stub.
                    196:
1.168     joerg     197: 20071209:
                    198:        The acpiec(4) driver has been split into two attachments. If you
                    199:        get ACPI errors before the attachment, please update your kernel
1.169     wiz       200:        configuration file appropriately or see GENERIC for more details.
1.168     joerg     201:
1.166     xtraeme   202: 20071115:
                    203:        The it(4) driver has been renamed to itesio(4) and the old port
                    204:        argument specified in the kernel configuration file is not valid
                    205:        anymore. The itesio(4) driver now uses the Super I/O address port
                    206:        rather than the EC address port. Please update your kernel
1.167     wiz       207:        configuration file appropriately or see GENERIC for more details.
1.166     xtraeme   208:
1.165     jmmv      209: 20071028:
                    210:        The pccons(4) driver has been removed from the NetBSD/shark port.
                    211:        You need to update any custom kernel configuration file you have
                    212:        to remove any references to pccons (which includes removing the
                    213:        now useless XSERVER option) and replace them with the correct
                    214:        entries for the wscons driver.  See the GENERIC configuration file
                    215:        for more details.
                    216:
1.164     gdt       217: 20070913:
                    218:        A latent bug in dhclient/dhcpd that caused it to be unable to
                    219:        enumerate interfaces was fixed.  The bug began to cause
                    220:        problems after 20070911 when the kernel's SIOCGIFCONF
                    221:        implementation was repaired.  From 20070529 to 20070911 racoon
                    222:        could not enumerate interfaces.  (These are noted because
                    223:        normal kernel/userspace version matching hygiene is not
                    224:        sufficient to avoid this problem.)  Ensure that both kernel
                    225:        and userland are from after 20070913.
                    226:
1.163     joerg     227: 20070703:
1.199     dholland  228:        nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It
                    229:        calls the target-specific strip program, and the logic to pass
                    230:        down STRIP from make has been removed.  This requires a
                    231:        re-installation of tools.
1.163     joerg     232:
1.161     dsl       233: 20070422:
                    234:        The way OS emulations lookup filenames inside the emulation root
                    235:        has been changed.  Rather than modify the pathname (and copy back
                    236:        to userspace) namei() and lookup() directly check the emulation
                    237:        root. One side effect is that absolute symlinks inside the emulated
1.167     wiz       238:        root file system will be relative to that file system - unless they
1.161     dsl       239:        start /../ this is useful when the emulated root is a real install
                    240:        that has such links.
                    241:        This might affect symlinks that have been added to reference outside
                    242:        the emulated root.
                    243:
1.160     jmcneill  244: 20070412:
                    245:        The pckbc driver on sgimips IP32 has been removed. Use macekbc
                    246:        instead. See the GENERIC32_IP3x kernel configuration for an
                    247:        example.
                    248:
1.159     gdt       249: 20070319:
                    250:         src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
                    251:         on many platforms due to incorrect flags settings.  If you
                    252:         updated and built after about 20070315, do "nbmake-$arch
                    253:        cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
                    254:        rebuild of object files that might have been built
                    255:        incorrectly, and ensure that you have at least
                    256:        src/lib/libc/Makefile 1.130.
                    257:
1.158     dbj       258: 20070210:
                    259:         src/sys/sys/{sa.h,savar.h} were removed.
                    260:           find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
                    261:               | xargs egrep -l '/sa.h|/savar.h' | xargs rm
                    262:         will allow dependencies on those files to get get rebuilt
                    263:
1.157     apb       264: 20070209:
                    265:         The threading model was changed when the newlock2 branch
                    266:         was merged to NetBSD-current.  If you boot with a new
                    267:         kernel (version 4.99.10), then you also need a new pthread
                    268:         library (/usr/lib/libpthread.so.0.7).  If you boot with
                    269:         an old kernel, then you need the old pthread library
                    270:         (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
                    271:         the pthread library in sync, old threaded applications should
                    272:         continue to work with an old or new kernel.  Note that named(8)
                    273:        is the only threaded application in the base system.
                    274:
1.154     he        275: 20061214:
                    276:        Following the move of string_to_flags() and flags_to_string()
                    277:        from the bin/ls/ sources to libutil, users doing UPDATE builds
                    278:        will need to do a "make cleandir" in
                    279:                tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
                    280:                bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
1.156     he        281:                usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
                    282:                as the installation images in distrib/
1.154     he        283:        in order to excise stale references to the old stat_flags.h header
                    284:        file in the ls sources -- stat_flags.h has been removed.
                    285:
1.152     christos  286: 20061108:
                    287:        The configure script used in the src/tools/gcc compiler has been
                    288:        changed to indicate that our libc has ssp support built-in and
                    289:        does not depend on -lssp and -lssp-nonshared. You'll need to
                    290:        make clean in src/tools/gcc first to rebuild the compiler.
                    291:
1.151     rpaulo    292: 20061009:
                    293:        The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
                    294:        available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
                    295:
1.150     bjh21     296: 20060814:
                    297:        The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
                    298:        withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
                    299:        kernel configuration for an example.  X servers from the last
                    300:        few years should cope.
                    301:
1.149     christos  302: 20060703:
                    303:        MPACPI is no more. We always configure PCI interrupts using ACPI
                    304:        if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
                    305:        to ACPI_SCANPCI. Thanks to work from fvdl.
                    306:
1.148     dogcow    307: 20060627:
                    308:        socket(2) has changed, and its system call has been versioned.
                    309:        For userlands with the old version of socket(2), make sure that
                    310:        your kernel has 'options COMPAT_30' set, or else 'bad system call'
                    311:        errors will result.
                    312:
1.1       abs       313: Hints for a more successful build:
                    314: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1.123     jmc       315:     Use build.sh, but do not use its "expert mode":
1.132     jmmv      316:        This will automatically build the tools in the
1.123     jmc       317:           correct order, and it will keep the tools and the
                    318:           new build products from interfering with the running
                    319:           system.  This will allow you to ignore most of the
                    320:           other advice in this file.
1.2       mrg       321:     Build a new kernel first:
                    322:        This makes sure that any new system calls or features
                    323:           expected by the new userland will be present.  This
                    324:           helps to avoid critical errors when upgrading.
1.1       abs       325:     Use object directories:
                    326:        This helps to keep stale object
                    327:           files from polluting the build if a Makefile "forgets"
                    328:           about one.  It also makes it easier to clean up after
                    329:           a build.  It's also necessary if you want to use the
                    330:           same source tree for multiple machines.
1.123     jmc       331:           To use object directories with build.sh:
                    332:            a) invoke build.sh with the "-M" or "-O" options.
                    333:           To use object directories without using build.sh:
1.1       abs       334:            a) cd /usr/src ; make cleandir
1.2       mrg       335:            b) Add "OBJMACHINE=yes" to /etc/mk.conf
                    336:            c) Add "MKOBJDIRS=yes" to /etc/mk.conf
1.1       abs       337:            d) cd /usr/src ; make build
1.2       mrg       338:           Note that running "make obj" in a directory will create
                    339:           in obj.$MACHINE directory.
1.1       abs       340:     Build to a DESTDIR:
1.123     jmc       341:        This helps to keep old installed files (especially libraries)
                    342:           from interfering with the new build.
                    343:           To build to a DESTDIR with build.sh, use the "-D" option.
                    344:           To build to a DESTDIR without using build.sh, set the DESTDIR
                    345:           environment variable before running make build.  It should be
                    346:           set to the pathname of an initially empty directory.
                    347:           Problems: if you do not use build.sh, you might need to
                    348:                update critical utilities without using DESTDIR since
                    349:                nothing is executed from what is installed in DESTDIR.
                    350:                (See critical utils, below.)
1.1       abs       351:     Build often:
                    352:        This keeps critical utilities current enough to not choke
                    353:        on any other part of the source tree that depends on up to
1.123     jmc       354:        date functionality.  If you use build.sh, you should not have
                    355:        this problem.
1.1       abs       356:
                    357: What to do if things don't work:
                    358: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                    359: When things don't work there is usually a few things that commonly
                    360: should be done.
                    361:     1) make includes
                    362:        This should be done automatically by make build.
                    363:     2)  cd share/mk && make install
                    364:        Again, automatically done by make build.
                    365:
                    366: Failsafe rebuild of a small part of the tree:
                    367: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                    368: To make sure you rebuild something correctly you want to do
                    369: something like the following:
                    370:     1)  Make sure the includes and .mk files are up to date.
                    371:     2)  Make sure any program used to build the particular
                    372:        utility is up to date.  (yacc, lex, etc...)
                    373:     3)  cd ...path/to/util...
                    374:        make cleandir
                    375:        rm ...all obj directories...
                    376:        make cleandir                   # yes, again
                    377:        make obj
                    378:        make depend && make
                    379:
                    380: Failsafe rebuild of the entire tree:
                    381: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                    382: If you really want to make sure the source tree is clean and
1.2       mrg       383: ready for a build try the following.  Note that sourcing /etc/mk.conf
                    384: (a make(1) Makefile) in this manner is not right, and will not work
                    385: for anyone who uses any make(1) features in /etc/mk.conf.
1.1       abs       386:
                    387: ---cut here---
                    388: #!/bin/sh
                    389: . /etc/mk.conf
                    390:
1.58      lukem     391: if [ -z $NETBSDSRCDIR ] ; then
                    392:     NETBSDSRCDIR=/usr/src
1.1       abs       393: fi
1.58      lukem     394: if [ \! -d $NETBSDSRCDIR ] ; then
1.1       abs       395:     echo Unable to find sources
                    396:     exit 1
                    397: fi
1.58      lukem     398: find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
1.1       abs       399:
                    400: if [ -z $BSDOBJDIR ] ; then
                    401:     BSDOBJDIR=/usr/obj
                    402: fi
                    403: if [ -d $BSDOBJDIR ] ; then
                    404:     rm -rf $BSDOBJDIR
                    405: fi
                    406:
1.58      lukem     407: cd $NETBSDSRCDIR && make cleandir
1.1       abs       408:
                    409: ---cut here---
                    410:
                    411: Critical utilities:
                    412: ^^^^^^^^^^^^^^^^^^^
1.3       itojun    413:        usr.bin/compile_et
1.1       abs       414:        usr.bin/make
                    415:        usr.bin/yacc
                    416:        usr.bin/lex
1.11      lukem     417:        usr.bin/xlint
1.142     drochner  418:        usr.bin/config
1.1       abs       419:
1.34      simonb    420: Other problems and possible solutions:
1.1       abs       421: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                    422: Symptom:Complaints involving a Makefile.
1.17      erh       423: Fix:   Rebuild usr.bin/make:
                    424:        cd usr.bin/make && make && make install
1.111     simonb    425:        Or, a failsafe method if that doesn't work:
1.17      erh       426:        cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
                    427:
1.1       abs       428: Fix:   Make sure .mk files are up to date.
                    429:        cd share/mk && make install
1.2       mrg       430:
                    431: Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
1.142     drochner  432: Fix:   Rebuild usr.bin/config
1.1       abs       433:
                    434: Symptom:
                    435: Fix:   Rebuild usr.bin/yacc
                    436:
                    437: Symptom:
                    438: Fix:   Rebuild usr.bin/lex
                    439:
                    440: Symptom:
                    441: Fix:   rm /usr/lib/libbfd.a
1.4       itojun    442:
                    443: Symptom:Obsolete intermediate files are used during compilation
                    444: Fix:   Try the following sequence of commands in the directory in question.
                    445:        make cleandir; rm `make print-objdir`; make cleandir; make obj
                    446:        (If you built the tree without "make obj" in the past, obsolete files
                    447:        may remain.  The command tries to clean everything up)
1.5       wiz       448:
                    449: Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
                    450: Fix:   Rebuild and install usr.bin/menuc
1.12      itojun    451:
                    452: Symptom:mklocale not found during build in share/locale/ctype
                    453: Fix:   Build and install usr.bin/mklocale
1.13      dogcow    454:
1.86      kleink    455: Symptom:undefined reference to `__assert13' or `__unsetenv13'
1.13      dogcow    456: Fix:    Rebuild and install lib/libc
                    457:
1.142     drochner  458: Symptom:usr.bin/config fails to build.
1.19      cgd       459: Fix:   Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
1.13      dogcow    460:
1.19      cgd       461: Symptom:undefined reference to `getprogname' or `setprogname'
                    462: Fix:    Rebuild and install lib/libc
1.24      abs       463:
                    464: Symptom:lint does not understand the '-X' option
                    465: Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint

CVSweb <webmaster@jp.NetBSD.org>