The NetBSD Project

CVS log for src/sys/ufs/lfs/lfs.h

[BACK] Up to [cvs.netbsd.org] / src / sys / ufs / lfs

Request diff between arbitrary revisions


Default branch: MAIN


Revision 1.134.2.2 / (download) - annotate - [select for diffs], Tue Apr 17 00:08:56 2012 UTC (5 weeks, 4 days ago) by yamt
Branch: yamt-pagecache
Changes since 1.134.2.1: +36 -13 lines
Diff to previous 1.134.2.1 (colored) to branchpoint 1.134 (colored) next main 1.135 (colored)

sync with head

Revision 1.135.2.1 / (download) - annotate - [select for diffs], Sat Mar 17 17:40:07 2012 UTC (2 months, 1 week ago) by bouyer
Branch: netbsd-6
Changes since 1.135: +16 -6 lines
Diff to previous 1.135 (colored) next main 1.136 (colored)

Pull up following revision(s) (requested by perseant in ticket #116):
	sys/ufs/lfs/lfs_alloc.c: revision 1.112
	tests/fs/vfs/t_rmdirrace.c: revision 1.9
	tests/fs/vfs/t_renamerace.c: revision 1.25
	sys/ufs/lfs/lfs_vnops.c: revision 1.240
	sys/ufs/lfs/lfs_segment.c: revision 1.224
	sys/ufs/lfs/lfs_bio.c: revision 1.122
	sys/ufs/lfs/lfs_vfsops.c: revision 1.294
	sbin/newfs_lfs/make_lfs.c: revision 1.19
	sys/ufs/lfs/lfs.h: revision 1.136
Pass t_renamerace and t_rmdirrace tests.
Adapt dholland@'s fix to ufs_rename to fix PR kern/43582.  Address several
other MP locking issues discovered during the course of investigating the
same problem.
Removed extraneous vn_lock() calls on the Ifile, since the Ifile writes
are controlled by the segment lock.
Fix PR kern/45982 by deemphasizing the estimate of how much metadata
will fill the empty space on disk when the disk is nearly empty
(t_renamerace crates a lot of inode blocks on a tiny empty disk).

Revision 1.134.6.1 / (download) - annotate - [select for diffs], Sat Feb 18 07:35:53 2012 UTC (3 months ago) by mrg
Branch: jmcneill-usbmp
Changes since 1.134: +36 -13 lines
Diff to previous 1.134 (colored) next main 1.135 (colored)

merge to -current.

Revision 1.136 / (download) - annotate - [select for diffs], Thu Feb 16 02:47:55 2012 UTC (3 months, 1 week ago) by perseant
Branch: MAIN
CVS Tags: yamt-pagecache-base5, yamt-pagecache-base4, jmcneill-usbmp-base9, jmcneill-usbmp-base8, jmcneill-usbmp-base7, jmcneill-usbmp-base6, jmcneill-usbmp-base5, jmcneill-usbmp-base4, jmcneill-usbmp-base3, jmcneill-usbmp-base2, HEAD
Changes since 1.135: +16 -6 lines
Diff to previous 1.135 (colored)

Pass t_renamerace and t_rmdirrace tests.

Adapt dholland@'s fix to ufs_rename to fix PR kern/43582.  Address several
other MP locking issues discovered during the course of investigating the
same problem.

Removed extraneous vn_lock() calls on the Ifile, since the Ifile writes
are controlled by the segment lock.

Fix PR kern/45982 by deemphasizing the estimate of how much metadata
will fill the empty space on disk when the disk is nearly empty
(t_renamerace crates a lot of inode blocks on a tiny empty disk).

Revision 1.135 / (download) - annotate - [select for diffs], Mon Jan 2 22:10:44 2012 UTC (4 months, 3 weeks ago) by perseant
Branch: MAIN
CVS Tags: netbsd-6-base
Branch point for: netbsd-6
Changes since 1.134: +26 -13 lines
Diff to previous 1.134 (colored)


* Remove PGO_RECLAIM during lfs_putpages()' call to genfs_putpages(),
  to avoid a live lock in the latter when reclaiming a vnode with
  dirty pages.

* Add a new segment flag, SEGM_RECLAIM, to note when a segment is
  being written for vnode reclamation, and record which inode is being
  reclaimed, to aid in forensic debugging.

* Add a new segment flag, SEGM_SINGLE, so that opportunistic writes
  can write a single segment's worth of blocks and then stop, rather
  than writing all the way up to the cleaner's reserved number of
  segments.

* Add assert statements to check mutex ownership is the way it ought
  to be, mostly in lfs_putpages; fix problems uncovered by this.

* Don't clear VU_DIROP until the inode actually makes its way to disk,
  avoiding a problem where dirop inodes could become separated
  (uncovered by a modified version of the "ckckp" forensic regression
  test).

* Move the vfs_getopsbyname() call into lfs_writerd.  Prepare code to
  make lfs_writerd notice when there are no more LFSs, and exit losing
  the reference, so that, in theory, the module can be unloaded.  This
  code is not enabled, since it causes a crash on exit.

* Set IN_MODIFIED on inodes flushed by lfs_flush_dirops.  Really we
  only need to set IN_MODIFIED if we are going to write them again
  (e.g., to write pages); need to think about this more.

Finally, several changes to help avoid "no clean segments" panics:

* In lfs_bmapv, note when a vnode is loaded only to discover whether
  its blocks are live, so it can immediately be recycled.  Since the
  cleaner will try to choose ~empty segments over full ones, this
  prevents the cleaner from (1) filling the vnode cache with junk, and
  (2) squeezing any unwritten writes to disk and running the fs out of
  segments.

* Overestimate by half the amount of metadata that will be required
  to fill the clean segments.  This will make the disk appear smaller,
  but should help avoid a "no clean segments" panic.

* Rearrange lfs_writerd.  In particular, lfs_writerd now pays
  attention to the number of clean segments available, and holds off
  writing until there is room.

Revision 1.134.2.1 / (download) - annotate - [select for diffs], Wed Nov 30 14:33:46 2011 UTC (5 months, 3 weeks ago) by yamt
Branch: yamt-pagecache
Changes since 1.134: +2 -2 lines
Diff to previous 1.134 (colored)

make lfs another pager specific flag so that it won't be affected by
an nfs hack in genfs.

Revision 1.134 / (download) - annotate - [select for diffs], Mon Jul 11 08:27:40 2011 UTC (10 months, 2 weeks ago) by hannken
Branch: MAIN
CVS Tags: yamt-pagecache-base3, yamt-pagecache-base2, yamt-pagecache-base, jmcneill-usbmp-pre-base2, jmcneill-usbmp-base, jmcneill-audiomp3-base, jmcneill-audiomp3
Branch point for: yamt-pagecache, jmcneill-usbmp
Changes since 1.133: +2 -2 lines
Diff to previous 1.133 (colored)

Change VOP_BWRITE() to take a vnode as its first argument like all other
VOPs do.  Layered file systems no longer have to modify bp->b_vp and run
into trouble when an async VOP_BWRITE() uses the wrong vnode.

- change all occurences of VOP_BWRITE(bp) to VOP_BWRITE(bp->b_vp, bp).
- remove layer_bwrite().
- welcome to 5.99.55

Adresses PR kern/38762 panic: vwakeup: neg numoutput

No objections from tech-kern@.

Revision 1.132.2.1 / (download) - annotate - [select for diffs], Fri Apr 30 14:44:35 2010 UTC (2 years ago) by uebayasi
Branch: uebayasi-xip
Changes since 1.132: +16 -17 lines
Diff to previous 1.132 (colored) next main 1.133 (colored)

Sync with HEAD.

Revision 1.125.10.4 / (download) - annotate - [select for diffs], Thu Mar 11 15:04:44 2010 UTC (2 years, 2 months ago) by yamt
Branch: yamt-nfs-mp
Changes since 1.125.10.3: +31 -22 lines
Diff to previous 1.125.10.3 (colored) to branchpoint 1.125 (colored) next main 1.126 (colored)

sync with head

Revision 1.133 / (download) - annotate - [select for diffs], Tue Feb 16 23:20:30 2010 UTC (2 years, 3 months ago) by mlelstv
Branch: MAIN
CVS Tags: yamt-nfs-mp-base9, yamt-nfs-mp-base11, yamt-nfs-mp-base10, uebayasi-xip-base4, uebayasi-xip-base3, uebayasi-xip-base2, uebayasi-xip-base1, rmind-uvmplock-nbase, rmind-uvmplock-base, rmind-uvmplock, matt-mips64-premerge-20101231, jruoho-x86intr-base, jruoho-x86intr, cherry-xenmp-base, cherry-xenmp, bouyer-quota2-nbase, bouyer-quota2-base, bouyer-quota2
Changes since 1.132: +16 -17 lines
Diff to previous 1.132 (colored)

Three changes in a single commit.

- drop the notion of frags (LFS fragments) vs fsb (FFS fragments)
  The code uses a complicated unity function that just makes the
  code difficult to understand.

- support larger sector sizes. Fix disk address computations
  to use DEV_BSIZE in the kernel as required by device drivers
  and to use sector sizes in userland.

- Fix several locking bugs in lfs_bio.c and lfs_subr.c.

Revision 1.132 / (download) - annotate - [select for diffs], Thu Nov 5 17:16:36 2009 UTC (2 years, 6 months ago) by pooka
Branch: MAIN
CVS Tags: uebayasi-xip-base, matt-premerge-20091211
Branch point for: uebayasi-xip
Changes since 1.131: +9 -4 lines
Diff to previous 1.131 (colored)

... actually, define compat only for the kernel.  Userlandia should
see only one version of the interfaces.

Revision 1.131 / (download) - annotate - [select for diffs], Thu Nov 5 16:59:55 2009 UTC (2 years, 6 months ago) by pooka
Branch: MAIN
Changes since 1.130: +3 -2 lines
Diff to previous 1.130 (colored)

Include compat/sys/time_types.h instead of compat/sys/time.h.
Fixes lint drama with interface name collisions.

Revision 1.130 / (download) - annotate - [select for diffs], Thu Nov 5 11:54:49 2009 UTC (2 years, 6 months ago) by pooka
Branch: MAIN
Changes since 1.129: +4 -13 lines
Diff to previous 1.129 (colored)

Include compat code by default.

Revision 1.129 / (download) - annotate - [select for diffs], Thu Oct 29 17:10:32 2009 UTC (2 years, 6 months ago) by christos
Branch: MAIN
CVS Tags: jym-xensuspend-nbase
Changes since 1.128: +18 -5 lines
Diff to previous 1.128 (colored)

PR/42246: NAKAJIMA Yoshihiro: provide COMPAT_50 for LFS

Revision 1.125.10.3 / (download) - annotate - [select for diffs], Wed Aug 19 18:48:34 2009 UTC (2 years, 9 months ago) by yamt
Branch: yamt-nfs-mp
Changes since 1.125.10.2: +2 -2 lines
Diff to previous 1.125.10.2 (colored) to branchpoint 1.125 (colored)

sync with head.

Revision 1.127.12.1 / (download) - annotate - [select for diffs], Thu Jul 23 23:33:03 2009 UTC (2 years, 10 months ago) by jym
Branch: jym-xensuspend
Changes since 1.127: +2 -2 lines
Diff to previous 1.127 (colored) next main 1.128 (colored)

Sync with HEAD.

Revision 1.128 / (download) - annotate - [select for diffs], Sun Jul 19 03:39:14 2009 UTC (2 years, 10 months ago) by dholland
Branch: MAIN
CVS Tags: yamt-nfs-mp-base8, yamt-nfs-mp-base7, jymxensuspend-base
Changes since 1.127: +2 -2 lines
Diff to previous 1.127 (colored)

typo in comment

Revision 1.125.10.2 / (download) - annotate - [select for diffs], Mon May 4 08:14:38 2009 UTC (3 years ago) by yamt
Branch: yamt-nfs-mp
Changes since 1.125.10.1: +4 -4 lines
Diff to previous 1.125.10.1 (colored) to branchpoint 1.125 (colored)

sync with head.

Revision 1.126.2.1 / (download) - annotate - [select for diffs], Mon Jun 23 04:32:05 2008 UTC (3 years, 11 months ago) by wrstuden
Branch: wrstuden-revivesa
Changes since 1.126: +4 -4 lines
Diff to previous 1.126 (colored) next main 1.127 (colored)

Sync w/ -current. 34 merge conflicts to follow.

Revision 1.125.6.1 / (download) - annotate - [select for diffs], Mon Jun 2 13:24:35 2008 UTC (3 years, 11 months ago) by mjf
Branch: mjf-devfs2
Changes since 1.125: +4 -11 lines
Diff to previous 1.125 (colored) next main 1.126 (colored)

Sync with HEAD.

Revision 1.125.8.1 / (download) - annotate - [select for diffs], Sun May 18 12:35:55 2008 UTC (4 years ago) by yamt
Branch: yamt-pf42
Changes since 1.125: +4 -11 lines
Diff to previous 1.125 (colored) next main 1.126 (colored)

sync with head.

Revision 1.127 / (download) - annotate - [select for diffs], Fri May 16 09:22:00 2008 UTC (4 years ago) by hannken
Branch: MAIN
CVS Tags: yamt-pf42-base4, yamt-pf42-base3, yamt-pf42-base2, yamt-nfs-mp-base6, yamt-nfs-mp-base5, yamt-nfs-mp-base4, yamt-nfs-mp-base3, wrstuden-revivesa-base-4, wrstuden-revivesa-base-3, wrstuden-revivesa-base-2, wrstuden-revivesa-base-1, wrstuden-revivesa-base, simonb-wapbl-nbase, simonb-wapbl-base, simonb-wapbl, nick-hppapmap-base4, nick-hppapmap-base3, nick-hppapmap-base2, nick-hppapmap-base, nick-hppapmap, netbsd-5-base, netbsd-5-1-RELEASE, netbsd-5-1-RC4, netbsd-5-1-RC3, netbsd-5-1-RC2, netbsd-5-1-RC1, netbsd-5-1-2-RELEASE, netbsd-5-1-1-RELEASE, netbsd-5-1, netbsd-5-0-RELEASE, netbsd-5-0-RC4, netbsd-5-0-RC3, netbsd-5-0-RC2, netbsd-5-0-RC1, netbsd-5-0-2-RELEASE, netbsd-5-0-1-RELEASE, netbsd-5-0, netbsd-5, mjf-devfs2-base, matt-nb5-pq3-base, matt-nb5-pq3, matt-nb5-mips64-u2-k2-k4-k7-k8-k9, matt-nb5-mips64-u1-k1-k5, matt-nb5-mips64-premerge-20101231, matt-nb5-mips64-premerge-20091211, matt-nb5-mips64-k15, matt-nb5-mips64, matt-nb4-mips64-k7-u2a-k9b, matt-mips64-base2, jym-xensuspend-base, hpcarm-cleanup-nbase, haad-nbase2, haad-dm-base2, haad-dm-base1, haad-dm-base, haad-dm, ad-audiomp2-base, ad-audiomp2
Branch point for: jym-xensuspend
Changes since 1.126: +4 -4 lines
Diff to previous 1.126 (colored)

Make sure all cached buffers with valid, not yet written data have been
run through copy-on-write.  Call fscow_run() with valid data where possible.

The LP_UFSCOW hack is no longer needed to protect ffs_copyonwrite() against
endless recursion.

- Add a flag B_MODIFY to bread(), breada() and breadn().  If set the caller
  intends to modify the buffer returned.

- Always run copy-on-write on buffers returned from ffs_balloc().

- Add new function ffs_getblk() that gets a buffer, assigns a new blkno,
  may clear the buffer and runs copy-on-write.  Process possible errors
  from getblk() or fscow_run().  Part of PR kern/38664.

Welcome to 4.99.63

Reviewed by: YAMAMOTO Takashi <yamt@netbsd.org>

Revision 1.125.10.1 / (download) - annotate - [select for diffs], Fri May 16 02:26:00 2008 UTC (4 years ago) by yamt
Branch: yamt-nfs-mp
Changes since 1.125: +1 -8 lines
Diff to previous 1.125 (colored)

sync with head.

Revision 1.126 / (download) - annotate - [select for diffs], Mon Apr 28 20:24:11 2008 UTC (4 years ago) by martin
Branch: MAIN
CVS Tags: yamt-nfs-mp-base2
Branch point for: wrstuden-revivesa
Changes since 1.125: +1 -8 lines
Diff to previous 1.125 (colored)

Remove clause 3 and 4 from TNF licenses

Revision 1.120.8.3 / (download) - annotate - [select for diffs], Sun Mar 23 02:05:12 2008 UTC (4 years, 2 months ago) by matt
Branch: matt-armv6
Changes since 1.120.8.2: +5 -7 lines
Diff to previous 1.120.8.2 (colored) to branchpoint 1.120 (colored) next main 1.121 (colored)

sync with HEAD

Revision 1.88.2.6 / (download) - annotate - [select for diffs], Wed Feb 27 08:37:06 2008 UTC (4 years, 2 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88.2.5: +5 -7 lines
Diff to previous 1.88.2.5 (colored) next main 1.89 (colored)

sync with head.

Revision 1.122.4.1 / (download) - annotate - [select for diffs], Mon Feb 18 21:07:28 2008 UTC (4 years, 3 months ago) by mjf
Branch: mjf-devfs
Changes since 1.122: +26 -32 lines
Diff to previous 1.122 (colored) next main 1.123 (colored)

Sync with HEAD.

Revision 1.125 / (download) - annotate - [select for diffs], Fri Feb 15 13:30:56 2008 UTC (4 years, 3 months ago) by ad
Branch: MAIN
CVS Tags: yamt-pf42-baseX, yamt-pf42-base, yamt-nfs-mp-base, yamt-lazymbuf-base15, yamt-lazymbuf-base14, nick-net80211-sync-base, nick-net80211-sync, mjf-devfs-base, matt-armv6-nbase, keiichi-mipv6-nbase, keiichi-mipv6-base, keiichi-mipv6, hpcarm-cleanup-base, ad-socklock-base1
Branch point for: yamt-pf42, yamt-nfs-mp, mjf-devfs2
Changes since 1.124: +5 -7 lines
Diff to previous 1.124 (colored)

The buffer LOCKED flag need not be under the protection of bufcache_lock,
BUSY is enough.

Revision 1.88.2.5 / (download) - annotate - [select for diffs], Mon Jan 21 09:48:09 2008 UTC (4 years, 4 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88.2.4: +30 -34 lines
Diff to previous 1.88.2.4 (colored)

sync with head

Revision 1.120.8.2 / (download) - annotate - [select for diffs], Wed Jan 9 01:58:28 2008 UTC (4 years, 4 months ago) by matt
Branch: matt-armv6
Changes since 1.120.8.1: +30 -34 lines
Diff to previous 1.120.8.1 (colored) to branchpoint 1.120 (colored)

sync with HEAD

Revision 1.122.10.2 / (download) - annotate - [select for diffs], Tue Jan 8 22:12:03 2008 UTC (4 years, 4 months ago) by bouyer
Branch: bouyer-xeni386
CVS Tags: bouyer-xeni386-merge1
Changes since 1.122.10.1: +2 -0 lines
Diff to previous 1.122.10.1 (colored) to branchpoint 1.122 (colored) next main 1.123 (colored)

Sync with HEAD

Revision 1.124 / (download) - annotate - [select for diffs], Thu Jan 3 19:28:50 2008 UTC (4 years, 4 months ago) by ad
Branch: MAIN
CVS Tags: matt-armv6-base, bouyer-xeni386-nbase, bouyer-xeni386-base
Changes since 1.123: +3 -1 lines
Diff to previous 1.123 (colored)

Use pool_cache.

Revision 1.122.10.1 / (download) - annotate - [select for diffs], Wed Jan 2 21:58:21 2008 UTC (4 years, 4 months ago) by bouyer
Branch: bouyer-xeni386
Changes since 1.122: +28 -34 lines
Diff to previous 1.122 (colored)

Sync with HEAD

Revision 1.123 / (download) - annotate - [select for diffs], Wed Jan 2 11:49:10 2008 UTC (4 years, 4 months ago) by ad
Branch: MAIN
Changes since 1.122: +28 -34 lines
Diff to previous 1.122 (colored)

Merge vmlocking2 to head.

Revision 1.122.6.2 / (download) - annotate - [select for diffs], Wed Dec 19 21:27:11 2007 UTC (4 years, 5 months ago) by ad
Branch: vmlocking2
Changes since 1.122.6.1: +14 -15 lines
Diff to previous 1.122.6.1 (colored) to branchpoint 1.122 (colored) next main 1.123 (colored)

Use a global lfs_lock.

Revision 1.122.6.1 / (download) - annotate - [select for diffs], Tue Dec 4 13:03:47 2007 UTC (4 years, 5 months ago) by ad
Branch: vmlocking2
Changes since 1.122: +29 -34 lines
Diff to previous 1.122 (colored)

Pull the vmlocking changes into a new branch.

Revision 1.120.8.1 / (download) - annotate - [select for diffs], Tue Nov 6 23:35:15 2007 UTC (4 years, 6 months ago) by matt
Branch: matt-armv6
CVS Tags: matt-armv6-prevmlocking
Changes since 1.120: +5 -5 lines
Diff to previous 1.120 (colored)

sync with HEAD

Revision 1.88.2.4 / (download) - annotate - [select for diffs], Sat Oct 27 11:36:44 2007 UTC (4 years, 6 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88.2.3: +5 -5 lines
Diff to previous 1.88.2.3 (colored)

sync with head.

Revision 1.120.6.1 / (download) - annotate - [select for diffs], Fri Oct 26 15:49:32 2007 UTC (4 years, 7 months ago) by joerg
Branch: jmcneill-pm
Changes since 1.120: +5 -5 lines
Diff to previous 1.120 (colored) next main 1.121 (colored)

Sync with HEAD.

Follow the merge of pmap.c on i386 and amd64 and move
pmap_init_tmp_pgtbl into arch/x86/x86/pmap.c. Modify the ACPI wakeup
code to restore CR4 before jumping back into kernel space as the large
page option might cover that.

Revision 1.120.10.1 / (download) - annotate - [select for diffs], Sun Oct 14 11:49:17 2007 UTC (4 years, 7 months ago) by yamt
Branch: yamt-x86pmap
Changes since 1.120: +5 -5 lines
Diff to previous 1.120 (colored) next main 1.121 (colored)

sync with head.

Revision 1.122 / (download) - annotate - [select for diffs], Wed Oct 10 20:42:34 2007 UTC (4 years, 7 months ago) by ad
Branch: MAIN
CVS Tags: yamt-x86pmap-base4, yamt-x86pmap-base3, yamt-kmem-base3, yamt-kmem-base2, yamt-kmem-base, yamt-kmem, vmlocking2-base3, vmlocking2-base2, vmlocking2-base1, vmlocking-nbase, vmlocking-base, reinoud-bufcleanup-nbase, reinoud-bufcleanup-base, jmcneill-pm-base, jmcneill-base, cube-autoconf-base, cube-autoconf, bouyer-xenamd64-base2, bouyer-xenamd64-base, bouyer-xenamd64
Branch point for: vmlocking2, mjf-devfs, bouyer-xeni386
Changes since 1.121: +2 -2 lines
Diff to previous 1.121 (colored)

Merge from vmlocking:

- Split vnode::v_flag into three fields, depending on field locking.
- simple_lock -> kmutex in a few places.
- Fix some simple locking problems.

Revision 1.121 / (download) - annotate - [select for diffs], Mon Oct 8 18:01:29 2007 UTC (4 years, 7 months ago) by ad
Branch: MAIN
Changes since 1.120: +4 -4 lines
Diff to previous 1.120 (colored)

Merge ffs locking & brelse changes from the vmlocking branch.

Revision 1.118.6.4 / (download) - annotate - [select for diffs], Fri Aug 24 23:28:46 2007 UTC (4 years, 9 months ago) by ad
Branch: vmlocking
Changes since 1.118.6.3: +10 -9 lines
Diff to previous 1.118.6.3 (colored) to branchpoint 1.118 (colored) next main 1.119 (colored)

Sync with buffer cache locking changes. See buf.h/vfs_bio.c for details.
Some minor portions are incomplete and needs to be verified as a whole.

Revision 1.118.8.1 / (download) - annotate - [select for diffs], Wed Jul 11 20:12:44 2007 UTC (4 years, 10 months ago) by mjf
Branch: mjf-ufs-trans
Changes since 1.118: +1 -1 lines
Diff to previous 1.118 (colored) next main 1.119 (colored)

Sync with head.

Revision 1.118.6.3 / (download) - annotate - [select for diffs], Sun Jun 17 21:32:10 2007 UTC (4 years, 11 months ago) by ad
Branch: vmlocking
Changes since 1.118.6.2: +2 -2 lines
Diff to previous 1.118.6.2 (colored) to branchpoint 1.118 (colored)

- Increase the number of thread priorities from 128 to 256. How the space
  is set up is to be revisited.
- Implement soft interrupts as kernel threads. A generic implementation
  is provided, with hooks for fast-path MD code that can run the interrupt
  threads over the top of other threads executing in the kernel.
- Split vnode::v_flag into three fields, depending on how the flag is
  locked (by the interlock, by the vnode lock, by the file system).
- Miscellaneous locking fixes and improvements.

Revision 1.118.2.2 / (download) - annotate - [select for diffs], Thu May 17 13:41:58 2007 UTC (5 years ago) by yamt
Branch: yamt-idlelwp
Changes since 1.118.2.1: +1 -2 lines
Diff to previous 1.118.2.1 (colored) to branchpoint 1.118 (colored) next main 1.119 (colored)

sync with head.

Revision 1.120 / (download) - annotate - [select for diffs], Wed May 16 19:11:37 2007 UTC (5 years ago) by perseant
Branch: MAIN
CVS Tags: yamt-x86pmap-base2, yamt-x86pmap-base, yamt-idlelwp-base8, nick-csl-alignment-base5, nick-csl-alignment-base, nick-csl-alignment, mjf-ufs-trans-base, matt-mips64-base, matt-mips64, hpcarm-cleanup
Branch point for: yamt-x86pmap, matt-armv6, jmcneill-pm
Changes since 1.119: +1 -2 lines
Diff to previous 1.119 (colored)

Change references to SEGM_W_DIROPS to SEGM_CKP, and replace the logic that
formerly used SEGM_W_DIROPS in lfs_segwrite() appropriately.  This prevents
a problem in which processes could get stuck in "buffers" sleep forever.

Revision 1.118.6.2 / (download) - annotate - [select for diffs], Sun May 13 17:36:43 2007 UTC (5 years ago) by ad
Branch: vmlocking
Changes since 1.118.6.1: +4 -4 lines
Diff to previous 1.118.6.1 (colored) to branchpoint 1.118 (colored)

- Pass the error number and residual count to biodone(), and let it handle
  setting error indicators. Prepare to eliminate B_ERROR.
- Add a flag argument to brelse() to be set into the buf's flags, instead
  of doing it directly. Typically used to set B_INVAL.
- Add a "struct cpu_info *" argument to kthread_create(), to be used to
  create bound threads. Change "bool mpsafe" to "int flags".
- Allow exit of LWPs in the IDL state when (l != curlwp).
- More locking fixes & conversion to the new API.

Revision 1.118.2.1 / (download) - annotate - [select for diffs], Mon May 7 10:56:15 2007 UTC (5 years ago) by yamt
Branch: yamt-idlelwp
Changes since 1.118: +2 -1 lines
Diff to previous 1.118 (colored)

sync with head.

Revision 1.119 / (download) - annotate - [select for diffs], Tue Apr 17 01:16:46 2007 UTC (5 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.118: +2 -1 lines
Diff to previous 1.118 (colored)

Install a new sysctl, vfs.lfs.ignore_lazy_sync, which causes LFS to ignore
the "smooth" syncer, as if vfs.sync.*delay = 0, but only for LFS.  The
default is "on", i.e., ignore lazy sync.

Reduce the amount of polling/busy-waiting done by lfs_putpages().  To
accomplish this, copied genfs_putpages() and modified it to indicate which
page it was that caused it to return with EDEADLK.  fsync()/fdatasync()
should no longer ever fail with EAGAIN, and should not consume huge
quantities of cpu.

Also, try to make dirops less likely to be written as the result of a
VOP_PUTPAGES(), while ensuring that they are written regularly.

Revision 1.118.6.1 / (download) - annotate - [select for diffs], Tue Mar 13 17:51:21 2007 UTC (5 years, 2 months ago) by ad
Branch: vmlocking
Changes since 1.118: +22 -28 lines
Diff to previous 1.118 (colored)

Pull in the initial set of changes for the vmlocking branch.

Revision 1.88.2.3 / (download) - annotate - [select for diffs], Mon Feb 26 09:12:20 2007 UTC (5 years, 2 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88.2.2: +4 -2 lines
Diff to previous 1.88.2.2 (colored)

sync with head.

Revision 1.118 / (download) - annotate - [select for diffs], Thu Feb 15 15:40:54 2007 UTC (5 years, 3 months ago) by ad
Branch: MAIN
CVS Tags: thorpej-atomic-base, thorpej-atomic, reinoud-bufcleanup, ad-audiomp-base, ad-audiomp
Branch point for: yamt-idlelwp, vmlocking, mjf-ufs-trans
Changes since 1.117: +4 -2 lines
Diff to previous 1.117 (colored)

Replace some uses of lockmgr() / simplelocks.

Revision 1.88.2.2 / (download) - annotate - [select for diffs], Sat Dec 30 20:51:01 2006 UTC (5 years, 4 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88.2.1: +46 -16 lines
Diff to previous 1.88.2.1 (colored)

sync with head.

Revision 1.114.2.1 / (download) - annotate - [select for diffs], Sat Nov 18 21:39:49 2006 UTC (5 years, 6 months ago) by ad
Branch: newlock2
Changes since 1.114: +19 -12 lines
Diff to previous 1.114 (colored) next main 1.115 (colored)

Sync with head.

Revision 1.116.2.1 / (download) - annotate - [select for diffs], Sun Oct 22 06:07:51 2006 UTC (5 years, 7 months ago) by yamt
Branch: yamt-splraiseipl
Changes since 1.116: +2 -1 lines
Diff to previous 1.116 (colored) next main 1.117 (colored)

sync with head

Revision 1.117 / (download) - annotate - [select for diffs], Thu Sep 28 23:08:23 2006 UTC (5 years, 7 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-splraiseipl-base5, yamt-splraiseipl-base4, yamt-splraiseipl-base3, yamt-splraiseipl-base2, wrstuden-fixsa-newbase, wrstuden-fixsa-base-1, wrstuden-fixsa-base, wrstuden-fixsa, post-newlock2-merge, newlock2-nbase, newlock2-base, netbsd-4-base, netbsd-4-0-RELEASE, netbsd-4-0-RC5, netbsd-4-0-RC4, netbsd-4-0-RC3, netbsd-4-0-RC2, netbsd-4-0-RC1, netbsd-4-0-1-RELEASE, netbsd-4-0, netbsd-4, matt-nb4-arm-base, matt-nb4-arm
Changes since 1.116: +2 -1 lines
Diff to previous 1.116 (colored)

Use lockstatus instead of a homebrewed locking system to control
LFCNWRAPSTOP and LFCNWRAPGO.

Be less verbose about the various looping checks: use log() rather than
printf(), and only log anything if we are really looping ("count = 2" is
not an error condition).

Allow dirops sleeping on available space to be interruptible.

Revision 1.116 / (download) - annotate - [select for diffs], Fri Sep 15 18:50:49 2006 UTC (5 years, 8 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-splraiseipl-base
Branch point for: yamt-splraiseipl
Changes since 1.115: +2 -2 lines
Diff to previous 1.115 (colored)

Don't remark a locked inode with IN_MODIFIED after writing it to disk,
if we ourselves hold the lock.  This prevents e.g. mknod from hanging
indefinitely.

Also, always use the return value from VOP_ISLOCKED to determine whether
we hold the lock or someone else does, rather than looking into the lock
structure ourselves.

Revision 1.115 / (download) - annotate - [select for diffs], Fri Sep 15 15:51:12 2006 UTC (5 years, 8 months ago) by yamt
Branch: MAIN
Changes since 1.114: +17 -11 lines
Diff to previous 1.114 (colored)

merge yamt-pdpolicy branch.
	- separate page replacement policy from the rest of kernel
	- implement an alternative replacement policy

Revision 1.95.4.1 / (download) - annotate - [select for diffs], Sat Sep 9 03:00:00 2006 UTC (5 years, 8 months ago) by rpaulo
Branch: rpaulo-netinet-merge-pcb
Changes since 1.95: +76 -14 lines
Diff to previous 1.95 (colored) next main 1.96 (colored)

sync with head

Revision 1.95.8.7 / (download) - annotate - [select for diffs], Sun Sep 3 15:26:07 2006 UTC (5 years, 8 months ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.6: +14 -1 lines
Diff to previous 1.95.8.6 (colored) to branchpoint 1.95 (colored) next main 1.96 (colored)

sync with head.

Revision 1.114 / (download) - annotate - [select for diffs], Fri Sep 1 19:41:28 2006 UTC (5 years, 8 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-pdpolicy-base9, yamt-pdpolicy-base8, rpaulo-netinet-merge-pcb-base
Branch point for: newlock2
Changes since 1.113: +14 -1 lines
Diff to previous 1.113 (colored)

Changes to help the roll-forward agent, to wit:

* Mark being-deleted files in the Ifile so we can finish deleting them
  at fs mount time.
* Flag the Ifile with "cleaner must clean" when writers are waiting for
  the cleaner, rather than relying solely on the cleaner's estimation of
  whether it should clean or not.
* Note partial segments written by a user agent (in particular,
  fsck_lfs) so that repeated rolls forward don't interfere with one
  another.
* Add a new fcntl, LFCNPASS, that allows the log to wrap exactly once,
  for better testing of the validity of checkpoints.
* Keep track of the on-disk nlink count when cleaning, so that we don't
  partially complete directory operations while cleaning.
* Ensure that every single Ifile inode write represents a consistent
  view of the filesystem.  In particular, the accounting for the segment
  we are writing the inode into must be correct, and the accounting for
  the segment that inode used to reside in must be correct.  Rather than
  just rewriting the inode if we wrote it wrong, rewrite the necessary
  ifile blocks before writing the inode so we never write it wrong.
* Don't unmark any VDIROP vnodes if we haven't written them to disk,
  avoiding yet another problem with the "wait for the cleaner" error
  return from lfs_putpages().

Also, move the last callback to an aiodone call, so we no longer do any
memory management from interrupt context.

Revision 1.95.8.6 / (download) - annotate - [select for diffs], Fri Aug 11 15:47:36 2006 UTC (5 years, 9 months ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.5: +9 -2 lines
Diff to previous 1.95.8.5 (colored) to branchpoint 1.95 (colored)

sync with head

Revision 1.77.2.18 / (download) - annotate - [select for diffs], Thu Aug 10 12:16:46 2006 UTC (5 years, 9 months ago) by tron
Branch: netbsd-3
CVS Tags: netbsd-3-1-RELEASE, netbsd-3-1-RC4, netbsd-3-1-RC3, netbsd-3-1-RC2, netbsd-3-1-RC1, netbsd-3-1-1-RELEASE, netbsd-3-1
Changes since 1.77.2.17: +8 -4 lines
Diff to previous 1.77.2.17 (colored) to branchpoint 1.77 (colored) next main 1.78 (colored)

Apply patch (requested by fair in perseant #1457):
Bring LFS up to current, including a patch (1.95 lfs_alloc.c) that
should prevent the inode free list errors seen on the STABLE branch
subsequent to pullup ticket #1327.

Revision 1.113 / (download) - annotate - [select for diffs], Sun Aug 6 12:34:12 2006 UTC (5 years, 9 months ago) by martin
Branch: MAIN
CVS Tags: yamt-pdpolicy-base7, abandoned-netbsd-4-base, abandoned-netbsd-4
Changes since 1.112: +4 -6 lines
Diff to previous 1.112 (colored)

Fix size confusion with lfs_fhandle - and as it now turns out to be the same
as the lfs compat_30_fhandle, g/c the latter.
Add an alias for the LFCNIFILEFH fcntl, so that binaries compiled in the
meantime (with too large lfs_fhandle) continue to work.

This makes vfs_cleanerd work again after the kernel checks filehandle size
more strictly (problem reported by Kurt Schreiner on current-users).

Revision 1.112 / (download) - annotate - [select for diffs], Mon Jul 31 16:34:44 2006 UTC (5 years, 9 months ago) by martin
Branch: MAIN
Changes since 1.111: +4 -6 lines
Diff to previous 1.111 (colored)

Make filehandles opaque to userland

Revision 1.111 / (download) - annotate - [select for diffs], Thu Jul 20 23:16:50 2006 UTC (5 years, 10 months ago) by perseant
Branch: MAIN
Changes since 1.110: +2 -1 lines
Diff to previous 1.110 (colored)

Note partial segments that are written by the cleaner, to help out the
roll-forward agent.

Revision 1.110 / (download) - annotate - [select for diffs], Thu Jul 13 22:05:52 2006 UTC (5 years, 10 months ago) by martin
Branch: MAIN
Changes since 1.109: +7 -2 lines
Diff to previous 1.109 (colored)

Version the lfs_cleanerd internal fcntl() for filehandles too,
so old cleaners should work with newer kernels.

Revision 1.107.4.1 / (download) - annotate - [select for diffs], Thu Jul 13 17:50:13 2006 UTC (5 years, 10 months ago) by gdamore
Branch: gdamore-uart
Changes since 1.107: +13 -5 lines
Diff to previous 1.107 (colored) next main 1.108 (colored)

Merge from HEAD.

Revision 1.109 / (download) - annotate - [select for diffs], Thu Jul 13 12:00:26 2006 UTC (5 years, 10 months ago) by martin
Branch: MAIN
Changes since 1.108: +7 -2 lines
Diff to previous 1.108 (colored)

Fix alignement problems for fhandle_t, exposed by gcc4.1.

While touching all vptofh/fhtovp functions, get rid of VFS_MAXFIDSIZ,
version the getfh(2) syscall and explicitly pass the size available in
the filehandle from userland.

Discussed on tech-kern, with lots of help from yamt (thanks!).

Revision 1.95.8.5 / (download) - annotate - [select for diffs], Mon Jun 26 12:54:49 2006 UTC (5 years, 11 months ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.4: +7 -4 lines
Diff to previous 1.95.8.4 (colored) to branchpoint 1.95 (colored)

sync with head.

Revision 1.108 / (download) - annotate - [select for diffs], Sat Jun 24 05:28:54 2006 UTC (5 years, 11 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-pdpolicy-base6
Changes since 1.107: +7 -4 lines
Diff to previous 1.107 (colored)

Change LFCNWRAP{STOP,GO} to make them more suitable for snapshotting; in
particular, the caller can now choose whether to wait for the condition
to be met, and if the caller of LFCNWRAPSTOP dies or otherwise closes
the descriptor, the filesystem is started again.  Updated the ckckp
regression test to use the new semantics.

dump_lfs(8) now uses the fcntls to implement LFS-style snapshotting through
the -X flag, addressing PR#33457 albeit not using fss(4).  Fixed a couple
other problems with dump_lfs that manifested themselves during testing.

Revision 1.88.2.1 / (download) - annotate - [select for diffs], Wed Jun 21 15:12:38 2006 UTC (5 years, 11 months ago) by yamt
Branch: yamt-lazymbuf
Changes since 1.88: +74 -61 lines
Diff to previous 1.88 (colored)

sync with head.

Revision 1.95.6.2 / (download) - annotate - [select for diffs], Thu Jun 1 22:39:43 2006 UTC (5 years, 11 months ago) by kardel
Branch: simonb-timecounters
CVS Tags: simonb-timcounters-final
Changes since 1.95.6.1: +33 -10 lines
Diff to previous 1.95.6.1 (colored) to branchpoint 1.95 (colored) next main 1.96 (colored)

Sync with head.

Revision 1.95.12.2 / (download) - annotate - [select for diffs], Wed May 24 15:50:48 2006 UTC (6 years ago) by tron
Branch: peter-altq
Changes since 1.95.12.1: +47 -12 lines
Diff to previous 1.95.12.1 (colored) to branchpoint 1.95 (colored) next main 1.96 (colored)

Merge 2006-05-24 NetBSD-current into the "peter-altq" branch.

Revision 1.95.8.4 / (download) - annotate - [select for diffs], Wed May 24 10:59:25 2006 UTC (6 years ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.3: +37 -10 lines
Diff to previous 1.95.8.3 (colored) to branchpoint 1.95 (colored)

sync with head.

Revision 1.77.2.17 / (download) - annotate - [select for diffs], Sat May 20 22:43:42 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.16: +6 -5 lines
Diff to previous 1.77.2.16 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_alloc.c: revision 1.93
	sys/ufs/lfs/lfs.h: revision 1.106
	sys/ufs/lfs/lfs_vfsops.c: revision 1.209
	sys/ufs/lfs/lfs_vnops.c: revision 1.175
	sys/ufs/lfs/lfs_segment.c: revision 1.178
Fixes to address the "vinvalbuf: dirty blocks" panic that can occur when
many inodes are cleaned at once.  Make sure that we write all the pages
on vnodes that are being flushed, even if we don't think there's room;
drain v_numoutput before lfs_vflush() completes.
Also, don't allow a vnode that is in the process of being cleaned to be
chosen by getnewvnode(); this avoids a segment accounting panic in the case
that a large number of inodes are fed to lfs_markv() all at once.

Revision 1.77.2.16 / (download) - annotate - [select for diffs], Sat May 20 22:42:50 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.15: +14 -5 lines
Diff to previous 1.77.2.15 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_alloc.c: revision 1.92
	sys/ufs/lfs/lfs.h: revision 1.105
	sys/ufs/lfs/lfs_vfsops.c: revision 1.207
	sys/ufs/lfs/lfs_subr.c: revision 1.59
	sys/ufs/lfs/lfs_vnops.c: revision 1.173
	sys/ufs/lfs/lfs_bio.c: revision 1.92
Introduce another per-filesystem parameter, lfs_resvseg, to separate the
notion of "how many segments are reserved for the cleaner" from that of
"how many segments are not counted in lfs_bfree".  The default value
used for existing filesystems is the same as the previous implicit value
of (lfs_minfreeseg / 2 + 1), modulo some sanity checking.
Count pending dirops on a per-filesystem basis, since once we start
writing them we can't stop until we're done.  This seems to help stave off
the "no clean segments" panic in the case of filling the filesystem with
directories and small files (e.g. simultaneously unpacking more copies of
pkgsrc than will fit).

Revision 1.77.2.15 / (download) - annotate - [select for diffs], Sat May 20 22:38:57 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.14: +14 -1 lines
Diff to previous 1.77.2.14 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.104
	sys/ufs/lfs/lfs_vfsops.c: revision 1.206
	sys/ufs/lfs/lfs_vnops.c: revision 1.170
	sys/ufs/lfs/lfs_extern.h: revision 1.80
	sys/ufs/lfs/lfs_segment.c: revision 1.176
	sys/ufs/lfs/lfs_inode.c: revision 1.103 via patch
	sys/ufs/lfs/lfs_alloc.c: revision 1.90
Postpone the segment accounting changes coming from truncation until the
inode that makes those changes valid is either written to disk by
lfs_writeinode() or discarded by lfs_vfree().
A couple of locking fixes are also included as well.

Revision 1.77.2.14 / (download) - annotate - [select for diffs], Sat May 20 22:24:27 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.13: +4 -1 lines
Diff to previous 1.77.2.13 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.103
	sys/ufs/lfs/lfs_segment.c: revision 1.174
	sys/ufs/lfs/lfs_vnops.c: revision 1.168
Introduce two fcntl calls that freeze the filesystem right at the point
where segment 0 is being considered for writing.  This allows for automated
checkpoint vailidity scanning, and could be used (in conjunction with the
existing LFCNREWIND) for e.g. snapshot dumps as well.
Include a regression test that does such scanning.
When writing the Ifile, loop through the dirty block list three times to
make sure that the checkpoint is always consistent (the first and second
times the Ifile blocks can cross a segment boundary; not so the third time
unless the segments are very small).  Discovered by using the aforementioned
regression test.

Revision 1.77.2.13 / (download) - annotate - [select for diffs], Sat May 20 22:19:33 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.12: +2 -1 lines
Diff to previous 1.77.2.12 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.102
	sys/ufs/lfs/lfs_segment.c: revision 1.173
	sys/ufs/lfs/lfs_vnops.c: revision 1.167 via patch
	sys/ufs/lfs/lfs_bio.c: revision 1.91
Make lfs_vref/lfs_vunref not need to know about VXLOCK and VFREEING
explicitly (especially since we didn't know about VFREEING at all before),
but notice the EBUSY return from vget() instead.
Fix some more MP locking protocol issues, most of which were pointed out by
Christian Ehrhardt this morning on tech-kern.

Revision 1.77.2.12 / (download) - annotate - [select for diffs], Sat May 20 22:11:58 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.11: +6 -3 lines
Diff to previous 1.77.2.11 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.101
	sys/ufs/lfs/lfs_vfsops.c: revision 1.202
	sys/ufs/lfs/lfs_alloc.c: revision 1.88
Optimize the free list search a little more; in particular use words
instead of bytes for the index, and never search below fs->lfs_freehd.
Fix a bug in the previous version of the search (an erroneous assumption
that ino_t was signed).
Free the bitmap when we unmount the filesystem.

Revision 1.77.2.11 / (download) - annotate - [select for diffs], Sat May 20 22:10:29 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.10: +2 -1 lines
Diff to previous 1.77.2.10 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_vfsops.c: revision 1.200
	sys/ufs/lfs/lfs_vnops.c: revision 1.164
	sys/ufs/lfs/lfs_inode.c: revision 1.101
	sys/ufs/lfs/lfs_extern.h: revision 1.78
	sys/ufs/lfs/lfs.h: revision 1.100
Implement a somewhat finer-grained mechanism for paging LFS-backed pages.
The writer daemon, if it does not need to flush the whole filesystem,
now only writes the vnodes for which the pagedaemon has requested pageouts
(although it does not pay attention to the page ranges the pagedaemon
supplies).

Revision 1.77.2.10 / (download) - annotate - [select for diffs], Sat May 20 22:09:28 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.9: +2 -1 lines
Diff to previous 1.77.2.9 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_alloc.c: revision 1.87
	sys/ufs/lfs/lfs.h: revision 1.99
	sys/ufs/lfs/lfs_vfsops.c: revision 1.199
	sys/ufs/lfs/lfs_extern.h: revision 1.77 via patch
Keep the free list ordered.  This solves a problem first pointed out to me
by Michel Oey, in which an aged LFS writes up to an extra Ifile block for
every file created; and paves the way for the truncation of the Ifile when
many files are deleted.

Revision 1.77.2.9 / (download) - annotate - [select for diffs], Sat May 20 22:04:21 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.8: +5 -2 lines
Diff to previous 1.77.2.8 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_subr.c: revision 1.58
	sys/ufs/lfs/lfs.h: revision 1.98
Make the segment lock aware of LWPs.  Fixes a (somewhat confusing)
"lockmgr: pid 3997, not exclusive lockholder 3997, unlocking" panic I
encountered while running blogbench on an LFS.

Revision 1.77.2.8 / (download) - annotate - [select for diffs], Sat May 20 21:59:47 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.7: +4 -1 lines
Diff to previous 1.77.2.7 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_vnops.c: revision 1.158
	sys/ufs/lfs/lfs_subr.c: revision 1.57
	sys/ufs/lfs/lfs_segment.c: revision 1.171
	sys/ufs/lfs/lfs.h: revision 1.97
	sys/ufs/lfs/lfs_vfsops.c: revision 1.195
	sys/ufs/lfs/lfs_extern.h: revision 1.76
Improvements to LFS's paging mechanism, to wit:
* Acknowledge that sometimes there are more dirty pages to be written to
   disk than clean segments.  When we reach the danger line,
   lfs_gop_write() now returns EAGAIN.  The caller of VOP_PUTPAGES(), if
   it holds the segment lock, drops it and waits for the cleaner to make
   room before continuing.
* Note and avoid a three-way deadlock in lfs_putpages (a writer holding
   a page busy blocks on the cleaner while the cleaner blocks on the
   segment lock while lfs_putpages blocks on the page).

Revision 1.77.2.7 / (download) - annotate - [select for diffs], Sat May 20 21:58:21 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.6: +3 -2 lines
Diff to previous 1.77.2.6 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_segment.c: revision 1.170
	sys/ufs/lfs/lfs.h: revision 1.96
	sys/ufs/lfs/lfs_vfsops.c: revision 1.194
	sys/ufs/lfs/lfs_syscalls.c: revision 1.109
From Konrad Schroeder, in response to strange df output on anoncvs.netbsd.org:
We were returning the wrong value for free space.  Now we're not.

Revision 1.77.2.6 / (download) - annotate - [select for diffs], Sat May 20 21:57:12 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.5: +11 -11 lines
Diff to previous 1.77.2.5 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.91
whitespace.

Revision 1.77.2.5 / (download) - annotate - [select for diffs], Sat May 20 21:56:50 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.4: +5 -5 lines
Diff to previous 1.77.2.4 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.90
change ino_t to u_int32_t for syscall compatibility.

Revision 1.77.2.4 / (download) - annotate - [select for diffs], Sat May 20 21:51:54 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.3: +4 -2 lines
Diff to previous 1.77.2.3 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs.h: revision 1.89
Move extern kernel variable declarations, into a _KERNEL protected session
so that the don't pollute userland's namespace.

Revision 1.77.2.3 / (download) - annotate - [select for diffs], Sat May 20 21:50:26 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.2: +3 -3 lines
Diff to previous 1.77.2.2 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_vnops.c: revision 1.152
	sys/ufs/lfs/lfs_debug.c: revision 1.31
	sys/ufs/lfs/lfs_subr.c: revision 1.53
	sys/ufs/lfs/lfs_extern.h: revision 1.68
	sys/ufs/lfs/lfs_inode.c: revision 1.96
	sys/ufs/lfs/lfs_bio.c: revision 1.86
	sys/ufs/lfs/lfs_alloc.c: revision 1.83
	sys/ufs/lfs/lfs_vfsops.c: revision 1.181
	sys/ufs/lfs/lfs.h: revision 1.88
	sys/ufs/lfs/lfs_segment.c: revision 1.164
- sprinkle const
- avoid shadow variables.

Revision 1.77.2.2 / (download) - annotate - [select for diffs], Sat May 20 21:18:49 2006 UTC (6 years ago) by riz
Branch: netbsd-3
Changes since 1.77.2.1: +2 -1 lines
Diff to previous 1.77.2.1 (colored) to branchpoint 1.77 (colored)

Pull up following revision(s) (requested by perseant in ticket #1327):
	sys/ufs/lfs/lfs_vfsops.c: revision 1.180
	sys/ufs/lfs/lfs_syscalls.c: revision 1.106
	sys/ufs/lfs/lfs.h: revision 1.87
Keep track of the number of segments reclaimed, since the cleaner doesn't
do this anymore (it hasn't for quite some time).  Add a couple of conditional
debugging messages to indicate why segments are not cleaned, in the event
that lfs_segclean is used.
Make the LFCNSEGWAITALL fcntl work again.

Revision 1.107 / (download) - annotate - [select for diffs], Sun May 14 21:32:45 2006 UTC (6 years ago) by elad
Branch: MAIN
CVS Tags: yamt-pdpolicy-base5, simonb-timecounters-base, gdamore-uart-base, chap-midi-nbase, chap-midi-base, chap-midi
Branch point for: gdamore-uart
Changes since 1.106: +3 -3 lines
Diff to previous 1.106 (colored)

integrate kauth.

Revision 1.106 / (download) - annotate - [select for diffs], Fri May 12 23:36:11 2006 UTC (6 years ago) by perseant
Branch: MAIN
Changes since 1.105: +6 -5 lines
Diff to previous 1.105 (colored)

Fixes to address the "vinvalbuf: dirty blocks" panic that can occur when
many inodes are cleaned at once.  Make sure that we write all the pages
on vnodes that are being flushed, even if we don't think there's room;
drain v_numoutput before lfs_vflush() completes.

Also, don't allow a vnode that is in the process of being cleaned to be
chosen by getnewvnode(); this avoids a segment accounting panic in the case
that a large number of inodes are fed to lfs_markv() all at once.

Revision 1.95.10.3 / (download) - annotate - [select for diffs], Thu May 11 23:32:03 2006 UTC (6 years ago) by elad
Branch: elad-kernelauth
Changes since 1.95.10.2: +27 -5 lines
Diff to previous 1.95.10.2 (colored) to branchpoint 1.95 (colored) next main 1.96 (colored)

sync with head

Revision 1.105 / (download) - annotate - [select for diffs], Thu May 4 04:22:55 2006 UTC (6 years ago) by perseant
Branch: MAIN
CVS Tags: elad-kernelauth-base
Changes since 1.104: +14 -5 lines
Diff to previous 1.104 (colored)

Introduce another per-filesystem parameter, lfs_resvseg, to separate the
notion of "how many segments are reserved for the cleaner" from that of
"how many segments are not counted in lfs_bfree".  The default value
used for existing filesystems is the same as the previous implicit value
of (lfs_minfreeseg / 2 + 1), modulo some sanity checking.

Count pending dirops on a per-filesystem basis, since once we start
writing them we can't stop until we're done.  This seems to help stave off
the "no clean segments" panic in the case of filling the filesystem with
directories and small files (e.g. simultaneously unpacking more copies of
pkgsrc than will fit).

Revision 1.104 / (download) - annotate - [select for diffs], Sun Apr 30 21:19:42 2006 UTC (6 years ago) by perseant
Branch: MAIN
Changes since 1.103: +14 -1 lines
Diff to previous 1.103 (colored)

Postpone the segment accounting changes coming from truncation until the
inode that makes those changes valid is either written to disk by
lfs_writeinode() or discarded by lfs_vfree().

A couple of locking fixes are also included as well.

Revision 1.95.6.1 / (download) - annotate - [select for diffs], Sat Apr 22 11:40:25 2006 UTC (6 years, 1 month ago) by simonb
Branch: simonb-timecounters
Changes since 1.95: +20 -4 lines
Diff to previous 1.95 (colored)

Sync with head.

Revision 1.95.10.2 / (download) - annotate - [select for diffs], Wed Apr 19 03:54:09 2006 UTC (6 years, 1 month ago) by elad
Branch: elad-kernelauth
Changes since 1.95.10.1: +20 -4 lines
Diff to previous 1.95.10.1 (colored) to branchpoint 1.95 (colored)

sync with head.

Revision 1.103 / (download) - annotate - [select for diffs], Mon Apr 17 20:02:34 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.102: +4 -1 lines
Diff to previous 1.102 (colored)

Introduce two fcntl calls that freeze the filesystem right at the point
where segment 0 is being considered for writing.  This allows for automated
checkpoint vailidity scanning, and could be used (in conjunction with the
existing LFCNREWIND) for e.g. snapshot dumps as well.

Include a regression test that does such scanning.

When writing the Ifile, loop through the dirty block list three times to
make sure that the checkpoint is always consistent (the first and second
times the Ifile blocks can cross a segment boundary; not so the third time
unless the segments are very small).  Discovered by using the aforementioned
regression test.

Revision 1.102 / (download) - annotate - [select for diffs], Thu Apr 13 23:46:28 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.101: +2 -1 lines
Diff to previous 1.101 (colored)

Make lfs_vref/lfs_vunref not need to know about VXLOCK and VFREEING
explicitly (especially since we didn't know about VFREEING at all before),
but notice the EBUSY return from vget() instead.

Fix some more MP locking protocol issues, most of which were pointed out by
Christian Ehrhardt this morning on tech-kern.

Revision 1.95.8.3 / (download) - annotate - [select for diffs], Tue Apr 11 11:55:58 2006 UTC (6 years, 1 month ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.2: +11 -3 lines
Diff to previous 1.95.8.2 (colored) to branchpoint 1.95 (colored)

sync with head

Revision 1.101 / (download) - annotate - [select for diffs], Mon Apr 10 21:20:19 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
CVS Tags: yamt-pdpolicy-base4
Changes since 1.100: +6 -3 lines
Diff to previous 1.100 (colored)

Optimize the free list search a little more; in particular use words
instead of bytes for the index, and never search below fs->lfs_freehd.

Fix a bug in the previous version of the search (an erroneous assumption
that ino_t was signed).

Free the bitmap when we unmount the filesystem.

Revision 1.100 / (download) - annotate - [select for diffs], Sat Apr 8 00:26:34 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.99: +2 -1 lines
Diff to previous 1.99 (colored)

Implement a somewhat finer-grained mechanism for paging LFS-backed pages.
The writer daemon, if it does not need to flush the whole filesystem,
now only writes the vnodes for which the pagedaemon has requested pageouts
(although it does not pay attention to the page ranges the pagedaemon
supplies).

Revision 1.99 / (download) - annotate - [select for diffs], Sat Apr 8 00:16:56 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.98: +2 -1 lines
Diff to previous 1.98 (colored)

Keep the free list ordered.  This solves a problem first pointed out to me
by Michel Oey, in which an aged LFS writes up to an extra Ifile block for
every file created; and paves the way for the truncation of the Ifile when
many files are deleted.

Revision 1.98 / (download) - annotate - [select for diffs], Fri Apr 7 23:44:14 2006 UTC (6 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.97: +5 -2 lines
Diff to previous 1.97 (colored)

Make the segment lock aware of LWPs.  Fixes a (somewhat confusing)
"lockmgr: pid 3997, not exclusive lockholder 3997, unlocking" panic I
encountered while running blogbench on an LFS.

Revision 1.95.8.2 / (download) - annotate - [select for diffs], Sat Apr 1 12:07:56 2006 UTC (6 years, 1 month ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95.8.1: +6 -2 lines
Diff to previous 1.95.8.1 (colored) to branchpoint 1.95 (colored)

sync with head.

Revision 1.95.12.1 / (download) - annotate - [select for diffs], Tue Mar 28 09:42:30 2006 UTC (6 years, 2 months ago) by tron
Branch: peter-altq
Changes since 1.95: +6 -2 lines
Diff to previous 1.95 (colored)

Merge 2006-03-28 NetBSD-current into the "peter-altq" branch.

Revision 1.97 / (download) - annotate - [select for diffs], Fri Mar 24 20:05:32 2006 UTC (6 years, 2 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-pdpolicy-base3
Changes since 1.96: +4 -1 lines
Diff to previous 1.96 (colored)

Improvements to LFS's paging mechanism, to wit:

* Acknowledge that sometimes there are more dirty pages to be written to
  disk than clean segments.  When we reach the danger line,
  lfs_gop_write() now returns EAGAIN.  The caller of VOP_PUTPAGES(), if
  it holds the segment lock, drops it and waits for the cleaner to make
  room before continuing.

* Note and avoid a three-way deadlock in lfs_putpages (a writer holding
  a page busy blocks on the cleaner while the cleaner blocks on the
  segment lock while lfs_putpages blocks on the page).

Revision 1.96 / (download) - annotate - [select for diffs], Fri Mar 17 23:21:01 2006 UTC (6 years, 2 months ago) by tls
Branch: MAIN
Changes since 1.95: +3 -2 lines
Diff to previous 1.95 (colored)

From Konrad Schroeder, in response to strange df output on anoncvs.netbsd.org:
We were returning the wrong value for free space.  Now we're not.

Revision 1.95.10.1 / (download) - annotate - [select for diffs], Wed Mar 8 01:39:12 2006 UTC (6 years, 2 months ago) by elad
Branch: elad-kernelauth
Changes since 1.95: +3 -3 lines
Diff to previous 1.95 (colored)

Adapt to kernel authorization KPI.

Revision 1.95.8.1 / (download) - annotate - [select for diffs], Sun Mar 5 12:51:09 2006 UTC (6 years, 2 months ago) by yamt
Branch: yamt-pdpolicy
Changes since 1.95: +17 -11 lines
Diff to previous 1.95 (colored)

separate page replacement policy from the rest of kernel.

Revision 1.95 / (download) - annotate - [select for diffs], Sun Dec 11 12:25:26 2005 UTC (6 years, 5 months ago) by christos
Branch: MAIN
CVS Tags: yamt-uio_vmspace-base5, yamt-uio_vmspace, yamt-pdpolicy-base2, yamt-pdpolicy-base, peter-altq-base
Branch point for: yamt-pdpolicy, simonb-timecounters, rpaulo-netinet-merge-pcb, peter-altq, elad-kernelauth
Changes since 1.94: +1 -1 lines
Diff to previous 1.94 (colored)

merge ktrace-lwp.

Revision 1.64.2.7 / (download) - annotate - [select for diffs], Thu Nov 10 14:12:32 2005 UTC (6 years, 6 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.6: +121 -66 lines
Diff to previous 1.64.2.6 (colored) next main 1.65 (colored)

Sync with HEAD. Here we go again...

Revision 1.94 / (download) - annotate - [select for diffs], Tue Sep 13 04:13:25 2005 UTC (6 years, 8 months ago) by christos
Branch: MAIN
CVS Tags: yamt-vop-base3, yamt-vop-base2, yamt-vop-base, yamt-vop, yamt-readahead-pervnode, yamt-readahead-perfile, yamt-readahead-base3, yamt-readahead-base2, yamt-readahead-base, yamt-readahead, thorpej-vnode-attr-base, thorpej-vnode-attr, ktrace-lwp-base
Changes since 1.93: +6 -1 lines
Diff to previous 1.93 (colored)

split out lfs_itimes(). It is used in fsck_lfs.

Revision 1.93 / (download) - annotate - [select for diffs], Mon Sep 12 16:24:41 2005 UTC (6 years, 8 months ago) by christos
Branch: MAIN
Changes since 1.92: +4 -39 lines
Diff to previous 1.92 (colored)

Use nanotime() to update the time fields in filesystems. Convert the code
from macros to real functions. Original patch and review from chuq.
Note: ext2fs only keeps seconds in the on-disk inode, and msdosfs does not
have enough precision for all fields, so this is not very useful for those
two.

Revision 1.92 / (download) - annotate - [select for diffs], Tue Aug 23 08:05:13 2005 UTC (6 years, 9 months ago) by christos
Branch: MAIN
Changes since 1.91: +3 -1 lines
Diff to previous 1.91 (colored)

Don't overload MAXNAMLEN, use a separate constant for each filesystem type.

Revision 1.91 / (download) - annotate - [select for diffs], Mon Aug 22 09:08:17 2005 UTC (6 years, 9 months ago) by yamt
Branch: MAIN
Changes since 1.90: +11 -11 lines
Diff to previous 1.90 (colored)

whitespace.

Revision 1.90 / (download) - annotate - [select for diffs], Mon Aug 22 08:53:03 2005 UTC (6 years, 9 months ago) by christos
Branch: MAIN
Changes since 1.89: +5 -5 lines
Diff to previous 1.89 (colored)

change ino_t to u_int32_t for syscall compatibility.

Revision 1.89 / (download) - annotate - [select for diffs], Sun Jul 31 20:18:32 2005 UTC (6 years, 9 months ago) by christos
Branch: MAIN
Changes since 1.88: +4 -2 lines
Diff to previous 1.88 (colored)

Move extern kernel variable declarations, into a _KERNEL protected session
so that the don't pollute userland's namespace.

Revision 1.88 / (download) - annotate - [select for diffs], Sun May 29 21:25:24 2005 UTC (6 years, 11 months ago) by christos
Branch: MAIN
Branch point for: yamt-lazymbuf
Changes since 1.87: +3 -3 lines
Diff to previous 1.87 (colored)

- sprinkle const
- avoid shadow variables.

Revision 1.87 / (download) - annotate - [select for diffs], Fri May 20 19:48:25 2005 UTC (7 years ago) by perseant
Branch: MAIN
Changes since 1.86: +2 -1 lines
Diff to previous 1.86 (colored)

Keep track of the number of segments reclaimed, since the cleaner doesn't
do this anymore (it hasn't for quite some time).  Add a couple of conditional
debugging messages to indicate why segments are not cleaned, in the event
that lfs_segclean is used.

Make the LFCNSEGWAITALL fcntl work again.

Revision 1.72.4.1 / (download) - annotate - [select for diffs], Tue May 10 05:08:57 2005 UTC (7 years ago) by riz
Branch: netbsd-2
CVS Tags: netbsd-2-1-RELEASE, netbsd-2-1-RC6, netbsd-2-1-RC5, netbsd-2-1-RC4, netbsd-2-1-RC3, netbsd-2-1-RC2, netbsd-2-1-RC1, netbsd-2-1
Changes since 1.72: +47 -16 lines
Diff to previous 1.72 (colored) next main 1.73 (colored)

Pull up the following revisions (requested by perseant in ticket #1281):

        1.8 sys/ufs/lfs/TODO
        1.75 sys/ufs/lfs/lfs.h                  (via patch)
        1.74 sys/ufs/lfs/lfs_alloc.c            (via patch)
        1.49, 1.51 sys/ufs/lfs/lfs_balloc.c     (1.51 via patch)
        1.78 sys/ufs/lfs/lfs_bio.c
        1.62 sys/ufs/lfs/lfs_extern.h           (via patch)
        1.156 sys/ufs/lfs/lfs_segment.c         (via patch)
        1.48 sys/ufs/lfs/lfs_subr.c
        1.101 sys/ufs/lfs/lfs_syscalls.c
        1.163 sys/ufs/lfs/lfs_vfsops.c          (via patch)
        1.134 sys/ufs/lfs/lfs_vnops.c           (via patch)
        1.61 sys/ufs/ufs/ufs_readwrite.c        (via patch)

        1.20 libexec/lfs_cleanerd/clean.h       (via patch)
        1.52 libexec/lfs_cleanerd/cleanerd.c    (via patch)
        1.41 libexec/lfs_cleanerd/library.c     (via patch)

        1.4 regress/sys/fs/lfs/newfs_fsck/Makefile
        1.2 regress/sys/fs/lfs/newfs_fsck/mkfs_mount
        1.2 regress/sys/fs/lfs/newfs_fsck/smallfiles
        1.3 sbin/fsck_lfs/bufcache.c
        1.3 sbin/fsck_lfs/bufcache.h
        1.3 sbin/fsck_lfs/lfs.h
        1.8 sbin/fsck_lfs/lfs.c                 (via patch)
        1.8 sbin/fsck_lfs/pass3.c               (via patch)
        1.18 sbin/fsck_lfs/pass0.c              (via patch)
        1.18 sbin/fsck_lfs/utilities.c          (via patch)
        1.7 sbin/fsck_lfs/segwrite.c
        1.19 sbin/fsck_lfs/setup.c              (via patch)
        1.3 sbin/newfs_lfs/Makefile
        0 sbin/newfs_lfs/lfs.c                  (yes, remove it)
        1.1 sbin/newfs_lfs/make_lfs.c
        1.15 sbin/newfs_lfs/newfs.c             (via patch)

Various minor LFS improvements.

Kernel:

* Note when lfs_putpages(9) thinks it is not going to be writing any
   pages before calling genfs_putpages(9).  This prevents a situation in
   which blocks can be queued for writing without a segment header.
* Correct computation of NRESERVE(), though it is still a gross
   overestimate in most cases.  Note that if NRESERVE() is too high, it
   may be impossible to create files on the filesystem.  We catch this
   case on filesystem mount and refuse to mount r/w.
* Allow filesystems to be mounted whose block size is == MAXBSIZE.
* Somewhere along the line, ufs_bmaparray(9) started mangling UNWRITTEN
   entries in indirect blocks again, triggering a failed assertion "daddr
   <= LFS_MAX_DADDR".  Explicitly convert to and from int32_t to correct
   this.  Should fix PR #29045.
* Add a high-water mark for the number of dirty pages any given LFS can
   hold before triggering a flush.  This is settable by sysctl, but off
   (zero) by default.
* Be more careful about the MAX_BYTES and MAX_BUFS computations so we
   shouldn't see "please increase to at least zero" messages.
* Note that VBLK and VCHR vnodes can have nonzero values in di_db[0]
   even though their v_size == 0.  Don't panic when we see this.
   Fixes PR #26680.
* Change lfs_bfree to a signed quantity.  The manner in which it is
   processed before being passed to the cleaner means that sometimes it
   may drop below zero, and the cleaner must be aware of this.
* Never report bfree < 0 (or higher than lfs_dsize) through
   lfs_statfs(9).  This prevents df(1) from ever telling us that our full
   filesystems have 16TB free.
* Account space allocated through lfs_balloc(9) that does not have
   associated buffer headers, so that the pagedaemon doesn't run us out
   of segments.
* Return ENOSPC from lfs_balloc(9) when bfree drops to zero.
* Address a deadlock in lfs_bmapv/lfs_markv when the filesystem is being
   unmounted.  Because vfs_busy() is a shared lock, and
   lfs_bmapv/lfs_markv mark the filesystem vfs_busy(), the cleaner can be
   holding the lock that umount() is blocking on, then try to vfs_busy()
   again in getnewvnode().

cleaner:

* Adapt lfs_cleanerd to use the fcntl call to get the Ifile filehandle,
   so it need not be in the namespace.
* Make lfs_cleanerd be more careful when there are very few available
   segments.
* Make lfs_cleanerd less verbose when the filesystem is unmounted.

newfs_lfs, fsck_lfs, and regression:

* Extend the lfs library from fsck_lfs(8) so that it can be used with a
   not-yet-existent LFS.  Make newfs_lfs(8) use this library, so it can
   create LFSs whose Ifile is larger than one segment.  Addresses PR #11110.
* Make newfs_lfs(8) use strsuftoi64() for its arguments, a la newfs(8).
* Make fsck_lfs(8) respect the "file system is clean" flag.
* Don't let fsck_lfs(8) think it has dirty blocks when invoked with the
   -n flag.
* Remove the Ifile from the filesystem namespace.  The cleaner now uses
   a fcntl call on the root inode to find the Ifile filehandle.  (As a
   side-effect, addresses PR #29144.)

Revision 1.77.2.1 / (download) - annotate - [select for diffs], Sat May 7 11:21:29 2005 UTC (7 years ago) by tron
Branch: netbsd-3
CVS Tags: netbsd-3-0-RELEASE, netbsd-3-0-RC6, netbsd-3-0-RC5, netbsd-3-0-RC4, netbsd-3-0-RC3, netbsd-3-0-RC2, netbsd-3-0-RC1, netbsd-3-0-3-RELEASE, netbsd-3-0-2-RELEASE, netbsd-3-0-1-RELEASE, netbsd-3-0
Changes since 1.77: +97 -17 lines
Diff to previous 1.77 (colored)

Apply patch (requested by perseant in ticket #242):
* fsck_lfs buffer cache fixes, including PR #29151
* Change fsck_lfs phase 0 message to reflect reality
* fsck_lfs: check phase 5 (cleanerinfo accounting) even on
  roll-forward
* Keep better track of the free list during roll-forward, avoiding
  a core dump
* Improve hash table use for fsck_lfs buffer and vnode cache
* Document fsck_lfs flag -f, and implement -q
* Add resize_lfs, including kernel support
* Add LFS to mountd's list of exportable filesystem types
* Make the LFS lkm work again [christos@]
* Add MP locking to the LFS kernel subsystem
* Fix pager_map deadlock in lfs_putpages()
* Avoid incomplete file extension that looks like "partial
  truncation" to fsck
* Use lfs_malloc for cleaner malloc, since the cleaner often runs
  in low-memory conditions.
* Use splay trees, not hash table, to track page allocation for
  write.
* Fix mkdir panic on full fs
* Fix page accounting leak by counting differently.
* Use rightly named structure for lfs_getattr [skrll@]
* Cosmetic changes for readability.

Revision 1.74.4.1 / (download) - annotate - [select for diffs], Fri Apr 29 11:29:39 2005 UTC (7 years ago) by kent
Branch: kent-audio2
Changes since 1.74: +163 -34 lines
Diff to previous 1.74 (colored) next main 1.75 (colored)

sync with -current

Revision 1.86 / (download) - annotate - [select for diffs], Sat Apr 23 19:47:51 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
CVS Tags: kent-audio2-base
Changes since 1.85: +31 -2 lines
Diff to previous 1.85 (colored)

Provide a resize_lfs(8), including kernel and cleaner support.  The current
implementation requires the fs to be mounted while resizing.  Tested in both
directions, and everything appears to work happily, but ymmv.

Revision 1.85 / (download) - annotate - [select for diffs], Tue Apr 19 20:59:05 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.84: +6 -3 lines
Diff to previous 1.84 (colored)

Keep per-inode, per-fs, and subsystem-wide counts of blocks allocated through
lfs_balloc(), and use that to estimate the number of dirty pages belonging
to LFS (subsystem or filesystem).  This is almost certainly wrong for
the case of a large mmap()ed region, but the accounting is tighter than
what we had before, and performs much better in the typical case of pages
dirtied through write().

Revision 1.84 / (download) - annotate - [select for diffs], Sat Apr 16 19:52:09 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.83: +4 -2 lines
Diff to previous 1.83 (colored)

Make userland compile again.

Revision 1.83 / (download) - annotate - [select for diffs], Sat Apr 16 17:35:58 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.82: +4 -4 lines
Diff to previous 1.82 (colored)

Use splay trees, rather than a hash table, to manage the accounting of
blocks allocated through VOP_BALLOC() for pages to be written to disk.
This accounting no longer takes a noticeable fraction of the system CPU.

Revision 1.82 / (download) - annotate - [select for diffs], Sat Apr 16 17:28:37 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.81: +5 -3 lines
Diff to previous 1.81 (colored)

Use lfs_malloc() to manage the blkiov arrays that the cleaner functions use,
since the cleaner is likely to operate in a low-memory condition.

Revision 1.81 / (download) - annotate - [select for diffs], Thu Apr 14 00:58:26 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.80: +5 -5 lines
Diff to previous 1.80 (colored)

Tabify leading whitespace

Revision 1.80 / (download) - annotate - [select for diffs], Thu Apr 14 00:44:16 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.79: +3 -5 lines
Diff to previous 1.79 (colored)

Consolidate the hash table we use to maintain the integrity of lfs_avail
into a single, system-wide table, rather than having a separate hash table
per inode.  Significantly reduces the "system" cpu usage of your average
file write.

Revision 1.79 / (download) - annotate - [select for diffs], Thu Apr 14 00:02:46 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.78: +3 -1 lines
Diff to previous 1.78 (colored)

Keep track of the highest block held by an LFS inode, so that we can
be assured that the last byte of a file is always allocated.  Previously
a file extension could cause the filesystem to be flushed, writing an
inconsistent inode to disk.  Although this condition would be corrected
the next time blocks were written to disk, an intervening crash would leave
the filesystem in an inconsistent state, leaving fsck_lfs to complain
of an inode "partially truncated".

Revision 1.78 / (download) - annotate - [select for diffs], Fri Apr 1 21:59:46 2005 UTC (7 years, 1 month ago) by perseant
Branch: MAIN
Changes since 1.77: +50 -6 lines
Diff to previous 1.77 (colored)

Protect various per-fs structures with fs->lfs_interlock simple_lock, to
improve behavior in the multiprocessor case.  Add debugging segment-lock
assertion statements.

Revision 1.74.6.1 / (download) - annotate - [select for diffs], Sat Mar 19 08:37:03 2005 UTC (7 years, 2 months ago) by yamt
Branch: yamt-km
Changes since 1.74: +75 -26 lines
Diff to previous 1.74 (colored) next main 1.75 (colored)

sync with head.  xen and whitespace.  xen part is not finished.

Revision 1.64.2.6 / (download) - annotate - [select for diffs], Tue Mar 8 13:53:12 2005 UTC (7 years, 2 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.5: +28 -10 lines
Diff to previous 1.64.2.5 (colored)

Sync with HEAD.

Revision 1.77 / (download) - annotate - [select for diffs], Tue Mar 8 00:18:19 2005 UTC (7 years, 2 months ago) by perseant
Branch: MAIN
CVS Tags: yamt-km-base4, yamt-km-base3, netbsd-3-base
Branch point for: netbsd-3
Changes since 1.76: +28 -10 lines
Diff to previous 1.76 (colored)

Straighten out the maze of ifdefs.  Instead, consolidate all the debugging
stuff under '#ifdef DEBUG', and use sysctl knobs to turn on/off particular
parts of the debugging reporting (if DEBUG is enabled).  Re-enable the LFS
statistics in sysctl, while I'm there.  A bit of a rototill.

Revision 1.64.2.5 / (download) - annotate - [select for diffs], Fri Mar 4 16:54:46 2005 UTC (7 years, 2 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.4: +49 -18 lines
Diff to previous 1.64.2.4 (colored)

Sync with HEAD.

Hi Perry!

Revision 1.76 / (download) - annotate - [select for diffs], Sat Feb 26 22:32:20 2005 UTC (7 years, 2 months ago) by perry
Branch: MAIN
Changes since 1.75: +3 -3 lines
Diff to previous 1.75 (colored)

nuke trailing whitespace

Revision 1.75 / (download) - annotate - [select for diffs], Sat Feb 26 05:40:42 2005 UTC (7 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.74: +47 -16 lines
Diff to previous 1.74 (colored)

Various minor LFS improvements:

* Note when lfs_putpages(9) thinks it is not going to be writing any
  pages before calling genfs_putpages(9).  This prevents a situation in
  which blocks can be queued for writing without a segment header.
* Correct computation of NRESERVE(), though it is still a gross
  overestimate in most cases.  Note that if NRESERVE() is too high, it
  may be impossible to create files on the filesystem.  We catch this
  case on filesystem mount and refuse to mount r/w.
* Allow filesystems to be mounted whose block size is == MAXBSIZE.
* Somewhere along the line, ufs_bmaparray(9) started mangling UNWRITTEN
  entries in indirect blocks again, triggering a failed assertion "daddr
  <= LFS_MAX_DADDR".  Explicitly convert to and from int32_t to correct
  this.
* Add a high-water mark for the number of dirty pages any given LFS can
  hold before triggering a flush.  This is settable by sysctl, but off
  (zero) by default.
* Be more careful about the MAX_BYTES and MAX_BUFS computations so we
  shouldn't see "please increase to at least zero" messages.
* Note that VBLK and VCHR vnodes can have nonzero values in di_db[0]
  even though their v_size == 0.  Don't panic when we see this.
* Change lfs_bfree to a signed quantity.  The manner in which it is
  processed before being passed to the cleaner means that sometimes it
  may drop below zero, and the cleaner must be aware of this.
* Never report bfree < 0 (or higher than lfs_dsize) through
  lfs_statvfs(9).  This prevents df(1) from ever telling us that our full
  filesystems have 16TB free.
* Account space allocated through lfs_balloc(9) that does not have
  associated buffer headers, so that the pagedaemon doesn't run us out
  of segments.
* Return ENOSPC from lfs_balloc(9) when bfree drops to zero.
* Address a deadlock in lfs_bmapv/lfs_markv when the filesystem is being
  unmounted.  Because vfs_busy() is a shared lock, and
  lfs_bmapv/lfs_markv mark the filesystem vfs_busy(), the cleaner can be
  holding the lock that umount() is blocking on, then try to vfs_busy()
  again in getnewvnode().

Revision 1.64.2.4 / (download) - annotate - [select for diffs], Tue Sep 21 13:39:10 2004 UTC (7 years, 8 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.3: +1 -1 lines
Diff to previous 1.64.2.3 (colored)

Fix the sync with head I botched.

Revision 1.64.2.3 / (download) - annotate - [select for diffs], Sat Sep 18 14:56:59 2004 UTC (7 years, 8 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.2: +1 -1 lines
Diff to previous 1.64.2.2 (colored)

Sync with HEAD.

Revision 1.64.2.2 / (download) - annotate - [select for diffs], Wed Aug 25 06:59:14 2004 UTC (7 years, 9 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64.2.1: +10 -7 lines
Diff to previous 1.64.2.1 (colored)

Sync with HEAD.

Revision 1.74 / (download) - annotate - [select for diffs], Sat Aug 14 14:32:04 2004 UTC (7 years, 9 months ago) by mycroft
Branch: MAIN
CVS Tags: yamt-km-base2, yamt-km-base, matt-timespec, kent-audio1-beforemerge, kent-audio1-base, kent-audio1
Branch point for: yamt-km, kent-audio2
Changes since 1.73: +5 -2 lines
Diff to previous 1.73 (colored)

Push atime/mtime updates even further -- into the reclaim path, so they happen
rarely in the normal case.  (Note: This happens at reboot/shutdown time because
all file systems are unmounted.)

Also, for IN_MODIFY, use IN_ACCESSED, not IN_MODIFIED; otherwise "ls -l" of
your device node or FIFO would cause the time stamps to get written too
quickly.

Revision 1.73 / (download) - annotate - [select for diffs], Sat Aug 14 01:08:03 2004 UTC (7 years, 9 months ago) by mycroft
Branch: MAIN
Changes since 1.72: +6 -6 lines
Diff to previous 1.72 (colored)

Add a new flag, IN_MODIFY.  This is like IN_UPDATE|IN_CHANGE, but unlike
setting those flags, it does not cause the inode to be written in the periodic
sync.  This is used for writes to special files (devices and named pipes) and
FIFOs.

Do not preemptively sync updates to access times and modification times.  They
are now updated in the inode only opportunistically, or when the file or device
is closed.  (Really, it should be delayed beyond close, but this is enough to
help substantially with device nodes.)

And the most amusing part:
Trickle sync was broken on both FFS and ext2fs, in different ways.  In FFS, the
periodic call to VFS_SYNC(MNT_LAZY) was still causing all file data to be
synced.  In ext2fs, it was causing the metadata to *not* be synced.  We now
only call VOP_UPDATE() on the node if we're doing MNT_LAZY.  I've confirmed
that we do in fact trickle correctly now.

Revision 1.64.2.1 / (download) - annotate - [select for diffs], Tue Aug 3 10:56:57 2004 UTC (7 years, 9 months ago) by skrll
Branch: ktrace-lwp
Changes since 1.64: +20 -18 lines
Diff to previous 1.64 (colored)

Sync with HEAD

Revision 1.72 / (download) - annotate - [select for diffs], Tue Mar 9 06:43:18 2004 UTC (8 years, 2 months ago) by yamt
Branch: MAIN
CVS Tags: netbsd-2-base, netbsd-2-0-base, netbsd-2-0-RELEASE, netbsd-2-0-RC5, netbsd-2-0-RC4, netbsd-2-0-RC3, netbsd-2-0-RC2, netbsd-2-0-RC1, netbsd-2-0-3-RELEASE, netbsd-2-0-2-RELEASE, netbsd-2-0-1-RELEASE, netbsd-2-0
Branch point for: netbsd-2
Changes since 1.71: +4 -1 lines
Diff to previous 1.71 (colored)

use correct segment size.  this fixes memory corruption when using lfsv1.

Revision 1.71 / (download) - annotate - [select for diffs], Wed Jan 28 10:54:23 2004 UTC (8 years, 3 months ago) by yamt
Branch: MAIN
Changes since 1.70: +4 -4 lines
Diff to previous 1.70 (colored)

use bufmem instead of bufpages to make lfs a little less broken.

Revision 1.70 / (download) - annotate - [select for diffs], Sun Sep 7 11:53:57 2003 UTC (8 years, 8 months ago) by yamt
Branch: MAIN
Changes since 1.69: +1 -4 lines
Diff to previous 1.69 (colored)

- raise spl to bio in lfs_countlocked() rather than having callers to do so.
- buffer cache MP locks.
- assert B_CALL buffers are not on the free queue.

Revision 1.69 / (download) - annotate - [select for diffs], Thu Aug 7 16:34:33 2003 UTC (8 years, 9 months ago) by agc
Branch: MAIN
Changes since 1.68: +2 -6 lines
Diff to previous 1.68 (colored)

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

Revision 1.68 / (download) - annotate - [select for diffs], Wed Jul 30 13:36:40 2003 UTC (8 years, 9 months ago) by yamt
Branch: MAIN
Changes since 1.67: +1 -3 lines
Diff to previous 1.67 (colored)

using normal bufcache buffer for cluster buffer head.

Revision 1.67 / (download) - annotate - [select for diffs], Sat Jul 12 16:17:06 2003 UTC (8 years, 10 months ago) by yamt
Branch: MAIN
Changes since 1.66: +5 -3 lines
Diff to previous 1.66 (colored)

- protect global resource counts with lfs_subsys_lock.
- clean up scattered externs a little.

Revision 1.66 / (download) - annotate - [select for diffs], Wed Jul 2 13:43:02 2003 UTC (8 years, 10 months ago) by yamt
Branch: MAIN
Changes since 1.65: +3 -3 lines
Diff to previous 1.65 (colored)

use queue.h macros.

Revision 1.65 / (download) - annotate - [select for diffs], Wed Jul 2 13:40:51 2003 UTC (8 years, 10 months ago) by yamt
Branch: MAIN
Changes since 1.64: +7 -1 lines
Diff to previous 1.64 (colored)

- add a new functions, lfs_writer_enter/leave, and use them instead of
  duplicated code fragments.
- add an assertion.

Revision 1.64 / (download) - annotate - [select for diffs], Wed Apr 23 07:20:37 2003 UTC (9 years, 1 month ago) by perseant
Branch: MAIN
Branch point for: ktrace-lwp
Changes since 1.63: +15 -3 lines
Diff to previous 1.63 (colored)

Make LFS work better (though still not "well") as an NFS-exported
filesystem (and other things that needed to be fixed before the tests
would complete), to wit:

* Include the fs ident in the filehandle; improve stale filehandle checks.

* Change definition of blksize() to use the on-dinode size instead of
  the inode's i_size, so that fsck_lfs will work properly again.

* Use b_interlock in lfs_vtruncbuf.

* Postpone dirop reclamation until after the seglock has been released,
  so that lfs_truncate is not called with the segment lock held.

* Don't loop in lfs_fsync(), just write everything and wait.

* Be more careful about the interlock/uobjlock in lfs_putpages: when we
  lose this lock, we have to resynchronize dirtiness of pages in each
  block.

* Be sure to always write indirect blocks and update metadata in
  lfs_putpages; fixes a bug that caused blocks to be accounted to the
  wrong segment.

Revision 1.63 / (download) - annotate - [select for diffs], Wed Apr 9 00:32:54 2003 UTC (9 years, 1 month ago) by thorpej
Branch: MAIN
Changes since 1.62: +4 -3 lines
Diff to previous 1.62 (colored)

Use PAGE_SIZE rather than NBPG.

Revision 1.62 / (download) - annotate - [select for diffs], Wed Apr 2 10:39:39 2003 UTC (9 years, 1 month ago) by fvdl
Branch: MAIN
Changes since 1.61: +10 -10 lines
Diff to previous 1.61 (colored)

Add support for UFS2. UFS2 is an enhanced FFS, adding support for
64 bit block pointers, extended attribute storage, and a few
other things.

This commit does not yet include the code to manipulate the extended
storage (for e.g. ACLs), this will be done later.

Originally written by Kirk McKusick and Network Associates Laboratories for
FreeBSD.

Revision 1.61 / (download) - annotate - [select for diffs], Fri Mar 28 08:03:38 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.60: +332 -314 lines
Diff to previous 1.60 (colored)

Add a sleeper count, to prevent the cleaner from panicing the kernel
when the filesystem is unmounted, relocking the Ifile when its lock is
draining.  (We can't use vfs_busy() since the process is sleeping for a
good long time.)  Clean up / organize lfs.h, while I'm here.

In lfs_update_single, assert that disk addresses are either negative, or
are still positive when converted to int32_t, to prevent recurrence of a
negative/positive block problem.

Revision 1.60 / (download) - annotate - [select for diffs], Fri Mar 21 06:26:36 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.59: +5 -5 lines
Diff to previous 1.59 (colored)

KNF (space after keywords).

Revision 1.59 / (download) - annotate - [select for diffs], Fri Mar 21 06:16:53 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.58: +4 -3 lines
Diff to previous 1.58 (colored)

Use VONWORKLST as a heuristic for vnode emptiness, rather than exhaustively
checking the memq.

Take greater care not to dirty the Ifile vnode when unmounting the filesystem.
This should fix a "(vp->v_flag & VONWORKLST) == 0" assertion panic in vgonel
that could occur when unmounting.

Do not allow the Ifile to be mapped for writing.

Revision 1.58 / (download) - annotate - [select for diffs], Sat Mar 15 06:58:49 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.57: +6 -1 lines
Diff to previous 1.57 (colored)

Add simple_lock protection for lfs_seglock and lfs_subsys_pages; these will
be expanded to cover other per-fs and subsystem-wide data as well.

Fix a case of IN_MODIFIED being set without updating lfs_uinodes, resulting
in a "lfs_uinodes < 0" panic.

Fix a deadlock in lfs_putpages arising from the need to busy all pages in a
block; unbusy any that had already been busied before starting over.

Revision 1.57 / (download) - annotate - [select for diffs], Tue Mar 11 02:47:39 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.56: +1 -7 lines
Diff to previous 1.56 (colored)

- Get rid of unused #ifdefs LFS_NO_PAGEMOVE and LFS_MALLOC_SUMMARY (both
  always true) and accompanying dead code.

- When constructing write clusters in lfs_writeseg, if the block we are
  about to add is itself a cluster from GOP_WRITE, don't put a cluster
  in a cluster, just write the GOP_WRITE cluster on its own.  This seems
  to represent a slight performance gain on my test machine.

- Charge someone's rusage for writes on LFSes.  It's difficult to tell
  who the "right" process to charge is; just charge whoever triggered
  the write.

Revision 1.56 / (download) - annotate - [select for diffs], Sat Mar 8 22:14:31 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.55: +2 -6 lines
Diff to previous 1.55 (colored)

Take away "#ifdef LFS_UBC".

Revision 1.55 / (download) - annotate - [select for diffs], Sat Mar 8 02:55:47 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.54: +5 -2 lines
Diff to previous 1.54 (colored)

Add an lfs_strategy() that checks to make sure we're not trying to read
where the cleaner is trying to write, instead of tying up the "live"
buffers (or pages).

Fix a bug in the LFS_UBC case where oversized buffers would not be
checksummed correctly, causing uncleanable segments.

Make sure that wakeup(fs->lfs_iocount) is done if fs->lfs_iocount is 1
as well as 0, since we wait in some places for it to drop to 1.

Activate all pages that make it into lfs_gop_write without the segment
lock held, since they must have been dirtied very recently, even if
PG_DELWRI is not set.

Revision 1.54 / (download) - annotate - [select for diffs], Sun Mar 2 04:34:30 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.53: +8 -6 lines
Diff to previous 1.53 (colored)

Account SEGUSE_ACTIVE correctly so that the automatic segment cleaning
actually happens.

Add a new fcntl call that will write the minimum necessary to checkpoint
(i.e., for on-disk directory structure to be consistent, not including
updates to file data) so that the cleaner can clean segments more quickly
without sacrificing three-way commit for cleaning.

Revision 1.53 / (download) - annotate - [select for diffs], Thu Feb 27 07:10:27 2003 UTC (9 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.52: +4 -4 lines
Diff to previous 1.52 (colored)

Do roundup and offset arithmetic in 64 bits, to allow >=2G files.

Revision 1.52 / (download) - annotate - [select for diffs], Tue Feb 25 23:12:07 2003 UTC (9 years, 3 months ago) by perseant
Branch: MAIN
Changes since 1.51: +7 -7 lines
Diff to previous 1.51 (colored)

Make fs-specific fcntl macros take three arguments (approved wrstuden).
Let LFS use fcntl for cleaner functions.

Revision 1.51 / (download) - annotate - [select for diffs], Mon Feb 24 08:42:49 2003 UTC (9 years, 3 months ago) by perseant
Branch: MAIN
Changes since 1.50: +14 -1 lines
Diff to previous 1.50 (colored)

Add lfs_ioctl vnode op, with ioctls to take over cleaner system call
functionality (not including segment clean, since that is now done
automatically as checkpoints happen).

Revision 1.50 / (download) - annotate - [select for diffs], Sun Feb 23 00:22:33 2003 UTC (9 years, 3 months ago) by perseant
Branch: MAIN
Changes since 1.49: +4 -3 lines
Diff to previous 1.49 (colored)

Fix a buffer overflow bug in the LFS_UBC case that manifested itself
either as a mysterious UVM error or as "panic: dirty bufs".  Verify
maximum size in lfs_malloc.

Teach lfs_updatemeta and lfs_shellsort about oversized cluster blocks from
lfs_gop_write.

When unwiring pages in lfs_gop_write, deactivate them, under the theory
that the pagedaemon wanted to free them last we knew.

Revision 1.49 / (download) - annotate - [select for diffs], Thu Feb 20 04:27:23 2003 UTC (9 years, 3 months ago) by perseant
Branch: MAIN
Changes since 1.48: +189 -189 lines
Diff to previous 1.48 (colored)

Tabify, and fix some comment alignment problems.

Revision 1.48 / (download) - annotate - [select for diffs], Wed Feb 19 12:49:10 2003 UTC (9 years, 3 months ago) by yamt
Branch: MAIN
Changes since 1.47: +3 -2 lines
Diff to previous 1.47 (colored)

workaround for "another flush is..." infinity loop in writerd.
if we're writerd, sleep in lfs_flush until another writer goes away
instead of busy loop in writed.

Revision 1.47 / (download) - annotate - [select for diffs], Tue Feb 18 14:58:31 2003 UTC (9 years, 3 months ago) by soren
Branch: MAIN
Changes since 1.46: +3 -1 lines
Diff to previous 1.46 (colored)

Make libsa compile again.

Revision 1.46 / (download) - annotate - [select for diffs], Mon Feb 17 23:48:16 2003 UTC (9 years, 3 months ago) by perseant
Branch: MAIN
Changes since 1.45: +104 -18 lines
Diff to previous 1.45 (colored)

Add code to UBCify LFS.  This is still behind "#ifdef LFS_UBC" for now
(there are still some details to work out) but expect that to go
away soon.  To support these basic changes (creation of lfs_putpages,
lfs_gop_write, mods to lfs_balloc) several other changes were made, to
wit:

* Create a writer daemon kernel thread whose purpose is to handle page
  writes for the pagedaemon, but which also takes over some of the
  functions of lfs_check().  This thread is started the first time an
  LFS is mounted.

* Add a "flags" parameter to GOP_SIZE.  Current values are
  GOP_SIZE_READ, meaning that the call should return the size of the
  in-core version of the file, and GOP_SIZE_WRITE, meaning that it
  should return the on-disk size.  One of GOP_SIZE_READ or
  GOP_SIZE_WRITE must be specified.

* Instead of using malloc(...M_WAITOK) for everything, reserve enough
  resources to get by and use malloc(...M_NOWAIT), using the reserves if
  necessary.  Use the pool subsystem for structures small enough that
  this is feasible.  This also obsoletes LFS_THROTTLE.

And a few that are not strictly necessary:

* Moves the LFS inode extensions off onto a separately allocated
  structure; getting closer to LFS as an LKM.  "Welcome to 1.6O."

* Unified GOP_ALLOC between FFS and LFS.

* Update LFS copyright headers to correct values.

* Actually cast to unsigned in lfs_shellsort, like the comment says.

* Keep track of which segments were empty before the previous
  checkpoint; any segments that pass two checkpoints both dirty and
  empty can be summarily cleaned.  Do this.  Right now lfs_segclean
  still works, but this should be turned into an effectless
  compatibility syscall.

Revision 1.45 / (download) - annotate - [select for diffs], Wed Jan 29 13:14:33 2003 UTC (9 years, 3 months ago) by yamt
Branch: MAIN
Changes since 1.44: +3 -1 lines
Diff to previous 1.44 (colored)

don't use daddr_t for segment summary since it's an on-disk structure.

Revision 1.44 / (download) - annotate - [select for diffs], Mon Jan 27 23:17:56 2003 UTC (9 years, 3 months ago) by yamt
Branch: MAIN
Changes since 1.43: +2 -2 lines
Diff to previous 1.43 (colored)

make these compilable with lfs debug options.
(follow daddr_t change)

XXX maybe segment number should be 64bit.

Revision 1.43 / (download) - annotate - [select for diffs], Fri Jan 24 21:55:25 2003 UTC (9 years, 4 months ago) by fvdl
Branch: MAIN
Changes since 1.42: +25 -22 lines
Diff to previous 1.42 (colored)

Bump daddr_t to 64 bits. Replace it with int32_t in all places where
it was used on-disk, so that on-disk formats remain the same.
Remove ufs_daddr_t and ufs_lbn_t for the time being.

Revision 1.36.2.5 / (download) - annotate - [select for diffs], Wed Dec 11 06:51:43 2002 UTC (9 years, 5 months ago) by thorpej
Branch: nathanw_sa
CVS Tags: nathanw_sa_end
Changes since 1.36.2.4: +7 -0 lines
Diff to previous 1.36.2.4 (colored) to branchpoint 1.36 (colored) next main 1.37 (colored)

Sync with HEAD.

Revision 1.42 / (download) - annotate - [select for diffs], Sun Dec 1 00:12:10 2002 UTC (9 years, 5 months ago) by matt
Branch: MAIN
CVS Tags: nathanw_sa_before_merge, nathanw_sa_base, gmcgarry_ucred_base, gmcgarry_ucred, gmcgarry_ctxsw_base, gmcgarry_ctxsw, fvdl_fs64_base
Changes since 1.41: +8 -1 lines
Diff to previous 1.41 (colored)

Add multiple inclusion protection for headers.  Fix mismatched
variable declarations (missing const's) as needed.

Revision 1.36.6.4 / (download) - annotate - [select for diffs], Fri Sep 6 08:50:14 2002 UTC (9 years, 8 months ago) by jdolecek
Branch: kqueue
Changes since 1.36.6.3: +3 -1 lines
Diff to previous 1.36.6.3 (colored) to branchpoint 1.36 (colored) next main 1.37 (colored)

sync kqueue branch with HEAD

Revision 1.36.2.4 / (download) - annotate - [select for diffs], Thu Aug 1 02:47:03 2002 UTC (9 years, 9 months ago) by nathanw
Branch: nathanw_sa
Changes since 1.36.2.3: +3 -1 lines
Diff to previous 1.36.2.3 (colored) to branchpoint 1.36 (colored)

Catch up to -current.

Revision 1.39.2.2 / (download) - annotate - [select for diffs], Mon Jul 15 10:37:23 2002 UTC (9 years, 10 months ago) by gehenna
Branch: gehenna-devsw
Changes since 1.39.2.1: +3 -1 lines
Diff to previous 1.39.2.1 (colored) to branchpoint 1.39 (colored) next main 1.40 (colored)

catch up with -current.

Revision 1.41 / (download) - annotate - [select for diffs], Sat Jul 6 01:30:11 2002 UTC (9 years, 10 months ago) by perseant
Branch: MAIN
CVS Tags: kqueue-beforemerge, kqueue-base, kqueue-aftermerge, gehenna-devsw-base
Changes since 1.40: +3 -1 lines
Diff to previous 1.40 (colored)

Deal with fragment size changes better.  For each fragment that can
exist on an on-disk inode, we keep a record of its size in struct inode,
which is updated when we write the block to disk.  The cleaner routines
thus have ready access to what size is the correct size for this block,
on disk.

Fixed a related bug: if a file with fragments is being cleaned
(fragments being cleaned) at the same time it is being extended beyond
NDADDR blocks, we could write a bogus FINFO record that has a frag in the
middle; when it was cleaned this would give back bogus file data.  Don't
write the indirect blocks in this case, since there is no need.

lfs_fragextend and lfs_truncate no longer require the seglock, but instead
take a shared lock, which the seglock locks exclusively.

Revision 1.36.6.3 / (download) - annotate - [select for diffs], Sun Jun 23 17:52:09 2002 UTC (9 years, 11 months ago) by jdolecek
Branch: kqueue
Changes since 1.36.6.2: +92 -14 lines
Diff to previous 1.36.6.2 (colored) to branchpoint 1.36 (colored)

catch up with -current on kqueue branch

Revision 1.39.2.1 / (download) - annotate - [select for diffs], Thu Jun 20 15:53:07 2002 UTC (9 years, 11 months ago) by gehenna
Branch: gehenna-devsw
Changes since 1.39: +4 -1 lines
Diff to previous 1.39 (colored)

catch up with -current.

Revision 1.39.4.1 / (download) - annotate - [select for diffs], Thu Jun 20 03:51:02 2002 UTC (9 years, 11 months ago) by lukem
Branch: netbsd-1-6
CVS Tags: netbsd-1-6-RELEASE, netbsd-1-6-RC3, netbsd-1-6-RC2, netbsd-1-6-RC1, netbsd-1-6-PATCH002-RELEASE, netbsd-1-6-PATCH002-RC4, netbsd-1-6-PATCH002-RC3, netbsd-1-6-PATCH002-RC2, netbsd-1-6-PATCH002-RC1, netbsd-1-6-PATCH002, netbsd-1-6-PATCH001-RELEASE, netbsd-1-6-PATCH001-RC3, netbsd-1-6-PATCH001-RC2, netbsd-1-6-PATCH001-RC1, netbsd-1-6-PATCH001
Changes since 1.39: +4 -1 lines
Diff to previous 1.39 (colored) next main 1.40 (colored)

Pull up revision 1.40 (requested by perseant in ticket #325):
For synchronous writes, keep separate i/o counters for each write, so
processes don't have to wait for one another to finish (e.g., nfsd seems
to be a little happier now, though I haven't measured the difference).
Synchronous checkpoints, however, must always wait for all i/o to finish.
Take the contents of the callback functions and have them run in thread
context instead (aiodoned thread).  lfs_iocount no longer has to be
protected in splbio(), and quite a bit less of the segment construction
loop needs to be in splbio() as well.
If lfs_markv is handed a block that is not the correct size according to
the inode, refuse to process it.  (Formerly it was extended to the "correct"
size.)  This is possibly more prone to deadlock, but less prone to corruption.
lfs_segclean now outright refuses to clean segments that appear to have live
bytes in them.  Again this may be more prone to deadlock but avoids
corruption.
Replace ufsspec_close and ufsfifo_close with LFS equivalents; this means
that no UFS functions need to know about LFS_ITIMES any more.  Remove
the reference from ufs/inode.h.
Tested on i386, test-compiled on alpha.

Revision 1.36.2.3 / (download) - annotate - [select for diffs], Thu Jun 20 03:50:26 2002 UTC (9 years, 11 months ago) by nathanw
Branch: nathanw_sa
Changes since 1.36.2.2: +92 -14 lines
Diff to previous 1.36.2.2 (colored) to branchpoint 1.36 (colored)

Catch up to -current.

Revision 1.40 / (download) - annotate - [select for diffs], Sun Jun 16 00:13:15 2002 UTC (9 years, 11 months ago) by perseant
Branch: MAIN
Changes since 1.39: +4 -1 lines
Diff to previous 1.39 (colored)

For synchronous writes, keep separate i/o counters for each write, so
processes don't have to wait for one another to finish (e.g., nfsd seems
to be a little happier now, though I haven't measured the difference).
Synchronous checkpoints, however, must always wait for all i/o to finish.

Take the contents of the callback functions and have them run in thread
context instead (aiodoned thread).  lfs_iocount no longer has to be
protected in splbio(), and quite a bit less of the segment construction
loop needs to be in splbio() as well.

If lfs_markv is handed a block that is not the correct size according to
the inode, refuse to process it.  (Formerly it was extended to the "correct"
size.)  This is possibly more prone to deadlock, but less prone to corruption.

lfs_segclean now outright refuses to clean segments that appear to have live
bytes in them.  Again this may be more prone to deadlock but avoids
corruption.

Replace ufsspec_close and ufsfifo_close with LFS equivalents; this means
that no UFS functions need to know about LFS_ITIMES any more.  Remove
the reference from ufs/inode.h.

Tested on i386, test-compiled on alpha.

Revision 1.39 / (download) - annotate - [select for diffs], Tue May 14 20:03:53 2002 UTC (10 years ago) by perseant
Branch: MAIN
CVS Tags: netbsd-1-6-base
Branch point for: netbsd-1-6, gehenna-devsw
Changes since 1.38: +89 -14 lines
Diff to previous 1.38 (colored)

Phase one of my three-phase plan to make LFS play nice with UBC, and bug-fixes
I found while making sure there weren't any new ones.

* Make the write clusters keep track of the buffers whose blocks they contain.
  This should make it possible to (1) write clusters using a page mapping
  instead of malloc, if desired, and (2) schedule blocks for rewriting
  (somewhere else) if a write error occurs.  Code is present to use
  pagemove() to construct the clusters but that is untested and will go away
  anyway in favor of page mapping.
* DEBUG now keeps a log of Ifile writes, so that any lingering instances of
  the "dirty bufs" problem can be properly debugged.
* Keep track of whether the Ifile has been dirtied by various routines that
  can be called by lfs_segwrite, and loop on that until it is clean, for
  a checkpoint.  Checkpoints need to be squeaky clean.
* Warn the user (once) if the Ifile grows larger than is reasonable for their
  buffer cache.  Both lfs_mountfs and lfs_unmount check since the Ifile can
  grow.
* If an inode is not found in a disk block, try rereading the block, under
  the assumption that the block was copied to a cluster and then freed.
* Protect WRITEINPROG() with splbio() to fix a hang in lfs_update.

Revision 1.36.6.2 / (download) - annotate - [select for diffs], Thu Jan 10 20:05:08 2002 UTC (10 years, 4 months ago) by thorpej
Branch: kqueue
Changes since 1.36.6.1: +9 -9 lines
Diff to previous 1.36.6.1 (colored) to branchpoint 1.36 (colored)

Sync kqueue branch with -current.

Revision 1.36.2.2 / (download) - annotate - [select for diffs], Tue Jan 8 00:34:50 2002 UTC (10 years, 4 months ago) by nathanw
Branch: nathanw_sa
Changes since 1.36.2.1: +9 -9 lines
Diff to previous 1.36.2.1 (colored) to branchpoint 1.36 (colored)

Catch up to -current.

Revision 1.38 / (download) - annotate - [select for diffs], Fri Nov 23 21:44:25 2001 UTC (10 years, 6 months ago) by chs
Branch: MAIN
CVS Tags: newlock-base, newlock, ifpoll-base, ifpoll, eeh-devprop-base, eeh-devprop
Changes since 1.37: +9 -9 lines
Diff to previous 1.37 (colored)

add spaces for KNF.  confirmed to produce identical objects.

Revision 1.36.2.1 / (download) - annotate - [select for diffs], Fri Aug 24 00:13:22 2001 UTC (10 years, 9 months ago) by nathanw
Branch: nathanw_sa
Changes since 1.36: +212 -94 lines
Diff to previous 1.36 (colored)

Catch up with -current.

Revision 1.36.6.1 / (download) - annotate - [select for diffs], Fri Aug 3 04:14:07 2001 UTC (10 years, 9 months ago) by lukem
Branch: kqueue
Changes since 1.36: +212 -94 lines
Diff to previous 1.36 (colored)

update to -current

Revision 1.37 / (download) - annotate - [select for diffs], Fri Jul 13 20:30:22 2001 UTC (10 years, 10 months ago) by perseant
Branch: MAIN
CVS Tags: thorpej-mips-cache-base, thorpej-mips-cache, thorpej-devvp-base3, thorpej-devvp-base2, thorpej-devvp-base, thorpej-devvp, pre-chs-ubcperf, post-chs-ubcperf
Changes since 1.36: +212 -94 lines
Diff to previous 1.36 (colored)

Merge the short-lived perseant-lfsv2 branch into the trunk.

Kernels and tools understand both v1 and v2 filesystems; newfs_lfs
generates v2 by default.  Changes for the v2 layout include:

- Segments of non-PO2 size and arbitrary block offset, so these can be
  matched to convenient physical characteristics of the partition (e.g.,
  stripe or track size and offset).

- Address by fragment instead of by disk sector, paving the way for
  non-512-byte-sector devices.  In theory fragments can be as large
  as you like, though in reality they must be smaller than MAXBSIZE in size.

- Use serial number and filesystem identifier to ensure that roll-forward
  doesn't get old data and think it's new.  Roll-forward is enabled for
  v2 filesystems, though not for v1 filesystems by default.

- The inode free list is now a tailq, paving the way for undelete (undelete
  is not yet implemented, but can be without further non-backwards-compatible
  changes to disk structures).

- Inode atime information is kept in the Ifile, instead of on the inode;
  that is, the inode is never written *just* because atime was changed.
  Because of this the inodes remain near the file data on the disk, rather
  than wandering all over as the disk is read repeatedly.  This speeds up
  repeated reads by a small but noticeable amount.

Other changes of note include:

- The ifile written by newfs_lfs can now be of arbitrary length, it is no
  longer restricted to a single indirect block.

- Fixed an old bug where ctime was changed every time a vnode was created.
  I need to look more closely to make sure that the times are only updated
  during write(2) and friends, not after-the-fact during a segment write,
  and certainly not by the cleaner.

Revision 1.36.4.4 / (download) - annotate - [select for diffs], Fri Jul 13 04:51:23 2001 UTC (10 years, 10 months ago) by perseant
Branch: perseant-lfsv2
Changes since 1.36.4.3: +1 -2 lines
Diff to previous 1.36.4.3 (colored) to branchpoint 1.36 (colored) next main 1.37 (colored)

Be more careful about when we update ctime/mtime.  In particular, if we
are only writing indirect blocks, that doesn't count for mtime; and when
we first create a vnode, that certainly *does not* count for ctime
(a bug that's been there from the beginning).

This does not change the fact that mtime might still be set after write(2)
is "completed", but it does make the atime-in-the-ifile code have some
effect (noticeable less degradation of read time after an intervening
large write).

Revision 1.36.4.3 / (download) - annotate - [select for diffs], Tue Jul 10 01:43:29 2001 UTC (10 years, 10 months ago) by perseant
Branch: perseant-lfsv2
Changes since 1.36.4.2: +21 -8 lines
Diff to previous 1.36.4.2 (colored) to branchpoint 1.36 (colored)

Turn the free list into a tailq, with both head and tail kept on the ifile.

Update access times on the inode even if it does not get marked IN_ACCESS.

Revision 1.36.4.2 / (download) - annotate - [select for diffs], Mon Jul 2 17:48:17 2001 UTC (10 years, 10 months ago) by perseant
Branch: perseant-lfsv2
Changes since 1.36.4.1: +37 -28 lines
Diff to previous 1.36.4.1 (colored) to branchpoint 1.36 (colored)

Change disk addressing unit to be the fragment, instead of the disk sector.
All quantities in the superblock, inodes, indirect blocks, etc. refer now
to this abstract unit (called "fsb" as it is in FFS) instead of disk sectors;
as a consequence segment summary blocks have to be multiples of a fragment in
size.  In v1 filesystems, compatibility code ensures that 1 fsb == 1 sector,
regardless of fragment size.

Fragments can now range in size between 512 and 32k; in the event that
LFS_LABELPAD (8k) is smaller than the disk address unit size, an extra
proto-superblock is kept at 8k from the beginning of the disk, to be used
*only* to locate the real superblocks.  (Not all of the userland knows about
this yet.)

Almost all of this was done not by me, but by joff.

Revision 1.36.4.1 / (download) - annotate - [select for diffs], Wed Jun 27 03:49:39 2001 UTC (10 years, 11 months ago) by perseant
Branch: perseant-lfsv2
Changes since 1.36: +184 -87 lines
Diff to previous 1.36 (colored)

Import of what I've been calling "LFSv2", that is, LFS with some features
added that require changes to the on-disk data structures.  These include:

- 64-bit time in everything but inodes
- User-specified segment offset, and segment size no longer
  restricted to PO2.
- Serial number on segment summaries in addition to timestamp, and
  a new volume identifier, to make roll-forward feasible without
  fear of finding old data and thinking it was new.

Although I think this version works at least as well as what's on the trunk,
we're not done yet; hence this commit is going in on a branch and not on
the trunk.  Enhancements that are not here yet include fragment addressing,
like FFS does, instead of block addressing.

Revision 1.25.2.2 / (download) - annotate - [select for diffs], Sat Feb 3 21:50:12 2001 UTC (11 years, 3 months ago) by he
Branch: netbsd-1-5
CVS Tags: netbsd-1-5-PATCH003, netbsd-1-5-PATCH002, netbsd-1-5-PATCH001
Changes since 1.25.2.1: +42 -1 lines
Diff to previous 1.25.2.1 (colored) to branchpoint 1.25 (colored) next main 1.26 (colored)

Pull up revisions 1.33-1.35 (requested by perseant):
  o Don't write anything if the filesystem is idle (PR#10979).
  o Close up accounting holes in LFS' accounting of immediately-
    available-space, number of clean segments, and amount of dirty
    space taken up by metadata (PR#11468, PR#11470, PR#11534).

Revision 1.16.2.3 / (download) - annotate - [select for diffs], Fri Jan 5 17:37:02 2001 UTC (11 years, 4 months ago) by bouyer
Branch: thorpej_scsipi
Changes since 1.16.2.2: +2 -2 lines
Diff to previous 1.16.2.2 (colored) to branchpoint 1.16 (colored) next main 1.17 (colored)

Sync with HEAD

Revision 1.36 / (download) - annotate - [select for diffs], Wed Dec 20 00:24:23 2000 UTC (11 years, 5 months ago) by cgd
Branch: MAIN
CVS Tags: thorpej_scsipi_nbase, thorpej_scsipi_beforemerge, thorpej_scsipi_base, perseant-lfsv2-base
Branch point for: perseant-lfsv2, nathanw_sa, kqueue
Changes since 1.35: +3 -3 lines
Diff to previous 1.35 (colored)

replace \<space(s)><newline> (wrong!) with \<newline>

Revision 1.16.2.2 / (download) - annotate - [select for diffs], Wed Nov 22 16:06:48 2000 UTC (11 years, 6 months ago) by bouyer
Branch: thorpej_scsipi
Changes since 1.16.2.1: +42 -1 lines
Diff to previous 1.16.2.1 (colored) to branchpoint 1.16 (colored)

Sync with HEAD.

Revision 1.16.2.1 / (download) - annotate - [select for diffs], Mon Nov 20 18:11:47 2000 UTC (11 years, 6 months ago) by bouyer
Branch: thorpej_scsipi
Changes since 1.16: +105 -42 lines
Diff to previous 1.16 (colored)

Update thorpej_scsipi to -current as of a month ago

Revision 1.35 / (download) - annotate - [select for diffs], Fri Nov 17 19:14:41 2000 UTC (11 years, 6 months ago) by perseant
Branch: MAIN
Changes since 1.34: +30 -0 lines
Diff to previous 1.34 (colored)

Correct accounting of lfs_avail, locked_queue_count, and locked_queue_bytes.
(PR #11468).  In the case of fragment allocation, check to see if enough
space is available before extending a fragment already scheduled for writing.

The locked_queue_* variables indicate the number of buffer headers and bytes,
respectively, that are unavailable to getnewbuf() because they are locked up
waiting for LFS to flush them; make sure that that is actually what we're
counting, i.e., never count malloced buffers, and always use b_bufsize instead
of b_bcount.

If DEBUG is defined, the periodic calls to lfs_countlocked will now complain
if either counter is incorrect.  (In the future lfs_countlocked will not need
to be called at all if DEBUG is not defined.)

Revision 1.34 / (download) - annotate - [select for diffs], Mon Nov 13 00:24:30 2000 UTC (11 years, 6 months ago) by perseant
Branch: MAIN
Changes since 1.33: +1 -2 lines
Diff to previous 1.33 (colored)

Remove debugging code that accidentally went in with yesterday's commit.

Revision 1.33 / (download) - annotate - [select for diffs], Sun Nov 12 07:58:36 2000 UTC (11 years, 6 months ago) by perseant
Branch: MAIN
Changes since 1.32: +13 -1 lines
Diff to previous 1.32 (colored)

Do not needlessly dirty segment table blocks during lfs_segwrite,
preventing needless disk activity when the filesystem is idle.  (PR #10979.)

Revision 1.25.2.1 / (download) - annotate - [select for diffs], Thu Sep 14 18:50:17 2000 UTC (11 years, 8 months ago) by perseant
Branch: netbsd-1-5
CVS Tags: netbsd-1-5-RELEASE, netbsd-1-5-BETA2, netbsd-1-5-BETA
Changes since 1.25: +89 -18 lines
Diff to previous 1.25 (colored)

Pull up recent LFS kernel changes (approved by thorpej):

ufs/ufs/inode.h, 1.20--1.22      (add i_lfs_effnblks extension ;
                                 make ITIMES aware of LFS_ITIMES;
                                 _LKM protection so userland progs
                                 compile)
ufs/ufs/ufs_vnops.c, 1.69, 1.71  (remove IN_ADIROP;
                                 use ITIMES instead of FFS_ITIMES)
ufs/ufs/ufs_readwrite.c, 1.27    (use lfs_reserve in lfs_write)
ufs/lfs/lfs.h, 1.26--1.32        (define LFS_EST_* macros ;
                                 change MIN_FREE_SEGS to lfs_minfreesegs ;
                                 add avail and bfree to CLEANERINFO ;
                                 change lfs_uinodes to signed ;
                                 change lfs_dmeta to signed ;
                                 add whitespace to line up structure
                                 members ;
                                 explicit cast to int32_t in LFS_EST_*
                                 macros)
ufs/lfs/lfs_alloc.c, back out 1.34.2.3 (pullups of 1.39, 1.40);
then pull up         1.38        (clean up on error)
                     1.39--1.43  (restore fvdl's ufs_hashlock fix ;
                                 restore fvdl's ufs_hashlock fix ;
                                 set i_lfs_effnblks ;
                                 use UINO macros ;
                                 add comments and fix long lines)
ufs/lfs/lfs_balloc.c, 1.19       (don't succeed halfway)
                      1.21--1.25 (use i_lfs_effnblks ;
                                 fix i_lfs_effnblks computation and
                                 quieten ;
                                 fix i_ffs_blocks in unwritten fragment ;
                                 remove useless debugging check ;
                                 add comments and (c) 2000)
ufs/lfs/lfs_bio.c, 1.24--1.30    (cleanup and make lfs_flush_fs take
                                   "struct lfs *" instead of "struct
                                 mount *" ;
                                 use lfs_minfreeseg instead of
                                 MIN_FREE_SEGS ;
                                 use UINO macros, and copy bfree/avail
                                   to CLEANERINFO ;
                                 add lfs_reserve function ;
                                 1.28--1.30 fix printf formatting)
ufs/lfs/lfs_cksum.c, 1.13        (add (c) 2000)
ufs/lfs/lfs_debug.c, 1.11        (use btodb instead of DEV_BSIZE)
ufs/lfs/lfs_extern.h, 1.18, 1.20--1.21 (function prototype changes)
ufs/lfs/lfs_inode.c, 1.38        (rewrite lfs_truncate from
                                 ffs_truncate)
                     1.40--1.44  (count written and unwritten blocks
                                   seperately ;
                                 use disk block units instead of bytes ;
                                 remove unnecessary "mod" variable ;
                                 correct B_DELWRI to avoid bawrite panic ;
                                 use lfs_reserve)
ufs/lfs/lfs_segment.c, 1.52-1.59 (use lfs_dmeta to note used summaries ;
                                 check for UNWRITTEN in indirect blocks ;
                                 more debugging stuff inside #ifdef
                                 DEBUG_LFS ;
                                 use LK_CANRECURSE ;
                                 don't drop dirty indirect blocks ;
                                 use UINO macros ;
                                 don't hose the free list ;
                                 use btodb() instead of DEV_BSIZE ;
                                 make it compile again (oops))
ufs/lfs/lfs_subr.c, 1.16--1.17   (check for locked inodes before
                                 changing ;
                                 use btodb() instead of DEV_BSIZE, (c)
                                 2000)
ufs/lfs/lfs_syscalls.c, back out 1.41.4.2 (fvdl's ufs_hashlock fix);
then pull up          1.43       (use lfs_dmeta)
                      1.44--1.45 (restore fvdl's ufs_hashlock fix)
                      1.46--1.47 (fix lfs_avail leakage from sblock
                                 segments ;
                                 use UINO macros)
                      1.49       (bounds-check inode numbers in
                                 lfs_markv)
ufs/lfs/lfs_vfsops.c, 1.53       (use LFS_EST_* macros in lfs_statfs)
                      1.56--1.58 (initialize lfs_minfreeseg, lfs_effnblk ;
                                 initialize lfs_uinodes ;
                                 initialize lfs_ravail)
ufs/lfs/lfs_vnops.c, 1.40        (remove VDIROP from removed files)
                     1.42--1.44  (move SET_ENDOP below the removal of
                                 VDIROP ;
                                 use UINO macros and add lfs_itimes
                                 function ;
                                 use lfs_reserve in dirops)

Revision 1.32 / (download) - annotate - [select for diffs], Wed Sep 13 00:07:56 2000 UTC (11 years, 8 months ago) by perseant
Branch: MAIN
Changes since 1.31: +6 -4 lines
Diff to previous 1.31 (colored)

Cast back to int32_t in LFS_EST_BFREE and LFS_EST_RSVD macros, for
consistency with their arguments.

Change the debugging printf in lfs_reserve to match, and enclose it in
#ifdef DEBUG.

Tested on alpha, arm32, sparc.

Revision 1.31 / (download) - annotate - [select for diffs], Sat Sep 9 04:49:54 2000 UTC (11 years, 8 months ago) by perseant
Branch: MAIN
Changes since 1.30: +6 -4 lines
Diff to previous 1.30 (colored)

Various bug-fixes to LFS, to wit:


Kernel:

* Add runtime quantity lfs_ravail, the number of disk-blocks reserved
  for writing.  Writes to the filesystem first reserve a maximum amount
  of blocks before their write is allowed to proceed; after the blocks
  are allocated the reserved total is reduced by a corresponding amount.

  If the lfs_reserve function cannot immediately reserve the requested
  number of blocks, the inode is unlocked, and the thread sleeps until
  the cleaner has made enough space available for the blocks to be
  reserved.  In this way large files can be written to the filesystem
  (or, smaller files can be written to a nearly-full but thoroughly
  clean filesystem) and the cleaner can still function properly.

* Remove explicit switching on dlfs_minfreeseg from the kernel code; it
  is now merely a fs-creation parameter used to compute dlfs_avail and
  dlfs_bfree (and used by fsck_lfs(8) to check their accuracy).  Its
  former role is better assumed by a properly computed dlfs_avail.

* Bounds-check inode numbers submitted through lfs_bmapv and lfs_markv.
  This prevents a panic, but, if the cleaner is feeding the filesystem
  the wrong data, you are still in a world of hurt.

* Cleanup: remove explicit references of DEV_BSIZE in favor of
  btodb()/dbtob().

lfs_cleanerd:

* Make -n mean "send N segments' blocks through a single call to
  lfs_markv".  Previously it had meant "clean N segments though N calls
  to lfs_markv, before looking again to see if more need to be cleaned".
  The new behavior gives better packing of direct data on disk with as
  little metadata as possible, largely alleviating the problem that the
  cleaner can consume more disk through inefficient use of metadata than
  it frees by moving dirty data away from clean "holes" to produce
  entirely clean segments.

* Make -b mean "read as many segments as necessary to write N segments
  of dirty data back to disk", rather than its former meaning of "read
  as many segments as necessary to free N segments worth of space".  The
  new meaning, combined with the new -n behavior described above,
  further aids in cleaning storage efficiency as entire segments can be
  written at once, using as few blocks as possible for segment summaries
  and inode blocks.

* Make the cleaner take note of segments which could not be cleaned due
  to error, and not attempt to clean them until they are entirely free
  of dirty blocks.  This prevents the case in which a cleanerd running
  with -n 1 and without -b (formerly the default) would spin trying
  repeatedly to clean a corrupt segment, while the remaining space
  filled and deadlocked the filesystem.

* Update the lfs_cleanerd manual page to describe all the options,
  including the changes mentioned here (in particular, the -b and -n
  flags were previously undocumented).

fsck_lfs:

* Check, and optionally fix, lfs_avail (to an exact figure) and
  lfs_bfree (within a margin of error) in pass 5.

newfs_lfs:

* Reduce the default dlfs_minfreeseg to 1/20 of the total segments.

* Add a warning if the sgs disklabel field is 16 (the default for FFS'
  cpg, but not usually desirable for LFS' sgs: 5--8 is a better range).

* Change the calculation of lfs_avail and lfs_bfree, corresponding to
  the kernel changes mentioned above.

mount_lfs:

* Add -N and -b options to pass corresponding -n and -b options to
  lfs_cleanerd.

* Default to calling lfs_cleanerd with "-b -n 4".


[All of these changes were largely tested in the 1.5 branch, with the
idea that they (along with previous un-pulled-up work) could be applied
to the branch while it was still in ALPHA2; however my test system has
experienced corruption on another filesystem (/dev/console has gone
missing :^), and, while I believe this unrelated to the LFS changes, I
cannot with good conscience request that the changes be pulled up.]

Revision 1.30 / (download) - annotate - [select for diffs], Sat Sep 9 04:18:28 2000 UTC (11 years, 8 months ago) by perseant
Branch: MAIN
Changes since 1.29: +3 -3 lines
Diff to previous 1.29 (colored)

Change dlfs_dmeta and dlfs_avail to signed quantities, to prevent
underflow errors, visible in userland as impossibly high values
returned from df(1).

Revision 1.29 / (download) - annotate - [select for diffs], Wed Jul 5 22:25:43 2000 UTC (11 years, 10 months ago) by perseant
Branch: MAIN
Changes since 1.28: +47 -5 lines
Diff to previous 1.28 (colored)

Clean up accounting of lfs_uinodes (dirty but unwritten inodes).

Make lfs_uinodes a signed quantity for debugging purposes, and set it to
zero as fs mount time.

Enclose setting/clearing of the dirty flags (IN_MODIFIED, IN_ACCESSED,
IN_CLEANING) in macros, and use those macros everywhere.  Make
LFS_ITIMES use these macros; updated the ITIMES macro in inode.h to know
about this.  Make ufs_getattr use ITIMES instead of FFS_ITIMES.

Revision 1.28 / (download) - annotate - [select for diffs], Tue Jul 4 22:30:37 2000 UTC (11 years, 10 months ago) by perseant
Branch: MAIN
Changes since 1.27: +10 -11 lines
Diff to previous 1.27 (colored)

Fix errors observed while trying to fill the filesystem with yesterday's
fixes:

- Write copies of bfree and avail in the CLEANERINFO block, so the
  cleaner doesn't have to guess which superblock has the current
  information (if indeed any do).

- Tighten up accounting of lfs_avail (more needs to be done).

- When cleansing indirect blocks of UNWRITTEN, make sure not to mark
  them clean, since they'll need to be rewritten later.

Revision 1.27 / (download) - annotate - [select for diffs], Mon Jul 3 01:45:46 2000 UTC (11 years, 10 months ago) by perseant
Branch: MAIN
Changes since 1.26: +7 -5 lines
Diff to previous 1.26 (colored)

Allow the number of free segments reserved for the cleaner to be
parametrized in the filesystem, defaulting to MIN_FREE_SEGS = 2 but set
to something more reasonable at newfs_lfs time.

Note the number of blocks that have been scheduled for writing but which
are not yet on disk in an inode extension, i_lfs_effnblks.  Move
i_ffs_effnlink out of the ffs extension and onto the main inode, since
it's used all over the shared code and the lfs extension would clobber
it.

At inode write time, indirect blocks and inode-held blocks of inodes
that have i_lfs_effnblks != i_ffs_blocks are cleansed of UNWRITTEN disk
addresses, so that these never make it to disk.

Revision 1.26 / (download) - annotate - [select for diffs], Tue Jun 27 20:57:11 2000 UTC (11 years, 11 months ago) by perseant
Branch: MAIN
Changes since 1.25: +34 -10 lines
Diff to previous 1.25 (colored)

Fixes associated with filling an LFS:

Change the space computation to appear to change the size of the *disk*
rather than the *bytes used* when more segment summaries and inode
blocks are written.  Try to estimate the amount of space that these will
take up when more files are written, so the disk size doesn't change too
much.

Regularize error returns from lfs_valloc, lfs_balloc, lfs_truncate: they
now fail entirely, rather than succeeding half-way and leaving the fs in
an inconsistent state.

Rewrite lfs_truncate, mostly stealing from ffs_truncate.  The old
lfs_truncate had difficulty truncating a large file to a non-zero size
(indirect blocks were not handled appropriately).

Unmark VDIROP on fvp after ufs_remove, ufs_rmdir, so these can be
reclaimed immediately: this vnode would not be written to disk again
anyway if the removal succeeded, and if it failed, no directory
operation occurred.

ufs_makeinode and ufs_mkdir now remove IN_ADIROP on error.

Revision 1.23.2.1 / (download) - annotate - [select for diffs], Thu Jun 22 17:10:35 2000 UTC (11 years, 11 months ago) by minoura
Branch: minoura-xpg4dl
Changes since 1.23: +7 -1 lines
Diff to previous 1.23 (colored) next main 1.24 (colored)

Sync w/ netbsd-1-5-base.

Revision 1.25 / (download) - annotate - [select for diffs], Tue Jun 6 20:19:14 2000 UTC (11 years, 11 months ago) by perseant
Branch: MAIN
CVS Tags: netbsd-1-5-base, netbsd-1-5-ALPHA2
Branch point for: netbsd-1-5
Changes since 1.24: +4 -1 lines
Diff to previous 1.24 (colored)

Protect inode free list with seglock, instead of separate lock, so that
the head of the inode free list (on the superblock) always matches the
rest of the free list (in the ifile).

Protect lfs_fragextend with seglock, to prevent the segment byte count
fudging from making its way to disk.

Don't try to inactivate dirop vnodes that are still in the middle of
their dirop (may address PR#10285).

Revision 1.24 / (download) - annotate - [select for diffs], Wed May 31 01:40:01 2000 UTC (11 years, 11 months ago) by perseant
Branch: MAIN
Changes since 1.23: +4 -1 lines
Diff to previous 1.23 (colored)

update for IN_ACCESSED changes

Revision 1.23 / (download) - annotate - [select for diffs], Sat May 27 00:19:52 2000 UTC (12 years ago) by perseant
Branch: MAIN
CVS Tags: minoura-xpg4dl-base
Branch point for: minoura-xpg4dl
Changes since 1.22: +2 -1 lines
Diff to previous 1.22 (colored)

Prevent dirops from getting around lfs_check and wedging the buffer cache.
All the dirop vnops now mark the inodes with a new flag, IN_ADIROP, which
is removed as soon as the dirop is done (as opposed to VDIROP which stays
until the file is written).  To address one issue raised in PR#9357.

Revision 1.22 / (download) - annotate - [select for diffs], Sat May 13 23:43:14 2000 UTC (12 years ago) by perseant
Branch: MAIN
Changes since 1.21: +1 -17 lines
Diff to previous 1.21 (colored)

Change the sementics of the last parameter from a boolean ("waitfor") to
a set of flags ("flags").  Two flags are defined, UPDATE_WAIT and
UPDATE_DIROP.

Under the old semantics, VOP_UPDATE would block if waitfor were set,
under the assumption that directory operations should be done
synchronously.  At least LFS and FFS+softdep do not make this
assumption; FFS+softdep got around the problem by enclosing all relevant
calls to VOP_UPDATE in a "if(!DOINGSOFTDEP(vp))", while LFS simply
ignored waitfor, one of the reasons why NFS-serving an LFS filesystem
did not work properly.

Under the new semantics, the UPDATE_DIROP flag is a hint to the
fs-specific update routine that the call comes from a dirop routine, and
should be wait for, or not, accordingly.

Closes PR#8996.

Revision 1.21 / (download) - annotate - [select for diffs], Fri May 5 20:59:21 2000 UTC (12 years ago) by perseant
Branch: MAIN
Changes since 1.20: +4 -2 lines
Diff to previous 1.20 (colored)

Change the way LFS does block accounting, from trying to infer from the
buffer cache flags, to marking the inode and/or indirect blocks with a
special disk address UNWRITTEN==-2 when a block is accounted for.  (This
address is never written to disk, but only used in-core.  This is essentially
the same method of block accounting as on the UBC branch, where the buffer
headers don't exist.)  Make sure that truncation is handled properly,
especially in the case of holey files.

Fixes PR#9994.

Revision 1.14.2.4 / (download) - annotate - [select for diffs], Thu Jan 20 21:00:49 2000 UTC (12 years, 4 months ago) by he
Branch: netbsd-1-4
CVS Tags: netbsd-1-4-PATCH003, netbsd-1-4-PATCH002
Changes since 1.14.2.3: +2 -1 lines
Diff to previous 1.14.2.3 (colored) to branchpoint 1.14 (colored) next main 1.15 (colored)

Pull up revision 1.20 (requested by perseant):
  Files removed (through unlink, rmdir) are now really removed, though the
  removal is postponed until the dirop is complete to ensure validity of
  the filesystem through a crash.  Use a separate per-fs lock, instead of
  ufs_hashlock, to protect the inode free list.  Change calling semantics
  of lfs_ifind, to give better error reporting:  If fed a struct buf, it
  can report the block number of the offending inode block as well as the
  inode number.

Revision 1.20 / (download) - annotate - [select for diffs], Wed Jan 19 00:03:04 2000 UTC (12 years, 4 months ago) by perseant
Branch: MAIN
CVS Tags: chs-ubc2-newbase
Changes since 1.19: +2 -1 lines
Diff to previous 1.19 (colored)

Changes to stabilize LFS.  The first two of these should also apply to the
1.4 branch.

* Use a separate per-fs lock, instead of ufs_hashlock, to protect the Inode
  free list.  This seems to prevent the "lockmgr: %d, not exclusive lock holder
  %d, unlocking" message I was mis-attributing last night to an unlocked vnode
  being passed to vrele.

* Change calling semantics of lfs_ifind, to give better error reporting:
  If fed a struct buf, it can report the block number of the offending inode
  block as well as the inode number.

* Back out rev 1.10 of lfs_subr.c, since the replacement code was slightly
  uglier while being functionally identical.

* Make lfs_vunref use the same free list convention as vrele/vput, so that
  vget does not remove vnodes from a hash list they are not on.

Revision 1.16.6.1 / (download) - annotate - [select for diffs], Mon Dec 27 18:36:39 1999 UTC (12 years, 5 months ago) by wrstuden
Branch: wrstuden-devbsize
Changes since 1.16: +7 -9 lines
Diff to previous 1.16 (colored) next main 1.17 (colored)

Pull up to last week's -current.

Revision 1.14.2.3 / (download) - annotate - [select for diffs], Fri Dec 17 23:53:17 1999 UTC (12 years, 5 months ago) by he
Branch: netbsd-1-4
Changes since 1.14.2.2: +5 -6 lines
Diff to previous 1.14.2.2 (colored) to branchpoint 1.14 (colored)

Pull up revision 1.17 (requested by perseant):
  Address locking protocol error for inode hash, and make the
  maximum number of active dirops a global quantity.

Revision 1.14.2.2 / (download) - annotate - [select for diffs], Fri Dec 17 23:20:39 1999 UTC (12 years, 5 months ago) by he
Branch: netbsd-1-4
Changes since 1.14.2.1: +2 -1 lines
Diff to previous 1.14.2.1 (colored) to branchpoint 1.14 (colored)

Pull up revision 1.15 (requested by perseant):
  Avoid flushing vnodes involved in a dirop, making lfs' promise
  of "no fsck needed, even in the event of a crash" closer to
  reality.

Revision 1.19 / (download) - annotate - [select for diffs], Wed Dec 15 07:10:34 1999 UTC (12 years, 5 months ago) by perseant
Branch: MAIN
CVS Tags: wrstuden-devbsize-base, wrstuden-devbsize-19991221
Changes since 1.18: +1 -2 lines
Diff to previous 1.18 (colored)

In lfs_bwrite, don't mark buffers dirty if lfs is mounted read-only.
(Previously buffers could be marked dirty by the cleaner, and possibly by
other means.)

Also check for softdep mount in vfs_shutdown before trying to bawrite
buffers, since other filesystems don't need it and lfs doesn't bawrite.
(This fragment reviewed by fvdl.)

Partially addresses PR#8964.

Revision 1.18 / (download) - annotate - [select for diffs], Wed Dec 8 23:17:31 1999 UTC (12 years, 5 months ago) by simonb
Branch: MAIN
Changes since 1.17: +3 -3 lines
Diff to previous 1.17 (colored)

Use an explicitly sized type (u_int32_t) for inode numbers in the super
block instead of ino_t.  Reviewed by Konrad Schroder.

Revision 1.14.6.1 / (download) - annotate - [select for diffs], Tue Nov 30 13:36:22 1999 UTC (12 years, 5 months ago) by itojun
Branch: kame
CVS Tags: kame_141_19991130
Changes since 1.14: +2 -1 lines
Diff to previous 1.14 (colored) next main 1.15 (colored)

bring in latest KAME (as of 19991130, KAME/NetBSD141) into kame branch
just for reference purposes.
This commit includes 1.4 -> 1.4.1 sync for kame branch.

The branch does not compile at all (due to the lack of ALTQ and some other
source code).  Please do not try to modify the branch, this is just for
referenre purposes.

synchronization to latest KAME will take place on HEAD branch soon.

Revision 1.16.4.1 / (download) - annotate - [select for diffs], Mon Nov 15 00:42:23 1999 UTC (12 years, 6 months ago) by fvdl
Branch: fvdl-softdep
Changes since 1.16: +5 -6 lines
Diff to previous 1.16 (colored) next main 1.17 (colored)

Sync with -current

Revision 1.17.2.2 / (download) - annotate - [select for diffs], Sat Nov 6 20:33:06 1999 UTC (12 years, 6 months ago) by perseant
Branch: comdex-fall-1999
Changes since 1.17.2.1: +530 -0 lines
Diff to previous 1.17.2.1 (colored) to branchpoint 1.17 (colored) next main 1.18 (colored)

Address ufs_hashlock/ufs_ihashins protocol bug, discovered while doing a
post-mortem of a production machine.  Also, take the active dirop
count off of the fs and make it global (since it is measuring a global
resource) and tie the threshold value LFS_MAXDIROP to desiredvnodes.

Revision 1.17.2.1, Sat Nov 6 20:33:05 1999 UTC (12 years, 6 months ago) by perseant
Branch: comdex-fall-1999
Changes since 1.17: +0 -530 lines
FILE REMOVED

file lfs.h was added on branch comdex-fall-1999 on 1999-11-06 20:33:06 +0000

Revision 1.17 / (download) - annotate - [select for diffs], Sat Nov 6 20:33:05 1999 UTC (12 years, 6 months ago) by perseant
Branch: MAIN
CVS Tags: fvdl-softdep-base, comdex-fall-1999-base
Branch point for: comdex-fall-1999
Changes since 1.16: +5 -6 lines
Diff to previous 1.16 (colored)

Address ufs_hashlock/ufs_ihashins protocol bug, discovered while doing a
post-mortem of a production machine.  Also, take the active dirop
count off of the fs and make it global (since it is measuring a global
resource) and tie the threshold value LFS_MAXDIROP to desiredvnodes.

Revision 1.14.4.2 / (download) - annotate - [select for diffs], Tue Aug 31 21:03:45 1999 UTC (12 years, 8 months ago) by perseant
Branch: chs-ubc2
Changes since 1.14.4.1: +4 -2 lines
Diff to previous 1.14.4.1 (colored) to branchpoint 1.14 (colored) next main 1.15 (colored)

Rudimentary support for LFS under UBC:

- LFS-specific VOP_BALLOC and VOP_PUTPAGES vnode ops.

- getblk VREG panic #ifdef'd out (can be reinstated when Ifile is
  internalized and Ifile can be made another type from VREG)

- interface to VOP_PUTPAGES changed to pass all pager flags, not
  just sync.  FS putpages routines must know about the pager flags.

- new LFS magic disk address, -2 ("unwritten"), meaning accounted for
  but not assigned to a fixed disk location (since LFS does these two
  things separately, and the previous accounting method using buffer
  headers no longer will work).  Changed references to (foo == (daddr_t)-1)
  to (foo < 0).  Since disk drivers reject all addresses < 0, this should
  not present a problem for other FSs.

Revision 1.14.2.1 / (download) - annotate - [select for diffs], Fri Jun 25 20:49:37 1999 UTC (12 years, 11 months ago) by perry
Branch: netbsd-1-4
CVS Tags: netbsd-1-4-PATCH001
Changes since 1.14: +2 -1 lines
Diff to previous 1.14 (colored)

pullup 1.15->1.16 (perseant)

Revision 1.14.4.1 / (download) - annotate - [select for diffs], Mon Jun 21 01:31:06 1999 UTC (12 years, 11 months ago) by thorpej
Branch: chs-ubc2
Changes since 1.14: +3 -1 lines
Diff to previous 1.14 (colored)

Sync w/ -current.

Revision 1.16 / (download) - annotate - [select for diffs], Tue Jun 15 22:25:41 1999 UTC (12 years, 11 months ago) by perseant
Branch: MAIN
CVS Tags: chs-ubc2-base
Branch point for: wrstuden-devbsize, thorpej_scsipi, fvdl-softdep
Changes since 1.15: +2 -1 lines
Diff to previous 1.15 (colored)

Minor changes to the segment live bytes calculation.  In particular, fixed
a bug in fragment extension that could run the count negative.  Also, don't
overcount for inodes, and don't count segment summaries.  Thus, for empty
segments the live bytes count should now be exactly zero.

Revision 1.15 / (download) - annotate - [select for diffs], Tue Jun 1 03:00:40 1999 UTC (12 years, 11 months ago) by perseant
Branch: MAIN
Changes since 1.14: +2 -1 lines
Diff to previous 1.14 (colored)

Fixed lfs_update (and related functions) so that calls from lfs_fsync
will DTRT with vnodes marked VDIROP.  In particular, the message
"flushing VDIROP" will no longer appear, and the filesystem will remain
stable in the event of a crash.

This was particularly a problem with NFS-exported LFSes, since fsync
was called on every file close.

Revision 1.14 / (download) - annotate - [select for diffs], Thu Mar 25 21:39:18 1999 UTC (13 years, 2 months ago) by perseant
Branch: MAIN
CVS Tags: netbsd-1-4-base, netbsd-1-4-RELEASE, kame_14_19990705, kame_14_19990628
Branch point for: netbsd-1-4, kame, chs-ubc2
Changes since 1.13: +2 -13 lines
Diff to previous 1.13 (colored)

clean up unused/required #ifdefs

Revision 1.13 / (download) - annotate - [select for diffs], Wed Mar 17 18:38:34 1999 UTC (13 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.12: +3 -3 lines
Diff to previous 1.12 (colored)

Move dlfs_pad to the end of struct dlfs (after the pad), for upward
compatibility.

Revision 1.12 / (download) - annotate - [select for diffs], Wed Mar 17 16:49:00 1999 UTC (13 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.11: +1 -1 lines
Diff to previous 1.11 (colored)

Fix pad on lfs.h so it is really 512 bytes, as advertized

Revision 1.11 / (download) - annotate - [select for diffs], Wed Mar 10 00:20:00 1999 UTC (13 years, 2 months ago) by perseant
Branch: MAIN
Changes since 1.10: +126 -20 lines
Diff to previous 1.10 (colored)

New sources should leave the LFS in a more-or-less working state.  Changes
include:

	- DIROP segregation is enabled, and greater care is taken
	  to make sure that a checkpoint completes.  Fsck is not
	  needed to remount the filesystem.
	- Several checks to make sure that the LFS subsystem does not
	  overuse various resources (memory, in particular).
	- The cleaner routines, lfs_markv in particular, are completely
	  rewritten.  A buffer overflow is removed.  Greater care is taken
	  to ensure that inodes come from where lfs_cleanerd say they come
	  from (so we know nothing has changed since lfs_bmapv was called).
	- Fragment allocation is fixed, so that writes beyond end-of-file
	  do the right thing.

Revision 1.10 / (download) - annotate - [select for diffs], Fri Sep 11 21:27:12 1998 UTC (13 years, 8 months ago) by pk
Branch: MAIN
CVS Tags: kenh-if-detach-base, kenh-if-detach, chs-ubc-base, chs-ubc
Changes since 1.9: +99 -52 lines
Diff to previous 1.9 (colored)

PR#6032: define fixed sized on-disk superblock structure.

Revision 1.9 / (download) - annotate - [select for diffs], Sun Mar 1 02:23:23 1998 UTC (14 years, 2 months ago) by fvdl
Branch: MAIN
CVS Tags: eeh-paddr_t-base, eeh-paddr_t
Changes since 1.8: +52 -26 lines
Diff to previous 1.8 (colored)

Merge with Lite2 + local changes

Revision 1.1.1.2 / (download) - annotate - [select for diffs] (vendor branch), Sun Mar 1 02:14:11 1998 UTC (14 years, 2 months ago) by fvdl
Branch: netbsd, CSRG
CVS Tags: lite-2
Changes since 1.1.1.1: +157 -125 lines
Diff to previous 1.1.1.1 (colored)

Import 4.4BSD-Lite2

Revision 1.1.1.1 / (download) - annotate - [select for diffs] (vendor branch), Sun Mar 1 02:10:46 1998 UTC (14 years, 2 months ago) by fvdl
Branch: netbsd, CSRG
CVS Tags: lite-1, date-03-may-96
Changes since 1.1: +1 -4 lines
Diff to previous 1.1 (colored)

Import 4.4BSD-Lite for reference

Revision 1.8 / (download) - annotate - [select for diffs], Thu Dec 5 19:01:46 1996 UTC (15 years, 5 months ago) by is
Branch: MAIN
CVS Tags: thorpej-signal-base, thorpej-signal, thorpej-setroot, netbsd-1-3-base, netbsd-1-3-RELEASE, netbsd-1-3-PATCH003-CANDIDATE2, netbsd-1-3-PATCH003-CANDIDATE1, netbsd-1-3-PATCH003-CANDIDATE0, netbsd-1-3-PATCH003, netbsd-1-3-PATCH002, netbsd-1-3-PATCH001, netbsd-1-3-BETA, netbsd-1-3, mrg-vm-swap, marc-pcmcia-bp, marc-pcmcia-base, marc-pcmcia, is-newarp-before-merge, is-newarp-base, is-newarp, bouyer-scsipi
Changes since 1.7: +8 -8 lines
Diff to previous 1.7 (colored)

Make the struct lfs 512 bytes long on 32bit machines whose compiler doesn't
align 32bit integers. Use explicit sized typing at some other places.

XXX This still won't fix lfs for 64bit machines, as we have some
assumptions about sizeof(pointer)=sizeof(u_int32_t) in here, and (if I
looked right) a misaligned u_int64_t. The right fix (to cite cgd) will
be to seperate on-disk-representation from in-core, but I don't have
the time (at the moment) to do this.

Revision 1.7 / (download) - annotate - [select for diffs], Fri Feb 9 22:28:45 1996 UTC (16 years, 3 months ago) by christos
Branch: MAIN
CVS Tags: netbsd-1-2-base, netbsd-1-2-RELEASE, netbsd-1-2-PATCH001, netbsd-1-2-BETA, netbsd-1-2
Changes since 1.6: +6 -6 lines
Diff to previous 1.6 (colored)

lfs prototypes

Revision 1.6 / (download) - annotate - [select for diffs], Wed Dec 21 20:01:01 1994 UTC (17 years, 5 months ago) by mycroft
Branch: MAIN
CVS Tags: netbsd-1-1-base, netbsd-1-1-RELEASE, netbsd-1-1-PATCH001, netbsd-1-1
Changes since 1.5: +2 -0 lines
Diff to previous 1.5 (colored)

Add RCS ids where missing.

Revision 1.5 / (download) - annotate - [select for diffs], Wed Dec 14 13:03:45 1994 UTC (17 years, 5 months ago) by mycroft
Branch: MAIN
Changes since 1.4: +43 -41 lines
Diff to previous 1.4 (colored)

Sync with CSRG.

Revision 1.4 / (download) - annotate - [select for diffs], Thu Nov 17 16:58:41 1994 UTC (17 years, 6 months ago) by mycroft
Branch: MAIN
Changes since 1.3: +3 -1 lines
Diff to previous 1.3 (colored)

Round struct lfs to 512 bytes.

Revision 1.3 / (download) - annotate - [select for diffs], Thu Oct 20 04:21:10 1994 UTC (17 years, 7 months ago) by cgd
Branch: MAIN
Changes since 1.2: +102 -104 lines
Diff to previous 1.2 (colored)

update for new syscall args description mechanism, and deal safely
with wider types.

Revision 1.2 / (download) - annotate - [select for diffs], Wed Jun 29 06:46:46 1994 UTC (17 years, 11 months ago) by cgd
Branch: MAIN
CVS Tags: netbsd-1-0-base, netbsd-1-0-RELEASE, netbsd-1-0-PATCH1, netbsd-1-0-PATCH06, netbsd-1-0-PATCH05, netbsd-1-0-PATCH04, netbsd-1-0-PATCH03, netbsd-1-0-PATCH02, netbsd-1-0-PATCH0, netbsd-1-0
Changes since 1.1: +3 -2 lines
Diff to previous 1.1 (colored)

New RCS ID's, take two.  they're more aesthecially pleasant, and use 'NetBSD'

Revision 1.1 / (download) - annotate - [select for diffs], Wed Jun 8 11:42:23 1994 UTC (17 years, 11 months ago) by mycroft
Branch: MAIN

Update to 4.4-Lite fs code, with local changes.

This form allows you to request diff's between any two revisions of a file. You may select a symbolic revision name using the selection box or you may type in a numeric name using the type-in text box.




CVSweb <webmaster@jp.NetBSD.org>