CVS log for src/lib/librumpuser/rumpuser.c

Up to [cvs.NetBSD.org] / src / lib / librumpuser

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

PR kern/57626: instead of an (arbitrary) FAKE_PAGE_SHIFT (and always
using 4k pages), query the hypervisor for the real page size of the host
kernel and use that for architectures that do not have compile time
constant page sizes.

Fix return value inspection for clock_nanosleep() (not displayed in the
diff, need to look at the entire file for context).

from Robert Millan <rmh@freebsd.org> via rumpkernel-users

Print the "halted\n" from previous commit to stdout, not stderr.

The putchar hypercall writes to stdout, so this change restores
the original "functionality" (which was not intended to change).

from gson, via tests

Since the rump kernel does not know when the container it's running in
actually halts, print "halted" in the hypercall.

check clock_gettime() rv

Rebase to HEAD as of a few days ago.

Rebase.

Clean up error handling in rumpuser_init()

Clean up random implementation for librumpuser

Use /dev/urandom for platforms without arc4random, not srandom(),
deduplicate code, do not read excessive random bytes

Reviewed by pooka@

Reinstate include of netdb.h, needed on some cross builds

Split out file and memory access in librumpuser

This allows alternate implementations to reuse these parts, and the file
parts will at the next hypercall revision be moved to their own driver.

Discussed with pooka@

sync with head.

for a reference, the tree before this commit was tagged
as yamt-pagecache-tag8.

this commit was splitted into small chunks to avoid
a limitation of cvs.  ("Protocol error: too many arguments")

Always use sysconf() to query host processor count instead of separate
tricks for each platform.

Do not use uninitialized pointer if posix_memalign() fails.

make implementation of rumpuser_kill() match the documentation

Translate signal numbers between rump kernel and (POSIX) host.

librumpuser: add some #ifdef __APPLE__ and missing bits to build it on OS X.
OK pooka@

Change the default value of rump kernels CPUs to 2.  It used to be
the number of host cores, but that value is overkill for most uses,
especially with massively multicore hosts.  Dozens of useless virtual
CPUs are relatively speaking expensive in terms of bootstrap time and
memory footprint.  On the other end of the spectrum, defaulting to 2
might shake out some bugs from the qemu test runs.

resync from head

Add a generalized rumpuser_syncfd() call which allows the caller
to request a sync or a barrier for fd.

Pass off_t over the hypercall interface as int64_t to avoid potential
problems in setups where off_t doesn't want to be 64bit.

I'm already excitedly waiting for 128bit off_t and _LARGE_LARGE_FILES

Pass enums over the hypercall interface as ints to avoid some
pathological scenarios from arising in setups where enums might be
of a different size in the rump kernel and hypervisor.

Ok, maybe using int64 for nanoseconds in the (sec,nsec) tuple was
a bit too future-proof.  I think long is enough there (let's just
hope nobody redefines "nano").  Also, make seconds signed just in
case someone wants their clock to be in 1901.

avoid Wunused on !NetBSD

Flip parameter order in the clock hypercalls to make them consistent
with everything else wrt in/out parameters.

Translate error codes between the hypervisor and rump kernel.

Some systems don't provide preadv/pwritev (hi Solaris!), so implement
that with lseek + readv/writev instead (and avoid rewinding the
pointer with soon-to-be documentation).

Make hypercall calling conventions consistent: iff a hypercall can fail,
it returns an int containing the error value.

Reduce hypercalls related to reading to essentially an amalgamation
of readv and preadv.  ditto for writing.  Hypercalls are so seldomly
used that it doesn't justify 3x the calls for syntactic sugar.

Replace the various "get info from hypervisor" interfaces with one
unified rumpuser_getparam(), and make it return a plist.  The
contents can come e.g. from the env or a config file.  Make
identifiers starting with an underscore denote system identifiers
which must be implemented by hypervisor. (yea, j/k about the plist bit)

The fsync hypercall is now used only with close, so get rid of it.
rumpuser_bio() should do the necessary syncing.

Make the rump kernel upcalls which were previous available only to
the sysproxy module available for the entire hypervisor.

RUMPUSER_OPEN_DIRECT is no longer necessary

changes to bio hypercalls, part 3/n:

retire the filemmap/memsync hypercalls, they're no longer used

Rework how the bio hypercalls work, part 1/n:

Reduce the set of hypercalls to one: "do block i/o".  This not only
eliminates a lot of pseudo-duplicate code, it also gives the
hypervisor a lot more freedom on how to optimize the i/o.

don't need event.h here anymore

Improve the time-related hypercalls so that's it's possible to
sleep until an absolute time on the host's monotonic clock (should
something like that be supported).

make the file monitoring hypercalls private to shmif

The ioctl hypercall is used only by the usb host controller driver,
so make it exclusive to that component.  I'm happy to see it gone.

make the random hypercall more generic

* treat kern_malloc.c as an unreal allocator (it's so lightweight)
* get rid of the rumpuser_realloc() hypercall
* pass size to rumpuser_free()

rumpuser_poll() is used only by sockin, so make the hypercall
private to that component.

* integrate rumpuser_getversion() with the hypervisor initialization
* rename some identifiers to better match reality

Terminate result of readlink().  Makes writefilewatch_setup() work in
cases when the buffer doesn't accidentally contain suitable zeroes.

Thanks to Juan RP who debugged this with me!

resync with head

sync with head

sync with (a bit old) head

Use the /proc way for counting host cores on Cygwin.

.. and make it compile on said platforms.

Provide an implementation of writewatchfile for platforms without kqueue
or inotify (it's a rather simple implementation ;)

FreeBSD and DragonFly also provide hosts cpus via sysctl hw.ncpu.

Apparently MAP_ANON mmap() on Linux requires MAP_PRIVATE to be specified
for the addr parameter to have a sane effect.  Make it so.

Resync to 2012-11-19 00:00:00 UTC

Fixes for Solarisa.

Check return value of ftruncate().  Some versions of gcc give
warnings if I don't.

sync with head

Implement the writewatchfile routines for a Linux hypervisor.  As a
result, the shmif network driver now works when hosted on Linux.

Do not assume that O_FOO flags have matching values in the rump kernel
and hypervisor.

Make librumphijack compile and work on Linux.  Do not try to hijack
calls which are not supported on Linux and therefore cannot be
handled by the rump kernel side syscall emulation (not that they'd
be present in the calling binaries anyway).

Once again, make the rump kernel hypercall layer work on Linux.

Update old-style definitions to ANSI, remove a couple of register
definitions along the way. Fixed gcc 4.1 build (thank you vax)

sync with head

Remove arc4random() and arc4randbytes() from the kernel API.  Replace
arc4random() hacks in rump with stubs that call the host arc4random() to
get numbers that are hopefully actually random (arc4random() keyed with
stack junk is not).  This should fix some of the currently failing anita
tests -- we should no longer generate duplicate "random" MAC addresses in
the test environment.

Sync with HEAD

Support query of the partition size in case underlying device is
a wedge.  This still lacks the proplibistic query of the sector
size and just assumes 512.  It's good that we make asking a file's
size as simple as requiring one stat(), one open() and three (3)
different ioctls plus some proplist mumbojumbo.  I'm surprised it's
available at all by means other than #wish.

code mostly from Taylor R Campbell, rant from me.

happiness is a quiet lint

include pid of rump server in hostname

Fix fd leak also in non-NetBSD code path.

Fix fdleak in error case. Found by cppcheck.

Make int *error and optional parameter (i.e. it can be NULL).
Sometimes the caller just doesn't care which errno close() might
throw.

* if kevent() fails with EINTR, try again instead of returning an error
* stuff rumpuser_dprintf to stderr instead of stdout

Version rumpuser ABI with a lightweight mechanism.

Add the ability to specify a preferred address the "map anon memory"
hypercall.

Check return value of posix_memalign ... always helpful to not return
garbage memory in case of failure.

Don't pass "canfail" down to rumpuser_malloc -- there's quite little
we can do with that info way down there.  Instead, pass alignment.
Implement rumpuser_malloc() with posix_memalign().

Add rumpuser interface to fetch number of host cpus.

Actually, support rumpuser_kill() only on NetBSD, since signal
numbers may not match on non-NetBSD hosts.

Add rumpuser_kill, which sends a signal to a host process.

librumpuser is not _KERNEL code and does not belong in sys.  Move
the source files from src/sys/rump/librump/rumpuser to src/lib/librumpuser
(from where it is already built).  Even so, keep rumpuser.h in
sys/rump/include for kernel source tree self-containment.