CVS log for src/lib/libc/citrus/citrus_none.c

Up to [cvs.NetBSD.org] / src / lib / libc / citrus

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

Mostly merge changes from HEAD upto 20200411

PR/54414: Valery Ushakov: c99 requires that wcsrtombs(3) updates the source
argument on conversion error

Make the tests pass once more when __STDC_ISO_10646__ is not defined.

Move Unicode <-> ku/ten mapping into the individual codec modules.
Mapping is based on existing iconv data for single-byte encodings,
and included for several, but not all, multibyte encodings.

Initial commit of a mostly-working implementation of __STDC_ISO_10646__,
with collation support using the Unicode Collation Algorithm.

The conversion from men/ku/ten form to Unicode is a gross hack at present.
Fixing this, and fleshing out the LC_COLLATE locale component, are next
on the agenda.

s == NULL is illegal.

Redo previous: catch NULL pointer earlier, check for empty string
latter.

Spell NULL correctly.

sync with head.

for a reference, the tree before this commit was tagged
as yamt-pagecache-tag8.

this commit was splitted into small chunks to avoid
a limitation of cvs.  ("Protocol error: too many arguments")

resync from head

Add mbsnrtowcs and wcsnrtombs. Approved by core.

Sync w/ -current. 34 merge conflicts to follow.

sync with head.

remove unused include, locale.h.

file citrus_none.c was added on branch christos-time_t on 2008-06-14 16:01:08 +0000

remove unused include, locale.h.

remove unnecessary __UNCONST.

WARNS=4

Initialize error return value.

fix lib/31874.
- add _citrus_stdenc_get_state_desc() interface to get
  encoding-scheme-independent encoder/decoder state descriptions.
- make sure that iconv_std module uses it to judge whether the last
  sequences forms complete shift sequences.
- bump minor of i18n_module because of get_state_desc().

Pull up revision 1.13 (requested by christos in ticket #1361):
Don't sign extend characters when they get converted to wide characters in
mbtowc. Otherwise you are not going to be able to wctomb them. Added
regression test. From kim, many thanks.

Pull up revision 1.13 (requested by christos in ticket #68):
Don't sign extend characters when they get converted to wide characters in
mbtowc. Otherwise you are not going to be able to wctomb them. Added
regression test. From kim, many thanks.

Don't sign extend characters when they get converted to wide characters in
mbtowc. Otherwise you are not going to be able to wctomb them. Added
regression test. From kim, many thanks.

_citrus_NONE_stdenc_wctomb: return E2BIG correctly.

_citrus_NONE_stdenc_cstomb: return E2BIG correctly.

correct wcrtomb(3) - it is not conforming to standard on handling L'\0'.
This change also affects Citrus iconv engine.

Citrus iconv support (1)
add core engine of Citrus iconv and some support routines.
  - iconv core (citrus_iconv)
  - coded character set mapper (csmapper)
  - encoding scheme database (esdb)
  - standard encoding scheme handler (stdenc)
  - basic character set manipulation utilities (bcs)
  - mmap based infrastructure (citrus_lookup/_mmap/_memstream/_db)
  - some source codes of new plugins (not built yet)

Pull up revision 1.7 (requested by yamt in ticket #1202):
when s==0, wctomb should initialize its internal state and return if
encodings have state dependency or not.
a patch provided with PR 18269 by wurlitzer.
modified by me.
fix part of PR 18269.

Pull up revision 1.6 (requested by yamt in ticket #1202):
mbsrtowcs_priv template:
        n == 0 is not an error. it's a valid input.
_citrus_NONE_ctype_mbsrtowcs:
        fix a typo that causes SEGV.
while i'm here, make them similar each other.
fix PR 19620.

changes related to lib/20576 and lib/20577.
  - add wcstok() and wcswcs(),
  - add wcstok(3),
  - move btowc() and wctob() into each ctype modules,
  - bump ctype interface ABI version,
  - bump i18n modules' minor and
  - update sets.
and fix a stupid bug in _RUNE_ISCACHED macro.

Sync with HEAD.

when s==0, wctomb should initialize its internal state and return if
encodings have state dependency or not.

a patch provided with PR 18269 by wurlitzer.
modified by me.

fix part of PR 18269.

mbsrtowcs_priv template:
	n == 0 is not an error. it's a valid input.
_citrus_NONE_ctype_mbsrtowcs:
	fix a typo that causes SEGV.

while i'm here, make them similar each other.

fix PR 19620.

Catch up to -current.

1.6 pullup ticket number 11, from thorpej. Original commit message:

>Add some casts to quiet a "discards qualifier from pointer target type"
>warning from gcc 3.2 (experimental) (which is complaining about the loss
>of __restrict).
>
>Reviewed and approved by tshiozak@astec.co.jp.

Add some casts to quiet a "discards qualifier from pointer target type"
warning from gcc 3.2 (experimental) (which is complaining about the loss
of __restrict).

Reviewed and approved by tshiozak@astec.co.jp.

Catch up to -current.

wcsrtombs: handle dst == 0 case correctly.

Catch up to -current.

file citrus_none.c was added on branch nathanw_sa on 2002-03-22 20:42:01 +0000

remove unneeded ARGSUSED.

fix a bug; calling mbtowc(0, 0, 0) causes the programs to crash under
single byte locales.

refine i18n stuffs.
  - add libc/citrus directory.
    this directory contains the common stuffs not only for locale
    but also other facilities relating to i18n (e.g. iconv).
  - To keep the binary compatibility for the ctype modules easily,
    the interface between libc and the modules is simplified.
  - For the future integrated extension, module pool is renamed
    from "/usr/lib/runemodule" to "/usr/lib/i18n".
    In the future, this directory will contain the modules for "iconv",
    "collation", etc.
  - some cosmetic changes.
  - Bug fix for runetype.h; __attribute__((__packed__)) is placed at
    the wrong position and it is invalid unintentionally.
    But, the all members of the structures seem well-aligned.  Thus,
    this bug causes no problem, hopefully.

HEADS UP:
  - /usr/lib/rumemodule is obsoleted.  If you use the multibyte locales,
    you need to install /usr/lib/i18n/* from sys/lib/i18n_module .
  - The binary compatibility of /usr/share/locale/*/LC_CTYPE is probably kept.
    Perhaps, the bug fix about __packed__ mentioned above breaks the
    compatibility...  Be careful especially on 64bit platforms.