CVS log for pkgsrc/devel/py-protobuf/PLIST

Up to [cvs.NetBSD.org] / pkgsrc / devel / py-protobuf

Request diff between arbitrary revisions

Default branch: MAIN

Revision 1.22 / (download) - annotate - [select for diffs], Wed Nov 15 18:12:24 2023 UTC (2 weeks, 2 days ago) by wiz
Branch: MAIN
CVS Tags: HEAD
Changes since 1.21: +9 -6 lines
Diff to previous 1.21 (colored)

*protobuf: update to 25.0 branch

Compiler

    Implement proto2/proto3 with editions (3813b66)
    Defines Protobuf compiler version strings as macros and separates out suffix string definition. (3c59585)
    Add utf8_validation feature back to the global feature set. (153028d)
    Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (4322e00)
    Merge the protobuf and upb Bazel repos (7286ffc)
    Editions: Introduce functionality to protoc for generating edition feature set defaults. (4019e25)
    Editions: Migrate edition strings to enum in C++ code. (f083ebf)
    Create a reflection helper for ExtensionIdentifier. (4d5ab73)
    Editions: Provide an API for C++ generators to specify their features. (e897bcf)
    Editions: Refactor feature resolution to use an intermediate message. (57d8049)
    Publish extension declarations with declaration verifications. (e72b0e1)
    Editions: Stop propagating partially resolved feature sets to plugins. (b66ef4c)
    Editions: Migrate string_field_validation to a C++ feature (1f95830)
    Editions: Include defaults for any features in the generated pool. (15863ff)
    Protoc: parser rejects explicit use of map_entry option (#13479) (8f59292)
    Protoc: validate that reserved range start is before end (#13474) (3be00f7)
    Protoc: support identifiers as reserved names in addition to string literals (only in editions) (#13471) (e701f4f)
    Drop support for Bazel 5. (a80daa2)
    Allow code generators to specify whether or not they support editions. (2176a14)

C++

    Set PROTOBUF_EXPORT on InternalOutOfLineDeleteMessageLite() (#14434) (db89a51)
    Update stale checked-in files (#14431) (ada0be8)
    Apply PROTOBUF_NOINLINE to declarations of some functions that want it. (6e848b0)
    Implement proto2/proto3 with editions (3813b66)
    Make JSON UTF-8 boundary check inclusive of the largest possible UTF-8 character. (e80b8ec)
    Reduce Map::size_type to 32-bits. Protobuf containers can't have more than (95d2b2e)
    Defines Protobuf compiler version strings as macros and separates out suffix string definition. (3c59585)
    Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated oneof accessors. (e33e0d2)
    Fix bug in reflection based Swap of map fields. (bef5b75)
    Add utf8_validation feature back to the global feature set. (153028d)
    Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (4322e00)
    Add prefetching to arena allocations. (fbdeb5a)
    Merge the protobuf and upb Bazel repos (7286ffc)
    Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated repeated and map field accessors. (9a0a3cf)
    Editions: Migrate edition strings to enum in C++ code. (f083ebf)
    Workaround ICE on gcc 7.5 by not having one overload call the other one with a (0522054)
    Create a reflection helper for ExtensionIdentifier. (4d5ab73)
    Editions: Provide an API for C++ generators to specify their features. (e897bcf)
    Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated string field accessors. (18c338a)
    Editions: Refactor feature resolution to use an intermediate message. (57d8049)
    Fixes for 32-bit MSVC. (66cf6b1)
    Publish extension declarations with declaration verifications. (e72b0e1)
    Export the constants in protobuf's any.h to support DLL builds. (fd24b1b)
    Implement AbslStringify for the Descriptor family of types. (230232a)
    Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated message field accessors. (064035c)
    Editions: Stop propagating partially resolved feature sets to plugins. (b66ef4c)
    Editions: Migrate string_field_validation to a C++ feature (1f95830)
    Editions: Include defaults for any features in the generated pool. (15863ff)
    Introduce C++ feature for UTF8 validation. (c7119e6)
    Protoc: validate that reserved range start is before end (#13474) (3be00f7)
    Remove option to disable the table-driven parser in protoc. (6d03f9b)
    Lock down ctype=CORD in proto file. (b359e50)
    Support split repeated fields. (5b5e5bf)
    In OSS mode omit some extern template specializations. We have seen reports of (ab96824)
    Automated rollback of commit adb2c4b. (0ea0052)
    Allow code generators to specify whether or not they support editions. (2176a14)
    Handle conflicting macros for FreeBSD (#13303) (2a95295)

Python

    Fixed Python memory leak in map lookup. (1711ebd)
    Loosen upb for json name conflict check in proto2 between json name and field (41af1d5)
    Defines Protobuf compiler version strings as macros and separates out suffix string definition. (3c59585)
    Add ABSL_ATTRIBUTE_LIFETIME_BOUND attribute on generated oneof accessors. (e33e0d2)
    Ensure Timestamp.ToDatetime(tz) has correct offset (f0c56f9)
    Do not check required field for upb python MergeFrom (1e0bc56)
    Setting up version updater to prepare for poison pills and embedding version info into C++, Python and Java gencode. (4322e00)
    Merge the protobuf and upb Bazel repos (7286ffc)
    Comparing a proto message with an object of unknown returns NotImplemented (12d4f41)
    Emit slots in pyi output as a tuple rather than a list for --pyi_out. (4a4f615)
    Fix a bug that strips options from descriptor.proto in Python. (27d42c5)
    Raise warings for message.UnknownFields() usages and navigate to the new add (c988759)
    Add protobuf python keyword support in path for stub generator. Also added tests for (4cc258a)
    Add tuple support to set Struct (533fbbb)

Python C-Extension (Default)

    Comparing a proto message with an object of unknown returns NotImplemented (protocolbuffers/upb@243add4)
    See also UPB changes below, which may affect Python C-Extension (Default).

Revision 1.21 / (download) - annotate - [select for diffs], Thu Nov 2 21:42:59 2023 UTC (4 weeks, 1 day ago) by wiz
Branch: MAIN
Changes since 1.20: +2 -2 lines
Diff to previous 1.20 (colored)

py-protobuf: fix PLIST

Revision 1.20 / (download) - annotate - [select for diffs], Thu Nov 2 12:17:25 2023 UTC (4 weeks, 1 day ago) by wiz
Branch: MAIN
Changes since 1.19: +17 -15 lines
Diff to previous 1.19 (colored)

{,py-}protobuf: update to 24.4

Based on wip package by bsiegert.

Ten months of heavy development.

Revision 1.19 / (download) - annotate - [select for diffs], Sun Dec 4 17:38:45 2022 UTC (11 months, 3 weeks ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2023Q3-base, pkgsrc-2023Q3, pkgsrc-2023Q2-base, pkgsrc-2023Q2, pkgsrc-2023Q1-base, pkgsrc-2023Q1, pkgsrc-2022Q4-base, pkgsrc-2022Q4
Changes since 1.18: +9 -9 lines
Diff to previous 1.18 (colored)

protobuf py-protobuf: updated to [34].21.10

Protocol Buffers v21.10

Java

Use bit-field int values in buildPartial to skip work on unset groups of fields.
Mark nested builder as clean after clear is called

UPB

Fix UPB_LIKELY() for 32-bit Windows builds; update protobuf_deps to point to the current upb 21.x

Other

Add public modifiers to kotlin code

Revision 1.18 / (download) - annotate - [select for diffs], Mon Jul 18 14:19:52 2022 UTC (16 months, 2 weeks ago) by wiz
Branch: MAIN
CVS Tags: pkgsrc-2022Q3-base, pkgsrc-2022Q3
Changes since 1.17: +10 -7 lines
Diff to previous 1.17 (colored)

{py-,}protobuf: update to {3,4}.21.2

2022-05-27 version 21.1 (C++/Java/Python/PHP/Objective-C/C#/Ruby)

  C++
  * cmake: Revert "Fix cmake install targets (#9822)" (#10060)
  * Remove Abseil dependency from CMake build (#10056)

  Python
  * Update python wheel metadata with more information incl. required python version (#10058)
  * Fix segmentation fault when instantiating field via repeated field assignment (#10066)

2022-05-25 version 21.0 (C++/Java/Python/PHP/Objective-C/C#/Ruby)

  C++
  * cmake: Call get_filename_component() with DIRECTORY mode instead of PATH mode (#9614)
  * Escape GetObject macro inside protoc-generated code (#9739)
  * Update CMake configuration to add a dependency on Abseil (#9793)
  * Fix cmake install targets (#9822)
  * Use __constinit only in GCC 12.2 and up (#9936)

  Python
  * Increment python major version to 4 in version.json for python upb (#9926)
  * The C extension module for Python has been rewritten to use the upb library.
    This is expected to deliver significant performance benefits, especially when
    parsing large payloads.  There are some minor breaking changes, but these
    should not impact most users.  For more information see:
    https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates
  * Fixed win32 build and fixed str(message) on all Windows platforms. (#9976)
  * The binary wheel for macOS now supports Apple silicon.


2022-05-19 version 21.0-rc2(C++/Java/Python/PHP/Objective-C/C#/Ruby)

  Python
  * Fix windows builds
  * Throw more helpful error if generated code is out of date
  * Fixed two reference leaks

2022-05-10 version 21.0-rc1 (C++/Java/Python/PHP/Objective-C/C#/Ruby)

  C++
  * Rename main cmake/CMakeLists.txt to CMakeLists.txt (#9603)
  * avoid allocating memory if all extension are cleared (#9345)
  * cmake: Call get_filename_component() with DIRECTORY mode instead of PATH mode (#9614)
  * Escape GetObject macro inside protoc-generated code (#9739)
  * Update CMake configuration to add a dependency on Abseil (#9793)
  * Use __constinit only in GCC 12.2 and up (#9936)
  * Refactor generated message class layout
  * Optimize tokenizer ParseInteger by removing division
  * Reserve exactly the right amount of capacity in ExtensionSet::MergeFrom
  * Parse FLT_MAX correctly when represented in JSON

  Python
  * Increment python major version to 4 in version.json for python upb (#9926)
  * The C extension module for Python has been rewritten to use the upb library.
    This is expected to deliver significant performance benefits, especially when
    parsing large payloads.  There are some minor breaking changes, but these
    should not impact most users.  For more information see:
    https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates
  * Due to the breaking changes for Python, the major version number for Python
    has been incremented.
  * The binary wheel for macOS now supports Apple silicon.

  Compiler
  * Protoc outputs the list of suggested field numbers when invalid field
    numbers are specified in the .proto file.
  * Require package names to be less than 512 bytes in length

Revision 1.17 / (download) - annotate - [select for diffs], Sun Apr 3 18:19:24 2022 UTC (19 months, 4 weeks ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2022Q2-base, pkgsrc-2022Q2
Changes since 1.16: +4 -1 lines
Diff to previous 1.16 (colored)

protobuf py-protobuf: updated to 3.20.0

Protocol Buffers v3.20.0

C++

Add option to use external GTest in CMake
cmake: Set correct sonames for libprotobuf-lite.so and libprotoc.so
Java

Revert "Standardize on Array copyOf"
Resolve more java field accessor name conflicts

Python

Pin multibuild scripts to get manylinux1 wheels back
Dropped support for Python < 3.7

PHP

fix: [PHP] add missing reserved classnames

Ruby

Dropped Ruby 2.3 and 2.4 support for CI and releases.
[Ruby] Message.decode/encode: Add max_recursion_depth option
Ruby: rename max_recursion_depth to recursion_limit
Fix conversion of singleton classes in Ruby
Suppress warning for intentional circular require
[Ruby] allow encode json options to be an object that responds to to_hash

Other

[C#] Fix trim warnings
Add protoc-gen-go-svc to options.md
Fixes NullReferenceException when accessing FieldDescriptor.IsPacked
Add ToProto() method to all C# descriptor classes
Add cmake option protobuf_INSTALL to not install files
[CMake] Allow custom plugin options e.g. to generate mocks
Add an option to preserve proto names in JsonFormatter
Add test scope to kotlin-test for protobuf-kotlin-lite
Add prefix_to_proto_package_mappings_path ObjC option.
[ObjC] Rename proto_package_to_prefix_mappings_path to package_to_prefix_mappings_path.
cmake: Use linker version scripts
Add a generation option to control use of forward declarations in headers.
[C#] fix parse failure for extensions with large field numbers

Revision 1.16 / (download) - annotate - [select for diffs], Thu Sep 30 18:59:47 2021 UTC (2 years, 2 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2022Q1-base, pkgsrc-2022Q1, pkgsrc-2021Q4-base, pkgsrc-2021Q4
Changes since 1.15: +1 -2 lines
Diff to previous 1.15 (colored)

protobuf py-protobuf: updated to 3.18.0

Protocol Buffers v3.18.0

C++

Fix warnings raised by clang 11
Make StringPiece constructible from std::string_view
Add missing capability attributes for LLVM 12
Stop using std::iterator (deprecated in C++17).
Move field_access_listener from libprotobuf-lite to libprotobuf
Fix 7047 Safely handle setlocale
Remove deprecated version of SetTotalBytesLimit()
Support arena allocation of google::protobuf::AnyMetadata
Fix undefined symbol error around SharedCtor()
Fix default value of enum(int) in json_util with proto2
Better Smaller ByteSizeLong
Introduce event filters for inject_field_listener_events
Reduce memory usage of DescriptorPool
For lazy fields copy serialized form when allowed.
Re-introduce the InlinedStringField class
v2 access listener
Reduce padding in the proto's ExtensionRegistry map.
GetExtension performance optimizations
Make tracker a static variable rather than call static functions
Support extensions in field access listener
Annotate MergeFrom for field access listener
Fix incomplete types for field access listener
Add map_entry/new_map_entry to SpecificField in MessageDifferencer. They
record the map items which are different in MessageDifferencer's reporter.
Reduce binary size due to fieldless proto messages
TextFormat: ParseInfoTree supports getting field end location in addition to
start.
Fix repeated enum extension size in field listener
Enable Any Text Expansion for Descriptors::DebugString()
Switch from int{8,16,32,64} to int{8,16,32,64}_t

Python

Drops support for 2.7 and 3.5.

Revision 1.15 / (download) - annotate - [select for diffs], Sat Nov 14 14:08:16 2020 UTC (3 years ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2021Q3-base, pkgsrc-2021Q3, pkgsrc-2021Q2-base, pkgsrc-2021Q2, pkgsrc-2021Q1-base, pkgsrc-2021Q1, pkgsrc-2020Q4-base, pkgsrc-2020Q4
Changes since 1.14: +1 -25 lines
Diff to previous 1.14 (colored)

py-protobuf: updated to 3.14.0

Protocol Buffers v3.14.0

Python

Print google.protobuf.NullValue as null instead of "NULL_VALUE" when it is
used outside WKT Value/Struct.
Fix bug occurring when attempting to deep copy an enum type in python 3.
Add a setuptools extension for generating Python protobufs
Remove uses of pkg_resources in non-namespace packages.
[bazel/py] Omit google/init.py from the Protobuf runtime.
Removed the unnecessary setuptools package dependency for Python package
Fix PyUnknownFields memory leak

Revision 1.14 / (download) - annotate - [select for diffs], Thu Jul 30 07:02:40 2020 UTC (3 years, 4 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2020Q3-base, pkgsrc-2020Q3
Changes since 1.13: +1 -142 lines
Diff to previous 1.13 (colored)

protobuf py-protobuf: updated to 3.12.4

3.12.4:
Unknown changes

3.12.3:
Objective-C
* Tweak the union used for Extensions to support old generated code.

Revision 1.13 / (download) - annotate - [select for diffs], Thu May 21 16:31:15 2020 UTC (3 years, 6 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2020Q2-base, pkgsrc-2020Q2
Changes since 1.12: +142 -1 lines
Diff to previous 1.12 (colored)

py-protobuf: updated to 3.12.1

Protocol Buffers v3.12.0

Python
[experimental] Added proto3 presence support.
[experimental] fast import protobuf module, only works with cpp generated code linked in.
Truncate 'float' fields to 4 bytes of precision in setters for pure-Python
implementation (C++ extension was already doing this).
Fixed a memory leak in C++ bindings.
Added a deprecation warning when code tries to create Descriptor objects
directly.
Fix unintended comparison between bytes and string in descriptor.py.
Avoid printing excess digits for float fields in TextFormat.
Remove Python 2.5 syntax compatibility from the proto compiler generated _pb2.py module code.
Drop 3.3, 3.4 and use single version docker images for all python tests

Revision 1.12 / (download) - annotate - [select for diffs], Fri Jul 12 19:57:37 2019 UTC (4 years, 4 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2020Q1-base, pkgsrc-2020Q1, pkgsrc-2019Q4-base, pkgsrc-2019Q4, pkgsrc-2019Q3-base, pkgsrc-2019Q3
Changes since 1.11: +4 -1 lines
Diff to previous 1.11 (colored)

py-protobuf: updated to 3.9.0

Protocol Buffers v3.9.0

Python

Change implementation of Name() for enums that allow aliases in proto2 in Python
to be in line with claims in C++ implementation (to return first value).
Explicitly say what field cannot be set when the new value fails a type check.
Duplicate register in descriptor pool will raise errors
Add slots to all well_known_types classes, custom attributes are not allowed anymore.
text_format only present 8 valid digits for float fields by default

Revision 1.11 / (download) - annotate - [select for diffs], Wed May 29 14:49:01 2019 UTC (4 years, 6 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2019Q2-base, pkgsrc-2019Q2
Changes since 1.10: +4 -1 lines
Diff to previous 1.10 (colored)

py-protobuf: updated to 3.8.0

Protocol Buffers v3.8.0
Python
Changes implementation of Name() for enums that allow aliases in proto2 in Python to be in line with claims in C++ implementation (to return first value).
Added double_format option in text format printer.
Added iter and contains to extension dict
Added allow_unknown_field option in python text format parser
Fixed Timestamp.ToDatetime() loses precision issue
Support unknown field in text format printer.
Float field will be convert to inf if bigger than struct.unpack('f', b'\xff\xff\x7f\x7f')[0] which is about 3.4028234664e+38,
convert to -inf if smaller than -3.4028234664e+38
Allowed casting str->bytes in Message.setstate

Revision 1.10 / (download) - annotate - [select for diffs], Thu Mar 21 21:29:08 2019 UTC (4 years, 8 months ago) by adam
Branch: MAIN
CVS Tags: pkgsrc-2019Q1-base, pkgsrc-2019Q1
Changes since 1.9: +1 -136 lines
Diff to previous 1.9 (colored)

py-protobuf: updated to 3.7.0

version 3.7.0:
Python
* Added Python 3.7 compatibility.
* Modified ParseFromString to return bytes parsed .
* Introduce Proto C API.
* FindFileContainingSymbol in descriptor pool is now able to find field and enum values.
* reflection.MakeClass()  and  reflection.ParseMessage() are deprecated.
* Added DescriptorPool.FindMethodByName() method in pure python (c extension alreay has it)
* Flipped proto3 to preserve unknown fields by default.
* Added support for memoryview in python3 proto message parsing.
* Added MergeFrom for repeated scalar fields in c extension (pure python already has it)
* Surrogates are now rejected at setters in python3.
* Added public unknown field API.
* RecursionLimit is also set to max if allow_oversize_protos is enabled.
* Disallow duplicate scalars in proto3 text_format parse.
* Fix some segment faults for c extension map field.

Revision 1.9 / (download) - annotate - [select for diffs], Sun Jan 6 11:21:06 2019 UTC (4 years, 10 months ago) by markd
Branch: MAIN
Changes since 1.8: +3 -1 lines
Diff to previous 1.8 (colored)

{py-,}protobuf: update to 3.6.1

minor changes.
patches for python3.7
build py-protobuf with "--cpp_implementation" to get _message extension

Revision 1.8 / (download) - annotate - [select for diffs], Sat Aug 4 21:32:53 2018 UTC (5 years, 3 months ago) by minskim
Branch: MAIN
CVS Tags: pkgsrc-2018Q4-base, pkgsrc-2018Q4, pkgsrc-2018Q3-base, pkgsrc-2018Q3
Changes since 1.7: +4 -1 lines
Diff to previous 1.7 (colored)

devel/py-protobuf: Sync with devel/protobuf

Revision 1.7 / (download) - annotate - [select for diffs], Mon Jan 1 22:29:25 2018 UTC (5 years, 11 months ago) by rillig
Branch: MAIN
CVS Tags: pkgsrc-2018Q2-base, pkgsrc-2018Q2, pkgsrc-2018Q1-base, pkgsrc-2018Q1
Changes since 1.6: +1 -2 lines
Diff to previous 1.6 (colored)

Sort PLIST files.

Unsorted entries in PLIST files have generated a pkglint warning for at
least 12 years. Somewhat more recently, pkglint has learned to sort
PLIST files automatically. Since pkglint 5.4.23, the sorting is only
done in obvious, simple cases. These have been applied by running:

  pkglint -Cnone,PLIST -Wnone,plist-sort -r -F

Revision 1.6 / (download) - annotate - [select for diffs], Fri Nov 17 22:09:11 2017 UTC (6 years ago) by he
Branch: MAIN
CVS Tags: pkgsrc-2017Q4-base, pkgsrc-2017Q4
Changes since 1.5: +12 -8 lines
Diff to previous 1.5 (colored)

Upgrade protobuf to version 3.5.0.

Pkgsrc changes:
 * Adapt PLIST.
 * After exchange, set MAINTAINER to pkgsrc-users@

Upstream changes:

2017-11-13 version 3.5.0 (C++/Java/Python/PHP/Objective-C/C#/Ruby/JavaScript)
  Planned Future Changes
  * Make C++ implementation C++11 only: we plan to require C++11 to build
    protobuf code starting from 3.6.0 release. Please join this github issue:
    https://github.com/google/protobuf/issues/2780 to provide your feedback.

  General
  * Unknown fields are now preserved in proto3 for most of the language
    implementations for proto3 by default. See the per-language section for
    details.
  * reserve keyword are now supported in enums

  C++
  * Proto3 messages are now preserving unknown fields by default. If you rely on
    unknowns fields being dropped. Please use DiscardUnknownFields() explicitly.
  * Deprecated the unsafe_arena_release_* and unsafe_arena_add_allocated_*
    methods for string fields.
  * Added move constructor and move assignment to RepeatedField,
    RepeatedPtrField and google::protobuf::Any.
  * Added perfect forwarding in Arena::CreateMessage
  * In-progress experimental support for implicit weak fields with lite protos.
    This feature allows the linker to strip out more unused messages and reduce
    binary size.
  * Various performance optimizations.

  Java
  * Proto3 messages are now preserving unknown fields by default. If you'd like
    to drop unknown fields, please use the DiscardUnknownFieldsParser API. For
    example:
      Parser<Foo> parser = DiscardUnknownFieldsParser.wrap(Foo.parser());
      Foo foo = parser.parseFrom(input);
  * Added a new CodedInputStream decoder for Iterable<ByteBuffer> with direct
    ByteBuffers.
  * TextFormat now prints unknown length-delimited fields as messages if
    possible.
  * FieldMaskUtil.merge() no longer creates unnecessary empty messages when a
    message field is unset in both source message and destination message.
  * Various performance optimizations.

  Python
  * Proto3 messages are now preserving unknown fields by default. Use
    message.DiscardUnknownFields() to drop unknown fields.
  * Add FieldDescriptor.file in generated code.
  * Add descriptor pool FindOneofByName in pure python.
  * Change unknown enum values into unknown field set .
  * Add more Python dict/list compatibility for Struct/ListValue.
  * Add utf-8 support for text_format.Merge()/Parse().
  * Support numeric unknown enum values for proto3 JSON format.
  * Add warning for Unexpected end-group tag in cpp extension.

  PHP
  * Proto3 messages are now preserving unknown fields.
  * Provide well known type messages in runtime.
  * Add prefix "PB" to generated class of reserved names.
  * Fixed all conformance tests for encode/decode json in php runtime. C
    extension needs more work.

  Objective-C
  * Fixed some issues around copying of messages with unknown fields and then
    mutating the unknown fields in the copy.

  C#
  * Added unknown field support in JsonParser.
  * Fixed oneof message field merge.
  * Simplify parsing messages from array slices.

  Ruby
  * Unknown fields are now preserved by default.
  * Fixed several bugs for segment fault.

  Javascript
  * Decoder can handle both paced and unpacked data no matter how the proto is
    defined.
  * Decoder now accept long varint for 32 bit integers.

Revision 1.5 / (download) - annotate - [select for diffs], Fri Oct 20 23:02:25 2017 UTC (6 years, 1 month ago) by minskim
Branch: MAIN
Changes since 1.4: +7 -1 lines
Diff to previous 1.4 (colored)

devel/{py-,}protobuf: Update to 3.4.1

Notable changes:

* C++
  - Proto3 messages are now able to preserve unknown fields.
  - Packable proto3 fields are now packed by default in serialization.

* Python
  - SerializeToString API is changed to SerializeToString(self, **kwargs).
  - Added sort_keys parameter in json format to make the output
    deterministic.

Revision 1.4 / (download) - annotate - [select for diffs], Wed Oct 19 12:16:34 2016 UTC (7 years, 1 month ago) by wiz
Branch: MAIN
CVS Tags: pkgsrc-2017Q3-base, pkgsrc-2017Q3, pkgsrc-2017Q2-base, pkgsrc-2017Q2, pkgsrc-2017Q1-base, pkgsrc-2017Q1, pkgsrc-2016Q4-base, pkgsrc-2016Q4
Changes since 1.3: +3 -0 lines
Diff to previous 1.3 (colored)

Updated py-protobuf to 3.1.0.

2016-09-23 version 3.1.0 (C++/Java/Python/PHP/Ruby/Objective-C/C#/JavaScript/Lite)
  Python
  * JSON support
    * Fixed some conformance issues.

Revision 1.3 / (download) - annotate - [select for diffs], Sat Aug 6 11:45:24 2016 UTC (7 years, 3 months ago) by kamil
Branch: MAIN
CVS Tags: pkgsrc-2016Q3-base, pkgsrc-2016Q3
Changes since 1.2: +189 -3 lines
Diff to previous 1.2 (colored)

Upgrade py-protobuf from 2.6.1 to 3.0.0

This version is backward compatible with proto2.

Upstream changelog:

Version 3.0.0

This change log summarizes all the changes since the last stable release
(v2.6.1). See the last section about changes since v3.0.0-beta-4.
Proto3

Introduced Protocol Buffers language version 3 (aka proto3).

When protocol buffers was initially open sourced it implemented Protocol
Buffers language version 2 (aka proto2), which is why the version number
started from v2.0.0. From v3.0.0, a new language version (proto3) is
introduced while the old version (proto2) will continue to be supported.

The main intent of introducing proto3 is to clean up protobuf before pushing
the language as the foundation of Google's new API platform. In proto3, the
language is simplified, both for ease of use and to make it available in a
wider range of programming languages. At the same time a few features are
added to better support common idioms found in APIs.

The following are the main new features in language version 3:
Removal of field presence logic for primitive value fields, removal of required fields, and removal of default values. This makes proto3 significantly easier to implement with open struct representations, as in languages like Android Java, Objective C, or Go.
Removal of unknown fields.
Removal of extensions, which are instead replaced by a new standard type called Any.
Fix semantics for unknown enum values.
Addition of maps (back-ported to proto2)
Addition of a small set of standard types for representation of time, dynamic data, etc (back-ported to proto2)
A well-defined encoding in JSON as an alternative to binary proto encoding.

A new notion "syntax" is introduced to specify whether a .proto file
uses proto2 or proto3:

// foo.proto
syntax = "proto3";
message Bar {...}

If omitted, the protocol buffer compiler generates a warning and "proto2" is
used as the default. This warning will be turned into an error in a future
release.

We recommend that new Protocol Buffers users use proto3. However, we do not
generally recommend that existing users migrate from proto2 from proto3 due
to API incompatibility, and we will continue to support proto2 for a long
time.

Other significant changes in proto3.
Explicit "optional" keyword are disallowed in proto3 syntax, as fields are optional by default; required fields are no longer supported.
Removed non-zero default values and field presence logic for non-message fields. e.g. has_xxx() methods are removed; primitive fields set to default values (0 for numeric fields, empty for string/bytes fields) will be skipped during serialization.
Group fields are no longer supported in proto3 syntax.
Changed repeated primitive fields to use packed serialization by default in proto3 (implemented for C++, Java, Python in this release). The user can still disable packed serialization by setting packed to false for now.
Added well-known type protos (any.proto, empty.proto, timestamp.proto, duration.proto, etc.). Users can import and use these protos just like regular proto files. Additional runtime support are available for each language.

Proto3 JSON is supported in several languages (fully supported in C++, Java,
Python and C# partially supported in Ruby). The JSON spec is defined in the
proto3 language guide:

https://developers.google.com/protocol-buffers/docs/proto3#json

We will publish a more detailed spec to define the exact behavior of
proto3-conformant JSON serializers and parsers. Until then, do not rely
on specific behaviors of the implementation if s not documented in
the above spec.
Proto3 enforces strict UTF-8 checking. Parsing will fail if a string field contains non UTF-8 data.

General

Introduced new language implementations (C#, JavaScript, Ruby, Objective-C) to proto3.

Added support for map fields (implemented in both proto2 and proto3).
Map fields can be declared using the following syntax:

message Foo {
map<string, string> values = 1;
}

The data of a map field is stored in memory as an unordered map and
can be accessed through generated accessors.

Added a "reserved" keyword in both proto2 and proto3 syntax. Users can use
this keyword to declare reserved field numbers and names to prevent them
from being reused by other fields in the same message.

To reserve field numbers, add a reserved declaration in your message:

message TestMessage {
reserved 2, 15, 9 to 11, 3;
}

This reserves field numbers 2, 3, 9, 10, 11 and 15. If a user uses any of
these as field numbers, the protocol buffer compiler will report an error.

Field names can also be reserved:

message TestMessage {
reserved "foo", "bar";
}

Added a deterministic serialization API (currently available in C++). The deterministic serialization guarantees that given a binary, equal messages will be serialized to the same bytes. This allows applications like MapReduce to group equal messages based on the serialized bytes. The deterministic serialization is, however, NOT canonical across languages; it is also unstable across different builds with schema changes due to unknown fields. Users who need canonical serialization, e.g. persistent storage in a canonical form, fingerprinting, etc, should define their own canonicalization specification and implement the serializer using reflection APIs rather than relying on this API.
Added a new field option "json_name". By default proto field names are converted to "lowerCamelCase" in proto3 JSON format. This option can be used to override this behavior and specify a different JSON name for the field.
Added conformance tests to ensure implementations are following proto3 JSON specification.

C++

Added arena allocation support (for both proto2 and proto3).

Profiling shows memory allocation and deallocation constitutes a significant
fraction of CPU-time spent in protobuf code and arena allocation is a
technique introduced to reduce this cost. With arena allocation, new
objects are allocated from a large piece of preallocated memory and
deallocation of these objects is almost free. Early adoption shows 20% to
50% improvement in some Google binaries.

To enable arena support, add the following option to your .proto file:

option cc_enable_arenas = true;

The protocol buffer compiler will generate additional code to make the generated
message classes work with arenas. This does not change the existing API
of protobuf messages and does not affect wire format. Your existing code
should continue to work after adding this option. In the future we will
make this option enabled by default.

To actually take advantage of arena allocation, you need to use the arena
APIs when creating messages. A quick example of using the arena API:

{
google::protobuf::Arena arena;
// Allocate a protobuf message in the arena.
MyMessage* message = Arena::CreateMessage<MyMessage>(&arena);
// All submessages will be allocated in the same arena.
if (!message->ParseFromString(data)) {
// Deal with malformed input data.
}
// Must not delete the message here. It will be deleted automatically
// when the arena is destroyed.
}

Currently arena allocation does not work with map fields. Enabling arenas in a .proto
file containing map fields will result in compile errors in the generated
code. This will be addressed in a future release.

Added runtime support for the Any type. To use Any in your proto file, first
import the definition of Any:

// foo.proto
import "google/protobuf/any.proto";
message Foo {
google.protobuf.Any any_field = 1;
}
message Bar {
int32 value = 1;
}

Then in C++ you can access the Any field using PackFrom()/UnpackTo()
methods:

Foo foo;
Bar bar = ...;
foo.mutable_any_field()->PackFrom(bar);
...
if (foo.any_field().IsType<Bar>()) {
foo.any_field().UnpackTo(&bar);
...
}

In text format, the entries of a map field will be sorted by key.

Introduced new utility functions/classes in the google/protobuf/util
directory:
MessageDifferencer: compare two proto messages and report their differences.
JsonUtil: support converting protobuf binary format to/from JSON.
TimeUtil: utility functions to work with well-known types Timestamp and Duration.
FieldMaskUtil: utility functions to work with FieldMask.

Introduced a deterministic serialization API in
CodedOutputStream::SetSerializationDeterministic(bool). See the notes about
deterministic serialization in the General section.

Java

Introduced a new util package that will be distributed as a separate
artifact in maven. It contains:
JsonFormat: convert proto messages to/from JSON.
Timestamps/Durations: utility functions to work with Timestamp and Duration.
FieldMaskUtil: utility functions to work with FieldMask.

Other related changes to CodedOutputStream
Additional use of sun.misc.Unsafe where possible to perform fast access to byte[] and ByteBuffer values and avoiding unnecessary range checking.
ByteBuffer-backed CodedOutputStream now writes directly to the ByteBuffer rather than to an intermediate array.

Performance optimizations for String fields serialization.
The static PARSER in each generated message is deprecated, and it will be removed in a future release. A static parser() getter is generated for each message type instead.
File option "java_generate_equals_and_hash" is now deprecated. equals() and hashCode() methods are generated by default.

Python

Python has received several updates, most notably support for proto3
semantics in any .proto file that declares syntax="proto3".
Messages declared in proto3 files no longer represent field presence
for scalar fields (number, enums, booleans, or strings). You can
no longer call HasField() for such fields, and they are serialized
based on whether they have a non-zero/empty/false value.

One other notable change is in the C++-accelerated implementation.
Descriptor objects (which describe the protobuf schema and allow
reflection over it) are no longer duplicated between the Python
and C++ layers. The Python descriptors are now simple wrappers
around the C++ descriptors. This change should significantly
reduce the memory usage of programs that use a lot of message
types.

Added map support.
maps now have a dict-like interface (msg.map_field[key] = value)
existing code that modifies maps via the repeated field interface will need to be updated.

Added proto3 JSON format utility. It includes support for all field types and a few well-known types.
Added runtime support for Any, Timestamp, Duration and FieldMask.
"[ ]" is now accepted for repeated scalar fields in text format parser.
Removed legacy Python 2.5 support.
Moved to a single Python 2.x/3.x-compatible codebase

Ruby

We have added proto3 support for Ruby via a native C/JRuby extension.

For the moment we only support proto3. Proto2 support is planned, but not
yet implemented. Proto3 JSON is supported, but the special JSON mappings
for the well-known types are not yet implemented.

The Ruby extension itself is included in the ruby/ directory, and details on
building and installing the extension are in ruby/README.md. The extension
is also be published as a Ruby gem. Code generator support is included as
part of protoc with the --ruby_out flag.

The Ruby extension implements a user-friendly DSL to define message types
(also generated by the code generator from .proto files). Once a message
type is defined, the user may create instances of the message that behave in
ways idiomatic to Ruby. For example:
Message fields are present as ordinary Ruby properties (getter method foo and setter method foo=).
Repeated field elements are stored in a container that acts like a native Ruby array, and map elements are stored in a container that acts like a native Ruby hashmap.
The usual well-known methods, such as #to_s, #dup, and the like, are present.

Unlike several existing third-party Ruby extensions for protobuf, this
extension is built on a "strongly-typed" philosophy: message fields and
array/map containers will throw exceptions eagerly when values of the
incorrect type are inserted.

See ruby/README.md for details.

Objective-C

Objective-C includes a code generator and a native objective-c runtime
library. By --objc_ to protoc, the code generator will generate
a header(.pbobjc.h) and an implementation file(.pbobjc.m) for each proto
file.

In this first release, the generated interface provides: enums, messages,
field support(single, repeated, map, oneof), proto2 and proto3 syntax
support, parsing and serialization. s compatible with ARC and non-ARC
usage. In addition, users can access it via the swift bridging header.

C# support is derived from the project at https://github.com/jskeet/protobuf-csharp-port, which is now in maintenance mode.
The primary differences between the previous project and the proto3 version are that message types are now mutable, and the codegen is integrated in protoc
There are two NuGet packages: Google.Protobuf (the support library) and Google.Protobuf.Tools (containing protoc)
Target platforms now .NET 4.5, selected portable subsets and .NET Core.
Null values are used to represent "no value" for message type fields, and for wrapper types such as Int32Value which map to C# nullable value types.
Proto3 semantics supported; proto2 files are prohibited for C# codegen.
Enum values are PascalCased, and if there's a prefix which matches the name of the enum, that is removed (so an enum COLOR with a value COLOR_LIGHT_GRAY would generate a value of just LightGray).

JavaScript

Added proto2/proto3 support for JavaScript. The runtime is written in pure JavaScript and works in browsers and in Node.js. To generate JavaScript code for your proto, invoke protoc with "--js_out". See js/README.md for more build instructions.
JavaScript has support for binary protobuf format, but not proto3 JSON. There is also no support for reflection, since the code size impacts from this are often not the right choice for the browser.
There is support for both CommonJS imports and Closure goog.require().

Lite

Supported Proto3 lite-runtime in Java for mobile platforms.
A new "lite" generator parameter was introduced in the protoc for C++ for
Proto3 syntax messages. Example usage:

./protoc --cpp_out=lite:$OUTPUT_PATH foo.proto

The protoc will treat the current input and all the transitive dependencies
as LITE. The same generator parameter must be used to generate the
dependencies.

In Proto3 syntax files, "optimized_for=LITE_RUNTIME" is no longer supported.

For Java, --javalite_out code generator is supported as a separate compiler
plugin in a separate branch.

Performance optimizations for Java Lite runtime on Android:
- Reduced allocations
- Reduced method overhead after ProGuarding
- Reduced code size after ProGuarding
Java Lite protos now implement deep equals/hashCode/toString

Compatibility Notice

v3.0.0 is the first API stable release of the v3.x series. We do not expect any future API breaking changes.
For C++, Java Lite and Objective-C, source level compatibility is guaranteed. Upgrading from v3.0.0 to newer minor version releases will be source compatible. For example, if your code compiles against protobuf v3.0.0, it will continue to compile after you upgrade protobuf library to v3.1.0.
For other languages, both source level compatibility and binary level compatibility are guaranteed. For example, if you have a Java binary built against protobuf v3.0.0. After switching the protobuf runtime binary to v3.1.0, your built binary should continue to work.
Compatibility is only guaranteed for documented API and documented behaviors. If you are using undocumented API (e.g., use anything in the C++ internal namespace), it can be broken by minor version releases in an undetermined manner.

Changes since v3.0.0-beta-4
Ruby

When you assign a string field a.string_, we now call #encode(UTF-8) on the string and freeze the copy. This saves you from needing to ensure the string is already encoded as UTF-8. It also prevents you from mutating the string after it has been assigned (this is how we ensure it stays valid UTF-8).
The generated file for foo.proto is now foo_pb.rb instead of just foo.rb. This makes it easier to see which imports/requires are from protobuf generated code, and also prevents conflicts with any foo.rb file you might have written directly in Ruby. It is a backward-incompatible change: you will need to update all of your require statements.
For package names like foo_bar, we now translate this to the Ruby module FooBar. This is more idiomatic Ruby than what we used to do (Foo_bar).

JavaScript

Scalar fields like numbers and boolean now return defaults instead of undefined or null when they are unset. You can test for presence explicitly by calling hasFoo(), which we now generate for scalar fields in proto2.

Java Lite

Java Lite is now implemented as a separate plugin, maintained in the javalite branch. Both lite runtime and protoc artifacts will be available in Maven.

Target platforms now .NET 4.5, selected portable subsets and .NET Core.
legacy_enum_values option is no longer supported.

Version 3.0.0-beta-4
General

Added a deterministic serialization API for C++. The deterministic serialization guarantees that given a binary, equal messages will be serialized to the same bytes. This allows applications like MapReduce to group equal messages based on the serialized bytes. The deterministic serialization is, however, NOT canonical across languages; it is also unstable across different builds with schema changes due to unknown fields. Users who need canonical serialization, e.g. persistent storage in a canonical form, fingerprinting, etc, should define their own canonicalization specification and implement the serializer using reflection APIs rather than relying on this API.

Added OneofOptions. You can now define custom options for oneof groups.

import "google/protobuf/descriptor.proto";
extend google.protobuf.OneofOptions {
optional int32 my_oneof_extension = 12345;
}
message Foo {
oneof oneof_group {
(my_oneof_extension) = 54321;
...
}
}

C++ (beta)

Introduced a deterministic serialization API in CodedOutputStream::SetSerializationDeterministic(bool). See the notes about deterministic serialization in the General section.
Added google::protobuf::Map::swap() to swap two map fields.
Fixed a memory leak when calling Reflection::ReleaseMessage() on a message allocated on arena.
Improved error reporting when parsing text format protos.
JSON
Added a new parser option to ignore unknown fields when parsing JSON.
Added convenient methods for message to/from JSON conversion.
Various performance optimizations.

Java (beta)

File option "java_generate_equals_and_hash" is now deprecated. equals() and hashCode() methods are generated by default.
Added a new JSON printer option "omittingInsignificantWhitespace" to produce a more compact JSON output. The printer will pretty-print by default.
Updated Java runtime to be compatible with 2.5.0/2.6.1 generated protos.

Python (beta)

Added support to pretty print Any messages in text format.
Added a flag to ignore unknown fields when parsing JSON.
Bugfix: "@type" field of a JSON Any message is now correctly put before other fields.

Objective-C (beta)

Updated the code to support compiling with more compiler warnings enabled. (Issue 1616)
Exposing more detailed errors for parsing failures. (PR 1623)
Small (breaking) change to the naming of some methods on the support classes for map<>. There were collisions with the system provided KVO support, so the names were changed to avoid those issues. (PR 1699)
Fixed for proper Swift bridging of error handling during parsing. (PR 1712)
Complete support for generating sources that will go into a Framework and depend on generated sources from other Frameworks. (Issue 1457)

C# (beta)

RepeatedField optimizations.
Support for .NET Core.
Minor bug fixes.
Ability to format a single value in JsonFormatter (advanced usage only).
Modifications to attributes applied to generated code.

Javascript (alpha)

Maps now have a real map API instead of being treated as repeated fields.
Well-known types are now provided in the google-protobuf package, and the code generator knows to require() them from that package.
Bugfix: non-canonical varints are correctly decoded.

Ruby (alpha)

Accessors for oneof fields now return default values instead of nil.

Java Lite

Java lite support is removed from protocol compiler. It will be supported as a protocol compiler plugin in a separate code branch.

Protocol Buffers v3.0.0-beta-3.1

@TeBoring TeBoring released this on 14 Jun

Fix iOS framework.

Version 3.0.0-beta-3
General

Supported Proto3 lite-runtime in C++/Java for mobile platforms.
Any type now supports APIs to specify prefixes other than type.googleapis.com
Removed javanano_use_deprecated_package option; Nano will always has its own ".nano" package.

C++ (Beta)

Improved hash maps.
Improved hash maps comments. In particular, please note that equal hash maps will not necessarily have the same iteration order and serialization.
Added a new hash maps implementation that will become the default in a later release.
Arenas
Several inlined methods in Arena were moved to out-of-line to improve build performance and code size.
Added SpaceAllocatedAndUsed() to report both space used and allocated
Added convenient class UnsafeArenaAllocatedRepeatedPtrFieldBackInserter
Any
Allow custom type URL prefixes in Any packing.
TextFormat now expand the Any type rather than printing bytes.
Performance optimizations and various bug fixes.

Java (Beta)

Introduced an ExperimentalApi annotation. Annotated APIs are experimental and are subject to change in a backward incompatible way in future releases.
Introduced zero-copy serialization as an ExperimentalApi
Introduction of the ByteOutput interface. This is similar to OutputStream but provides semantics for lazy writing (i.e. no immediate copy required) of fields that are considered to be immutable.
ByteString now supports writing to a ByteOutput, which will directly expose the internals of the ByteString (i.e. byte[] or ByteBuffer) to the ByteOutput without copying.
CodedOutputStream now supports writing to a ByteOutput. ByteString instances that are too large to fit in the internal buffer will be (lazily) written to the ByteOutput directly.
This allows applications using large ByteString fields to avoid duplication of these fields entirely. Such an application can supply a ByteOutput that chains together the chunks received from CodedOutputStream before forwarding them onto the IO system.
Other related changes to CodedOutputStream
Additional use of sun.misc.Unsafe where possible to perform fast access to byte[] and ByteBuffer values and avoiding unnecessary range checking.
ByteBuffer-backed CodedOutputStream now writes directly to the ByteBuffer rather than to an intermediate array.
Improved lite-runtime.
Lite protos now implement deep equals/hashCode/toString
Significantly improved the performance of Builder#mergeFrom() and Builder#mergeDelimitedFrom()
Various bug fixes and small feature enhancement.
Fixed stack overflow when in hashCode() for infinite recursive oneofs.
Fixed the lazy field parsing in lite to merge rather than overwrite.
TextFormat now supports reporting line/column numbers on errors.
Updated to add appropriate @Override for better compiler errors.

Python (Beta)

Added JSON format for Any, Struct, Value and ListValue
"[ ]" is now accepted for both repeated scalar fields and repeated message fields in text format parser.
Numerical field name is now supported in text format.
Added DiscardUnknownFields API for python protobuf message.

Objective-C (Beta)

Proto comments now come over as HeaderDoc comments in the generated sources so Xcode can pick them up and display them.
The library headers have been updated to use HeaderDoc comments so Xcode can pick them up and display them.
The per message and per field overhead in both generated code and runtime object sizes was reduced.
Generated code now include deprecated annotations when the proto file included them.

C# (Beta)

In general: some changes are breaking, which require regenerating messages.
Most user-written code will not be impacted except for the renaming of enum
values.

Allow custom type URL prefixes in Any packing, and ignore them when unpacking
protoc is now in a separate NuGet package (Google.Protobuf.Tools)
New option: internal_access to generate internal classes
Enum values are now PascalCased, and if there's a prefix which matches the name of the enum, that is removed (so an enum COLOR with a value COLOR_BLUE would generate a value of just Blue). An option (legacy_enum_values) is temporarily available to disable this, but the option will be removed for GA.
json_name option is now honored
If group tags are encountered when parsing, they are validated more thoroughly (although we don't support actual groups)
NuGet dependencies are better specified
Breaking: Preconditions is renamed to ProtoPreconditions
Breaking: GeneratedCodeInfo is renamed to GeneratedClrTypeInfo
JsonFormatter now allows writing to a TextWriter
New interface, ICustomDiagnosticMessage to allow more compact representations from ToString
CodedInputStream and CodedOutputStream now implement IDisposable, which simply disposes of the streams they were constructed with
Map fields no longer support null values (in line with other languages)
Improvements in JSON formatting and parsing

Javascript (Alpha)

Better support for "bytes" fields: bytes fields can be read as either a base64 string or UInt8Array (in environments where TypedArray is supported).
New support for CommonJS imports. This should make it easier to use the JavaScript support in Node.js and tools like WebPack. See js/README.md for more information.
Some significant internal refactoring to simplify and modularize the code.

Ruby (Alpha)

JSON serialization now properly uses camelCased names, with a runtime option that will preserve original names from .proto files instead.
Well-known types are now included in the distribution.
Release now includes binary gems for Windows, Mac, and Linux instead of just source gems.
Bugfix for serializing oneofs.

C++/Java Lite (Alpha)

A new "lite" generator parameter was introduced in the protoc for C++ and
Java for Proto3 syntax messages. Example usage:

./protoc --cpp_out=lite:$OUTPUT_PATH foo.proto

The protoc will treat the current input and all the transitive dependencies
as LITE. The same generator parameter must be used to generate the
dependencies.

In Proto3 syntax files, "optimized_for=LITE_RUNTIME" is no longer supported.

Version 3.0.0-beta-2
General

Introduced a new language implementation: JavaScript.
Added a new field option "json_name". By default proto field names are converted to "lowerCamelCase" in proto3 JSON format. This option can be used to override this behavior and specify a different JSON name for the field.
Added conformance tests to ensure implementations are following proto3 JSON specification.

C++ (Beta)

Various bug fixes and improvements to the JSON support utility:
Duplicate map keys in JSON are now rejected (i.e., translation will fail).
Fixed wire-format for google.protobuf.Value/ListValue.
Fixed precision loss when converting google.protobuf.Timestamp.
Fixed a bug when parsing invalid UTF-8 code points.
Fixed a memory leak.
Reduced call stack usage.

Java (Beta)

Cleaned up some unused methods on CodedOutputStream.
Presized lists for packed fields during parsing in the lite runtime to reduce allocations and improve performance.
Improved the performance of unknown fields in the lite runtime.
Introduced UnsafeByteStrings to support zero-copy ByteString creation.
Various bug fixes and improvements to the JSON support utility:
Fixed a thread-safety bug.
Added a new to JsonFormat.
Added a new to JsonFormat.
Updated the JSON utility to comply with proto3 JSON specification.

Python (Beta)

Added proto3 JSON format utility. It includes support for all field types and a few well-known types except for Any and Struct.
Added runtime support for Any, Timestamp, Duration and FieldMask.
"[ ]" is now accepted for repeated scalar fields in text format parser.

Objective-C (Beta)

Various bug-fixes and code tweaks to pass more strict compiler warnings.
Now has conformance test coverage and is passing all tests.

C# (Beta)

Various bug-fixes.
Code generation: Files generated in directories based on namespace.
Code generation: Include comments from .proto files in XML doc comments (naively)
Code generation: Change organization/naming of "reflection class" (access to file descriptor)
Code generation and library: Add Parser property to MessageDescriptor, and introduce a non-generic parser type.
Library: Added TypeRegistry to support JSON parsing/formatting of Any.
Library: Added Any.Pack/Unpack support.
Library: Implemented JSON parsing.

Javascript (Alpha)

Added proto3 support for JavaScript. The runtime is written in pure JavaScript and works in browsers and in Node.js. To generate JavaScript code for your proto, invoke protoc with "--js_out". See js/README.md for more build instructions.

Version 3.0.0-beta-1
Supported languages

C++/Java/Python/Ruby/Nano/Objective-C/C#

About Beta

This is the first beta release of protobuf v3.0.0. Not all languages have reached beta stage. Languages not marked as beta are still in alpha (i.e., be prepared for API breaking changes).

General

Proto3 JSON is supported in several languages (fully supported in C++
and Java, partially supported in Ruby/C#). The JSON spec is defined in
the proto3 language guide:

https://developers.google.com/protocol-buffers/docs/proto3#json

We will publish a more detailed spec to define the exact behavior of
proto3-conformant JSON serializers and parsers. Until then, do not rely
on specific behaviors of the implementation if s not documented in
the above spec. More specifically, the behavior is not yet finalized for
the following:
Parsing invalid JSON input (e.g., input with trailing commas).
Non-camelCase names in JSON input.
The same field appears multiple times in JSON input.
JSON arrays values.
The message has unknown fields.

Proto3 now enforces strict UTF-8 checking. Parsing will fail if a string
field contains non UTF-8 data.

C++ (Beta)

Performance optimization of arena construction and destruction.
Bug fixes for arena and maps support.
Changed to use cmake for Windows Visual Studio builds.
Added Bazel support.

Java (Beta)

Introduced a new util package that will be distributed as a separate
artifact in maven. It contains:
JsonFormat: convert proto messages to/from JSON.
TimeUtil: utility functions to work with Timestamp and Duration.
FieldMaskUtil: utility functions to work with FieldMask.

The static PARSER in each generated message is deprecated, and it will
be removed in a future release. A static parser() getter is generated
for each message type instead.
Performance optimizations for String fields serialization.
Performance optimizations for Lite runtime on Android:
Reduced allocations
Reduced method overhead after ProGuarding
Reduced code size after ProGuarding

Python (Alpha)

Removed legacy Python 2.5 support.
Moved to a single Python 2.x/3.x-compatible codebase, instead of using 2to3.
Fixed build/tests on Python 2.6, 2.7, 3.3, and 3.4.
Pure-Python works on all four.
Python/C++ implementation works on all but 3.4, due to changes in the Python/C++ API in 3.4.
Some preliminary work has been done to allow for multiple DescriptorPools with Python/C++.

Ruby (Alpha)

Many bugfixes:
fixed parsing/serialization of bytes, sint, sfixed types
other parser bugfixes
fixed memory leak affecting Ruby 2.2

JavaNano (Alpha)

JavaNano generated code now will be put in a nano package by default to avoid conflicts with Java generated code.

Objective-C (Alpha)

Added non-null markup to ObjC library. Requires SDK 8.4+ to build.
Many bugfixes:
Removed the class/enum filter.
Renamed some internal types to avoid conflicts with the well-known types protos.
Added missing support for parsing repeated primitive fields in packed or unpacked forms.
Added *Count for repeated and map<> fields to avoid auto-create when checking for them being set.

C# (Alpha)

Namespace changed to Google.Protobuf (and NuGet package will be named correspondingly).
Target platforms now .NET 4.5 and selected portable subsets only.
Removed lite runtime.
Reimplementation to use mutable message types.
Null references used to represent "no value" for message type fields.
Proto3 semantics supported; proto2 files are prohibited for C# codegen. Most proto3 features supported:
JSON formatting (a.k.a. serialization to JSON), including well-known types (except for Any).
Wrapper types mapped to nullable value types (or string/ByteString allowing nullability). JSON parsing is not supported yet.
maps
oneof
enum unknown value preservation

Version 3.0.0-alpha-3 (C++/Java/Python/Ruby/JavaNano/Objective-C/C#)
General

Introduced two new language implementations (Objective-C, C#) to proto3.
Explicit "optional" keyword are disallowed in proto3 syntax, as fields are optional by default.
Group fields are no longer supported in proto3 syntax.
Changed repeated primitive fields to use packed serialization by default in proto3 (implemented for C++, Java, Python in this release). The user can still disable packed serialization by setting packed to false for now.
Added well-known type protos (any.proto, empty.proto, timestamp.proto, duration.proto, etc.). Users can import and use these protos just like regular proto files. Addtional runtime support will be added for them in future releases (in the form of utility helper functions, or having them replaced by language specific types in generated code).

Added a "reserved" keyword in both proto2 and proto3 syntax. User can use
this keyword to declare reserved field numbers and names to prevent them
from being reused by other fields in the same message.

To reserve field numbers, add a reserved declaration in your message:

message TestMessage {
reserved 2, 15, 9 to 11, 3;
}

This reserves field numbers 2, 3, 9, 10, 11 and 15. If a user uses any of
these as field numbers, the protocol buffer compiler will report an error.

Field names can also be reserved:

message TestMessage {
reserved "foo", "bar";
}

Various bug fixes since 3.0.0-alpha-2

Objective-C

In this first release, the generated interface provides: enums, messages,
field support(single, repeated, map, oneof), proto2 and proto3 syntax
support, parsing and serialization. s compatible with ARC and non-ARC
usage. Besides, user can also access it via the swift bridging header.

See objectivec/README.md for details.

C# protobufs are based on project https://github.com/jskeet/protobuf-csharp-port. The original project was frozen and all the new development will happen here.
Codegen plugin for C# was completely rewritten to C++ and is now an intergral part of protoc.
Some refactorings and cleanup has been applied to the C# runtime library.

Only proto2 is supported in C# at the moment, proto3 support is in
progress and will likely bring significant breaking changes to the API.

See csharp/README.md for details.

C++

Added runtime support for Any type. To use Any in your proto file, first
import the definition of Any:

// foo.proto
import "google/protobuf/any.proto";
message Foo {
google.protobuf.Any any_field = 1;
}
message Bar {
int32 value = 1;
}

Then in C++ you can access the Any field using PackFrom()/UnpackTo()
methods:

Foo foo;
Bar bar = ...;
foo.mutable_any_field()->PackFrom(bar);
...
if (foo.any_field().IsType<Bar>()) {
foo.any_field().UnpackTo(&bar);
...
}

In text format, entries of a map field will be sorted by key.

Java

Continued optimizations on the lite runtime to improve performance for Android.

Python

Added map support.
maps now have a dict-like interface (msg.map_field[key] = value)
existing code that modifies maps via the repeated field interface will need to be updated.

Ruby

Improvements to RepeatedField's emulation of the Ruby Array API.
Various speedups and internal cleanups.

Version 3.0.0-alpha-2 (C++/Java/Python/Ruby/JavaNano)
General

Introduced Protocol Buffers language version 3 (aka proto3).

When protobuf was initially opensourced it implemented Protocol Buffers
language version 2 (aka proto2), which is why the version number
started from v2.0.0. From v3.0.0, a new language version (proto3) is
introduced while the old version (proto2) will continue to be supported.

The main intent of introducing proto3 is to clean up protobuf before
pushing the language as the foundation of Google's new API platform.
In proto3, the language is simplified, both for ease of use and to
make it available in a wider range of programming languages. At the
same time a few features are added to better support common idioms
found in APIs.

The following are the main new features in language version 3:
Removal of field presence logic for primitive value fields, removal of required fields, and removal of default values. This makes proto3 significantly easier to implement with open struct representations, as in languages like Android Java, Objective C, or Go.
Removal of unknown fields.
Removal of extensions, which are instead replaced by a new standard type called Any.
Fix semantics for unknown enum values.
Addition of maps.
Addition of a small set of standard types for representation of time, dynamic data, etc.
A well-defined encoding in JSON as an alternative to binary proto encoding.

This release (v3.0.0-alpha-2) includes partial proto3 support for C++,
Java, Python, Ruby and JavaNano. Items 6 (well-known types) and 7
(JSON format) in the above feature list are not implemented.

A new notion "syntax" is introduced to specify whether a .proto file
uses proto2 or proto3:

// foo.proto
syntax = "proto3";
message Bar {...}

If omitted, the protocol compiler will generate a warning and "proto2" will
be used as the default. This warning will be turned into an error in a
future release.

Added support for map fields (implemented in proto2 and proto3 C++/Java/JavaNano and proto3 Ruby).

Map fields can be declared using the following syntax:

message Foo {
map<string, string> values = 1;
}

Data of a map field will be stored in memory as an unordered map and it
can be accessed through generated accessors.

C++

Added arena allocation support (for both proto2 and proto3).

Profiling shows memory allocation and deallocation constitutes a significant
fraction of CPU-time spent in protobuf code and arena allocation is a
technique introduced to reduce this cost. With arena allocation, new
objects will be allocated from a large piece of preallocated memory and
deallocation of these objects is almost free. Early adoption shows 20% to
50% improvement in some Google binaries.

To enable arena support, add the following option to your .proto file:

option cc_enable_arenas = true;

Protocol compiler will generate additional code to make the generated
message classes work with arenas. This does not change the existing API
of protobuf messages and does not affect wire format. Your existing code
should continue to work after adding this option. In the future we will
make this option enabled by default.

To actually take advantage of arena allocation, you need to use the arena
APIs when creating messages. A quick example of using the arena API:

Currently arena does not work with map fields. Enabling arena in a .proto
file containing map fields will result in compile errors in the generated
code. This will be addressed in a future release.

Python

Ruby

We have added proto3 support for Ruby via a native C extension.

The Ruby extension itself is included in the ruby/ directory, and details on
building and installing the extension are in ruby/README.md. The extension
will also be published as a Ruby gem. Code generator support is included as
part of protoc with the --ruby_out flag.

See ruby/README.md for details.

JavaNano

JavaNano is a special code generator and runtime library designed especially
for resource-restricted systems, like Android. It is very resource-friendly
in both the amount of code and the runtime overhead. Here is an an overview
of JavaNano features compared with the official Java protobuf:
No descriptors or message builders.
All messages are mutable; fields are public Java fields.
For optional fields only, encapsulation behind setter/getter/hazzer/ clearer functions is opt-in, which provide proper 'has' state support.
For proto2, if not opted in, has state (field presence) is not available. Serialization outputs all fields not equal to their defaults. The behavior is consistent with proto3 semantics.
Required fields (proto2 only) are always serialized.
Enum constants are integers; protection against invalid values only when parsing from the wire.
Enum constants can be generated into container interfaces bearing the enum's name (so the referencing code is in Java style).
CodedInputByteBufferNano can only take byte.
Similarly CodedOutputByteBufferNano can only write to byte[].
Repeated fields are in arrays, not ArrayList or Vector. Null array elements are allowed and silently ignored.
Full support for serializing/deserializing repeated packed fields.
Support extensions (in proto2).
Unset messages/groups are null, not an immutable empty default instance.
toByteArray(...) and mergeFrom(...) are now static functions of MessageNano.
The 'bytes' type translates to the Java type byte[].

See javanano/README.txt for details.

Version 3.0.0-alpha-1 (C++/Java)
General

Introduced Protocol Buffers language version 3 (aka proto3).

The main intent of introducing proto3 is to clean up protobuf before
pushing the language as the foundation of Google's new API platform.
In proto3, the language is simplified, both for ease of use and to
make it available in a wider range of programming languages. At the
same time a few features are added to better support common idioms
found in APIs.

The following are the main new features in language version 3:
Removal of field presence logic for primitive value fields, removal of required fields, and removal of default values. This makes proto3 significantly easier to implement with open struct representations, as in languages like Android Java, Objective C, or Go.
Removal of unknown fields.
Removal of extensions, which are instead replaced by a new standard type called Any.
Fix semantics for unknown enum values.
Addition of maps.
Addition of a small set of standard types for representation of time, dynamic data, etc.
A well-defined encoding in JSON as an alternative to binary proto encoding.

This release (v3.0.0-alpha-1) includes partial proto3 support for C++ and
Java. Items 6 (well-known types) and 7 (JSON format) in the above feature
list are not impelmented.

A new notion "syntax" is introduced to specify whether a .proto file
uses proto2 or proto3:

// foo.proto
syntax = "proto3";
message Bar {...}

If omitted, the protocol compiler will generate a warning and "proto2" will
be used as the default. This warning will be turned into an error in a
future release.

Added support for map fields (implemented in C++/Java for both proto2 and
proto3).

Map fields can be declared using the following syntax:

message Foo {
map<string, string> values = 1;
}

Data of a map field will be stored in memory as an unordered map and it
can be accessed through generated accessors.

C++

Added arena allocation support (for both proto2 and proto3).

Profiling shows memory allocation and deallocation constitutes a significant
fraction of CPU-time spent in protobuf code and arena allocation is a
technique introduced to reduce this cost. With arena allocation, new
objects will be allocated from a large piece of preallocated memory and
deallocation of these objects is almost free. Early adoption shows 20% to
50% improvement in some Google binaries.

To enable arena support, add the following option to your .proto file:

option cc_enable_arenas = true;

To actually take advantage of arena allocation, you need to use the arena
APIs when creating messages. A quick example of using the arena API:

Currently arena does not work with map fields. Enabling arena in a .proto
file containing map fields will result in compile errors in the generated
code. This will be addressed in a future release.

Revision 1.2 / (download) - annotate - [select for diffs], Wed Jun 10 01:31:52 2015 UTC (8 years, 5 months ago) by wiedi
Branch: MAIN
CVS Tags: pkgsrc-2016Q2-base, pkgsrc-2016Q2, pkgsrc-2016Q1-base, pkgsrc-2016Q1, pkgsrc-2015Q4-base, pkgsrc-2015Q4, pkgsrc-2015Q3-base, pkgsrc-2015Q3, pkgsrc-2015Q2-base, pkgsrc-2015Q2
Changes since 1.1: +12 -0 lines
Diff to previous 1.1 (colored)

Update protobuf to 2.6.1

Changelog:

2014-10-20 version 2.6.1:

  C++
  * Added atomicops support for Solaris.
  * Released memory allocated by InitializeDefaultRepeatedFields() and
    GetEmptyString(). Some memory sanitizers reported them as memory leaks.

  Java
  * Updated DynamicMessage.setField() to handle repeated enum values
    correctly.
  * Fixed a bug that caused NullPointerException to be thrown when
    converting manually constructed FileDescriptorProto to
    FileDescriptor.

  Python
  * Fixed WhichOneof() to work with de-serialized protobuf messages.
  * Fixed a missing file problem of Python C++ implementation.

2014-08-15 version 2.6.0:

  General
  * Added oneofs(unions) feature. Fields in the same oneof will share
    memory and at most one field can be set at the same time. Use the
    oneof keyword to define a oneof like:
      message SampleMessage {
        oneof test_oneof {
          string name = 4;
          YourMessage sub_message = 9;
        }
      }
  * Files, services, enums, messages, methods and enum values can be marked
    as deprecated now.
  * Added Support for list values, including lists of mesaages, when
    parsing text-formatted protos in C++ and Java.
      For example:  foo: [1, 2, 3]

  C++
  * Enhanced customization on TestFormat printing.
  * Added SwapFields() in reflection API to swap a subset of fields.
    Added SetAllocatedMessage() in reflection API.
  * Repeated primitive extensions are now packable. The
    [packed=true] option only affects serializers. Therefore, it is
    possible to switch a repeated extension field to packed format
    without breaking backwards-compatibility.
  * Various speed optimizations.

  Java
  * writeTo() method in ByteString can now write a substring to an
    output stream. Added endWith() method for ByteString.
  * ByteString and ByteBuffer are now supported in CodedInputStream
    and CodedOutputStream.
  * java_generate_equals_and_hash can now be used with the LITE_RUNTIME.

  Python
  * A new C++-backed extension module (aka "cpp api v2") that replaces the
    old ("cpp api v1") one.  Much faster than the pure Python code.  This one
    resolves many bugs and is recommended for general use over the
    pure Python when possible.
  * Descriptors now have enum_types_by_name and extension_types_by_name dict
    attributes.
  * Support for Python 3.

Revision 1.1 / (download) - annotate - [select for diffs], Thu Oct 9 09:10:47 2014 UTC (9 years, 1 month ago) by khorben
Branch: MAIN
CVS Tags: pkgsrc-2015Q1-base, pkgsrc-2015Q1, pkgsrc-2014Q4-base, pkgsrc-2014Q4

Packaged the python bindings to devel/protobuf as devel/py-protobuf

This form allows you to request diff's between any two revisions of a file. You may select a symbolic revision name using the selection box or you may type in a numeric name using the type-in text box.

Diffs between
and

CVSweb <webmaster@jp.NetBSD.org>