Announcing TOSA v0.50.0

TOSA 0.50.0 Release Notes

We have now tagged and released TOSA v0.50.0. All of the repositories exist on https://git.mlplatform.org

Specification

  • Add a new definition for TOSA levels. Levels define operator parameter
    ranges that an implementation shall support. This is distinct from a profile
    that defines the operations and data-types supported
  • Tensor coordinates are clarified to be 32-bit integer values
  • Operator clarifications: SLICE, RESIZE, RESCALE
  • Add the ability to CAST between floating-point types

Reference model

  • Note that in this release, the specification has added the concept of
    levels, but the reference model and conformance tests do not support
    testing of levels
  • Added FP16 and BF16 data type support, renamed FLOAT to FP32
  • Started support for TOSA Main Inference conformance. Still a work in
    progress
  • Added the IModelRunner interface to allow running the reference model
    via an API
  • Added simple testing against Numpy
  • Tests created/fixed: prelu, CAST, RESCALE, TILE, SIGMOID
  • Upgraded Eigen submodule to version 3.4.0
  • Misc. bugfixes

Conformance Tests

  • Started adding tests for Main Inference – CONST, IDENTITY, CONCAT, PAD, RESHAPE, REVERSE, SLICE, TILE, TRANSPOSE, GATHER, SCATTER, ARGMAX, MAX_POOL2D
  • Various updates to align with specification updates.

Serialization Library

  • Added support for FP16 and BF16. Float data type renamed to FP32
  • Updated the flatbuffers submodule to version 2.0.6.

TOSA MLIR translator

  • Add support for FP16 serialization
  • bugfixes
1 Like