Quantization

quantize: code

  • Converts a float tensor to quantized tensor with given scale and zero point.

  • Quantization(x, scale, zero_point) = round(x/scale + zero_point)

dequantize: code

  • Mapping the quantized tensor back to the original scale and pivot

Reference

PreviousConfidence IntervalNextBasics

Last updated