notes

Contents:

  • C++
  • Sphinx
  • git
  • docker
  • LaTeX
  • Kaldi
  • bash
  • CUDA
  • torch
    • torch.load and torch.save
    • torch.gather
    • DDP
    • TorchScript
    • Logical operations
    • Note
    • Quantization
      • Internals
      • torch.quantize_per_tensor
      • quantize_per_tensor_dynamic
      • torch.quantize_per_channel
      • Observer
      • Hello
      • References
        • Links
    • android
    • onnx
    • nn.LSTM
    • torchvision
    • audograd
    • seed
    • float16
    • Dynamo
    • random
    • compile
    • benchmark
    • cv2
    • einsum
  • Python
  • java
  • javascript
  • HTML
  • css
  • pybind11
  • Protocol Buffers
  • gRPC
  • lwn.net
  • Linker and Loader
  • espnet
  • cmake
  • huggingface
  • EECS E6870 Speech Recognition
  • ncnn
  • LLVM
  • Android
  • qemu
  • sox
  • MNN
  • SIMD
  • asio
  • websocketpp
  • Operating systems
  • encoding
  • ios
  • Embedded systems
  • ssh
  • onnx
  • csharp
  • Flask
  • ARM
  • VirtualBox
  • Go
  • Whisper
  • Windows
  • qt
  • webassembly
  • spleeter
  • django
  • React
  • tts
  • rust
  • ELF
  • ROS2
  • OpenFst
  • Colab
  • Dart
  • Flutter
  • Keyword spotting (KWS)
  • Papers
  • Pascal
  • ggml
  • Amphion
  • HarmonyOS
  • icefall
  • RKNN
  • lhotse
  • ffmpeg
  • vlc
notes
  • torch
  • Quantization
  • References
  • Edit on GitHub

References

The main implementation is in

https://github.com/pytorch/pytorch/tree/master/aten/src/ATen/native/quantized

  • Introducing Quantized Tensor

    https://github.com/pytorch/pytorch/wiki/Introducing-Quantized-Tensor

  • Model Quantization for PyTorch (Proposal) #18318

    https://github.com/pytorch/pytorch/issues/18318

  • torch_quantization_design_proposal

    https://github.com/pytorch/pytorch/wiki/torch_quantization_design_proposal

Links

  • https://github.com/pytorch/pytorch/blob/master/test/quantization/core/test_quantized_tensor.py

  • https://github.com/pytorch/pytorch/blob/master/test/quantization/core/experimental/test_quantized_tensor.py

  • https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/test/quantized_test.cpp

  • https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/native/quantized/README.md

  • https://pytorch.org/blog/introduction-to-quantization-on-pytorch/

  • https://pytorch.org/docs/stable/quantization.html

  • Deep Dive on PyTorch Quantization - Chris Gottbrath

    YouTube: https://www.youtube.com/watch?v=c3MT2qV5f9w

Previous Next

© Copyright 2022, fangjun.

Built with Sphinx using a theme provided by Read the Docs.