AMP

Review NN

Implement neural network

Three tasks applying mixed precision in NN

Implement in PyTorch

Training Neural Networks with Mixed Precision

How to choose factor

Training Mixed Precision User Guide#^hcxfmn1qod

Learn FP16 and Tensor cores in NVIDIA GPUs

Learn SASS Semantics -- (FP16) Half instructions store pattern
[[Characterizing_the_Error_Resilience_of_Applications_using_Mixed_Precision_Floating_Point_Formats.pdf]]

Use GPUFPX to create tight constraints.