We experimentally support algorithm composition (e.g., --algs awq,signround or --algs hadamard,awq,signround) in AutoRound to improve accuracy of quantized models. We welcome any practical, deployable algorithms that are ready for real-world use. Feel free to submit a PR or leave a comment in Issues.
We experimentally support algorithm composition (e.g., --algs awq,signround or --algs hadamard,awq,signround) in AutoRound to improve accuracy of quantized models. We welcome any practical, deployable algorithms that are ready for real-world use. Feel free to submit a PR or leave a comment in Issues.