Deprecate config functions like int4_weight_only
#2994
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` ghstack-source-id: efd30d0 Pull Request resolved: #2994
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2994
Note: Links to docs will display an error until the docs builds have been completed. ❌ 4 New FailuresAs of commit 155c576 with merge base 58c3064 ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` ghstack-source-id: cccdd5a Pull Request resolved: #2994
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` ghstack-source-id: 9b2f9a3 Pull Request resolved: #2994
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
**Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
…eight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 12, 2025
…eight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
liangel-02
approved these changes
Sep 12, 2025
andrewor14
added a commit
that referenced
this pull request
Sep 15, 2025
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` ghstack-source-id: 9b2f9a3 Pull Request resolved: #2994
…ht_only`"
**Summary:** These have been superseded by `AOBaseConfig` objects
for several releases already, but we never deprecated them.
We will keep them around for another release before breaking BC
and removing them.
**Test Plan:**
```
python test/quantization/test_quant_api.py -k test_config_deprecation
```
```
>>> int4_weight_only()
/home/andrewor/local/ao/torchao/utils.py:446: UserWarning: `int4_weight_only` is deprecated and will be removed in a future release. Please use `Int4WeightOnlyConfig` instead. Example usage:
quantize_(model, Int4WeightOnlyConfig(...))
warnings.warn(
Int4WeightOnlyConfig(group_size=128, layout=TensorCoreTiledLayout(inner_k_tiles=8), use_hqq=False, zero_point_domain=<ZeroPointDomain.NONE: 3>, set_inductor_config=True, preserve_zero=None, int4_packing_format=<Int4PackingFormat.PLAIN: 'plain'>, int4_choose_qparams_algorithm=<Int4ChooseQParamsAlgorithm.TINYGEMM: 'tinygemm'>, version=2)
```
[ghstack-poisoned]
**Summary:** These have been superseded by `AOBaseConfig` objects
for several releases already, but we never deprecated them.
We will keep them around for another release before breaking BC
and removing them.
**Test Plan:**
```
python test/quantization/test_quant_api.py -k test_config_deprecation
```
```
>>> int4_weight_only()
/home/andrewor/local/ao/torchao/utils.py:446: UserWarning: `int4_weight_only` is deprecated and will be removed in a future release. Please use `Int4WeightOnlyConfig` instead. Example usage:
quantize_(model, Int4WeightOnlyConfig(...))
warnings.warn(
Int4WeightOnlyConfig(group_size=128, layout=TensorCoreTiledLayout(inner_k_tiles=8), use_hqq=False, zero_point_domain=<ZeroPointDomain.NONE: 3>, set_inductor_config=True, preserve_zero=None, int4_packing_format=<Int4PackingFormat.PLAIN: 'plain'>, int4_choose_qparams_algorithm=<Int4ChooseQParamsAlgorithm.TINYGEMM: 'tinygemm'>, version=2)
```
[ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 15, 2025
…ons like `int4_weight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 15, 2025
…eight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
jerryzh168
approved these changes
Sep 15, 2025
andrewor14
added a commit
that referenced
this pull request
Sep 16, 2025
**Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` ghstack-source-id: 9b2f9a3 Pull Request resolved: #2994
…ht_only`"
**Summary:** These have been superseded by `AOBaseConfig` objects
for several releases already, but we never deprecated them.
We will keep them around for another release before breaking BC
and removing them.
**Test Plan:**
```
python test/quantization/test_quant_api.py -k test_config_deprecation
```
```
>>> int4_weight_only()
/home/andrewor/local/ao/torchao/utils.py:446: UserWarning: `int4_weight_only` is deprecated and will be removed in a future release. Please use `Int4WeightOnlyConfig` instead. Example usage:
quantize_(model, Int4WeightOnlyConfig(...))
warnings.warn(
Int4WeightOnlyConfig(group_size=128, layout=TensorCoreTiledLayout(inner_k_tiles=8), use_hqq=False, zero_point_domain=<ZeroPointDomain.NONE: 3>, set_inductor_config=True, preserve_zero=None, int4_packing_format=<Int4PackingFormat.PLAIN: 'plain'>, int4_choose_qparams_algorithm=<Int4ChooseQParamsAlgorithm.TINYGEMM: 'tinygemm'>, version=2)
```
[ghstack-poisoned]
**Summary:** These have been superseded by `AOBaseConfig` objects
for several releases already, but we never deprecated them.
We will keep them around for another release before breaking BC
and removing them.
**Test Plan:**
```
python test/quantization/test_quant_api.py -k test_config_deprecation
```
```
>>> int4_weight_only()
/home/andrewor/local/ao/torchao/utils.py:446: UserWarning: `int4_weight_only` is deprecated and will be removed in a future release. Please use `Int4WeightOnlyConfig` instead. Example usage:
quantize_(model, Int4WeightOnlyConfig(...))
warnings.warn(
Int4WeightOnlyConfig(group_size=128, layout=TensorCoreTiledLayout(inner_k_tiles=8), use_hqq=False, zero_point_domain=<ZeroPointDomain.NONE: 3>, set_inductor_config=True, preserve_zero=None, int4_packing_format=<Int4PackingFormat.PLAIN: 'plain'>, int4_choose_qparams_algorithm=<Int4ChooseQParamsAlgorithm.TINYGEMM: 'tinygemm'>, version=2)
```
[ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 16, 2025
…ons like `int4_weight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 16, 2025
…eight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Sep 17, 2025
…#2995) * Deprecate config functions like `int4_weight_only` **Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned] * Update on "Deprecate config functions like `int4_weight_only`" **Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned] * Update on "Deprecate config functions like `int4_weight_only`" **Summary:** These have been superseded by `AOBaseConfig` objects for several releases already, but we never deprecated them. We will keep them around for another release before breaking BC and removing them. **Test Plan:** ``` python test/quantization/test_quant_api.py -k test_config_deprecation ``` [ghstack-poisoned] * Remove internal usage of all config functions like `int4_weight_only` **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned] * Update on "Remove internal usage of all config functions like `int4_weight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned] * Update on "Remove internal usage of all config functions like `int4_weight_only`" **Summary:** These are now deprecated as of #2994. We should stop using them internally as well. **Test Plan:** CI [ghstack-poisoned]
andrewor14
added a commit
that referenced
this pull request
Oct 10, 2025
**Summary:** As a follow-up to #2994, this commit removes all quantization functions that were used as configs. These functions were deprecated in 0.14.0 and will be removed in the next release, 0.15.0. **Test Plan:** CI [ghstack-poisoned]
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Stack from ghstack (oldest at bottom):
int4_weight_only#2995int4_weight_only#2994Summary: These have been superseded by
AOBaseConfigobjectsfor several releases already, but we never deprecated them.
We will keep them around for another release before breaking BC
and removing them.
Test Plan: