这是indexloc提供的服务,不要输入任何密码
Skip to content

Conversation

@Innixma
Copy link
Contributor

@Innixma Innixma commented Aug 15, 2024

Issue #, if available:

Description of changes:

  • Skip temperature scaling if zero or negative temperature. A negative temperature could be selected if the model has a worse validation score than a model that predicts a constant 0.5 value. This can happen when there are very few rows of validation data and is an artifact of validation overfitting.
  • increase learning rate by 10x to make convergence faster, reduce max iters by 5x to compensate. We can afford a more aggressive learning rate now that we pick the best iteration instead of the final iteration, so divergence is less problematic.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@Innixma Innixma added enhancement New feature or request module: tabular labels Aug 15, 2024
@Innixma Innixma added this to the 1.2 Release milestone Aug 15, 2024
@Innixma Innixma requested a review from prateekdesai04 August 15, 2024 22:19
Copy link
Contributor

@prateekdesai04 prateekdesai04 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link

Job PR-4397-eaa5b75 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-4397/eaa5b75/index.html

@Innixma Innixma merged commit 025ab6f into autogluon:master Aug 16, 2024
@Innixma Innixma deleted the temp_scale_prevent_negative branch April 16, 2025 21:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request module: tabular

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants