这是indexloc提供的服务,不要输入任何密码
Skip to content

Conversation

@Maegereg
Copy link
Contributor

@Maegereg Maegereg commented Sep 11, 2025

  • Adds a dependency matrix nox session.
  • Increases the minimum pyspark version to 3.5.
  • Adds the dependency matrix to the release pipeline.

Every linux configuration takes ~30 minutes, which is ~1.5% of OpenDP's 2000 monthly free minutes. Running a mac combination takes ~30*10 (minute multiplier) = 200 minutes, so 15% of OpenDP's free minutes.

I would like to run mac combinations, since we already know we missed a dependency problem in the past by not running them, but I think we can't afford any. Instead, we should probably just try to make sure I (or someone else with a mac) runs the dependency matrix locally before any release.

I had originally proposed running every python version we support, but if we assume 5 python versions that means every dependency matrix run will use 15% of OpenDP's monthly CI time. Sticking to just the newest and oldest python versions will keep us to 6%, which seems less likely to get us into trouble. That still means that every new python version we support will be in the dependency matrix for some amount of time (just not the entire time it's supported), which I think should catch most issues that are likely to arise.

@Maegereg Maegereg requested a review from tmager September 11, 2025 18:48
@Maegereg Maegereg self-assigned this Sep 11, 2025
Copy link
Contributor

@tmager tmager left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, and strategy for handling how to run the matrix in CI makes sense. It shouldn't be much of a headache for one of us to run the full Linux dependency matrix locally before releases as well.

@Maegereg Maegereg added this pull request to the merge queue Sep 12, 2025
Merged via the queue into main with commit dd4672b Sep 12, 2025
3 checks passed
@Maegereg Maegereg deleted the dasm/dependency-matrix branch September 12, 2025 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants