Features

Ability to force rebuild @conda/@pypi environments

This release adds the ability to force rebuild environments, which can be used to try solve environment resolution related issues

Simply apply the new flag to trigger a rebuild

python HelloConda.py --environment conda --force-rebuild-environments run

What's Changed

• [cards] remove dual write by @valayDave in #2453
• remove references to dual writes in card datastore by @savingoyal in #2458
• remove card dual writes by @savingoyal in #2457
• feature: alternate approach to environment force-rebuild by @saikonen in #2443
• release: 2.15.18 by @saikonen in #2465

Full Changelog: 2.15.17...2.15.18

What's Changed

• Two fixes: runner/deployer with configs and None config by @romain-intel in #2454
• feat: kubernetes image pull secrets by @nschmeller in #2400
• bump version by @savingoyal in #2455

New Contributors

• @nschmeller made their first contribution in #2400

Full Changelog: 2.15.16...2.15.17

What's Changed

• fix: boto3 client configuration handling in client_params by @yg7445 in #2412
• Add retry to compute_info in Metadata service by @tlee14-upstart in #2433
• move the generate_fake content_to deployer.py by @Qianh1225 in #2430
• S3 tests dev stack using minio by @madhur-ob in #2445
• Fix stub generator by @npow in #2447
• bump version to 2.15.16 by @talsperre in #2450

New Contributors

• @yg7445 made their first contribution in #2412
• @tlee14-upstart made their first contribution in #2433
• @Qianh1225 made their first contribution in #2430

Full Changelog: 2.15.15...2.15.16

What's Changed

• fix: skip metaflow dependencies in uv-environment by @saikonen in #2421
• fix: UV-environment skip installing metaflow extensions by @saikonen in #2423
• drop support for python 3.5 by @madhur-ob in #2424
• cleaner imports by @madhur-ob in #2427
• archive option in list files inside code package by @madhur-ob in #2425
• Resolve regex calls warnings by @emmanuel-ferdman in #2422
• determine root using file by @madhur-ob in #2428
• Add @pypi to full-stack test by @savingoyal in #2431
• Bump vite from 5.4.18 to 5.4.19 in /metaflow/plugins/cards/ui by @dependabot in #2432
• Extend the use of config_expr by @romain-intel in #2409
• update imports for py 3.7 by @savingoyal in #2435
• Revert "update imports for py 3.7" by @savingoyal in #2436
• Fix typos by @GameRoMan in #2440
• release: 2.15.15 by @saikonen in #2439

New Contributors

• @emmanuel-ferdman made their first contribution in #2422
• @GameRoMan made their first contribution in #2440

Full Changelog: 2.15.14...2.15.15

What's Changed

• fix: add back conda debug option that got removed. by @saikonen in #2419
• release: 2.15.14 by @saikonen in #2420

Full Changelog: 2.15.13...2.15.14

What's Changed

• [conda] conda deps pinning for azure/gcp downloaders by @valayDave in #2413
• fix default dict for json loads by @iamsgarg-ob in #2414
• release 2.15.13 by @savingoyal in #2416

Full Changelog: 2.15.12...2.15.13

What's Changed

• fix: threaded resolve for conda/pypi omitting exceptions by @saikonen in #2399
• feature: add debug logging to conda_environment, micromamba and pypi by @saikonen in #2403
• fix: properly close filehandles for GS and Azure uploads by @saikonen in #2407
• [S3] Revert default params in s3op.py by @npow in #2406
• Handle class instances in stub generator by @npow in #2408
• Release 2.15.12 by @talsperre in #2411

Full Changelog: 2.15.11...2.15.12

Improvements

Increase timeout for Google Storage datastore client

This release fixes an issue where the default timeouts of the Google Cloud Storage client were affecting uploading massive files to the flow datastore.

The fix should affect flows that relied on @conda/@pypi with large individual dependencies, which might previously timeout during their upload, resulting in a broken environment.

What's Changed

• Remove url from payload by @npow in #2395
• fix: remove custom emoji from Slack messages by @saikonen in #2396
• fix: bump GS datastore save_bytes timeout by @saikonen in #2397
• release: 2.15.11 by @saikonen in #2398

Full Changelog: 2.15.10...2.15.11

What's Changed

• support nvct by @madhur-ob in #2393
• Terminate early on ENOSPC by @npow in #2392
• prep 2.15.10 release by @savingoyal in #2394

Full Changelog: 2.15.9...2.15.10

What's Changed

• [kubernetes] security context for pods by @valayDave in #2387
• use absolute path for flow file for Runner and Deployer by @madhur-ob in #2386
• [kubernetes] fix bug in container security context by @valayDave in #2388
• 2.15.9 by @savingoyal in #2389

Full Changelog: 2.15.8...2.15.9