flytectl/v0.9.2

Changelog

• ca04314 Auth/prevent lookup per call (#5686)
• 89efcc6 Fix flytectl returning the oldest workflow when using --latest flag (#5716)
• 96c799c Move default execution name generation to flyteadmin (#5714)
• 5f69589 Refactor flyteadmin to pass proto structs as pointers (#5717)
• 43c9d94 Turn flyteidl and flytectl releases into manual gh workflows (#5635)
• 7d59f10 [flytectl] DataConfig missing from TaskSpec (#5692)

Flyte v1.13.1 milestone release

Flyte 1.13.1 Release Notes

What's Changed

• chore: update runllm widget configuration by @agiron123 in #5530
• Use jsonpb AllowUnknownFields everywhere by @andrewwdye in #5521
• [flyteadmin] Use WithContext in all DB calls by @Sovietaced in #5538
• add new project state: SYSTEM_ARCHIVED by @troychiu in #5544
• Pryce/doc 434 clarify how code is pushed into a given image during pyflyte by @pryce-turner in #5548
• Increase more memory limits in flyteagent by @Future-Outlier in #5550
• Updated map task information to indicate array node is now the default and optional return type by @pryce-turner in #5561
• reverted mockery-v2 on ExecutionContext by @hamersaw in #5562
• Fix issues with helm chart release process by @Sovietaced in #5560
• Add FlyteDirectory to file_types.rst template by @ppiegaze in #5564
• Fully populate Abort task event fields by @va6996 in #5551
• [fix] Add blob typechecker by @ddl-rliu in #5519
• Refactor echo plugin by @pingsutw in #5565
• [Bug] fix ArrayNode state's TaskPhase reset by @pvditt in #5451
• Remove confusing prometheus configuration options in helm charts by @Sovietaced in #5549
• [Housekeeping] Bump Go version to 1.22 by @lowc1012 in #5032
• Fix typos by @omahs in #5571
• Respect original task definition retry strategy for single task executions by @katrogan in #5577
• Clarify the support for the Java/Scala SDK in the docs by @eapolinario in #5582
• Fix spelling issues by @nnsW3 in #5580
• Give flyte binary cluster role permission to create service accounts by @shreyas44 in #5579
• Simplify single task retry strategy check by @eapolinario in #5584
• Fix failures in generate_helm CI check by @eapolinario in #5587
• Update GPU docs by @davidmirror-ops in #5515
• Update azblob 1.1.0 -> 1.4.0 / azcore 1.7.2 -> 1.13.0 by @ddl-ebrown in #5590
• Bump github.com/go-jose/go-jose/v3 from 3.0.0 to 3.0.3 in /flyteadmin by @dependabot in #5591
• add execution mode to ArrayNode proto by @pvditt in #5512
• Fix incorrect YAML for unpartitoned GPU by @davidmirror-ops in #5595
• Another YAML fix by @davidmirror-ops in #5596
• DOC-431 Document pyflyte option --overwrite-cache by @ppiegaze in #5567
• Upgrade docker dependency to address vulnerability by @katrogan in #5614
• Support offloading workflow CRD inputs by @katrogan in #5609
• [flyteadmin] Refactor panic recovery into middleware by @Sovietaced in #5546
• Snowflake agent Doc by @Future-Outlier in #5620
• [flytepropeller][compiler] Error Handling when Type is not found by @Future-Outlier in #5612
• Fix nil pointer when task plugin load returns error by @Sovietaced in #5622
• Log stack trace when refresh cache sync recovers from panic by @Sovietaced in #5623
• [Doc] Fix snowflake agent secret documentation error by @Future-Outlier in #5626
• [Doc] Explain how Agent Secret Works by @Future-Outlier in #5625
• Fix typo in execution manager by @ddl-rliu in #5619
• Amend Admin to use grpc message size by @wild-endeavor in #5628
• [Docs] document the process of setting ttl for a ray cluster by @pingsutw in #5636
• Add CustomHeaderMatcher to pass additional headers by @andrewwdye in #5563
• Turn flyteidl and flytectl releases into manual gh workflows by @eapolinario in #5635
• docs: fix typo by @cratiu222 in #5643
• Use enable_deck=True in docs by @thomasjpfan in #5645
• Fix flyteidl release checkout all tags by @eapolinario in #5646
• Install pyarrow in sandbox functional tests by @eapolinario in #5647
• docs: add documentation for configuring notifications in GCP by @desihsu in #5545
• Correct "sucessfile" to "successfile" by @shengyu7697 in #5652
• Fix ordering for custom template values in cluster resource controller by @katrogan in #5648
• Don't error when attempting to trigger schedules for inactive projects by @katrogan in #5649
• Update Flyte components - v1.13.1-rc0 by @flyte-bot in #5656
• Add offloaded path to literal by @katrogan in #5660
• Improve error messaging for invalid arguments by @pingsutw in #5658
• DOC-462 Update "Try Flyte in the browser" text by @neverett in #5654
• DOC-533 Remove outdated duplicate notification config content by @neverett in #5672
• Validate labels before creating flyte CRD by @pingsutw in #5671
• Add FLYTE_INTERNAL_POD_NAME environment variable that holds the pod name by @bgedik in #5616
• Upstream Using InMemory token cache for admin clientset in propeller by @pvditt in #5621
• [Bug] Update resource failures w/ Finalizers set (#423) by @pvditt in #5673
• [BUG] array node eventing bump version by @pvditt in #5680
• Add custominfo to agents by @ddl-rliu in #5604
• [BUG] use deep copy of bit arrays when getting array node state by @pvditt in #5681
• More concise definition of launchplan by @eapolinario in #5682
• Auth/prevent lookup per call by @wild-endeavor in #5686
• Update Flyte components - v1.13.1-rc1 by @flyte-bot in #5691
• [flytectl] DataConfig missing from TaskSpec by @wild-endeavor in #5692

New Contributors

• @omahs made their first contribution in #5571
• @nnsW3 made their first contribution in #5580
• @shreyas44 made their first contribution in #5579
• @cratiu222 made their first contribution in #5643
• @desihsu made their first contribution in #5545
• @shengyu7697 made their first contribution in #5652
• @bgedik made their first contribution in #5616
  Full Changelog: v1.13.0...v1.13.1

Flyte v1.13.1-rc1 milestone release

Flyte v1.13.0-rc1 Release Notes

What's Changed

• Add CustomHeaderMatcher to pass additional headers by @andrewwdye in #5563
• Turn flyteidl and flytectl releases into manual gh workflows by @eapolinario in #5635
• docs: fix typo by @cratiu222 in #5643
• Use enable_deck=True in docs by @thomasjpfan in #5645
• Fix flyteidl release checkout all tags by @eapolinario in #5646
• Install pyarrow in sandbox functional tests by @eapolinario in #5647
• docs: add documentation for configuring notifications in GCP by @desihsu in #5545
• Correct "sucessfile" to "successfile" by @shengyu7697 in #5652
• Fix ordering for custom template values in cluster resource controller by @katrogan in #5648
• Don't error when attempting to trigger schedules for inactive projects by @katrogan in #5649
• Update Flyte components - v1.13.1-rc0 by @flyte-bot in #5656
• Add offloaded path to literal by @katrogan in #5660
• Improve error messaging for invalid arguments by @pingsutw in #5658
• DOC-462 Update "Try Flyte in the browser" text by @neverett in #5654
• DOC-533 Remove outdated duplicate notification config content by @neverett in #5672
• Validate labels before creating flyte CRD by @pingsutw in #5671
• Add FLYTE_INTERNAL_POD_NAME environment variable that holds the pod name by @bgedik in #5616
• Upstream Using InMemory token cache for admin clientset in propeller by @pvditt in #5621
• [Bug] Update resource failures w/ Finalizers set (#423) by @pvditt in #5673
• [BUG] array node eventing bump version by @pvditt in #5680
• Add custominfo to agents by @ddl-rliu in #5604
• [BUG] use deep copy of bit arrays when getting array node state by @pvditt in #5681
• More concise definition of launchplan by @eapolinario in #5682
• Auth/prevent lookup per call by @wild-endeavor in #5686

New Contributors

• @cratiu222 made their first contribution in #5643
• @desihsu made their first contribution in #5545
• @shengyu7697 made their first contribution in #5652
• @bgedik made their first contribution in #5616

Full Changelog: flytectl/v0.9.1...v1.13.1-rc1

Flyte v1.13.1-rc0 milestone release

Flyte v1.13.1-rc0 Release Notes

Changelog

• chore: update runllm widget configuration by @agiron123 in #5530
• Use jsonpb AllowUnknownFields everywhere by @andrewwdye in #5521
• [flyteadmin] Use WithContext in all DB calls by @Sovietaced in #5538
• add new project state: SYSTEM_ARCHIVED by @troychiu in #5544
• Pryce/doc 434 clarify how code is pushed into a given image during pyflyte by @pryce-turner in #5548
• Increase more memory limits in flyteagent by @Future-Outlier in #5550
• Updated map task information to indicate array node is now the default and optional return type by @pryce-turner in #5561
• reverted mockery-v2 on ExecutionContext by @hamersaw in #5562
• Fix issues with helm chart release process by @Sovietaced in #5560
• Add FlyteDirectory to file_types.rst template by @ppiegaze in #5564
• Fully populate Abort task event fields by @va6996 in #5551
• [fix] Add blob typechecker by @ddl-rliu in #5519
• Refactor echo plugin by @pingsutw in #5565
• [Bug] fix ArrayNode state's TaskPhase reset by @pvditt in #5451
• Remove confusing prometheus configuration options in helm charts by @Sovietaced in #5549
• [Housekeeping] Bump Go version to 1.22 by @lowc1012 in #5032
• Fix typos by @omahs in #5571
• Respect original task definition retry strategy for single task executions by @katrogan in #5577
• Clarify the support for the Java/Scala SDK in the docs by @eapolinario in #5582
• Fix spelling issues by @nnsW3 in #5580
• Give flyte binary cluster role permission to create service accounts by @shreyas44 in #5579
• Simplify single task retry strategy check by @eapolinario in #5584
• Fix failures in generate_helm CI check by @eapolinario in #5587
• Update GPU docs by @davidmirror-ops in #5515
• Update azblob 1.1.0 -> 1.4.0 / azcore 1.7.2 -> 1.13.0 by @ddl-ebrown in #5590
• Bump github.com/go-jose/go-jose/v3 from 3.0.0 to 3.0.3 in /flyteadmin by @dependabot in #5591
• add execution mode to ArrayNode proto by @pvditt in #5512
• Fix incorrect YAML for unpartitoned GPU by @davidmirror-ops in #5595
• Another YAML fix by @davidmirror-ops in #5596
• DOC-431 Document pyflyte option --overwrite-cache by @ppiegaze in #5567
• Upgrade docker dependency to address vulnerability by @katrogan in #5614
• Support offloading workflow CRD inputs by @katrogan in #5609
• [flyteadmin] Refactor panic recovery into middleware by @Sovietaced in #5546
• Snowflake agent Doc by @Future-Outlier in #5620
• [flytepropeller][compiler] Error Handling when Type is not found by @Future-Outlier in #5612
• Fix nil pointer when task plugin load returns error by @Sovietaced in #5622
• Log stack trace when refresh cache sync recovers from panic by @Sovietaced in #5623
• [Doc] Fix snowflake agent secret documentation error by @Future-Outlier in #5626
• [Doc] Explain how Agent Secret Works by @Future-Outlier in #5625
• Fix typo in execution manager by @ddl-rliu in #5619
• Amend Admin to use grpc message size by @wild-endeavor in #5628
• [Docs] document the process of setting ttl for a ray cluster by @pingsutw in #5636
• Add CustomHeaderMatcher to pass additional headers by @andrewwdye in #5563
• Turn flyteidl and flytectl releases into manual gh workflows by @eapolinario in #5635
• docs: fix typo by @cratiu222 in #5643
• Use enable_deck=True in docs by @thomasjpfan in #5645
• Fix flyteidl release checkout all tags by @eapolinario in #5646
• Install pyarrow in sandbox functional tests by @eapolinario in #5647
• docs: add documentation for configuring notifications in GCP by @desihsu in #5545
• Correct "sucessfile" to "successfile" by @shengyu7697 in #5652
• Fix ordering for custom template values in cluster resource controller by @katrogan in #5648
• Don't error when attempting to trigger schedules for inactive projects by @katrogan in #5649

New Contributors

• @omahs made their first contribution in #5571
• @nnsW3 made their first contribution in #5580
• @shreyas44 made their first contribution in #5579
• @cratiu222 made their first contribution in #5643
• @desihsu made their first contribution in #5545
• @shengyu7697 made their first contribution in #5652

Full Changelog: v1.13.0...v1.13.1-rc0

flytectl/v0.9.1

Changelog

• 2b0e8ef Document how to release flytectl (#5537)
• 71779b3 Fix typos (#5571)
• 6292dec Update azblob 1.1.0 -> 1.4.0 / azcore 1.7.2 -> 1.13.0 (#5590)
• 01ecd0a Upgrade docker dependency to address vulnerability (#5614)
• e13bfe3 Use jsonpb AllowUnknownFields everywhere (#5521)
• 02a0d2e [Housekeeping] Bump Go version to 1.22 (#5032)

Flyte v1.13.0 milestone release

Flyte 1.13.0 Release Notes

Flyte 1.13.0 brings a host of new features, optimizations, and fixes, enhancing the platform's functionality and user experience. This release also welcomes several new contributors to the Flyte community. Below are the highlights of this release.

🚀 New Features & Improvements

1. Features

   • Watch agent metadata service
   • Allow controlling in which task phases log links are shown
   • Add executionClusterLabel

2. Helm Charts & Manifests

   • Grafana dashboard updates for better monitoring and observability.
   • Core helm chart updates for propeller configuration of agent service.
   • Helm chart updates related to Prometheus, Webhook HPA, and Flyteconsole probes.

3. Documentation Improvements

   • Added examples and guides, including a guide for setting up the OpenAI batch agent backend and updated Optimization Performance docs.
   • Fix doc link to testing agent on local cluster and replace Azure AD OIDC URL.
   • Clarify networking configurations between data plane propeller and control plane data catalog in multi-cluster deployments.

4. Performance & Bug Fixes

   • Fix cache and token management issues, including addressing auto-refresh cache race conditions and improving token refresh mechanisms.
   • Fix SQL insert operations to handle NULL values appropriately.
   • Keep EnvFrom from pod template
   • Miscellaneous fixes for pod templates, Kubeflow webhook errors, and logging configurations.

5. Flytectl

   • Add prefetch functionality for paginator
   • Fix upgrade and version commands

🔧 Housekeeping & Deprecations

1. Miscellaneous
   • Add OTLP and sampling to otelutils
   • Refactor distributed job using common ReplicaSpec
   • Fix typos using codespell CI job.
   • Remove obsolete Flyte config files.
   • Upgraded various dependencies, including Golang, Docker, and others.
   • Move to upstream mockery, which simplifies the migration to mockery-v2
   • Key-value execution tags

🆕 New Contributors

• @zychen5186 for adding prefetch functionality for paginator.
• @EraYaN for replacing Azure AD OIDC URL.
• @Dlougach for making BaseURL insensitive to trailing slashes for metadata endpoint redirect.
• @flixr for honoring redoc.enabled=false in charts.
• @trevormcguire for including group in apiVersion in plugin_collector.
• @va6996 for inheriting execution cluster label from source execution.
• @mhotan for Helm chart updates related to Prometheus, Webhook HPA, and Flyteconsole probes.
• @eltociear for updating token_source.go.

Full Changelog

flytectl/v0.9.0

Changelog

• f87a049 Add API to get domain (#5443)
• e1d9c5c Add OTLP and sampling to otelutils (#5504)
• ba88e82 Add lint-fix make target, add gci to flytectl, remove goimports make target (#5484)
• 791471c Fix: Make 'flytectl compile' consider launchplans used within workflows (#5463)
• f54b74e Fix: replace with in OSS docs (#5501)
• ed40a94 Remove doc building from flytectl (#5494)
• c97a0e9 Remove github.ref from group (#5518)
• c512571 reimplement functions in go-mouff-update, use ghreposervice (#5470)

Flyte v1.13.0-rc0 milestone release

Flyte v1.13.0-rc0 Release Notes

Major Features and Improvements

• Key-value execution tags: Enhanced execution tagging capabilities. (#5453)
• Watch agent metadata service: Improved monitoring of agent metadata. (#5017)
• Distributed job refactoring: Refactored distributed job using common ReplicaSpec. (#5355)
• Execution cluster label inheritance: Executions now inherit cluster labels from source executions. (#5431)
• Domain API: Added new API to retrieve domain information. (#5443)
• Execution environment versioning: Added version to ExecutionEnv proto message. (#5506)
• OTLP and sampling in otelutils: Enhanced observability with OpenTelemetry Protocol (OTLP) support. (#5504)

Notable Changes

• Removed mmcloud plugin. (#5468)
• Updated k3s version to 1.29.0. (#5475)
• Improved auth flow to support custom base URLs in deployments. (#5192)
• Added flyteconsole URL to FlyteWorkflow CRD. (#5449)
• Enhanced 'flytectl compile' to consider launch plans within workflows. (#5463)
• Introduced control over task phases for log link display. (#4726)
• Improved Helm chart configurations for Prometheus, Webhook HPA, and Flyteconsole probes. (#5508)

Bug Fixes and Optimizations

• Fixed flaky auto_refresh_test. (#5438)
• Corrected NULL to empty string in SQL insert for migrations. (#5482)
• Resolved issues with broken mermaid diagrams in documentation. (#5498)
• Fixed Ray plugin to use default service account if not set in task metadata. (#5499)

Documentation and Usability

• Updated community page. (#5496)
• Improved documentation on logging link lifetime configuration. (#5503)
• Replaced 'uctl' with 'flytectl' in OSS docs for consistency. (#5501)

New Contributors

• @Dlougach, @flixr, @trevormcguire, @va6996, @mhotan, and @eltociear made their first contributions to the project.

For a complete list of changes, please refer to the full changelog.

flytectl/v0.8.24

Changelog

• 9ffc54f Indicate that jq is now required to install flytectl via the script (#5440)
• f08eb47 Upstream revert revert auth token fix (#5407)

Flyte v1.12.1-rc0 milestone release

Flyte 1.12.1-rc0 Release Notes

Flyte 1.12.1-rc0 is a release candidate that focuses on documentation enhancements, bug fixes, and improvements to the core infrastructure. This release also includes contributions from a new member of the Flyte community. Below are the highlights of this release.

🚀 New Features & Improvements

1. Documentation Improvements

   • Removed the source code renderer section from the Decks article.
   • Added documentation for OpenAI batch agent backend setup.
   • Updated the example Flyte agent Dockerfile.
   • Fixed documentation link to testing agent on local cluster.
   • Fixed Kubeflow webhook error in the documentation.
   • Updated Flytekit version to 1.12.1b2 in monodocs requirements.
   • Updated Flytefile.md and replaced SHA instead of master in RLI links.

2. Infrastructure and Configuration

   • Reverted "Ensure token is refreshed on Unauthenticated".
   • Updated core Helm chart for propeller configuration of agent service.
   • Fixed Flytectl install script in the monorepo.
   • Moved to upstream mockery.
   • Used a different git command to match the Flyteidl tags.

3. Bug Fixes

   • Handled auto-refresh cache race condition.
   • Fixed typos using codespell CI job.
   • Fixed build failure in monodocs.
   • Replaced Azure AD OIDC URL with the correct one.

4. Miscellaneous

   • Updated the lock file.
   • Added executionClusterLabel for better execution cluster management.

🆕 New Contributors

• @EraYaN for replacing Azure AD OIDC URL with the correct one.

Full Changelog