Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: gprcio limitation to < 1.66 in Python is problematic #34081

Open
1 of 17 tasks
potiuk opened this issue Feb 26, 2025 · 4 comments · May be fixed by #34196
Open
1 of 17 tasks

[Bug]: gprcio limitation to < 1.66 in Python is problematic #34081

potiuk opened this issue Feb 26, 2025 · 4 comments · May be fixed by #34196
Assignees
@liferoad
Labels
bug P2 python
Milestone
2.65.0 Release

Comments

@potiuk
Copy link
Member

potiuk commented Feb 26, 2025

What happened?

Some of the dependencies of Airflow (ydb) started to expect grpcio > 1.68.1 and apache-beam has < 1.66 - this is causing us to limit the other packages from installing - which we do not really like to do. It would be great to lift the upper-bound limitation if possible.

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
potiuk added a commit to potiuk/airflow that referenced this issue Feb 26, 2025
@potiuk
Limit ydb to < 3.19.0
a329e73 
Ydb 3.19.0 wrongly states it compatibility with grpc.io and it
caused our tests to fail as it conflicts with apache.beam < 1.66.

Temporarily limiting it now, deferring final solution(s) to:

* apache/beam#34081

or

* https://github.com/ydb-platform/ydb/issues/15087
@potiuk potiuk mentioned this issue Feb 26, 2025
Merged
potiuk added a commit to apache/airflow that referenced this issue Feb 26, 2025
@potiuk
Limit ydb to < 3.19.0 (#47105)
c0c7614 
Ydb 3.19.0 wrongly states it compatibility with grpc.io and it
caused our tests to fail as it conflicts with apache.beam < 1.66.

Temporarily limiting it now, deferring final solution(s) to:

* apache/beam#34081

or

* https://github.com/ydb-platform/ydb/issues/15087
ambika-garg pushed a commit to ambika-garg/airflow that referenced this issue Feb 28, 2025
@potiuk @ambika-garg
Limit ydb to < 3.19.0 (apache#47105)
c66a149 
Ydb 3.19.0 wrongly states it compatibility with grpc.io and it
caused our tests to fail as it conflicts with apache.beam < 1.66.

Temporarily limiting it now, deferring final solution(s) to:

* apache/beam#34081

or

* https://github.com/ydb-platform/ydb/issues/15087
@liferoad
Copy link
Contributor

https://github.com/apache/beam/blob/master/sdks/python/setup.py#L358 and grpc/grpc#37710

@liferoad
Copy link
Contributor

cc @tvalentyn

@tvalentyn
Copy link
Contributor

tvalentyn commented Mar 1, 2025 •
edited
Loading

grpc/grpc#37710 was never rootcaused; we could try to lift the restriction, and see if the issue is present in recent grpc versions.

@potiuk
Copy link
Member Author

potiuk commented Mar 1, 2025 •
edited by tvalentyn
Loading

grpc/grpc#37710 was never rootcaused; we could try to lift the restriction, and see if the issue is present in recent grpc versions.

Sounds reasonable indeed. Thanks for looking at it!

@liferoad liferoad added this to the 2.65.0 Release milestone Mar 1, 2025
@liferoad liferoad self-assigned this Mar 4, 2025
@liferoad liferoad linked a pull request Mar 6, 2025 that will close this issue
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@liferoad liferoad

Labels
bug P2 python
Projects
None yet
Milestone
2.65.0 Release
Development

Successfully merging a pull request may close this issue.

[DO NOT MERGE] Removed < 1.66 for grpcio liferoad/beam
3 participants
@potiuk @liferoad @tvalentyn