Skip to content

[Spark Connector] Installation Instructions Are Missing Dependencies #242

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[Spark Connector] Installation Instructions Are Missing Dependencies #242

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
4e4d926
java libs
rachel-mack Feb 5, 2025
eec16d7
vale
rachel-mack Feb 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions source/java/api.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,17 @@ compatible with Scala 2.12:
</dependency>
</dependencies>

.. note::

If you use the {+connector-short+} without the Java Driver, you must
install the following libraries:

- :java-docs:`BSON </apidocs/bson/index.html>`

- :java-docs:`Core </apidocs/mongodb-driver-core/index.html>`

- :java-docs:`Java Driver </apidocs/mongodb-driver-sync/index.html>`

Comment on lines +46 to +56
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tech reviewer question:
Can you confirm that these are the equivalent packages for working with Scala and Python?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not needed / doesn't make sense - if they are using the maven coordinates as above it will pull in all the jars.

If the user wants to supply --jars flag to spark-submit they can download an uber jar containing all the mongodb dependencies eg:

mongo-spark-connector_2.12-10.4.1-all.jar

Which is available on maven central to download.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rozza I'm trying to address this issue: https://jira.mongodb.org/browse/DOCSP-41571

Do you think that they were having a problem specific to their own installation, or is there a step they were missing that we should make a note of in the documentation?

Configuration
-------------

Expand Down
Loading