Add a recomended extras group

[sjmonson]

Summary

Adds a python extras group for recommended packages and adds a couple optional tokenizer packages to it.

Details

• Adds the recommended package group with tiktoken, and blobfile
• Add default-optional-dependency-keys field for future compatibly with PEP 771 compliant tools pip is picky about the key in [project] so reverted. Since the group name is the default I'm not sure this is even necessary.

---

• "I certify that all code in this PR is my own, except as noted below."

Use of AI

• Includes AI-assisted code completion
• Includes code generated by an AI application
• Includes AI-generated tests (NOTE: AI written tests should have a docstring that includes ## WRITTEN BY AI ##)

[Copilot]

Pull Request Overview

This PR adds a new Python package extras group called "recommended" that includes optional tokenizer packages for enhanced functionality. The change introduces optional dependencies for tiktoken and blobfile packages to support OpenAI tokenizer features.

• Adds a "recommended" extras group with tiktoken and blobfile dependencies
• Includes a pdm.toml configuration update for dependency management strategy

Reviewed Changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated 2 comments.

File	Description
pyproject.toml	Adds the "recommended" optional dependencies group with tiktoken and blobfile packages
pdm.toml	Adds strategy configuration for dependency updates

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[AlonKellner-RedHat]

Looks good 👍