Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spike] Gemini LLM support - node.js #2890

Open
kmudduluru opened this issue Jan 16, 2025 · 2 comments
Open

[Spike] Gemini LLM support - node.js #2890

kmudduluru opened this issue Jan 16, 2025 · 2 comments

Comments

@kmudduluru
Copy link
Contributor

Have support for gemini LLM

Similar to OpenAI, Customers are using gemini LLM heavily and would like new relic to support it as well.

Basically looking for gemini support similar to: https://docs.newrelic.com/docs/ai-monitoring/intro-to-ai-monitoring/

Feature request here

@workato-integration
Copy link

@newrelic-node-agent-team newrelic-node-agent-team moved this from Prioritized to Triage Needed: Unprioritized Features in Node.js Engineering Board Jan 16, 2025
@kmudduluru kmudduluru moved this from Triage Needed: Unprioritized Features to Prioritized in Node.js Engineering Board Jan 16, 2025
@jsumners-nr
Copy link
Contributor

There is a lot of missing detail here. These LLMs support multiple features. Which ones are we supposed to support?

  1. Which models are we supposed to target?
    a. https://ai.google.dev/gemini-api/docs/models/gemini
    b. https://ai.google.dev/gemini-api/docs/models/gemini-v2
    c. https://ai.google.dev/gemini-api/docs/models/experimental-models
  2. Which "capabilities" are we supposed to support?
    a. https://ai.google.dev/gemini-api/docs/text-generation?lang=node
    b. https://ai.google.dev/gemini-api/docs/vision?lang=node
    c. https://ai.google.dev/gemini-api/docs/audio?lang=node
    d. https://ai.google.dev/gemini-api/docs/long-context
    e. https://ai.google.dev/gemini-api/docs/code-execution?lang=node
    f. https://ai.google.dev/gemini-api/docs/structured-output?lang=node
    g. https://ai.google.dev/gemini-api/docs/imagen
    h. https://ai.google.dev/gemini-api/docs/function-calling
    i. https://ai.google.dev/gemini-api/docs/document-processing?lang=node
    j. https://ai.google.dev/gemini-api/docs/grounding?lang=node
    k. https://ai.google.dev/gemini-api/docs/model-tuning
    l. https://ai.google.dev/gemini-api/docs/embeddings
  3. Do we have any LLM experts that have researched this tool and provided details on how it works relative to the ones we already support? I.e. what are the finer details we need to be aware of during instrumentation? For example, our Bedrock support has been being improved by the LLM team because there are operational details that were left out of the original request and are now being filled in by that team.

@kmudduluru kmudduluru changed the title Gemini LLM support - node.js [Spike] Gemini LLM support - node.js Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Quarter
Development

No branches or pull requests

2 participants