Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Cannot ask questions using the claude-3-5-sonnet-20240620 image #609

Open
yuzhegan opened this issue Sep 19, 2024 · 0 comments
Open
Labels
bug Something isn't working

Comments

@yuzhegan
Copy link

Describe the bug

Using the "HakonHarnes/img-clip.nvim" plugin to paste images only results in the image path format as follows: /home/dav/assets/2024-09-19-23-18-34.png, but when sending a question to AI for answering, the answer cannot follow the content of the image to return the result, as if the AI cannot access the content of the image. My configuration is as follows:

To reproduce

return {
{
"yetone/avante.nvim",
dependencies = {
"nvim-tree/nvim-web-devicons",
"stevearc/dressing.nvim",
"nvim-lua/plenary.nvim",
"MunifTanjim/nui.nvim",
{
-- support for image pasting
"HakonHarnes/img-clip.nvim",
event = "VeryLazy",
opts = {
-- recommended settings
default = {
embed_image_as_base64 = false,
prompt_for_file_name = false,
drag_and_drop = {
insert_mode = true,
},
-- required for Windows users
use_absolute_path = true,
},
},
keys = {
{ "p", "PasteImage", desc = "Paste image from system clipboard" },
}

		}
		-- {
		-- 	"MeanderingProgrammer/render-markdown.nvim",
		-- 	opts = {
		-- 		file_types = { "markdown", "Avante" },
		-- 	},
		-- 	ft = { "markdown", "Avante" },
		-- },
	},
	event = "VeryLazy",
	build = "make",
	opts = {
		provider = "claude",
		claude = {
			endpoint = "https://api.anthropic.com",
			model = "claude-3-5-sonnet-20240620",
			-- model = "gpt-4o",
			proxy = nil,        -- [protocol://]host[:port] Use this proxy
			allow_insecure = false, -- Allow insecure server connections
			timeout = 30000,    -- Timeout in milliseconds
			temperature = 0,
			max_tokens = 4096,
		},

		mappings = {
			ask = "<leader>aa",
			edit = "<leader>ae",
			refresh = "<leader>ar",
			diff = {
				ours = "co",
				theirs = "ct",
				both = "cb",
				next = "]x",
				prev = "[x",
			},
			jump = {
				next = "]]",
				prev = "[[",
			},
			submit = {
				normal = "<CR>",
				insert = "<C-s>",
			},
			toggle = {
				debug = "<leader>ad",
				hint = "<leader>ah",
			},
		},
	},
},

}

Expected behavior

No response

Environment

NVIM v0.11.0-dev-757+g5931f780e
Build type: RelWithDebInfo
ArchLinux

Repro

vim.env.LAZY_STDPATH = ".repro"
load(vim.fn.system("curl -s https://raw.githubusercontent.com/folke/lazy.nvim/main/bootstrap.lua"))()

require("lazy.minit").repro({
  spec = {
    -- add any other plugins here
  },
})
@yuzhegan yuzhegan added the bug Something isn't working label Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant