v0.12.0

What's Changed

New Features 🎉

• feat: qwen2.5 vl model by @yuyutaotao @zhoushaw in #383

Bug Fixes 🐞

• fix: partial scroll issue in chrome extension by @yuyutaotao in #401
• fix: coord bias of Qwen model by @yuyutaotao in #407
• fix: ci of qwen model by @yuyutaotao in #410

Other Changes

• Potential fix for code scanning alert no. 14: Clear-text logging of sensitive information by @yuyutaotao in #405

Full Changelog: v0.11.3...v0.12.0

v0.11.3

What's Changed

Bug Fixes 🐞

• fix(report): resolve the report generation failure caused by the absence of a selector by @zhoushaw in #392
• fix(report): reduce playwright report size by @zhoushaw in #396

Other Changes

• doc: badge links by @cwtuan in #393

New Contributors

• @cwtuan made their first contribution in #393

Full Changelog: v0.11.2...v0.11.3

v0.11.2

What's Changed

New Features 🎉

• feat(yaml): export yaml runner in javascipt by @yuyutaotao in #368
• feat(browser): Add the forceSameTabNavigation configuration to prevent AI from opening new pages during operations, thus avoiding task interruptions. by @zhoushaw in #389
• feat(reporting): Add test ID to test data attributes by @myselfsaurabh in #380

Bug Fixes 🐞

• fix: upgrade langsmith sdk by @yuyutaotao in #374
• fix: correctly collect elements in absolute container by @yuyutaotao in #373
• fix: update discord links #375 by @yuyutaotao in #379
• fix(keybord): resolve selectAll/Copy/Paste event by @zhoushaw in #384
• fix(browser-event): optimize limit open new tab script and add yaml test by @zhoushaw in #391

Full Changelog: v0.11.0...v0.11.2

v0.11.0

What's Changed

New Features 🎉

• feat(web-extract): extract web content as a tree by @yuyutaotao in #337
• feat(cache): supports ui-tars model caching capability by @zhoushaw in #361

playwright

- playwright test --config=playwright.config.ts
+ MIDSCENE_CACHE=true playwright test --config=playwright.config.ts

puppeteer

- tsx demo.ts 
+ MIDSCENE_CACHE=true tsx demo.ts

const mid = new PuppeteerAgent(originPage, {
  cacheId: 'puppeteer-swag-sab)', // Add cache id
});

Bridge Mode

- tsx demo.ts
+ MIDSCENE_CACHE=true tsx demo.ts

const agent = new AgentOverChromeBridge({
  cacheId: 'star-midscene-github', // Add cache id
});

Effect

After enabling the cache, the execution time is significantly reduced, for example, from 1m16s to 23s.

before

after

• feat: use different color for annotations by @yuyutaotao in #366

Bug Fixes 🐞

• fix: improve waitForNetworkIdle with timeout handling by @myselfsaurabh in #365
• fix(ui-tars): resolve page down and page up event error by @zhoushaw in #370
• fix: ai evaluation by @yuyutaotao in #371

Other Changes

• doc: enable code search in rspress by @yuyutaotao in #356
• workflow: enhance error messages and improve the debugging experience. by @zhoushaw in #363
• chore: optimize e2e test by @zhoushaw in #364

New Contributors

• @myselfsaurabh made their first contribution in #365

Full Changelog: v0.10.5...v0.11.0

v0.10.5

What's Changed

Bug Fixes 🐞

• fix(prompt): resolve params format error by @zhoushaw in #343

Full Changelog: v0.10.4...v0.10.5

v0.10.4

What's Changed

Bug Fixes 🐞

• fix(prompt): resolve the llm-planning format error by @zhoushaw in #341

Other Changes

• workflow(ci): optimize ai test workflow by @zhoushaw in #336

Full Changelog: v0.10.3...v0.10.4

v0.10.3

What's Changed

Bug Fixes 🐞

• fix: resolve shared exports error by @zhoushaw in #335

Other Changes

• chore: fix ai test by @zhoushaw in #332
• chore: change default model name by @zhoushaw in #333

Full Changelog: v0.10.2...v0.10.3

v0.10.0

What's Changed

New Features 🎉

• feat(ai-model): support the ui-tars model @zhoushaw
• feat(chrome-devtool): add 'stop' button in extension by @yuyutaotao in #281
• feat(chrome-devtool): allow tracking active tab in bridge mode by @yuyutaotao in #282

Other Changes

• chore(prompt): switch thought language to english by @zhoushaw in #283
• feat: fix doc content by @Brass-neck in #285
• feat(ai-model): remove dom info in assertion to make it reliable by @yuyutaotao in #284
• fix(extract-data): position ignore container element by @zhoushaw in #290
• docs: add doc about data privacy by @yuyutaotao in #291
• chore: optimize pr labeler by @zhoushaw in #292
• chore: move ai test into example repo by @yuyutaotao in #293
• feat: show pointer position in chrome extension by @yuyutaotao in #286

New Contributors

• @Brass-neck made their first contribution in #285

Full Changelog: v0.9.2...v0.10.0

v0.9.2

What's Changed

New Features 🎉

• feat: allow tracking newly-opened tabs in Chrome extension by @yuyutaotao in #272
• feat(chrome-devtool): water flow animation on the target page by @zhoushaw in #271

Bug Fixes 🐞

• fix: memory leak in report file by @yuyutaotao in #275

Other Changes

• doc: update the instructions to configure the model service by @yuyutaotao in #274

Full Changelog: v0.9.1...v0.9.2

v0.9.0

What's Changed

New Features 🎉

• feat: use our new version of logo by @yuyutaotao in #229

Full Changelog: v0.8.14...v0.8.15

What's Changed

New Features 🎉

• feat: support keyless auth mode for azure by @yuyutaotao in #227
• feat: use our new version of logo by @yuyutaotao in #229

Bug Fixes 🐞

• fix: remove scripting permission from manifest by @yuyutaotao in #219
• fix: typo in model name by @yuyutaotao in #223

Document 📖

• docs: add lark link by @zhoushaw in #218

Other Changes

• Update issue templates by @yuyutaotao in #213

Full Changelog: v0.8.12...v0.8.15