[bug] Parts of the WebUI don’t load or show outdated data

[JourneyOver]

CrossWatch version

v0.11.6

Interface

Web user interface

Providers involved

• AniList
• BingeBase
• CrossWatch
• Emby
• FlickList
• Floppy
• Jellyfin
• Kodi
• MDBList
• Nuvio
• Plex
• PublicMetaDB
• PunchPlay
• Scrob
• SIMKL
• Stremio
• Tautulli
• TMDb
• Trakt

Affected area

• Watchlist
• History
• Progress or Playback progress
• Ratings
• Collections
• Scrobble (watcher/webhook)
• Scheduler
• Analyzer
• Events
• Import/Export
• Metadata or IDs
• Web UI
• Command line interface
• Configuration or API

What happened?

Decided to check out CrossWatch again since it had been a while, mostly to see what had changed, but the WebUI seems to be pretty buggy for me at the moment.

Main tab

On the main tab, widgets sometimes never load at all (as in just don't show up at all), or I get a Could not load this widget error.

When they do load, things like recent history and recent scrobble seem to be very outdated. I don't rate items, so I'm not sure if latest ratings is affected as well.

I've also noticed that some widgets will initially load with outdated data, then eventually switch over to Could not load this widget even though they technically loaded beforehand.

Editor page / CrossWatch history

The editor page seems to have similar issues. Sometimes it doesn't load properly at all and I have to refresh a few times before everything shows up.

Even after it loads, the history for the CrossWatch provider still seems to stay outdated.

I currently have these watcher routes set up:

• Plex -> CrossWatch
• Plex -> Trakt
• Plex -> FlickList

The Plex -> Trakt and Plex -> FlickList watcher routes seem to work perfectly fine and the history for at least trakt seems to be correct, but the CrossWatch history doesn't appear to stay up to date.

I also have a sync pair set up for Plex -> CrossWatch that syncs collections, and that seems to be working without any issues.

This made me wonder if recent history on the main tab and the history view on the editor page only get updated when there is a sync pair configured to sync history from provider -> CrossWatch, rather than through a watcher route. Is that the case?

That still wouldn't explain why recent scrobble also stays outdated though, so I'm not sure if these are all related to the same issue or if I'm misunderstanding how those widgets are populated.

FlickList provider in the editor

I also noticed that the FlickList provider doesn't appear in the provider selector on the editor page.

Is that intentional, or should FlickList be available there as well?

Scheduler

One last thing is the scheduler under Settings -> Scheduler.

From what I can tell, there doesn't seem to be any way to actually enable the scheduler through the WebUI. There is an enable button for the webhook functionality, but nothing similar for the scheduler itself.

I ended up having to stop CrossWatch, manually edit the config file to enable the scheduler, then start it again.

Unless I'm overlooking something, it would be nice to have an enable/disable option for the scheduler directly in the WebUI as well.

How can we reproduce it?

1. Load up the webUI and notice the various issues noted above.

Sync Output debug log

No response

Analyzer output

No response

Additional context

From what I can see there is nothing in the logs or in the browser console output that would explain these issues. Also unsure on what to mark fully for the affected areas other than webUI so I'm just leaving at that for now..

Confirmation

• I removed tokens, API keys, passwords, usernames, and other sensitive information.

[JourneyOver]

random example of the recent scrobble being outdated as well as the history

as you can see the sidebar on the right is correct in terms of scrobbles, but the one on the bottom is only showing a single scrobble and also the history being behind as well (the watchlist didn't load at all either for some reason).

Also is recent scrobble and recent sync on the right sidebar only supposed to show up when the view details is enabled?

Also noticed that the time in the view details always shows my actual current time, instead of the time of when the actual data was produced..

[cenodude]

HI,

Thanks but a bug report is not really meant for asking about all kinds of different things.
Its impossible for me to keep track on that. Next time please use Discussions first, then you also know what is a bug or not a bug.

Clean you full state files. Thats the first thing i would advice:

This will clean everything. Meaning your state files etc start fresh again.

Do a full clear for your browser cache or try a different browser. Many of the issues you’re seeing seem cache related. Be sure to use a Chromium-compatible browser.

Above is the first thing tha tneeds to be resolved.

I also noticed that the FlickList provider doesn't appear in the provider selector on the editor page.

FlickList is shown when there is saved/imported/synced state or manual policy data for it. Merely having FlickList connected, with no saved editor state yet, does not auto-list it. Or its related due to your cache issues.

From what I can tell, there doesn't seem to be any way to actually enable the scheduler through the WebUI. There is an enable button for the webhook functionality, but nothing similar for the scheduler itself.

Yes... this is a bug. Standard scheduling could not be enabled only advanced schedling. I will make a new bug report out of this

[cenodude]

To get things clear regarding the dashboard and outdated information:

• Recent Scrobble is populated by watcher/webhook scrobble events. If Plex playback is routed to Trakt, FlickList, CrossWatch, etc., the completed watch should appear there.
• Recent History is populated by history sync activity/state, not by live watcher playback events.
• So a Plex -> CrossWatch watcher route will not make the Recent History widget update immediately. That activity belongs in Recent Scrobble.

I tested Plex -> CrossWatch and Recent Scrobble updates correctly after playback, so I can’t reproduce an outdated dashboard issue there.

If you still have issues after resetting everything and resetting your browser cache. Then please sent me the following:

http://yourCrossWatch:8787 /api/activity/history and /api/dashboard/widgets

I need both, so i can validate it for you.

This made me wonder if recent history on the main tab and the history view on the editor page only get updated when there is a sync pair configured to sync history from provider -> CrossWatch, rather than through a watcher route. Is that the case?

For basically everything in CW, those views read from the state data that is created and updated by sync runs. They are not meant to reflect every live watcher/scrobble event immediately. Ofcourse a watcher/scrobble event will eventuelly be an history event but only when you sync history.

CrossWatch is a sync hub that presents sync results and recent activity in a dashboard. It is not intended to function as a full standalone tracker.

https://wiki.crosswatch.app

[JourneyOver]

Next time please use Discussions first

Yea sure will do. If you want we can close this issue thread and move it over to discussions if you want??

Do a full clear for your browser cache or try a different browser. Many of the issues you’re seeing seem cache related. Be sure to use a Chromium-compatible browser.

I did try on several different browsers some that hadn't even touched crosswatch and had no cache at all since they was completely fresh browsers and everything was still showing the same as my normal browser which is why I started up this issue thread since I was seeing the issues on multiple browsers.

Any ways, I did a overview maintenance run (idk how I missed the run button there before when I was trying to do maintenance stuff to see if I could get it fixed before opening up this whole thread), and at least for some initial testing it seems to have worked and corrected things, I still need to do some more testing though to confirm if it really is fixed and going to continue showing everything correctly.

FlickList is shown when there is saved/imported/synced state or manual policy data for it

Ah so I'd of needed to import data from flicklist itself to crosswatch? like I did for trakt (as I had trakt show up in the editor page) was just a little confused on the matter. Was thinking it was just pulling straight from the flicklist/trakt, since when I checked trakt in the editor page everything was always up to date even though I wasn't pulling in any new info from trakt to crosswatch and was only using scrobble events from crosswatch back to trakt after I did an initial import so I was thinking it was just being weird on why it didn't have any data from flicklist in the editor as well.. but good to know I guess.

---

To get things clear regarding the dashboard and outdated information:

Recent Scrobble is populated by watcher/webhook scrobble events. If Plex playback is routed to Trakt, FlickList, CrossWatch, etc., the completed watch should appear there.
Recent History is populated by history sync activity/state, not by live watcher playback events.
So a Plex -> CrossWatch watcher route will not make the Recent History widget update immediately. That activity belongs in Recent Scrobble.

I tested Plex -> CrossWatch and Recent Scrobble updates correctly after playback, so I can’t reproduce an outdated dashboard issue there.

Understood but I do need to note that both yesterday when this issue first started and also now with after running the maintenance on the overview and things seemingly working okay so far, it updated both recent history and recent scrobble at the same time (though yesterday it broke after the very first scrobble event to crosswatch as noted in my picture that I had shown) even though I am only doing a plex -> crosswatch watcher route and not a plex -> crosswatch sync pair for history.

anyways as noted above need to do some more testing but at least for now things seem to be working okay.. if they break again I'll report back with the info from /api/activity/history and /api/dashboard/widgets

CrossWatch is a sync hub that presents sync results and recent activity in a dashboard. It is not intended to function as a full standalone tracker.

I understand this already.

[cenodude]

I've converted it to a discussion. It's easier for me, because I want to keep issues and bug reports focused.

Good that those things seems corrected now. When was the last time you used CrossWatch before updating? If you were on a very old version and jumped straight to the latest one, I think that could have affected some things. Perhaps a version that was not yet database driven?

Ah so I'd of needed to import data from flicklist itself to crosswatch? like I did for trakt (as I had trakt show up in the editor page) was just a little confused on the matter. Was thinking it was just pulling straight from the flicklist/trakt, since when I checked trakt in the editor page everything was always up to date even though I wasn't pulling in any new info from trakt to crosswatch and was only using scrobble events from crosswatch back to trakt after I did an initial import so I was thinking it was just being weird on why it didn't have any data from flicklist in the editor as well.. but good to know I guess.

No import is needed, but it needs data. A sync should be enough. For example, a Plex to Flicklist history sync, watchlist sync, or any other feature should make the data show up in the Editor when you select the correct provider, profile and feature. If that is not the case, let me know. After each sync to editor should have the latest data from that sync.

Just to be complete: when you use the CrossWatch tracker as the scrobble sink, it behaves differently from external providers/trackers. If something is watched past the configured watched threshold (typically 90%) the CrossWatch sink automatically writes it as a history event in the local CrossWatch tracker. That means it becomes viewable in the editor under: CrossWatch - History

For other sinks, the finished watch is recorded as recent scrobble/activity, but it only shows in editor history after the relevant provider state is refreshed by sync/import.

Also let me know if your widgets are still acting strange, not loading properly or anything like that, or if the Editor is behaving oddly, for example if you need to refresh it multiple times before it works.

[cenodude]

Good. then i think we're good now. Roughly 6x faster on top of the earlier improvement and aprox 50x from the original failure.

[cenodude]

thanks for your time and testing

[JourneyOver]

It's not a problem at all, if I run into anymore problems with the widgets or anything I'll throw up a message in here!

[cenodude]

That would be perfect.. The thing is i dont have such large library as you have so this could really help tuning CrossWatch thats its more suitable for also larger data. Thanks again.

[JourneyOver]

The thing is i dont have such large library as you have so this could really help tuning CrossWatch thats its more suitable for also larger data. Thanks again.

If you ever need someone to test something out against a decent size library just shoot me a ping (can be in here or where ever) and I'll gladly help test something whenever I have some free time ^^ but yea it's not a problem :D