Initiating a full scan on a large collection the scan crashes out after random amount of time/comics

[dgparryuk]

What happened?

5,000+ series and just short of 50,000 issues
it runs until it doesn't - and then starts to error until the kativa window is closed and restarted and scan re-ran
I had the same problem when I first set it up using the Comic Library and for a few reasons I decided to change over to ComicVine Library and it's doing it on that too.

What did you expect?

it not to crash

Kavita Version Number - If you don not see your version number listed, please update Kavita and see if your issue still persists.

0.8.4.2 - Stable

What operating system is Kavita being hosted from?

Windows

If the issue is being seen on Desktop, what OS are you running where you see the issue?

None

If the issue is being seen in the UI, what browsers are you seeing the problem on?

No response

If the issue is being seen on Mobile, what OS are you running where you see the issue?

None

If the issue is being seen on the Mobile UI, what browsers are you seeing the problem on?

No response

Relevant log output

[Kavita] [2025-01-29 12:08:28.140 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Processing cover image generation for series: Star Wars: Tales of the Jedi - The Golden Age of the Sith (1996)
[Kavita] [2025-01-29 12:08:28.141 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0000.cbz
[Kavita] [2025-01-29 12:08:28.180 +00:00  77] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP GET /api/stream/dashboard?visibleOnly=true responded 200 in 14.3085 ms
[Kavita] [2025-01-29 12:08:28.211 +00:00  77] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP POST /api/series/on-deck?libraryId=0&pageNumber=1&pageSize=20 responded 200 in 6.8623 ms
[Kavita] [2025-01-29 12:08:28.244 +00:00  77] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP POST /api/series/recently-added-v2?pageNumber=1&pageSize=20 responded 200 in 6.4879 ms
[Kavita] [2025-01-29 12:08:28.252 +00:00  87] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP GET /api/metadata/genres?context=4 responded 200 in 1.8324 ms
[Kavita] [2025-01-29 12:08:28.263 +00:00  44] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP POST /api/series/recently-updated-series responded 200 in 54.8132 ms
[Kavita] [2025-01-29 12:08:28.264 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0001.cbz
[Kavita] [2025-01-29 12:08:28.572 +00:00  87] [Information] Serilog.AspNetCore.RequestLoggingMiddleware HTTP GET /api/recommended/more-in?libraryId=0&genreId=2&pageNumber=0&pageSize=30 responded 200 in 6.8003 ms
[Kavita] [2025-01-29 12:08:28.577 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0002.cbz
[Kavita] [2025-01-29 12:08:28.888 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0003.cbz
[Kavita] [2025-01-29 12:08:29.189 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0004.cbz
[Kavita] [2025-01-29 12:08:29.599 +00:00  88] [Debug] API.Services.MetadataService [MetadataService] Generating cover image for D:/Comics/Comicvine/Star Wars - Tales of the Jedi - The Golden Age of the Sith (1996)/Star Wars - Tales of the Jedi - The Golden Age of the Sith #0005.cbz
[Kavita] [2025-01-29 12:08:30.437 +00:00  88] [Information] API.Services.MetadataService [MetadataService] Updated covers for Star Wars: Tales of the Jedi - The Golden Age of the Sith (1996) in 2296 milliseconds
[Kavita] [2025-01-29 12:08:30.437 +00:00  88] [Debug] API.Services.MetadataService Dispatching 8 update events
[Kavita] [2025-01-29 12:08:30.837 +00:00  88] [Information] API.Services.Tasks.Metadata.WordCountAnalyzerService [WordCountAnalyzerService] Updated metadata for Star Wars: Tales of the Jedi - The Golden Age of the Sith (1996) in 399 milliseconds
[Kavita] [2025-01-29 12:08:30.837 +00:00  88] [Debug] API.Services.Tasks.ScannerService [TIME] Kavita took 38339 ms to process Star Wars: Tales of the Jedi - The Golden Age of the Sith (1996)
[Kavita] [2025-01-29 12:08:30.838 +00:00  88] [Information] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Beginning series update on Army of Darkness (1992), Forced: false
[Kavita] [2025-01-29 12:08:30.839 +00:00  88] [Information] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Processing series Army of Darkness (1992) with 3 files
[Kavita] [2025-01-29 12:08:30.840 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Adding new chapter, Army of Darkness (1992) - Vol 1992 Ch 1
[Kavita] [2025-01-29 12:08:32.547 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 654 ms to process writer on Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0001 for 2 people
[Kavita] [2025-01-29 12:08:36.206 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 5161 ms to create/update Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0001
[Kavita] [2025-01-29 12:08:36.206 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Adding new chapter, Army of Darkness (1992) - Vol 1992 Ch 2
[Kavita] [2025-01-29 12:08:37.693 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 333 ms to process writer on Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0002 for 2 people
[Kavita] [2025-01-29 12:08:40.459 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 4163 ms to create/update Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0002
[Kavita] [2025-01-29 12:08:40.459 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Adding new chapter, Army of Darkness (1992) - Vol 1992 Ch 3
[Kavita] [2025-01-29 12:08:41.929 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 464 ms to process writer on Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0003 for 2 people
[Kavita] [2025-01-29 12:08:45.024 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [TIME] Kavita took 4441 ms to create/update Chapter: D:/Comics/Comicvine/Army of Darkness (1992)/Army of Darkness #0003
[Kavita] [2025-01-29 12:08:45.030 +00:00  88] [Information] API.Services.Tasks.Scanner.ProcessSeries Collection tag(s) found for Army of Darkness (1992), updating collections
[Kavita] [2025-01-29 12:08:45.033 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries Creating new collection tag for Evil Dead
[Kavita] [2025-01-29 12:08:45.217 +00:00  88] [Error] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] There was an exception updating series for Army of Darkness (1992)
Microsoft.EntityFrameworkCore.DbUpdateConcurrencyException: The database operation was expected to affect 1 row(s), but actually affected 0 row(s); data may have been modified or deleted since entities were loaded. See https://go.microsoft.com/fwlink/?LinkId=527962 for information on understanding and handling optimistic concurrency exceptions.
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ThrowAggregateUpdateConcurrencyExceptionAsync(RelationalDataReader reader, Int32 commandIndex, Int32 expectedRowsAffected, Int32 rowsAffected, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ConsumeResultSetWithRowsAffectedOnlyAsync(Int32 commandIndex, RelationalDataReader reader, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ConsumeAsync(RelationalDataReader reader, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1 entriesToSave, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManager stateManager, Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken)
   at API.Data.UnitOfWork.CommitAsync() in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Data\UnitOfWork.cs:line 118
   at API.Services.Tasks.Scanner.ProcessSeries.UpdateCollectionTags(Series series, Chapter firstChapter) in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Services\Tasks\Scanner\ProcessSeries.cs:line 444
   at API.Services.Tasks.Scanner.ProcessSeries.UpdateSeriesMetadata(Series series, Library library) in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Services\Tasks\Scanner\ProcessSeries.cs:line 318
   at API.Services.Tasks.Scanner.ProcessSeries.ProcessSeriesAsync(IList`1 parsedInfos, Library library, Int32 totalToProcess, Boolean forceUpdate) in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Services\Tasks\Scanner\ProcessSeries.cs:line 149
[Kavita] [2025-01-29 12:08:45.278 +00:00  88] [Debug] API.Services.Tasks.ScannerService [TIME] Kavita took 14439 ms to process Army of Darkness (1992)
[Kavita] [2025-01-29 12:08:45.278 +00:00  88] [Information] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Beginning series update on Demolition Man (1993), Forced: false
[Kavita] [2025-01-29 12:08:45.280 +00:00  88] [Information] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Processing series Demolition Man (1993) with 4 files
[Kavita] [2025-01-29 12:08:45.280 +00:00  88] [Debug] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] Adding new chapter, Demolition Man (1993) - Vol 1993 Ch 1
[Kavita] [2025-01-29 12:08:45.534 +00:00  88] [Error] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] There was an issue adding/updating a person
Microsoft.EntityFrameworkCore.DbUpdateConcurrencyException: The database operation was expected to affect 1 row(s), but actually affected 0 row(s); data may have been modified or deleted since entities were loaded. See https://go.microsoft.com/fwlink/?LinkId=527962 for information on understanding and handling optimistic concurrency exceptions.
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ThrowAggregateUpdateConcurrencyExceptionAsync(RelationalDataReader reader, Int32 commandIndex, Int32 expectedRowsAffected, Int32 rowsAffected, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ConsumeResultSetWithRowsAffectedOnlyAsync(Int32 commandIndex, RelationalDataReader reader, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.AffectedCountModificationCommandBatch.ConsumeAsync(RelationalDataReader reader, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1 entriesToSave, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManager stateManager, Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken)
   at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken)
   at API.Data.UnitOfWork.CommitAsync() in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Data\UnitOfWork.cs:line 118
   at API.Helpers.PersonHelper.UpdateChapterPeopleAsync(Chapter chapter, IList`1 people, PersonRole role, IUnitOfWork unitOfWork) in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Helpers\PersonHelper.cs:line 171
   at API.Services.Tasks.Scanner.ProcessSeries.UpdateChapterPeopleAsync(Chapter chapter, IList`1 people, PersonRole role) in C:\Users\josep\Documents\Projects\KavitaOrg\Kavita\API\Services\Tasks\Scanner\ProcessSeries.cs:line 1022
[Kavita] [2025-01-29 12:08:45.689 +00:00  88] [Error] API.Services.Tasks.Scanner.ProcessSeries [ScannerService] There was an issue adding/updating a person

Additional Notes

No response