yonlu/yellowjacket
1
1 Fork 0
Code Issues 61 Pull Requests 1 Actions Packages Projects Releases 13 Wiki Activity

The track list payload is ~800 bytes a track: repeated keys, per-track cover URLs, unread fields #281

New Issue
Open
opened 2026-10-06 02:40:28 +00:00 by yonlu · 1 comment
yonlu commented 2026-10-06 02:40:28 +00:00
Owner
Copy link
Copy source

GetTracks returns one JSON object per track with 25 keys: ~800 bytes per track, 20.5 MB at 26 138 tracks. Roughly:

  • ~350 B/track is key names repeated on every row;
  • four cover URLs (CoverArtPath/Small/Medium/Large) that are identical for every track of an album;
  • artist, album, genre, composer, file type and track length strings repeated per track (~10 tracks per album);
  • LastPlayed and the three larger cover tiers, which the Tracks view does not read (details come from the track cache).

Serializing it is ~170 MB of transient Go allocation (struct per row, reflection-driven marshal, then copies), and parsing it is the WebView's 390 MB peak.

Proposed

Replace GetTracks with a columnar, dictionary-encoded table: one array per column, every repeated string column an index into one shared string table, built straight from the rows without an intermediate []Track. The frontend decodes it once into the same row objects the Tracks view uses (shared strings, so the JS heap shrinks too). Only the columns the Tracks view can display, sort or link by are included.

A Go test pins bytes-per-track on the fixture library so a new column has to raise the budget on purpose.

`GetTracks` returns one JSON object per track with 25 keys: ~800 bytes per track, 20.5 MB at 26 138 tracks. Roughly: - ~350 B/track is **key names** repeated on every row; - four cover URLs (`CoverArtPath/Small/Medium/Large`) that are identical for every track of an album; - artist, album, genre, composer, file type and track length strings repeated per track (~10 tracks per album); - `LastPlayed` and the three larger cover tiers, which the Tracks view does not read (details come from the track cache). Serializing it is ~170 MB of transient Go allocation (struct per row, reflection-driven marshal, then copies), and parsing it is the WebView's 390 MB peak. ### Proposed Replace `GetTracks` with a columnar, dictionary-encoded table: one array per column, every repeated string column an index into one shared string table, built straight from the rows without an intermediate `[]Track`. The frontend decodes it once into the same row objects the Tracks view uses (shared strings, so the JS heap shrinks too). Only the columns the Tracks view can display, sort or link by are included. A Go test pins bytes-per-track on the fixture library so a new column has to raise the budget on purpose.
yonlu self-assigned this 2026-10-06 02:40:43 +00:00
yonlu added the
Status
In Progress
 label 2026-10-06 02:40:44 +00:00
yonlu commented 2026-10-06 02:40:44 +00:00
Author
Owner
Copy link
Copy source

Plan 023 (scoped library payloads), in order 279 → 281 → 280 → 282, then 283 and 284. Measured before/after with make perf against the bulk seed.

Plan 023 (scoped library payloads), in order 279 → 281 → 280 → 282, then 283 and 284. Measured before/after with make perf against the bulk seed.
Sign in to join this conversation.
No Branch/Tag Specified
Labels
Clear labels
Area/Design
Area/Downloads
Area/Explore
Area/Library-UI
Area/Metadata
Area/Packaging
Area/Player
Area/Queue
Area/Settings
Area/Shell-Nav
Compat/Breaking
Breaking change that won't be backward compatible
 Kind/Bug
Something is not working
 Kind/Documentation
Documentation changes
 Kind/Enhancement
Improve existing functionality
 Kind/Feature
New functionality
 Kind/Security
This is security issue
 Kind/Testing
Issue or pull request related to testing
 Platform/Android
Platform/Desktop
Priority
Critical
1
The priority is critical
Priority
High
2
The priority is high
Priority
Medium
3
The priority is medium
Priority
Low
4
The priority is low
Reviewed
Confirmed
1
Issue has been confirmed
Reviewed
Duplicate
2
This issue or pull request already exists
Reviewed
Invalid
3
Invalid issue
Reviewed
Won't Fix
3
This issue won't be fixed
Status
Blocked
1
Something is blocking this issue or pull request
Status
Need More Info
2
Feedback is required to reproduce issue or to continue work
Status
Abandoned
3
Somebody has started to work on this but abandoned work
Status
In Progress
Somebody is actively working on this right now
No labels Area/Library-UI Kind/Enhancement Platform/Android Platform/Desktop
Priority
High
2
Status
In Progress
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
logan yonlu
No Assignees yonlu
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: yonlu/yellowjacket#281