Skip to content

Generalize loader batching logic to support effects - #505

Merged
DZakh merged 8 commits into
mainfrom
dz/load-layer-from-generated
Apr 15, 2025
Merged

Generalize loader batching logic to support effects#505
DZakh merged 8 commits into
mainfrom
dz/load-layer-from-generated

Conversation

@DZakh

@DZakh DZakh commented Apr 14, 2025

Copy link
Copy Markdown
Member

And move more code into npm package.

Currently there are no changes in the LoadLayer logic, besides the part

| (indexesToLoad, idsToLoad) =>
loadLayer
->executeLoadEntitiesById(~idsToLoad, ~batchQueue, ~inMemoryStore)
->Promise.then(_ =>
loadLayer->executeLoadEntitiesByIndex(~indexesToLoad, ~batchQueue, ~inMemoryStore)
)
now running in parallel.

@DZakh
DZakh requested a review from JonoPrest April 14, 2025 11:08
@DZakh DZakh changed the title Move more code from generated to npm package Generalize loader batching logic to support effects Apr 14, 2025
Comment on lines +101 to +106
Logging.setLogger(
~logStrategy,
~logFilePath,
~defaultFileLogLevel,
~userLogLevel,
)

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not pefect, but currently allows to move quite some code from generated

@JonoPrest

Copy link
Copy Markdown
Collaborator

Looks like tests are failing

@JonoPrest JonoPrest left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@DZakh
DZakh merged commit 8e8ec57 into main Apr 15, 2025
@DZakh
DZakh deleted the dz/load-layer-from-generated branch April 15, 2025 10:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants