Skip to content

add fondations for LLM#643

Merged
tharvik merged 8 commits intodevelopfrom
641-partial-merge-llm-tharvik
Mar 1, 2024
Merged

add fondations for LLM#643
tharvik merged 8 commits intodevelopfrom
641-partial-merge-llm-tharvik

Conversation

@tharvik
Copy link
Copy Markdown
Collaborator

@tharvik tharvik commented Feb 29, 2024

merging LLM (from #619) requires some reshaping of the code, here goes some changes splitted from the original PR.

  • add a Model abstracting away tensorflow specifics
    • still incomplete as it input/output tf.Tensors for now, and one can extract the tf.LayersModel
    • remove Task.training.modelCompileData as it's now contained inside the models.TFJS
  • add typesafe event emitter to safely register/call callbacks
  • rename Task.taskID to Task.id
  • while at it: drop unused training_functions, update axios, use async file read

@tharvik tharvik self-assigned this Feb 29, 2024
Base automatically changed from 638-no-reexport-tharvik to develop February 29, 2024 11:52
@tharvik tharvik force-pushed the 641-partial-merge-llm-tharvik branch from dd8a4f6 to cf5545b Compare February 29, 2024 12:06
@tharvik tharvik force-pushed the 641-partial-merge-llm-tharvik branch from cf5545b to bb51e16 Compare March 1, 2024 09:50
@tharvik tharvik force-pushed the 641-partial-merge-llm-tharvik branch from bb51e16 to 10be5f1 Compare March 1, 2024 10:16
@tharvik tharvik marked this pull request as ready for review March 1, 2024 10:26
@tharvik tharvik merged commit 8eede14 into develop Mar 1, 2024
@tharvik tharvik deleted the 641-partial-merge-llm-tharvik branch March 1, 2024 14:35
@JulienVig
Copy link
Copy Markdown
Collaborator

JulienVig commented Mar 4, 2024

For what it's worth very good stuff! I only left comments for what I didn't understand but it's a very nice refactoring

@tharvik tharvik mentioned this pull request Mar 5, 2024
@tharvik
Copy link
Copy Markdown
Collaborator Author

tharvik commented Mar 5, 2024

For what it's worth very good stuff! I only left comments for what I didn't understand but it's a very nice refactoring

héhé, thanks 😄

followup of fixes from your remarks #645

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants