Repository navigation
[HWORKS-3465] Add Factories for Fine-Tuning, Deployment, Generic - #704
Open
jimdowling wants to merge 4 commits into
Open
jimdowling wants to merge 4 commits into
jimdowling wants to merge 4 commits into
Conversation
https://hopsworks.atlassian.net/browse/HWORKS-3465 The Factory had no way to fine-tune a foundation model, and the base environments had no fine-tuning or RL post-training stack. Add a built-in LLM fine-tuning (LoRA) factory, a single-host fine-tuning environment and a Ray RL post-training environment, move every Ray environment to Ray 2.59.0, and retire the Ray TensorFlow and TensorFlow training environments (environments cloned from them keep working). Working from the Terminal gets w9s, an overview of the project's factory systems, and the Factory chat stops getting out of step with the Terminal. Deployment and Generic factories follow. The docs list the new environments, drop the TensorFlow training environment, and update the configuration reference for the rl-post-training setting and the Ray version. Signed-off-by: Jim Dowling <jim@logicalclocks.com> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
jimdowling
marked this pull request as ready for review
October 23, 2026 15:24
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
JIRA: HWORKS-3465
Adds a built-in LLM fine-tuning (LoRA) factory, a single-host fine-tuning environment (
lora-fine-tuning-torch) and a Ray RL post-training environment (rl-post-training), moves every Ray environment to Ray 2.59.0, and retires the Ray TensorFlow and TensorFlow training environments (environments cloned from them keep working;tensorflow-inference-pipelinestays for TensorFlow Serving). The Terminal getsw9s, an overview of the project's factory systems, and the Factory chat no longer gets out of step with the Terminal. Deployment and Generic factories follow in a later change.Related PRs: docker-images, hopsworks-ee, hopsworks-helm, hopsworks-front, hopsworks-api, loadtest
Merge order: docker-images first (it publishes the images the backend and chart name), then hopsworks-ee, hopsworks-helm, hopsworks-front, hopsworks-api, docs, loadtest.
This PR
rl-post-trainingsetting and the Ray version.Testing
hopsworks-docs markdownlintand the stricthopsworks-docs checkbuild.Loadtests
Run on a dev cluster (5.3.0-SNAPSHOT, Ray on) with this backend, frontend and chart DML deployed, as in-cluster loadtest Jobs from loadtest#1188:
workflows/model_training(test_finetune_envs,test_traintorch and TensorFlow),test_factories(7),test_environment,test_ray_job_execution(4),test_proxy_terminal(2),test_terminal_proxy_token(3),test_proxy_raydashboard(7).*-5.3.0-SNAPSHOTparents (ray-training-pipeline,ray-torch-training-pipeline,rl-post-training,lora-fine-tuning-torch,tensorflow-inference-pipeline,terminal-server,terminal-gpu,terminal-spark): 14/14 passed, the image-dependent subset (workflows/model_training,test_environment,test_ray_job_execution, the two Terminal proxy modules).🤖 Generated with Claude Code