Skip to content

Conversation

@corbt
Copy link
Contributor

@corbt corbt commented Jan 19, 2026

Summary

Removes the TorchTune training backend and related experimental dev projects that are no longer actively maintained.

Changes

TorchTune Removal

  • Deleted src/art/torchtune/ directory (service, recipe, config, batch)
  • Deleted src/art/dev/torchtune.py (TorchtuneArgs, TorchtuneModel types)
  • Removed torchtune_args from InternalModelConfig
  • Removed TorchTune branching logic from LocalBackend._get_service()
  • Removed torchtune from dependencies

Dev Projects Removal

  • Deleted dev/tau-bench/ directory
  • Deleted dev/swebench/ directory
  • Removed sweagent from dependencies

Example Cleanup

  • Deleted examples/temporal_clue/temporal-clue-torchtune.ipynb

Rationale

As discussed in #514 and #450, TorchTune development has stagnated (last PyPI release was April 2025). The codebase will focus on:

  • Unsloth for single-node LoRA training
  • Megatron (future) for distributed full fine-tuning

Impact

  • 185 files deleted, ~937k lines removed
  • Training backends now: UnslothService, TinkerService
  • MegatronService to be added in future work

Closes #514
Relates to #450

Cursor Bot added 2 commits January 19, 2026 23:31
Removes:
- src/art/torchtune/ directory (service, recipe, config, batch)
- src/art/dev/torchtune.py (TorchtuneArgs, TorchtuneModel types)
- examples/temporal_clue/temporal-clue-torchtune.ipynb
- dev/tau-bench/run_training.py, run.ipynb
- dev/swebench/train.ipynb

Updates:
- src/art/dev/__init__.py: Remove TorchtuneArgs export
- src/art/dev/model.py: Remove torchtune_args from InternalModelConfig
- src/art/dev/get_model_config.py: Remove torchtune logic
- src/art/local/backend.py: Remove TorchtuneService branching
- pyproject.toml: Remove torchtune dependency
- uv.lock: Updated to remove torchtune

The codebase now supports Unsloth (LoRA) and Tinker services only.
Megatron support will be added in the future.
These experimental projects are no longer actively maintained and can be
recovered from git history if needed.
@corbt corbt merged commit 003bf38 into main Jan 20, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[RFC] Deprecate TorchTune service in favor of Unsloth/Megatron

2 participants