Add checkpoints
Browse files
README.md
CHANGED
|
@@ -1,44 +1,12 @@
|
|
| 1 |
---
|
| 2 |
-
|
| 3 |
-
tags:
|
| 4 |
-
- robotics
|
| 5 |
-
- human-to-robot
|
| 6 |
-
- video-generation
|
| 7 |
-
- inverse-dynamics
|
| 8 |
---
|
| 9 |
-
|
| 10 |
# RoboTryOn
|
| 11 |
|
| 12 |
-
Checkpoints for
|
| 13 |
-
|
| 14 |
-
[Project page](https://ryan-seungyong-lee.github.io/RoboTryOn) 路 [Code](https://github.com/ryan-seungyong-lee/RoboTryOn)
|
| 15 |
|
| 16 |
-
|
|
| 17 |
|---|---|---|
|
| 18 |
-
| `
|
| 19 |
-
| `
|
| 20 |
-
| `video_lora/` | Video synthesis, LTX-2.5 in-context LoRA | coming soon |
|
| 21 |
-
| `idm/` | Inverse dynamics model, shared by all embodiments | available |
|
| 22 |
-
|
| 23 |
-
All models are trained on teleoperated episodes of OpenArm, RB-Y1 and GR-1.
|
| 24 |
-
|
| 25 |
-
## Usage
|
| 26 |
-
|
| 27 |
-
```bash
|
| 28 |
-
huggingface-cli download RyanL22/RoboTryOn --local-dir ckpt
|
| 29 |
-
python scripts/run_pipeline.py --config configs/pipeline.yaml ... \
|
| 30 |
-
checkpoints.image=ckpt/image_fft checkpoints.video=ckpt/video_lora checkpoints.idm=ckpt/idm
|
| 31 |
-
```
|
| 32 |
-
|
| 33 |
-
See the [code repository](https://github.com/ryan-seungyong-lee/RoboTryOn) for the full pipeline.
|
| 34 |
-
|
| 35 |
-
## Citation
|
| 36 |
-
|
| 37 |
-
```bibtex
|
| 38 |
-
@article{lee2026robotryon,
|
| 39 |
-
title={Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On},
|
| 40 |
-
author={Lee, Seungyong and Jang, Suhyeok and Kim, Minyoung and Shin, Jinwoo},
|
| 41 |
-
journal={arXiv preprint arXiv:XXXX.XXXXX},
|
| 42 |
-
year={2026}
|
| 43 |
-
}
|
| 44 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
+
license: other
|
| 3 |
+
tags: [robotics, image-to-image, video-generation]
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
|
|
|
| 5 |
# RoboTryOn
|
| 6 |
|
| 7 |
+
Checkpoints for [RoboTryOn](https://github.com/ryan-seungyong-lee/RoboTryOn) ([paper](https://arxiv.org/abs/2611.05163)).
|
|
|
|
|
|
|
| 8 |
|
| 9 |
+
| Path | Model | Base |
|
| 10 |
|---|---|---|
|
| 11 |
+
| `image/` | keyframe translation (LoRA + widened `x_embedder`) | [FLUX.2-klein-base-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B) |
|
| 12 |
+
| `video/` | video synthesis (in-context LoRA) | [LTX-2.5-Diffusers](https://huggingface.co/Lightricks/LTX-2.5-Diffusers) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
image/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5bb698a8d529bd8312629262eefee357afefc5a4b77da8122bfbb0821664fe9b
|
| 3 |
+
size 444621672
|
image/x_embedder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:148b3687593cfdf2a21969aaf0f8caebce87483c66883744c0d8e099492f46ae
|
| 3 |
+
size 8388704
|
video/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e277fc9d5c890a461a78c754d8075dbf29c2d05c04fa04461beea6af018f701
|
| 3 |
+
size 1308752560
|