RyanL22 commited on
Commit
487153d
路
verified 路
1 Parent(s): 4d50a2f

Add checkpoints

Browse files
README.md CHANGED
@@ -1,44 +1,12 @@
1
  ---
2
- pipeline_tag: robotics
3
- tags:
4
- - robotics
5
- - human-to-robot
6
- - video-generation
7
- - inverse-dynamics
8
  ---
9
-
10
  # RoboTryOn
11
 
12
- Checkpoints for **Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On**.
13
-
14
- [Project page](https://ryan-seungyong-lee.github.io/RoboTryOn) 路 [Code](https://github.com/ryan-seungyong-lee/RoboTryOn)
15
 
16
- | Folder | Model | Status |
17
  |---|---|---|
18
- | `image_fft/` | Keyframe translation, FLUX.2 [klein] 9B full fine-tune | coming soon |
19
- | `image_lora/` | Keyframe translation, FLUX.2 [klein] 9B LoRA | coming soon |
20
- | `video_lora/` | Video synthesis, LTX-2.5 in-context LoRA | coming soon |
21
- | `idm/` | Inverse dynamics model, shared by all embodiments | available |
22
-
23
- All models are trained on teleoperated episodes of OpenArm, RB-Y1 and GR-1.
24
-
25
- ## Usage
26
-
27
- ```bash
28
- huggingface-cli download RyanL22/RoboTryOn --local-dir ckpt
29
- python scripts/run_pipeline.py --config configs/pipeline.yaml ... \
30
- checkpoints.image=ckpt/image_fft checkpoints.video=ckpt/video_lora checkpoints.idm=ckpt/idm
31
- ```
32
-
33
- See the [code repository](https://github.com/ryan-seungyong-lee/RoboTryOn) for the full pipeline.
34
-
35
- ## Citation
36
-
37
- ```bibtex
38
- @article{lee2026robotryon,
39
- title={Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On},
40
- author={Lee, Seungyong and Jang, Suhyeok and Kim, Minyoung and Shin, Jinwoo},
41
- journal={arXiv preprint arXiv:XXXX.XXXXX},
42
- year={2026}
43
- }
44
- ```
 
1
  ---
2
+ license: other
3
+ tags: [robotics, image-to-image, video-generation]
 
 
 
 
4
  ---
 
5
  # RoboTryOn
6
 
7
+ Checkpoints for [RoboTryOn](https://github.com/ryan-seungyong-lee/RoboTryOn) ([paper](https://arxiv.org/abs/2611.05163)).
 
 
8
 
9
+ | Path | Model | Base |
10
  |---|---|---|
11
+ | `image/` | keyframe translation (LoRA + widened `x_embedder`) | [FLUX.2-klein-base-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B) |
12
+ | `video/` | video synthesis (in-context LoRA) | [LTX-2.5-Diffusers](https://huggingface.co/Lightricks/LTX-2.5-Diffusers) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
image/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bb698a8d529bd8312629262eefee357afefc5a4b77da8122bfbb0821664fe9b
3
+ size 444621672
image/x_embedder.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:148b3687593cfdf2a21969aaf0f8caebce87483c66883744c0d8e099492f46ae
3
+ size 8388704
video/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e277fc9d5c890a461a78c754d8075dbf29c2d05c04fa04461beea6af018f701
3
+ size 1308752560