XMemTransfer Pythia-160M source memory (50M)

This repository contains a frozen Pythia-160M source-memory artifact used in the XMemTransfer cross-architecture experiments.

Project links

Files

  • memory.pt: source memory checkpoint
  • memory_best.pt: best checkpoint selected during source training
  • memory_config.json: hash and memory configuration
  • source_adaptor_best.pt: source-side adaptor checkpoint used with the source memory

Intended use

This artifact is meant to be paired with target-side adaptors from the XMemTransfer project for cross-model memory-transfer experiments.

Provenance

  • source model family: Pythia-160M
  • source corpus: WikiText
  • source token budget: 50M
  • canonicalization mode: vocab

Usage and limitations

These files are research artifacts for the XMemTransfer implementation, not standalone Transformers pipeline checkpoints. Follow the project code to construct the memory reader and load the checkpoint. Results depend on the paired backbone, source memory, data preprocessing, and configuration released with the model.

Citation

Please cite the XMemTransfer paper when using these artifacts.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OLAResearchX/xmemtransfer-pythia160m-source-50m

Finetuned
(345)
this model

Dataset used to train OLAResearchX/xmemtransfer-pythia160m-source-50m

Collection including OLAResearchX/xmemtransfer-pythia160m-source-50m

Paper for OLAResearchX/xmemtransfer-pythia160m-source-50m