Hugging Face's logo

payelb
/
aligned_tinyllama_ultrafeedback_fixed1k_mars

Safetensors
trl
ppo
lora
alignment
reward-modeling
ultrafeedback
Model card Files
xet
 Community
aligned_tinyllama_ultrafeedback_fixed1k_mars / adapter_config.json

Commit History

Upload model
7cc6da3
verified

payelb commited on