Search results

ValueError: Invalid pattern: '**' can only be an entire path component

bugSomething isn't workingSomething isn't working

Status: Open.

#607 In CarperAI/trlx;

· amrzv opened on Jun 7, 2025

ImportError: cannot import name 'prepare_model_for_int8_training' from 'peft'

bugSomething isn't workingSomething isn't working

Status: Open.

#606 In CarperAI/trlx;

· amrzv opened on Apr 23, 2025

Extracting total-loss, PPO-loss, rewards per step, returns per step in RLHF-PPO implementation

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#605 In CarperAI/trlx;

· Ritam-M opened on Feb 17, 2025

Question about model load

Status: Open.

#604 In CarperAI/trlx;

· gray311 opened on Feb 11, 2025

Does the framework support PPO training for Qwen2?

feature requestNew feature or requestNew feature or request

Status: Open.

#603 In CarperAI/trlx;

· oldwangggggg opened on Dec 21, 2024

reward_fn in accelerate_ppo_trainer.py

Status: Open.

#602 In CarperAI/trlx;

· Jerrrrykun opened on Dec 11, 2024

OOM error with PEFT LoRA on Llama2-7B

bugSomething isn't workingSomething isn't working

Status: Open.

#601 In CarperAI/trlx;

· arpaiva opened on Sep 20, 2024

Load the checkpoint fails

bugSomething isn't workingSomething isn't working

Status: Open.

#600 In CarperAI/trlx;

· AfraAmini opened on Sep 6, 2024

cannot import name 'flatten_dataclass' from 'trlx.data.ilql_types'

bugSomething isn't workingSomething isn't working

Status: Open.

#599 In CarperAI/trlx;

· AfraAmini opened on Jul 31, 2024

maybe bug in prepare & load's order

bugSomething isn't workingSomething isn't working

Status: Open.

#598 In CarperAI/trlx;

· daiwk opened on Jul 27, 2024

Error when running Ray Tune to launch hyperparameter sweep

bugSomething isn't workingSomething isn't working

Status: Open.

#597 In CarperAI/trlx;

· Jing-L97 opened on Jul 26, 2024

Crash when using save_state with deepspeed: <code>model.state_dict</code> functions incompatible with new deepspeed.

bugSomething isn't workingSomething isn't working

Status: Open.

#596 In CarperAI/trlx;

· JohannesAck opened on Jul 11, 2024