nohup: ignoring input
Namespace(save_dir='/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg', self_attn_layer_to_quant='23 22 25 24 26', mlp_layer_to_quant='27 16 19 17 25', model_id='/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen/Qwen2.5-7B', cuda_id=6)
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:07<00:21,  7.18s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:14<00:14,  7.11s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:21<00:07,  7.04s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:27<00:00,  6.77s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:27<00:00,  6.89s/it]
Qwen2ForCausalLM(
  (model): Qwen2Model(
    (embed_tokens): Embedding(152064, 3584)
    (layers): ModuleList(
      (0-27): 28 x Qwen2DecoderLayer(
        (self_attn): Qwen2Attention(
          (q_proj): Linear(in_features=3584, out_features=3584, bias=True)
          (k_proj): Linear(in_features=3584, out_features=512, bias=True)
          (v_proj): Linear(in_features=3584, out_features=512, bias=True)
          (o_proj): Linear(in_features=3584, out_features=3584, bias=False)
        )
        (mlp): Qwen2MLP(
          (gate_proj): Linear(in_features=3584, out_features=18944, bias=False)
          (up_proj): Linear(in_features=3584, out_features=18944, bias=False)
          (down_proj): Linear(in_features=18944, out_features=3584, bias=False)
          (act_fn): SiLUActivation()
        )
        (input_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
        (post_attention_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
      )
    )
    (norm): Qwen2RMSNorm((3584,), eps=1e-06)
    (rotary_emb): Qwen2RotaryEmbedding()
  )
  (lm_head): Linear(in_features=3584, out_features=152064, bias=False)
)
Setting `pad_token_id` to `eos_token_id`:151643 for open-end generation.
Once upon a time, there was a girl named Alice, who was curious about the world around her. She was always eager to learn new things and explore new places. One day, she heard about a magical garden where flowers could talk and animals could dance. She decided to go there and see for herself.
As she entered the garden, she saw a group of flowers talking to each other. She listened intently and learned that they had a problem. One of the flowers was sick and needed medicine to get better.
quanting ... 
layers.0.self_attn 4 bit quant 
layers.0.mlp 4 bit quant 
layers.1.self_attn 4 bit quant 
layers.1.mlp 4 bit quant 
layers.2.self_attn 4 bit quant 
layers.2.mlp 4 bit quant 
layers.3.self_attn 4 bit quant 
layers.3.mlp 4 bit quant 
layers.4.self_attn 4 bit quant 
layers.4.mlp 4 bit quant 
layers.5.self_attn 4 bit quant 
layers.5.mlp 4 bit quant 
layers.6.self_attn 4 bit quant 
layers.6.mlp 4 bit quant 
layers.7.self_attn 4 bit quant 
layers.7.mlp 4 bit quant 
layers.8.self_attn 4 bit quant 
layers.8.mlp 4 bit quant 
layers.9.self_attn 4 bit quant 
layers.9.mlp 4 bit quant 
layers.10.self_attn 4 bit quant 
layers.10.mlp 4 bit quant 
layers.11.self_attn 4 bit quant 
layers.11.mlp 4 bit quant 
layers.12.self_attn 4 bit quant 
layers.12.mlp 4 bit quant 
layers.13.self_attn 4 bit quant 
layers.13.mlp 4 bit quant 
layers.14.self_attn 4 bit quant 
layers.14.mlp 4 bit quant 
layers.15.self_attn 4 bit quant 
layers.15.mlp 4 bit quant 
layers.16.self_attn 4 bit quant 
layers.16.mlp 2 bit quant 
layers.17.self_attn 4 bit quant 
layers.17.mlp 2 bit quant 
layers.18.self_attn 4 bit quant 
layers.18.mlp 4 bit quant 
layers.19.self_attn 4 bit quant 
layers.19.mlp 2 bit quant 
layers.20.self_attn 4 bit quant 
layers.20.mlp 4 bit quant 
layers.21.self_attn 4 bit quant 
layers.21.mlp 4 bit quant 
layers.22.self_attn 2 bit quant 
layers.22.mlp 4 bit quant 
layers.23.self_attn 2 bit quant 
layers.23.mlp 4 bit quant 
layers.24.self_attn 2 bit quant 
layers.24.mlp 4 bit quant 
layers.25.self_attn 2 bit quant 
layers.25.mlp 2 bit quant 
layers.26.self_attn 2 bit quant 
layers.26.mlp 4 bit quant 
layers.27.self_attn 4 bit quant 
layers.27.mlp 2 bit quant 
quanted
Qwen2ForCausalLM(
  (model): Qwen2Model(
    (embed_tokens): Embedding(152064, 3584)
    (layers): ModuleList(
      (0-27): 28 x Qwen2DecoderLayer(
        (self_attn): Qwen2Attention(
          (q_proj): W8A16Linear(3584, 3584, bias=True, weight_quant=per_channel)
          (k_proj): W8A16Linear(3584, 512, bias=True, weight_quant=per_channel)
          (v_proj): W8A16Linear(3584, 512, bias=True, weight_quant=per_channel)
          (o_proj): W8A16Linear(3584, 3584, bias=False, weight_quant=per_channel)
        )
        (mlp): Qwen2MLP(
          (gate_proj): W8A16Linear(3584, 18944, bias=False, weight_quant=per_channel)
          (up_proj): W8A16Linear(3584, 18944, bias=False, weight_quant=per_channel)
          (down_proj): W8A16Linear(18944, 3584, bias=False, weight_quant=per_channel)
          (act_fn): SiLUActivation()
        )
        (input_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
        (post_attention_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
      )
    )
    (norm): Qwen2RMSNorm((3584,), eps=1e-06)
    (rotary_emb): Qwen2RotaryEmbedding()
  )
  (lm_head): Linear(in_features=3584, out_features=152064, bias=False)
)
Setting `pad_token_id` to `eos_token_id`:151643 for open-end generation.
Once upon a time, in a not---- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - –-­­-­­ - - - - - - - - - - - - - -  _  _  \  :   1  .   2  : 2  1   2  .  0   S 

==================================================
开始评估：任务=winogrande | 少样本数=5 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/winogrande.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-06:15:45:36 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-06:15:45:36 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-06:15:45:36 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-06:15:45:36 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-06:15:45:36 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-06:15:45:36 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-06:15:45:37 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-06:15:45:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-06:15:45:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.03it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.24s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.05it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.28s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.11it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.58it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.35it/s]

Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.23s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.15it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.01s/it]
2025-12-06:15:45:57 WARNING  [evaluator:309] Overwriting default num_fewshot of winogrande from None to 5
2025-12-06:15:45:57 INFO     [api.task:434] Building contexts for winogrande on rank 1...

  0%|          | 0/633 [00:00<?, ?it/s]
100%|██████████| 633/633 [00:00<00:00, 25109.18it/s]
2025-12-06:15:46:08 WARNING  [evaluator:309] Overwriting default num_fewshot of winogrande from None to 5
2025-12-06:15:46:08 INFO     [api.task:434] Building contexts for winogrande on rank 0...

  0%|          | 0/634 [00:00<?, ?it/s]
100%|██████████| 634/634 [00:00<00:00, 26730.89it/s]
n136-128-154:1791018:1791018 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1791018:1791018 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1791018:1791018 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1791018:1791018 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1791018:1791018 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1791020:1791020 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1791020:1791020 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1791020:1791020 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1791020:1791020 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1791020:1791020 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1791018:1791806 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1791018:1791806 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1791020:1791807 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1791020:1791807 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1791018:1791806 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1791018:1791806 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1791018:1791806 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1791020:1791807 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1791020:1791807 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1791020:1791807 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1791020:1791807 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1791020:1791807 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1791020:1791807 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1791018:1791806 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1791018:1791806 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1791018:1791806 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1791020:1791807 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1791020:1791807 [1] NCCL INFO Using network IB
n136-128-154:1791018:1791806 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1791018:1791806 [0] NCCL INFO Using network IB
n136-128-154:1791020:1791807 [1] NCCL INFO ncclCommInitRankConfig comm 0xf0a51c0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x29335eaf64f1b6d4 - Init START
n136-128-154:1791018:1791806 [0] NCCL INFO ncclCommInitRankConfig comm 0xec12000 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x29335eaf64f1b6d4 - Init START
n136-128-154:1791018:1791806 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1791020:1791807 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1791020:1791807 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1791020:1791807 [1] NCCL INFO Retrieving state for IB
n136-128-154:1791020:1791807 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1791020:1791807 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1791020:1791807 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1791020:1791807 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1791020:1791807 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1791018:1791806 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1791018:1791806 [0] NCCL INFO Retrieving state for IB
n136-128-154:1791018:1791806 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1791018:1791806 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1791018:1791806 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1791018:1791806 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1791018:1791806 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1791018:1791806 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1791020:1791807 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1791018:1791806 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1791020:1791807 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1791018:1791806 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1791018:1791806 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1791018:1791806 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1791018:1791806 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1791018:1791806 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1791018:1791806 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1791018:1791806 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1791018:1791806 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1791018:1791806 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1791018:1791806 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1791018:1791806 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1791018:1791806 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1791018:1791806 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1791018:1791806 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1791018:1791806 [0] NCCL INFO ==========================================
n136-128-154:1791018:1791806 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1791018:1791806 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1791018:1791806 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1791020:1791807 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1791020:1791807 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1791020:1791807 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1791020:1791807 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1791020:1791807 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1791020:1791807 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1791020:1791807 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1791020:1791807 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1791020:1791807 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1791020:1791807 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1791020:1791807 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1791020:1791807 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1791020:1791807 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1791020:1791807 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1791020:1791807 [1] NCCL INFO ==========================================
n136-128-154:1791020:1791807 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1791020:1791807 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1791020:1791807 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1791018:1791806 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1791018:1791806 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1791018:1791806 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791018:1791806 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791018:1791806 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791018:1791806 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791018:1791806 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791018:1791806 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1791018:1791806 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1791020:1791807 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1791020:1791807 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791020:1791807 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1791018:1791806 [0] NCCL INFO comm 0xec12000 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1791020:1791807 [1] NCCL INFO comm 0xf0a51c0 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791020:1791807 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1791020:1791807 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1791020:1791807 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1791020:1791807 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1791018:1791806 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1791018:1791806 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1791020:1791807 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1791020:1791819 [1] NCCL INFO [Proxy Service] Device 1 CPU core 44
n136-128-154:1791020:1791820 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 109
n136-128-154:1791018:1791806 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1791018:1791806 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1791018:1791821 [0] NCCL INFO [Proxy Service] Device 0 CPU core 98
n136-128-154:1791018:1791822 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 100
n136-128-154:1791020:1791807 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1791020:1791807 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1791018:1791806 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1791018:1791806 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1791018:1791806 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1791020:1791807 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1791020:1791807 [1] NCCL INFO ncclCommInitRankConfig comm 0xf0a51c0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x29335eaf64f1b6d4 - Init COMPLETE
n136-128-154:1791020:1791807 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.51 (kernels 0.21, alloc 0.20, bootstrap 0.00, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:1791018:1791806 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1791018:1791806 [0] NCCL INFO ncclCommInitRankConfig comm 0xec12000 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x29335eaf64f1b6d4 - Init COMPLETE
n136-128-154:1791018:1791806 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.51 (kernels 0.22, alloc 0.20, bootstrap 0.00, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791020:1791823 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1791018:1791824 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1791020:1791823 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-06:15:46:09 INFO     [evaluator:559] Running loglikelihood requests
2025-12-06:15:46:09 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/1268 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/1268 [00:05<2:00:42,  5.72s/it]
Running loglikelihood requests:   5%|▌         | 65/1268 [00:06<01:31, 13.16it/s] 
Running loglikelihood requests:  10%|█         | 129/1268 [00:07<00:45, 25.14it/s]
Running loglikelihood requests:  15%|█▌        | 193/1268 [00:08<00:30, 35.82it/s]
Running loglikelihood requests:  20%|██        | 257/1268 [00:09<00:22, 44.82it/s]
Running loglikelihood requests:  25%|██▌       | 321/1268 [00:10<00:18, 52.28it/s]
Running loglikelihood requests:  30%|███       | 385/1268 [00:11<00:15, 58.10it/s]
Running loglikelihood requests:  35%|███▌      | 449/1268 [00:11<00:13, 62.66it/s]
Running loglikelihood requests:  40%|████      | 513/1268 [00:12<00:11, 65.86it/s]
Running loglikelihood requests:  46%|████▌     | 577/1268 [00:13<00:10, 68.25it/s]
Running loglikelihood requests:  51%|█████     | 641/1268 [00:14<00:08, 70.65it/s]
Running loglikelihood requests:  56%|█████▌    | 705/1268 [00:15<00:07, 72.40it/s]
Running loglikelihood requests:  61%|██████    | 769/1268 [00:16<00:06, 73.66it/s]
Running loglikelihood requests:  66%|██████▌   | 833/1268 [00:16<00:05, 74.69it/s]
Running loglikelihood requests:  71%|███████   | 897/1268 [00:17<00:05, 73.91it/s]
Running loglikelihood requests:  76%|███████▌  | 961/1268 [00:18<00:04, 73.71it/s]
Running loglikelihood requests:  81%|████████  | 1025/1268 [00:19<00:03, 74.15it/s]
Running loglikelihood requests:  86%|████████▌ | 1089/1268 [00:20<00:02, 75.99it/s]
Running loglikelihood requests:  91%|█████████ | 1153/1268 [00:21<00:01, 77.23it/s]
Running loglikelihood requests:  96%|█████████▌| 1217/1268 [00:21<00:00, 80.57it/s]
Running loglikelihood requests: 100%|██████████| 1268/1268 [00:21<00:00, 58.00it/s]
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1791020:1791915 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1791020:1791819 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-06:15:46:42 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto (64)
|  Tasks   |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|----------|------:|------|-----:|------|---|-----:|---|-----:|
|winogrande|      1|none  |     5|acc   |↑  |0.5588|±  | 0.014|

[rank0]:[W1206 15:46:42.102750030 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1791018:1791821 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1791018:1792101 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1791020:1791819 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1791020:1791920 [1] NCCL INFO comm 0xf0a51c0 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1791018:1792101 [0] NCCL INFO comm 0xec12000 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 winogrande 评估完成！

==================================================
开始评估：任务=gsm8k | 少样本数=4 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/gsm8k.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-06:15:48:07 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-06:15:48:07 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-06:15:48:07 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-06:15:48:07 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-06:15:48:07 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-06:15:48:07 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-06:15:48:09 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-06:15:48:09 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-06:15:48:09 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.07s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.03s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.24s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.29s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.29s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.31s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.07it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.09it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.03s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.05s/it]

2025-12-06:15:48:32 INFO     [evaluator:290] gsm8k: Using gen_kwargs: {'until': ['Question:', '</s>', '<|im_end|>'], 'do_sample': False, 'temperature': 0.0}
2025-12-06:15:48:32 WARNING  [evaluator:309] Overwriting default num_fewshot of gsm8k from 5 to 4
2025-12-06:15:48:32 INFO     [api.task:434] Building contexts for gsm8k on rank 1...

  0%|          | 0/659 [00:00<?, ?it/s]
  6%|▋         | 42/659 [00:00<00:01, 411.16it/s]
 13%|█▎        | 84/659 [00:00<00:01, 414.71it/s]
 19%|█▉        | 126/659 [00:00<00:01, 414.58it/s]
 25%|██▌       | 168/659 [00:00<00:01, 412.59it/s]
 32%|███▏      | 210/659 [00:00<00:01, 401.68it/s]
 38%|███▊      | 251/659 [00:00<00:01, 400.00it/s]
 44%|████▍     | 293/659 [00:00<00:00, 404.94it/s]
 51%|█████     | 335/659 [00:00<00:00, 407.93it/s]
 57%|█████▋    | 377/659 [00:00<00:00, 410.55it/s]
 64%|██████▎   | 419/659 [00:01<00:00, 412.69it/s]
 70%|██████▉   | 461/659 [00:01<00:00, 410.46it/s]
 76%|███████▋  | 503/659 [00:01<00:00, 411.81it/s]
 83%|████████▎ | 545/659 [00:01<00:00, 413.32it/s]
 89%|████████▉ | 587/659 [00:01<00:00, 414.42it/s]
 95%|█████████▌| 629/659 [00:01<00:00, 413.16it/s]
100%|██████████| 659/659 [00:01<00:00, 410.85it/s]
2025-12-06:15:48:35 INFO     [evaluator:290] gsm8k: Using gen_kwargs: {'until': ['Question:', '</s>', '<|im_end|>'], 'do_sample': False, 'temperature': 0.0}
2025-12-06:15:48:35 WARNING  [evaluator:309] Overwriting default num_fewshot of gsm8k from 5 to 4
2025-12-06:15:48:35 INFO     [api.task:434] Building contexts for gsm8k on rank 0...

  0%|          | 0/660 [00:00<?, ?it/s]
  6%|▋         | 42/660 [00:00<00:01, 409.52it/s]
 13%|█▎        | 83/660 [00:00<00:01, 407.83it/s]
 19%|█▉        | 125/660 [00:00<00:01, 412.65it/s]
 25%|██▌       | 167/660 [00:00<00:01, 415.20it/s]
 32%|███▏      | 210/660 [00:00<00:01, 417.53it/s]
 38%|███▊      | 252/660 [00:00<00:00, 418.35it/s]
 45%|████▍     | 295/660 [00:00<00:00, 418.97it/s]
 51%|█████     | 337/660 [00:00<00:00, 418.90it/s]
 57%|█████▋    | 379/660 [00:00<00:00, 414.36it/s]
 64%|██████▍   | 422/660 [00:01<00:00, 416.60it/s]
 70%|███████   | 464/660 [00:01<00:00, 416.52it/s]
 77%|███████▋  | 507/660 [00:01<00:00, 417.89it/s]
 83%|████████▎ | 549/660 [00:01<00:00, 416.92it/s]
 90%|████████▉ | 591/660 [00:01<00:00, 415.57it/s]
 96%|█████████▌| 633/660 [00:01<00:00, 414.99it/s]
100%|██████████| 660/660 [00:01<00:00, 415.55it/s]
n136-128-154:1792223:1792223 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1792223:1792223 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1792223:1792223 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1792223:1792223 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1792223:1792223 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1792224:1792224 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1792224:1792224 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1792224:1792224 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1792224:1792224 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1792224:1792224 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1792224:1792659 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1792223:1792658 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1792224:1792659 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1792223:1792658 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1792223:1792658 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1792223:1792658 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1792224:1792659 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1792224:1792659 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1792223:1792658 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1792224:1792659 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1792223:1792658 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1792223:1792658 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1792223:1792658 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1792224:1792659 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1792224:1792659 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1792224:1792659 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1792223:1792658 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1792223:1792658 [0] NCCL INFO Using network IB
n136-128-154:1792224:1792659 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1792224:1792659 [1] NCCL INFO Using network IB
n136-128-154:1792224:1792659 [1] NCCL INFO ncclCommInitRankConfig comm 0x10b76070 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x380a53995dbc77d1 - Init START
n136-128-154:1792223:1792658 [0] NCCL INFO ncclCommInitRankConfig comm 0xf8345c0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x380a53995dbc77d1 - Init START
n136-128-154:1792224:1792659 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1792223:1792658 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1792224:1792659 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1792224:1792659 [1] NCCL INFO Retrieving state for IB
n136-128-154:1792224:1792659 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1792224:1792659 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1792223:1792658 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1792223:1792658 [0] NCCL INFO Retrieving state for IB
n136-128-154:1792223:1792658 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1792224:1792659 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1792223:1792658 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1792224:1792659 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1792223:1792658 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1792224:1792659 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1792223:1792658 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1792223:1792658 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1792224:1792659 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1792224:1792659 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1792223:1792658 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1792223:1792658 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1792223:1792658 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1792223:1792658 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1792223:1792658 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1792223:1792658 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1792223:1792658 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1792223:1792658 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1792223:1792658 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1792223:1792658 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1792223:1792658 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1792223:1792658 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1792223:1792658 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1792223:1792658 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1792223:1792658 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1792223:1792658 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1792223:1792658 [0] NCCL INFO ==========================================
n136-128-154:1792223:1792658 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1792223:1792658 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1792223:1792658 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1792224:1792659 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1792224:1792659 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1792224:1792659 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1792224:1792659 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1792224:1792659 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1792224:1792659 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1792224:1792659 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1792224:1792659 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1792224:1792659 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1792224:1792659 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1792224:1792659 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1792224:1792659 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1792224:1792659 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1792224:1792659 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1792224:1792659 [1] NCCL INFO ==========================================
n136-128-154:1792224:1792659 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1792224:1792659 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1792224:1792659 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1792223:1792658 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1792223:1792658 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1792223:1792658 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792223:1792658 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1792224:1792659 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1792224:1792659 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1792224:1792659 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792224:1792659 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1792223:1792658 [0] NCCL INFO comm 0xf8345c0 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1792224:1792659 [1] NCCL INFO comm 0x10b76070 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1792223:1792658 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1792223:1792658 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1792223:1792658 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1792224:1792659 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1792224:1792659 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1792224:1792659 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1792223:1792658 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1792223:1792658 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1792223:1792673 [0] NCCL INFO [Proxy Service] Device 0 CPU core 99
n136-128-154:1792223:1792674 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 36
n136-128-154:1792224:1792659 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1792224:1792675 [1] NCCL INFO [Proxy Service] Device 1 CPU core 108
n136-128-154:1792224:1792676 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 45
n136-128-154:1792223:1792658 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1792223:1792658 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1792223:1792658 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1792224:1792659 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1792224:1792659 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1792223:1792658 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1792223:1792658 [0] NCCL INFO ncclCommInitRankConfig comm 0xf8345c0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x380a53995dbc77d1 - Init COMPLETE
n136-128-154:1792223:1792658 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.57 (kernels 0.24, alloc 0.21, bootstrap 0.00, allgathers 0.01, topo 0.07, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:1792224:1792659 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1792224:1792659 [1] NCCL INFO ncclCommInitRankConfig comm 0x10b76070 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x380a53995dbc77d1 - Init COMPLETE
n136-128-154:1792224:1792659 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.56 (kernels 0.24, alloc 0.21, bootstrap 0.00, allgathers 0.01, topo 0.07, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1792224:1792677 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792223:1792678 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1792224:1792677 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-06:15:48:37 INFO     [evaluator:559] Running generate_until requests
2025-12-06:15:48:37 INFO     [evaluator:559] Running generate_until requests
Passed argument batch_size = auto. Detecting largest batch size

Running generate_until requests:   0%|          | 0/660 [00:00<?, ?it/s]Passed argument batch_size = auto. Detecting largest batch size
Determined Largest batch size: 1
Determined Largest batch size: 1
Both `max_new_tokens` (=2048) and `max_length`(=1578) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1605) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 1/660 [02:46<30:25:20, 166.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1567) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1554) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 2/660 [03:34<17:44:53, 97.10s/it] Both `max_new_tokens` (=2048) and `max_length`(=1557) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1539) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 3/660 [04:24<13:44:04, 75.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1519) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1536) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 4/660 [05:13<11:50:58, 65.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1508) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1484) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 5/660 [06:02<10:47:46, 59.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1494) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1483) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 6/660 [06:51<10:07:41, 55.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1480) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1459) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 7/660 [07:39<9:39:39, 53.26s/it] Both `max_new_tokens` (=2048) and `max_length`(=1468) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1456) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 8/660 [08:28<9:23:36, 51.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1459) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1446) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|▏         | 9/660 [09:16<9:10:03, 50.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1451) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1440) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 10/660 [10:05<9:01:14, 49.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1435) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1440) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 11/660 [10:52<8:53:48, 49.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1431) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1431) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 12/660 [11:41<8:50:31, 49.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=1429) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1427) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 13/660 [12:30<8:48:01, 48.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1393) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1423) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 14/660 [13:20<8:50:52, 49.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1387) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1410) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 15/660 [14:10<8:52:16, 49.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1386) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1398) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 16/660 [14:58<8:47:33, 49.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1397) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 17/660 [15:47<8:44:24, 48.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1379) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1396) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 18/660 [16:34<8:40:05, 48.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1377) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1384) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 19/660 [17:24<8:41:31, 48.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1377) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 20/660 [18:13<8:43:37, 49.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1372) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 21/660 [19:03<8:44:52, 49.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1365) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1373) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 22/660 [19:53<8:45:42, 49.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1365) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1357) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 23/660 [20:41<8:39:56, 48.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1353) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1353) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▎         | 24/660 [21:00<7:04:08, 40.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1352) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1352) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 25/660 [21:49<7:33:06, 42.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1342) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1351) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 26/660 [22:38<7:50:52, 44.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1341) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1349) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 27/660 [23:27<8:05:27, 46.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1340) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1338) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 28/660 [24:16<8:11:32, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1337) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1329) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 29/660 [25:03<8:13:54, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1323) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1328) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 30/660 [25:51<8:15:30, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1322) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1327) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 31/660 [26:39<8:16:50, 47.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=1321) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1322) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 32/660 [27:27<8:17:55, 47.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1318) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1318) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 33/660 [28:14<8:15:46, 47.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 34/660 [29:02<8:17:19, 47.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1313) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 35/660 [29:50<8:17:12, 47.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1313) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 36/660 [30:38<8:18:25, 47.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1312) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 37/660 [31:27<8:18:37, 48.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1306) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1310) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 38/660 [32:14<8:16:11, 47.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1303) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1307) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 39/660 [33:03<8:17:41, 48.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1300) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1306) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 40/660 [33:50<8:15:05, 47.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1297) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1302) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 41/660 [34:39<8:15:44, 48.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1297) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1298) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▋         | 42/660 [35:26<8:14:21, 48.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=1296) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1295) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 43/660 [36:16<8:18:25, 48.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1293) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1292) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 44/660 [37:06<8:21:40, 48.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1290) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1290) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 45/660 [37:54<8:19:29, 48.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1282) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 46/660 [37:59<6:02:15, 35.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1278) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1289) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 47/660 [38:48<6:46:04, 39.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1277) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1288) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 48/660 [39:38<7:16:42, 42.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1274) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1282) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 49/660 [40:30<7:42:20, 45.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1275) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 50/660 [41:20<7:54:49, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1269) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1273) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 51/660 [42:09<8:00:56, 47.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1269) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 52/660 [42:59<8:09:02, 48.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1265) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 53/660 [43:49<8:14:27, 48.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1264) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1268) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 54/660 [44:37<8:09:41, 48.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=1262) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1267) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 55/660 [45:25<8:07:31, 48.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1258) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1256) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 56/660 [46:14<8:09:08, 48.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1257) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▊         | 57/660 [47:04<8:12:30, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1256) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 58/660 [47:54<8:15:23, 49.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1254) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 59/660 [48:43<8:12:42, 49.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1252) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 60/660 [49:33<8:13:33, 49.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1249) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 61/660 [50:25<8:22:15, 50.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1246) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 62/660 [51:16<8:22:15, 50.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1250) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 63/660 [52:04<8:16:07, 49.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1247) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1247) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 64/660 [52:55<8:18:10, 50.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1246) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 65/660 [53:43<8:11:35, 49.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 66/660 [54:32<8:07:03, 49.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1239) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1243) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 67/660 [55:19<8:01:19, 48.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1238) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 68/660 [56:08<8:00:26, 48.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 69/660 [56:56<7:59:04, 48.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1234) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1239) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 70/660 [57:45<7:58:12, 48.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1238) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 71/660 [58:33<7:55:53, 48.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 72/660 [59:21<7:52:53, 48.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 73/660 [1:00:09<7:51:55, 48.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1231) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1235) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 74/660 [1:00:58<7:51:50, 48.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1235) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█▏        | 75/660 [1:01:47<7:55:07, 48.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1234) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 76/660 [1:02:37<7:56:20, 48.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1225) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 77/660 [1:03:25<7:54:36, 48.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1225) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1230) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 78/660 [1:04:15<7:55:03, 48.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1224) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1229) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 79/660 [1:05:03<7:53:41, 48.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 80/660 [1:05:53<7:53:21, 48.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1226) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 81/660 [1:06:42<7:55:10, 49.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1222) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 82/660 [1:07:35<8:05:23, 50.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=1222) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 83/660 [1:08:24<7:59:13, 49.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 84/660 [1:09:13<7:55:19, 49.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1218) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1220) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 85/660 [1:10:03<7:55:15, 49.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1217) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1218) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 86/660 [1:10:52<7:53:09, 49.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1215) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 87/660 [1:11:42<7:53:56, 49.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 88/660 [1:12:30<7:50:22, 49.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 89/660 [1:13:21<7:52:49, 49.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1213) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▎        | 90/660 [1:14:12<7:55:11, 50.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1211) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 91/660 [1:15:00<7:50:09, 49.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1206) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 92/660 [1:15:51<7:51:30, 49.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1205) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 93/660 [1:16:42<7:54:58, 50.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1205) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 94/660 [1:17:31<7:51:05, 49.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1204) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1206) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 95/660 [1:18:19<7:45:10, 49.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 96/660 [1:19:08<7:41:50, 49.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 97/660 [1:19:57<7:40:23, 49.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 98/660 [1:20:45<7:38:39, 48.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 99/660 [1:21:34<7:36:53, 48.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 100/660 [1:22:23<7:36:12, 48.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1201) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 101/660 [1:23:12<7:34:37, 48.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1198) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 102/660 [1:24:01<7:35:16, 48.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1198) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 103/660 [1:24:50<7:35:25, 49.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 104/660 [1:25:39<7:34:38, 49.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1196) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1194) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 105/660 [1:26:28<7:33:21, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1196) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 106/660 [1:27:17<7:31:06, 48.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1195) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 107/660 [1:28:06<7:31:30, 48.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▋        | 108/660 [1:28:55<7:30:54, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 109/660 [1:29:43<7:27:43, 48.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 110/660 [1:30:31<7:23:41, 48.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 111/660 [1:31:20<7:24:41, 48.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1190) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 112/660 [1:32:09<7:25:11, 48.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1190) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1187) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 113/660 [1:32:58<7:26:38, 48.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1189) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1186) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 114/660 [1:33:47<7:25:25, 48.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1188) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 115/660 [1:34:37<7:26:20, 49.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1187) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 116/660 [1:35:25<7:24:05, 48.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1186) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 117/660 [1:36:14<7:21:33, 48.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 118/660 [1:37:02<7:18:36, 48.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 119/660 [1:37:50<7:17:50, 48.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 120/660 [1:38:38<7:15:38, 48.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 121/660 [1:39:27<7:16:07, 48.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 122/660 [1:40:17<7:17:13, 48.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1179) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▊        | 123/660 [1:41:06<7:18:37, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1179) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 124/660 [1:41:55<7:16:08, 48.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 125/660 [1:42:43<7:15:42, 48.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 126/660 [1:43:32<7:13:34, 48.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1177) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 127/660 [1:44:20<7:11:03, 48.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 128/660 [1:45:07<7:07:32, 48.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1180) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 129/660 [1:45:56<7:08:05, 48.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 130/660 [1:46:44<7:07:09, 48.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1175) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 131/660 [1:47:33<7:05:52, 48.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1174) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 132/660 [1:48:21<7:05:53, 48.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1174) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 133/660 [1:49:10<7:05:40, 48.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 134/660 [1:49:59<7:05:41, 48.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1171) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 135/660 [1:50:48<7:05:51, 48.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 136/660 [1:51:37<7:06:52, 48.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1169) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 137/660 [1:52:26<7:06:09, 48.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1169) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 138/660 [1:53:16<7:08:10, 49.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1168) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1167) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 139/660 [1:54:05<7:07:33, 49.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1168) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1166) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 140/660 [1:54:54<7:05:01, 49.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1167) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1166) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██▏       | 141/660 [1:55:43<7:04:08, 49.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1165) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1164) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 142/660 [1:56:32<7:03:56, 49.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1165) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1162) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 143/660 [1:57:22<7:04:21, 49.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1164) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 144/660 [1:58:13<7:09:03, 49.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1163) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 145/660 [1:59:01<7:04:36, 49.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1163) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1160) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 146/660 [1:59:51<7:02:42, 49.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1162) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 147/660 [2:00:41<7:04:17, 49.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 148/660 [2:01:31<7:03:53, 49.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1158) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 149/660 [2:02:19<7:00:18, 49.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1157) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 150/660 [2:03:08<6:58:10, 49.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 151/660 [2:03:57<6:56:35, 49.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1157) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 152/660 [2:04:48<7:00:20, 49.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=1156) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 153/660 [2:05:38<7:01:26, 49.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1156) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1152) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 154/660 [2:06:28<7:00:11, 49.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1155) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1152) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 155/660 [2:07:17<6:58:12, 49.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1155) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▎       | 156/660 [2:08:07<6:57:24, 49.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 157/660 [2:08:56<6:55:23, 49.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 158/660 [2:09:45<6:52:59, 49.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 159/660 [2:10:37<6:58:07, 50.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 160/660 [2:11:29<7:02:29, 50.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 161/660 [2:12:19<6:58:37, 50.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 162/660 [2:13:08<6:54:18, 49.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 163/660 [2:13:55<6:48:21, 49.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 164/660 [2:14:44<6:45:51, 49.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 165/660 [2:15:32<6:42:22, 48.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 166/660 [2:16:21<6:41:08, 48.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 167/660 [2:17:09<6:38:27, 48.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1147) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 168/660 [2:17:56<6:34:30, 48.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1147) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 169/660 [2:18:44<6:34:55, 48.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 170/660 [2:19:32<6:31:48, 47.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 171/660 [2:20:21<6:33:06, 48.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 172/660 [2:21:08<6:30:37, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 173/660 [2:21:56<6:30:06, 48.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1145) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▋       | 174/660 [2:22:44<6:28:43, 47.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 175/660 [2:23:32<6:28:50, 48.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 176/660 [2:24:21<6:28:14, 48.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 177/660 [2:25:09<6:27:34, 48.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1142) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 178/660 [2:25:58<6:29:08, 48.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 179/660 [2:26:46<6:27:46, 48.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 180/660 [2:27:33<6:24:25, 48.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1138) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 181/660 [2:28:21<6:22:38, 47.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1137) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 182/660 [2:29:09<6:21:56, 47.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1137) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 183/660 [2:29:57<6:22:17, 48.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 184/660 [2:30:47<6:23:57, 48.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 185/660 [2:31:39<6:32:25, 49.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 186/660 [2:32:29<6:33:09, 49.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 187/660 [2:33:19<6:31:42, 49.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 188/660 [2:34:10<6:34:16, 50.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▊       | 189/660 [2:35:01<6:35:11, 50.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1132) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1133) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 190/660 [2:35:50<6:31:37, 49.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1133) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 191/660 [2:36:38<6:27:11, 49.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 192/660 [2:37:26<6:22:25, 49.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 193/660 [2:38:14<6:17:55, 48.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 194/660 [2:39:01<6:14:28, 48.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 195/660 [2:39:49<6:12:32, 48.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 196/660 [2:40:36<6:10:39, 47.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 197/660 [2:41:25<6:10:56, 48.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1126) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1128) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 198/660 [2:42:12<6:09:24, 47.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1126) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1128) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 199/660 [2:43:00<6:07:37, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 200/660 [2:43:48<6:06:21, 47.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 201/660 [2:44:35<6:04:38, 47.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 202/660 [2:45:23<6:03:41, 47.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 203/660 [2:46:10<6:02:30, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1123) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 204/660 [2:46:58<6:01:35, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1123) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 205/660 [2:47:45<6:00:47, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 206/660 [2:48:33<5:59:51, 47.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███▏      | 207/660 [2:49:20<5:59:15, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 208/660 [2:50:08<5:58:26, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 209/660 [2:50:55<5:57:21, 47.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1118) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 210/660 [2:51:43<5:56:44, 47.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 211/660 [2:52:30<5:55:35, 47.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 212/660 [2:53:18<5:54:38, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1115) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 213/660 [2:54:05<5:53:57, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 214/660 [2:54:53<5:53:05, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1115) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 215/660 [2:55:40<5:52:19, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 216/660 [2:56:28<5:51:16, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 217/660 [2:57:15<5:50:46, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 218/660 [2:58:03<5:50:50, 47.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1111) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 219/660 [2:58:52<5:53:07, 48.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1111) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 220/660 [2:59:42<5:56:45, 48.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1109) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 221/660 [3:00:29<5:51:45, 48.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1110) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▎      | 222/660 [3:01:16<5:48:03, 47.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1110) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 223/660 [3:02:04<5:48:38, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 224/660 [3:02:53<5:49:48, 48.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 225/660 [3:03:40<5:45:45, 47.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 226/660 [3:04:26<5:42:42, 47.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1107) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 227/660 [3:05:13<5:39:55, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1107) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 228/660 [3:06:00<5:39:35, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 229/660 [3:06:48<5:40:28, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 230/660 [3:07:35<5:38:37, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 231/660 [3:08:22<5:36:33, 47.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1102) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 232/660 [3:09:11<5:40:36, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 233/660 [3:10:01<5:44:36, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 234/660 [3:10:48<5:41:24, 48.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1100) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 235/660 [3:11:37<5:42:08, 48.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1100) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 236/660 [3:12:26<5:42:32, 48.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 237/660 [3:13:13<5:38:19, 47.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 238/660 [3:14:00<5:35:36, 47.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 239/660 [3:14:47<5:33:18, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▋      | 240/660 [3:15:34<5:31:20, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 241/660 [3:16:21<5:29:49, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 242/660 [3:17:07<5:27:56, 47.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 243/660 [3:17:55<5:27:33, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 244/660 [3:18:42<5:26:28, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 245/660 [3:19:29<5:25:39, 47.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 246/660 [3:20:16<5:24:50, 47.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 247/660 [3:21:03<5:23:21, 46.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 248/660 [3:21:50<5:22:41, 46.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 249/660 [3:22:37<5:21:46, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 250/660 [3:23:23<5:20:47, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 251/660 [3:24:10<5:20:09, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1092) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 252/660 [3:24:57<5:18:55, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 253/660 [3:25:44<5:18:14, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 254/660 [3:26:32<5:18:38, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▊      | 255/660 [3:27:19<5:19:00, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 256/660 [3:28:07<5:18:14, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 257/660 [3:28:53<5:16:47, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 258/660 [3:29:41<5:15:46, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 259/660 [3:30:27<5:14:03, 46.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 260/660 [3:31:14<5:13:04, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 261/660 [3:32:03<5:15:13, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 262/660 [3:32:53<5:20:38, 48.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1085) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 263/660 [3:33:40<5:17:51, 48.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1084) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 264/660 [3:34:28<5:16:29, 47.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1084) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 265/660 [3:35:17<5:18:18, 48.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1083) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 266/660 [3:36:06<5:17:10, 48.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 267/660 [3:36:53<5:14:35, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1085) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 268/660 [3:37:41<5:13:15, 47.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 269/660 [3:38:31<5:16:08, 48.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 270/660 [3:39:20<5:16:37, 48.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 271/660 [3:40:07<5:13:38, 48.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 272/660 [3:40:55<5:10:37, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1081) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████▏     | 273/660 [3:41:42<5:07:53, 47.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 274/660 [3:42:28<5:04:54, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 275/660 [3:43:15<5:02:39, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 276/660 [3:44:02<5:01:24, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1075) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 277/660 [3:44:48<4:59:49, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 278/660 [3:45:35<4:58:23, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 279/660 [3:46:22<4:57:11, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 280/660 [3:47:08<4:56:08, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 281/660 [3:47:55<4:56:01, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 282/660 [3:48:42<4:54:56, 46.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 283/660 [3:49:29<4:54:18, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 284/660 [3:50:16<4:53:56, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 285/660 [3:51:03<4:52:43, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 286/660 [3:51:50<4:51:39, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 287/660 [3:52:38<4:54:55, 47.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▎     | 288/660 [3:53:25<4:52:37, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 289/660 [3:54:12<4:51:22, 47.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 290/660 [3:54:59<4:49:57, 47.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 291/660 [3:55:46<4:48:52, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 292/660 [3:56:33<4:48:02, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 293/660 [3:57:19<4:46:53, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 294/660 [3:58:06<4:45:54, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 295/660 [3:58:53<4:45:33, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 296/660 [3:59:40<4:44:37, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 297/660 [4:00:27<4:43:27, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 298/660 [4:01:14<4:42:36, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 299/660 [4:02:00<4:41:45, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 300/660 [4:02:48<4:41:24, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 301/660 [4:03:34<4:40:35, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 302/660 [4:04:21<4:39:16, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 303/660 [4:05:08<4:38:23, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 304/660 [4:05:55<4:38:00, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 305/660 [4:06:42<4:37:17, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▋     | 306/660 [4:07:29<4:36:35, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 307/660 [4:08:15<4:35:39, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 308/660 [4:09:02<4:34:31, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 309/660 [4:09:49<4:33:54, 46.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 310/660 [4:10:36<4:33:03, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 311/660 [4:10:44<3:24:16, 35.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 312/660 [4:11:31<3:44:24, 38.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 313/660 [4:11:50<3:09:47, 32.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 314/660 [4:12:37<3:33:35, 37.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 315/660 [4:13:23<3:49:33, 39.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 316/660 [4:14:10<4:00:34, 41.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 317/660 [4:14:58<4:10:39, 43.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 318/660 [4:15:46<4:16:45, 45.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 319/660 [4:16:33<4:19:19, 45.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 320/660 [4:17:20<4:20:05, 45.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▊     | 321/660 [4:18:08<4:23:19, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 322/660 [4:18:57<4:27:24, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 323/660 [4:19:45<4:26:42, 47.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 324/660 [4:20:32<4:26:03, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 325/660 [4:21:20<4:24:59, 47.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 326/660 [4:22:08<4:24:56, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 327/660 [4:22:58<4:28:42, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 328/660 [4:23:47<4:28:16, 48.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 329/660 [4:24:35<4:26:31, 48.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 330/660 [4:25:24<4:26:57, 48.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 331/660 [4:26:11<4:24:36, 48.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 332/660 [4:26:58<4:22:13, 47.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 333/660 [4:27:48<4:24:02, 48.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 334/660 [4:28:39<4:26:38, 49.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 335/660 [4:29:25<4:22:03, 48.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 336/660 [4:30:12<4:18:49, 47.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 337/660 [4:30:59<4:16:25, 47.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 338/660 [4:31:46<4:14:37, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████▏    | 339/660 [4:32:33<4:13:14, 47.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 340/660 [4:33:20<4:11:49, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 341/660 [4:34:07<4:10:39, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 342/660 [4:34:54<4:09:45, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 343/660 [4:35:41<4:08:36, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 344/660 [4:36:28<4:07:34, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 345/660 [4:37:15<4:06:37, 46.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 346/660 [4:38:02<4:05:42, 46.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 347/660 [4:38:49<4:04:52, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 348/660 [4:39:36<4:03:47, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 349/660 [4:40:23<4:03:31, 46.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 350/660 [4:41:10<4:02:57, 47.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1046) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 351/660 [4:41:56<4:01:36, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 352/660 [4:42:44<4:01:20, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 353/660 [4:43:30<4:00:09, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▎    | 354/660 [4:44:17<3:58:41, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 355/660 [4:45:03<3:57:10, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 356/660 [4:45:50<3:56:06, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 357/660 [4:46:36<3:55:00, 46.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 358/660 [4:47:22<3:53:49, 46.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1046) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 359/660 [4:48:10<3:54:17, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1045) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 360/660 [4:49:00<3:59:14, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1045) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 361/660 [4:49:48<3:58:01, 47.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 362/660 [4:50:35<3:56:16, 47.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 363/660 [4:51:24<3:57:49, 48.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 364/660 [4:52:13<3:58:28, 48.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 365/660 [4:53:00<3:56:04, 48.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 366/660 [4:53:48<3:54:00, 47.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 367/660 [4:54:35<3:52:34, 47.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 368/660 [4:55:22<3:51:00, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 369/660 [4:56:09<3:49:54, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 370/660 [4:56:56<3:48:54, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 371/660 [4:57:44<3:47:45, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▋    | 372/660 [4:58:31<3:46:59, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 373/660 [4:59:18<3:45:51, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1039) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 374/660 [5:00:05<3:45:05, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1039) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 375/660 [5:00:53<3:44:41, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 376/660 [5:01:40<3:43:46, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 377/660 [5:02:27<3:43:16, 47.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1038) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 378/660 [5:03:14<3:42:10, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 379/660 [5:04:02<3:41:26, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 380/660 [5:04:49<3:40:39, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 381/660 [5:05:36<3:39:44, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 382/660 [5:06:23<3:38:56, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 383/660 [5:07:11<3:38:06, 47.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 384/660 [5:07:58<3:37:47, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 385/660 [5:08:46<3:37:01, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 386/660 [5:09:33<3:35:53, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1032) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▊    | 387/660 [5:10:20<3:35:05, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=1032) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 388/660 [5:11:07<3:34:07, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 389/660 [5:11:54<3:33:22, 47.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 390/660 [5:12:42<3:32:30, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 391/660 [5:13:29<3:31:36, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 392/660 [5:14:16<3:31:02, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1028) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1033) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 393/660 [5:15:03<3:30:02, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 394/660 [5:15:50<3:29:09, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 395/660 [5:16:38<3:28:34, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 396/660 [5:17:25<3:27:30, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 397/660 [5:18:12<3:27:05, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 398/660 [5:18:59<3:26:00, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 399/660 [5:19:46<3:25:17, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 400/660 [5:20:34<3:24:39, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1028) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 401/660 [5:21:21<3:23:39, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 402/660 [5:22:08<3:22:59, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 403/660 [5:22:55<3:22:10, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 404/660 [5:23:42<3:21:18, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████▏   | 405/660 [5:24:30<3:20:40, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 406/660 [5:25:17<3:20:06, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1023) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 407/660 [5:26:04<3:19:32, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 408/660 [5:26:52<3:18:50, 47.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1023) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 409/660 [5:27:39<3:17:53, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 410/660 [5:28:27<3:17:38, 47.43s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 411/660 [5:29:15<3:17:28, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 412/660 [5:30:02<3:16:24, 47.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 413/660 [5:30:50<3:15:41, 47.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 414/660 [5:31:37<3:14:24, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 415/660 [5:31:43<2:22:46, 34.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 416/660 [5:32:32<2:39:33, 39.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 417/660 [5:33:20<2:49:41, 41.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 418/660 [5:34:07<2:55:24, 43.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 419/660 [5:34:55<2:59:25, 44.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▎   | 420/660 [5:35:44<3:03:43, 45.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 421/660 [5:36:33<3:06:45, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 422/660 [5:37:19<3:05:55, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 423/660 [5:38:06<3:05:10, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 424/660 [5:38:53<3:04:25, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 425/660 [5:39:41<3:04:10, 47.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 426/660 [5:40:31<3:06:57, 47.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 427/660 [5:41:21<3:09:14, 48.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1013) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 428/660 [5:42:10<3:08:36, 48.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 429/660 [5:43:00<3:09:08, 49.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 430/660 [5:43:50<3:09:37, 49.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 431/660 [5:44:38<3:06:40, 48.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 432/660 [5:45:27<3:06:15, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1013) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 433/660 [5:46:17<3:06:07, 49.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 434/660 [5:47:04<3:02:26, 48.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 435/660 [5:47:50<2:59:38, 47.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 436/660 [5:48:37<2:57:27, 47.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 437/660 [5:49:24<2:55:46, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▋   | 438/660 [5:50:10<2:54:04, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 439/660 [5:50:57<2:52:46, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 440/660 [5:51:43<2:51:37, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1008) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1008) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 441/660 [5:52:30<2:50:35, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1007) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1007) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 442/660 [5:53:17<2:49:52, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 443/660 [5:54:03<2:48:47, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 444/660 [5:54:50<2:47:54, 46.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 445/660 [5:55:36<2:47:05, 46.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 446/660 [5:56:23<2:46:12, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 447/660 [5:57:09<2:45:27, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 448/660 [5:57:56<2:44:39, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 449/660 [5:58:43<2:44:03, 46.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 450/660 [5:59:29<2:43:08, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 451/660 [6:00:17<2:43:01, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 452/660 [6:01:04<2:43:15, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▊   | 453/660 [6:01:51<2:41:38, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=995) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 454/660 [6:02:37<2:40:26, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 455/660 [6:03:23<2:39:16, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1001) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 456/660 [6:04:10<2:38:21, 46.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1001) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 457/660 [6:04:56<2:37:17, 46.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=1000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 458/660 [6:05:46<2:39:30, 47.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 459/660 [6:06:35<2:41:14, 48.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=992) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 460/660 [6:07:23<2:40:06, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=992) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 461/660 [6:08:11<2:39:20, 48.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=991) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 462/660 [6:09:01<2:40:12, 48.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 463/660 [6:09:49<2:39:08, 48.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 464/660 [6:10:37<2:37:28, 48.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 465/660 [6:11:24<2:35:37, 47.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 466/660 [6:12:11<2:34:13, 47.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 467/660 [6:12:59<2:33:04, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=995) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 468/660 [6:13:46<2:32:05, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 469/660 [6:14:34<2:31:18, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 470/660 [6:15:22<2:30:55, 47.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████▏  | 471/660 [6:16:09<2:29:53, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=985) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 472/660 [6:16:56<2:28:40, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 473/660 [6:17:43<2:27:34, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 474/660 [6:18:31<2:26:54, 47.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 475/660 [6:19:18<2:25:56, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 476/660 [6:20:05<2:25:03, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=988) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 477/660 [6:20:52<2:24:09, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=988) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 478/660 [6:21:40<2:23:20, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 479/660 [6:22:27<2:22:41, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 480/660 [6:23:14<2:21:47, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 481/660 [6:24:01<2:20:52, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=981) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 482/660 [6:24:49<2:20:05, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 483/660 [6:25:36<2:19:19, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=980) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 484/660 [6:26:23<2:18:30, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 485/660 [6:27:10<2:17:40, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▎  | 486/660 [6:27:57<2:16:44, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 487/660 [6:28:44<2:16:03, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 488/660 [6:29:31<2:15:06, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 489/660 [6:30:19<2:14:25, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 490/660 [6:31:06<2:13:39, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 491/660 [6:31:53<2:12:49, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 492/660 [6:32:40<2:12:05, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 493/660 [6:33:27<2:11:13, 47.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 494/660 [6:34:14<2:10:27, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 495/660 [6:35:02<2:09:39, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=972) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 496/660 [6:35:49<2:08:56, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=972) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 497/660 [6:36:36<2:08:10, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 498/660 [6:37:23<2:07:22, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 499/660 [6:38:10<2:06:42, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 500/660 [6:38:58<2:05:54, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 501/660 [6:39:45<2:05:11, 47.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 502/660 [6:40:33<2:04:43, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 503/660 [6:41:20<2:04:06, 47.43s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▋  | 504/660 [6:42:08<2:03:29, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=968) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 505/660 [6:42:55<2:02:35, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 506/660 [6:43:43<2:02:08, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 507/660 [6:44:31<2:01:52, 47.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 508/660 [6:45:19<2:01:16, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 509/660 [6:46:06<1:59:29, 47.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 510/660 [6:46:53<1:58:24, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 511/660 [6:47:42<1:59:06, 47.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 512/660 [6:48:31<1:58:41, 48.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 513/660 [6:49:17<1:56:39, 47.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 514/660 [6:50:04<1:55:09, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 515/660 [6:50:51<1:53:45, 47.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 516/660 [6:51:39<1:54:12, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 517/660 [6:52:29<1:54:44, 48.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 518/660 [6:53:15<1:52:33, 47.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▊  | 519/660 [6:54:02<1:51:30, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=964) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 520/660 [6:54:50<1:51:14, 47.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=964) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 521/660 [6:55:37<1:49:56, 47.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 522/660 [6:56:25<1:49:10, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 523/660 [6:57:15<1:50:00, 48.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 524/660 [6:58:03<1:49:00, 48.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 525/660 [6:58:49<1:47:11, 47.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 526/660 [6:59:36<1:45:34, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 527/660 [7:00:22<1:44:22, 47.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 528/660 [7:01:09<1:43:07, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 529/660 [7:01:55<1:42:06, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 530/660 [7:02:42<1:41:15, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 531/660 [7:03:28<1:40:22, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 532/660 [7:04:15<1:39:38, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 533/660 [7:05:02<1:38:46, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 534/660 [7:05:48<1:38:04, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 535/660 [7:06:35<1:37:19, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 536/660 [7:07:22<1:36:27, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████▏ | 537/660 [7:08:09<1:35:50, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 538/660 [7:08:55<1:35:04, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 539/660 [7:09:42<1:34:17, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=951) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 540/660 [7:10:29<1:33:27, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 541/660 [7:11:15<1:32:33, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 542/660 [7:12:03<1:32:16, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 543/660 [7:12:50<1:31:41, 47.02s/it]Both `max_new_tokens` (=2048) and `max_length`(=951) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 544/660 [7:13:37<1:30:50, 46.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 545/660 [7:14:24<1:29:54, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 546/660 [7:15:11<1:29:02, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 547/660 [7:15:57<1:28:11, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 548/660 [7:16:44<1:27:21, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 549/660 [7:17:32<1:27:19, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 550/660 [7:18:22<1:28:07, 48.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 551/660 [7:19:09<1:26:28, 47.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▎ | 552/660 [7:19:57<1:26:03, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 553/660 [7:20:46<1:26:03, 48.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 554/660 [7:21:33<1:24:27, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 555/660 [7:22:20<1:23:06, 47.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 556/660 [7:23:06<1:21:45, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=942) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 557/660 [7:23:53<1:20:42, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=943) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 558/660 [7:24:40<1:19:44, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=942) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 559/660 [7:25:26<1:18:45, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 560/660 [7:26:13<1:17:56, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 561/660 [7:27:00<1:17:08, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=938) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 562/660 [7:27:46<1:16:19, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=939) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 563/660 [7:28:33<1:15:34, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=937) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 564/660 [7:29:20<1:14:43, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 565/660 [7:30:06<1:13:59, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=932) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 566/660 [7:30:53<1:13:12, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 567/660 [7:31:40<1:12:26, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 568/660 [7:32:27<1:11:36, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 569/660 [7:33:13<1:10:46, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▋ | 570/660 [7:34:00<1:09:59, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 571/660 [7:34:46<1:09:08, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=934) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 572/660 [7:35:33<1:08:22, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=934) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 573/660 [7:36:19<1:07:31, 46.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=933) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 574/660 [7:37:06<1:06:44, 46.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 575/660 [7:37:52<1:05:55, 46.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 576/660 [7:38:39<1:05:12, 46.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 577/660 [7:39:26<1:04:28, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 578/660 [7:40:12<1:03:39, 46.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 579/660 [7:40:59<1:02:57, 46.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=920) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 580/660 [7:41:48<1:03:04, 47.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=919) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 581/660 [7:42:35<1:02:17, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=924) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 582/660 [7:43:23<1:01:34, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=922) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 583/660 [7:44:10<1:00:42, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=922) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 584/660 [7:44:57<59:56, 47.33s/it]  Both `max_new_tokens` (=2048) and `max_length`(=911) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▊ | 585/660 [7:45:45<59:10, 47.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=919) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 586/660 [7:46:32<58:23, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=908) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=918) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 587/660 [7:47:19<57:39, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=907) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=917) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 588/660 [7:48:07<56:52, 47.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=905) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=916) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 589/660 [7:48:54<56:06, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=903) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 590/660 [7:49:42<55:21, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 591/660 [7:50:29<54:27, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 592/660 [7:51:16<53:43, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 593/660 [7:52:04<52:56, 47.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=912) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 594/660 [7:52:54<52:52, 48.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=912) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 595/660 [7:53:43<52:31, 48.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 596/660 [7:54:31<51:26, 48.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 597/660 [7:55:18<50:30, 48.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 598/660 [7:56:08<50:09, 48.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 599/660 [7:56:57<49:38, 48.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 600/660 [7:57:45<48:27, 48.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=909) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 601/660 [7:58:32<47:15, 48.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=909) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 602/660 [7:59:19<46:12, 47.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=905) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████▏| 603/660 [8:00:09<45:48, 48.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=895) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=903) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 604/660 [8:00:59<45:29, 48.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=894) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 605/660 [8:01:45<44:07, 48.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=893) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 606/660 [8:02:33<43:08, 47.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 607/660 [8:03:22<42:46, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 608/660 [8:04:11<41:56, 48.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 609/660 [8:04:58<40:51, 48.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=891) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 610/660 [8:05:47<40:23, 48.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=890) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 611/660 [8:06:36<39:32, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=889) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 612/660 [8:07:22<38:16, 47.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=887) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 613/660 [8:08:09<37:13, 47.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=886) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 614/660 [8:08:55<36:11, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=886) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 615/660 [8:09:42<35:15, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 616/660 [8:10:28<34:20, 46.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=891) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 617/660 [8:11:15<33:28, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=890) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▎| 618/660 [8:12:03<33:05, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=882) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 619/660 [8:12:50<32:14, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=881) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 620/660 [8:13:37<31:24, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=879) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 621/660 [8:14:24<30:33, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=879) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 622/660 [8:15:11<29:42, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=877) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=882) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 623/660 [8:15:58<28:54, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=875) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=880) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 624/660 [8:16:44<28:07, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=873) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=878) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 625/660 [8:17:31<27:20, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=872) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=878) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 626/660 [8:18:18<26:32, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=871) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=876) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 627/660 [8:19:05<25:45, 46.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=874) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 628/660 [8:19:52<24:59, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=865) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=872) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 629/660 [8:20:39<24:19, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=863) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 630/660 [8:21:27<23:36, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=861) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 631/660 [8:22:14<22:48, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=856) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=869) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 632/660 [8:23:01<21:57, 47.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=868) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 633/660 [8:23:48<21:10, 47.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=863) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 634/660 [8:24:35<20:21, 47.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=854) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=862) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 635/660 [8:25:22<19:36, 47.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=853) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=860) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▋| 636/660 [8:26:11<19:05, 47.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=853) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=857) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 637/660 [8:27:01<18:33, 48.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=846) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 638/660 [8:27:48<17:33, 47.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=844) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=848) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 639/660 [8:28:36<16:47, 48.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=843) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=847) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 640/660 [8:29:24<16:01, 48.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=842) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=846) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 641/660 [8:30:11<15:04, 47.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=837) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=845) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 642/660 [8:30:57<14:10, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=836) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=844) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 643/660 [8:31:44<13:21, 47.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=834) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=843) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 644/660 [8:32:31<12:31, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=825) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 645/660 [8:33:17<11:41, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=824) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=842) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 646/660 [8:34:04<10:55, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=823) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=841) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 647/660 [8:34:51<10:07, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=820) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=841) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 648/660 [8:35:37<09:20, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=817) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 649/660 [8:35:38<06:00, 32.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=817) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=835) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 650/660 [8:36:24<06:09, 36.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=816) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=834) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▊| 651/660 [8:37:11<05:59, 39.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=812) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=832) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 652/660 [8:37:58<05:35, 41.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=802) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=831) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 653/660 [8:38:44<05:03, 43.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=800) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=830) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 654/660 [8:39:31<04:26, 44.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=794) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=826) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 655/660 [8:40:18<03:44, 45.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=794) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=822) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 656/660 [8:41:05<03:02, 45.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=792) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=813) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 657/660 [8:41:52<02:18, 46.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=781) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=812) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 658/660 [8:42:39<01:32, 46.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=760) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=809) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 659/660 [8:43:25<00:46, 46.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=699) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=808) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|██████████| 660/660 [8:44:12<00:00, 46.46s/it]
Running generate_until requests: 100%|██████████| 660/660 [8:44:12<00:00, 47.66s/it]
Both `max_new_tokens` (=2048) and `max_length`(=800) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=799) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=796) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=792) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=680) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1792224:1860544 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1792224:1792675 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:00:37:11 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 4, batch_size: auto
|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|     4|exact_match|↑  |0.0038|±  |0.0017|
|     |       |strict-match    |     4|exact_match|↑  |0.0000|±  |0.0000|

[rank0]:[W1207 00:37:12.466506526 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1792223:1792673 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1792223:1860601 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1792224:1792675 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1792224:1860550 [1] NCCL INFO comm 0x10b76070 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1792223:1860601 [0] NCCL INFO comm 0xf8345c0 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 gsm8k 评估完成！

==================================================
开始评估：任务=boolq | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/boolq.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-07:00:38:37 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-07:00:38:37 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-07:00:38:37 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:38:37 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:38:37 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:38:37 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:38:38 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:38:39 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:38:39 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.29s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.29s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.32s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.32s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.21s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.22s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.19it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.19it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.00it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.00it/s]
2025-12-07:00:38:43 WARNING  [api.task:844] [Task: boolq] metric acc is defined, but aggregation is not. using default aggregation=mean
2025-12-07:00:38:43 WARNING  [api.task:856] [Task: boolq] metric acc is defined, but higher_is_better is not. using default higher_is_better=True
2025-12-07:00:38:43 WARNING  [api.task:844] [Task: boolq] metric acc is defined, but aggregation is not. using default aggregation=mean
2025-12-07:00:38:43 WARNING  [api.task:856] [Task: boolq] metric acc is defined, but higher_is_better is not. using default higher_is_better=True
2025-12-07:00:39:02 WARNING  [evaluator:309] Overwriting default num_fewshot of boolq from None to 0
2025-12-07:00:39:02 INFO     [api.task:434] Building contexts for boolq on rank 0...

  0%|          | 0/1635 [00:00<?, ?it/s]
 17%|█▋        | 277/1635 [00:00<00:00, 2766.69it/s]
 34%|███▍      | 555/1635 [00:00<00:00, 2770.94it/s]
 51%|█████     | 836/1635 [00:00<00:00, 2785.96it/s]
 68%|██████▊   | 1118/1635 [00:00<00:00, 2796.54it/s]
 86%|████████▌ | 1398/1635 [00:00<00:00, 2795.70it/s]
100%|██████████| 1635/1635 [00:00<00:00, 2792.40it/s]
n136-128-154:1860653:1860653 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1860653:1860653 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1860653:1860653 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1860653:1860653 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1860653:1860653 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1860653:1860854 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1860653:1860854 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1860653:1860854 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1860653:1860854 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1860653:1860854 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1860653:1860854 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1860653:1860854 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1860653:1860854 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1860653:1860854 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1860653:1860854 [0] NCCL INFO Using network IB
n136-128-154:1860653:1860854 [0] NCCL INFO ncclCommInitRankConfig comm 0xfdcd020 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x724ed52b33f18117 - Init START
2025-12-07:00:39:03 WARNING  [evaluator:309] Overwriting default num_fewshot of boolq from None to 0
2025-12-07:00:39:03 INFO     [api.task:434] Building contexts for boolq on rank 1...

  0%|          | 0/1635 [00:00<?, ?it/s]
 17%|█▋        | 279/1635 [00:00<00:00, 2784.27it/s]
 34%|███▍      | 561/1635 [00:00<00:00, 2801.56it/s]
 51%|█████▏    | 842/1635 [00:00<00:00, 2782.60it/s]
 69%|██████▊   | 1122/1635 [00:00<00:00, 2787.29it/s]
 86%|████████▌ | 1402/1635 [00:00<00:00, 2789.36it/s]
100%|██████████| 1635/1635 [00:00<00:00, 2795.03it/s]
n136-128-154:1860654:1860654 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1860654:1860654 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1860654:1860654 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1860654:1860654 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1860654:1860654 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1860654:1860868 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1860654:1860868 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1860654:1860868 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1860654:1860868 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1860654:1860868 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1860654:1860868 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1860654:1860868 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1860654:1860868 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1860654:1860868 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1860654:1860868 [1] NCCL INFO Using network IB
n136-128-154:1860654:1860868 [1] NCCL INFO ncclCommInitRankConfig comm 0xe916fa0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x724ed52b33f18117 - Init START
n136-128-154:1860654:1860868 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1860653:1860854 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1860654:1860868 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1860654:1860868 [1] NCCL INFO Retrieving state for IB
n136-128-154:1860654:1860868 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1860654:1860868 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1860654:1860868 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1860653:1860854 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1860653:1860854 [0] NCCL INFO Retrieving state for IB
n136-128-154:1860653:1860854 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1860654:1860868 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1860653:1860854 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1860654:1860868 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1860653:1860854 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1860653:1860854 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1860653:1860854 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1860654:1860868 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1860653:1860854 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1860654:1860868 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1860653:1860854 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1860653:1860854 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1860653:1860854 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1860653:1860854 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1860653:1860854 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1860653:1860854 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1860653:1860854 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1860653:1860854 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1860653:1860854 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1860653:1860854 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1860653:1860854 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1860653:1860854 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1860653:1860854 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1860653:1860854 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1860653:1860854 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1860653:1860854 [0] NCCL INFO ==========================================
n136-128-154:1860653:1860854 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1860653:1860854 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1860653:1860854 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1860654:1860868 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1860654:1860868 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1860654:1860868 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1860654:1860868 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1860654:1860868 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1860654:1860868 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1860654:1860868 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1860654:1860868 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1860654:1860868 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1860654:1860868 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1860654:1860868 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1860654:1860868 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1860654:1860868 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1860654:1860868 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1860654:1860868 [1] NCCL INFO ==========================================
n136-128-154:1860654:1860868 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1860654:1860868 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1860654:1860868 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1860653:1860854 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1860653:1860854 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1860653:1860854 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860653:1860854 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1860654:1860868 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1860654:1860868 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1860654:1860868 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860654:1860868 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1860653:1860854 [0] NCCL INFO comm 0xfdcd020 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1860654:1860868 [1] NCCL INFO comm 0xe916fa0 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1860654:1860868 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1860653:1860854 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1860654:1860868 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1860654:1860868 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1860653:1860854 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1860653:1860854 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1860654:1860868 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1860653:1860854 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1860653:1860854 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1860653:1860876 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 35
n136-128-154:1860653:1860875 [0] NCCL INFO [Proxy Service] Device 0 CPU core 98
n136-128-154:1860654:1860868 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1860654:1860877 [1] NCCL INFO [Proxy Service] Device 1 CPU core 47
n136-128-154:1860654:1860878 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 112
n136-128-154:1860653:1860854 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1860653:1860854 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1860653:1860854 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1860654:1860868 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1860654:1860868 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1860653:1860854 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1860653:1860854 [0] NCCL INFO ncclCommInitRankConfig comm 0xfdcd020 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x724ed52b33f18117 - Init COMPLETE
n136-128-154:1860653:1860854 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 2.09 (kernels 0.17, alloc 0.23, bootstrap 1.52, allgathers 0.00, topo 0.05, graphs 0.00, connections 0.03, rest 0.08)
n136-128-154:1860654:1860868 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1860654:1860868 [1] NCCL INFO ncclCommInitRankConfig comm 0xe916fa0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x724ed52b33f18117 - Init COMPLETE
n136-128-154:1860654:1860868 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.48 (kernels 0.11, alloc 0.19, bootstrap 0.00, allgathers 0.00, topo 0.05, graphs 0.00, connections 0.04, rest 0.07)
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860653:1860879 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1860654:1860880 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1860653:1860879 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-07:00:39:05 INFO     [evaluator:559] Running loglikelihood requests
2025-12-07:00:39:05 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/3270 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 45
Determined largest batch size: 45

Running loglikelihood requests:   0%|          | 1/3270 [00:55<50:35:37, 55.72s/it]
Running loglikelihood requests:   3%|▎         | 91/3270 [00:56<23:28,  2.26it/s]  
Running loglikelihood requests:   6%|▌         | 181/3270 [00:57<09:47,  5.26it/s]
Running loglikelihood requests:   8%|▊         | 271/3270 [00:58<05:25,  9.22it/s]
Running loglikelihood requests:  11%|█         | 361/3270 [00:59<03:23, 14.33it/s]
Running loglikelihood requests:  14%|█▍        | 451/3270 [01:00<02:15, 20.78it/s]
Running loglikelihood requests:  17%|█▋        | 541/3270 [01:01<01:35, 28.60it/s]
Running loglikelihood requests:  19%|█▉        | 631/3270 [01:02<01:09, 37.78it/s]
Running loglikelihood requests:  22%|██▏       | 721/3270 [01:03<00:52, 48.10it/s]
Running loglikelihood requests:  25%|██▍       | 811/3270 [01:03<00:41, 59.01it/s]
Running loglikelihood requests:  28%|██▊       | 901/3270 [01:04<00:33, 70.16it/s]
Running loglikelihood requests:  30%|███       | 991/3270 [01:05<00:28, 80.78it/s]
Running loglikelihood requests:  33%|███▎      | 1081/3270 [01:06<00:24, 90.70it/s]
Running loglikelihood requests:  36%|███▌      | 1171/3270 [01:06<00:21, 99.65it/s]
Running loglikelihood requests:  39%|███▊      | 1261/3270 [01:07<00:18, 108.03it/s]
Running loglikelihood requests:  41%|████▏     | 1351/3270 [01:08<00:16, 115.44it/s]
Running loglikelihood requests:  44%|████▍     | 1441/3270 [01:08<00:15, 121.60it/s]
Running loglikelihood requests:  47%|████▋     | 1531/3270 [01:09<00:13, 127.17it/s]
Running loglikelihood requests:  50%|████▉     | 1621/3270 [01:10<00:12, 131.97it/s]
Running loglikelihood requests:  52%|█████▏    | 1711/3270 [01:10<00:11, 135.86it/s]
Running loglikelihood requests:  55%|█████▌    | 1801/3270 [01:11<00:10, 140.97it/s]
Running loglikelihood requests:  58%|█████▊    | 1891/3270 [01:11<00:09, 145.13it/s]
Running loglikelihood requests:  61%|██████    | 1981/3270 [01:12<00:08, 149.18it/s]
Running loglikelihood requests:  63%|██████▎   | 2071/3270 [01:12<00:07, 152.49it/s]
Running loglikelihood requests:  66%|██████▌   | 2161/3270 [01:13<00:07, 155.85it/s]
Running loglikelihood requests:  69%|██████▉   | 2251/3270 [01:14<00:06, 160.23it/s]
Running loglikelihood requests:  72%|███████▏  | 2341/3270 [01:14<00:05, 164.34it/s]
Running loglikelihood requests:  74%|███████▍  | 2431/3270 [01:15<00:04, 168.55it/s]
Running loglikelihood requests:  77%|███████▋  | 2521/3270 [01:15<00:04, 172.27it/s]
Running loglikelihood requests:  80%|███████▉  | 2611/3270 [01:16<00:03, 176.04it/s]
Running loglikelihood requests:  83%|████████▎ | 2701/3270 [01:16<00:03, 180.33it/s]
Running loglikelihood requests:  85%|████████▌ | 2791/3270 [01:16<00:02, 186.58it/s]
Running loglikelihood requests:  88%|████████▊ | 2881/3270 [01:17<00:02, 193.14it/s]
Running loglikelihood requests:  91%|█████████ | 2971/3270 [01:17<00:01, 200.43it/s]
Running loglikelihood requests:  94%|█████████▎| 3061/3270 [01:18<00:00, 209.44it/s]
Running loglikelihood requests:  96%|█████████▋| 3151/3270 [01:18<00:00, 219.41it/s]
Running loglikelihood requests:  99%|█████████▉| 3241/3270 [01:18<00:00, 276.37it/s]
Running loglikelihood requests: 100%|██████████| 3270/3270 [01:18<00:00, 41.57it/s] 
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1860654:1860963 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1860654:1860877 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:00:40:36 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (45)
|Tasks|Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|-----|------:|------|-----:|------|---|-----:|---|-----:|
|boolq|      2|none  |     0|acc   |↑  |0.6373|±  |0.0084|

[rank0]:[W1207 00:40:37.217866339 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1860653:1860875 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1860653:1861018 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1860654:1860877 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1860654:1860968 [1] NCCL INFO comm 0xe916fa0 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1860653:1861018 [0] NCCL INFO comm 0xfdcd020 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 boolq 评估完成！

==================================================
开始评估：任务=arc_challenge | 少样本数=25 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/arc_challenge.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-07:00:42:00 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-07:00:42:00 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-07:00:42:00 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:42:00 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:42:00 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:42:00 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:42:01 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:42:01 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:42:01 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.25s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.25s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.28s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.28s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.21s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.21s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.19it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.01it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.19it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.01it/s]
2025-12-07:00:42:19 WARNING  [evaluator:309] Overwriting default num_fewshot of arc_challenge from None to 25
2025-12-07:00:42:19 INFO     [api.task:434] Building contexts for arc_challenge on rank 0...

  0%|          | 0/586 [00:00<?, ?it/s]
  1%|          | 4/586 [00:00<00:16, 34.95it/s]
  1%|▏         | 8/586 [00:00<00:16, 35.87it/s]
  2%|▏         | 12/586 [00:00<00:15, 36.05it/s]2025-12-07:00:42:19 WARNING  [evaluator:309] Overwriting default num_fewshot of arc_challenge from None to 25
2025-12-07:00:42:19 INFO     [api.task:434] Building contexts for arc_challenge on rank 1...

  0%|          | 0/586 [00:00<?, ?it/s]
  3%|▎         | 16/586 [00:00<00:15, 36.25it/s]
  1%|          | 4/586 [00:00<00:16, 35.03it/s]
  3%|▎         | 20/586 [00:00<00:15, 35.97it/s]
  1%|▏         | 8/586 [00:00<00:16, 36.11it/s]
  4%|▍         | 24/586 [00:00<00:15, 36.21it/s]
  2%|▏         | 12/586 [00:00<00:15, 36.35it/s]
  5%|▍         | 28/586 [00:00<00:15, 36.34it/s]
  3%|▎         | 16/586 [00:00<00:15, 36.59it/s]
  5%|▌         | 32/586 [00:00<00:15, 36.39it/s]
  3%|▎         | 20/586 [00:00<00:15, 36.00it/s]
  6%|▌         | 36/586 [00:00<00:15, 36.34it/s]
  4%|▍         | 24/586 [00:00<00:15, 36.20it/s]
  7%|▋         | 40/586 [00:01<00:15, 36.35it/s]
  5%|▍         | 28/586 [00:00<00:15, 36.21it/s]
  8%|▊         | 44/586 [00:01<00:14, 36.42it/s]
  5%|▌         | 32/586 [00:00<00:15, 36.45it/s]
  8%|▊         | 48/586 [00:01<00:14, 36.48it/s]
  9%|▉         | 52/586 [00:01<00:14, 36.51it/s]
  6%|▌         | 36/586 [00:00<00:15, 35.91it/s]
 10%|▉         | 56/586 [00:01<00:14, 36.58it/s]
  7%|▋         | 40/586 [00:01<00:15, 36.02it/s]
 10%|█         | 60/586 [00:01<00:14, 36.60it/s]
  8%|▊         | 44/586 [00:01<00:14, 36.28it/s]
 11%|█         | 64/586 [00:01<00:14, 36.65it/s]
  8%|▊         | 48/586 [00:01<00:14, 36.00it/s]
 12%|█▏        | 68/586 [00:01<00:14, 36.60it/s]
  9%|▉         | 52/586 [00:01<00:14, 36.25it/s]
 12%|█▏        | 72/586 [00:01<00:14, 36.58it/s]
 10%|▉         | 56/586 [00:01<00:14, 36.54it/s]
 13%|█▎        | 76/586 [00:02<00:13, 36.56it/s]
 10%|█         | 60/586 [00:01<00:14, 36.37it/s]
 14%|█▎        | 80/586 [00:02<00:13, 36.56it/s]
 11%|█         | 64/586 [00:01<00:14, 36.53it/s]
 14%|█▍        | 84/586 [00:02<00:13, 36.60it/s]
 12%|█▏        | 68/586 [00:01<00:14, 36.68it/s]
 15%|█▌        | 88/586 [00:02<00:13, 36.61it/s]
 12%|█▏        | 72/586 [00:01<00:14, 36.33it/s]
 16%|█▌        | 92/586 [00:02<00:13, 36.55it/s]
 13%|█▎        | 76/586 [00:02<00:13, 36.48it/s]
 14%|█▎        | 80/586 [00:02<00:13, 36.67it/s]
 16%|█▋        | 96/586 [00:02<00:13, 36.18it/s]
 14%|█▍        | 84/586 [00:02<00:13, 36.35it/s]
 17%|█▋        | 100/586 [00:02<00:13, 35.65it/s]
 15%|█▌        | 88/586 [00:02<00:13, 36.48it/s]
 18%|█▊        | 104/586 [00:02<00:13, 35.72it/s]
 16%|█▌        | 92/586 [00:02<00:13, 36.64it/s]
 18%|█▊        | 108/586 [00:02<00:13, 35.92it/s]
 16%|█▋        | 96/586 [00:02<00:13, 36.52it/s]
 19%|█▉        | 112/586 [00:03<00:13, 35.84it/s]
 17%|█▋        | 100/586 [00:02<00:13, 36.43it/s]
 20%|█▉        | 116/586 [00:03<00:13, 35.91it/s]
 18%|█▊        | 104/586 [00:02<00:13, 36.62it/s]
 20%|██        | 120/586 [00:03<00:12, 36.02it/s]
 18%|█▊        | 108/586 [00:02<00:13, 36.75it/s]
 21%|██        | 124/586 [00:03<00:12, 36.15it/s]
 19%|█▉        | 112/586 [00:03<00:13, 36.42it/s]
 22%|██▏       | 128/586 [00:03<00:12, 36.21it/s]
 20%|█▉        | 116/586 [00:03<00:12, 36.60it/s]
 23%|██▎       | 132/586 [00:03<00:12, 36.28it/s]
 20%|██        | 120/586 [00:03<00:12, 36.75it/s]
 23%|██▎       | 136/586 [00:03<00:12, 36.27it/s]
 21%|██        | 124/586 [00:03<00:12, 36.86it/s]
 24%|██▍       | 140/586 [00:03<00:12, 36.43it/s]
 22%|██▏       | 128/586 [00:03<00:12, 36.46it/s]
 25%|██▍       | 144/586 [00:03<00:12, 36.53it/s]
 23%|██▎       | 132/586 [00:03<00:12, 36.60it/s]
 25%|██▌       | 148/586 [00:04<00:11, 36.60it/s]
 23%|██▎       | 136/586 [00:03<00:12, 36.74it/s]
 26%|██▌       | 152/586 [00:04<00:11, 36.67it/s]
 24%|██▍       | 140/586 [00:03<00:12, 36.84it/s]
 27%|██▋       | 156/586 [00:04<00:11, 36.72it/s]
 25%|██▍       | 144/586 [00:03<00:12, 36.80it/s]
 27%|██▋       | 160/586 [00:04<00:11, 36.75it/s]
 25%|██▌       | 148/586 [00:04<00:11, 36.89it/s]
 28%|██▊       | 164/586 [00:04<00:11, 36.77it/s]
 26%|██▌       | 152/586 [00:04<00:11, 36.97it/s]
 29%|██▊       | 168/586 [00:04<00:11, 36.77it/s]
 27%|██▋       | 156/586 [00:04<00:11, 36.85it/s]
 29%|██▉       | 172/586 [00:04<00:11, 36.33it/s]
 27%|██▋       | 160/586 [00:04<00:11, 36.56it/s]
 30%|███       | 176/586 [00:04<00:11, 36.44it/s]
 28%|██▊       | 164/586 [00:04<00:11, 36.73it/s]
 31%|███       | 180/586 [00:04<00:11, 36.54it/s]
 29%|██▊       | 168/586 [00:04<00:11, 36.85it/s]
 31%|███▏      | 184/586 [00:05<00:10, 36.60it/s]
 29%|██▉       | 172/586 [00:04<00:11, 36.90it/s]
 32%|███▏      | 188/586 [00:05<00:10, 36.69it/s]
 30%|███       | 176/586 [00:04<00:11, 36.92it/s]
 33%|███▎      | 192/586 [00:05<00:10, 36.73it/s]
 31%|███       | 180/586 [00:04<00:11, 36.49it/s]
 33%|███▎      | 196/586 [00:05<00:10, 36.71it/s]
 31%|███▏      | 184/586 [00:05<00:10, 36.60it/s]
 34%|███▍      | 200/586 [00:05<00:10, 36.73it/s]
 32%|███▏      | 188/586 [00:05<00:10, 36.69it/s]
 35%|███▍      | 204/586 [00:05<00:10, 36.65it/s]
 33%|███▎      | 192/586 [00:05<00:10, 36.79it/s]
 35%|███▌      | 208/586 [00:05<00:10, 36.60it/s]
 33%|███▎      | 196/586 [00:05<00:10, 36.85it/s]
 36%|███▌      | 212/586 [00:05<00:10, 36.66it/s]
 34%|███▍      | 200/586 [00:05<00:10, 36.77it/s]
 37%|███▋      | 216/586 [00:05<00:10, 36.65it/s]
 35%|███▍      | 204/586 [00:05<00:10, 36.84it/s]
 38%|███▊      | 220/586 [00:06<00:10, 36.59it/s]
 35%|███▌      | 208/586 [00:05<00:10, 36.87it/s]
 38%|███▊      | 224/586 [00:06<00:09, 36.63it/s]
 36%|███▌      | 212/586 [00:05<00:10, 36.88it/s]
 39%|███▉      | 228/586 [00:06<00:09, 36.69it/s]
 37%|███▋      | 216/586 [00:05<00:10, 36.90it/s]
 40%|███▉      | 232/586 [00:06<00:09, 36.65it/s]
 38%|███▊      | 220/586 [00:06<00:10, 36.48it/s]
 40%|████      | 236/586 [00:06<00:09, 36.68it/s]
 38%|███▊      | 224/586 [00:06<00:09, 36.60it/s]
 41%|████      | 240/586 [00:06<00:09, 36.69it/s]
 39%|███▉      | 228/586 [00:06<00:09, 36.69it/s]
 42%|████▏     | 244/586 [00:06<00:09, 36.72it/s]
 40%|███▉      | 232/586 [00:06<00:09, 36.72it/s]
 42%|████▏     | 248/586 [00:06<00:09, 36.76it/s]
 40%|████      | 236/586 [00:06<00:09, 36.84it/s]
 43%|████▎     | 252/586 [00:06<00:09, 36.73it/s]
 41%|████      | 240/586 [00:06<00:09, 36.50it/s]
 44%|████▎     | 256/586 [00:07<00:08, 36.75it/s]
 42%|████▏     | 244/586 [00:06<00:09, 36.62it/s]
 44%|████▍     | 260/586 [00:07<00:08, 36.30it/s]
 42%|████▏     | 248/586 [00:06<00:09, 36.76it/s]
 45%|████▌     | 264/586 [00:07<00:08, 36.39it/s]
 43%|████▎     | 252/586 [00:06<00:09, 36.85it/s]
 46%|████▌     | 268/586 [00:07<00:08, 36.53it/s]
 44%|████▎     | 256/586 [00:06<00:08, 36.95it/s]
 46%|████▋     | 272/586 [00:07<00:08, 36.63it/s]
 44%|████▍     | 260/586 [00:07<00:08, 36.99it/s]
 47%|████▋     | 276/586 [00:07<00:08, 36.73it/s]
 45%|████▌     | 264/586 [00:07<00:08, 36.86it/s]
 48%|████▊     | 280/586 [00:07<00:08, 36.75it/s]
 46%|████▌     | 268/586 [00:07<00:08, 36.90it/s]
 48%|████▊     | 284/586 [00:07<00:08, 36.68it/s]
 46%|████▋     | 272/586 [00:07<00:08, 36.96it/s]
 49%|████▉     | 288/586 [00:07<00:08, 36.69it/s]
 47%|████▋     | 276/586 [00:07<00:08, 36.97it/s]
 50%|████▉     | 292/586 [00:08<00:08, 36.70it/s]
 48%|████▊     | 280/586 [00:07<00:08, 37.02it/s]
 51%|█████     | 296/586 [00:08<00:07, 36.66it/s]
 48%|████▊     | 284/586 [00:07<00:08, 37.08it/s]
 51%|█████     | 300/586 [00:08<00:07, 36.74it/s]
 49%|████▉     | 288/586 [00:07<00:08, 37.14it/s]
 52%|█████▏    | 304/586 [00:08<00:07, 36.75it/s]
 50%|████▉     | 292/586 [00:07<00:07, 36.75it/s]
 53%|█████▎    | 308/586 [00:08<00:07, 36.82it/s]
 51%|█████     | 296/586 [00:08<00:07, 36.89it/s]
 53%|█████▎    | 312/586 [00:08<00:07, 36.87it/s]
 51%|█████     | 300/586 [00:08<00:07, 36.98it/s]
 54%|█████▍    | 316/586 [00:08<00:07, 36.87it/s]
 52%|█████▏    | 304/586 [00:08<00:07, 37.06it/s]
 55%|█████▍    | 320/586 [00:08<00:07, 36.90it/s]
 53%|█████▎    | 308/586 [00:08<00:07, 37.10it/s]
 55%|█████▌    | 324/586 [00:08<00:07, 36.57it/s]
 53%|█████▎    | 312/586 [00:08<00:07, 37.13it/s]
 56%|█████▌    | 328/586 [00:08<00:07, 36.70it/s]
 54%|█████▍    | 316/586 [00:08<00:07, 37.15it/s]
 57%|█████▋    | 332/586 [00:09<00:06, 36.77it/s]
 55%|█████▍    | 320/586 [00:08<00:07, 36.68it/s]
 57%|█████▋    | 336/586 [00:09<00:06, 36.82it/s]
 55%|█████▌    | 324/586 [00:08<00:07, 36.80it/s]
 58%|█████▊    | 340/586 [00:09<00:06, 36.84it/s]
 56%|█████▌    | 328/586 [00:08<00:07, 36.85it/s]
 59%|█████▊    | 344/586 [00:09<00:06, 36.87it/s]
 57%|█████▋    | 332/586 [00:09<00:06, 36.90it/s]
 59%|█████▉    | 348/586 [00:09<00:06, 36.12it/s]
 57%|█████▋    | 336/586 [00:09<00:06, 37.00it/s]
 60%|██████    | 352/586 [00:09<00:06, 36.09it/s]
 58%|█████▊    | 340/586 [00:09<00:06, 37.02it/s]
 61%|██████    | 356/586 [00:09<00:06, 36.17it/s]
 59%|█████▊    | 344/586 [00:09<00:06, 37.04it/s]
 61%|██████▏   | 360/586 [00:09<00:06, 36.33it/s]
 59%|█████▉    | 348/586 [00:09<00:06, 36.94it/s]
 62%|██████▏   | 364/586 [00:09<00:06, 36.46it/s]
 60%|██████    | 352/586 [00:09<00:06, 36.95it/s]
 63%|██████▎   | 368/586 [00:10<00:05, 36.57it/s]
 61%|██████    | 356/586 [00:09<00:06, 36.98it/s]
 63%|██████▎   | 372/586 [00:10<00:05, 36.64it/s]
 61%|██████▏   | 360/586 [00:09<00:06, 37.01it/s]
 64%|██████▍   | 376/586 [00:10<00:05, 36.69it/s]
 62%|██████▏   | 364/586 [00:09<00:05, 37.03it/s]
 65%|██████▍   | 380/586 [00:10<00:05, 36.70it/s]
 63%|██████▎   | 368/586 [00:10<00:05, 37.06it/s]
 66%|██████▌   | 384/586 [00:10<00:05, 36.74it/s]
 63%|██████▎   | 372/586 [00:10<00:05, 37.04it/s]
 66%|██████▌   | 388/586 [00:10<00:05, 36.71it/s]
 64%|██████▍   | 376/586 [00:10<00:05, 37.07it/s]
 67%|██████▋   | 392/586 [00:10<00:05, 36.69it/s]
 65%|██████▍   | 380/586 [00:10<00:05, 36.66it/s]
 68%|██████▊   | 396/586 [00:10<00:05, 36.74it/s]
 66%|██████▌   | 384/586 [00:10<00:05, 36.66it/s]
 68%|██████▊   | 400/586 [00:10<00:05, 36.67it/s]
 66%|██████▌   | 388/586 [00:10<00:05, 36.76it/s]
 69%|██████▉   | 404/586 [00:11<00:04, 36.60it/s]
 67%|██████▋   | 392/586 [00:10<00:05, 36.83it/s]
 70%|██████▉   | 408/586 [00:11<00:04, 36.56it/s]
 68%|██████▊   | 396/586 [00:10<00:05, 36.89it/s]
 70%|███████   | 412/586 [00:11<00:04, 36.57it/s]
 68%|██████▊   | 400/586 [00:10<00:05, 36.97it/s]
 71%|███████   | 416/586 [00:11<00:04, 36.66it/s]
 69%|██████▉   | 404/586 [00:10<00:04, 37.03it/s]
 72%|███████▏  | 420/586 [00:11<00:04, 36.23it/s]
 70%|██████▉   | 408/586 [00:11<00:04, 37.04it/s]
 72%|███████▏  | 424/586 [00:11<00:04, 36.34it/s]
 70%|███████   | 412/586 [00:11<00:04, 37.05it/s]
 73%|███████▎  | 428/586 [00:11<00:04, 36.41it/s]
 71%|███████   | 416/586 [00:11<00:04, 36.70it/s]
 74%|███████▎  | 432/586 [00:11<00:04, 36.47it/s]
 72%|███████▏  | 420/586 [00:11<00:04, 36.79it/s]
 74%|███████▍  | 436/586 [00:11<00:04, 35.82it/s]
 72%|███████▏  | 424/586 [00:11<00:04, 36.85it/s]
 75%|███████▌  | 440/586 [00:12<00:04, 36.02it/s]
 73%|███████▎  | 428/586 [00:11<00:04, 36.93it/s]
 76%|███████▌  | 444/586 [00:12<00:03, 36.19it/s]
 74%|███████▎  | 432/586 [00:11<00:04, 36.95it/s]
 76%|███████▋  | 448/586 [00:12<00:03, 36.33it/s]
 74%|███████▍  | 436/586 [00:11<00:04, 36.96it/s]
 77%|███████▋  | 452/586 [00:12<00:03, 36.46it/s]
 75%|███████▌  | 440/586 [00:11<00:03, 36.88it/s]
 78%|███████▊  | 456/586 [00:12<00:03, 36.47it/s]
 76%|███████▌  | 444/586 [00:12<00:03, 36.90it/s]
 78%|███████▊  | 460/586 [00:12<00:03, 36.54it/s]
 76%|███████▋  | 448/586 [00:12<00:03, 36.72it/s]
 79%|███████▉  | 464/586 [00:12<00:03, 36.49it/s]
 77%|███████▋  | 452/586 [00:12<00:03, 36.78it/s]
 80%|███████▉  | 468/586 [00:12<00:03, 36.51it/s]
 78%|███████▊  | 456/586 [00:12<00:03, 36.87it/s]
 81%|████████  | 472/586 [00:12<00:03, 35.10it/s]
 78%|███████▊  | 460/586 [00:12<00:03, 36.93it/s]
 81%|████████  | 476/586 [00:13<00:03, 35.27it/s]
 79%|███████▉  | 464/586 [00:12<00:03, 36.96it/s]
 82%|████████▏ | 480/586 [00:13<00:02, 35.69it/s]
 80%|███████▉  | 468/586 [00:12<00:03, 36.98it/s]
 83%|████████▎ | 484/586 [00:13<00:02, 35.96it/s]
 81%|████████  | 472/586 [00:12<00:03, 37.00it/s]
 81%|████████  | 476/586 [00:12<00:02, 37.02it/s]
 83%|████████▎ | 488/586 [00:13<00:02, 36.12it/s]
 82%|████████▏ | 480/586 [00:13<00:02, 37.00it/s]
 84%|████████▍ | 492/586 [00:13<00:02, 36.25it/s]
 83%|████████▎ | 484/586 [00:13<00:02, 36.99it/s]
 85%|████████▍ | 496/586 [00:13<00:02, 36.35it/s]
 85%|████████▌ | 500/586 [00:13<00:02, 36.39it/s]
 83%|████████▎ | 488/586 [00:13<00:02, 36.55it/s]
 84%|████████▍ | 492/586 [00:13<00:02, 36.67it/s]
 86%|████████▌ | 504/586 [00:13<00:02, 36.26it/s]
 85%|████████▍ | 496/586 [00:13<00:02, 36.76it/s]
 87%|████████▋ | 508/586 [00:13<00:02, 36.35it/s]
 85%|████████▌ | 500/586 [00:13<00:02, 36.85it/s]
 87%|████████▋ | 512/586 [00:14<00:02, 36.46it/s]
 86%|████████▌ | 504/586 [00:13<00:02, 36.93it/s]
 88%|████████▊ | 516/586 [00:14<00:01, 36.38it/s]
 87%|████████▋ | 508/586 [00:13<00:02, 36.98it/s]
 89%|████████▊ | 520/586 [00:14<00:01, 36.52it/s]
 87%|████████▋ | 512/586 [00:13<00:02, 37.00it/s]
 89%|████████▉ | 524/586 [00:14<00:01, 36.64it/s]
 88%|████████▊ | 516/586 [00:14<00:01, 37.02it/s]
 90%|█████████ | 528/586 [00:14<00:01, 36.70it/s]
 89%|████████▊ | 520/586 [00:14<00:01, 37.02it/s]
 91%|█████████ | 532/586 [00:14<00:01, 36.75it/s]
 89%|████████▉ | 524/586 [00:14<00:01, 37.02it/s]
 91%|█████████▏| 536/586 [00:14<00:01, 36.72it/s]
 90%|█████████ | 528/586 [00:14<00:01, 36.55it/s]
 92%|█████████▏| 540/586 [00:14<00:01, 36.66it/s]
 91%|█████████ | 532/586 [00:14<00:01, 36.66it/s]
 93%|█████████▎| 544/586 [00:14<00:01, 36.58it/s]
 91%|█████████▏| 536/586 [00:14<00:01, 36.79it/s]
 94%|█████████▎| 548/586 [00:15<00:01, 36.53it/s]
 92%|█████████▏| 540/586 [00:14<00:01, 36.79it/s]
 94%|█████████▍| 552/586 [00:15<00:00, 36.44it/s]
 93%|█████████▎| 544/586 [00:14<00:01, 36.88it/s]
 95%|█████████▍| 556/586 [00:15<00:00, 36.40it/s]
 94%|█████████▎| 548/586 [00:14<00:01, 36.98it/s]
 96%|█████████▌| 560/586 [00:15<00:00, 35.92it/s]
 94%|█████████▍| 552/586 [00:15<00:00, 36.99it/s]
 96%|█████████▌| 564/586 [00:15<00:00, 36.00it/s]
 95%|█████████▍| 556/586 [00:15<00:00, 37.03it/s]
 97%|█████████▋| 568/586 [00:15<00:00, 36.10it/s]
 96%|█████████▌| 560/586 [00:15<00:00, 37.01it/s]
 98%|█████████▊| 572/586 [00:15<00:00, 36.16it/s]
 96%|█████████▌| 564/586 [00:15<00:00, 37.02it/s]
 98%|█████████▊| 576/586 [00:15<00:00, 36.17it/s]
 97%|█████████▋| 568/586 [00:15<00:00, 36.86it/s]
 99%|█████████▉| 580/586 [00:15<00:00, 36.21it/s]
 98%|█████████▊| 572/586 [00:15<00:00, 36.90it/s]
100%|█████████▉| 584/586 [00:16<00:00, 36.23it/s]
100%|██████████| 586/586 [00:16<00:00, 36.44it/s]
n136-128-154:1861092:1861092 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861092:1861092 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861092:1861092 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1861092:1861092 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1861092:1861092 [0] NCCL INFO Comm config Blocking set to 1

 98%|█████████▊| 576/586 [00:15<00:00, 36.89it/s]
 99%|█████████▉| 580/586 [00:15<00:00, 36.87it/s]
100%|█████████▉| 584/586 [00:15<00:00, 36.88it/s]
100%|██████████| 586/586 [00:15<00:00, 36.78it/s]
n136-128-154:1861093:1861093 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1861093:1861093 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861093:1861093 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861093:1861093 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1861092:1861317 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1861093:1861093 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1861092:1861317 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1861092:1861317 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861092:1861317 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861092:1861317 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1861092:1861317 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1861092:1861317 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1861092:1861317 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1861092:1861317 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1861092:1861317 [0] NCCL INFO Using network IB
n136-128-154:1861092:1861317 [0] NCCL INFO ncclCommInitRankConfig comm 0x106c2ac0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd0b62efd4b604bc3 - Init START
n136-128-154:1861093:1861320 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1861093:1861320 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1861093:1861320 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861093:1861320 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861093:1861320 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1861093:1861320 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1861093:1861320 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1861093:1861320 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1861093:1861320 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1861093:1861320 [1] NCCL INFO Using network IB
n136-128-154:1861093:1861320 [1] NCCL INFO ncclCommInitRankConfig comm 0x10ab4400 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd0b62efd4b604bc3 - Init START
n136-128-154:1861093:1861320 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1861092:1861317 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1861093:1861320 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1861093:1861320 [1] NCCL INFO Retrieving state for IB
n136-128-154:1861093:1861320 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1861093:1861320 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1861093:1861320 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1861093:1861320 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1861093:1861320 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1861092:1861317 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1861092:1861317 [0] NCCL INFO Retrieving state for IB
n136-128-154:1861092:1861317 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1861092:1861317 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1861092:1861317 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1861092:1861317 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1861092:1861317 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1861092:1861317 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861092:1861317 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861093:1861320 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861093:1861320 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861092:1861317 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1861093:1861320 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1861092:1861317 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1861093:1861320 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1861092:1861317 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1861093:1861320 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1861092:1861317 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1861093:1861320 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1861092:1861317 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1861093:1861320 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1861092:1861317 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861093:1861320 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1861092:1861317 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1861093:1861320 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1861092:1861317 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861093:1861320 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1861092:1861317 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1861093:1861320 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1861092:1861317 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1861093:1861320 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1861092:1861317 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1861093:1861320 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1861092:1861317 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1861093:1861320 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1861092:1861317 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1861093:1861320 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1861092:1861317 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1861093:1861320 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1861092:1861317 [0] NCCL INFO ==========================================
n136-128-154:1861093:1861320 [1] NCCL INFO ==========================================
n136-128-154:1861092:1861317 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861093:1861320 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861092:1861317 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861093:1861320 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861092:1861317 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1861093:1861320 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1861093:1861320 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1861093:1861320 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1861093:1861320 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1861093:1861320 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1861093:1861320 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861093:1861320 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861092:1861317 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861092:1861317 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861093:1861320 [1] NCCL INFO comm 0x10ab4400 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1861092:1861317 [0] NCCL INFO comm 0x106c2ac0 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861093:1861320 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1861093:1861320 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1861093:1861320 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1861093:1861320 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1861092:1861317 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1861092:1861317 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1861093:1861320 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1861093:1861331 [1] NCCL INFO [Proxy Service] Device 1 CPU core 117
n136-128-154:1861093:1861332 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 54
n136-128-154:1861092:1861317 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1861092:1861317 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1861092:1861333 [0] NCCL INFO [Proxy Service] Device 0 CPU core 98
n136-128-154:1861092:1861334 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 35
n136-128-154:1861093:1861320 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1861093:1861320 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1861092:1861317 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1861092:1861317 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1861092:1861317 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1861093:1861320 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1861093:1861320 [1] NCCL INFO ncclCommInitRankConfig comm 0x10ab4400 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd0b62efd4b604bc3 - Init COMPLETE
n136-128-154:1861093:1861320 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.55 (kernels 0.19, alloc 0.18, bootstrap 0.00, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.01, rest 0.11)
n136-128-154:1861092:1861317 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1861092:1861317 [0] NCCL INFO ncclCommInitRankConfig comm 0x106c2ac0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd0b62efd4b604bc3 - Init COMPLETE
n136-128-154:1861092:1861317 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.84 (kernels 0.21, alloc 0.32, bootstrap 0.13, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.01, rest 0.11)
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861335 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861092:1861336 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1861093:1861335 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-07:00:42:36 INFO     [evaluator:559] Running loglikelihood requests
2025-12-07:00:42:36 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/2344 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 45
Determined largest batch size: 45

Running loglikelihood requests:   0%|          | 1/2344 [00:56<36:53:24, 56.68s/it]
Running loglikelihood requests:   2%|▏         | 46/2344 [01:00<36:30,  1.05it/s]  
Running loglikelihood requests:   4%|▍         | 94/2344 [01:04<16:04,  2.33it/s]
Running loglikelihood requests:   6%|▌         | 142/2344 [01:08<09:46,  3.76it/s]
Running loglikelihood requests:   8%|▊         | 189/2344 [01:11<06:54,  5.21it/s]
Running loglikelihood requests:  10%|█         | 242/2344 [01:15<05:02,  6.94it/s]
Running loglikelihood requests:  12%|█▏        | 290/2344 [01:18<04:07,  8.29it/s]
Running loglikelihood requests:  14%|█▍        | 336/2344 [01:22<03:34,  9.35it/s]
Running loglikelihood requests:  16%|█▋        | 381/2344 [01:25<03:12, 10.21it/s]
Running loglikelihood requests:  18%|█▊        | 429/2344 [01:29<02:51, 11.15it/s]
Running loglikelihood requests:  20%|██        | 480/2344 [01:32<02:33, 12.11it/s]
Running loglikelihood requests:  22%|██▏       | 526/2344 [01:36<02:25, 12.49it/s]
Running loglikelihood requests:  25%|██▍       | 580/2344 [01:39<02:11, 13.46it/s]
Running loglikelihood requests:  27%|██▋       | 626/2344 [01:42<02:07, 13.48it/s]
Running loglikelihood requests:  29%|██▉       | 674/2344 [01:46<02:01, 13.70it/s]
Running loglikelihood requests:  31%|███       | 719/2344 [01:49<01:59, 13.65it/s]
Running loglikelihood requests:  33%|███▎      | 765/2344 [01:52<01:55, 13.72it/s]
Running loglikelihood requests:  35%|███▍      | 813/2344 [01:56<01:49, 13.93it/s]
Running loglikelihood requests:  37%|███▋      | 863/2344 [01:59<01:43, 14.32it/s]
Running loglikelihood requests:  39%|███▉      | 914/2344 [02:02<01:37, 14.71it/s]
Running loglikelihood requests:  41%|████      | 959/2344 [02:06<01:35, 14.47it/s]
Running loglikelihood requests:  43%|████▎     | 1005/2344 [02:09<01:33, 14.36it/s]
Running loglikelihood requests:  45%|████▍     | 1052/2344 [02:12<01:29, 14.40it/s]
Running loglikelihood requests:  47%|████▋     | 1110/2344 [02:15<01:19, 15.50it/s]
Running loglikelihood requests:  49%|████▉     | 1159/2344 [02:18<01:16, 15.47it/s]
Running loglikelihood requests:  52%|█████▏    | 1208/2344 [02:22<01:13, 15.47it/s]
Running loglikelihood requests:  54%|█████▎    | 1255/2344 [02:25<01:11, 15.29it/s]
Running loglikelihood requests:  56%|█████▌    | 1303/2344 [02:28<01:08, 15.27it/s]
Running loglikelihood requests:  58%|█████▊    | 1356/2344 [02:31<01:02, 15.76it/s]
Running loglikelihood requests:  60%|█████▉    | 1401/2344 [02:34<01:01, 15.36it/s]
Running loglikelihood requests:  62%|██████▏   | 1454/2344 [02:37<00:56, 15.88it/s]
Running loglikelihood requests:  64%|██████▍   | 1504/2344 [02:40<00:52, 15.99it/s]
Running loglikelihood requests:  66%|██████▋   | 1553/2344 [02:43<00:49, 16.03it/s]
Running loglikelihood requests:  68%|██████▊   | 1601/2344 [02:46<00:46, 15.97it/s]
Running loglikelihood requests:  71%|███████   | 1653/2344 [02:49<00:42, 16.35it/s]
Running loglikelihood requests:  72%|███████▏  | 1698/2344 [02:52<00:40, 15.96it/s]
Running loglikelihood requests:  74%|███████▍  | 1745/2344 [02:55<00:37, 15.90it/s]
Running loglikelihood requests:  76%|███████▋  | 1793/2344 [02:58<00:34, 15.98it/s]
Running loglikelihood requests:  78%|███████▊  | 1840/2344 [03:01<00:31, 15.95it/s]
Running loglikelihood requests:  81%|████████  | 1891/2344 [03:04<00:27, 16.37it/s]
Running loglikelihood requests:  83%|████████▎ | 1938/2344 [03:07<00:24, 16.32it/s]
Running loglikelihood requests:  85%|████████▍ | 1983/2344 [03:10<00:22, 16.09it/s]
Running loglikelihood requests:  87%|████████▋ | 2032/2344 [03:13<00:19, 16.33it/s]
Running loglikelihood requests:  89%|████████▉ | 2089/2344 [03:16<00:14, 17.36it/s]
Running loglikelihood requests:  91%|█████████ | 2137/2344 [03:19<00:12, 17.22it/s]
Running loglikelihood requests:  93%|█████████▎| 2185/2344 [03:22<00:09, 17.17it/s]
Running loglikelihood requests:  96%|█████████▌| 2241/2344 [03:24<00:05, 18.01it/s]
Running loglikelihood requests:  98%|█████████▊| 2295/2344 [03:27<00:02, 19.25it/s]
Running loglikelihood requests: 100%|██████████| 2344/2344 [03:27<00:00, 11.31it/s]
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861093:1861588 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861093:1861331 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:00:46:24 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 25, batch_size: auto (45)
|    Tasks    |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge|      1|none  |    25|acc     |↑  |0.3959|±  |0.0143|
|             |       |none  |    25|acc_norm|↑  |0.4283|±  |0.0145|

[rank0]:[W1207 00:46:25.993834409 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861092:1861333 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861093:1861331 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861092:1861643 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861093:1861593 [1] NCCL INFO comm 0x10ab4400 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1861092:1861643 [0] NCCL INFO comm 0x106c2ac0 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 arc_challenge 评估完成！

==================================================
开始评估：任务=truthfulqa_mc1 | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/truthfulqa_mc1.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-07:00:47:48 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-07:00:47:48 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-07:00:47:48 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:47:48 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:47:48 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:47:48 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:47:49 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:47:50 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:47:50 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.01it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.00s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.07s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.07s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.03s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.03s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.36it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.18it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.34it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.17it/s]
2025-12-07:00:48:09 INFO     [evaluator:305] num_fewshot has been set to 0 for truthfulqa_mc1 in its config. Manual configuration will be ignored.
2025-12-07:00:48:09 INFO     [api.task:434] Building contexts for truthfulqa_mc1 on rank 0...

  0%|          | 0/409 [00:00<?, ?it/s]
 25%|██▍       | 101/409 [00:00<00:00, 1008.02it/s]
 50%|█████     | 205/409 [00:00<00:00, 1022.23it/s]
 75%|███████▌  | 308/409 [00:00<00:00, 1011.70it/s]
100%|██████████| 409/409 [00:00<00:00, 1015.34it/s]
n136-128-154:1861701:1861701 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861701:1861701 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861701:1861701 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1861701:1861701 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1861701:1861701 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1861701:1861893 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1861701:1861893 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1861701:1861893 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861701:1861893 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861701:1861893 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1861701:1861893 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1861701:1861893 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1861701:1861893 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1861701:1861893 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1861701:1861893 [0] NCCL INFO Using network IB
n136-128-154:1861701:1861893 [0] NCCL INFO ncclCommInitRankConfig comm 0xf5433f0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x405acd16b64ca290 - Init START
2025-12-07:00:48:17 INFO     [evaluator:305] num_fewshot has been set to 0 for truthfulqa_mc1 in its config. Manual configuration will be ignored.
2025-12-07:00:48:17 INFO     [api.task:434] Building contexts for truthfulqa_mc1 on rank 1...

  0%|          | 0/408 [00:00<?, ?it/s]
 24%|██▍       | 99/408 [00:00<00:00, 988.64it/s]
 49%|████▉     | 201/408 [00:00<00:00, 1005.33it/s]
 74%|███████▍  | 302/408 [00:00<00:00, 996.09it/s] 
 99%|█████████▉| 404/408 [00:00<00:00, 1004.28it/s]
100%|██████████| 408/408 [00:00<00:00, 1001.70it/s]
n136-128-154:1861702:1861702 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1861702:1861702 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861702:1861702 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861702:1861702 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1861702:1861702 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1861702:1861908 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1861702:1861908 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1861702:1861908 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1861702:1861908 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1861702:1861908 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1861702:1861908 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1861702:1861908 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1861702:1861908 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1861702:1861908 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1861702:1861908 [1] NCCL INFO Using network IB
n136-128-154:1861702:1861908 [1] NCCL INFO ncclCommInitRankConfig comm 0xf847890 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x405acd16b64ca290 - Init START
n136-128-154:1861702:1861908 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1861701:1861893 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1861701:1861893 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1861701:1861893 [0] NCCL INFO Retrieving state for IB
n136-128-154:1861701:1861893 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1861701:1861893 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1861702:1861908 [1] NCCL INFO Retrieving state for IB
n136-128-154:1861702:1861908 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1861701:1861893 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1861701:1861893 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1861701:1861893 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1861702:1861908 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861702:1861908 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861701:1861893 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861701:1861893 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1861701:1861893 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1861701:1861893 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1861701:1861893 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1861701:1861893 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1861701:1861893 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1861701:1861893 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1861701:1861893 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1861701:1861893 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1861701:1861893 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1861701:1861893 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1861701:1861893 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1861701:1861893 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1861701:1861893 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1861701:1861893 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1861701:1861893 [0] NCCL INFO ==========================================
n136-128-154:1861701:1861893 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861701:1861893 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861701:1861893 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1861702:1861908 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1861702:1861908 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1861702:1861908 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1861702:1861908 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1861702:1861908 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1861702:1861908 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1861702:1861908 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1861702:1861908 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1861702:1861908 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1861702:1861908 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1861702:1861908 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1861702:1861908 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1861702:1861908 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1861702:1861908 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1861702:1861908 [1] NCCL INFO ==========================================
n136-128-154:1861702:1861908 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861702:1861908 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1861702:1861908 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1861701:1861893 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1861701:1861893 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1861701:1861893 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861701:1861893 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861701:1861893 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861701:1861893 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861701:1861893 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861701:1861893 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861701:1861893 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1861702:1861908 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1861702:1861908 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1861702:1861908 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1861702:1861908 [1] NCCL INFO comm 0xf847890 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1861701:1861893 [0] NCCL INFO comm 0xf5433f0 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861702:1861908 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1861702:1861908 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1861702:1861908 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1861702:1861908 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1861701:1861893 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1861701:1861893 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1861701:1861893 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1861701:1861893 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1861701:1861915 [0] NCCL INFO [Proxy Service] Device 0 CPU core 98
n136-128-154:1861701:1861916 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 38
n136-128-154:1861702:1861908 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1861702:1861917 [1] NCCL INFO [Proxy Service] Device 1 CPU core 103
n136-128-154:1861702:1861918 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 104
n136-128-154:1861701:1861893 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1861701:1861893 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1861701:1861893 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1861702:1861908 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1861702:1861908 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1861701:1861893 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1861701:1861893 [0] NCCL INFO ncclCommInitRankConfig comm 0xf5433f0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x405acd16b64ca290 - Init COMPLETE
n136-128-154:1861701:1861893 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 7.54 (kernels 0.20, alloc 0.19, bootstrap 7.00, allgathers 0.00, topo 0.07, graphs 0.00, connections 0.01, rest 0.07)
n136-128-154:1861702:1861908 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1861702:1861908 [1] NCCL INFO ncclCommInitRankConfig comm 0xf847890 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x405acd16b64ca290 - Init COMPLETE
n136-128-154:1861702:1861908 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.46 (kernels 0.12, alloc 0.18, bootstrap 0.00, allgathers 0.00, topo 0.07, graphs 0.00, connections 0.01, rest 0.07)
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861920 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861701:1861919 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1861702:1861920 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-07:00:48:18 INFO     [evaluator:559] Running loglikelihood requests
2025-12-07:00:48:18 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/2066 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/2066 [00:07<4:04:07,  7.09s/it]
Running loglikelihood requests:   3%|▎         | 65/2066 [00:08<03:09, 10.54it/s] 
Running loglikelihood requests:   6%|▌         | 129/2066 [00:09<01:36, 20.13it/s]
Running loglikelihood requests:   9%|▉         | 193/2066 [00:10<01:05, 28.59it/s]
Running loglikelihood requests:  12%|█▏        | 257/2066 [00:11<00:50, 35.72it/s]
Running loglikelihood requests:  16%|█▌        | 321/2066 [00:12<00:42, 41.47it/s]
Running loglikelihood requests:  19%|█▊        | 385/2066 [00:13<00:36, 45.95it/s]
Running loglikelihood requests:  22%|██▏       | 449/2066 [00:14<00:32, 49.55it/s]
Running loglikelihood requests:  25%|██▍       | 513/2066 [00:15<00:29, 52.25it/s]
Running loglikelihood requests:  28%|██▊       | 577/2066 [00:17<00:27, 54.31it/s]
Running loglikelihood requests:  31%|███       | 641/2066 [00:18<00:25, 55.85it/s]
Running loglikelihood requests:  34%|███▍      | 705/2066 [00:19<00:23, 57.02it/s]
Running loglikelihood requests:  37%|███▋      | 769/2066 [00:20<00:22, 57.86it/s]
Running loglikelihood requests:  40%|████      | 833/2066 [00:21<00:21, 58.46it/s]
Running loglikelihood requests:  43%|████▎     | 897/2066 [00:22<00:19, 59.00it/s]
Running loglikelihood requests:  47%|████▋     | 961/2066 [00:23<00:18, 59.36it/s]
Running loglikelihood requests:  50%|████▉     | 1025/2066 [00:24<00:17, 59.69it/s]
Running loglikelihood requests:  53%|█████▎    | 1089/2066 [00:25<00:16, 59.80it/s]
Running loglikelihood requests:  56%|█████▌    | 1153/2066 [00:26<00:15, 60.10it/s]
Running loglikelihood requests:  59%|█████▉    | 1217/2066 [00:27<00:14, 60.28it/s]
Running loglikelihood requests:  62%|██████▏   | 1281/2066 [00:28<00:12, 60.40it/s]
Running loglikelihood requests:  65%|██████▌   | 1345/2066 [00:29<00:11, 60.52it/s]
Running loglikelihood requests:  68%|██████▊   | 1409/2066 [00:30<00:10, 60.73it/s]
Running loglikelihood requests:  71%|███████▏  | 1473/2066 [00:31<00:09, 60.85it/s]
Running loglikelihood requests:  74%|███████▍  | 1537/2066 [00:32<00:08, 60.95it/s]
Running loglikelihood requests:  77%|███████▋  | 1601/2066 [00:33<00:07, 60.93it/s]
Running loglikelihood requests:  81%|████████  | 1665/2066 [00:35<00:06, 61.10it/s]
Running loglikelihood requests:  84%|████████▎ | 1729/2066 [00:36<00:05, 61.27it/s]
Running loglikelihood requests:  87%|████████▋ | 1793/2066 [00:37<00:04, 61.34it/s]
Running loglikelihood requests:  90%|████████▉ | 1857/2066 [00:38<00:03, 61.50it/s]
Running loglikelihood requests:  93%|█████████▎| 1921/2066 [00:39<00:02, 61.61it/s]
Running loglikelihood requests:  96%|█████████▌| 1985/2066 [00:40<00:01, 62.14it/s]
Running loglikelihood requests:  99%|█████████▉| 2049/2066 [00:40<00:00, 78.93it/s]
Running loglikelihood requests: 100%|██████████| 2066/2066 [00:40<00:00, 51.02it/s]
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1861702:1861962 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861702:1861917 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:00:49:10 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (64)
|    Tasks     |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|--------------|------:|------|-----:|------|---|-----:|---|-----:|
|truthfulqa_mc1|      2|none  |     0|acc   |↑  |0.2974|±  | 0.016|

[rank0]:[W1207 00:49:11.872260977 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861701:1861915 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1861702:1861917 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1861701:1862020 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1861702:1861968 [1] NCCL INFO comm 0xf847890 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1861701:1862020 [0] NCCL INFO comm 0xf5433f0 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 truthfulqa_mc1 评估完成！

==================================================
开始评估：任务=piqa | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/piqa.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-07:00:50:37 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-07:00:50:37 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-07:00:50:37 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:50:37 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:50:37 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:50:37 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:50:38 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:50:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:50:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.29s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.30s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.27s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.29s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.12s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.13s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.29it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.07it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.29it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.06it/s]
2025-12-07:00:50:54 WARNING  [evaluator:309] Overwriting default num_fewshot of piqa from None to 0
2025-12-07:00:50:54 INFO     [api.task:434] Building contexts for piqa on rank 1...

  0%|          | 0/919 [00:00<?, ?it/s]
 14%|█▍        | 132/919 [00:00<00:00, 1316.22it/s]
 29%|██▊       | 264/919 [00:00<00:00, 1310.84it/s]
 46%|████▌     | 420/919 [00:00<00:00, 1423.03it/s]
 63%|██████▎   | 575/919 [00:00<00:00, 1470.39it/s]
 79%|███████▉  | 730/919 [00:00<00:00, 1496.91it/s]
 97%|█████████▋| 887/919 [00:00<00:00, 1518.87it/s]
100%|██████████| 919/919 [00:00<00:00, 1474.27it/s]
2025-12-07:00:50:55 WARNING  [evaluator:309] Overwriting default num_fewshot of piqa from None to 0
2025-12-07:00:50:55 INFO     [api.task:434] Building contexts for piqa on rank 0...

  0%|          | 0/919 [00:00<?, ?it/s]
 17%|█▋        | 154/919 [00:00<00:00, 1532.17it/s]
 34%|███▎      | 308/919 [00:00<00:00, 1516.64it/s]
 50%|█████     | 464/919 [00:00<00:00, 1536.20it/s]
 68%|██████▊   | 621/919 [00:00<00:00, 1545.73it/s]
 85%|████████▍ | 777/919 [00:00<00:00, 1550.22it/s]
100%|██████████| 919/919 [00:00<00:00, 1545.52it/s]
n136-128-154:1862073:1862073 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862073:1862073 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862073:1862073 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1862073:1862073 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1862073:1862073 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1862074:1862074 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1862074:1862074 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862074:1862074 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862074:1862074 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1862074:1862074 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1862074:1862295 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1862073:1862294 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1862074:1862295 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1862073:1862294 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1862073:1862294 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862073:1862294 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862073:1862294 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1862074:1862295 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862074:1862295 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862074:1862295 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1862074:1862295 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1862074:1862295 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1862074:1862295 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1862074:1862295 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1862074:1862295 [1] NCCL INFO Using network IB
n136-128-154:1862073:1862294 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1862073:1862294 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1862073:1862294 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1862073:1862294 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1862073:1862294 [0] NCCL INFO Using network IB
n136-128-154:1862074:1862295 [1] NCCL INFO ncclCommInitRankConfig comm 0x10ebbab0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x632767f26687259c - Init START
n136-128-154:1862073:1862294 [0] NCCL INFO ncclCommInitRankConfig comm 0x100cb200 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x632767f26687259c - Init START
n136-128-154:1862074:1862295 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1862073:1862294 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1862073:1862294 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1862073:1862294 [0] NCCL INFO Retrieving state for IB
n136-128-154:1862073:1862294 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1862073:1862294 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1862074:1862295 [1] NCCL INFO Retrieving state for IB
n136-128-154:1862074:1862295 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1862073:1862294 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1862073:1862294 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1862073:1862294 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1862074:1862295 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862074:1862295 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862073:1862294 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862073:1862294 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862074:1862295 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1862074:1862295 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1862074:1862295 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1862074:1862295 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1862074:1862295 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1862074:1862295 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1862074:1862295 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1862074:1862295 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1862074:1862295 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1862074:1862295 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1862074:1862295 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1862074:1862295 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1862074:1862295 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1862074:1862295 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1862074:1862295 [1] NCCL INFO ==========================================
n136-128-154:1862074:1862295 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862074:1862295 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862074:1862295 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1862073:1862294 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1862073:1862294 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1862073:1862294 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1862073:1862294 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1862073:1862294 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1862073:1862294 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1862073:1862294 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1862073:1862294 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1862073:1862294 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1862073:1862294 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1862073:1862294 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1862073:1862294 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1862073:1862294 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1862073:1862294 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1862073:1862294 [0] NCCL INFO ==========================================
n136-128-154:1862073:1862294 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862073:1862294 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862073:1862294 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1862074:1862295 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1862074:1862295 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1862074:1862295 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1862074:1862295 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862074:1862295 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1862074:1862295 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862074:1862295 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862073:1862294 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862073:1862294 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862074:1862295 [1] NCCL INFO comm 0x10ebbab0 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1862073:1862294 [0] NCCL INFO comm 0x100cb200 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862074:1862295 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1862073:1862294 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1862074:1862295 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1862074:1862295 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1862074:1862295 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1862073:1862294 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1862073:1862294 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1862074:1862295 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1862073:1862294 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1862073:1862294 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1862073:1862307 [0] NCCL INFO [Proxy Service] Device 0 CPU core 38
n136-128-154:1862074:1862306 [1] NCCL INFO [Proxy Service] Device 1 CPU core 34
n136-128-154:1862073:1862308 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 103
n136-128-154:1862074:1862309 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 40
n136-128-154:1862074:1862295 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1862074:1862295 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1862073:1862294 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1862073:1862294 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1862073:1862294 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1862074:1862295 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1862074:1862295 [1] NCCL INFO ncclCommInitRankConfig comm 0x10ebbab0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x632767f26687259c - Init COMPLETE
n136-128-154:1862074:1862295 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.64 (kernels 0.26, alloc 0.17, bootstrap 0.02, allgathers 0.00, topo 0.08, graphs 0.00, connections 0.01, rest 0.09)
n136-128-154:1862073:1862294 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1862073:1862294 [0] NCCL INFO ncclCommInitRankConfig comm 0x100cb200 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x632767f26687259c - Init COMPLETE
n136-128-154:1862073:1862294 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.64 (kernels 0.26, alloc 0.19, bootstrap 0.00, allgathers 0.00, topo 0.08, graphs 0.00, connections 0.01, rest 0.09)
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862074:1862310 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862073:1862311 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1862074:1862310 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-07:00:50:56 INFO     [evaluator:559] Running loglikelihood requests
2025-12-07:00:50:56 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/1838 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/1838 [00:07<3:54:58,  7.67s/it]
Running loglikelihood requests:   4%|▎         | 65/1838 [00:08<02:45, 10.71it/s] 
Running loglikelihood requests:   7%|▋         | 129/1838 [00:08<01:15, 22.70it/s]
Running loglikelihood requests:  11%|█         | 194/1838 [00:09<00:45, 36.21it/s]
Running loglikelihood requests:  14%|█▍        | 258/1838 [00:09<00:31, 50.41it/s]
Running loglikelihood requests:  18%|█▊        | 322/1838 [00:10<00:23, 65.25it/s]
Running loglikelihood requests:  21%|██        | 386/1838 [00:10<00:18, 79.84it/s]
Running loglikelihood requests:  25%|██▍       | 451/1838 [00:11<00:14, 93.73it/s]
Running loglikelihood requests:  28%|██▊       | 515/1838 [00:11<00:12, 106.82it/s]
Running loglikelihood requests:  32%|███▏      | 579/1838 [00:12<00:10, 117.84it/s]
Running loglikelihood requests:  35%|███▍      | 643/1838 [00:12<00:09, 127.96it/s]
Running loglikelihood requests:  38%|███▊      | 707/1838 [00:13<00:08, 133.70it/s]
Running loglikelihood requests:  42%|████▏     | 771/1838 [00:13<00:07, 142.26it/s]
Running loglikelihood requests:  45%|████▌     | 835/1838 [00:13<00:06, 149.06it/s]
Running loglikelihood requests:  49%|████▉     | 899/1838 [00:14<00:06, 154.08it/s]
Running loglikelihood requests:  52%|█████▏    | 964/1838 [00:14<00:05, 159.72it/s]
Running loglikelihood requests:  56%|█████▌    | 1028/1838 [00:14<00:04, 164.79it/s]
Running loglikelihood requests:  59%|█████▉    | 1092/1838 [00:15<00:04, 168.61it/s]
Running loglikelihood requests:  63%|██████▎   | 1157/1838 [00:15<00:03, 173.36it/s]
Running loglikelihood requests:  66%|██████▋   | 1221/1838 [00:15<00:03, 177.94it/s]
Running loglikelihood requests:  70%|██████▉   | 1286/1838 [00:16<00:03, 181.86it/s]
Running loglikelihood requests:  73%|███████▎  | 1350/1838 [00:16<00:02, 181.45it/s]
Running loglikelihood requests:  77%|███████▋  | 1414/1838 [00:16<00:02, 184.92it/s]
Running loglikelihood requests:  80%|████████  | 1478/1838 [00:17<00:01, 188.90it/s]
Running loglikelihood requests:  84%|████████▍ | 1542/1838 [00:17<00:01, 191.90it/s]
Running loglikelihood requests:  87%|████████▋ | 1606/1838 [00:17<00:01, 194.63it/s]
Running loglikelihood requests:  91%|█████████ | 1670/1838 [00:18<00:00, 199.14it/s]
Running loglikelihood requests:  94%|█████████▍| 1734/1838 [00:18<00:00, 203.19it/s]
Running loglikelihood requests:  98%|█████████▊| 1799/1838 [00:18<00:00, 230.61it/s]
Running loglikelihood requests: 100%|██████████| 1838/1838 [00:18<00:00, 98.17it/s] 
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862074:1862332 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862074:1862306 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:00:51:26 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (64)
|Tasks|Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-----|------:|------|-----:|--------|---|-----:|---|-----:|
|piqa |      1|none  |     0|acc     |↑  |0.6774|±  |0.0109|
|     |       |none  |     0|acc_norm|↑  |0.6817|±  |0.0109|

[rank0]:[W1207 00:51:27.186925054 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862073:1862307 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862073:1862392 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862074:1862306 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1862074:1862337 [1] NCCL INFO comm 0x10ebbab0 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1862073:1862392 [0] NCCL INFO comm 0x100cb200 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 piqa 评估完成！

==================================================
开始评估：任务=hellaswag | 少样本数=10 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg2/hellaswag.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-07:00:52:52 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-07:00:52:52 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-07:00:52:52 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:52:52 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:52:52 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-07:00:52:52 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-07:00:52:53 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:52:53 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-07:00:52:53 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.24s/it]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.24s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.27s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.27s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.22s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.22s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.18it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.18it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.01it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.01it/s]
2025-12-07:00:53:15 WARNING  [evaluator:309] Overwriting default num_fewshot of hellaswag from None to 10
2025-12-07:00:53:15 INFO     [api.task:434] Building contexts for hellaswag on rank 1...
2025-12-07:00:53:16 WARNING  [evaluator:309] Overwriting default num_fewshot of hellaswag from None to 10
2025-12-07:00:53:16 INFO     [api.task:434] Building contexts for hellaswag on rank 0...

  0%|          | 0/5021 [00:00<?, ?it/s]
  0%|          | 19/5021 [00:00<00:26, 188.99it/s]
  1%|          | 39/5021 [00:00<00:25, 193.82it/s]
  1%|          | 59/5021 [00:00<00:25, 192.23it/s]
  2%|▏         | 79/5021 [00:00<00:25, 193.12it/s]
  2%|▏         | 99/5021 [00:00<00:25, 193.64it/s]
  2%|▏         | 119/5021 [00:00<00:25, 194.86it/s]
  3%|▎         | 139/5021 [00:00<00:25, 194.55it/s]
  3%|▎         | 159/5021 [00:00<00:24, 195.16it/s]
  0%|          | 0/5021 [00:00<?, ?it/s]
  4%|▎         | 179/5021 [00:00<00:24, 195.98it/s]
  0%|          | 19/5021 [00:00<00:26, 187.77it/s]
  4%|▍         | 199/5021 [00:01<00:24, 195.44it/s]
  1%|          | 38/5021 [00:00<00:26, 185.92it/s]
  4%|▍         | 219/5021 [00:01<00:24, 194.62it/s]
  1%|          | 58/5021 [00:00<00:26, 189.54it/s]
  5%|▍         | 239/5021 [00:01<00:24, 194.31it/s]
  2%|▏         | 78/5021 [00:00<00:25, 190.79it/s]
  5%|▌         | 259/5021 [00:01<00:24, 194.82it/s]
  2%|▏         | 98/5021 [00:00<00:25, 192.26it/s]
  6%|▌         | 279/5021 [00:01<00:24, 194.80it/s]
  2%|▏         | 118/5021 [00:00<00:25, 193.15it/s]
  6%|▌         | 299/5021 [00:01<00:24, 194.87it/s]
  3%|▎         | 138/5021 [00:00<00:25, 193.78it/s]
  6%|▋         | 319/5021 [00:01<00:24, 194.57it/s]
  3%|▎         | 158/5021 [00:00<00:25, 194.36it/s]
  7%|▋         | 339/5021 [00:01<00:24, 193.91it/s]
  4%|▎         | 178/5021 [00:00<00:24, 194.25it/s]
  7%|▋         | 359/5021 [00:01<00:23, 194.31it/s]
  4%|▍         | 198/5021 [00:01<00:24, 194.17it/s]
  8%|▊         | 379/5021 [00:01<00:23, 194.23it/s]
  4%|▍         | 218/5021 [00:01<00:24, 192.29it/s]
  8%|▊         | 399/5021 [00:02<00:23, 194.08it/s]
  5%|▍         | 238/5021 [00:01<00:24, 192.05it/s]
  8%|▊         | 419/5021 [00:02<00:23, 194.31it/s]
  5%|▌         | 258/5021 [00:01<00:24, 192.55it/s]
  9%|▊         | 439/5021 [00:02<00:23, 194.93it/s]
  6%|▌         | 278/5021 [00:01<00:24, 192.86it/s]
  9%|▉         | 459/5021 [00:02<00:23, 195.62it/s]
  6%|▌         | 298/5021 [00:01<00:24, 193.28it/s]
 10%|▉         | 479/5021 [00:02<00:23, 195.98it/s]
  6%|▋         | 318/5021 [00:01<00:24, 193.34it/s]
 10%|▉         | 499/5021 [00:02<00:23, 195.82it/s]
  7%|▋         | 338/5021 [00:01<00:24, 193.56it/s]
 10%|█         | 519/5021 [00:02<00:22, 196.25it/s]
  7%|▋         | 358/5021 [00:01<00:24, 193.67it/s]
 11%|█         | 539/5021 [00:02<00:22, 196.75it/s]
  8%|▊         | 378/5021 [00:01<00:24, 191.50it/s]
 11%|█         | 559/5021 [00:02<00:22, 194.47it/s]
  8%|▊         | 398/5021 [00:02<00:24, 191.59it/s]
 12%|█▏        | 579/5021 [00:02<00:22, 195.23it/s]
  8%|▊         | 418/5021 [00:02<00:23, 191.98it/s]
 12%|█▏        | 599/5021 [00:03<00:22, 196.10it/s]
 12%|█▏        | 619/5021 [00:03<00:22, 196.59it/s]
  9%|▊         | 438/5021 [00:02<00:23, 192.21it/s]
 13%|█▎        | 639/5021 [00:03<00:22, 197.07it/s]
  9%|▉         | 458/5021 [00:02<00:23, 192.24it/s]
 13%|█▎        | 659/5021 [00:03<00:22, 197.60it/s]
 10%|▉         | 478/5021 [00:02<00:23, 192.48it/s]
 14%|█▎        | 679/5021 [00:03<00:21, 198.05it/s]
 10%|▉         | 498/5021 [00:02<00:23, 192.96it/s]
 14%|█▍        | 699/5021 [00:03<00:21, 198.62it/s]
 10%|█         | 518/5021 [00:02<00:23, 193.43it/s]
 14%|█▍        | 720/5021 [00:03<00:21, 199.20it/s]
 11%|█         | 538/5021 [00:02<00:23, 192.22it/s]
 15%|█▍        | 741/5021 [00:03<00:21, 199.46it/s]
 11%|█         | 558/5021 [00:02<00:23, 192.65it/s]
 15%|█▌        | 762/5021 [00:03<00:21, 199.81it/s]
 12%|█▏        | 578/5021 [00:03<00:23, 193.02it/s]
 16%|█▌        | 782/5021 [00:03<00:21, 199.39it/s]
 12%|█▏        | 598/5021 [00:03<00:22, 193.11it/s]
 16%|█▌        | 802/5021 [00:04<00:21, 198.83it/s]
 12%|█▏        | 618/5021 [00:03<00:22, 192.76it/s]
 16%|█▋        | 822/5021 [00:04<00:21, 198.54it/s]
 13%|█▎        | 638/5021 [00:03<00:22, 192.74it/s]
 17%|█▋        | 842/5021 [00:04<00:21, 198.04it/s]
 13%|█▎        | 658/5021 [00:03<00:22, 193.04it/s]
 17%|█▋        | 862/5021 [00:04<00:21, 198.02it/s]
 14%|█▎        | 678/5021 [00:03<00:22, 193.58it/s]
 18%|█▊        | 882/5021 [00:04<00:21, 196.31it/s]
 14%|█▍        | 698/5021 [00:03<00:22, 193.82it/s]
 18%|█▊        | 902/5021 [00:04<00:21, 195.68it/s]
 14%|█▍        | 718/5021 [00:03<00:22, 194.04it/s]
 18%|█▊        | 922/5021 [00:04<00:21, 195.18it/s]
 15%|█▍        | 738/5021 [00:03<00:22, 194.16it/s]
 19%|█▉        | 942/5021 [00:04<00:20, 194.44it/s]
 15%|█▌        | 758/5021 [00:03<00:21, 194.06it/s]
 19%|█▉        | 962/5021 [00:04<00:20, 193.31it/s]
 15%|█▌        | 778/5021 [00:04<00:21, 193.95it/s]
 20%|█▉        | 982/5021 [00:05<00:20, 194.35it/s]
 16%|█▌        | 798/5021 [00:04<00:21, 194.14it/s]
 20%|█▉        | 1002/5021 [00:05<00:20, 194.42it/s]
 16%|█▋        | 818/5021 [00:04<00:21, 194.69it/s]
 20%|██        | 1022/5021 [00:05<00:20, 194.90it/s]
 17%|█▋        | 838/5021 [00:04<00:21, 194.91it/s]
 21%|██        | 1042/5021 [00:05<00:20, 195.09it/s]
 17%|█▋        | 858/5021 [00:04<00:21, 192.99it/s]
 21%|██        | 1062/5021 [00:05<00:20, 195.15it/s]
 17%|█▋        | 878/5021 [00:04<00:21, 192.86it/s]
 22%|██▏       | 1082/5021 [00:05<00:20, 195.39it/s]
 18%|█▊        | 898/5021 [00:04<00:21, 193.34it/s]
 22%|██▏       | 1102/5021 [00:05<00:20, 195.30it/s]
 18%|█▊        | 918/5021 [00:04<00:21, 193.68it/s]
 22%|██▏       | 1122/5021 [00:05<00:19, 195.50it/s]
 19%|█▊        | 938/5021 [00:04<00:21, 193.62it/s]
 23%|██▎       | 1142/5021 [00:05<00:19, 195.97it/s]
 19%|█▉        | 958/5021 [00:04<00:20, 194.18it/s]
 23%|██▎       | 1162/5021 [00:05<00:19, 196.28it/s]
 19%|█▉        | 978/5021 [00:05<00:20, 193.66it/s]
 24%|██▎       | 1182/5021 [00:06<00:19, 196.60it/s]
 20%|█▉        | 998/5021 [00:05<00:20, 193.95it/s]
 24%|██▍       | 1202/5021 [00:06<00:19, 197.53it/s]
 20%|██        | 1018/5021 [00:05<00:20, 194.51it/s]
 24%|██▍       | 1222/5021 [00:06<00:19, 195.94it/s]
 21%|██        | 1038/5021 [00:05<00:20, 194.51it/s]
 25%|██▍       | 1242/5021 [00:06<00:19, 197.08it/s]
 21%|██        | 1058/5021 [00:05<00:20, 194.38it/s]
 25%|██▌       | 1262/5021 [00:06<00:19, 196.82it/s]
 21%|██▏       | 1078/5021 [00:05<00:20, 194.59it/s]
 26%|██▌       | 1282/5021 [00:06<00:18, 197.21it/s]
 22%|██▏       | 1098/5021 [00:05<00:20, 194.50it/s]
 26%|██▌       | 1302/5021 [00:06<00:18, 197.36it/s]
 22%|██▏       | 1118/5021 [00:05<00:20, 194.72it/s]
 26%|██▋       | 1322/5021 [00:06<00:18, 197.64it/s]
 23%|██▎       | 1138/5021 [00:05<00:19, 194.79it/s]
 27%|██▋       | 1342/5021 [00:06<00:18, 197.79it/s]
 23%|██▎       | 1158/5021 [00:05<00:19, 194.57it/s]
 27%|██▋       | 1362/5021 [00:06<00:18, 197.65it/s]
 23%|██▎       | 1178/5021 [00:06<00:19, 194.33it/s]
 28%|██▊       | 1382/5021 [00:07<00:18, 197.79it/s]
 24%|██▍       | 1198/5021 [00:06<00:19, 194.72it/s]
 28%|██▊       | 1402/5021 [00:07<00:18, 197.84it/s]
 24%|██▍       | 1218/5021 [00:06<00:19, 195.28it/s]
 28%|██▊       | 1422/5021 [00:07<00:18, 198.08it/s]
 25%|██▍       | 1238/5021 [00:06<00:19, 195.91it/s]
 29%|██▊       | 1442/5021 [00:07<00:18, 197.85it/s]
 25%|██▌       | 1258/5021 [00:06<00:19, 195.80it/s]
 29%|██▉       | 1462/5021 [00:07<00:17, 197.72it/s]
 25%|██▌       | 1278/5021 [00:06<00:19, 195.81it/s]
 30%|██▉       | 1482/5021 [00:07<00:17, 197.78it/s]
 26%|██▌       | 1298/5021 [00:06<00:18, 196.06it/s]
 30%|██▉       | 1502/5021 [00:07<00:17, 198.13it/s]
 26%|██▌       | 1318/5021 [00:06<00:18, 195.70it/s]
 30%|███       | 1522/5021 [00:07<00:17, 198.57it/s]
 27%|██▋       | 1338/5021 [00:06<00:18, 195.40it/s]
 31%|███       | 1542/5021 [00:07<00:17, 198.29it/s]
 27%|██▋       | 1358/5021 [00:07<00:18, 195.10it/s]
 31%|███       | 1562/5021 [00:07<00:17, 198.29it/s]
 27%|██▋       | 1378/5021 [00:07<00:18, 195.20it/s]
 32%|███▏      | 1582/5021 [00:08<00:17, 198.66it/s]
 28%|██▊       | 1398/5021 [00:07<00:18, 194.96it/s]
 32%|███▏      | 1602/5021 [00:08<00:17, 198.73it/s]
 28%|██▊       | 1418/5021 [00:07<00:18, 194.86it/s]
 32%|███▏      | 1622/5021 [00:08<00:17, 198.95it/s]
 29%|██▊       | 1438/5021 [00:07<00:18, 195.05it/s]
 33%|███▎      | 1642/5021 [00:08<00:16, 199.05it/s]
 29%|██▉       | 1458/5021 [00:07<00:18, 195.55it/s]
 33%|███▎      | 1663/5021 [00:08<00:16, 199.28it/s]
 29%|██▉       | 1478/5021 [00:07<00:18, 195.62it/s]
 34%|███▎      | 1684/5021 [00:08<00:16, 199.64it/s]
 30%|██▉       | 1498/5021 [00:07<00:18, 194.17it/s]
 34%|███▍      | 1704/5021 [00:08<00:16, 199.23it/s]
 30%|███       | 1518/5021 [00:07<00:18, 194.14it/s]
 34%|███▍      | 1725/5021 [00:08<00:16, 199.38it/s]
 31%|███       | 1538/5021 [00:07<00:17, 194.20it/s]
 35%|███▍      | 1745/5021 [00:08<00:16, 199.19it/s]
 31%|███       | 1558/5021 [00:08<00:17, 193.39it/s]
 35%|███▌      | 1765/5021 [00:08<00:16, 198.68it/s]
 31%|███▏      | 1578/5021 [00:08<00:17, 193.00it/s]
 36%|███▌      | 1785/5021 [00:09<00:16, 198.32it/s]
 32%|███▏      | 1598/5021 [00:08<00:17, 192.52it/s]
 36%|███▌      | 1805/5021 [00:09<00:16, 198.00it/s]
 32%|███▏      | 1618/5021 [00:08<00:17, 192.81it/s]
 36%|███▋      | 1825/5021 [00:09<00:16, 197.85it/s]
 33%|███▎      | 1638/5021 [00:08<00:17, 193.70it/s]
 37%|███▋      | 1845/5021 [00:09<00:16, 197.91it/s]
 33%|███▎      | 1658/5021 [00:08<00:17, 194.47it/s]
 37%|███▋      | 1865/5021 [00:09<00:15, 198.12it/s]
 33%|███▎      | 1678/5021 [00:08<00:17, 195.05it/s]
 38%|███▊      | 1885/5021 [00:09<00:15, 197.88it/s]
 34%|███▍      | 1698/5021 [00:08<00:16, 195.57it/s]
 38%|███▊      | 1905/5021 [00:09<00:15, 197.76it/s]
 34%|███▍      | 1718/5021 [00:08<00:16, 195.90it/s]
 38%|███▊      | 1925/5021 [00:09<00:15, 198.17it/s]
 35%|███▍      | 1738/5021 [00:08<00:16, 196.31it/s]
 39%|███▊      | 1945/5021 [00:09<00:15, 198.33it/s]
 35%|███▌      | 1758/5021 [00:09<00:16, 196.29it/s]
 39%|███▉      | 1965/5021 [00:09<00:15, 197.96it/s]
 35%|███▌      | 1778/5021 [00:09<00:16, 195.82it/s]
 40%|███▉      | 1985/5021 [00:10<00:15, 197.97it/s]
 36%|███▌      | 1798/5021 [00:09<00:16, 193.61it/s]
 40%|███▉      | 2006/5021 [00:10<00:15, 198.77it/s]
 36%|███▌      | 1818/5021 [00:09<00:16, 193.69it/s]
 40%|████      | 2026/5021 [00:10<00:15, 198.97it/s]
 37%|███▋      | 1838/5021 [00:09<00:16, 193.90it/s]
 41%|████      | 2046/5021 [00:10<00:14, 199.00it/s]
 37%|███▋      | 1858/5021 [00:09<00:16, 193.94it/s]
 41%|████      | 2066/5021 [00:10<00:14, 199.01it/s]
 37%|███▋      | 1878/5021 [00:09<00:16, 194.10it/s]
 42%|████▏     | 2086/5021 [00:10<00:14, 199.20it/s]
 38%|███▊      | 1898/5021 [00:09<00:16, 193.98it/s]
 42%|████▏     | 2106/5021 [00:10<00:14, 199.06it/s]
 42%|████▏     | 2126/5021 [00:10<00:14, 198.63it/s]
 38%|███▊      | 1918/5021 [00:09<00:16, 191.81it/s]
 43%|████▎     | 2146/5021 [00:10<00:14, 198.65it/s]
 39%|███▊      | 1938/5021 [00:10<00:16, 189.54it/s]
 43%|████▎     | 2166/5021 [00:10<00:14, 198.41it/s]
 39%|███▉      | 1957/5021 [00:10<00:16, 186.78it/s]
 44%|████▎     | 2186/5021 [00:11<00:14, 198.06it/s]
 39%|███▉      | 1977/5021 [00:10<00:16, 188.08it/s]
 44%|████▍     | 2206/5021 [00:11<00:14, 197.98it/s]
 40%|███▉      | 1997/5021 [00:10<00:15, 190.01it/s]
 44%|████▍     | 2226/5021 [00:11<00:14, 197.91it/s]
 40%|████      | 2017/5021 [00:10<00:15, 191.69it/s]
 45%|████▍     | 2246/5021 [00:11<00:14, 197.71it/s]
 41%|████      | 2037/5021 [00:10<00:15, 192.61it/s]
 45%|████▌     | 2266/5021 [00:11<00:13, 197.81it/s]
 41%|████      | 2057/5021 [00:10<00:15, 193.49it/s]
 46%|████▌     | 2286/5021 [00:11<00:13, 198.03it/s]
 41%|████▏     | 2077/5021 [00:10<00:15, 194.56it/s]
 46%|████▌     | 2306/5021 [00:11<00:13, 197.82it/s]
 42%|████▏     | 2097/5021 [00:10<00:14, 194.94it/s]
 46%|████▋     | 2326/5021 [00:11<00:13, 197.74it/s]
 42%|████▏     | 2117/5021 [00:10<00:14, 195.40it/s]
 47%|████▋     | 2346/5021 [00:11<00:13, 198.04it/s]
 43%|████▎     | 2137/5021 [00:11<00:14, 195.90it/s]
 47%|████▋     | 2366/5021 [00:12<00:13, 197.54it/s]
 43%|████▎     | 2157/5021 [00:11<00:14, 195.31it/s]
 48%|████▊     | 2386/5021 [00:12<00:13, 197.34it/s]
 43%|████▎     | 2177/5021 [00:11<00:14, 194.82it/s]
 48%|████▊     | 2406/5021 [00:12<00:13, 197.92it/s]
 44%|████▍     | 2197/5021 [00:11<00:14, 194.57it/s]
 48%|████▊     | 2426/5021 [00:12<00:13, 198.50it/s]
 44%|████▍     | 2217/5021 [00:11<00:14, 194.57it/s]
 49%|████▊     | 2447/5021 [00:12<00:12, 199.10it/s]
 45%|████▍     | 2237/5021 [00:11<00:14, 194.55it/s]
 49%|████▉     | 2467/5021 [00:12<00:12, 199.20it/s]
 45%|████▍     | 2257/5021 [00:11<00:14, 194.38it/s]
 50%|████▉     | 2487/5021 [00:12<00:12, 197.99it/s]
 45%|████▌     | 2277/5021 [00:11<00:14, 194.91it/s]
 50%|████▉     | 2507/5021 [00:12<00:12, 197.96it/s]
 46%|████▌     | 2297/5021 [00:11<00:13, 195.33it/s]
 50%|█████     | 2528/5021 [00:12<00:12, 198.52it/s]
 46%|████▌     | 2317/5021 [00:11<00:13, 195.42it/s]
 51%|█████     | 2548/5021 [00:12<00:12, 198.74it/s]
 47%|████▋     | 2337/5021 [00:12<00:13, 194.91it/s]
 51%|█████     | 2568/5021 [00:13<00:12, 198.88it/s]
 47%|████▋     | 2357/5021 [00:12<00:13, 195.27it/s]
 52%|█████▏    | 2588/5021 [00:13<00:12, 199.07it/s]
 47%|████▋     | 2377/5021 [00:12<00:13, 195.23it/s]
 52%|█████▏    | 2608/5021 [00:13<00:12, 198.90it/s]
 48%|████▊     | 2397/5021 [00:12<00:13, 195.20it/s]
 52%|█████▏    | 2628/5021 [00:13<00:12, 198.90it/s]
 48%|████▊     | 2417/5021 [00:12<00:13, 195.25it/s]
 53%|█████▎    | 2648/5021 [00:13<00:11, 198.54it/s]
 49%|████▊     | 2437/5021 [00:12<00:13, 195.80it/s]
 53%|█████▎    | 2668/5021 [00:13<00:11, 197.88it/s]
 49%|████▉     | 2457/5021 [00:12<00:13, 194.42it/s]
 54%|█████▎    | 2688/5021 [00:13<00:11, 198.27it/s]
 49%|████▉     | 2477/5021 [00:12<00:13, 192.75it/s]
 54%|█████▍    | 2708/5021 [00:13<00:11, 198.03it/s]
 50%|████▉     | 2497/5021 [00:12<00:13, 191.47it/s]
 54%|█████▍    | 2728/5021 [00:13<00:11, 197.95it/s]
 50%|█████     | 2517/5021 [00:12<00:12, 193.27it/s]
 55%|█████▍    | 2748/5021 [00:13<00:11, 198.33it/s]
 51%|█████     | 2537/5021 [00:13<00:12, 194.49it/s]
 55%|█████▌    | 2768/5021 [00:14<00:11, 197.93it/s]
 51%|█████     | 2557/5021 [00:13<00:12, 195.50it/s]
 56%|█████▌    | 2788/5021 [00:14<00:11, 197.88it/s]
 51%|█████▏    | 2577/5021 [00:13<00:12, 196.01it/s]
 56%|█████▌    | 2808/5021 [00:14<00:11, 198.35it/s]
 52%|█████▏    | 2597/5021 [00:13<00:12, 196.38it/s]
 56%|█████▋    | 2828/5021 [00:14<00:11, 197.91it/s]
 52%|█████▏    | 2617/5021 [00:13<00:12, 196.34it/s]
 57%|█████▋    | 2849/5021 [00:14<00:10, 198.55it/s]
 53%|█████▎    | 2637/5021 [00:13<00:12, 196.56it/s]
 57%|█████▋    | 2870/5021 [00:14<00:10, 199.18it/s]
 53%|█████▎    | 2657/5021 [00:13<00:12, 196.53it/s]
 58%|█████▊    | 2891/5021 [00:14<00:10, 199.85it/s]
 53%|█████▎    | 2677/5021 [00:13<00:11, 196.32it/s]
 58%|█████▊    | 2912/5021 [00:14<00:10, 200.30it/s]
 54%|█████▎    | 2697/5021 [00:13<00:11, 196.20it/s]
 58%|█████▊    | 2933/5021 [00:14<00:10, 199.78it/s]
 54%|█████▍    | 2717/5021 [00:14<00:11, 196.13it/s]
 59%|█████▉    | 2953/5021 [00:14<00:10, 199.36it/s]
 55%|█████▍    | 2737/5021 [00:14<00:11, 195.83it/s]
 59%|█████▉    | 2973/5021 [00:15<00:10, 198.69it/s]
 55%|█████▍    | 2757/5021 [00:14<00:11, 195.04it/s]
 60%|█████▉    | 2993/5021 [00:15<00:10, 197.86it/s]
 55%|█████▌    | 2777/5021 [00:14<00:11, 195.24it/s]
 60%|██████    | 3013/5021 [00:15<00:10, 198.18it/s]
 56%|█████▌    | 2797/5021 [00:14<00:11, 195.71it/s]
 60%|██████    | 3033/5021 [00:15<00:10, 198.17it/s]
 56%|█████▌    | 2817/5021 [00:14<00:11, 195.83it/s]
 61%|██████    | 3053/5021 [00:15<00:09, 197.54it/s]
 57%|█████▋    | 2837/5021 [00:14<00:11, 196.19it/s]
 61%|██████    | 3073/5021 [00:15<00:09, 198.14it/s]
 57%|█████▋    | 2857/5021 [00:14<00:11, 196.56it/s]
 62%|██████▏   | 3093/5021 [00:15<00:09, 198.40it/s]
 57%|█████▋    | 2877/5021 [00:14<00:10, 196.34it/s]
 62%|██████▏   | 3113/5021 [00:15<00:09, 198.62it/s]
 58%|█████▊    | 2897/5021 [00:14<00:10, 196.69it/s]
 62%|██████▏   | 3133/5021 [00:15<00:09, 197.06it/s]
 58%|█████▊    | 2917/5021 [00:15<00:10, 196.82it/s]
 63%|██████▎   | 3153/5021 [00:15<00:09, 196.45it/s]
 58%|█████▊    | 2937/5021 [00:15<00:10, 197.36it/s]
 63%|██████▎   | 3173/5021 [00:16<00:09, 196.06it/s]
 59%|█████▉    | 2957/5021 [00:15<00:10, 197.52it/s]
 64%|██████▎   | 3193/5021 [00:16<00:09, 196.03it/s]
 59%|█████▉    | 2977/5021 [00:15<00:10, 197.85it/s]
 64%|██████▍   | 3213/5021 [00:16<00:09, 195.24it/s]
 60%|█████▉    | 2997/5021 [00:15<00:10, 197.72it/s]
 64%|██████▍   | 3233/5021 [00:16<00:09, 195.81it/s]
 60%|██████    | 3017/5021 [00:15<00:10, 197.18it/s]
 65%|██████▍   | 3253/5021 [00:16<00:09, 196.31it/s]
 60%|██████    | 3037/5021 [00:15<00:10, 196.62it/s]
 65%|██████▌   | 3273/5021 [00:16<00:08, 196.72it/s]
 61%|██████    | 3057/5021 [00:15<00:09, 196.83it/s]
 66%|██████▌   | 3293/5021 [00:16<00:08, 197.15it/s]
 61%|██████▏   | 3077/5021 [00:15<00:09, 196.75it/s]
 66%|██████▌   | 3313/5021 [00:16<00:08, 197.63it/s]
 62%|██████▏   | 3097/5021 [00:15<00:09, 197.05it/s]
 66%|██████▋   | 3333/5021 [00:16<00:08, 197.62it/s]
 62%|██████▏   | 3117/5021 [00:16<00:09, 196.87it/s]
 67%|██████▋   | 3353/5021 [00:16<00:08, 197.64it/s]
 62%|██████▏   | 3137/5021 [00:16<00:09, 196.69it/s]
 67%|██████▋   | 3373/5021 [00:17<00:08, 197.62it/s]
 63%|██████▎   | 3157/5021 [00:16<00:09, 196.36it/s]
 68%|██████▊   | 3393/5021 [00:17<00:08, 197.23it/s]
 63%|██████▎   | 3177/5021 [00:16<00:09, 195.90it/s]
 68%|██████▊   | 3413/5021 [00:17<00:08, 196.81it/s]
 64%|██████▎   | 3197/5021 [00:16<00:09, 196.23it/s]
 68%|██████▊   | 3433/5021 [00:17<00:08, 196.51it/s]
 64%|██████▍   | 3217/5021 [00:16<00:09, 196.14it/s]
 69%|██████▉   | 3453/5021 [00:17<00:07, 196.48it/s]
 64%|██████▍   | 3237/5021 [00:16<00:09, 196.36it/s]
 69%|██████▉   | 3473/5021 [00:17<00:07, 196.74it/s]
 65%|██████▍   | 3257/5021 [00:16<00:08, 196.28it/s]
 70%|██████▉   | 3493/5021 [00:17<00:07, 196.88it/s]
 65%|██████▌   | 3277/5021 [00:16<00:08, 196.57it/s]
 70%|██████▉   | 3513/5021 [00:17<00:07, 196.80it/s]
 66%|██████▌   | 3297/5021 [00:16<00:08, 196.77it/s]
 70%|███████   | 3533/5021 [00:17<00:07, 196.85it/s]
 66%|██████▌   | 3317/5021 [00:17<00:08, 196.90it/s]
 71%|███████   | 3553/5021 [00:18<00:07, 197.24it/s]
 66%|██████▋   | 3337/5021 [00:17<00:08, 197.21it/s]
 71%|███████   | 3573/5021 [00:18<00:07, 197.21it/s]
 67%|██████▋   | 3357/5021 [00:17<00:08, 197.34it/s]
 72%|███████▏  | 3593/5021 [00:18<00:07, 197.55it/s]
 67%|██████▋   | 3377/5021 [00:17<00:08, 197.17it/s]
 72%|███████▏  | 3613/5021 [00:18<00:07, 197.72it/s]
 68%|██████▊   | 3397/5021 [00:17<00:08, 195.66it/s]
 72%|███████▏  | 3633/5021 [00:18<00:07, 197.67it/s]
 68%|██████▊   | 3417/5021 [00:17<00:08, 195.62it/s]
 73%|███████▎  | 3653/5021 [00:18<00:06, 197.91it/s]
 68%|██████▊   | 3437/5021 [00:17<00:08, 195.19it/s]
 73%|███████▎  | 3673/5021 [00:18<00:06, 198.36it/s]
 69%|██████▉   | 3457/5021 [00:17<00:08, 194.55it/s]
 74%|███████▎  | 3693/5021 [00:18<00:06, 198.40it/s]
 69%|██████▉   | 3477/5021 [00:17<00:07, 194.83it/s]
 74%|███████▍  | 3713/5021 [00:18<00:06, 198.74it/s]
 70%|██████▉   | 3497/5021 [00:17<00:07, 195.24it/s]
 74%|███████▍  | 3733/5021 [00:18<00:06, 198.59it/s]
 70%|███████   | 3517/5021 [00:18<00:07, 195.54it/s]
 75%|███████▍  | 3753/5021 [00:19<00:06, 198.15it/s]
 70%|███████   | 3537/5021 [00:18<00:07, 195.86it/s]
 75%|███████▌  | 3773/5021 [00:19<00:06, 195.90it/s]
 71%|███████   | 3557/5021 [00:18<00:07, 195.89it/s]
 76%|███████▌  | 3793/5021 [00:19<00:06, 196.09it/s]
 71%|███████   | 3577/5021 [00:18<00:07, 195.87it/s]
 76%|███████▌  | 3813/5021 [00:19<00:06, 196.71it/s]
 72%|███████▏  | 3597/5021 [00:18<00:07, 195.62it/s]
 76%|███████▋  | 3833/5021 [00:19<00:06, 197.01it/s]
 72%|███████▏  | 3617/5021 [00:18<00:07, 195.18it/s]
 77%|███████▋  | 3853/5021 [00:19<00:05, 197.15it/s]
 72%|███████▏  | 3637/5021 [00:18<00:07, 195.72it/s]
 77%|███████▋  | 3873/5021 [00:19<00:05, 197.81it/s]
 73%|███████▎  | 3657/5021 [00:18<00:06, 195.63it/s]
 78%|███████▊  | 3893/5021 [00:19<00:05, 197.84it/s]
 73%|███████▎  | 3677/5021 [00:18<00:06, 195.63it/s]
 78%|███████▊  | 3913/5021 [00:19<00:05, 197.93it/s]
 74%|███████▎  | 3697/5021 [00:18<00:06, 195.91it/s]
 78%|███████▊  | 3933/5021 [00:19<00:05, 198.23it/s]
 74%|███████▍  | 3717/5021 [00:19<00:06, 196.16it/s]
 79%|███████▊  | 3953/5021 [00:20<00:05, 197.82it/s]
 74%|███████▍  | 3737/5021 [00:19<00:06, 196.57it/s]
 79%|███████▉  | 3973/5021 [00:20<00:05, 197.67it/s]
 75%|███████▍  | 3757/5021 [00:19<00:06, 196.43it/s]
 80%|███████▉  | 3993/5021 [00:20<00:05, 197.69it/s]
 75%|███████▌  | 3777/5021 [00:19<00:06, 196.77it/s]
 80%|███████▉  | 4014/5021 [00:20<00:05, 198.42it/s]
 76%|███████▌  | 3797/5021 [00:19<00:06, 196.22it/s]
 80%|████████  | 4034/5021 [00:20<00:04, 198.46it/s]
 76%|███████▌  | 3817/5021 [00:19<00:06, 196.00it/s]
 81%|████████  | 4054/5021 [00:20<00:04, 198.74it/s]
 76%|███████▋  | 3837/5021 [00:19<00:06, 195.69it/s]
 81%|████████  | 4074/5021 [00:20<00:04, 199.06it/s]
 77%|███████▋  | 3857/5021 [00:19<00:05, 195.20it/s]
 82%|████████▏ | 4094/5021 [00:20<00:04, 198.69it/s]
 77%|███████▋  | 3877/5021 [00:19<00:05, 195.08it/s]
 82%|████████▏ | 4114/5021 [00:20<00:04, 198.68it/s]
 78%|███████▊  | 3897/5021 [00:20<00:05, 194.92it/s]
 82%|████████▏ | 4134/5021 [00:20<00:04, 198.97it/s]
 78%|███████▊  | 3917/5021 [00:20<00:05, 195.15it/s]
 83%|████████▎ | 4154/5021 [00:21<00:04, 198.11it/s]
 78%|███████▊  | 3937/5021 [00:20<00:05, 194.22it/s]
 83%|████████▎ | 4174/5021 [00:21<00:04, 198.21it/s]
 79%|███████▉  | 3957/5021 [00:20<00:05, 195.10it/s]
 84%|████████▎ | 4194/5021 [00:21<00:04, 198.10it/s]
 79%|███████▉  | 3977/5021 [00:20<00:05, 195.53it/s]
 84%|████████▍ | 4214/5021 [00:21<00:04, 197.95it/s]
 80%|███████▉  | 3997/5021 [00:20<00:05, 195.93it/s]
 84%|████████▍ | 4234/5021 [00:21<00:03, 197.84it/s]
 80%|████████  | 4017/5021 [00:20<00:05, 193.77it/s]
 85%|████████▍ | 4254/5021 [00:21<00:03, 197.80it/s]
 80%|████████  | 4037/5021 [00:20<00:05, 193.45it/s]
 85%|████████▌ | 4274/5021 [00:21<00:03, 197.85it/s]
 81%|████████  | 4057/5021 [00:20<00:04, 194.49it/s]
 86%|████████▌ | 4294/5021 [00:21<00:03, 197.13it/s]
 81%|████████  | 4077/5021 [00:20<00:04, 195.35it/s]
 86%|████████▌ | 4314/5021 [00:21<00:03, 197.77it/s]
 82%|████████▏ | 4097/5021 [00:21<00:04, 196.15it/s]
 86%|████████▋ | 4334/5021 [00:21<00:03, 197.65it/s]
 82%|████████▏ | 4117/5021 [00:21<00:04, 196.85it/s]
 87%|████████▋ | 4354/5021 [00:22<00:03, 197.03it/s]
 82%|████████▏ | 4137/5021 [00:21<00:04, 197.20it/s]
 87%|████████▋ | 4374/5021 [00:22<00:03, 196.63it/s]
 83%|████████▎ | 4157/5021 [00:21<00:04, 197.55it/s]
 88%|████████▊ | 4394/5021 [00:22<00:03, 197.37it/s]
 83%|████████▎ | 4177/5021 [00:21<00:04, 197.00it/s]
 88%|████████▊ | 4414/5021 [00:22<00:03, 197.54it/s]
 84%|████████▎ | 4197/5021 [00:21<00:04, 196.78it/s]
 88%|████████▊ | 4434/5021 [00:22<00:02, 197.99it/s]
 84%|████████▍ | 4217/5021 [00:21<00:04, 196.59it/s]
 89%|████████▊ | 4454/5021 [00:22<00:02, 198.15it/s]
 84%|████████▍ | 4237/5021 [00:21<00:03, 196.26it/s]
 89%|████████▉ | 4474/5021 [00:22<00:02, 198.18it/s]
 85%|████████▍ | 4257/5021 [00:21<00:03, 195.85it/s]
 90%|████████▉ | 4494/5021 [00:22<00:02, 197.95it/s]
 85%|████████▌ | 4277/5021 [00:21<00:03, 195.89it/s]
 90%|████████▉ | 4514/5021 [00:22<00:02, 198.27it/s]
 86%|████████▌ | 4297/5021 [00:22<00:03, 195.92it/s]
 90%|█████████ | 4534/5021 [00:22<00:02, 198.36it/s]
 86%|████████▌ | 4317/5021 [00:22<00:03, 195.69it/s]
 91%|█████████ | 4554/5021 [00:23<00:02, 198.39it/s]
 86%|████████▋ | 4337/5021 [00:22<00:03, 195.69it/s]
 91%|█████████ | 4574/5021 [00:23<00:02, 198.11it/s]
 91%|█████████▏| 4594/5021 [00:23<00:02, 197.95it/s]
 87%|████████▋ | 4357/5021 [00:22<00:03, 195.60it/s]
 92%|█████████▏| 4614/5021 [00:23<00:02, 197.89it/s]
 87%|████████▋ | 4377/5021 [00:22<00:03, 195.86it/s]
 92%|█████████▏| 4634/5021 [00:23<00:01, 197.15it/s]
 88%|████████▊ | 4397/5021 [00:22<00:03, 195.85it/s]
 93%|█████████▎| 4654/5021 [00:23<00:01, 196.96it/s]
 88%|████████▊ | 4417/5021 [00:22<00:03, 195.86it/s]
 93%|█████████▎| 4674/5021 [00:23<00:01, 196.63it/s]
 88%|████████▊ | 4437/5021 [00:22<00:02, 195.95it/s]
 93%|█████████▎| 4694/5021 [00:23<00:01, 196.32it/s]
 89%|████████▉ | 4457/5021 [00:22<00:02, 196.19it/s]
 89%|████████▉ | 4477/5021 [00:22<00:02, 196.26it/s]
 94%|█████████▍| 4714/5021 [00:23<00:01, 193.47it/s]
 90%|████████▉ | 4497/5021 [00:23<00:02, 196.85it/s]
 94%|█████████▍| 4734/5021 [00:23<00:01, 194.83it/s]
 90%|████████▉ | 4517/5021 [00:23<00:02, 197.32it/s]
 95%|█████████▍| 4754/5021 [00:24<00:01, 195.53it/s]
 90%|█████████ | 4537/5021 [00:23<00:02, 195.97it/s]
 95%|█████████▌| 4774/5021 [00:24<00:01, 196.47it/s]
 91%|█████████ | 4557/5021 [00:23<00:02, 196.71it/s]
 95%|█████████▌| 4794/5021 [00:24<00:01, 197.02it/s]
 91%|█████████ | 4577/5021 [00:23<00:02, 197.06it/s]
 96%|█████████▌| 4814/5021 [00:24<00:01, 197.42it/s]
 92%|█████████▏| 4597/5021 [00:23<00:02, 197.12it/s]
 96%|█████████▋| 4834/5021 [00:24<00:00, 197.82it/s]
 92%|█████████▏| 4617/5021 [00:23<00:02, 197.14it/s]
 97%|█████████▋| 4854/5021 [00:24<00:00, 198.18it/s]
 92%|█████████▏| 4637/5021 [00:23<00:01, 197.05it/s]
 97%|█████████▋| 4875/5021 [00:24<00:00, 198.79it/s]
 93%|█████████▎| 4657/5021 [00:23<00:01, 195.22it/s]
 98%|█████████▊| 4896/5021 [00:24<00:00, 199.46it/s]
 93%|█████████▎| 4677/5021 [00:24<00:01, 194.74it/s]
 98%|█████████▊| 4916/5021 [00:24<00:00, 199.29it/s]
 98%|█████████▊| 4936/5021 [00:25<00:00, 199.29it/s]
 94%|█████████▎| 4697/5021 [00:24<00:01, 194.26it/s]
 99%|█████████▊| 4956/5021 [00:25<00:00, 198.05it/s]
 94%|█████████▍| 4717/5021 [00:24<00:01, 193.73it/s]
 99%|█████████▉| 4976/5021 [00:25<00:00, 197.92it/s]
 94%|█████████▍| 4737/5021 [00:24<00:01, 194.24it/s]
100%|█████████▉| 4996/5021 [00:25<00:00, 197.56it/s]
 95%|█████████▍| 4757/5021 [00:24<00:01, 193.89it/s]
100%|█████████▉| 5016/5021 [00:25<00:00, 197.37it/s]
 95%|█████████▌| 4777/5021 [00:24<00:01, 193.76it/s]
100%|██████████| 5021/5021 [00:25<00:00, 197.40it/s]

 96%|█████████▌| 4797/5021 [00:24<00:01, 193.85it/s]
 96%|█████████▌| 4817/5021 [00:24<00:01, 193.94it/s]
 96%|█████████▋| 4837/5021 [00:24<00:00, 194.36it/s]
 97%|█████████▋| 4857/5021 [00:24<00:00, 194.65it/s]
 97%|█████████▋| 4877/5021 [00:25<00:00, 194.84it/s]
 98%|█████████▊| 4897/5021 [00:25<00:00, 195.20it/s]
 98%|█████████▊| 4917/5021 [00:25<00:00, 195.75it/s]
 98%|█████████▊| 4937/5021 [00:25<00:00, 196.05it/s]
 99%|█████████▊| 4957/5021 [00:25<00:00, 196.09it/s]
 99%|█████████▉| 4977/5021 [00:25<00:00, 196.49it/s]
100%|█████████▉| 4997/5021 [00:25<00:00, 196.75it/s]
100%|█████████▉| 5017/5021 [00:25<00:00, 196.78it/s]
100%|██████████| 5021/5021 [00:25<00:00, 194.88it/s]
n136-128-154:1862446:1862446 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862446:1862446 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862446:1862446 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:1862446:1862446 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1862446:1862446 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:1862447:1862447 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:1862447:1862447 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862447:1862447 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862447:1862447 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:1862447:1862447 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:1862446:1862683 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1862446:1862683 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1862447:1862684 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:1862447:1862684 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:1862446:1862683 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862446:1862683 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862446:1862683 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1862447:1862684 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:1862447:1862684 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:1862447:1862684 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:1862446:1862683 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1862446:1862683 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1862446:1862683 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:1862446:1862683 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1862446:1862683 [0] NCCL INFO Using network IB
n136-128-154:1862447:1862684 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:1862447:1862684 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:1862447:1862684 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:1862447:1862684 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:1862447:1862684 [1] NCCL INFO Using network IB
n136-128-154:1862446:1862683 [0] NCCL INFO ncclCommInitRankConfig comm 0xe17bf30 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd9077272157001ae - Init START
n136-128-154:1862447:1862684 [1] NCCL INFO ncclCommInitRankConfig comm 0xdd95b90 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd9077272157001ae - Init START
n136-128-154:1862446:1862683 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1862447:1862684 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:1862446:1862683 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1862446:1862683 [0] NCCL INFO Retrieving state for IB
n136-128-154:1862446:1862683 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:1862446:1862683 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1862446:1862683 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1862446:1862683 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1862447:1862684 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:1862447:1862684 [1] NCCL INFO Retrieving state for IB
n136-128-154:1862447:1862684 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:1862446:1862683 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1862447:1862684 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:1862447:1862684 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:1862447:1862684 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:1862447:1862684 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:1862446:1862683 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862447:1862684 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862446:1862683 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862447:1862684 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:1862446:1862683 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1862446:1862683 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1862446:1862683 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1862446:1862683 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1862446:1862683 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1862446:1862683 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1862446:1862683 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1862446:1862683 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1862446:1862683 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1862446:1862683 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1862446:1862683 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1862446:1862683 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1862446:1862683 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1862446:1862683 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1862446:1862683 [0] NCCL INFO ==========================================
n136-128-154:1862446:1862683 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862446:1862683 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862446:1862683 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:1862447:1862684 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:1862447:1862684 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:1862447:1862684 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:1862447:1862684 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:1862447:1862684 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:1862447:1862684 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:1862447:1862684 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:1862447:1862684 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:1862447:1862684 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:1862447:1862684 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:1862447:1862684 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:1862447:1862684 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:1862447:1862684 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:1862447:1862684 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:1862447:1862684 [1] NCCL INFO ==========================================
n136-128-154:1862447:1862684 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862447:1862684 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:1862446:1862683 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1862447:1862684 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:1862446:1862683 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:1862447:1862684 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1862447:1862684 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862447:1862684 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:1862446:1862683 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:1862446:1862683 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862446:1862683 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:1862447:1862684 [1] NCCL INFO comm 0xdd95b90 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:1862446:1862683 [0] NCCL INFO comm 0xe17bf30 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862447:1862684 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:1862447:1862684 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:1862447:1862684 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:1862447:1862684 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:1862446:1862683 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:1862446:1862683 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:1862446:1862683 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1862446:1862683 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:1862446:1862697 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 108
n136-128-154:1862446:1862696 [0] NCCL INFO [Proxy Service] Device 0 CPU core 107
n136-128-154:1862447:1862684 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:1862447:1862698 [1] NCCL INFO [Proxy Service] Device 1 CPU core 34
n136-128-154:1862447:1862699 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 100
n136-128-154:1862446:1862683 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1862446:1862683 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1862447:1862684 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:1862447:1862684 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:1862446:1862683 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:1862447:1862684 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1862447:1862684 [1] NCCL INFO ncclCommInitRankConfig comm 0xdd95b90 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd9077272157001ae - Init COMPLETE
n136-128-154:1862447:1862684 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.86 (kernels 0.23, alloc 0.40, bootstrap 0.00, allgathers 0.01, topo 0.08, graphs 0.00, connections 0.02, rest 0.12)
n136-128-154:1862446:1862683 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:1862446:1862683 [0] NCCL INFO ncclCommInitRankConfig comm 0xe17bf30 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd9077272157001ae - Init COMPLETE
n136-128-154:1862446:1862683 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.87 (kernels 0.23, alloc 0.40, bootstrap 0.01, allgathers 0.00, topo 0.08, graphs 0.00, connections 0.02, rest 0.12)
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862446:1862700 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1862701 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:1862446:1862700 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-07:00:53:44 INFO     [evaluator:559] Running loglikelihood requests
2025-12-07:00:53:44 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/20084 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 57
Determined largest batch size: 57

Running loglikelihood requests:   0%|          | 1/20084 [00:40<223:48:06, 40.12s/it]
Running loglikelihood requests:   0%|          | 58/20084 [00:45<3:12:23,  1.73it/s] 
Running loglikelihood requests:   1%|          | 115/20084 [00:50<1:36:00,  3.47it/s]
Running loglikelihood requests:   1%|          | 172/20084 [00:54<1:04:31,  5.14it/s]
Running loglikelihood requests:   1%|          | 229/20084 [00:59<49:31,  6.68it/s]  
Running loglikelihood requests:   1%|▏         | 286/20084 [01:03<41:10,  8.01it/s]
Running loglikelihood requests:   2%|▏         | 343/20084 [01:08<36:01,  9.13it/s]
Running loglikelihood requests:   2%|▏         | 400/20084 [01:13<32:46, 10.01it/s]
Running loglikelihood requests:   2%|▏         | 457/20084 [01:17<30:37, 10.68it/s]
Running loglikelihood requests:   3%|▎         | 514/20084 [01:22<28:59, 11.25it/s]
Running loglikelihood requests:   3%|▎         | 571/20084 [01:26<27:49, 11.69it/s]
Running loglikelihood requests:   3%|▎         | 628/20084 [01:31<27:06, 11.96it/s]
Running loglikelihood requests:   3%|▎         | 685/20084 [01:35<26:35, 12.15it/s]
Running loglikelihood requests:   4%|▎         | 742/20084 [01:39<25:59, 12.41it/s]
Running loglikelihood requests:   4%|▍         | 799/20084 [01:44<25:31, 12.60it/s]
Running loglikelihood requests:   4%|▍         | 856/20084 [01:48<25:08, 12.74it/s]
Running loglikelihood requests:   5%|▍         | 913/20084 [01:53<24:51, 12.85it/s]
Running loglikelihood requests:   5%|▍         | 970/20084 [01:57<24:37, 12.94it/s]
Running loglikelihood requests:   5%|▌         | 1027/20084 [02:01<24:26, 13.00it/s]
Running loglikelihood requests:   5%|▌         | 1084/20084 [02:06<24:14, 13.06it/s]
Running loglikelihood requests:   6%|▌         | 1141/20084 [02:10<24:04, 13.11it/s]
Running loglikelihood requests:   6%|▌         | 1198/20084 [02:14<23:55, 13.16it/s]
Running loglikelihood requests:   6%|▌         | 1255/20084 [02:18<23:46, 13.20it/s]
Running loglikelihood requests:   7%|▋         | 1312/20084 [02:23<23:39, 13.22it/s]
Running loglikelihood requests:   7%|▋         | 1369/20084 [02:27<23:33, 13.24it/s]
Running loglikelihood requests:   7%|▋         | 1426/20084 [02:31<23:25, 13.27it/s]
Running loglikelihood requests:   7%|▋         | 1483/20084 [02:36<23:18, 13.30it/s]
Running loglikelihood requests:   8%|▊         | 1540/20084 [02:40<23:10, 13.33it/s]
Running loglikelihood requests:   8%|▊         | 1597/20084 [02:44<23:03, 13.36it/s]
Running loglikelihood requests:   8%|▊         | 1654/20084 [02:48<22:56, 13.39it/s]
Running loglikelihood requests:   9%|▊         | 1711/20084 [02:53<22:50, 13.40it/s]
Running loglikelihood requests:   9%|▉         | 1768/20084 [02:57<22:44, 13.42it/s]
Running loglikelihood requests:   9%|▉         | 1825/20084 [03:01<22:38, 13.44it/s]
Running loglikelihood requests:   9%|▉         | 1882/20084 [03:05<22:32, 13.46it/s]
Running loglikelihood requests:  10%|▉         | 1939/20084 [03:09<22:26, 13.48it/s]
Running loglikelihood requests:  10%|▉         | 1996/20084 [03:14<22:19, 13.50it/s]
Running loglikelihood requests:  10%|█         | 2053/20084 [03:18<22:13, 13.52it/s]
Running loglikelihood requests:  11%|█         | 2110/20084 [03:22<22:07, 13.54it/s]
Running loglikelihood requests:  11%|█         | 2167/20084 [03:26<22:00, 13.57it/s]
Running loglikelihood requests:  11%|█         | 2224/20084 [03:30<21:54, 13.59it/s]
Running loglikelihood requests:  11%|█▏        | 2281/20084 [03:35<21:48, 13.60it/s]
Running loglikelihood requests:  12%|█▏        | 2338/20084 [03:39<21:42, 13.62it/s]
Running loglikelihood requests:  12%|█▏        | 2395/20084 [03:43<21:36, 13.64it/s]
Running loglikelihood requests:  12%|█▏        | 2452/20084 [03:47<21:30, 13.67it/s]
Running loglikelihood requests:  12%|█▏        | 2509/20084 [03:51<21:24, 13.68it/s]
Running loglikelihood requests:  13%|█▎        | 2566/20084 [03:55<21:18, 13.70it/s]
Running loglikelihood requests:  13%|█▎        | 2623/20084 [04:00<21:12, 13.72it/s]
Running loglikelihood requests:  13%|█▎        | 2680/20084 [04:04<21:07, 13.73it/s]
Running loglikelihood requests:  14%|█▎        | 2737/20084 [04:08<21:01, 13.75it/s]
Running loglikelihood requests:  14%|█▍        | 2794/20084 [04:12<20:55, 13.78it/s]
Running loglikelihood requests:  14%|█▍        | 2851/20084 [04:16<20:50, 13.78it/s]
Running loglikelihood requests:  14%|█▍        | 2908/20084 [04:20<20:44, 13.80it/s]
Running loglikelihood requests:  15%|█▍        | 2965/20084 [04:24<20:38, 13.82it/s]
Running loglikelihood requests:  15%|█▌        | 3022/20084 [04:28<20:33, 13.84it/s]
Running loglikelihood requests:  15%|█▌        | 3079/20084 [04:32<20:28, 13.84it/s]
Running loglikelihood requests:  16%|█▌        | 3136/20084 [04:37<20:25, 13.83it/s]
Running loglikelihood requests:  16%|█▌        | 3193/20084 [04:41<20:20, 13.84it/s]
Running loglikelihood requests:  16%|█▌        | 3250/20084 [04:45<20:14, 13.86it/s]
Running loglikelihood requests:  16%|█▋        | 3307/20084 [04:49<20:07, 13.89it/s]
Running loglikelihood requests:  17%|█▋        | 3364/20084 [04:53<20:03, 13.90it/s]
Running loglikelihood requests:  17%|█▋        | 3421/20084 [04:57<19:56, 13.93it/s]
Running loglikelihood requests:  17%|█▋        | 3478/20084 [05:01<19:51, 13.94it/s]
Running loglikelihood requests:  18%|█▊        | 3535/20084 [05:05<19:46, 13.95it/s]
Running loglikelihood requests:  18%|█▊        | 3592/20084 [05:09<19:40, 13.97it/s]
Running loglikelihood requests:  18%|█▊        | 3649/20084 [05:13<19:35, 13.98it/s]
Running loglikelihood requests:  18%|█▊        | 3706/20084 [05:17<19:29, 14.00it/s]
Running loglikelihood requests:  19%|█▊        | 3763/20084 [05:22<19:26, 13.99it/s]
Running loglikelihood requests:  19%|█▉        | 3820/20084 [05:26<19:22, 13.99it/s]
Running loglikelihood requests:  19%|█▉        | 3877/20084 [05:30<19:16, 14.02it/s]
Running loglikelihood requests:  20%|█▉        | 3934/20084 [05:34<19:09, 14.05it/s]
Running loglikelihood requests:  20%|█▉        | 3991/20084 [05:38<19:03, 14.07it/s]
Running loglikelihood requests:  20%|██        | 4048/20084 [05:42<18:58, 14.09it/s]
Running loglikelihood requests:  20%|██        | 4105/20084 [05:46<18:51, 14.12it/s]
Running loglikelihood requests:  21%|██        | 4162/20084 [05:50<18:45, 14.14it/s]
Running loglikelihood requests:  21%|██        | 4219/20084 [05:54<18:40, 14.15it/s]
Running loglikelihood requests:  21%|██▏       | 4276/20084 [05:58<18:35, 14.17it/s]
Running loglikelihood requests:  22%|██▏       | 4333/20084 [06:02<18:30, 14.19it/s]
Running loglikelihood requests:  22%|██▏       | 4390/20084 [06:06<18:24, 14.21it/s]
Running loglikelihood requests:  22%|██▏       | 4447/20084 [06:10<18:20, 14.21it/s]
Running loglikelihood requests:  22%|██▏       | 4504/20084 [06:14<18:13, 14.24it/s]
Running loglikelihood requests:  23%|██▎       | 4561/20084 [06:18<18:08, 14.26it/s]
Running loglikelihood requests:  23%|██▎       | 4618/20084 [06:22<17:59, 14.33it/s]
Running loglikelihood requests:  23%|██▎       | 4675/20084 [06:26<17:51, 14.38it/s]
Running loglikelihood requests:  24%|██▎       | 4732/20084 [06:30<17:45, 14.41it/s]
Running loglikelihood requests:  24%|██▍       | 4789/20084 [06:34<17:39, 14.44it/s]
Running loglikelihood requests:  24%|██▍       | 4846/20084 [06:37<17:34, 14.46it/s]
Running loglikelihood requests:  24%|██▍       | 4903/20084 [06:41<17:31, 14.44it/s]
Running loglikelihood requests:  25%|██▍       | 4960/20084 [06:45<17:28, 14.42it/s]
Running loglikelihood requests:  25%|██▍       | 5017/20084 [06:49<17:25, 14.42it/s]
Running loglikelihood requests:  25%|██▌       | 5074/20084 [06:53<17:20, 14.42it/s]
Running loglikelihood requests:  26%|██▌       | 5131/20084 [06:57<17:16, 14.42it/s]
Running loglikelihood requests:  26%|██▌       | 5188/20084 [07:01<17:12, 14.43it/s]
Running loglikelihood requests:  26%|██▌       | 5245/20084 [07:05<17:07, 14.44it/s]
Running loglikelihood requests:  26%|██▋       | 5302/20084 [07:09<17:03, 14.44it/s]
Running loglikelihood requests:  27%|██▋       | 5359/20084 [07:13<16:59, 14.45it/s]
Running loglikelihood requests:  27%|██▋       | 5416/20084 [07:17<16:54, 14.45it/s]
Running loglikelihood requests:  27%|██▋       | 5473/20084 [07:21<16:50, 14.46it/s]
Running loglikelihood requests:  28%|██▊       | 5530/20084 [07:25<16:45, 14.47it/s]
Running loglikelihood requests:  28%|██▊       | 5587/20084 [07:29<16:40, 14.49it/s]
Running loglikelihood requests:  28%|██▊       | 5644/20084 [07:33<16:35, 14.50it/s]
Running loglikelihood requests:  28%|██▊       | 5701/20084 [07:37<16:31, 14.51it/s]
Running loglikelihood requests:  29%|██▊       | 5758/20084 [07:40<16:27, 14.51it/s]
Running loglikelihood requests:  29%|██▉       | 5815/20084 [07:44<16:19, 14.57it/s]
Running loglikelihood requests:  29%|██▉       | 5872/20084 [07:48<16:12, 14.61it/s]
Running loglikelihood requests:  30%|██▉       | 5929/20084 [07:52<16:07, 14.63it/s]
Running loglikelihood requests:  30%|██▉       | 5986/20084 [07:56<16:01, 14.66it/s]
Running loglikelihood requests:  30%|███       | 6043/20084 [08:00<15:57, 14.66it/s]
Running loglikelihood requests:  30%|███       | 6100/20084 [08:04<15:53, 14.66it/s]
Running loglikelihood requests:  31%|███       | 6157/20084 [08:08<15:48, 14.68it/s]
Running loglikelihood requests:  31%|███       | 6214/20084 [08:12<15:44, 14.69it/s]
Running loglikelihood requests:  31%|███       | 6271/20084 [08:15<15:39, 14.70it/s]
Running loglikelihood requests:  32%|███▏      | 6328/20084 [08:19<15:35, 14.71it/s]
Running loglikelihood requests:  32%|███▏      | 6385/20084 [08:23<15:31, 14.71it/s]
Running loglikelihood requests:  32%|███▏      | 6442/20084 [08:27<15:26, 14.72it/s]
Running loglikelihood requests:  32%|███▏      | 6499/20084 [08:31<15:22, 14.72it/s]
Running loglikelihood requests:  33%|███▎      | 6556/20084 [08:35<15:18, 14.73it/s]
Running loglikelihood requests:  33%|███▎      | 6613/20084 [08:39<15:14, 14.74it/s]
Running loglikelihood requests:  33%|███▎      | 6670/20084 [08:42<15:08, 14.76it/s]
Running loglikelihood requests:  33%|███▎      | 6727/20084 [08:46<15:03, 14.78it/s]
Running loglikelihood requests:  34%|███▍      | 6784/20084 [08:50<14:59, 14.79it/s]
Running loglikelihood requests:  34%|███▍      | 6841/20084 [08:54<14:55, 14.80it/s]
Running loglikelihood requests:  34%|███▍      | 6898/20084 [08:58<14:50, 14.81it/s]
Running loglikelihood requests:  35%|███▍      | 6955/20084 [09:02<14:45, 14.82it/s]
Running loglikelihood requests:  35%|███▍      | 7012/20084 [09:06<14:41, 14.82it/s]
Running loglikelihood requests:  35%|███▌      | 7069/20084 [09:09<14:36, 14.84it/s]
Running loglikelihood requests:  35%|███▌      | 7126/20084 [09:13<14:29, 14.90it/s]
Running loglikelihood requests:  36%|███▌      | 7183/20084 [09:17<14:23, 14.93it/s]
Running loglikelihood requests:  36%|███▌      | 7240/20084 [09:21<14:19, 14.95it/s]
Running loglikelihood requests:  36%|███▋      | 7297/20084 [09:25<14:15, 14.95it/s]
Running loglikelihood requests:  37%|███▋      | 7354/20084 [09:28<14:12, 14.93it/s]
Running loglikelihood requests:  37%|███▋      | 7411/20084 [09:32<14:08, 14.94it/s]
Running loglikelihood requests:  37%|███▋      | 7468/20084 [09:36<14:04, 14.94it/s]
Running loglikelihood requests:  37%|███▋      | 7525/20084 [09:40<14:01, 14.93it/s]
Running loglikelihood requests:  38%|███▊      | 7582/20084 [09:44<13:56, 14.95it/s]
Running loglikelihood requests:  38%|███▊      | 7639/20084 [09:47<13:52, 14.95it/s]
Running loglikelihood requests:  38%|███▊      | 7696/20084 [09:51<13:48, 14.94it/s]
Running loglikelihood requests:  39%|███▊      | 7753/20084 [09:55<13:43, 14.97it/s]
Running loglikelihood requests:  39%|███▉      | 7810/20084 [09:59<13:38, 14.99it/s]
Running loglikelihood requests:  39%|███▉      | 7867/20084 [10:03<13:34, 15.01it/s]
Running loglikelihood requests:  39%|███▉      | 7924/20084 [10:06<13:29, 15.03it/s]
Running loglikelihood requests:  40%|███▉      | 7981/20084 [10:10<13:25, 15.03it/s]
Running loglikelihood requests:  40%|████      | 8038/20084 [10:14<13:20, 15.05it/s]
Running loglikelihood requests:  40%|████      | 8095/20084 [10:18<13:15, 15.07it/s]
Running loglikelihood requests:  41%|████      | 8152/20084 [10:22<13:11, 15.08it/s]
Running loglikelihood requests:  41%|████      | 8209/20084 [10:25<13:06, 15.09it/s]
Running loglikelihood requests:  41%|████      | 8266/20084 [10:29<13:02, 15.10it/s]
Running loglikelihood requests:  41%|████▏     | 8323/20084 [10:33<12:58, 15.11it/s]
Running loglikelihood requests:  42%|████▏     | 8380/20084 [10:37<12:53, 15.12it/s]
Running loglikelihood requests:  42%|████▏     | 8437/20084 [10:40<12:49, 15.14it/s]
Running loglikelihood requests:  42%|████▏     | 8494/20084 [10:44<12:45, 15.14it/s]
Running loglikelihood requests:  43%|████▎     | 8551/20084 [10:48<12:38, 15.20it/s]
Running loglikelihood requests:  43%|████▎     | 8608/20084 [10:52<12:33, 15.24it/s]
Running loglikelihood requests:  43%|████▎     | 8665/20084 [10:55<12:27, 15.27it/s]
Running loglikelihood requests:  43%|████▎     | 8722/20084 [10:59<12:25, 15.24it/s]
Running loglikelihood requests:  44%|████▎     | 8779/20084 [11:03<12:22, 15.23it/s]
Running loglikelihood requests:  44%|████▍     | 8836/20084 [11:07<12:18, 15.23it/s]
Running loglikelihood requests:  44%|████▍     | 8893/20084 [11:10<12:20, 15.10it/s]
Running loglikelihood requests:  45%|████▍     | 8950/20084 [11:14<12:21, 15.02it/s]
Running loglikelihood requests:  45%|████▍     | 9007/20084 [11:18<12:14, 15.09it/s]
Running loglikelihood requests:  45%|████▌     | 9064/20084 [11:22<12:08, 15.14it/s]
Running loglikelihood requests:  45%|████▌     | 9121/20084 [11:25<12:00, 15.22it/s]
Running loglikelihood requests:  46%|████▌     | 9178/20084 [11:29<12:02, 15.10it/s]
Running loglikelihood requests:  46%|████▌     | 9235/20084 [11:33<12:01, 15.04it/s]
Running loglikelihood requests:  46%|████▋     | 9292/20084 [11:37<11:53, 15.12it/s]
Running loglikelihood requests:  47%|████▋     | 9349/20084 [11:40<11:47, 15.18it/s]
Running loglikelihood requests:  47%|████▋     | 9406/20084 [11:44<11:41, 15.21it/s]
Running loglikelihood requests:  47%|████▋     | 9463/20084 [11:48<11:36, 15.25it/s]
Running loglikelihood requests:  47%|████▋     | 9520/20084 [11:52<11:31, 15.28it/s]
Running loglikelihood requests:  48%|████▊     | 9577/20084 [11:55<11:27, 15.28it/s]
Running loglikelihood requests:  48%|████▊     | 9634/20084 [11:59<11:22, 15.30it/s]
Running loglikelihood requests:  48%|████▊     | 9691/20084 [12:03<11:15, 15.37it/s]
Running loglikelihood requests:  49%|████▊     | 9748/20084 [12:06<11:10, 15.42it/s]
Running loglikelihood requests:  49%|████▉     | 9805/20084 [12:10<11:05, 15.45it/s]
Running loglikelihood requests:  49%|████▉     | 9862/20084 [12:14<11:01, 15.45it/s]
Running loglikelihood requests:  49%|████▉     | 9919/20084 [12:17<10:56, 15.48it/s]
Running loglikelihood requests:  50%|████▉     | 9976/20084 [12:21<10:54, 15.44it/s]
Running loglikelihood requests:  50%|████▉     | 10033/20084 [12:25<10:50, 15.45it/s]
Running loglikelihood requests:  50%|█████     | 10090/20084 [12:29<10:46, 15.46it/s]
Running loglikelihood requests:  51%|█████     | 10147/20084 [12:32<10:42, 15.47it/s]
Running loglikelihood requests:  51%|█████     | 10204/20084 [12:36<10:37, 15.49it/s]
Running loglikelihood requests:  51%|█████     | 10261/20084 [12:40<10:33, 15.51it/s]
Running loglikelihood requests:  51%|█████▏    | 10318/20084 [12:43<10:29, 15.52it/s]
Running loglikelihood requests:  52%|█████▏    | 10375/20084 [12:47<10:24, 15.54it/s]
Running loglikelihood requests:  52%|█████▏    | 10432/20084 [12:50<10:19, 15.59it/s]
Running loglikelihood requests:  52%|█████▏    | 10489/20084 [12:54<10:14, 15.62it/s]
Running loglikelihood requests:  53%|█████▎    | 10546/20084 [12:58<10:09, 15.65it/s]
Running loglikelihood requests:  53%|█████▎    | 10603/20084 [13:01<10:04, 15.67it/s]
Running loglikelihood requests:  53%|█████▎    | 10660/20084 [13:05<10:00, 15.70it/s]
Running loglikelihood requests:  53%|█████▎    | 10717/20084 [13:09<09:56, 15.71it/s]
Running loglikelihood requests:  54%|█████▎    | 10774/20084 [13:12<09:52, 15.72it/s]
Running loglikelihood requests:  54%|█████▍    | 10831/20084 [13:16<09:49, 15.70it/s]
Running loglikelihood requests:  54%|█████▍    | 10888/20084 [13:20<09:46, 15.68it/s]
Running loglikelihood requests:  54%|█████▍    | 10945/20084 [13:23<09:43, 15.66it/s]
Running loglikelihood requests:  55%|█████▍    | 11002/20084 [13:27<09:40, 15.65it/s]
Running loglikelihood requests:  55%|█████▌    | 11059/20084 [13:30<09:36, 15.66it/s]
Running loglikelihood requests:  55%|█████▌    | 11116/20084 [13:34<09:32, 15.67it/s]
Running loglikelihood requests:  56%|█████▌    | 11173/20084 [13:38<09:28, 15.67it/s]
Running loglikelihood requests:  56%|█████▌    | 11230/20084 [13:41<09:23, 15.73it/s]
Running loglikelihood requests:  56%|█████▌    | 11287/20084 [13:45<09:18, 15.76it/s]
Running loglikelihood requests:  56%|█████▋    | 11344/20084 [13:49<09:13, 15.79it/s]
Running loglikelihood requests:  57%|█████▋    | 11401/20084 [13:52<09:09, 15.81it/s]
Running loglikelihood requests:  57%|█████▋    | 11458/20084 [13:56<09:09, 15.70it/s]
Running loglikelihood requests:  57%|█████▋    | 11515/20084 [13:59<09:08, 15.61it/s]
Running loglikelihood requests:  58%|█████▊    | 11572/20084 [14:03<09:03, 15.67it/s]
Running loglikelihood requests:  58%|█████▊    | 11629/20084 [14:07<08:58, 15.70it/s]
Running loglikelihood requests:  58%|█████▊    | 11686/20084 [14:10<08:53, 15.74it/s]
Running loglikelihood requests:  58%|█████▊    | 11743/20084 [14:14<08:49, 15.75it/s]
Running loglikelihood requests:  59%|█████▉    | 11800/20084 [14:18<08:45, 15.75it/s]
Running loglikelihood requests:  59%|█████▉    | 11857/20084 [14:21<08:42, 15.75it/s]
Running loglikelihood requests:  59%|█████▉    | 11914/20084 [14:25<08:38, 15.75it/s]
Running loglikelihood requests:  60%|█████▉    | 11971/20084 [14:28<08:33, 15.81it/s]
Running loglikelihood requests:  60%|█████▉    | 12028/20084 [14:32<08:27, 15.87it/s]
Running loglikelihood requests:  60%|██████    | 12085/20084 [14:35<08:22, 15.91it/s]
Running loglikelihood requests:  60%|██████    | 12142/20084 [14:39<08:18, 15.94it/s]
Running loglikelihood requests:  61%|██████    | 12199/20084 [14:43<08:13, 15.98it/s]
Running loglikelihood requests:  61%|██████    | 12256/20084 [14:46<08:09, 15.98it/s]
Running loglikelihood requests:  61%|██████▏   | 12313/20084 [14:50<08:06, 15.97it/s]
Running loglikelihood requests:  62%|██████▏   | 12370/20084 [14:53<08:03, 15.96it/s]
Running loglikelihood requests:  62%|██████▏   | 12427/20084 [14:57<07:59, 15.98it/s]
Running loglikelihood requests:  62%|██████▏   | 12484/20084 [15:00<07:55, 15.99it/s]
Running loglikelihood requests:  62%|██████▏   | 12541/20084 [15:04<07:51, 16.01it/s]
Running loglikelihood requests:  63%|██████▎   | 12598/20084 [15:08<07:47, 16.02it/s]
Running loglikelihood requests:  63%|██████▎   | 12655/20084 [15:11<07:43, 16.02it/s]
Running loglikelihood requests:  63%|██████▎   | 12712/20084 [15:15<07:38, 16.08it/s]
Running loglikelihood requests:  64%|██████▎   | 12769/20084 [15:18<07:33, 16.12it/s]
Running loglikelihood requests:  64%|██████▍   | 12826/20084 [15:22<07:29, 16.16it/s]
Running loglikelihood requests:  64%|██████▍   | 12883/20084 [15:25<07:24, 16.19it/s]
Running loglikelihood requests:  64%|██████▍   | 12940/20084 [15:29<07:20, 16.21it/s]
Running loglikelihood requests:  65%|██████▍   | 12997/20084 [15:32<07:17, 16.20it/s]
Running loglikelihood requests:  65%|██████▍   | 13054/20084 [15:36<07:14, 16.19it/s]
Running loglikelihood requests:  65%|██████▌   | 13111/20084 [15:39<07:09, 16.23it/s]
Running loglikelihood requests:  66%|██████▌   | 13168/20084 [15:43<07:05, 16.26it/s]
Running loglikelihood requests:  66%|██████▌   | 13225/20084 [15:46<07:01, 16.29it/s]
Running loglikelihood requests:  66%|██████▌   | 13282/20084 [15:50<06:57, 16.31it/s]
Running loglikelihood requests:  66%|██████▋   | 13339/20084 [15:53<06:53, 16.31it/s]
Running loglikelihood requests:  67%|██████▋   | 13396/20084 [15:57<06:49, 16.34it/s]
Running loglikelihood requests:  67%|██████▋   | 13453/20084 [16:00<06:47, 16.26it/s]
Running loglikelihood requests:  67%|██████▋   | 13510/20084 [16:04<06:43, 16.31it/s]
Running loglikelihood requests:  68%|██████▊   | 13567/20084 [16:07<06:38, 16.34it/s]
Running loglikelihood requests:  68%|██████▊   | 13624/20084 [16:11<06:35, 16.34it/s]
Running loglikelihood requests:  68%|██████▊   | 13681/20084 [16:14<06:31, 16.35it/s]
Running loglikelihood requests:  68%|██████▊   | 13738/20084 [16:18<06:27, 16.36it/s]
Running loglikelihood requests:  69%|██████▊   | 13795/20084 [16:21<06:23, 16.38it/s]
Running loglikelihood requests:  69%|██████▉   | 13852/20084 [16:24<06:20, 16.39it/s]
Running loglikelihood requests:  69%|██████▉   | 13909/20084 [16:28<06:16, 16.39it/s]
Running loglikelihood requests:  70%|██████▉   | 13966/20084 [16:31<06:11, 16.46it/s]
Running loglikelihood requests:  70%|██████▉   | 14023/20084 [16:35<06:07, 16.50it/s]
Running loglikelihood requests:  70%|███████   | 14080/20084 [16:38<06:03, 16.53it/s]
Running loglikelihood requests:  70%|███████   | 14137/20084 [16:42<05:59, 16.56it/s]
Running loglikelihood requests:  71%|███████   | 14194/20084 [16:45<05:55, 16.59it/s]
Running loglikelihood requests:  71%|███████   | 14251/20084 [16:49<05:51, 16.62it/s]
Running loglikelihood requests:  71%|███████   | 14308/20084 [16:52<05:47, 16.64it/s]
Running loglikelihood requests:  72%|███████▏  | 14365/20084 [16:55<05:43, 16.66it/s]
Running loglikelihood requests:  72%|███████▏  | 14422/20084 [16:59<05:39, 16.68it/s]
Running loglikelihood requests:  72%|███████▏  | 14479/20084 [17:02<05:36, 16.68it/s]
Running loglikelihood requests:  72%|███████▏  | 14536/20084 [17:06<05:32, 16.70it/s]
Running loglikelihood requests:  73%|███████▎  | 14593/20084 [17:09<05:28, 16.70it/s]
Running loglikelihood requests:  73%|███████▎  | 14650/20084 [17:12<05:25, 16.72it/s]
Running loglikelihood requests:  73%|███████▎  | 14707/20084 [17:16<05:22, 16.69it/s]
Running loglikelihood requests:  74%|███████▎  | 14764/20084 [17:19<05:19, 16.67it/s]
Running loglikelihood requests:  74%|███████▍  | 14821/20084 [17:23<05:15, 16.66it/s]
Running loglikelihood requests:  74%|███████▍  | 14878/20084 [17:26<05:12, 16.67it/s]
Running loglikelihood requests:  74%|███████▍  | 14935/20084 [17:30<05:08, 16.67it/s]
Running loglikelihood requests:  75%|███████▍  | 14992/20084 [17:33<05:05, 16.68it/s]
Running loglikelihood requests:  75%|███████▍  | 15049/20084 [17:36<05:01, 16.69it/s]
Running loglikelihood requests:  75%|███████▌  | 15106/20084 [17:40<04:57, 16.73it/s]
Running loglikelihood requests:  75%|███████▌  | 15163/20084 [17:43<04:53, 16.79it/s]
Running loglikelihood requests:  76%|███████▌  | 15220/20084 [17:46<04:49, 16.81it/s]
Running loglikelihood requests:  76%|███████▌  | 15277/20084 [17:50<04:45, 16.84it/s]
Running loglikelihood requests:  76%|███████▋  | 15334/20084 [17:53<04:41, 16.87it/s]
Running loglikelihood requests:  77%|███████▋  | 15391/20084 [17:57<04:37, 16.89it/s]
Running loglikelihood requests:  77%|███████▋  | 15448/20084 [18:00<04:34, 16.92it/s]
Running loglikelihood requests:  77%|███████▋  | 15505/20084 [18:03<04:30, 16.93it/s]
Running loglikelihood requests:  77%|███████▋  | 15562/20084 [18:07<04:26, 16.94it/s]
Running loglikelihood requests:  78%|███████▊  | 15619/20084 [18:10<04:23, 16.96it/s]
Running loglikelihood requests:  78%|███████▊  | 15676/20084 [18:13<04:19, 16.98it/s]
Running loglikelihood requests:  78%|███████▊  | 15733/20084 [18:17<04:16, 16.98it/s]
Running loglikelihood requests:  79%|███████▊  | 15790/20084 [18:20<04:12, 17.03it/s]
Running loglikelihood requests:  79%|███████▉  | 15847/20084 [18:23<04:08, 17.05it/s]
Running loglikelihood requests:  79%|███████▉  | 15904/20084 [18:27<04:04, 17.07it/s]
Running loglikelihood requests:  79%|███████▉  | 15961/20084 [18:30<04:01, 17.05it/s]
Running loglikelihood requests:  80%|███████▉  | 16018/20084 [18:33<03:58, 17.04it/s]
Running loglikelihood requests:  80%|████████  | 16075/20084 [18:37<03:55, 17.05it/s]
Running loglikelihood requests:  80%|████████  | 16132/20084 [18:40<03:51, 17.05it/s]
Running loglikelihood requests:  81%|████████  | 16189/20084 [18:43<03:47, 17.10it/s]
Running loglikelihood requests:  81%|████████  | 16246/20084 [18:47<03:43, 17.14it/s]
Running loglikelihood requests:  81%|████████  | 16303/20084 [18:50<03:39, 17.19it/s]
Running loglikelihood requests:  81%|████████▏ | 16360/20084 [18:53<03:36, 17.22it/s]
Running loglikelihood requests:  82%|████████▏ | 16417/20084 [18:57<03:32, 17.26it/s]
Running loglikelihood requests:  82%|████████▏ | 16474/20084 [19:00<03:28, 17.28it/s]
Running loglikelihood requests:  82%|████████▏ | 16531/20084 [19:03<03:25, 17.29it/s]
Running loglikelihood requests:  83%|████████▎ | 16588/20084 [19:06<03:21, 17.32it/s]
Running loglikelihood requests:  83%|████████▎ | 16645/20084 [19:10<03:18, 17.34it/s]
Running loglikelihood requests:  83%|████████▎ | 16702/20084 [19:13<03:14, 17.37it/s]
Running loglikelihood requests:  83%|████████▎ | 16759/20084 [19:16<03:11, 17.40it/s]
Running loglikelihood requests:  84%|████████▎ | 16816/20084 [19:19<03:07, 17.42it/s]
Running loglikelihood requests:  84%|████████▍ | 16873/20084 [19:23<03:04, 17.45it/s]
Running loglikelihood requests:  84%|████████▍ | 16930/20084 [19:26<03:00, 17.43it/s]
Running loglikelihood requests:  85%|████████▍ | 16987/20084 [19:29<02:57, 17.44it/s]
Running loglikelihood requests:  85%|████████▍ | 17044/20084 [19:33<02:54, 17.44it/s]
Running loglikelihood requests:  85%|████████▌ | 17101/20084 [19:36<02:50, 17.48it/s]
Running loglikelihood requests:  85%|████████▌ | 17158/20084 [19:39<02:46, 17.54it/s]
Running loglikelihood requests:  86%|████████▌ | 17215/20084 [19:42<02:43, 17.59it/s]
Running loglikelihood requests:  86%|████████▌ | 17272/20084 [19:45<02:39, 17.61it/s]
Running loglikelihood requests:  86%|████████▋ | 17329/20084 [19:49<02:36, 17.64it/s]
Running loglikelihood requests:  87%|████████▋ | 17386/20084 [19:52<02:32, 17.67it/s]
Running loglikelihood requests:  87%|████████▋ | 17443/20084 [19:55<02:29, 17.70it/s]
Running loglikelihood requests:  87%|████████▋ | 17500/20084 [19:58<02:25, 17.72it/s]
Running loglikelihood requests:  87%|████████▋ | 17557/20084 [20:02<02:22, 17.74it/s]
Running loglikelihood requests:  88%|████████▊ | 17614/20084 [20:05<02:18, 17.77it/s]
Running loglikelihood requests:  88%|████████▊ | 17671/20084 [20:08<02:15, 17.80it/s]
Running loglikelihood requests:  88%|████████▊ | 17728/20084 [20:11<02:12, 17.83it/s]
Running loglikelihood requests:  89%|████████▊ | 17785/20084 [20:14<02:08, 17.87it/s]
Running loglikelihood requests:  89%|████████▉ | 17842/20084 [20:17<02:05, 17.93it/s]
Running loglikelihood requests:  89%|████████▉ | 17899/20084 [20:21<02:01, 17.97it/s]
Running loglikelihood requests:  89%|████████▉ | 17956/20084 [20:24<01:58, 18.00it/s]
Running loglikelihood requests:  90%|████████▉ | 18013/20084 [20:27<01:54, 18.03it/s]
Running loglikelihood requests:  90%|████████▉ | 18070/20084 [20:30<01:51, 18.04it/s]
Running loglikelihood requests:  90%|█████████ | 18127/20084 [20:33<01:48, 18.04it/s]
Running loglikelihood requests:  91%|█████████ | 18184/20084 [20:36<01:44, 18.10it/s]
Running loglikelihood requests:  91%|█████████ | 18241/20084 [20:39<01:41, 18.12it/s]
Running loglikelihood requests:  91%|█████████ | 18298/20084 [20:43<01:38, 18.13it/s]
Running loglikelihood requests:  91%|█████████▏| 18355/20084 [20:46<01:35, 18.18it/s]
Running loglikelihood requests:  92%|█████████▏| 18412/20084 [20:49<01:31, 18.23it/s]
Running loglikelihood requests:  92%|█████████▏| 18469/20084 [20:52<01:28, 18.27it/s]
Running loglikelihood requests:  92%|█████████▏| 18526/20084 [20:55<01:24, 18.33it/s]
Running loglikelihood requests:  93%|█████████▎| 18583/20084 [20:58<01:21, 18.38it/s]
Running loglikelihood requests:  93%|█████████▎| 18640/20084 [21:01<01:18, 18.41it/s]
Running loglikelihood requests:  93%|█████████▎| 18697/20084 [21:04<01:15, 18.47it/s]
Running loglikelihood requests:  93%|█████████▎| 18754/20084 [21:07<01:11, 18.52it/s]
Running loglikelihood requests:  94%|█████████▎| 18811/20084 [21:10<01:08, 18.58it/s]
Running loglikelihood requests:  94%|█████████▍| 18868/20084 [21:13<01:05, 18.66it/s]
Running loglikelihood requests:  94%|█████████▍| 18925/20084 [21:16<01:01, 18.72it/s]
Running loglikelihood requests:  95%|█████████▍| 18982/20084 [21:19<00:58, 18.78it/s]
Running loglikelihood requests:  95%|█████████▍| 19039/20084 [21:22<00:55, 18.84it/s]
Running loglikelihood requests:  95%|█████████▌| 19096/20084 [21:25<00:52, 18.90it/s]
Running loglikelihood requests:  95%|█████████▌| 19153/20084 [21:28<00:49, 18.98it/s]
Running loglikelihood requests:  96%|█████████▌| 19210/20084 [21:31<00:45, 19.06it/s]
Running loglikelihood requests:  96%|█████████▌| 19267/20084 [21:34<00:42, 19.15it/s]
Running loglikelihood requests:  96%|█████████▌| 19324/20084 [21:37<00:39, 19.24it/s]
Running loglikelihood requests:  96%|█████████▋| 19381/20084 [21:40<00:36, 19.32it/s]
Running loglikelihood requests:  97%|█████████▋| 19438/20084 [21:43<00:33, 19.39it/s]
Running loglikelihood requests:  97%|█████████▋| 19495/20084 [21:46<00:30, 19.48it/s]
Running loglikelihood requests:  97%|█████████▋| 19552/20084 [21:49<00:27, 19.57it/s]
Running loglikelihood requests:  98%|█████████▊| 19609/20084 [21:52<00:24, 19.69it/s]
Running loglikelihood requests:  98%|█████████▊| 19666/20084 [21:55<00:21, 19.79it/s]
Running loglikelihood requests:  98%|█████████▊| 19723/20084 [21:57<00:18, 19.95it/s]
Running loglikelihood requests:  98%|█████████▊| 19780/20084 [22:00<00:15, 20.14it/s]
Running loglikelihood requests:  99%|█████████▉| 19837/20084 [22:03<00:12, 20.37it/s]
Running loglikelihood requests:  99%|█████████▉| 19894/20084 [22:06<00:09, 20.59it/s]
Running loglikelihood requests:  99%|█████████▉| 19951/20084 [22:08<00:06, 20.84it/s]
Running loglikelihood requests: 100%|█████████▉| 20008/20084 [22:11<00:03, 21.21it/s]
Running loglikelihood requests: 100%|█████████▉| 20065/20084 [22:12<00:00, 26.68it/s]
Running loglikelihood requests: 100%|██████████| 20084/20084 [22:12<00:00, 15.08it/s]
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:1862447:1865958 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862447:1862698 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-07:01:17:28 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 10, batch_size: auto (57)
|  Tasks  |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|hellaswag|      1|none  |    10|acc     |↑  |0.4351|±  |0.0049|
|         |       |none  |    10|acc_norm|↑  |0.5978|±  |0.0049|

[rank0]:[W1207 01:17:29.546832091 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862446:1862696 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1862447:1862698 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:1862446:1866014 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:1862447:1865964 [1] NCCL INFO comm 0xdd95b90 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:1862446:1866014 [0] NCCL INFO comm 0xe17bf30 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 hellaswag 评估完成！
Execution time: 34699.1 seconds