nohup: ignoring input
Namespace(save_dir='/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg', self_attn_layer_to_quant='23 22 25 24 26', mlp_layer_to_quant='27 16 19', model_id='/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen/Qwen2.5-7B', cuda_id=6)
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:07<00:21,  7.24s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:14<00:14,  7.16s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:21<00:07,  7.13s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:27<00:00,  6.75s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:27<00:00,  6.90s/it]
Qwen2ForCausalLM(
  (model): Qwen2Model(
    (embed_tokens): Embedding(152064, 3584)
    (layers): ModuleList(
      (0-27): 28 x Qwen2DecoderLayer(
        (self_attn): Qwen2Attention(
          (q_proj): Linear(in_features=3584, out_features=3584, bias=True)
          (k_proj): Linear(in_features=3584, out_features=512, bias=True)
          (v_proj): Linear(in_features=3584, out_features=512, bias=True)
          (o_proj): Linear(in_features=3584, out_features=3584, bias=False)
        )
        (mlp): Qwen2MLP(
          (gate_proj): Linear(in_features=3584, out_features=18944, bias=False)
          (up_proj): Linear(in_features=3584, out_features=18944, bias=False)
          (down_proj): Linear(in_features=18944, out_features=3584, bias=False)
          (act_fn): SiLUActivation()
        )
        (input_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
        (post_attention_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
      )
    )
    (norm): Qwen2RMSNorm((3584,), eps=1e-06)
    (rotary_emb): Qwen2RotaryEmbedding()
  )
  (lm_head): Linear(in_features=3584, out_features=152064, bias=False)
)
Setting `pad_token_id` to `eos_token_id`:151643 for open-end generation.
Once upon a time, in a small town, there lived a wise old man named Mr. Thompson. He was known for his incredible ability to solve any problem that came his way. One day, a group of young kids from the town approached him with a challenge. They had a set of 10 distinct numbers, and they wanted to know how many ways they could pick 3 numbers from the set such that their sum was divisible by 3. Mr. Thompson, being the wise man that he was,
quanting ... 
layers.0.self_attn 4 bit quant 
layers.0.mlp 4 bit quant 
layers.1.self_attn 4 bit quant 
layers.1.mlp 4 bit quant 
layers.2.self_attn 4 bit quant 
layers.2.mlp 4 bit quant 
layers.3.self_attn 4 bit quant 
layers.3.mlp 4 bit quant 
layers.4.self_attn 4 bit quant 
layers.4.mlp 4 bit quant 
layers.5.self_attn 4 bit quant 
layers.5.mlp 4 bit quant 
layers.6.self_attn 4 bit quant 
layers.6.mlp 4 bit quant 
layers.7.self_attn 4 bit quant 
layers.7.mlp 4 bit quant 
layers.8.self_attn 4 bit quant 
layers.8.mlp 4 bit quant 
layers.9.self_attn 4 bit quant 
layers.9.mlp 4 bit quant 
layers.10.self_attn 4 bit quant 
layers.10.mlp 4 bit quant 
layers.11.self_attn 4 bit quant 
layers.11.mlp 4 bit quant 
layers.12.self_attn 4 bit quant 
layers.12.mlp 4 bit quant 
layers.13.self_attn 4 bit quant 
layers.13.mlp 4 bit quant 
layers.14.self_attn 4 bit quant 
layers.14.mlp 4 bit quant 
layers.15.self_attn 4 bit quant 
layers.15.mlp 4 bit quant 
layers.16.self_attn 4 bit quant 
layers.16.mlp 2 bit quant 
layers.17.self_attn 4 bit quant 
layers.17.mlp 4 bit quant 
layers.18.self_attn 4 bit quant 
layers.18.mlp 4 bit quant 
layers.19.self_attn 4 bit quant 
layers.19.mlp 2 bit quant 
layers.20.self_attn 4 bit quant 
layers.20.mlp 4 bit quant 
layers.21.self_attn 4 bit quant 
layers.21.mlp 4 bit quant 
layers.22.self_attn 2 bit quant 
layers.22.mlp 4 bit quant 
layers.23.self_attn 2 bit quant 
layers.23.mlp 4 bit quant 
layers.24.self_attn 2 bit quant 
layers.24.mlp 4 bit quant 
layers.25.self_attn 2 bit quant 
layers.25.mlp 4 bit quant 
layers.26.self_attn 2 bit quant 
layers.26.mlp 4 bit quant 
layers.27.self_attn 4 bit quant 
layers.27.mlp 2 bit quant 
quanted
Qwen2ForCausalLM(
  (model): Qwen2Model(
    (embed_tokens): Embedding(152064, 3584)
    (layers): ModuleList(
      (0-27): 28 x Qwen2DecoderLayer(
        (self_attn): Qwen2Attention(
          (q_proj): W8A16Linear(3584, 3584, bias=True, weight_quant=per_channel)
          (k_proj): W8A16Linear(3584, 512, bias=True, weight_quant=per_channel)
          (v_proj): W8A16Linear(3584, 512, bias=True, weight_quant=per_channel)
          (o_proj): W8A16Linear(3584, 3584, bias=False, weight_quant=per_channel)
        )
        (mlp): Qwen2MLP(
          (gate_proj): W8A16Linear(3584, 18944, bias=False, weight_quant=per_channel)
          (up_proj): W8A16Linear(3584, 18944, bias=False, weight_quant=per_channel)
          (down_proj): W8A16Linear(18944, 3584, bias=False, weight_quant=per_channel)
          (act_fn): SiLUActivation()
        )
        (input_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
        (post_attention_layernorm): Qwen2RMSNorm((3584,), eps=1e-06)
      )
    )
    (norm): Qwen2RMSNorm((3584,), eps=1e-06)
    (rotary_emb): Qwen2RotaryEmbedding()
  )
  (lm_head): Linear(in_features=3584, out_features=152064, bias=False)
)
Setting `pad_token_id` to `eos_token_id`:151643 for open-end generation.
Once upon a time, in a small unassuming ab Abundabun in the heart of the four- dimensional 3D+1 ( three spatial and one temporal dimension ish) of  ababab  in a dimension                   oise ababab ab ab ab abab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab ab

==================================================
开始评估：任务=winogrande | 少样本数=5 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/winogrande.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-08:17:45:22 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-08:17:45:22 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-08:17:45:22 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-08:17:45:22 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-08:17:45:22 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-08:17:45:22 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-08:17:45:26 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-08:17:45:26 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-08:17:45:26 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.34it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:03,  1.02s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.28it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.05s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.31it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.87it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.62it/s]

Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:00,  1.00it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.43it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.22it/s]
2025-12-08:17:45:46 WARNING  [evaluator:309] Overwriting default num_fewshot of winogrande from None to 5
2025-12-08:17:45:46 INFO     [api.task:434] Building contexts for winogrande on rank 1...

  0%|          | 0/633 [00:00<?, ?it/s]
100%|██████████| 633/633 [00:00<00:00, 27296.78it/s]
2025-12-08:17:45:47 WARNING  [evaluator:309] Overwriting default num_fewshot of winogrande from None to 5
2025-12-08:17:45:47 INFO     [api.task:434] Building contexts for winogrande on rank 0...

  0%|          | 0/634 [00:00<?, ?it/s]
100%|██████████| 634/634 [00:00<00:00, 28062.95it/s]
n136-128-154:2061718:2061718 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2061718:2061718 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2061718:2061718 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2061718:2061718 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2061718:2061718 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:2061719:2061719 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2061719:2061719 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2061719:2061719 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2061719:2061719 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2061719:2061719 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2061718:2062420 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2061718:2062420 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2061719:2062421 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2061719:2062421 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2061718:2062420 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2061718:2062420 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2061718:2062420 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2061719:2062421 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2061719:2062421 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2061719:2062421 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2061718:2062420 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2061718:2062420 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2061718:2062420 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2061719:2062421 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2061719:2062421 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2061719:2062421 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2061718:2062420 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2061718:2062420 [0] NCCL INFO Using network IB
n136-128-154:2061719:2062421 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2061719:2062421 [1] NCCL INFO Using network IB
n136-128-154:2061719:2062421 [1] NCCL INFO ncclCommInitRankConfig comm 0x11503200 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x57372e7e365f65e - Init START
n136-128-154:2061718:2062420 [0] NCCL INFO ncclCommInitRankConfig comm 0x109f5100 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x57372e7e365f65e - Init START
n136-128-154:2061719:2062421 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2061718:2062420 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2061718:2062420 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2061718:2062420 [0] NCCL INFO Retrieving state for IB
n136-128-154:2061718:2062420 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2061718:2062420 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2061719:2062421 [1] NCCL INFO Retrieving state for IB
n136-128-154:2061719:2062421 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2061718:2062420 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2061718:2062420 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2061718:2062420 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2061719:2062421 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2061719:2062421 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2061719:2062421 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2061719:2062421 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2061719:2062421 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2061719:2062421 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2061719:2062421 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2061719:2062421 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2061719:2062421 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2061719:2062421 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2061718:2062420 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2061718:2062420 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2061719:2062421 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2061719:2062421 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2061719:2062421 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2061719:2062421 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2061719:2062421 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2061719:2062421 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2061719:2062421 [1] NCCL INFO ==========================================
n136-128-154:2061719:2062421 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2061719:2062421 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2061719:2062421 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2061718:2062420 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2061718:2062420 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2061718:2062420 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2061718:2062420 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2061718:2062420 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2061718:2062420 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2061718:2062420 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2061718:2062420 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2061718:2062420 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2061718:2062420 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2061718:2062420 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2061718:2062420 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2061718:2062420 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2061718:2062420 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2061718:2062420 [0] NCCL INFO ==========================================
n136-128-154:2061718:2062420 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2061718:2062420 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2061718:2062420 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2061719:2062421 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2061719:2062421 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2061719:2062421 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061719:2062421 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061719:2062421 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061719:2062421 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061719:2062421 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061719:2062421 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2061719:2062421 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2061718:2062420 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2061718:2062420 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061718:2062420 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2061719:2062421 [1] NCCL INFO comm 0x11503200 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2061718:2062420 [0] NCCL INFO comm 0x109f5100 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061718:2062420 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2061719:2062421 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2061719:2062421 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2061718:2062420 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2061718:2062420 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2061718:2062420 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2061718:2062420 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2061718:2062433 [0] NCCL INFO [Proxy Service] Device 0 CPU core 42
n136-128-154:2061718:2062434 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 60
n136-128-154:2061719:2062421 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2061719:2062435 [1] NCCL INFO [Proxy Service] Device 1 CPU core 38
n136-128-154:2061719:2062436 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 53
n136-128-154:2061718:2062420 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2061719:2062421 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2061718:2062420 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2061719:2062421 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2061718:2062420 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2061718:2062420 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2061718:2062420 [0] NCCL INFO ncclCommInitRankConfig comm 0x109f5100 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x57372e7e365f65e - Init COMPLETE
n136-128-154:2061718:2062420 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.88 (kernels 0.23, alloc 0.42, bootstrap 0.00, allgathers 0.01, topo 0.09, graphs 0.00, connections 0.04, rest 0.09)
n136-128-154:2061719:2062421 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2061719:2062421 [1] NCCL INFO ncclCommInitRankConfig comm 0x11503200 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x57372e7e365f65e - Init COMPLETE
n136-128-154:2061719:2062421 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.88 (kernels 0.23, alloc 0.42, bootstrap 0.00, allgathers 0.01, topo 0.09, graphs 0.00, connections 0.03, rest 0.09)
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062438 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061718:2062437 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2061719:2062438 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-08:17:45:49 INFO     [evaluator:559] Running loglikelihood requests
2025-12-08:17:45:49 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/1268 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/1268 [00:05<1:59:06,  5.64s/it]
Running loglikelihood requests:   5%|▌         | 65/1268 [00:06<01:30, 13.32it/s] 
Running loglikelihood requests:  10%|█         | 129/1268 [00:07<00:44, 25.45it/s]
Running loglikelihood requests:  15%|█▌        | 193/1268 [00:08<00:29, 36.31it/s]
Running loglikelihood requests:  20%|██        | 257/1268 [00:09<00:22, 45.42it/s]
Running loglikelihood requests:  25%|██▌       | 321/1268 [00:10<00:17, 52.77it/s]
Running loglikelihood requests:  30%|███       | 385/1268 [00:10<00:15, 58.64it/s]
Running loglikelihood requests:  35%|███▌      | 449/1268 [00:11<00:12, 63.18it/s]
Running loglikelihood requests:  40%|████      | 513/1268 [00:12<00:11, 66.40it/s]
Running loglikelihood requests:  46%|████▌     | 577/1268 [00:13<00:09, 69.13it/s]
Running loglikelihood requests:  51%|█████     | 641/1268 [00:14<00:08, 71.45it/s]
Running loglikelihood requests:  56%|█████▌    | 705/1268 [00:15<00:07, 73.27it/s]
Running loglikelihood requests:  61%|██████    | 769/1268 [00:15<00:06, 74.59it/s]
Running loglikelihood requests:  66%|██████▌   | 833/1268 [00:16<00:05, 75.69it/s]
Running loglikelihood requests:  71%|███████   | 897/1268 [00:17<00:04, 76.62it/s]
Running loglikelihood requests:  76%|███████▌  | 961/1268 [00:18<00:03, 77.30it/s]
Running loglikelihood requests:  81%|████████  | 1025/1268 [00:19<00:03, 78.20it/s]
Running loglikelihood requests:  86%|████████▌ | 1089/1268 [00:19<00:02, 79.13it/s]
Running loglikelihood requests:  91%|█████████ | 1153/1268 [00:20<00:01, 80.12it/s]
Running loglikelihood requests:  96%|█████████▌| 1217/1268 [00:21<00:00, 85.54it/s]
Running loglikelihood requests: 100%|██████████| 1268/1268 [00:21<00:00, 59.38it/s]
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2061719:2062496 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2061719:2062435 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-08:17:46:21 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto (64)
|  Tasks   |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|----------|------:|------|-----:|------|---|-----:|---|-----:|
|winogrande|      1|none  |     5|acc   |↑  |0.5588|±  | 0.014|

[rank0]:[W1208 17:46:22.406339430 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2061718:2062433 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2061718:2062564 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2061719:2062435 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2061719:2062508 [1] NCCL INFO comm 0x11503200 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2061718:2062564 [0] NCCL INFO comm 0x109f5100 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 winogrande 评估完成！

==================================================
开始评估：任务=gsm8k | 少样本数=4 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/gsm8k.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-08:17:47:43 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-08:17:47:43 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-08:17:47:43 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-08:17:47:43 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-08:17:47:43 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-08:17:47:43 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-08:17:47:44 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-08:17:47:45 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-08:17:47:45 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.21it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.12it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.15it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.07it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.17it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.67it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.44it/s]

Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.09it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.56it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.35it/s]
2025-12-08:17:48:01 INFO     [evaluator:290] gsm8k: Using gen_kwargs: {'until': ['Question:', '</s>', '<|im_end|>'], 'do_sample': False, 'temperature': 0.0}
2025-12-08:17:48:01 WARNING  [evaluator:309] Overwriting default num_fewshot of gsm8k from 5 to 4
2025-12-08:17:48:01 INFO     [api.task:434] Building contexts for gsm8k on rank 0...

  0%|          | 0/660 [00:00<?, ?it/s]
  6%|▌         | 41/660 [00:00<00:01, 400.91it/s]
 12%|█▏        | 82/660 [00:00<00:01, 401.16it/s]
 19%|█▊        | 123/660 [00:00<00:01, 401.99it/s]
 25%|██▍       | 164/660 [00:00<00:01, 398.81it/s]
 31%|███       | 204/660 [00:00<00:01, 389.56it/s]
 37%|███▋      | 245/660 [00:00<00:01, 393.58it/s]
 43%|████▎     | 285/660 [00:00<00:00, 395.15it/s]
 49%|████▉     | 325/660 [00:00<00:00, 395.84it/s]
 55%|█████▌    | 366/660 [00:00<00:00, 398.27it/s]
 62%|██████▏   | 406/660 [00:01<00:00, 398.42it/s]
 68%|██████▊   | 446/660 [00:01<00:00, 397.30it/s]
 74%|███████▎  | 486/660 [00:01<00:00, 395.67it/s]
 80%|███████▉  | 526/660 [00:01<00:00, 395.20it/s]
 86%|████████▌ | 567/660 [00:01<00:00, 396.98it/s]
 92%|█████████▏| 608/660 [00:01<00:00, 398.45it/s]
 98%|█████████▊| 649/660 [00:01<00:00, 400.96it/s]
100%|██████████| 660/660 [00:01<00:00, 397.84it/s]
n136-128-154:2062874:2062874 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2062874:2062874 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2062874:2062874 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2062874:2062874 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2062874:2062874 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:2062874:2063938 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2062874:2063938 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2062874:2063938 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2062874:2063938 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2062874:2063938 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2062874:2063938 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2062874:2063938 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2062874:2063938 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2062874:2063938 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2062874:2063938 [0] NCCL INFO Using network IB
n136-128-154:2062874:2063938 [0] NCCL INFO ncclCommInitRankConfig comm 0xf5bdd20 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x3b2c48198e38d0ad - Init START
2025-12-08:17:48:04 INFO     [evaluator:290] gsm8k: Using gen_kwargs: {'until': ['Question:', '</s>', '<|im_end|>'], 'do_sample': False, 'temperature': 0.0}
2025-12-08:17:48:04 WARNING  [evaluator:309] Overwriting default num_fewshot of gsm8k from 5 to 4
2025-12-08:17:48:04 INFO     [api.task:434] Building contexts for gsm8k on rank 1...

  0%|          | 0/659 [00:00<?, ?it/s]
  6%|▋         | 42/659 [00:00<00:01, 410.09it/s]
 13%|█▎        | 84/659 [00:00<00:01, 413.54it/s]
 19%|█▉        | 126/659 [00:00<00:01, 415.42it/s]
 25%|██▌       | 168/659 [00:00<00:01, 416.85it/s]
 32%|███▏      | 211/659 [00:00<00:01, 418.61it/s]
 39%|███▊      | 254/659 [00:00<00:00, 420.08it/s]
 45%|████▌     | 297/659 [00:00<00:00, 416.40it/s]
 51%|█████▏    | 339/659 [00:00<00:00, 413.72it/s]
 58%|█████▊    | 381/659 [00:00<00:00, 413.45it/s]
 64%|██████▍   | 423/659 [00:01<00:00, 411.15it/s]
 71%|███████   | 465/659 [00:01<00:00, 412.99it/s]
 77%|███████▋  | 507/659 [00:01<00:00, 414.19it/s]
 83%|████████▎ | 549/659 [00:01<00:00, 415.53it/s]
 90%|████████▉ | 591/659 [00:01<00:00, 414.36it/s]
 96%|█████████▌| 633/659 [00:01<00:00, 415.90it/s]
100%|██████████| 659/659 [00:01<00:00, 415.26it/s]
n136-128-154:2062875:2062875 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2062875:2062875 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2062875:2062875 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2062875:2062875 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2062875:2062875 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2062875:2064076 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2062875:2064076 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2062875:2064076 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2062875:2064076 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2062875:2064076 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2062875:2064076 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2062875:2064076 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2062875:2064076 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2062875:2064076 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2062875:2064076 [1] NCCL INFO Using network IB
n136-128-154:2062875:2064076 [1] NCCL INFO ncclCommInitRankConfig comm 0x104d2320 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x3b2c48198e38d0ad - Init START
n136-128-154:2062875:2064076 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2062874:2063938 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2062875:2064076 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2062875:2064076 [1] NCCL INFO Retrieving state for IB
n136-128-154:2062875:2064076 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2062875:2064076 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2062875:2064076 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2062875:2064076 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2062875:2064076 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2062874:2063938 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2062874:2063938 [0] NCCL INFO Retrieving state for IB
n136-128-154:2062874:2063938 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2062874:2063938 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2062874:2063938 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2062874:2063938 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2062874:2063938 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2062874:2063938 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2062874:2063938 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2062874:2063938 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2062874:2063938 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2062874:2063938 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2062874:2063938 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2062874:2063938 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2062874:2063938 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2062874:2063938 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2062874:2063938 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2062874:2063938 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2062874:2063938 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2062874:2063938 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2062874:2063938 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2062874:2063938 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2062874:2063938 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2062874:2063938 [0] NCCL INFO ==========================================
n136-128-154:2062874:2063938 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2062874:2063938 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2062874:2063938 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2062874:2063938 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2062874:2063938 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2062874:2063938 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062874:2063938 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2062875:2064076 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2062875:2064076 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2062875:2064076 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2062875:2064076 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2062875:2064076 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2062875:2064076 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2062875:2064076 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2062875:2064076 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2062875:2064076 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2062875:2064076 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2062875:2064076 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2062875:2064076 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2062875:2064076 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2062875:2064076 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2062875:2064076 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2062875:2064076 [1] NCCL INFO ==========================================
n136-128-154:2062875:2064076 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2062875:2064076 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2062875:2064076 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2062875:2064076 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2062875:2064076 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2062875:2064076 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2062875:2064076 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062875:2064076 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2062874:2063938 [0] NCCL INFO comm 0xf5bdd20 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2062875:2064076 [1] NCCL INFO comm 0x104d2320 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062875:2064076 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2062875:2064076 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2062875:2064076 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2062875:2064076 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2062874:2063938 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2062874:2063938 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2062874:2063938 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2062874:2063938 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2062874:2064096 [0] NCCL INFO [Proxy Service] Device 0 CPU core 38
n136-128-154:2062874:2064097 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 39
n136-128-154:2062875:2064076 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2062875:2064098 [1] NCCL INFO [Proxy Service] Device 1 CPU core 60
n136-128-154:2062875:2064099 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 61
n136-128-154:2062874:2063938 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2062874:2063938 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2062875:2064076 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2062875:2064076 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2062874:2063938 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2062874:2063938 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2062874:2063938 [0] NCCL INFO ncclCommInitRankConfig comm 0xf5bdd20 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x3b2c48198e38d0ad - Init COMPLETE
n136-128-154:2062874:2063938 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 3.78 (kernels 0.26, alloc 0.11, bootstrap 3.20, allgathers 0.00, topo 0.07, graphs 0.00, connections 0.09, rest 0.05)
n136-128-154:2062875:2064076 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2062875:2064076 [1] NCCL INFO ncclCommInitRankConfig comm 0x104d2320 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x3b2c48198e38d0ad - Init COMPLETE
n136-128-154:2062875:2064076 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.48 (kernels 0.17, alloc 0.11, bootstrap 0.00, allgathers 0.00, topo 0.07, graphs 0.00, connections 0.08, rest 0.05)
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2062875:2064101 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062874:2064102 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2062875:2064101 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-08:17:48:07 INFO     [evaluator:559] Running generate_until requests
2025-12-08:17:48:07 INFO     [evaluator:559] Running generate_until requests
Passed argument batch_size = auto. Detecting largest batch size

Running generate_until requests:   0%|          | 0/660 [00:00<?, ?it/s]Passed argument batch_size = auto. Detecting largest batch size
Determined Largest batch size: 1
Determined Largest batch size: 1
Both `max_new_tokens` (=2048) and `max_length`(=1578) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1605) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 1/660 [02:46<30:23:21, 166.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1567) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1554) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 2/660 [03:32<17:29:41, 95.72s/it] Both `max_new_tokens` (=2048) and `max_length`(=1557) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1539) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   0%|          | 3/660 [04:18<13:21:50, 73.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1519) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1536) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 4/660 [05:05<11:25:35, 62.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1508) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1484) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 5/660 [05:52<10:23:35, 57.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=1494) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1483) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 6/660 [06:41<9:50:53, 54.21s/it] Both `max_new_tokens` (=2048) and `max_length`(=1480) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1459) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 7/660 [07:27<9:22:31, 51.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1468) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1456) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|          | 8/660 [08:14<9:03:17, 50.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=1459) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1446) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   1%|▏         | 9/660 [09:00<8:50:24, 48.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1451) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1440) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 10/660 [09:48<8:44:46, 48.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1435) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1440) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 11/660 [10:35<8:41:54, 48.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1431) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1431) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 12/660 [11:22<8:35:28, 47.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1429) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1427) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 13/660 [12:08<8:30:16, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1393) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1423) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 14/660 [12:55<8:26:51, 47.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1387) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1410) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 15/660 [13:41<8:23:41, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1386) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1398) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   2%|▏         | 16/660 [14:28<8:21:47, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1397) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 17/660 [15:14<8:20:17, 46.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1379) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1396) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1384) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 18/660 [16:00<8:17:54, 46.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1377) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 19/660 [16:08<6:10:59, 34.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1377) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 20/660 [16:54<6:47:37, 38.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1372) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1382) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 21/660 [17:40<7:13:26, 40.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1365) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1373) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 22/660 [18:28<7:34:03, 42.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1365) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1357) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   3%|▎         | 23/660 [19:16<7:50:25, 44.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1353) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1353) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▎         | 24/660 [20:04<8:02:42, 45.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1352) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1352) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 25/660 [20:52<8:08:24, 46.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1342) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1351) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 26/660 [21:40<8:13:23, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1341) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1349) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 27/660 [22:28<8:16:19, 47.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1340) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1338) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 28/660 [23:16<8:18:22, 47.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1337) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1329) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   4%|▍         | 29/660 [24:03<8:16:36, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1323) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1328) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 30/660 [24:50<8:15:34, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1322) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1327) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 31/660 [25:37<8:14:22, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=1321) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1322) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1318) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▍         | 32/660 [26:24<8:13:20, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1318) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 33/660 [27:12<8:15:33, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 34/660 [28:00<8:16:20, 47.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1313) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 35/660 [28:47<8:12:40, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1313) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1317) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   5%|▌         | 36/660 [29:33<8:09:20, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1312) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1310) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 37/660 [30:20<8:06:46, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1306) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1307) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 38/660 [31:06<8:05:51, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1303) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1306) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 39/660 [31:53<8:03:55, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1300) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1302) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 40/660 [32:40<8:02:47, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1297) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1298) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▌         | 41/660 [33:26<8:01:32, 46.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1297) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1295) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   6%|▋         | 42/660 [34:13<8:00:04, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1296) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1292) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 43/660 [34:59<7:59:14, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1293) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1290) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 44/660 [35:46<7:58:04, 46.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1290) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1289) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 45/660 [36:32<7:57:36, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1282) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1288) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 46/660 [37:20<8:00:03, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1278) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1282) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 47/660 [38:08<8:02:23, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1277) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1275) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 48/660 [38:55<8:00:57, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1274) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1273) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   7%|▋         | 49/660 [39:42<7:58:56, 47.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 50/660 [40:29<8:00:23, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1269) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1270) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 51/660 [41:18<8:04:46, 47.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1269) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1268) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 52/660 [42:05<8:01:30, 47.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1265) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1267) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 53/660 [42:53<8:00:10, 47.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1264) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1256) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 54/660 [43:41<8:02:22, 47.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1262) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 55/660 [44:28<7:59:14, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1258) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   8%|▊         | 56/660 [45:15<7:55:28, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1257) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1255) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▊         | 57/660 [46:01<7:52:21, 47.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=1256) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1252) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 58/660 [46:48<7:50:45, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1254) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 59/660 [47:34<7:48:20, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1251) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 60/660 [48:21<7:47:16, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1249) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1250) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 61/660 [49:07<7:46:04, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1246) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:   9%|▉         | 62/660 [49:54<7:44:36, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1247) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 63/660 [50:41<7:43:54, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1247) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 64/660 [51:27<7:43:01, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1246) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|▉         | 65/660 [52:14<7:42:15, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1245) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 66/660 [53:01<7:41:59, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1239) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1243) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 67/660 [53:47<7:40:23, 46.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1238) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 68/660 [54:34<7:39:59, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1241) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  10%|█         | 69/660 [55:20<7:38:37, 46.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1234) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1239) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 70/660 [56:07<7:37:42, 46.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1238) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 71/660 [56:53<7:37:14, 46.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 72/660 [57:40<7:36:52, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 73/660 [57:43<5:27:01, 33.43s/it]Both `max_new_tokens` (=2048) and `max_length`(=1231) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1236) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█         | 74/660 [58:29<6:05:04, 37.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1235) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  11%|█▏        | 75/660 [59:16<6:31:15, 40.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1235) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 76/660 [1:00:02<6:49:12, 42.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1225) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1234) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 77/660 [1:00:49<7:01:49, 43.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=1225) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1233) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 78/660 [1:01:35<7:09:37, 44.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1224) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1230) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 79/660 [1:02:22<7:15:39, 44.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1229) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 80/660 [1:03:08<7:19:21, 45.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1227) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 81/660 [1:03:55<7:23:08, 45.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1222) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1226) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  12%|█▏        | 82/660 [1:04:42<7:24:48, 46.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1222) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1223) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 83/660 [1:05:29<7:24:45, 46.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 84/660 [1:06:15<7:25:16, 46.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1218) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1221) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 85/660 [1:07:02<7:25:08, 46.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1217) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1220) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 86/660 [1:07:48<7:24:53, 46.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1218) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 87/660 [1:08:35<7:24:15, 46.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1215) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 88/660 [1:09:21<7:23:06, 46.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  13%|█▎        | 89/660 [1:10:08<7:22:55, 46.54s/it]Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1214) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▎        | 90/660 [1:10:55<7:22:12, 46.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1213) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 91/660 [1:11:41<7:21:15, 46.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1206) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1211) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 92/660 [1:12:28<7:20:44, 46.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1205) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 93/660 [1:13:15<7:21:56, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1205) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1208) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 94/660 [1:14:02<7:21:05, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1204) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  14%|█▍        | 95/660 [1:14:48<7:19:50, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1207) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 96/660 [1:15:35<7:19:04, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1206) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 97/660 [1:16:22<7:18:40, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▍        | 98/660 [1:17:08<7:17:09, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1203) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 99/660 [1:17:55<7:16:30, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1202) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 100/660 [1:18:42<7:16:32, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1201) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 101/660 [1:19:29<7:15:08, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  15%|█▌        | 102/660 [1:20:15<7:14:31, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1198) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1199) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 103/660 [1:21:02<7:13:30, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1198) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 104/660 [1:21:49<7:12:44, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1196) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 105/660 [1:22:35<7:11:35, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1196) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1197) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 106/660 [1:23:22<7:10:36, 46.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1195) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1194) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▌        | 107/660 [1:24:09<7:10:13, 46.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  16%|█▋        | 108/660 [1:24:55<7:09:09, 46.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1193) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 109/660 [1:25:42<7:09:08, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 110/660 [1:26:29<7:08:19, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 111/660 [1:27:16<7:08:04, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 112/660 [1:28:03<7:07:27, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1190) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1191) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 113/660 [1:28:49<7:06:29, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1189) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1190) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 114/660 [1:29:37<7:06:55, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1188) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1187) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  17%|█▋        | 115/660 [1:30:23<7:05:22, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1187) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1186) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 116/660 [1:31:10<7:03:53, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1186) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 117/660 [1:31:57<7:04:34, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 118/660 [1:32:45<7:07:25, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1185) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 119/660 [1:33:32<7:04:44, 47.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 120/660 [1:34:19<7:03:03, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 121/660 [1:35:05<7:01:11, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1184) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  18%|█▊        | 122/660 [1:35:52<7:00:11, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▊        | 123/660 [1:36:39<6:59:01, 46.82s/it]Both `max_new_tokens` (=2048) and `max_length`(=1183) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 124/660 [1:37:25<6:57:45, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1179) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 125/660 [1:38:12<6:56:50, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1182) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1179) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 126/660 [1:38:59<6:56:05, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 127/660 [1:39:46<6:54:59, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1181) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  19%|█▉        | 128/660 [1:40:33<6:54:56, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1180) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1177) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 129/660 [1:41:21<6:58:15, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 130/660 [1:42:09<6:59:52, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|█▉        | 131/660 [1:42:57<6:59:13, 47.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 132/660 [1:43:44<6:58:04, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1178) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1176) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 133/660 [1:44:33<6:59:46, 47.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1175) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 134/660 [1:45:21<7:00:26, 47.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1174) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  20%|██        | 135/660 [1:46:08<6:57:47, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1174) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 136/660 [1:46:55<6:54:56, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 137/660 [1:47:42<6:53:13, 47.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1173) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 138/660 [1:48:29<6:51:35, 47.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1168) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1171) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 139/660 [1:49:17<6:50:33, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1168) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1170) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██        | 140/660 [1:50:05<6:52:31, 47.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1167) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1169) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  21%|██▏       | 141/660 [1:50:59<7:08:56, 49.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1165) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1169) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 142/660 [1:51:52<7:16:36, 50.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1165) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1167) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 143/660 [1:52:39<7:07:42, 49.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1164) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1166) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 144/660 [1:53:27<7:00:42, 48.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1163) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1166) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 145/660 [1:54:14<6:56:05, 48.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=1163) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1164) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 146/660 [1:55:02<6:52:25, 48.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1162) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1162) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 147/660 [1:55:49<6:49:21, 47.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  22%|██▏       | 148/660 [1:56:36<6:47:26, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1161) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 149/660 [1:57:24<6:45:25, 47.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1160) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 150/660 [1:58:11<6:44:13, 47.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 151/660 [1:58:58<6:42:41, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1157) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1159) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 152/660 [1:59:46<6:42:50, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1156) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1158) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 153/660 [2:00:35<6:45:54, 48.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1156) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1157) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 154/660 [2:01:22<6:42:15, 47.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1155) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  23%|██▎       | 155/660 [2:02:09<6:39:07, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1155) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▎       | 156/660 [2:02:56<6:37:00, 47.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 157/660 [2:03:43<6:36:48, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1152) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 158/660 [2:04:31<6:37:18, 47.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=1154) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1152) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 159/660 [2:05:18<6:35:11, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=1153) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 160/660 [2:06:05<6:33:06, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  24%|██▍       | 161/660 [2:06:53<6:33:56, 47.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1151) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 162/660 [2:07:41<6:34:51, 47.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 163/660 [2:08:28<6:32:21, 47.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1150) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▍       | 164/660 [2:09:14<6:29:55, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 165/660 [2:10:01<6:28:18, 47.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 166/660 [2:10:48<6:26:32, 46.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1149) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 167/660 [2:11:34<6:25:03, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  25%|██▌       | 168/660 [2:12:21<6:24:18, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 169/660 [2:13:08<6:23:02, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1148) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 170/660 [2:13:55<6:22:35, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1147) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 171/660 [2:14:42<6:21:41, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1147) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 172/660 [2:15:28<6:20:31, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1144) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▌       | 173/660 [2:16:15<6:19:36, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  26%|██▋       | 174/660 [2:17:02<6:18:20, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 175/660 [2:17:49<6:18:05, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1146) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 176/660 [2:18:35<6:17:25, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1143) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1145) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 177/660 [2:19:22<6:16:40, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1142) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 178/660 [2:20:09<6:16:03, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 179/660 [2:20:56<6:14:53, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1141) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 180/660 [2:21:43<6:14:12, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1138) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  27%|██▋       | 181/660 [2:22:29<6:13:17, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1137) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 182/660 [2:23:16<6:12:23, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1137) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1140) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 183/660 [2:24:03<6:11:31, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 184/660 [2:24:49<6:10:31, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1139) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 185/660 [2:25:36<6:09:56, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 186/660 [2:26:23<6:08:51, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1136) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 187/660 [2:27:10<6:08:12, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1135) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  28%|██▊       | 188/660 [2:27:56<6:07:35, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▊       | 189/660 [2:28:43<6:06:44, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1132) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 190/660 [2:29:30<6:06:15, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1134) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 191/660 [2:30:16<6:05:15, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1133) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 192/660 [2:31:03<6:04:32, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1133) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 193/660 [2:31:50<6:03:41, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1131) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  29%|██▉       | 194/660 [2:32:37<6:02:44, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 195/660 [2:33:23<6:02:16, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 196/660 [2:34:10<6:01:12, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|██▉       | 197/660 [2:34:57<6:00:28, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1126) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1130) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 198/660 [2:35:44<6:00:02, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1126) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 199/660 [2:36:30<5:59:22, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 200/660 [2:37:17<5:58:36, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1129) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  30%|███       | 201/660 [2:38:04<5:57:28, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1128) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 202/660 [2:38:51<5:56:49, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1128) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 203/660 [2:39:37<5:55:59, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 204/660 [2:40:24<5:55:22, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 205/660 [2:41:11<5:54:43, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1125) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███       | 206/660 [2:41:58<5:54:12, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1124) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  31%|███▏      | 207/660 [2:42:45<5:53:40, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1123) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 208/660 [2:43:31<5:52:25, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1123) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 209/660 [2:44:18<5:51:51, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1122) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 210/660 [2:45:05<5:51:03, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1121) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 211/660 [2:45:52<5:49:58, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 212/660 [2:46:39<5:49:26, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1115) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1119) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 213/660 [2:47:25<5:48:27, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1118) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  32%|███▏      | 214/660 [2:48:12<5:47:53, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 215/660 [2:48:59<5:47:01, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1114) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 216/660 [2:49:47<5:48:09, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 217/660 [2:50:35<5:51:05, 47.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1117) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 218/660 [2:51:23<5:50:31, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1115) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 219/660 [2:52:10<5:47:53, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1113) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 220/660 [2:52:57<5:46:20, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1112) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  33%|███▎      | 221/660 [2:53:46<5:49:42, 47.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1110) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1111) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▎      | 222/660 [2:54:35<5:51:19, 48.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1110) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1111) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 223/660 [2:55:22<5:47:55, 47.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1109) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 224/660 [2:56:10<5:47:58, 47.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 225/660 [2:56:58<5:47:12, 47.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 226/660 [2:57:46<5:47:08, 47.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1105) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  34%|███▍      | 227/660 [2:58:36<5:50:01, 48.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 228/660 [2:59:23<5:47:37, 48.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1108) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 229/660 [3:00:12<5:46:28, 48.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1107) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▍      | 230/660 [3:01:00<5:47:07, 48.43s/it]Both `max_new_tokens` (=2048) and `max_length`(=1103) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1107) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 231/660 [3:01:49<5:46:12, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1102) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 232/660 [3:02:36<5:42:26, 48.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 233/660 [3:03:25<5:44:16, 48.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1106) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  35%|███▌      | 234/660 [3:04:14<5:45:11, 48.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1100) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 235/660 [3:05:03<5:44:00, 48.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1104) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 236/660 [3:05:52<5:44:48, 48.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 237/660 [3:06:40<5:43:04, 48.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1101) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 238/660 [3:07:28<5:39:08, 48.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1100) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▌      | 239/660 [3:08:16<5:38:52, 48.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  36%|███▋      | 240/660 [3:09:05<5:38:26, 48.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1099) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 241/660 [3:09:52<5:36:13, 48.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1098) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 242/660 [3:10:39<5:32:31, 47.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 243/660 [3:11:26<5:29:45, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 244/660 [3:12:13<5:28:03, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1097) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 245/660 [3:13:00<5:26:14, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 246/660 [3:13:48<5:27:54, 47.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  37%|███▋      | 247/660 [3:14:36<5:27:20, 47.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 248/660 [3:15:22<5:25:02, 47.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1096) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 249/660 [3:16:09<5:23:32, 47.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1095) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 250/660 [3:16:56<5:21:50, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 251/660 [3:17:44<5:22:34, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 252/660 [3:18:31<5:21:38, 47.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1094) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 253/660 [3:19:18<5:19:45, 47.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  38%|███▊      | 254/660 [3:20:05<5:18:27, 47.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1093) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1092) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▊      | 255/660 [3:20:52<5:16:59, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 256/660 [3:21:39<5:15:56, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 257/660 [3:22:26<5:17:06, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1091) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 258/660 [3:23:17<5:22:27, 48.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 259/660 [3:24:07<5:26:05, 48.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1090) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  39%|███▉      | 260/660 [3:24:56<5:24:40, 48.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 261/660 [3:25:46<5:26:25, 49.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 262/660 [3:26:35<5:25:30, 49.07s/it]Both `max_new_tokens` (=2048) and `max_length`(=1085) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|███▉      | 263/660 [3:27:23<5:23:45, 48.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1084) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1089) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 264/660 [3:28:11<5:20:57, 48.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=1084) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 265/660 [3:28:58<5:16:44, 48.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1083) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 266/660 [3:29:46<5:16:11, 48.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1088) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  40%|████      | 267/660 [3:30:35<5:16:12, 48.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1087) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 268/660 [3:31:22<5:12:21, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 269/660 [3:32:08<5:09:10, 47.44s/it]Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1086) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 270/660 [3:32:55<5:06:53, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1085) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 271/660 [3:33:41<5:04:41, 47.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████      | 272/660 [3:34:28<5:03:29, 46.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  41%|████▏     | 273/660 [3:35:15<5:02:42, 46.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 274/660 [3:36:02<5:01:53, 46.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1082) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 275/660 [3:36:48<5:00:19, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1081) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 276/660 [3:37:35<4:59:22, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1075) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 277/660 [3:37:56<4:08:51, 38.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 278/660 [3:38:43<4:22:43, 41.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 279/660 [3:39:29<4:32:23, 42.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  42%|████▏     | 280/660 [3:40:16<4:38:34, 43.99s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 281/660 [3:41:02<4:42:44, 44.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1080) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 282/660 [3:41:49<4:45:24, 45.30s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 283/660 [3:42:36<4:47:33, 45.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 284/660 [3:43:22<4:48:00, 45.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 285/660 [3:44:09<4:48:31, 46.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 286/660 [3:44:55<4:48:27, 46.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1079) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  43%|████▎     | 287/660 [3:45:42<4:48:46, 46.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1078) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▎     | 288/660 [3:46:29<4:48:36, 46.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1077) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 289/660 [3:47:16<4:48:03, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 290/660 [3:48:02<4:47:17, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1076) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 291/660 [3:48:49<4:46:34, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 292/660 [3:49:36<4:47:02, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  44%|████▍     | 293/660 [3:50:23<4:46:30, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1074) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 294/660 [3:51:09<4:44:50, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1073) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 295/660 [3:51:56<4:44:07, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▍     | 296/660 [3:52:43<4:43:09, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 297/660 [3:53:29<4:42:27, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 298/660 [3:54:16<4:41:30, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1072) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 299/660 [3:55:02<4:40:13, 46.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1071) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  45%|████▌     | 300/660 [3:55:49<4:39:32, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1070) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 301/660 [3:56:36<4:39:11, 46.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 302/660 [3:57:23<4:38:28, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 303/660 [3:58:10<4:38:16, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1069) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 304/660 [3:58:56<4:37:05, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▌     | 305/660 [3:59:43<4:36:19, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  46%|████▋     | 306/660 [4:00:30<4:35:39, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1068) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 307/660 [4:01:16<4:35:09, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 308/660 [4:02:04<4:35:55, 47.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 309/660 [4:02:52<4:35:46, 47.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 310/660 [4:03:39<4:34:46, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1067) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 311/660 [4:04:25<4:33:09, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 312/660 [4:05:12<4:31:42, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  47%|████▋     | 313/660 [4:05:59<4:31:04, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1066) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 314/660 [4:06:45<4:30:12, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 315/660 [4:06:46<3:08:54, 32.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 316/660 [4:07:32<3:32:23, 37.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1065) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 317/660 [4:08:19<3:48:09, 39.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 318/660 [4:09:06<3:58:48, 41.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1064) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 319/660 [4:09:52<4:06:08, 43.31s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1063) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  48%|████▊     | 320/660 [4:10:39<4:10:38, 44.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1062) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▊     | 321/660 [4:11:25<4:13:54, 44.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1061) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 322/660 [4:12:12<4:15:38, 45.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 323/660 [4:12:58<4:16:49, 45.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1060) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 324/660 [4:13:45<4:17:57, 46.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 325/660 [4:14:32<4:18:01, 46.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1059) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  49%|████▉     | 326/660 [4:15:18<4:18:04, 46.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 327/660 [4:16:05<4:17:23, 46.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1058) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 328/660 [4:16:51<4:16:39, 46.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|████▉     | 329/660 [4:17:38<4:16:55, 46.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 330/660 [4:18:25<4:16:16, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 331/660 [4:19:13<4:17:36, 46.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 332/660 [4:20:00<4:16:47, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  50%|█████     | 333/660 [4:20:46<4:15:23, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1057) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 334/660 [4:21:33<4:14:14, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 335/660 [4:22:19<4:13:09, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1052) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 336/660 [4:23:06<4:12:27, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 337/660 [4:23:53<4:11:20, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████     | 338/660 [4:24:40<4:10:40, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1056) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  51%|█████▏    | 339/660 [4:25:26<4:09:48, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1055) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 340/660 [4:26:13<4:08:47, 46.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 341/660 [4:27:00<4:08:21, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1054) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 342/660 [4:27:47<4:09:25, 47.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 343/660 [4:28:35<4:09:45, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 344/660 [4:29:23<4:09:30, 47.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1053) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 345/660 [4:30:09<4:07:11, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  52%|█████▏    | 346/660 [4:30:57<4:06:58, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1051) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 347/660 [4:31:45<4:07:56, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 348/660 [4:32:32<4:06:46, 47.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1050) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 349/660 [4:33:19<4:04:52, 47.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 350/660 [4:34:06<4:03:01, 47.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1046) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 351/660 [4:34:52<4:01:50, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 352/660 [4:35:39<4:00:33, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1049) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  53%|█████▎    | 353/660 [4:36:27<4:02:06, 47.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▎    | 354/660 [4:37:16<4:02:56, 47.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 355/660 [4:38:03<4:01:45, 47.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 356/660 [4:38:51<4:00:41, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 357/660 [4:39:38<3:59:53, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1048) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 358/660 [4:40:25<3:58:35, 47.40s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  54%|█████▍    | 359/660 [4:41:12<3:57:38, 47.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 360/660 [4:42:00<3:56:48, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1047) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 361/660 [4:42:47<3:56:03, 47.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1046) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▍    | 362/660 [4:43:35<3:55:13, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1045) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 363/660 [4:44:22<3:55:06, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1045) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 364/660 [4:45:10<3:54:55, 47.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 365/660 [4:45:58<3:53:59, 47.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  55%|█████▌    | 366/660 [4:46:46<3:54:16, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 367/660 [4:47:34<3:53:22, 47.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 368/660 [4:48:20<3:50:44, 47.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1044) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 369/660 [4:49:07<3:49:17, 47.28s/it]Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 370/660 [4:49:56<3:49:57, 47.58s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▌    | 371/660 [4:50:44<3:50:33, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1043) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  56%|█████▋    | 372/660 [4:51:31<3:48:50, 47.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 373/660 [4:52:20<3:48:58, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=1039) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 374/660 [4:53:08<3:48:46, 48.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=1039) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 375/660 [4:53:55<3:46:50, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1042) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 376/660 [4:54:42<3:44:40, 47.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 377/660 [4:55:29<3:43:04, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 378/660 [4:56:16<3:41:23, 47.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1041) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  57%|█████▋    | 379/660 [4:57:02<3:39:56, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1040) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 380/660 [4:57:49<3:38:49, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1038) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 381/660 [4:58:36<3:38:06, 46.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 382/660 [4:59:23<3:37:29, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 383/660 [5:00:10<3:36:20, 46.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1037) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 384/660 [5:00:56<3:35:11, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 385/660 [5:01:43<3:34:27, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1036) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  58%|█████▊    | 386/660 [5:02:30<3:33:23, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1032) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▊    | 387/660 [5:03:16<3:32:36, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1032) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 388/660 [5:04:03<3:31:39, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 389/660 [5:04:50<3:31:07, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1035) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 390/660 [5:05:36<3:30:16, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 391/660 [5:06:23<3:29:49, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  59%|█████▉    | 392/660 [5:07:11<3:30:03, 47.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1028) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 393/660 [5:07:58<3:29:46, 47.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 394/660 [5:08:46<3:29:14, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1034) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|█████▉    | 395/660 [5:09:33<3:28:09, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=1027) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1033) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 396/660 [5:10:19<3:26:51, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 397/660 [5:11:06<3:25:39, 46.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1031) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 398/660 [5:11:53<3:24:33, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  60%|██████    | 399/660 [5:12:39<3:23:23, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1030) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 400/660 [5:13:26<3:22:45, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 401/660 [5:14:13<3:21:48, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 402/660 [5:15:00<3:21:14, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1029) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 403/660 [5:15:47<3:20:26, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1028) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████    | 404/660 [5:16:33<3:19:22, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1026) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  61%|██████▏   | 405/660 [5:17:20<3:18:42, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1025) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 406/660 [5:18:07<3:17:56, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 407/660 [5:18:54<3:17:28, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 408/660 [5:19:40<3:16:30, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1023) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1024) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 409/660 [5:20:27<3:15:42, 46.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1023) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 410/660 [5:21:14<3:14:58, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 411/660 [5:22:01<3:14:09, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  62%|██████▏   | 412/660 [5:22:48<3:13:24, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 413/660 [5:23:34<3:12:20, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1022) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 414/660 [5:24:21<3:12:03, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 415/660 [5:25:08<3:11:14, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1021) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 416/660 [5:25:55<3:10:03, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1020) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 417/660 [5:26:41<3:09:18, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 418/660 [5:27:28<3:08:29, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1019) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  63%|██████▎   | 419/660 [5:28:15<3:07:41, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▎   | 420/660 [5:29:02<3:07:18, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1018) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 421/660 [5:29:48<3:06:17, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 422/660 [5:30:35<3:05:27, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 423/660 [5:31:22<3:04:27, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 424/660 [5:32:09<3:03:52, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1017) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  64%|██████▍   | 425/660 [5:32:55<3:03:00, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 426/660 [5:33:42<3:02:01, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 427/660 [5:34:29<3:01:19, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=1013) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▍   | 428/660 [5:35:15<3:00:36, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1016) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 429/660 [5:36:02<2:59:49, 46.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 430/660 [5:36:51<3:01:15, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 431/660 [5:37:39<3:01:20, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1015) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  65%|██████▌   | 432/660 [5:38:26<3:00:54, 47.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 433/660 [5:39:14<3:00:32, 47.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1014) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 434/660 [5:40:02<3:00:05, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1013) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 435/660 [5:40:51<3:00:19, 48.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1012) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 436/660 [5:41:41<3:01:43, 48.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▌   | 437/660 [5:42:31<3:02:09, 49.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1011) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  66%|██████▋   | 438/660 [5:43:18<2:59:27, 48.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 439/660 [5:44:06<2:58:02, 48.34s/it]Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1010) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 440/660 [5:44:56<2:58:20, 48.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=1008) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 441/660 [5:45:44<2:56:44, 48.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=1007) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1009) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 442/660 [5:46:30<2:54:06, 47.92s/it]Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1008) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 443/660 [5:47:17<2:51:36, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1007) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 444/660 [5:48:03<2:49:59, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  67%|██████▋   | 445/660 [5:48:51<2:49:39, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 446/660 [5:49:41<2:51:17, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1006) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 447/660 [5:50:29<2:51:13, 48.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 448/660 [5:51:19<2:51:36, 48.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1005) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 449/660 [5:52:09<2:52:35, 49.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 450/660 [5:52:58<2:51:14, 48.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1004) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 451/660 [5:53:46<2:49:58, 48.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=1003) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  68%|██████▊   | 452/660 [5:54:36<2:50:30, 49.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▊   | 453/660 [5:55:24<2:48:21, 48.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 454/660 [5:56:11<2:46:04, 48.37s/it]Both `max_new_tokens` (=2048) and `max_length`(=1002) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 455/660 [5:56:59<2:44:08, 48.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=1001) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=995) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 456/660 [5:57:46<2:42:20, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=1001) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 457/660 [5:58:34<2:41:38, 47.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=1000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  69%|██████▉   | 458/660 [5:59:22<2:41:10, 47.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 459/660 [6:00:10<2:40:48, 48.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 460/660 [6:00:57<2:39:29, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=998) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|██████▉   | 461/660 [6:01:45<2:38:08, 47.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=992) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 462/660 [6:02:32<2:37:06, 47.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=992) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 463/660 [6:03:19<2:35:59, 47.51s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=991) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 464/660 [6:04:07<2:34:54, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=997) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  70%|███████   | 465/660 [6:04:54<2:33:59, 47.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 466/660 [6:05:41<2:33:06, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=996) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 467/660 [6:06:30<2:33:19, 47.66s/it]Both `max_new_tokens` (=2048) and `max_length`(=995) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 468/660 [6:07:18<2:33:07, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 469/660 [6:08:06<2:32:15, 47.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=994) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████   | 470/660 [6:08:56<2:33:49, 48.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  71%|███████▏  | 471/660 [6:09:46<2:34:12, 48.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=993) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 472/660 [6:10:34<2:32:23, 48.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 473/660 [6:11:21<2:29:50, 48.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=990) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=985) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 474/660 [6:12:10<2:29:58, 48.38s/it]Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 475/660 [6:12:59<2:30:15, 48.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=989) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 476/660 [6:13:50<2:31:03, 49.26s/it]Both `max_new_tokens` (=2048) and `max_length`(=988) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 477/660 [6:14:40<2:31:19, 49.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=988) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  72%|███████▏  | 478/660 [6:15:29<2:29:54, 49.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 479/660 [6:16:18<2:28:54, 49.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 480/660 [6:17:08<2:28:10, 49.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=987) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 481/660 [6:17:55<2:25:43, 48.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=986) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 482/660 [6:18:43<2:23:27, 48.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 483/660 [6:19:30<2:21:43, 48.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=981) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 484/660 [6:20:17<2:20:18, 47.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=984) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=980) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  73%|███████▎  | 485/660 [6:21:05<2:19:06, 47.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▎  | 486/660 [6:21:52<2:18:18, 47.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=983) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 487/660 [6:22:40<2:17:17, 47.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=982) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 488/660 [6:23:27<2:16:21, 47.57s/it]Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 489/660 [6:23:28<1:35:38, 33.56s/it]Both `max_new_tokens` (=2048) and `max_length`(=979) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=978) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 490/660 [6:24:15<1:46:37, 37.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  74%|███████▍  | 491/660 [6:25:03<1:54:13, 40.55s/it]Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=977) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 492/660 [6:25:50<1:59:18, 42.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 493/660 [6:26:37<2:02:20, 43.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=976) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▍  | 494/660 [6:27:24<2:04:13, 44.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 495/660 [6:28:11<2:05:03, 45.47s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 496/660 [6:28:58<2:05:33, 45.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=975) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 497/660 [6:29:45<2:05:35, 46.23s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=972) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  75%|███████▌  | 498/660 [6:30:32<2:05:21, 46.43s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=972) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 499/660 [6:31:19<2:05:05, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 500/660 [6:32:06<2:04:34, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=974) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 501/660 [6:32:53<2:04:01, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=973) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 502/660 [6:33:40<2:03:19, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▌  | 503/660 [6:34:27<2:02:33, 46.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  76%|███████▋  | 504/660 [6:35:14<2:01:54, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=971) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 505/660 [6:36:00<2:01:05, 46.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 506/660 [6:36:47<2:00:28, 46.94s/it]Both `max_new_tokens` (=2048) and `max_length`(=970) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=968) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 507/660 [6:37:35<2:00:16, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 508/660 [6:38:22<1:59:17, 47.09s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 509/660 [6:39:09<1:58:40, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=969) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 510/660 [6:39:57<1:57:53, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  77%|███████▋  | 511/660 [6:40:44<1:57:04, 47.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 512/660 [6:41:31<1:56:14, 47.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 513/660 [6:42:18<1:55:31, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=967) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 514/660 [6:43:05<1:54:50, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 515/660 [6:43:53<1:54:44, 47.48s/it]Both `max_new_tokens` (=2048) and `max_length`(=966) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 516/660 [6:44:41<1:53:39, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 517/660 [6:45:28<1:52:48, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  78%|███████▊  | 518/660 [6:46:15<1:51:49, 47.25s/it]Both `max_new_tokens` (=2048) and `max_length`(=965) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▊  | 519/660 [6:47:02<1:50:58, 47.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=964) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 520/660 [6:47:49<1:50:08, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=964) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 521/660 [6:48:36<1:49:20, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=963) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 522/660 [6:49:23<1:48:29, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=962) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 523/660 [6:50:11<1:47:40, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  79%|███████▉  | 524/660 [6:50:58<1:46:59, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 525/660 [6:51:45<1:46:16, 47.24s/it]Both `max_new_tokens` (=2048) and `max_length`(=961) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 526/660 [6:52:32<1:45:25, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|███████▉  | 527/660 [6:53:20<1:44:39, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=960) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 528/660 [6:54:07<1:43:44, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=958) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 529/660 [6:54:54<1:42:53, 47.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 530/660 [6:55:41<1:42:13, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  80%|████████  | 531/660 [6:56:28<1:41:09, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=959) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 532/660 [6:57:14<1:40:09, 46.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 533/660 [6:58:01<1:39:07, 46.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 534/660 [6:58:48<1:38:10, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 535/660 [6:59:34<1:37:22, 46.74s/it]Both `max_new_tokens` (=2048) and `max_length`(=957) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=955) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████  | 536/660 [7:00:21<1:36:27, 46.67s/it]Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  81%|████████▏ | 537/660 [7:01:07<1:35:38, 46.65s/it]Both `max_new_tokens` (=2048) and `max_length`(=956) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 538/660 [7:01:54<1:34:49, 46.64s/it]Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 539/660 [7:02:40<1:33:57, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=953) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 540/660 [7:03:27<1:33:23, 46.70s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=951) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 541/660 [7:04:15<1:32:57, 46.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 542/660 [7:05:02<1:32:17, 46.93s/it]Both `max_new_tokens` (=2048) and `max_length`(=952) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 543/660 [7:05:48<1:31:16, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=951) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  82%|████████▏ | 544/660 [7:06:35<1:30:21, 46.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 545/660 [7:07:21<1:29:28, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=950) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 546/660 [7:08:08<1:28:31, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 547/660 [7:08:54<1:27:46, 46.61s/it]Both `max_new_tokens` (=2048) and `max_length`(=949) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 548/660 [7:09:41<1:26:57, 46.59s/it]Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 549/660 [7:10:28<1:26:15, 46.62s/it]Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=948) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 550/660 [7:11:14<1:25:29, 46.63s/it]Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  83%|████████▎ | 551/660 [7:12:01<1:24:39, 46.60s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=947) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▎ | 552/660 [7:12:49<1:24:58, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 553/660 [7:13:40<1:26:10, 48.32s/it]Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=946) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 554/660 [7:14:28<1:25:10, 48.22s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=945) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 555/660 [7:15:16<1:23:50, 47.91s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 556/660 [7:16:03<1:22:38, 47.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  84%|████████▍ | 557/660 [7:16:51<1:22:00, 47.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=943) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=944) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 558/660 [7:17:39<1:21:20, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=942) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=942) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 559/660 [7:18:26<1:20:22, 47.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▍ | 560/660 [7:19:14<1:19:36, 47.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=941) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 561/660 [7:20:02<1:18:45, 47.73s/it]Both `max_new_tokens` (=2048) and `max_length`(=938) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 562/660 [7:20:50<1:18:05, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=940) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 563/660 [7:21:39<1:18:14, 48.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=939) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  85%|████████▌ | 564/660 [7:22:27<1:17:01, 48.14s/it]Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=937) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 565/660 [7:23:14<1:15:46, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=932) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 566/660 [7:24:01<1:14:28, 47.53s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 567/660 [7:24:48<1:13:18, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=936) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 568/660 [7:25:34<1:12:13, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=928) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▌ | 569/660 [7:26:21<1:11:13, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  86%|████████▋ | 570/660 [7:27:08<1:10:16, 46.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 571/660 [7:27:54<1:09:25, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=935) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 572/660 [7:28:41<1:08:33, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=934) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 573/660 [7:29:28<1:07:45, 46.72s/it]Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=934) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 574/660 [7:30:14<1:06:55, 46.69s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=933) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 575/660 [7:31:01<1:06:14, 46.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 576/660 [7:31:49<1:05:57, 47.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=923) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=927) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  87%|████████▋ | 577/660 [7:32:37<1:05:35, 47.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 578/660 [7:33:25<1:04:51, 47.46s/it]Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 579/660 [7:34:12<1:03:53, 47.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=920) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=926) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 580/660 [7:35:01<1:03:42, 47.78s/it]Both `max_new_tokens` (=2048) and `max_length`(=919) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 581/660 [7:35:50<1:03:25, 48.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=925) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 582/660 [7:36:37<1:02:29, 48.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=924) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 583/660 [7:37:25<1:01:26, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=922) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  88%|████████▊ | 584/660 [7:38:13<1:00:35, 47.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=911) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=922) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▊ | 585/660 [7:39:01<1:00:02, 48.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=921) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 586/660 [7:39:48<58:52, 47.73s/it]  Both `max_new_tokens` (=2048) and `max_length`(=908) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=919) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 587/660 [7:40:35<57:40, 47.41s/it]Both `max_new_tokens` (=2048) and `max_length`(=907) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=918) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 588/660 [7:41:21<56:36, 47.17s/it]Both `max_new_tokens` (=2048) and `max_length`(=905) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=917) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 589/660 [7:42:09<55:48, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=903) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=916) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  89%|████████▉ | 590/660 [7:42:56<55:00, 47.15s/it]Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 591/660 [7:43:43<54:16, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=915) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 592/660 [7:44:30<53:25, 47.13s/it]Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|████████▉ | 593/660 [7:45:17<52:41, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=914) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 594/660 [7:46:04<51:53, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=912) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 595/660 [7:46:52<51:05, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=912) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 596/660 [7:47:39<50:20, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  90%|█████████ | 597/660 [7:48:26<49:31, 47.16s/it]Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 598/660 [7:49:13<48:45, 47.18s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 599/660 [7:50:00<47:58, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 600/660 [7:50:48<47:11, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=910) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 601/660 [7:51:35<46:25, 47.21s/it]Both `max_new_tokens` (=2048) and `max_length`(=897) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████ | 602/660 [7:51:36<32:11, 33.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=909) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  91%|█████████▏| 603/660 [7:52:23<35:33, 37.42s/it]Both `max_new_tokens` (=2048) and `max_length`(=895) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=909) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 604/660 [7:53:10<37:47, 40.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=894) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=905) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 605/660 [7:53:58<38:57, 42.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=893) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=903) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 606/660 [7:54:45<39:35, 44.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=902) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 607/660 [7:55:32<39:47, 45.04s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 608/660 [7:56:20<39:39, 45.76s/it]Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 609/660 [7:57:08<39:22, 46.33s/it]Both `max_new_tokens` (=2048) and `max_length`(=891) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=900) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  92%|█████████▏| 610/660 [7:57:55<38:54, 46.68s/it]Both `max_new_tokens` (=2048) and `max_length`(=890) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=899) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 611/660 [7:58:42<38:17, 46.89s/it]Both `max_new_tokens` (=2048) and `max_length`(=889) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=898) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 612/660 [7:59:30<37:40, 47.10s/it]Both `max_new_tokens` (=2048) and `max_length`(=887) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 613/660 [8:00:17<36:58, 47.19s/it]Both `max_new_tokens` (=2048) and `max_length`(=886) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 614/660 [8:01:05<36:15, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=886) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 615/660 [8:01:52<35:31, 47.36s/it]Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=896) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 616/660 [8:02:40<34:45, 47.39s/it]Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  93%|█████████▎| 617/660 [8:03:28<34:02, 47.50s/it]Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=892) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▎| 618/660 [8:04:15<33:08, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=882) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=891) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 619/660 [8:05:02<32:18, 47.29s/it]Both `max_new_tokens` (=2048) and `max_length`(=881) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=890) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 620/660 [8:05:49<31:28, 47.20s/it]Both `max_new_tokens` (=2048) and `max_length`(=879) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 621/660 [8:06:36<30:37, 47.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=879) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 622/660 [8:07:23<29:47, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=877) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=884) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  94%|█████████▍| 623/660 [8:08:10<29:01, 47.06s/it]Both `max_new_tokens` (=2048) and `max_length`(=875) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=883) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 624/660 [8:08:56<28:10, 46.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=873) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=882) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 625/660 [8:09:43<27:21, 46.90s/it]Both `max_new_tokens` (=2048) and `max_length`(=872) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=880) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▍| 626/660 [8:10:30<26:31, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=871) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=878) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 627/660 [8:11:17<25:44, 46.80s/it]Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=878) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 628/660 [8:12:03<24:56, 46.77s/it]Both `max_new_tokens` (=2048) and `max_length`(=865) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=876) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 629/660 [8:12:50<24:09, 46.75s/it]Both `max_new_tokens` (=2048) and `max_length`(=863) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=874) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  95%|█████████▌| 630/660 [8:13:37<23:24, 46.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=861) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=872) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 631/660 [8:14:24<22:37, 46.79s/it]Both `max_new_tokens` (=2048) and `max_length`(=856) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 632/660 [8:15:11<21:55, 46.97s/it]Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=870) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 633/660 [8:15:58<21:09, 47.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=869) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 634/660 [8:16:45<20:23, 47.05s/it]Both `max_new_tokens` (=2048) and `max_length`(=854) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=868) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▌| 635/660 [8:17:32<19:35, 47.03s/it]Both `max_new_tokens` (=2048) and `max_length`(=853) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=863) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  96%|█████████▋| 636/660 [8:18:19<18:46, 46.95s/it]Both `max_new_tokens` (=2048) and `max_length`(=853) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=862) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 637/660 [8:19:06<18:02, 47.08s/it]Both `max_new_tokens` (=2048) and `max_length`(=846) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 638/660 [8:19:53<17:14, 47.01s/it]Both `max_new_tokens` (=2048) and `max_length`(=844) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=860) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 639/660 [8:20:40<16:26, 47.00s/it]Both `max_new_tokens` (=2048) and `max_length`(=843) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=857) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 640/660 [8:21:27<15:39, 46.98s/it]Both `max_new_tokens` (=2048) and `max_length`(=842) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=855) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 641/660 [8:22:14<14:52, 46.96s/it]Both `max_new_tokens` (=2048) and `max_length`(=837) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=848) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 642/660 [8:23:02<14:08, 47.11s/it]Both `max_new_tokens` (=2048) and `max_length`(=836) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=847) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  97%|█████████▋| 643/660 [8:23:49<13:23, 47.27s/it]Both `max_new_tokens` (=2048) and `max_length`(=834) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=846) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 644/660 [8:24:37<12:37, 47.35s/it]Both `max_new_tokens` (=2048) and `max_length`(=825) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=845) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 645/660 [8:25:24<11:51, 47.45s/it]Both `max_new_tokens` (=2048) and `max_length`(=824) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=844) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 646/660 [8:26:12<11:04, 47.49s/it]Both `max_new_tokens` (=2048) and `max_length`(=823) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=843) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 647/660 [8:27:00<10:20, 47.71s/it]Both `max_new_tokens` (=2048) and `max_length`(=820) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=842) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 648/660 [8:27:48<09:34, 47.85s/it]Both `max_new_tokens` (=2048) and `max_length`(=817) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=841) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 649/660 [8:28:36<08:46, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=817) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=841) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  98%|█████████▊| 650/660 [8:29:24<07:58, 47.86s/it]Both `max_new_tokens` (=2048) and `max_length`(=816) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=835) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▊| 651/660 [8:30:12<07:10, 47.83s/it]Both `max_new_tokens` (=2048) and `max_length`(=812) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=834) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 652/660 [8:31:00<06:22, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=802) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=832) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 653/660 [8:31:48<05:35, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=800) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=831) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 654/660 [8:32:36<04:47, 47.84s/it]Both `max_new_tokens` (=2048) and `max_length`(=794) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=830) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 655/660 [8:33:23<03:59, 47.88s/it]Both `max_new_tokens` (=2048) and `max_length`(=794) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=826) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests:  99%|█████████▉| 656/660 [8:34:11<03:11, 47.81s/it]Both `max_new_tokens` (=2048) and `max_length`(=792) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=822) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 657/660 [8:34:59<02:23, 47.87s/it]Both `max_new_tokens` (=2048) and `max_length`(=781) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=813) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 658/660 [8:35:48<01:36, 48.12s/it]Both `max_new_tokens` (=2048) and `max_length`(=760) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=812) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|█████████▉| 659/660 [8:36:37<00:48, 48.52s/it]Both `max_new_tokens` (=2048) and `max_length`(=699) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=809) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

Running generate_until requests: 100%|██████████| 660/660 [8:37:26<00:00, 48.67s/it]
Running generate_until requests: 100%|██████████| 660/660 [8:37:26<00:00, 47.04s/it]
Both `max_new_tokens` (=2048) and `max_length`(=808) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=800) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=799) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=796) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=792) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
Both `max_new_tokens` (=2048) and `max_length`(=680) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2062875:2118887 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2062875:2064098 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:02:30:37 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 4, batch_size: auto
|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|     4|exact_match|↑  |0.0053|±  | 0.002|
|     |       |strict-match    |     4|exact_match|↑  |0.0000|±  | 0.000|

[rank0]:[W1209 02:30:38.271385879 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2062874:2064096 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2062874:2118944 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2062875:2064098 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2062875:2118893 [1] NCCL INFO comm 0x104d2320 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2062874:2118944 [0] NCCL INFO comm 0xf5bdd20 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 gsm8k 评估完成！

==================================================
开始评估：任务=boolq | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/boolq.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:02:32:02 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-09:02:32:02 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-09:02:32:02 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:32:02 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:32:02 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:32:02 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:32:03 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:32:04 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:32:04 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.12it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.11it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.12it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.11it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.19it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.17it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.70it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.44it/s]
2025-12-09:02:32:07 WARNING  [api.task:844] [Task: boolq] metric acc is defined, but aggregation is not. using default aggregation=mean
2025-12-09:02:32:07 WARNING  [api.task:856] [Task: boolq] metric acc is defined, but higher_is_better is not. using default higher_is_better=True

Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.65it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.42it/s]
2025-12-09:02:32:07 WARNING  [api.task:844] [Task: boolq] metric acc is defined, but aggregation is not. using default aggregation=mean
2025-12-09:02:32:07 WARNING  [api.task:856] [Task: boolq] metric acc is defined, but higher_is_better is not. using default higher_is_better=True
2025-12-09:02:32:34 WARNING  [evaluator:309] Overwriting default num_fewshot of boolq from None to 0
2025-12-09:02:32:34 INFO     [api.task:434] Building contexts for boolq on rank 1...

  0%|          | 0/1635 [00:00<?, ?it/s]
 17%|█▋        | 273/1635 [00:00<00:00, 2722.64it/s]
 34%|███▎      | 551/1635 [00:00<00:00, 2753.61it/s]
 51%|█████     | 830/1635 [00:00<00:00, 2766.30it/s]
 68%|██████▊   | 1107/1635 [00:00<00:00, 2762.31it/s]
 85%|████████▍ | 1384/1635 [00:00<00:00, 2757.82it/s]
100%|██████████| 1635/1635 [00:00<00:00, 2757.43it/s]
2025-12-09:02:32:35 WARNING  [evaluator:309] Overwriting default num_fewshot of boolq from None to 0
2025-12-09:02:32:35 INFO     [api.task:434] Building contexts for boolq on rank 0...

  0%|          | 0/1635 [00:00<?, ?it/s]
 17%|█▋        | 275/1635 [00:00<00:00, 2741.61it/s]
 34%|███▎      | 550/1635 [00:00<00:00, 2739.76it/s]
 51%|█████     | 829/1635 [00:00<00:00, 2760.47it/s]
 68%|██████▊   | 1111/1635 [00:00<00:00, 2781.50it/s]
 85%|████████▌ | 1391/1635 [00:00<00:00, 2787.32it/s]
100%|██████████| 1635/1635 [00:00<00:00, 2781.17it/s]
n136-128-154:2118997:2118997 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2118997:2118997 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2118997:2118997 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2118997:2118997 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2118997:2118997 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:2118998:2118998 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2118998:2118998 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2118998:2118998 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2118998:2118998 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2118998:2118998 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2118997:2119417 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2118998:2119418 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2118997:2119417 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2118998:2119418 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2118997:2119417 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2118997:2119417 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2118997:2119417 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2118998:2119418 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2118998:2119418 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2118998:2119418 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2118998:2119418 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2118998:2119418 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2118998:2119418 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2118997:2119417 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2118997:2119417 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2118997:2119417 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2118998:2119418 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2118998:2119418 [1] NCCL INFO Using network IB
n136-128-154:2118997:2119417 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2118997:2119417 [0] NCCL INFO Using network IB
n136-128-154:2118998:2119418 [1] NCCL INFO ncclCommInitRankConfig comm 0x108a51d0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd79e75f1643ca660 - Init START
n136-128-154:2118997:2119417 [0] NCCL INFO ncclCommInitRankConfig comm 0x103454d0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd79e75f1643ca660 - Init START
n136-128-154:2118998:2119418 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2118997:2119417 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2118997:2119417 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2118997:2119417 [0] NCCL INFO Retrieving state for IB
n136-128-154:2118997:2119417 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2118997:2119417 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2118998:2119418 [1] NCCL INFO Retrieving state for IB
n136-128-154:2118998:2119418 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2118997:2119417 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2118997:2119417 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2118997:2119417 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2118998:2119418 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2118998:2119418 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2118997:2119417 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2118997:2119417 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2118997:2119417 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2118997:2119417 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2118997:2119417 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2118997:2119417 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2118997:2119417 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2118997:2119417 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2118997:2119417 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2118997:2119417 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2118997:2119417 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2118997:2119417 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2118997:2119417 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2118997:2119417 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2118997:2119417 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2118997:2119417 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2118997:2119417 [0] NCCL INFO ==========================================
n136-128-154:2118997:2119417 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2118997:2119417 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2118997:2119417 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2118998:2119418 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2118998:2119418 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2118998:2119418 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2118998:2119418 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2118998:2119418 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2118998:2119418 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2118998:2119418 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2118998:2119418 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2118998:2119418 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2118998:2119418 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2118998:2119418 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2118998:2119418 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2118998:2119418 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2118998:2119418 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2118998:2119418 [1] NCCL INFO ==========================================
n136-128-154:2118998:2119418 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2118998:2119418 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2118998:2119418 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2118997:2119417 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2118997:2119417 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2118997:2119417 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118997:2119417 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2118998:2119418 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2118998:2119418 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2118998:2119418 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118998:2119418 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2118997:2119417 [0] NCCL INFO comm 0x103454d0 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2118998:2119418 [1] NCCL INFO comm 0x108a51d0 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2118998:2119418 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2118998:2119418 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2118998:2119418 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2118998:2119418 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2118997:2119417 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2118997:2119417 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2118998:2119418 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2118998:2119429 [1] NCCL INFO [Proxy Service] Device 1 CPU core 112
n136-128-154:2118998:2119430 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 49
n136-128-154:2118997:2119417 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2118997:2119417 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2118997:2119431 [0] NCCL INFO [Proxy Service] Device 0 CPU core 34
n136-128-154:2118997:2119432 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 99
n136-128-154:2118998:2119418 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2118998:2119418 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2118997:2119417 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2118997:2119417 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2118997:2119417 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2118998:2119418 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2118998:2119418 [1] NCCL INFO ncclCommInitRankConfig comm 0x108a51d0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xd79e75f1643ca660 - Init COMPLETE
n136-128-154:2118998:2119418 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.60 (kernels 0.28, alloc 0.18, bootstrap 0.00, allgathers 0.00, topo 0.10, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:2118997:2119417 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2118997:2119417 [0] NCCL INFO ncclCommInitRankConfig comm 0x103454d0 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xd79e75f1643ca660 - Init COMPLETE
n136-128-154:2118997:2119417 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.60 (kernels 0.28, alloc 0.18, bootstrap 0.00, allgathers 0.00, topo 0.10, graphs 0.00, connections 0.01, rest 0.03)
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118997:2119433 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119434 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2118997:2119433 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-09:02:32:37 INFO     [evaluator:559] Running loglikelihood requests
2025-12-09:02:32:37 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/3270 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 45
Determined largest batch size: 45

Running loglikelihood requests:   0%|          | 1/3270 [00:55<50:45:21, 55.90s/it]
Running loglikelihood requests:   3%|▎         | 91/3270 [00:57<23:33,  2.25it/s]  
Running loglikelihood requests:   6%|▌         | 181/3270 [00:58<09:49,  5.24it/s]
Running loglikelihood requests:   8%|▊         | 271/3270 [00:59<05:26,  9.19it/s]
Running loglikelihood requests:  11%|█         | 361/3270 [01:00<03:23, 14.29it/s]
Running loglikelihood requests:  14%|█▍        | 451/3270 [01:00<02:16, 20.71it/s]
Running loglikelihood requests:  17%|█▋        | 541/3270 [01:01<01:35, 28.52it/s]
Running loglikelihood requests:  19%|█▉        | 631/3270 [01:02<01:10, 37.70it/s]
Running loglikelihood requests:  22%|██▏       | 721/3270 [01:03<00:53, 47.99it/s]
Running loglikelihood requests:  25%|██▍       | 811/3270 [01:04<00:41, 58.92it/s]
Running loglikelihood requests:  28%|██▊       | 901/3270 [01:04<00:33, 70.14it/s]
Running loglikelihood requests:  30%|███       | 991/3270 [01:05<00:28, 80.86it/s]
Running loglikelihood requests:  33%|███▎      | 1081/3270 [01:06<00:24, 90.67it/s]
Running loglikelihood requests:  36%|███▌      | 1171/3270 [01:07<00:21, 99.62it/s]
Running loglikelihood requests:  39%|███▊      | 1261/3270 [01:07<00:18, 108.10it/s]
Running loglikelihood requests:  41%|████▏     | 1351/3270 [01:08<00:16, 115.53it/s]
Running loglikelihood requests:  44%|████▍     | 1441/3270 [01:08<00:14, 122.07it/s]
Running loglikelihood requests:  47%|████▋     | 1531/3270 [01:09<00:13, 127.71it/s]
Running loglikelihood requests:  50%|████▉     | 1621/3270 [01:10<00:12, 132.42it/s]
Running loglikelihood requests:  52%|█████▏    | 1711/3270 [01:10<00:11, 137.08it/s]
Running loglikelihood requests:  55%|█████▌    | 1801/3270 [01:11<00:10, 141.93it/s]
Running loglikelihood requests:  58%|█████▊    | 1891/3270 [01:11<00:09, 146.28it/s]
Running loglikelihood requests:  61%|██████    | 1981/3270 [01:12<00:08, 150.05it/s]
Running loglikelihood requests:  63%|██████▎   | 2071/3270 [01:13<00:07, 152.97it/s]
Running loglikelihood requests:  66%|██████▌   | 2161/3270 [01:13<00:07, 156.23it/s]
Running loglikelihood requests:  69%|██████▉   | 2251/3270 [01:14<00:06, 160.76it/s]
Running loglikelihood requests:  72%|███████▏  | 2341/3270 [01:14<00:05, 164.69it/s]
Running loglikelihood requests:  74%|███████▍  | 2431/3270 [01:15<00:04, 168.63it/s]
Running loglikelihood requests:  77%|███████▋  | 2521/3270 [01:15<00:04, 172.63it/s]
Running loglikelihood requests:  80%|███████▉  | 2611/3270 [01:16<00:03, 176.01it/s]
Running loglikelihood requests:  83%|████████▎ | 2701/3270 [01:16<00:03, 180.36it/s]
Running loglikelihood requests:  85%|████████▌ | 2791/3270 [01:17<00:02, 186.57it/s]
Running loglikelihood requests:  88%|████████▊ | 2881/3270 [01:17<00:02, 193.45it/s]
Running loglikelihood requests:  91%|█████████ | 2971/3270 [01:17<00:01, 201.16it/s]
Running loglikelihood requests:  94%|█████████▎| 3061/3270 [01:18<00:00, 210.46it/s]
Running loglikelihood requests:  96%|█████████▋| 3151/3270 [01:18<00:00, 220.39it/s]
Running loglikelihood requests:  99%|█████████▉| 3241/3270 [01:18<00:00, 277.85it/s]
Running loglikelihood requests: 100%|██████████| 3270/3270 [01:18<00:00, 41.49it/s] 
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2118998:2119547 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2118998:2119429 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:02:34:08 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (45)
|Tasks|Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|-----|------:|------|-----:|------|---|-----:|---|-----:|
|boolq|      2|none  |     0|acc   |↑  |0.6028|±  |0.0086|

[rank0]:[W1209 02:34:09.673844874 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2118997:2119431 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2118997:2119623 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2118998:2119429 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2118998:2119553 [1] NCCL INFO comm 0x108a51d0 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2118997:2119623 [0] NCCL INFO comm 0x103454d0 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 boolq 评估完成！

==================================================
开始评估：任务=arc_challenge | 少样本数=25 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/arc_challenge.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:02:35:36 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-09:02:35:36 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-09:02:35:36 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:35:36 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:35:36 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:35:36 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:35:37 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:35:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:35:38 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.12it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.06it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.22it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.16it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.31it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.28it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.86it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.57it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.85it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.54it/s]
2025-12-09:02:36:05 WARNING  [evaluator:309] Overwriting default num_fewshot of arc_challenge from None to 25
2025-12-09:02:36:05 INFO     [api.task:434] Building contexts for arc_challenge on rank 0...

  0%|          | 0/586 [00:00<?, ?it/s]
  1%|          | 4/586 [00:00<00:16, 36.32it/s]
  1%|▏         | 8/586 [00:00<00:15, 36.73it/s]
  2%|▏         | 12/586 [00:00<00:15, 36.84it/s]
  3%|▎         | 16/586 [00:00<00:15, 37.00it/s]
  3%|▎         | 20/586 [00:00<00:15, 37.16it/s]
  4%|▍         | 24/586 [00:00<00:15, 37.14it/s]
  5%|▍         | 28/586 [00:00<00:15, 36.89it/s]
  5%|▌         | 32/586 [00:00<00:14, 37.02it/s]
  6%|▌         | 36/586 [00:00<00:14, 36.92it/s]
  7%|▋         | 40/586 [00:01<00:14, 37.02it/s]
  8%|▊         | 44/586 [00:01<00:14, 36.98it/s]2025-12-09:02:36:06 WARNING  [evaluator:309] Overwriting default num_fewshot of arc_challenge from None to 25
2025-12-09:02:36:06 INFO     [api.task:434] Building contexts for arc_challenge on rank 1...

  0%|          | 0/586 [00:00<?, ?it/s]
  8%|▊         | 48/586 [00:01<00:14, 37.07it/s]
  1%|          | 4/586 [00:00<00:16, 36.03it/s]
  9%|▉         | 52/586 [00:01<00:14, 36.74it/s]
  1%|▏         | 8/586 [00:00<00:16, 36.05it/s]
 10%|▉         | 56/586 [00:01<00:14, 36.88it/s]
 10%|█         | 60/586 [00:01<00:14, 36.88it/s]
  2%|▏         | 12/586 [00:00<00:16, 35.36it/s]
 11%|█         | 64/586 [00:01<00:14, 36.79it/s]
  3%|▎         | 16/586 [00:00<00:16, 35.41it/s]
 12%|█▏        | 68/586 [00:01<00:14, 36.75it/s]
  3%|▎         | 20/586 [00:00<00:15, 35.62it/s]
 12%|█▏        | 72/586 [00:01<00:13, 36.82it/s]
  4%|▍         | 24/586 [00:00<00:15, 36.01it/s]
 13%|█▎        | 76/586 [00:02<00:13, 36.83it/s]
  5%|▍         | 28/586 [00:00<00:15, 35.93it/s]
 14%|█▎        | 80/586 [00:02<00:13, 36.95it/s]
  5%|▌         | 32/586 [00:00<00:15, 36.19it/s]
 14%|█▍        | 84/586 [00:02<00:13, 37.07it/s]
  6%|▌         | 36/586 [00:01<00:15, 36.33it/s]
 15%|█▌        | 88/586 [00:02<00:13, 37.13it/s]
  7%|▋         | 40/586 [00:01<00:15, 36.35it/s]
 16%|█▌        | 92/586 [00:02<00:13, 37.12it/s]
  8%|▊         | 44/586 [00:01<00:14, 36.50it/s]
 16%|█▋        | 96/586 [00:02<00:13, 37.17it/s]
  8%|▊         | 48/586 [00:01<00:14, 36.64it/s]
 17%|█▋        | 100/586 [00:02<00:13, 36.76it/s]
  9%|▉         | 52/586 [00:01<00:14, 36.33it/s]
 18%|█▊        | 104/586 [00:02<00:13, 36.83it/s]
 10%|▉         | 56/586 [00:01<00:14, 36.41it/s]
 18%|█▊        | 108/586 [00:02<00:12, 36.94it/s]
 10%|█         | 60/586 [00:01<00:14, 36.47it/s]
 19%|█▉        | 112/586 [00:03<00:12, 37.07it/s]
 11%|█         | 64/586 [00:01<00:14, 36.23it/s]
 20%|█▉        | 116/586 [00:03<00:12, 37.13it/s]
 12%|█▏        | 68/586 [00:01<00:14, 36.37it/s]
 20%|██        | 120/586 [00:03<00:12, 37.16it/s]
 12%|█▏        | 72/586 [00:01<00:14, 36.35it/s]
 21%|██        | 124/586 [00:03<00:12, 37.12it/s]
 13%|█▎        | 76/586 [00:02<00:13, 36.45it/s]
 22%|██▏       | 128/586 [00:03<00:12, 37.11it/s]
 14%|█▎        | 80/586 [00:02<00:13, 36.52it/s]
 23%|██▎       | 132/586 [00:03<00:12, 36.72it/s]
 14%|█▍        | 84/586 [00:02<00:13, 36.62it/s]
 23%|██▎       | 136/586 [00:03<00:12, 36.86it/s]
 15%|█▌        | 88/586 [00:02<00:13, 36.36it/s]
 24%|██▍       | 140/586 [00:03<00:12, 36.95it/s]
 16%|█▌        | 92/586 [00:02<00:13, 36.44it/s]
 25%|██▍       | 144/586 [00:03<00:11, 36.99it/s]
 16%|█▋        | 96/586 [00:02<00:13, 36.48it/s]
 25%|██▌       | 148/586 [00:04<00:11, 36.97it/s]
 17%|█▋        | 100/586 [00:02<00:13, 36.24it/s]
 26%|██▌       | 152/586 [00:04<00:11, 36.99it/s]
 18%|█▊        | 104/586 [00:02<00:13, 36.31it/s]
 27%|██▋       | 156/586 [00:04<00:11, 36.94it/s]
 18%|█▊        | 108/586 [00:02<00:13, 36.24it/s]
 27%|██▋       | 160/586 [00:04<00:11, 36.85it/s]
 19%|█▉        | 112/586 [00:03<00:13, 36.35it/s]
 28%|██▊       | 164/586 [00:04<00:11, 36.87it/s]
 20%|█▉        | 116/586 [00:03<00:12, 36.31it/s]
 29%|██▊       | 168/586 [00:04<00:11, 36.88it/s]
 20%|██        | 120/586 [00:03<00:12, 36.39it/s]
 29%|██▉       | 172/586 [00:04<00:11, 36.93it/s]
 21%|██        | 124/586 [00:03<00:12, 36.47it/s]
 30%|███       | 176/586 [00:04<00:11, 36.98it/s]
 22%|██▏       | 128/586 [00:03<00:12, 36.57it/s]
 31%|███       | 180/586 [00:04<00:10, 36.98it/s]
 23%|██▎       | 132/586 [00:03<00:12, 36.32it/s]
 31%|███▏      | 184/586 [00:04<00:10, 36.94it/s]
 23%|██▎       | 136/586 [00:03<00:12, 36.44it/s]
 32%|███▏      | 188/586 [00:05<00:10, 36.96it/s]
 24%|██▍       | 140/586 [00:03<00:12, 36.40it/s]
 33%|███▎      | 192/586 [00:05<00:10, 36.92it/s]
 25%|██▍       | 144/586 [00:03<00:12, 36.50it/s]
 33%|███▎      | 196/586 [00:05<00:10, 36.91it/s]
 25%|██▌       | 148/586 [00:04<00:12, 36.19it/s]
 34%|███▍      | 200/586 [00:05<00:10, 36.93it/s]
 26%|██▌       | 152/586 [00:04<00:11, 36.33it/s]
 35%|███▍      | 204/586 [00:05<00:10, 36.91it/s]
 27%|██▋       | 156/586 [00:04<00:11, 36.49it/s]
 35%|███▌      | 208/586 [00:05<00:10, 36.91it/s]
 27%|██▋       | 160/586 [00:04<00:11, 36.60it/s]
 36%|███▌      | 212/586 [00:05<00:10, 36.93it/s]
 28%|██▊       | 164/586 [00:04<00:11, 36.59it/s]
 37%|███▋      | 216/586 [00:05<00:10, 36.94it/s]
 29%|██▊       | 168/586 [00:04<00:11, 35.26it/s]
 38%|███▊      | 220/586 [00:05<00:10, 36.51it/s]
 29%|██▉       | 172/586 [00:04<00:11, 35.54it/s]
 38%|███▊      | 224/586 [00:06<00:09, 36.60it/s]
 30%|███       | 176/586 [00:04<00:11, 35.73it/s]
 39%|███▉      | 228/586 [00:06<00:09, 36.66it/s]
 31%|███       | 180/586 [00:04<00:11, 34.35it/s]
 40%|███▉      | 232/586 [00:06<00:09, 36.70it/s]
 31%|███▏      | 184/586 [00:05<00:11, 34.45it/s]
 40%|████      | 236/586 [00:06<00:09, 36.63it/s]
 41%|████      | 240/586 [00:06<00:09, 36.52it/s]
 32%|███▏      | 188/586 [00:05<00:11, 34.35it/s]
 42%|████▏     | 244/586 [00:06<00:09, 36.61it/s]
 33%|███▎      | 192/586 [00:05<00:11, 34.98it/s]
 42%|████▏     | 248/586 [00:06<00:09, 36.64it/s]
 33%|███▎      | 196/586 [00:05<00:11, 35.31it/s]
 43%|████▎     | 252/586 [00:06<00:09, 36.72it/s]
 34%|███▍      | 200/586 [00:05<00:10, 35.58it/s]
 44%|████▎     | 256/586 [00:06<00:08, 36.77it/s]
 35%|███▍      | 204/586 [00:05<00:10, 35.55it/s]
 44%|████▍     | 260/586 [00:07<00:08, 36.77it/s]
 35%|███▌      | 208/586 [00:05<00:10, 35.84it/s]
 45%|████▌     | 264/586 [00:07<00:08, 36.85it/s]
 36%|███▌      | 212/586 [00:05<00:10, 36.12it/s]
 46%|████▌     | 268/586 [00:07<00:08, 36.90it/s]
 37%|███▋      | 216/586 [00:05<00:10, 36.30it/s]
 46%|████▋     | 272/586 [00:07<00:08, 36.90it/s]
 38%|███▊      | 220/586 [00:06<00:10, 36.44it/s]
 47%|████▋     | 276/586 [00:07<00:08, 36.95it/s]
 38%|███▊      | 224/586 [00:06<00:09, 36.58it/s]
 48%|████▊     | 280/586 [00:07<00:08, 36.70it/s]
 39%|███▉      | 228/586 [00:06<00:09, 36.56it/s]
 48%|████▊     | 284/586 [00:07<00:08, 36.67it/s]
 40%|███▉      | 232/586 [00:06<00:09, 36.56it/s]
 49%|████▉     | 288/586 [00:07<00:08, 36.78it/s]
 40%|████      | 236/586 [00:06<00:09, 36.41it/s]
 50%|████▉     | 292/586 [00:07<00:07, 36.88it/s]
 41%|████      | 240/586 [00:06<00:09, 36.54it/s]
 51%|█████     | 296/586 [00:08<00:07, 36.73it/s]
 42%|████▏     | 244/586 [00:06<00:09, 36.51it/s]
 51%|█████     | 300/586 [00:08<00:07, 36.38it/s]
 42%|████▏     | 248/586 [00:06<00:09, 35.79it/s]
 52%|█████▏    | 304/586 [00:08<00:07, 36.09it/s]
 43%|████▎     | 252/586 [00:06<00:09, 35.71it/s]
 53%|█████▎    | 308/586 [00:08<00:07, 36.39it/s]
 44%|████▎     | 256/586 [00:07<00:09, 35.98it/s]
 53%|█████▎    | 312/586 [00:08<00:07, 36.57it/s]
 44%|████▍     | 260/586 [00:07<00:08, 36.24it/s]
 54%|█████▍    | 316/586 [00:08<00:07, 36.73it/s]
 45%|████▌     | 264/586 [00:07<00:08, 36.41it/s]
 55%|█████▍    | 320/586 [00:08<00:07, 36.86it/s]
 46%|████▌     | 268/586 [00:07<00:08, 36.56it/s]
 55%|█████▌    | 324/586 [00:08<00:07, 36.93it/s]
 46%|████▋     | 272/586 [00:07<00:08, 36.65it/s]
 56%|█████▌    | 328/586 [00:08<00:06, 36.97it/s]
 47%|████▋     | 276/586 [00:07<00:08, 36.30it/s]
 57%|█████▋    | 332/586 [00:09<00:06, 36.97it/s]
 48%|████▊     | 280/586 [00:07<00:08, 36.43it/s]
 57%|█████▋    | 336/586 [00:09<00:06, 37.05it/s]
 48%|████▊     | 284/586 [00:07<00:08, 36.56it/s]
 58%|█████▊    | 340/586 [00:09<00:06, 37.04it/s]
 49%|████▉     | 288/586 [00:07<00:08, 36.67it/s]
 59%|█████▊    | 344/586 [00:09<00:06, 37.04it/s]
 50%|████▉     | 292/586 [00:08<00:08, 36.73it/s]
 59%|█████▉    | 348/586 [00:09<00:06, 37.09it/s]
 51%|█████     | 296/586 [00:08<00:07, 36.81it/s]
 60%|██████    | 352/586 [00:09<00:06, 37.08it/s]
 51%|█████     | 300/586 [00:08<00:07, 36.84it/s]
 61%|██████    | 356/586 [00:09<00:06, 37.10it/s]
 52%|█████▏    | 304/586 [00:08<00:07, 36.75it/s]
 61%|██████▏   | 360/586 [00:09<00:06, 37.14it/s]
 53%|█████▎    | 308/586 [00:08<00:07, 36.74it/s]
 62%|██████▏   | 364/586 [00:09<00:05, 37.15it/s]
 53%|█████▎    | 312/586 [00:08<00:07, 36.75it/s]
 63%|██████▎   | 368/586 [00:09<00:05, 37.14it/s]
 54%|█████▍    | 316/586 [00:08<00:07, 36.78it/s]
 63%|██████▎   | 372/586 [00:10<00:05, 37.13it/s]
 55%|█████▍    | 320/586 [00:08<00:07, 36.83it/s]
 64%|██████▍   | 376/586 [00:10<00:05, 36.86it/s]
 55%|█████▌    | 324/586 [00:08<00:07, 36.84it/s]
 65%|██████▍   | 380/586 [00:10<00:05, 36.93it/s]
 56%|█████▌    | 328/586 [00:09<00:07, 36.84it/s]
 66%|██████▌   | 384/586 [00:10<00:05, 37.00it/s]
 57%|█████▋    | 332/586 [00:09<00:06, 36.57it/s]
 66%|██████▌   | 388/586 [00:10<00:05, 37.05it/s]
 57%|█████▋    | 336/586 [00:09<00:06, 36.63it/s]
 67%|██████▋   | 392/586 [00:10<00:05, 37.05it/s]
 58%|█████▊    | 340/586 [00:09<00:06, 36.70it/s]
 68%|██████▊   | 396/586 [00:10<00:05, 37.10it/s]
 59%|█████▊    | 344/586 [00:09<00:06, 36.78it/s]
 68%|██████▊   | 400/586 [00:10<00:05, 37.17it/s]
 59%|█████▉    | 348/586 [00:09<00:06, 36.80it/s]
 69%|██████▉   | 404/586 [00:10<00:04, 37.14it/s]
 60%|██████    | 352/586 [00:09<00:06, 36.78it/s]
 70%|██████▉   | 408/586 [00:11<00:04, 37.16it/s]
 61%|██████    | 356/586 [00:09<00:06, 36.80it/s]
 70%|███████   | 412/586 [00:11<00:04, 37.21it/s]
 61%|██████▏   | 360/586 [00:09<00:06, 36.84it/s]
 71%|███████   | 416/586 [00:11<00:04, 37.28it/s]
 62%|██████▏   | 364/586 [00:10<00:06, 36.59it/s]
 72%|███████▏  | 420/586 [00:11<00:04, 37.23it/s]
 63%|██████▎   | 368/586 [00:10<00:05, 36.57it/s]
 72%|███████▏  | 424/586 [00:11<00:04, 37.27it/s]
 63%|██████▎   | 372/586 [00:10<00:05, 36.65it/s]
 73%|███████▎  | 428/586 [00:11<00:04, 37.23it/s]
 64%|██████▍   | 376/586 [00:10<00:05, 36.68it/s]
 74%|███████▎  | 432/586 [00:11<00:04, 37.20it/s]
 65%|██████▍   | 380/586 [00:10<00:05, 36.75it/s]
 74%|███████▍  | 436/586 [00:11<00:04, 37.20it/s]
 66%|██████▌   | 384/586 [00:10<00:05, 36.82it/s]
 75%|███████▌  | 440/586 [00:11<00:03, 37.20it/s]
 66%|██████▌   | 388/586 [00:10<00:05, 36.87it/s]
 76%|███████▌  | 444/586 [00:12<00:03, 37.23it/s]
 67%|██████▋   | 392/586 [00:10<00:05, 36.89it/s]
 76%|███████▋  | 448/586 [00:12<00:03, 37.22it/s]
 68%|██████▊   | 396/586 [00:10<00:05, 36.90it/s]
 77%|███████▋  | 452/586 [00:12<00:03, 36.94it/s]
 68%|██████▊   | 400/586 [00:11<00:05, 36.72it/s]
 78%|███████▊  | 456/586 [00:12<00:03, 36.99it/s]
 69%|██████▉   | 404/586 [00:11<00:04, 36.76it/s]
 78%|███████▊  | 460/586 [00:12<00:03, 36.95it/s]
 70%|██████▉   | 408/586 [00:11<00:04, 36.82it/s]
 79%|███████▉  | 464/586 [00:12<00:03, 37.06it/s]
 70%|███████   | 412/586 [00:11<00:04, 36.88it/s]
 80%|███████▉  | 468/586 [00:12<00:03, 37.11it/s]
 71%|███████   | 416/586 [00:11<00:04, 36.87it/s]
 81%|████████  | 472/586 [00:12<00:03, 37.08it/s]
 72%|███████▏  | 420/586 [00:11<00:04, 36.88it/s]
 81%|████████  | 476/586 [00:12<00:02, 37.09it/s]
 72%|███████▏  | 424/586 [00:11<00:04, 36.90it/s]
 82%|████████▏ | 480/586 [00:12<00:02, 37.06it/s]
 73%|███████▎  | 428/586 [00:11<00:04, 36.89it/s]
 83%|████████▎ | 484/586 [00:13<00:02, 37.10it/s]
 74%|███████▎  | 432/586 [00:11<00:04, 36.92it/s]
 83%|████████▎ | 488/586 [00:13<00:02, 37.14it/s]
 74%|███████▍  | 436/586 [00:11<00:04, 36.61it/s]
 84%|████████▍ | 492/586 [00:13<00:02, 37.11it/s]
 75%|███████▌  | 440/586 [00:12<00:03, 36.66it/s]
 85%|████████▍ | 496/586 [00:13<00:02, 37.10it/s]
 76%|███████▌  | 444/586 [00:12<00:03, 36.73it/s]
 85%|████████▌ | 500/586 [00:13<00:02, 37.14it/s]
 76%|███████▋  | 448/586 [00:12<00:03, 36.77it/s]
 86%|████████▌ | 504/586 [00:13<00:02, 37.18it/s]
 77%|███████▋  | 452/586 [00:12<00:03, 36.85it/s]
 87%|████████▋ | 508/586 [00:13<00:02, 37.20it/s]
 78%|███████▊  | 456/586 [00:12<00:03, 36.88it/s]
 87%|████████▋ | 512/586 [00:13<00:01, 37.21it/s]
 78%|███████▊  | 460/586 [00:12<00:03, 36.89it/s]
 88%|████████▊ | 516/586 [00:13<00:01, 37.17it/s]
 79%|███████▉  | 464/586 [00:12<00:03, 36.89it/s]
 89%|████████▊ | 520/586 [00:14<00:01, 36.76it/s]
 80%|███████▉  | 468/586 [00:12<00:03, 36.91it/s]
 89%|████████▉ | 524/586 [00:14<00:01, 36.84it/s]
 81%|████████  | 472/586 [00:12<00:03, 36.90it/s]
 90%|█████████ | 528/586 [00:14<00:01, 36.82it/s]
 81%|████████  | 476/586 [00:13<00:03, 36.52it/s]
 91%|█████████ | 532/586 [00:14<00:01, 36.83it/s]
 82%|████████▏ | 480/586 [00:13<00:02, 36.56it/s]
 91%|█████████▏| 536/586 [00:14<00:01, 36.90it/s]
 83%|████████▎ | 484/586 [00:13<00:02, 36.66it/s]
 92%|█████████▏| 540/586 [00:14<00:01, 36.97it/s]
 83%|████████▎ | 488/586 [00:13<00:02, 36.72it/s]
 93%|█████████▎| 544/586 [00:14<00:01, 37.02it/s]
 84%|████████▍ | 492/586 [00:13<00:02, 36.77it/s]
 94%|█████████▎| 548/586 [00:14<00:01, 37.08it/s]
 85%|████████▍ | 496/586 [00:13<00:02, 36.79it/s]
 94%|█████████▍| 552/586 [00:14<00:00, 37.10it/s]
 85%|████████▌ | 500/586 [00:13<00:02, 36.85it/s]
 95%|█████████▍| 556/586 [00:15<00:00, 37.08it/s]
 86%|████████▌ | 504/586 [00:13<00:02, 36.88it/s]
 96%|█████████▌| 560/586 [00:15<00:00, 37.15it/s]
 87%|████████▋ | 508/586 [00:13<00:02, 36.88it/s]
 96%|█████████▌| 564/586 [00:15<00:00, 37.19it/s]
 87%|████████▋ | 512/586 [00:14<00:02, 36.91it/s]
 97%|█████████▋| 568/586 [00:15<00:00, 37.19it/s]
 88%|████████▊ | 516/586 [00:14<00:01, 36.77it/s]
 98%|█████████▊| 572/586 [00:15<00:00, 37.21it/s]
 89%|████████▊ | 520/586 [00:14<00:01, 36.79it/s]
 98%|█████████▊| 576/586 [00:15<00:00, 37.21it/s]
 89%|████████▉ | 524/586 [00:14<00:01, 36.85it/s]
 99%|█████████▉| 580/586 [00:15<00:00, 37.24it/s]
 90%|█████████ | 528/586 [00:14<00:01, 36.89it/s]
100%|█████████▉| 584/586 [00:15<00:00, 37.27it/s]
100%|██████████| 586/586 [00:15<00:00, 36.97it/s]
n136-128-154:2119679:2119679 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2119679:2119679 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2119679:2119679 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2119679:2119679 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2119679:2119679 [0] NCCL INFO Comm config Blocking set to 1

 91%|█████████ | 532/586 [00:14<00:01, 36.81it/s]
 91%|█████████▏| 536/586 [00:14<00:01, 36.71it/s]
 92%|█████████▏| 540/586 [00:14<00:01, 36.75it/s]n136-128-154:2119679:2119909 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2119679:2119909 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2119679:2119909 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2119679:2119909 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2119679:2119909 [0] NCCL INFO NCCL_IB_HCA set to mlx5

 93%|█████████▎| 544/586 [00:14<00:01, 36.83it/s]n136-128-154:2119679:2119909 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2119679:2119909 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2119679:2119909 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2119679:2119909 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2119679:2119909 [0] NCCL INFO Using network IB
n136-128-154:2119679:2119909 [0] NCCL INFO ncclCommInitRankConfig comm 0x10f76950 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x6ebd969f77d8e249 - Init START

 94%|█████████▎| 548/586 [00:15<00:01, 36.86it/s]
 94%|█████████▍| 552/586 [00:15<00:00, 36.91it/s]
 95%|█████████▍| 556/586 [00:15<00:00, 36.87it/s]
 96%|█████████▌| 560/586 [00:15<00:00, 36.32it/s]
 96%|█████████▌| 564/586 [00:15<00:00, 36.24it/s]
 97%|█████████▋| 568/586 [00:15<00:00, 36.22it/s]
 98%|█████████▊| 572/586 [00:15<00:00, 36.22it/s]
 98%|█████████▊| 576/586 [00:15<00:00, 36.25it/s]
 99%|█████████▉| 580/586 [00:15<00:00, 36.26it/s]
100%|█████████▉| 584/586 [00:16<00:00, 36.22it/s]
100%|██████████| 586/586 [00:16<00:00, 36.44it/s]
n136-128-154:2119680:2119680 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2119680:2119680 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2119680:2119680 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2119680:2119680 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2119680:2119680 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2119680:2119917 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2119680:2119917 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2119680:2119917 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2119680:2119917 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2119680:2119917 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2119680:2119917 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2119680:2119917 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2119680:2119917 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2119680:2119917 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2119680:2119917 [1] NCCL INFO Using network IB
n136-128-154:2119680:2119917 [1] NCCL INFO ncclCommInitRankConfig comm 0x10d38510 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x6ebd969f77d8e249 - Init START
n136-128-154:2119680:2119917 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2119679:2119909 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2119680:2119917 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2119680:2119917 [1] NCCL INFO Retrieving state for IB
n136-128-154:2119680:2119917 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2119680:2119917 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2119680:2119917 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2119680:2119917 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2119680:2119917 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2119679:2119909 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2119679:2119909 [0] NCCL INFO Retrieving state for IB
n136-128-154:2119679:2119909 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2119679:2119909 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2119679:2119909 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2119679:2119909 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2119679:2119909 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2119680:2119917 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2119680:2119917 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2119679:2119909 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2119679:2119909 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2119679:2119909 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2119679:2119909 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2119679:2119909 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2119679:2119909 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2119679:2119909 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2119679:2119909 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2119679:2119909 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2119679:2119909 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2119679:2119909 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2119679:2119909 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2119679:2119909 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2119679:2119909 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2119679:2119909 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2119679:2119909 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2119679:2119909 [0] NCCL INFO ==========================================
n136-128-154:2119679:2119909 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2119679:2119909 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2119679:2119909 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2119680:2119917 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2119680:2119917 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2119680:2119917 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2119680:2119917 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2119680:2119917 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2119680:2119917 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2119680:2119917 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2119680:2119917 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2119680:2119917 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2119680:2119917 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2119680:2119917 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2119680:2119917 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2119680:2119917 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2119680:2119917 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2119680:2119917 [1] NCCL INFO ==========================================
n136-128-154:2119680:2119917 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2119680:2119917 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2119680:2119917 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2119680:2119917 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2119680:2119917 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2119680:2119917 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2119680:2119917 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119680:2119917 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119680:2119917 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2119680:2119917 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119680:2119917 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2119679:2119909 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119679:2119909 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2119680:2119917 [1] NCCL INFO comm 0x10d38510 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2119679:2119909 [0] NCCL INFO comm 0x10f76950 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119680:2119917 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2119679:2119909 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2119680:2119917 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2119680:2119917 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2119680:2119917 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2119679:2119909 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2119679:2119909 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2119680:2119917 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2119680:2119924 [1] NCCL INFO [Proxy Service] Device 1 CPU core 43
n136-128-154:2119680:2119925 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 48
n136-128-154:2119679:2119909 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2119679:2119909 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2119679:2119927 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 42
n136-128-154:2119679:2119926 [0] NCCL INFO [Proxy Service] Device 0 CPU core 41
n136-128-154:2119679:2119909 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2119679:2119909 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2119679:2119909 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2119680:2119917 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2119680:2119917 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2119680:2119917 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2119680:2119917 [1] NCCL INFO ncclCommInitRankConfig comm 0x10d38510 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x6ebd969f77d8e249 - Init COMPLETE
n136-128-154:2119680:2119917 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.60 (kernels 0.11, alloc 0.20, bootstrap 0.00, allgathers 0.00, topo 0.08, graphs 0.00, connections 0.07, rest 0.15)
n136-128-154:2119679:2119909 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2119679:2119909 [0] NCCL INFO ncclCommInitRankConfig comm 0x10f76950 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x6ebd969f77d8e249 - Init COMPLETE
n136-128-154:2119679:2119909 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 2.12 (kernels 0.17, alloc 0.26, bootstrap 1.40, allgathers 0.00, topo 0.08, graphs 0.00, connections 0.06, rest 0.15)
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119679:2119929 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2119680:2119928 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2119679:2119929 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-09:02:36:23 INFO     [evaluator:559] Running loglikelihood requests
2025-12-09:02:36:23 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/2344 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 45
Determined largest batch size: 45

Running loglikelihood requests:   0%|          | 1/2344 [00:56<36:31:50, 56.13s/it]
Running loglikelihood requests:   2%|▏         | 46/2344 [01:00<36:12,  1.06it/s]  
Running loglikelihood requests:   4%|▍         | 94/2344 [01:03<15:57,  2.35it/s]
Running loglikelihood requests:   6%|▌         | 142/2344 [01:07<09:42,  3.78it/s]
Running loglikelihood requests:   8%|▊         | 189/2344 [01:11<06:52,  5.23it/s]
Running loglikelihood requests:  10%|█         | 242/2344 [01:14<05:01,  6.97it/s]
Running loglikelihood requests:  12%|█▏        | 290/2344 [01:18<04:07,  8.31it/s]
Running loglikelihood requests:  14%|█▍        | 336/2344 [01:21<03:34,  9.36it/s]
Running loglikelihood requests:  16%|█▋        | 381/2344 [01:25<03:12, 10.20it/s]
Running loglikelihood requests:  18%|█▊        | 429/2344 [01:28<02:52, 11.13it/s]
Running loglikelihood requests:  20%|██        | 480/2344 [01:32<02:34, 12.09it/s]
Running loglikelihood requests:  22%|██▏       | 526/2344 [01:35<02:25, 12.47it/s]
Running loglikelihood requests:  25%|██▍       | 580/2344 [01:39<02:11, 13.42it/s]
Running loglikelihood requests:  27%|██▋       | 626/2344 [01:42<02:07, 13.44it/s]
Running loglikelihood requests:  29%|██▉       | 674/2344 [01:45<02:02, 13.65it/s]
Running loglikelihood requests:  31%|███       | 719/2344 [01:49<01:59, 13.61it/s]
Running loglikelihood requests:  33%|███▎      | 765/2344 [01:52<01:55, 13.67it/s]
Running loglikelihood requests:  35%|███▍      | 813/2344 [01:55<01:50, 13.88it/s]
Running loglikelihood requests:  37%|███▋      | 863/2344 [01:59<01:43, 14.26it/s]
Running loglikelihood requests:  39%|███▉      | 914/2344 [02:02<01:37, 14.65it/s]
Running loglikelihood requests:  41%|████      | 959/2344 [02:05<01:36, 14.42it/s]
Running loglikelihood requests:  43%|████▎     | 1005/2344 [02:09<01:33, 14.32it/s]
Running loglikelihood requests:  45%|████▍     | 1052/2344 [02:12<01:30, 14.35it/s]
Running loglikelihood requests:  47%|████▋     | 1110/2344 [02:15<01:19, 15.45it/s]
Running loglikelihood requests:  49%|████▉     | 1159/2344 [02:18<01:16, 15.40it/s]
Running loglikelihood requests:  52%|█████▏    | 1208/2344 [02:21<01:13, 15.40it/s]
Running loglikelihood requests:  54%|█████▎    | 1255/2344 [02:25<01:11, 15.22it/s]
Running loglikelihood requests:  56%|█████▌    | 1303/2344 [02:28<01:08, 15.20it/s]
Running loglikelihood requests:  58%|█████▊    | 1356/2344 [02:31<01:03, 15.68it/s]
Running loglikelihood requests:  60%|█████▉    | 1401/2344 [02:34<01:01, 15.29it/s]
Running loglikelihood requests:  62%|██████▏   | 1454/2344 [02:37<00:56, 15.81it/s]
Running loglikelihood requests:  64%|██████▍   | 1504/2344 [02:40<00:52, 15.91it/s]
Running loglikelihood requests:  66%|██████▋   | 1553/2344 [02:43<00:49, 15.95it/s]
Running loglikelihood requests:  68%|██████▊   | 1601/2344 [02:46<00:46, 15.88it/s]
Running loglikelihood requests:  71%|███████   | 1653/2344 [02:49<00:42, 16.26it/s]
Running loglikelihood requests:  72%|███████▏  | 1698/2344 [02:52<00:40, 15.87it/s]
Running loglikelihood requests:  74%|███████▍  | 1745/2344 [02:55<00:37, 15.81it/s]
Running loglikelihood requests:  76%|███████▋  | 1793/2344 [02:58<00:34, 15.89it/s]
Running loglikelihood requests:  78%|███████▊  | 1840/2344 [03:01<00:31, 15.86it/s]
Running loglikelihood requests:  81%|████████  | 1891/2344 [03:04<00:27, 16.26it/s]
Running loglikelihood requests:  83%|████████▎ | 1938/2344 [03:07<00:25, 16.21it/s]
Running loglikelihood requests:  85%|████████▍ | 1983/2344 [03:10<00:22, 16.00it/s]
Running loglikelihood requests:  87%|████████▋ | 2032/2344 [03:13<00:19, 16.24it/s]
Running loglikelihood requests:  89%|████████▉ | 2089/2344 [03:16<00:14, 17.27it/s]
Running loglikelihood requests:  91%|█████████ | 2137/2344 [03:19<00:12, 17.14it/s]
Running loglikelihood requests:  93%|█████████▎| 2185/2344 [03:22<00:09, 17.09it/s]
Running loglikelihood requests:  96%|█████████▌| 2241/2344 [03:24<00:05, 17.93it/s]
Running loglikelihood requests:  98%|█████████▊| 2295/2344 [03:27<00:02, 19.16it/s]
Running loglikelihood requests: 100%|██████████| 2344/2344 [03:27<00:00, 11.31it/s]
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2119680:2120175 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2119680:2119924 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:02:40:12 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 25, batch_size: auto (45)
|    Tasks    |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge|      1|none  |    25|acc     |↑  |0.4454|±  |0.0145|
|             |       |none  |    25|acc_norm|↑  |0.4701|±  |0.0146|

[rank0]:[W1209 02:40:13.746938469 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2119679:2119926 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2119679:2120230 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2119680:2119924 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2119680:2120180 [1] NCCL INFO comm 0x10d38510 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2119679:2120230 [0] NCCL INFO comm 0x10f76950 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 arc_challenge 评估完成！

==================================================
开始评估：任务=truthfulqa_mc1 | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/truthfulqa_mc1.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:02:41:38 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-09:02:41:38 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-09:02:41:38 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:41:38 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:41:38 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:41:38 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:41:40 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:41:40 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:41:40 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.05it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.05it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.02it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.02it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.08it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.07it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.55it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.54it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.32it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:03<00:00,  1.32it/s]

2025-12-09:02:42:04 INFO     [evaluator:305] num_fewshot has been set to 0 for truthfulqa_mc1 in its config. Manual configuration will be ignored.
2025-12-09:02:42:04 INFO     [api.task:434] Building contexts for truthfulqa_mc1 on rank 0...

  0%|          | 0/409 [00:00<?, ?it/s]
 24%|██▍       | 100/409 [00:00<00:00, 991.52it/s]
 50%|████▉     | 203/409 [00:00<00:00, 1012.49it/s]
 75%|███████▍  | 306/409 [00:00<00:00, 1019.55it/s]
100%|█████████▉| 408/409 [00:00<00:00, 1015.41it/s]
100%|██████████| 409/409 [00:00<00:00, 1013.41it/s]
n136-128-154:2120285:2120285 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120285:2120285 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120285:2120285 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2120285:2120285 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2120285:2120285 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:2120285:2120535 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2120285:2120535 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2120285:2120535 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120285:2120535 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120285:2120535 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2120285:2120535 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2120285:2120535 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2120285:2120535 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2120285:2120535 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2120285:2120535 [0] NCCL INFO Using network IB
n136-128-154:2120285:2120535 [0] NCCL INFO ncclCommInitRankConfig comm 0xef94000 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xb329e6d7aedcd68a - Init START
2025-12-09:02:42:06 INFO     [evaluator:305] num_fewshot has been set to 0 for truthfulqa_mc1 in its config. Manual configuration will be ignored.
2025-12-09:02:42:06 INFO     [api.task:434] Building contexts for truthfulqa_mc1 on rank 1...

  0%|          | 0/408 [00:00<?, ?it/s]
 23%|██▎       | 95/408 [00:00<00:00, 945.78it/s]
 48%|████▊     | 196/408 [00:00<00:00, 982.36it/s]
 73%|███████▎  | 296/408 [00:00<00:00, 990.24it/s]
 97%|█████████▋| 396/408 [00:00<00:00, 970.10it/s]
100%|██████████| 408/408 [00:00<00:00, 972.30it/s]
n136-128-154:2120286:2120286 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2120286:2120286 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120286:2120286 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120286:2120286 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2120286:2120286 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2120286:2120589 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2120286:2120589 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2120286:2120589 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120286:2120589 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120286:2120589 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2120286:2120589 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2120286:2120589 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2120286:2120589 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2120286:2120589 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2120286:2120589 [1] NCCL INFO Using network IB
n136-128-154:2120286:2120589 [1] NCCL INFO ncclCommInitRankConfig comm 0xf659f40 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xb329e6d7aedcd68a - Init START
n136-128-154:2120286:2120589 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2120285:2120535 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2120286:2120589 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2120286:2120589 [1] NCCL INFO Retrieving state for IB
n136-128-154:2120286:2120589 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2120286:2120589 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2120286:2120589 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2120286:2120589 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2120286:2120589 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2120285:2120535 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2120285:2120535 [0] NCCL INFO Retrieving state for IB
n136-128-154:2120285:2120535 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2120285:2120535 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2120285:2120535 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2120285:2120535 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2120285:2120535 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2120286:2120589 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120286:2120589 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120285:2120535 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120285:2120535 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120286:2120589 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2120286:2120589 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2120286:2120589 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2120286:2120589 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2120286:2120589 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2120286:2120589 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2120286:2120589 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2120286:2120589 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2120286:2120589 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2120285:2120535 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2120286:2120589 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2120285:2120535 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2120286:2120589 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2120285:2120535 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2120286:2120589 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2120286:2120589 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2120285:2120535 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2120286:2120589 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2120286:2120589 [1] NCCL INFO ==========================================
n136-128-154:2120285:2120535 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2120285:2120535 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120286:2120589 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2120285:2120535 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2120286:2120589 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120285:2120535 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2120285:2120535 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2120285:2120535 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2120286:2120589 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2120285:2120535 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2120285:2120535 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2120285:2120535 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2120285:2120535 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2120285:2120535 [0] NCCL INFO ==========================================
n136-128-154:2120285:2120535 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120285:2120535 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120285:2120535 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2120285:2120535 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2120286:2120589 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2120285:2120535 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2120285:2120535 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120285:2120535 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2120286:2120589 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120286:2120589 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120286:2120589 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120285:2120535 [0] NCCL INFO comm 0xef94000 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2120286:2120589 [1] NCCL INFO comm 0xf659f40 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120286:2120589 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2120286:2120589 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2120286:2120589 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2120286:2120589 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2120285:2120535 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2120285:2120535 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2120286:2120589 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2120286:2120596 [1] NCCL INFO [Proxy Service] Device 1 CPU core 41
n136-128-154:2120286:2120597 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 42
n136-128-154:2120285:2120535 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2120285:2120535 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2120285:2120598 [0] NCCL INFO [Proxy Service] Device 0 CPU core 116
n136-128-154:2120285:2120599 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 114
n136-128-154:2120285:2120535 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2120285:2120535 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2120285:2120535 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2120286:2120589 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2120286:2120589 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2120285:2120535 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2120285:2120535 [0] NCCL INFO ncclCommInitRankConfig comm 0xef94000 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xb329e6d7aedcd68a - Init COMPLETE
n136-128-154:2120285:2120535 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 2.20 (kernels 0.20, alloc 0.10, bootstrap 1.67, allgathers 0.00, topo 0.05, graphs 0.00, connections 0.14, rest 0.04)
n136-128-154:2120286:2120589 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2120286:2120589 [1] NCCL INFO ncclCommInitRankConfig comm 0xf659f40 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xb329e6d7aedcd68a - Init COMPLETE
n136-128-154:2120286:2120589 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.47 (kernels 0.13, alloc 0.10, bootstrap 0.00, allgathers 0.00, topo 0.05, graphs 0.00, connections 0.15, rest 0.03)
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120286:2120602 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120285:2120601 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2120286:2120602 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-09:02:42:07 INFO     [evaluator:559] Running loglikelihood requests
2025-12-09:02:42:07 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/2066 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/2066 [00:07<4:12:06,  7.33s/it]
Running loglikelihood requests:   3%|▎         | 65/2066 [00:08<03:14, 10.27it/s] 
Running loglikelihood requests:   6%|▌         | 129/2066 [00:09<01:38, 19.73it/s]
Running loglikelihood requests:   9%|▉         | 193/2066 [00:10<01:06, 28.16it/s]
Running loglikelihood requests:  12%|█▏        | 257/2066 [00:11<00:51, 35.34it/s]
Running loglikelihood requests:  16%|█▌        | 321/2066 [00:12<00:42, 41.20it/s]
Running loglikelihood requests:  19%|█▊        | 385/2066 [00:14<00:38, 43.87it/s]
Running loglikelihood requests:  22%|██▏       | 449/2066 [00:15<00:33, 47.97it/s]
Running loglikelihood requests:  25%|██▍       | 513/2066 [00:16<00:30, 51.05it/s]
Running loglikelihood requests:  28%|██▊       | 577/2066 [00:17<00:27, 53.48it/s]
Running loglikelihood requests:  31%|███       | 641/2066 [00:18<00:25, 55.05it/s]
Running loglikelihood requests:  34%|███▍      | 705/2066 [00:19<00:24, 56.52it/s]
Running loglikelihood requests:  37%|███▋      | 769/2066 [00:20<00:22, 57.60it/s]
Running loglikelihood requests:  40%|████      | 833/2066 [00:21<00:21, 58.25it/s]
Running loglikelihood requests:  43%|████▎     | 897/2066 [00:22<00:19, 58.87it/s]
Running loglikelihood requests:  47%|████▋     | 961/2066 [00:23<00:18, 59.25it/s]
Running loglikelihood requests:  50%|████▉     | 1025/2066 [00:24<00:17, 59.65it/s]
Running loglikelihood requests:  53%|█████▎    | 1089/2066 [00:25<00:16, 59.88it/s]
Running loglikelihood requests:  56%|█████▌    | 1153/2066 [00:27<00:15, 59.95it/s]
Running loglikelihood requests:  59%|█████▉    | 1217/2066 [00:28<00:14, 60.20it/s]
Running loglikelihood requests:  62%|██████▏   | 1281/2066 [00:29<00:13, 60.15it/s]
Running loglikelihood requests:  65%|██████▌   | 1345/2066 [00:30<00:12, 60.08it/s]
Running loglikelihood requests:  68%|██████▊   | 1409/2066 [00:31<00:10, 60.21it/s]
Running loglikelihood requests:  71%|███████▏  | 1473/2066 [00:32<00:09, 60.55it/s]
Running loglikelihood requests:  74%|███████▍  | 1537/2066 [00:33<00:08, 60.77it/s]
Running loglikelihood requests:  77%|███████▋  | 1601/2066 [00:34<00:07, 60.90it/s]
Running loglikelihood requests:  81%|████████  | 1665/2066 [00:35<00:06, 61.20it/s]
Running loglikelihood requests:  84%|████████▎ | 1729/2066 [00:36<00:05, 61.36it/s]
Running loglikelihood requests:  87%|████████▋ | 1793/2066 [00:37<00:04, 61.55it/s]
Running loglikelihood requests:  90%|████████▉ | 1857/2066 [00:38<00:03, 61.56it/s]
Running loglikelihood requests:  93%|█████████▎| 1921/2066 [00:39<00:02, 61.77it/s]
Running loglikelihood requests:  96%|█████████▌| 1985/2066 [00:40<00:01, 62.27it/s]
Running loglikelihood requests:  99%|█████████▉| 2049/2066 [00:40<00:00, 79.11it/s]
Running loglikelihood requests: 100%|██████████| 2066/2066 [00:40<00:00, 50.53it/s]
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120286:2120754 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120286:2120596 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:02:43:00 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (64)
|    Tasks     |Version|Filter|n-shot|Metric|   |Value|   |Stderr|
|--------------|------:|------|-----:|------|---|----:|---|-----:|
|truthfulqa_mc1|      2|none  |     0|acc   |↑  |0.328|±  |0.0164|

[rank0]:[W1209 02:43:00.131972389 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120285:2120598 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120285:2120809 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120286:2120596 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2120286:2120760 [1] NCCL INFO comm 0xf659f40 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2120285:2120809 [0] NCCL INFO comm 0xef94000 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 truthfulqa_mc1 评估完成！

==================================================
开始评估：任务=piqa | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/piqa.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:02:44:24 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-09:02:44:24 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-09:02:44:24 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:44:24 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:44:24 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:44:24 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:44:26 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:44:26 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:44:26 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.37it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.16it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.35it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.15it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.40it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.98it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.70it/s]

Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.20it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.70it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.46it/s]
2025-12-09:02:44:44 WARNING  [evaluator:309] Overwriting default num_fewshot of piqa from None to 0
2025-12-09:02:44:44 INFO     [api.task:434] Building contexts for piqa on rank 1...

  0%|          | 0/919 [00:00<?, ?it/s]
 15%|█▌        | 141/919 [00:00<00:00, 1409.41it/s]
 32%|███▏      | 294/919 [00:00<00:00, 1479.46it/s]
 49%|████▉     | 450/919 [00:00<00:00, 1512.31it/s]
 66%|██████▌   | 603/919 [00:00<00:00, 1515.29it/s]
 82%|████████▏ | 758/919 [00:00<00:00, 1527.53it/s]
 99%|█████████▉| 912/919 [00:00<00:00, 1530.96it/s]
100%|██████████| 919/919 [00:00<00:00, 1515.44it/s]
2025-12-09:02:44:47 WARNING  [evaluator:309] Overwriting default num_fewshot of piqa from None to 0
2025-12-09:02:44:47 INFO     [api.task:434] Building contexts for piqa on rank 0...

  0%|          | 0/919 [00:00<?, ?it/s]
 16%|█▌        | 147/919 [00:00<00:00, 1465.92it/s]
 33%|███▎      | 303/919 [00:00<00:00, 1517.26it/s]
 50%|████▉     | 455/919 [00:00<00:00, 1346.03it/s]
 64%|██████▍   | 592/919 [00:00<00:00, 1354.64it/s]
 81%|████████▏ | 748/919 [00:00<00:00, 1423.28it/s]
 98%|█████████▊| 897/919 [00:00<00:00, 1444.47it/s]
100%|██████████| 919/919 [00:00<00:00, 1427.03it/s]
n136-128-154:2120873:2120873 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120873:2120873 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120873:2120873 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2120873:2120873 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2120873:2120873 [0] NCCL INFO Comm config Blocking set to 1
n136-128-154:2120874:2120874 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2120874:2120874 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120874:2120874 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120874:2120874 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2120874:2120874 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2120874:2121105 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2120874:2121105 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2120873:2121104 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2120873:2121104 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2120874:2121105 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120874:2121105 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120874:2121105 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2120873:2121104 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2120873:2121104 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2120873:2121104 [0] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2120874:2121105 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2120874:2121105 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2120874:2121105 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2120874:2121105 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2120874:2121105 [1] NCCL INFO Using network IB
n136-128-154:2120873:2121104 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2120873:2121104 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2120873:2121104 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2120873:2121104 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2120873:2121104 [0] NCCL INFO Using network IB
n136-128-154:2120874:2121105 [1] NCCL INFO ncclCommInitRankConfig comm 0x10603ec0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x74864cb0f4d1c634 - Init START
n136-128-154:2120873:2121104 [0] NCCL INFO ncclCommInitRankConfig comm 0xee84980 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x74864cb0f4d1c634 - Init START
n136-128-154:2120874:2121105 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2120873:2121104 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2120874:2121105 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2120874:2121105 [1] NCCL INFO Retrieving state for IB
n136-128-154:2120874:2121105 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2120874:2121105 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2120874:2121105 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2120874:2121105 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2120874:2121105 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2120873:2121104 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2120873:2121104 [0] NCCL INFO Retrieving state for IB
n136-128-154:2120873:2121104 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2120873:2121104 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2120873:2121104 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2120873:2121104 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2120873:2121104 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2120873:2121104 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120873:2121104 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120873:2121104 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2120873:2121104 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2120873:2121104 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2120873:2121104 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2120873:2121104 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2120873:2121104 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2120873:2121104 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2120873:2121104 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2120873:2121104 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2120873:2121104 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2120873:2121104 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2120873:2121104 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2120873:2121104 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2120873:2121104 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2120873:2121104 [0] NCCL INFO ==========================================
n136-128-154:2120873:2121104 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120873:2121104 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120873:2121104 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2120873:2121104 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2120873:2121104 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2120873:2121104 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120873:2121104 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120873:2121104 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120873:2121104 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120873:2121104 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120873:2121104 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120873:2121104 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120874:2121105 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2120874:2121105 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2120874:2121105 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2120874:2121105 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2120874:2121105 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2120874:2121105 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2120874:2121105 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2120874:2121105 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2120874:2121105 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2120874:2121105 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2120874:2121105 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2120874:2121105 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2120874:2121105 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2120874:2121105 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2120874:2121105 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2120874:2121105 [1] NCCL INFO ==========================================
n136-128-154:2120874:2121105 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120874:2121105 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2120874:2121105 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2120874:2121105 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2120874:2121105 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2120874:2121105 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2120874:2121105 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2120874:2121105 [1] NCCL INFO comm 0x10603ec0 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2120873:2121104 [0] NCCL INFO comm 0xee84980 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2120873:2121104 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2120873:2121104 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2120874:2121105 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2120874:2121105 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2120873:2121104 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2120873:2121104 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2120873:2121104 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2120873:2121104 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2120873:2121117 [0] NCCL INFO [Proxy Service] Device 0 CPU core 98
n136-128-154:2120873:2121118 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 99
n136-128-154:2120874:2121105 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2120874:2121119 [1] NCCL INFO [Proxy Service] Device 1 CPU core 118
n136-128-154:2120874:2121120 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 119
n136-128-154:2120873:2121104 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2120873:2121104 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2120873:2121104 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2120874:2121105 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2120874:2121105 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2120874:2121105 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2120874:2121105 [1] NCCL INFO ncclCommInitRankConfig comm 0x10603ec0 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0x74864cb0f4d1c634 - Init COMPLETE
n136-128-154:2120874:2121105 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.74 (kernels 0.11, alloc 0.39, bootstrap 0.00, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.03, rest 0.14)
n136-128-154:2120873:2121104 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2120873:2121104 [0] NCCL INFO ncclCommInitRankConfig comm 0xee84980 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0x74864cb0f4d1c634 - Init COMPLETE
n136-128-154:2120873:2121104 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 0.74 (kernels 0.12, alloc 0.39, bootstrap 0.00, allgathers 0.00, topo 0.06, graphs 0.00, connections 0.03, rest 0.14)
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120873:2121122 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2120874:2121121 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2120873:2121122 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-09:02:44:49 INFO     [evaluator:559] Running loglikelihood requests
2025-12-09:02:44:49 INFO     [evaluator:559] Running loglikelihood requests

Running loglikelihood requests:   0%|          | 0/1838 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 64
Determined largest batch size: 64

Running loglikelihood requests:   0%|          | 1/1838 [00:07<3:55:02,  7.68s/it]
Running loglikelihood requests:   4%|▎         | 65/1838 [00:08<02:45, 10.74it/s] 
Running loglikelihood requests:   7%|▋         | 129/1838 [00:08<01:14, 22.79it/s]
Running loglikelihood requests:  11%|█         | 194/1838 [00:09<00:45, 36.38it/s]
Running loglikelihood requests:  14%|█▍        | 258/1838 [00:09<00:31, 50.79it/s]
Running loglikelihood requests:  18%|█▊        | 322/1838 [00:10<00:23, 65.79it/s]
Running loglikelihood requests:  21%|██        | 386/1838 [00:10<00:18, 80.38it/s]
Running loglikelihood requests:  25%|██▍       | 451/1838 [00:11<00:14, 94.71it/s]
Running loglikelihood requests:  28%|██▊       | 515/1838 [00:11<00:12, 107.75it/s]
Running loglikelihood requests:  32%|███▏      | 579/1838 [00:12<00:10, 119.42it/s]
Running loglikelihood requests:  35%|███▍      | 643/1838 [00:12<00:09, 129.58it/s]
Running loglikelihood requests:  38%|███▊      | 707/1838 [00:12<00:08, 134.82it/s]
Running loglikelihood requests:  42%|████▏     | 771/1838 [00:13<00:07, 143.26it/s]
Running loglikelihood requests:  45%|████▌     | 835/1838 [00:13<00:06, 149.15it/s]
Running loglikelihood requests:  49%|████▉     | 899/1838 [00:14<00:06, 155.23it/s]
Running loglikelihood requests:  52%|█████▏    | 964/1838 [00:14<00:05, 160.83it/s]
Running loglikelihood requests:  56%|█████▌    | 1028/1838 [00:14<00:04, 165.80it/s]
Running loglikelihood requests:  59%|█████▉    | 1092/1838 [00:15<00:04, 170.31it/s]
Running loglikelihood requests:  63%|██████▎   | 1157/1838 [00:15<00:03, 173.21it/s]
Running loglikelihood requests:  66%|██████▋   | 1221/1838 [00:15<00:03, 177.26it/s]
Running loglikelihood requests:  70%|██████▉   | 1286/1838 [00:16<00:03, 179.03it/s]
Running loglikelihood requests:  73%|███████▎  | 1350/1838 [00:16<00:02, 172.89it/s]
Running loglikelihood requests:  77%|███████▋  | 1414/1838 [00:16<00:02, 177.78it/s]
Running loglikelihood requests:  80%|████████  | 1478/1838 [00:17<00:01, 183.40it/s]
Running loglikelihood requests:  84%|████████▍ | 1542/1838 [00:17<00:01, 187.22it/s]
Running loglikelihood requests:  87%|████████▋ | 1606/1838 [00:17<00:01, 190.27it/s]
Running loglikelihood requests:  91%|█████████ | 1670/1838 [00:18<00:00, 195.11it/s]
Running loglikelihood requests:  94%|█████████▍| 1734/1838 [00:18<00:00, 200.00it/s]
Running loglikelihood requests:  98%|█████████▊| 1799/1838 [00:18<00:00, 226.62it/s]
Running loglikelihood requests: 100%|██████████| 1838/1838 [00:18<00:00, 98.09it/s] 
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2120874:2121150 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120874:2121119 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:02:45:17 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto (64)
|Tasks|Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-----|------:|------|-----:|--------|---|-----:|---|-----:|
|piqa |      1|none  |     0|acc     |↑  |0.7051|±  |0.0106|
|     |       |none  |     0|acc_norm|↑  |0.7144|±  |0.0105|

[rank0]:[W1209 02:45:18.589236697 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120873:2121117 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2120873:2121242 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2120874:2121119 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2120874:2121156 [1] NCCL INFO comm 0x10603ec0 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2120873:2121242 [0] NCCL INFO comm 0xee84980 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 piqa 评估完成！

==================================================
开始评估：任务=hellaswag | 少样本数=10 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg3/hellaswag.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:02:46:42 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-09:02:46:42 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:46:42 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:46:42 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-09:02:46:42 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:02:46:42 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:02:46:44 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:46:44 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:1'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]The tokenizer you are loading from '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
2025-12-09:02:46:44 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.12it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:00<00:02,  1.10it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.10it/s]
Loading checkpoint shards:  50%|█████     | 2/4 [00:01<00:01,  1.10it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.15it/s]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:02<00:00,  1.15it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.63it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.40it/s]

Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.63it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:02<00:00,  1.40it/s]
2025-12-09:02:47:11 WARNING  [evaluator:309] Overwriting default num_fewshot of hellaswag from None to 10
2025-12-09:02:47:11 INFO     [api.task:434] Building contexts for hellaswag on rank 0...
2025-12-09:02:47:12 WARNING  [evaluator:309] Overwriting default num_fewshot of hellaswag from None to 10
2025-12-09:02:47:12 INFO     [api.task:434] Building contexts for hellaswag on rank 1...

  0%|          | 0/5021 [00:00<?, ?it/s]
  0%|          | 19/5021 [00:00<00:26, 188.12it/s]
  1%|          | 39/5021 [00:00<00:25, 193.52it/s]
  1%|          | 59/5021 [00:00<00:25, 195.44it/s]
  2%|▏         | 79/5021 [00:00<00:25, 196.82it/s]
  2%|▏         | 99/5021 [00:00<00:24, 197.03it/s]
  2%|▏         | 119/5021 [00:00<00:24, 196.42it/s]
  3%|▎         | 139/5021 [00:00<00:26, 187.13it/s]
  3%|▎         | 159/5021 [00:00<00:25, 188.82it/s]
  0%|          | 0/5021 [00:00<?, ?it/s]
  4%|▎         | 179/5021 [00:00<00:25, 191.35it/s]
  0%|          | 19/5021 [00:00<00:26, 188.58it/s]
  4%|▍         | 199/5021 [00:01<00:24, 193.14it/s]
  1%|          | 39/5021 [00:00<00:25, 195.05it/s]
  4%|▍         | 219/5021 [00:01<00:24, 194.50it/s]
  1%|          | 59/5021 [00:00<00:25, 196.84it/s]
  5%|▍         | 239/5021 [00:01<00:24, 195.56it/s]
  2%|▏         | 79/5021 [00:00<00:24, 197.75it/s]
  5%|▌         | 259/5021 [00:01<00:24, 195.26it/s]
  2%|▏         | 99/5021 [00:00<00:24, 198.09it/s]
  6%|▌         | 279/5021 [00:01<00:24, 195.39it/s]
  2%|▏         | 119/5021 [00:00<00:24, 198.00it/s]
  6%|▌         | 299/5021 [00:01<00:24, 194.50it/s]
  3%|▎         | 139/5021 [00:00<00:24, 197.96it/s]
  6%|▋         | 319/5021 [00:01<00:24, 194.83it/s]
  3%|▎         | 159/5021 [00:00<00:24, 197.85it/s]
  7%|▋         | 339/5021 [00:01<00:24, 195.00it/s]
  4%|▎         | 179/5021 [00:00<00:24, 197.85it/s]
  4%|▍         | 199/5021 [00:01<00:24, 197.73it/s]
  7%|▋         | 359/5021 [00:01<00:23, 194.44it/s]
  4%|▍         | 219/5021 [00:01<00:24, 197.56it/s]
  8%|▊         | 379/5021 [00:01<00:23, 194.60it/s]
  5%|▍         | 239/5021 [00:01<00:24, 197.82it/s]
  8%|▊         | 399/5021 [00:02<00:23, 194.68it/s]
  5%|▌         | 259/5021 [00:01<00:24, 198.10it/s]
  8%|▊         | 419/5021 [00:02<00:23, 192.93it/s]
  6%|▌         | 279/5021 [00:01<00:24, 197.12it/s]
  9%|▊         | 439/5021 [00:02<00:23, 193.04it/s]
  6%|▌         | 299/5021 [00:01<00:23, 196.82it/s]
  9%|▉         | 459/5021 [00:02<00:23, 192.96it/s]
  6%|▋         | 319/5021 [00:01<00:23, 196.73it/s]
 10%|▉         | 479/5021 [00:02<00:23, 193.29it/s]
  7%|▋         | 339/5021 [00:01<00:23, 196.70it/s]
 10%|▉         | 499/5021 [00:02<00:23, 193.92it/s]
  7%|▋         | 359/5021 [00:01<00:23, 196.89it/s]
 10%|█         | 519/5021 [00:02<00:23, 194.31it/s]
  8%|▊         | 379/5021 [00:01<00:23, 196.46it/s]
 11%|█         | 539/5021 [00:02<00:23, 193.77it/s]
  8%|▊         | 399/5021 [00:02<00:23, 196.37it/s]
 11%|█         | 559/5021 [00:02<00:23, 193.47it/s]
  8%|▊         | 419/5021 [00:02<00:23, 196.40it/s]
 12%|█▏        | 579/5021 [00:02<00:22, 193.94it/s]
  9%|▊         | 439/5021 [00:02<00:23, 194.41it/s]
 12%|█▏        | 599/5021 [00:03<00:22, 193.04it/s]
  9%|▉         | 459/5021 [00:02<00:23, 194.17it/s]
 12%|█▏        | 619/5021 [00:03<00:22, 193.37it/s]
 10%|▉         | 479/5021 [00:02<00:23, 193.54it/s]
 13%|█▎        | 639/5021 [00:03<00:22, 193.47it/s]
 10%|▉         | 499/5021 [00:02<00:23, 193.63it/s]
 13%|█▎        | 659/5021 [00:03<00:22, 193.66it/s]
 10%|█         | 519/5021 [00:02<00:23, 193.64it/s]
 14%|█▎        | 679/5021 [00:03<00:22, 193.86it/s]
 11%|█         | 539/5021 [00:02<00:23, 193.36it/s]
 14%|█▍        | 699/5021 [00:03<00:22, 193.69it/s]
 11%|█         | 559/5021 [00:02<00:23, 193.64it/s]
 14%|█▍        | 719/5021 [00:03<00:22, 194.04it/s]
 12%|█▏        | 579/5021 [00:02<00:22, 193.71it/s]
 15%|█▍        | 739/5021 [00:03<00:22, 193.94it/s]
 12%|█▏        | 599/5021 [00:03<00:22, 193.07it/s]
 15%|█▌        | 759/5021 [00:03<00:21, 193.87it/s]
 12%|█▏        | 619/5021 [00:03<00:22, 193.55it/s]
 16%|█▌        | 779/5021 [00:04<00:21, 194.00it/s]
 13%|█▎        | 639/5021 [00:03<00:22, 193.78it/s]
 16%|█▌        | 799/5021 [00:04<00:21, 193.43it/s]
 13%|█▎        | 659/5021 [00:03<00:22, 194.40it/s]
 16%|█▋        | 819/5021 [00:04<00:21, 193.52it/s]
 14%|█▎        | 679/5021 [00:03<00:22, 194.95it/s]
 17%|█▋        | 839/5021 [00:04<00:21, 193.70it/s]
 14%|█▍        | 699/5021 [00:03<00:22, 195.14it/s]
 17%|█▋        | 859/5021 [00:04<00:21, 193.89it/s]
 14%|█▍        | 719/5021 [00:03<00:22, 195.29it/s]
 18%|█▊        | 879/5021 [00:04<00:21, 193.35it/s]
 15%|█▍        | 739/5021 [00:03<00:21, 195.38it/s]
 18%|█▊        | 899/5021 [00:04<00:21, 193.71it/s]
 15%|█▌        | 759/5021 [00:03<00:21, 195.62it/s]
 18%|█▊        | 919/5021 [00:04<00:21, 192.26it/s]
 16%|█▌        | 779/5021 [00:03<00:21, 195.38it/s]
 19%|█▊        | 939/5021 [00:04<00:21, 191.87it/s]
 16%|█▌        | 799/5021 [00:04<00:21, 195.60it/s]
 19%|█▉        | 959/5021 [00:04<00:21, 193.15it/s]
 16%|█▋        | 819/5021 [00:04<00:21, 195.72it/s]
 19%|█▉        | 979/5021 [00:05<00:20, 193.41it/s]
 17%|█▋        | 839/5021 [00:04<00:21, 195.85it/s]
 20%|█▉        | 999/5021 [00:05<00:20, 193.92it/s]
 17%|█▋        | 859/5021 [00:04<00:21, 196.34it/s]
 20%|██        | 1019/5021 [00:05<00:20, 191.70it/s]
 18%|█▊        | 879/5021 [00:04<00:21, 196.66it/s]
 21%|██        | 1039/5021 [00:05<00:20, 192.99it/s]
 18%|█▊        | 899/5021 [00:04<00:20, 196.78it/s]
 21%|██        | 1059/5021 [00:05<00:20, 193.55it/s]
 18%|█▊        | 919/5021 [00:04<00:20, 196.86it/s]
 21%|██▏       | 1079/5021 [00:05<00:20, 194.60it/s]
 19%|█▊        | 939/5021 [00:04<00:20, 195.44it/s]
 22%|██▏       | 1099/5021 [00:05<00:20, 195.15it/s]
 19%|█▉        | 959/5021 [00:04<00:20, 195.93it/s]
 22%|██▏       | 1119/5021 [00:05<00:19, 195.71it/s]
 19%|█▉        | 979/5021 [00:04<00:20, 196.28it/s]
 23%|██▎       | 1139/5021 [00:05<00:19, 195.86it/s]
 20%|█▉        | 999/5021 [00:05<00:20, 196.33it/s]
 23%|██▎       | 1159/5021 [00:05<00:19, 196.42it/s]
 20%|██        | 1019/5021 [00:05<00:20, 196.28it/s]
 23%|██▎       | 1179/5021 [00:06<00:19, 196.45it/s]
 21%|██        | 1039/5021 [00:05<00:20, 196.53it/s]
 24%|██▍       | 1199/5021 [00:06<00:19, 196.80it/s]
 21%|██        | 1059/5021 [00:05<00:20, 196.86it/s]
 24%|██▍       | 1219/5021 [00:06<00:19, 196.87it/s]
 21%|██▏       | 1079/5021 [00:05<00:20, 196.88it/s]
 25%|██▍       | 1239/5021 [00:06<00:19, 196.29it/s]
 22%|██▏       | 1099/5021 [00:05<00:19, 196.85it/s]
 25%|██▌       | 1259/5021 [00:06<00:19, 196.57it/s]
 22%|██▏       | 1119/5021 [00:05<00:19, 197.31it/s]
 25%|██▌       | 1279/5021 [00:06<00:19, 196.31it/s]
 23%|██▎       | 1139/5021 [00:05<00:19, 197.91it/s]
 26%|██▌       | 1299/5021 [00:06<00:18, 196.27it/s]
 23%|██▎       | 1159/5021 [00:05<00:19, 198.27it/s]
 26%|██▋       | 1319/5021 [00:06<00:18, 195.32it/s]
 23%|██▎       | 1179/5021 [00:06<00:19, 198.23it/s]
 27%|██▋       | 1339/5021 [00:06<00:18, 195.67it/s]
 24%|██▍       | 1199/5021 [00:06<00:19, 197.95it/s]
 27%|██▋       | 1359/5021 [00:06<00:18, 196.09it/s]
 24%|██▍       | 1219/5021 [00:06<00:19, 197.56it/s]
 27%|██▋       | 1379/5021 [00:07<00:18, 196.02it/s]
 25%|██▍       | 1239/5021 [00:06<00:19, 197.33it/s]
 28%|██▊       | 1399/5021 [00:07<00:18, 195.64it/s]
 25%|██▌       | 1259/5021 [00:06<00:19, 197.23it/s]
 28%|██▊       | 1419/5021 [00:07<00:18, 195.79it/s]
 25%|██▌       | 1279/5021 [00:06<00:18, 197.16it/s]
 29%|██▊       | 1439/5021 [00:07<00:18, 196.38it/s]
 26%|██▌       | 1299/5021 [00:06<00:18, 197.51it/s]
 29%|██▉       | 1459/5021 [00:07<00:18, 196.83it/s]
 26%|██▋       | 1319/5021 [00:06<00:18, 197.58it/s]
 29%|██▉       | 1479/5021 [00:07<00:18, 196.51it/s]
 27%|██▋       | 1339/5021 [00:06<00:18, 197.93it/s]
 30%|██▉       | 1499/5021 [00:07<00:17, 196.74it/s]
 27%|██▋       | 1359/5021 [00:06<00:18, 197.88it/s]
 30%|███       | 1519/5021 [00:07<00:17, 196.66it/s]
 27%|██▋       | 1379/5021 [00:07<00:18, 197.74it/s]
 31%|███       | 1539/5021 [00:07<00:17, 197.24it/s]
 28%|██▊       | 1399/5021 [00:07<00:18, 197.34it/s]
 31%|███       | 1559/5021 [00:08<00:17, 195.97it/s]
 28%|██▊       | 1419/5021 [00:07<00:18, 197.23it/s]
 31%|███▏      | 1579/5021 [00:08<00:17, 196.04it/s]
 29%|██▊       | 1439/5021 [00:07<00:18, 197.07it/s]
 32%|███▏      | 1599/5021 [00:08<00:17, 195.94it/s]
 29%|██▉       | 1459/5021 [00:07<00:18, 197.15it/s]
 32%|███▏      | 1619/5021 [00:08<00:17, 196.07it/s]
 29%|██▉       | 1479/5021 [00:07<00:18, 196.69it/s]
 33%|███▎      | 1639/5021 [00:08<00:17, 195.89it/s]
 30%|██▉       | 1499/5021 [00:07<00:17, 196.55it/s]
 33%|███▎      | 1659/5021 [00:08<00:17, 195.68it/s]
 30%|███       | 1519/5021 [00:07<00:17, 196.91it/s]
 33%|███▎      | 1679/5021 [00:08<00:17, 195.52it/s]
 31%|███       | 1539/5021 [00:07<00:17, 196.86it/s]
 34%|███▍      | 1699/5021 [00:08<00:17, 195.23it/s]
 31%|███       | 1559/5021 [00:07<00:17, 197.06it/s]
 34%|███▍      | 1719/5021 [00:08<00:16, 194.69it/s]
 31%|███▏      | 1579/5021 [00:08<00:17, 195.85it/s]
 35%|███▍      | 1739/5021 [00:08<00:16, 194.01it/s]
 32%|███▏      | 1599/5021 [00:08<00:17, 195.95it/s]
 35%|███▌      | 1759/5021 [00:09<00:16, 194.31it/s]
 32%|███▏      | 1619/5021 [00:08<00:17, 196.26it/s]
 35%|███▌      | 1779/5021 [00:09<00:16, 193.86it/s]
 33%|███▎      | 1639/5021 [00:08<00:17, 196.15it/s]
 36%|███▌      | 1799/5021 [00:09<00:16, 193.95it/s]
 33%|███▎      | 1659/5021 [00:08<00:17, 196.58it/s]
 36%|███▌      | 1819/5021 [00:09<00:16, 194.35it/s]
 33%|███▎      | 1679/5021 [00:08<00:17, 196.57it/s]
 37%|███▋      | 1839/5021 [00:09<00:16, 194.87it/s]
 34%|███▍      | 1699/5021 [00:08<00:16, 196.63it/s]
 37%|███▋      | 1859/5021 [00:09<00:16, 195.45it/s]
 34%|███▍      | 1719/5021 [00:08<00:16, 196.56it/s]
 37%|███▋      | 1879/5021 [00:09<00:16, 193.35it/s]
 35%|███▍      | 1739/5021 [00:08<00:16, 196.52it/s]
 38%|███▊      | 1899/5021 [00:09<00:16, 193.88it/s]
 35%|███▌      | 1759/5021 [00:08<00:16, 196.57it/s]
 38%|███▊      | 1919/5021 [00:09<00:16, 193.78it/s]
 35%|███▌      | 1779/5021 [00:09<00:16, 196.60it/s]
 39%|███▊      | 1939/5021 [00:09<00:15, 194.56it/s]
 36%|███▌      | 1799/5021 [00:09<00:16, 196.40it/s]
 39%|███▉      | 1959/5021 [00:10<00:15, 194.96it/s]
 36%|███▌      | 1819/5021 [00:09<00:16, 196.20it/s]
 39%|███▉      | 1979/5021 [00:10<00:15, 195.05it/s]
 37%|███▋      | 1839/5021 [00:09<00:16, 195.27it/s]
 40%|███▉      | 1999/5021 [00:10<00:15, 194.21it/s]
 37%|███▋      | 1859/5021 [00:09<00:16, 194.09it/s]
 40%|████      | 2019/5021 [00:10<00:15, 194.00it/s]
 37%|███▋      | 1879/5021 [00:09<00:16, 190.72it/s]
 41%|████      | 2039/5021 [00:10<00:15, 193.59it/s]
 38%|███▊      | 1899/5021 [00:09<00:16, 190.45it/s]
 41%|████      | 2059/5021 [00:10<00:15, 193.46it/s]
 38%|███▊      | 1919/5021 [00:09<00:16, 190.68it/s]
 41%|████▏     | 2079/5021 [00:10<00:15, 193.12it/s]
 39%|███▊      | 1939/5021 [00:09<00:16, 190.96it/s]
 42%|████▏     | 2099/5021 [00:10<00:15, 192.34it/s]
 39%|███▉      | 1959/5021 [00:10<00:16, 191.23it/s]
 42%|████▏     | 2119/5021 [00:10<00:15, 192.16it/s]
 39%|███▉      | 1979/5021 [00:10<00:15, 191.52it/s]
 43%|████▎     | 2139/5021 [00:11<00:14, 192.17it/s]
 40%|███▉      | 1999/5021 [00:10<00:15, 192.22it/s]
 43%|████▎     | 2159/5021 [00:11<00:14, 191.90it/s]
 40%|████      | 2019/5021 [00:10<00:15, 192.62it/s]
 43%|████▎     | 2179/5021 [00:11<00:14, 191.62it/s]
 41%|████      | 2039/5021 [00:10<00:15, 193.43it/s]
 44%|████▍     | 2199/5021 [00:11<00:14, 193.13it/s]
 41%|████      | 2059/5021 [00:10<00:15, 194.76it/s]
 44%|████▍     | 2219/5021 [00:11<00:14, 194.42it/s]
 41%|████▏     | 2079/5021 [00:10<00:15, 195.46it/s]
 45%|████▍     | 2239/5021 [00:11<00:14, 195.18it/s]
 42%|████▏     | 2099/5021 [00:10<00:14, 195.71it/s]
 45%|████▍     | 2259/5021 [00:11<00:14, 195.66it/s]
 42%|████▏     | 2119/5021 [00:10<00:14, 195.53it/s]
 45%|████▌     | 2279/5021 [00:11<00:13, 196.11it/s]
 43%|████▎     | 2139/5021 [00:10<00:14, 195.63it/s]
 46%|████▌     | 2299/5021 [00:11<00:13, 196.08it/s]
 43%|████▎     | 2159/5021 [00:11<00:14, 195.52it/s]
 46%|████▌     | 2319/5021 [00:11<00:13, 196.44it/s]
 43%|████▎     | 2179/5021 [00:11<00:14, 195.82it/s]
 47%|████▋     | 2339/5021 [00:12<00:13, 196.29it/s]
 44%|████▍     | 2199/5021 [00:11<00:14, 195.76it/s]
 47%|████▋     | 2359/5021 [00:12<00:13, 197.09it/s]
 44%|████▍     | 2219/5021 [00:11<00:14, 195.88it/s]
 47%|████▋     | 2379/5021 [00:12<00:13, 196.95it/s]
 45%|████▍     | 2239/5021 [00:11<00:14, 194.86it/s]
 48%|████▊     | 2399/5021 [00:12<00:13, 197.33it/s]
 45%|████▍     | 2259/5021 [00:11<00:14, 195.31it/s]
 48%|████▊     | 2419/5021 [00:12<00:13, 197.79it/s]
 45%|████▌     | 2279/5021 [00:11<00:14, 195.80it/s]
 49%|████▊     | 2439/5021 [00:12<00:13, 198.17it/s]
 46%|████▌     | 2299/5021 [00:11<00:13, 195.96it/s]
 49%|████▉     | 2459/5021 [00:12<00:12, 197.87it/s]
 46%|████▌     | 2319/5021 [00:11<00:13, 195.73it/s]
 49%|████▉     | 2479/5021 [00:12<00:12, 197.75it/s]
 47%|████▋     | 2339/5021 [00:11<00:13, 195.72it/s]
 50%|████▉     | 2499/5021 [00:12<00:12, 196.90it/s]
 47%|████▋     | 2359/5021 [00:12<00:13, 196.00it/s]
 50%|█████     | 2519/5021 [00:12<00:12, 195.16it/s]
 47%|████▋     | 2379/5021 [00:12<00:13, 196.55it/s]
 51%|█████     | 2539/5021 [00:13<00:12, 195.64it/s]
 48%|████▊     | 2399/5021 [00:12<00:13, 197.05it/s]
 51%|█████     | 2559/5021 [00:13<00:12, 195.77it/s]
 48%|████▊     | 2419/5021 [00:12<00:13, 197.68it/s]
 51%|█████▏    | 2579/5021 [00:13<00:12, 196.21it/s]
 49%|████▊     | 2439/5021 [00:12<00:13, 198.22it/s]
 52%|█████▏    | 2599/5021 [00:13<00:12, 196.61it/s]
 49%|████▉     | 2459/5021 [00:12<00:12, 198.43it/s]
 52%|█████▏    | 2619/5021 [00:13<00:12, 196.12it/s]
 49%|████▉     | 2479/5021 [00:12<00:12, 197.90it/s]
 53%|█████▎    | 2639/5021 [00:13<00:12, 196.55it/s]
 50%|████▉     | 2499/5021 [00:12<00:12, 197.50it/s]
 53%|█████▎    | 2659/5021 [00:13<00:12, 196.45it/s]
 50%|█████     | 2519/5021 [00:12<00:12, 196.11it/s]
 53%|█████▎    | 2679/5021 [00:13<00:11, 196.78it/s]
 51%|█████     | 2539/5021 [00:12<00:12, 196.28it/s]
 54%|█████▍    | 2699/5021 [00:13<00:11, 196.13it/s]
 51%|█████     | 2559/5021 [00:13<00:12, 196.33it/s]
 54%|█████▍    | 2719/5021 [00:13<00:11, 196.40it/s]
 51%|█████▏    | 2579/5021 [00:13<00:12, 196.61it/s]
 55%|█████▍    | 2739/5021 [00:14<00:11, 196.65it/s]
 52%|█████▏    | 2599/5021 [00:13<00:12, 197.13it/s]
 55%|█████▍    | 2759/5021 [00:14<00:11, 196.37it/s]
 52%|█████▏    | 2619/5021 [00:13<00:12, 197.41it/s]
 55%|█████▌    | 2779/5021 [00:14<00:11, 196.92it/s]
 53%|█████▎    | 2639/5021 [00:13<00:12, 195.97it/s]
 56%|█████▌    | 2799/5021 [00:14<00:11, 197.32it/s]
 53%|█████▎    | 2659/5021 [00:13<00:12, 196.25it/s]
 56%|█████▌    | 2819/5021 [00:14<00:11, 197.74it/s]
 53%|█████▎    | 2679/5021 [00:13<00:11, 196.17it/s]
 57%|█████▋    | 2839/5021 [00:14<00:11, 198.11it/s]
 54%|█████▍    | 2699/5021 [00:13<00:11, 196.09it/s]
 57%|█████▋    | 2859/5021 [00:14<00:10, 197.71it/s]
 54%|█████▍    | 2719/5021 [00:13<00:11, 196.00it/s]
 57%|█████▋    | 2879/5021 [00:14<00:10, 197.37it/s]
 55%|█████▍    | 2739/5021 [00:13<00:11, 195.99it/s]
 58%|█████▊    | 2899/5021 [00:14<00:10, 196.35it/s]
 55%|█████▍    | 2759/5021 [00:14<00:11, 196.24it/s]
 58%|█████▊    | 2919/5021 [00:14<00:10, 196.27it/s]
 55%|█████▌    | 2779/5021 [00:14<00:11, 196.49it/s]
 59%|█████▊    | 2939/5021 [00:15<00:10, 196.54it/s]
 56%|█████▌    | 2799/5021 [00:14<00:11, 196.71it/s]
 59%|█████▉    | 2959/5021 [00:15<00:10, 196.65it/s]
 56%|█████▌    | 2819/5021 [00:14<00:11, 196.99it/s]
 59%|█████▉    | 2979/5021 [00:15<00:10, 196.64it/s]
 57%|█████▋    | 2839/5021 [00:14<00:11, 194.05it/s]
 60%|█████▉    | 2999/5021 [00:15<00:10, 196.79it/s]
 57%|█████▋    | 2859/5021 [00:14<00:11, 194.95it/s]
 60%|██████    | 3019/5021 [00:15<00:10, 196.67it/s]
 57%|█████▋    | 2879/5021 [00:14<00:10, 195.74it/s]
 61%|██████    | 3039/5021 [00:15<00:10, 196.80it/s]
 58%|█████▊    | 2899/5021 [00:14<00:10, 196.39it/s]
 61%|██████    | 3059/5021 [00:15<00:09, 196.74it/s]
 58%|█████▊    | 2919/5021 [00:14<00:10, 196.75it/s]
 61%|██████▏   | 3079/5021 [00:15<00:09, 195.80it/s]
 59%|█████▊    | 2939/5021 [00:14<00:10, 196.96it/s]
 62%|██████▏   | 3099/5021 [00:15<00:09, 196.27it/s]
 59%|█████▉    | 2959/5021 [00:15<00:10, 197.09it/s]
 62%|██████▏   | 3119/5021 [00:15<00:09, 196.82it/s]
 59%|█████▉    | 2979/5021 [00:15<00:10, 197.28it/s]
 63%|██████▎   | 3139/5021 [00:16<00:09, 196.95it/s]
 60%|█████▉    | 2999/5021 [00:15<00:10, 197.57it/s]
 63%|██████▎   | 3159/5021 [00:16<00:09, 197.04it/s]
 60%|██████    | 3019/5021 [00:15<00:10, 197.90it/s]
 63%|██████▎   | 3179/5021 [00:16<00:09, 197.42it/s]
 61%|██████    | 3039/5021 [00:15<00:10, 197.68it/s]
 64%|██████▎   | 3199/5021 [00:16<00:09, 197.87it/s]
 61%|██████    | 3059/5021 [00:15<00:09, 196.34it/s]
 64%|██████▍   | 3219/5021 [00:16<00:09, 197.90it/s]
 61%|██████▏   | 3079/5021 [00:15<00:09, 197.02it/s]
 65%|██████▍   | 3239/5021 [00:16<00:08, 198.14it/s]
 62%|██████▏   | 3099/5021 [00:15<00:09, 197.18it/s]
 65%|██████▍   | 3259/5021 [00:16<00:08, 198.25it/s]
 62%|██████▏   | 3120/5021 [00:15<00:09, 198.05it/s]
 65%|██████▌   | 3279/5021 [00:16<00:08, 197.54it/s]
 63%|██████▎   | 3140/5021 [00:16<00:09, 198.01it/s]
 66%|██████▌   | 3299/5021 [00:16<00:08, 197.17it/s]
 63%|██████▎   | 3160/5021 [00:16<00:09, 197.77it/s]
 66%|██████▌   | 3319/5021 [00:17<00:08, 196.93it/s]
 63%|██████▎   | 3180/5021 [00:16<00:09, 197.67it/s]
 67%|██████▋   | 3339/5021 [00:17<00:08, 197.10it/s]
 64%|██████▎   | 3200/5021 [00:16<00:09, 197.62it/s]
 67%|██████▋   | 3359/5021 [00:17<00:08, 197.09it/s]
 64%|██████▍   | 3220/5021 [00:16<00:09, 198.19it/s]
 67%|██████▋   | 3379/5021 [00:17<00:08, 197.00it/s]
 65%|██████▍   | 3240/5021 [00:16<00:08, 198.62it/s]
 68%|██████▊   | 3399/5021 [00:17<00:08, 197.39it/s]
 65%|██████▍   | 3261/5021 [00:16<00:08, 199.07it/s]
 68%|██████▊   | 3419/5021 [00:17<00:08, 197.41it/s]
 65%|██████▌   | 3281/5021 [00:16<00:08, 199.22it/s]
 68%|██████▊   | 3439/5021 [00:17<00:08, 197.34it/s]
 66%|██████▌   | 3301/5021 [00:16<00:08, 199.01it/s]
 69%|██████▉   | 3459/5021 [00:17<00:07, 197.15it/s]
 66%|██████▌   | 3321/5021 [00:16<00:08, 198.89it/s]
 69%|██████▉   | 3479/5021 [00:17<00:07, 196.73it/s]
 67%|██████▋   | 3341/5021 [00:17<00:08, 198.30it/s]
 70%|██████▉   | 3499/5021 [00:17<00:07, 196.93it/s]
 67%|██████▋   | 3361/5021 [00:17<00:08, 197.00it/s]
 70%|███████   | 3519/5021 [00:18<00:07, 197.12it/s]
 67%|██████▋   | 3381/5021 [00:17<00:08, 197.12it/s]
 70%|███████   | 3539/5021 [00:18<00:07, 197.39it/s]
 68%|██████▊   | 3401/5021 [00:17<00:08, 197.00it/s]
 71%|███████   | 3559/5021 [00:18<00:07, 197.79it/s]
 68%|██████▊   | 3421/5021 [00:17<00:08, 197.27it/s]
 71%|███████▏  | 3579/5021 [00:18<00:07, 198.07it/s]
 69%|██████▊   | 3441/5021 [00:17<00:08, 197.24it/s]
 72%|███████▏  | 3599/5021 [00:18<00:07, 198.07it/s]
 69%|██████▉   | 3461/5021 [00:17<00:07, 197.38it/s]
 72%|███████▏  | 3619/5021 [00:18<00:07, 198.07it/s]
 69%|██████▉   | 3481/5021 [00:17<00:07, 197.48it/s]
 72%|███████▏  | 3639/5021 [00:18<00:06, 198.01it/s]
 70%|██████▉   | 3501/5021 [00:17<00:07, 197.65it/s]
 73%|███████▎  | 3659/5021 [00:18<00:06, 197.56it/s]
 70%|███████   | 3521/5021 [00:17<00:07, 197.98it/s]
 73%|███████▎  | 3679/5021 [00:18<00:06, 196.73it/s]
 71%|███████   | 3541/5021 [00:18<00:07, 197.74it/s]
 74%|███████▎  | 3699/5021 [00:18<00:06, 196.84it/s]
 71%|███████   | 3561/5021 [00:18<00:07, 198.01it/s]
 74%|███████▍  | 3719/5021 [00:19<00:06, 196.66it/s]
 71%|███████▏  | 3581/5021 [00:18<00:07, 198.56it/s]
 74%|███████▍  | 3739/5021 [00:19<00:06, 196.58it/s]
 72%|███████▏  | 3601/5021 [00:18<00:07, 198.55it/s]
 75%|███████▍  | 3759/5021 [00:19<00:06, 195.87it/s]
 72%|███████▏  | 3621/5021 [00:18<00:07, 198.85it/s]
 75%|███████▌  | 3779/5021 [00:19<00:06, 196.11it/s]
 73%|███████▎  | 3641/5021 [00:18<00:06, 198.83it/s]
 76%|███████▌  | 3799/5021 [00:19<00:06, 196.60it/s]
 73%|███████▎  | 3661/5021 [00:18<00:06, 198.10it/s]
 76%|███████▌  | 3819/5021 [00:19<00:06, 196.85it/s]
 73%|███████▎  | 3681/5021 [00:18<00:06, 198.12it/s]
 76%|███████▋  | 3839/5021 [00:19<00:06, 196.66it/s]
 74%|███████▎  | 3701/5021 [00:18<00:06, 198.01it/s]
 77%|███████▋  | 3859/5021 [00:19<00:05, 197.04it/s]
 74%|███████▍  | 3721/5021 [00:18<00:06, 197.64it/s]
 77%|███████▋  | 3879/5021 [00:19<00:05, 196.68it/s]
 75%|███████▍  | 3741/5021 [00:19<00:06, 197.68it/s]
 78%|███████▊  | 3899/5021 [00:19<00:05, 196.86it/s]
 75%|███████▍  | 3761/5021 [00:19<00:06, 197.20it/s]
 78%|███████▊  | 3919/5021 [00:20<00:05, 196.97it/s]
 75%|███████▌  | 3781/5021 [00:19<00:06, 197.61it/s]
 78%|███████▊  | 3939/5021 [00:20<00:05, 197.63it/s]
 76%|███████▌  | 3801/5021 [00:19<00:06, 196.34it/s]
 79%|███████▉  | 3959/5021 [00:20<00:05, 197.47it/s]
 76%|███████▌  | 3821/5021 [00:19<00:06, 196.15it/s]
 79%|███████▉  | 3979/5021 [00:20<00:05, 197.68it/s]
 76%|███████▋  | 3841/5021 [00:19<00:06, 196.21it/s]
 80%|███████▉  | 3999/5021 [00:20<00:05, 198.22it/s]
 77%|███████▋  | 3861/5021 [00:19<00:05, 196.18it/s]
 80%|████████  | 4019/5021 [00:20<00:05, 198.47it/s]
 77%|███████▋  | 3881/5021 [00:19<00:05, 196.06it/s]
 80%|████████  | 4039/5021 [00:20<00:04, 198.77it/s]
 78%|███████▊  | 3901/5021 [00:19<00:05, 196.17it/s]
 81%|████████  | 4059/5021 [00:20<00:04, 198.77it/s]
 78%|███████▊  | 3921/5021 [00:19<00:05, 196.49it/s]
 81%|████████  | 4079/5021 [00:20<00:04, 197.81it/s]
 78%|███████▊  | 3941/5021 [00:20<00:05, 196.65it/s]
 82%|████████▏ | 4099/5021 [00:20<00:04, 197.58it/s]
 79%|███████▉  | 3961/5021 [00:20<00:05, 197.05it/s]
 82%|████████▏ | 4119/5021 [00:21<00:04, 197.76it/s]
 79%|███████▉  | 3981/5021 [00:20<00:05, 197.22it/s]
 82%|████████▏ | 4139/5021 [00:21<00:04, 197.76it/s]
 80%|███████▉  | 4001/5021 [00:20<00:05, 197.79it/s]
 83%|████████▎ | 4159/5021 [00:21<00:04, 197.84it/s]
 80%|████████  | 4021/5021 [00:20<00:05, 198.36it/s]
 83%|████████▎ | 4179/5021 [00:21<00:04, 197.78it/s]
 80%|████████  | 4041/5021 [00:20<00:04, 198.03it/s]
 84%|████████▎ | 4199/5021 [00:21<00:04, 197.71it/s]
 81%|████████  | 4061/5021 [00:20<00:04, 198.58it/s]
 84%|████████▍ | 4219/5021 [00:21<00:04, 197.90it/s]
 81%|████████▏ | 4081/5021 [00:20<00:04, 198.99it/s]
 84%|████████▍ | 4239/5021 [00:21<00:03, 197.60it/s]
 82%|████████▏ | 4101/5021 [00:20<00:04, 199.11it/s]
 85%|████████▍ | 4259/5021 [00:21<00:03, 197.53it/s]
 82%|████████▏ | 4121/5021 [00:20<00:04, 198.95it/s]
 85%|████████▌ | 4279/5021 [00:21<00:03, 197.28it/s]
 82%|████████▏ | 4141/5021 [00:21<00:04, 198.80it/s]
 86%|████████▌ | 4299/5021 [00:21<00:03, 197.69it/s]
 83%|████████▎ | 4161/5021 [00:21<00:04, 198.44it/s]
 86%|████████▌ | 4319/5021 [00:22<00:03, 197.55it/s]
 83%|████████▎ | 4181/5021 [00:21<00:04, 198.28it/s]
 86%|████████▋ | 4339/5021 [00:22<00:03, 198.01it/s]
 84%|████████▎ | 4201/5021 [00:21<00:04, 197.17it/s]
 87%|████████▋ | 4359/5021 [00:22<00:03, 198.38it/s]
 84%|████████▍ | 4221/5021 [00:21<00:04, 196.79it/s]
 87%|████████▋ | 4379/5021 [00:22<00:03, 198.57it/s]
 84%|████████▍ | 4241/5021 [00:21<00:03, 196.70it/s]
 88%|████████▊ | 4399/5021 [00:22<00:03, 198.69it/s]
 85%|████████▍ | 4261/5021 [00:21<00:03, 194.50it/s]
 88%|████████▊ | 4419/5021 [00:22<00:03, 198.65it/s]
 85%|████████▌ | 4281/5021 [00:21<00:03, 195.20it/s]
 88%|████████▊ | 4439/5021 [00:22<00:02, 198.51it/s]
 86%|████████▌ | 4301/5021 [00:21<00:03, 195.96it/s]
 89%|████████▉ | 4459/5021 [00:22<00:02, 198.54it/s]
 86%|████████▌ | 4321/5021 [00:21<00:03, 196.92it/s]
 89%|████████▉ | 4479/5021 [00:22<00:02, 198.18it/s]
 86%|████████▋ | 4341/5021 [00:22<00:03, 197.17it/s]
 90%|████████▉ | 4499/5021 [00:22<00:02, 198.04it/s]
 87%|████████▋ | 4361/5021 [00:22<00:03, 197.34it/s]
 90%|█████████ | 4519/5021 [00:23<00:02, 198.01it/s]
 87%|████████▋ | 4381/5021 [00:22<00:03, 197.51it/s]
 90%|█████████ | 4539/5021 [00:23<00:02, 197.52it/s]
 88%|████████▊ | 4401/5021 [00:22<00:03, 197.65it/s]
 91%|█████████ | 4559/5021 [00:23<00:02, 197.63it/s]
 88%|████████▊ | 4421/5021 [00:22<00:03, 198.09it/s]
 91%|█████████ | 4579/5021 [00:23<00:02, 197.67it/s]
 88%|████████▊ | 4441/5021 [00:22<00:02, 194.83it/s]
 92%|█████████▏| 4599/5021 [00:23<00:02, 197.80it/s]
 89%|████████▉ | 4461/5021 [00:22<00:02, 194.23it/s]
 92%|█████████▏| 4619/5021 [00:23<00:02, 193.18it/s]
 89%|████████▉ | 4481/5021 [00:22<00:02, 194.76it/s]
 92%|█████████▏| 4639/5021 [00:23<00:01, 194.09it/s]
 90%|████████▉ | 4501/5021 [00:22<00:02, 195.37it/s]
 93%|█████████▎| 4659/5021 [00:23<00:01, 194.38it/s]
 90%|█████████ | 4521/5021 [00:23<00:02, 195.08it/s]
 93%|█████████▎| 4679/5021 [00:23<00:01, 195.15it/s]
 90%|█████████ | 4541/5021 [00:23<00:02, 195.14it/s]
 94%|█████████▎| 4699/5021 [00:23<00:01, 195.61it/s]
 91%|█████████ | 4561/5021 [00:23<00:02, 195.26it/s]
 94%|█████████▍| 4719/5021 [00:24<00:01, 196.29it/s]
 91%|█████████ | 4581/5021 [00:23<00:02, 195.31it/s]
 94%|█████████▍| 4739/5021 [00:24<00:01, 196.92it/s]
 92%|█████████▏| 4601/5021 [00:23<00:02, 194.70it/s]
 95%|█████████▍| 4759/5021 [00:24<00:01, 197.66it/s]
 92%|█████████▏| 4621/5021 [00:23<00:02, 195.00it/s]
 95%|█████████▌| 4779/5021 [00:24<00:01, 197.96it/s]
 92%|█████████▏| 4641/5021 [00:23<00:01, 195.24it/s]
 96%|█████████▌| 4799/5021 [00:24<00:01, 198.09it/s]
 93%|█████████▎| 4661/5021 [00:23<00:01, 195.33it/s]
 96%|█████████▌| 4819/5021 [00:24<00:01, 198.20it/s]
 93%|█████████▎| 4681/5021 [00:23<00:01, 195.63it/s]
 96%|█████████▋| 4840/5021 [00:24<00:00, 198.81it/s]
 94%|█████████▎| 4701/5021 [00:23<00:01, 196.10it/s]
 97%|█████████▋| 4860/5021 [00:24<00:00, 198.17it/s]
 94%|█████████▍| 4721/5021 [00:24<00:01, 196.27it/s]
 97%|█████████▋| 4880/5021 [00:24<00:00, 197.98it/s]
 94%|█████████▍| 4741/5021 [00:24<00:01, 196.20it/s]
 98%|█████████▊| 4900/5021 [00:25<00:00, 197.84it/s]
 95%|█████████▍| 4761/5021 [00:24<00:01, 196.60it/s]
 98%|█████████▊| 4920/5021 [00:25<00:00, 197.82it/s]
 95%|█████████▌| 4781/5021 [00:24<00:01, 196.72it/s]
 98%|█████████▊| 4940/5021 [00:25<00:00, 197.68it/s]
 96%|█████████▌| 4801/5021 [00:24<00:01, 196.97it/s]
 99%|█████████▉| 4960/5021 [00:25<00:00, 197.25it/s]
 96%|█████████▌| 4821/5021 [00:24<00:01, 197.26it/s]
 99%|█████████▉| 4980/5021 [00:25<00:00, 197.04it/s]
 96%|█████████▋| 4841/5021 [00:24<00:00, 197.40it/s]
100%|█████████▉| 5000/5021 [00:25<00:00, 197.58it/s]
 97%|█████████▋| 4861/5021 [00:24<00:00, 197.54it/s]
100%|█████████▉| 5020/5021 [00:25<00:00, 197.63it/s]
100%|██████████| 5021/5021 [00:25<00:00, 195.95it/s]
n136-128-154:2121332:2121332 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2121332:2121332 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2121332:2121332 [0] NCCL INFO cudaDriverVersion 12040
n136-128-154:2121332:2121332 [0] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2121332:2121332 [0] NCCL INFO Comm config Blocking set to 1

 97%|█████████▋| 4881/5021 [00:24<00:00, 197.67it/s]
 98%|█████████▊| 4901/5021 [00:24<00:00, 197.89it/s]n136-128-154:2121332:2121730 [0] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2121332:2121730 [0] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2121332:2121730 [0] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2121332:2121730 [0] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2121332:2121730 [0] NCCL INFO NCCL_IB_HCA set to mlx5

 98%|█████████▊| 4921/5021 [00:25<00:00, 196.86it/s]n136-128-154:2121332:2121730 [0] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2121332:2121730 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2121332:2121730 [0] NCCL INFO Initialized NET plugin IB
n136-128-154:2121332:2121730 [0] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2121332:2121730 [0] NCCL INFO Using network IB
n136-128-154:2121332:2121730 [0] NCCL INFO ncclCommInitRankConfig comm 0x46976f30 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xdce05904dd40e8bb - Init START

 98%|█████████▊| 4941/5021 [00:25<00:00, 197.10it/s]
 99%|█████████▉| 4961/5021 [00:25<00:00, 197.27it/s]
 99%|█████████▉| 4981/5021 [00:25<00:00, 197.04it/s]
100%|█████████▉| 5001/5021 [00:25<00:00, 197.01it/s]
100%|██████████| 5021/5021 [00:25<00:00, 197.21it/s]
100%|██████████| 5021/5021 [00:25<00:00, 196.48it/s]
n136-128-154:2121333:2121333 [1] NCCL INFO cudaDriverVersion 12040
n136-128-154:2121333:2121333 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2121333:2121333 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2121333:2121333 [1] NCCL INFO NCCL version 2.27.5+cuda12.9
n136-128-154:2121333:2121333 [1] NCCL INFO Comm config Blocking set to 1
n136-128-154:2121333:2121735 [1] NCCL INFO NET/Plugin: Could not find: none libnccl-net-none.so. 
n136-128-154:2121333:2121735 [1] NCCL INFO NCCL_IB_DISABLE set by environment to 0.
n136-128-154:2121333:2121735 [1] NCCL INFO NCCL_SOCKET_FAMILY set by environment to AF_INET6
n136-128-154:2121333:2121735 [1] NCCL INFO NCCL_SOCKET_IFNAME set by environment to =eth0
n136-128-154:2121333:2121735 [1] NCCL INFO NCCL_IB_HCA set to mlx5
n136-128-154:2121333:2121735 [1] NCCL INFO NCCL_IB_PCI_RELAXED_ORDERING set by environment to 1.
n136-128-154:2121333:2121735 [1] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [RO]; OOB eth0:fdbd:dc03:9:451::154<0>
n136-128-154:2121333:2121735 [1] NCCL INFO Initialized NET plugin IB
n136-128-154:2121333:2121735 [1] NCCL INFO Assigned NET plugin IB to comm
n136-128-154:2121333:2121735 [1] NCCL INFO Using network IB
n136-128-154:2121333:2121735 [1] NCCL INFO ncclCommInitRankConfig comm 0xec85c30 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xdce05904dd40e8bb - Init START
n136-128-154:2121333:2121735 [1] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2121332:2121730 [0] NCCL INFO RAS client listening socket at ::1<28028>
n136-128-154:2121333:2121735 [1] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2121333:2121735 [1] NCCL INFO Retrieving state for IB
n136-128-154:2121333:2121735 [1] NCCL INFO Initialized state 0 for IB
n136-128-154:2121333:2121735 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2121333:2121735 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2121333:2121735 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2121333:2121735 [1] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2121332:2121730 [0] NCCL INFO TOPO/NET : Importing network plugins to topology
n136-128-154:2121332:2121730 [0] NCCL INFO Retrieving state for IB
n136-128-154:2121332:2121730 [0] NCCL INFO Initialized state 0 for IB
n136-128-154:2121332:2121730 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_0 in topo with pciPath=/sys/devices/pci0000:09/0000:09:02.0/0000:0a:00.0/0000:0b:08.0/0000:1b:00.0/0000:1c:00.0/0000:1d:00.0 keep=1 coll=(null)
n136-128-154:2121332:2121730 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_1 in topo with pciPath=/sys/devices/pci0000:43/0000:43:02.0/0000:44:00.0/0000:45:08.0/0000:5e:00.0/0000:5f:00.0/0000:60:00.0 keep=1 coll=(null)
n136-128-154:2121332:2121730 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_2 in topo with pciPath=/sys/devices/pci0000:82/0000:82:02.0/0000:83:00.0/0000:84:08.0/0000:93:00.0/0000:94:00.0/0000:95:00.0 keep=1 coll=(null)
n136-128-154:2121332:2121730 [0] NCCL INFO ncclTopoPopulateNics : Filled mlx5_3 in topo with pciPath=/sys/devices/pci0000:be/0000:be:02.0/0000:bf:00.0/0000:c0:04.0/0000:ca:00.0/0000:cb:10.0/0000:cc:00.0 keep=1 coll=(null)
n136-128-154:2121333:2121735 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2121333:2121735 [1] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2121332:2121730 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 0 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2121332:2121730 [0] NCCL INFO GPU Direct RDMA Enabled for GPU 1 / HCA 3 (distance 5 <= 5), read 0 mode Default
n136-128-154:2121332:2121730 [0] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2121332:2121730 [0] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2121332:2121730 [0] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2121332:2121730 [0] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2121332:2121730 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2121332:2121730 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2121332:2121730 [0] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2121332:2121730 [0] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2121332:2121730 [0] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2121332:2121730 [0] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2121332:2121730 [0] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2121332:2121730 [0] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2121332:2121730 [0] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2121332:2121730 [0] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2121332:2121730 [0] NCCL INFO ==========================================
n136-128-154:2121332:2121730 [0] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2121333:2121735 [1] NCCL INFO === System : maxBw 240.0 totalBw 240.0 ===
n136-128-154:2121332:2121730 [0] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2121333:2121735 [1] NCCL INFO CPU/0-1 (1/1/2)
n136-128-154:2121333:2121735 [1] NCCL INFO + PCI[24.0] - PCI/0-83000 (1000c0101000ffff)
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - NIC/0-95000
n136-128-154:2121333:2121735 [1] NCCL INFO + PCI[24.0] - PCI/0-bf000 (1000c0101000ffff)
n136-128-154:2121332:2121730 [0] NCCL INFO Setting affinity for GPU 6 to 33-62,97-126
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - PCI/0-c3000 (1000c01010de13b8)
n136-128-154:2121333:2121735 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c5000 (0)
n136-128-154:2121333:2121735 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - PCI/0-c7000 (1000c01010de13b8)
n136-128-154:2121333:2121735 [1] NCCL INFO                             + PCI[24.0] - GPU/0-c9000 (1)
n136-128-154:2121333:2121735 [1] NCCL INFO                                           + NVL[240.0] - NVS/0-0
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - NIC/0-cc000
n136-128-154:2121333:2121735 [1] NCCL INFO + SYS[10.0] - CPU/0-0
n136-128-154:2121333:2121735 [1] NCCL INFO CPU/0-0 (1/1/2)
n136-128-154:2121333:2121735 [1] NCCL INFO + PCI[24.0] - PCI/0-a000 (1000c0101000ffff)
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - NIC/0-1d000
n136-128-154:2121333:2121735 [1] NCCL INFO + PCI[24.0] - PCI/0-44000 (1000c0101000ffff)
n136-128-154:2121333:2121735 [1] NCCL INFO               + PCI[24.0] - NIC/0-60000
n136-128-154:2121333:2121735 [1] NCCL INFO + SYS[10.0] - CPU/0-1
n136-128-154:2121333:2121735 [1] NCCL INFO ==========================================
n136-128-154:2121333:2121735 [1] NCCL INFO GPU/0-c5000 :GPU/0-c5000 (0/5000.0/LOC) GPU/0-c9000 (2/240.0/NVL) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2121333:2121735 [1] NCCL INFO GPU/0-c9000 :GPU/0-c5000 (2/240.0/NVL) GPU/0-c9000 (0/5000.0/LOC) NVS/0-0 (1/240.0/NVL) CPU/0-1 (3/24.0/PHB) CPU/0-0 (4/10.0/SYS) 
n136-128-154:2121333:2121735 [1] NCCL INFO Setting affinity for GPU 7 to 33-62,97-126
n136-128-154:2121332:2121730 [0] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2121332:2121730 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2121332:2121730 [0] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121332:2121730 [0] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO Pattern 4, crossNic 0, nChannels 12, bw 20.000000/20.000000, type NVL/PIX, sameChannels 1
n136-128-154:2121333:2121735 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  6 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  7 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  8 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  9 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO 10 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO 11 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO Pattern 1, crossNic 0, nChannels 12, bw 40.000000/40.000000, type NVL/PIX, sameChannels 0
n136-128-154:2121333:2121735 [1] NCCL INFO  0 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  1 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  2 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  3 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  4 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  5 : GPU/0-c5000 GPU/0-c9000
n136-128-154:2121333:2121735 [1] NCCL INFO  6 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO  7 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO  8 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO  9 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO 10 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121333:2121735 [1] NCCL INFO 11 : GPU/0-c9000 GPU/0-c5000
n136-128-154:2121332:2121730 [0] NCCL INFO comm 0x46976f30 rank 0 nRanks 2 nNodes 1 localRanks 2 localRank 0 MNNVL 0
n136-128-154:2121333:2121735 [1] NCCL INFO comm 0xec85c30 rank 1 nRanks 2 nNodes 1 localRanks 2 localRank 1 MNNVL 0
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 0 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 0 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 12 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 12 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 1 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 1 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 13 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 13 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 2 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 2 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 14 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 14 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 3 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 3 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 15 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 15 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 4 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 4 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 16 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 16 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 5 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 5 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 17 : 0 -> 1 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 17 : -1 -> 0 -> 1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 6 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 6 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 18 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 18 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 7 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 7 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 19 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 19 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 8 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 8 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 20 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 20 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 9 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 9 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 21 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 21 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 10 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 10 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 22 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 22 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 11 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 11 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121333:2121735 [1] NCCL INFO Tree 23 : -1 -> 1 -> 0/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Tree 23 : 1 -> 0 -> -1/-1/-1
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 00/24 : 0 1
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 01/24 : 0 1
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 02/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 00 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 03/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 01 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 04/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 02 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 05/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 03 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 06/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 04 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 07/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 05 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 08/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 06 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 09/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 07 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 10/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 08 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 11/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 09 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 12/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 10 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 13/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 11 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 14/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 12 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 15/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 13 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 16/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 14 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 17/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 15 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 18/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 16 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 19/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 17 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 20/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 18 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 21/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 19 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 22/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 20 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Channel 23/24 : 0 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 21 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 00 : 1 -> 0 -> 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 22 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 01 : 1 -> 0 -> 1
n136-128-154:2121333:2121735 [1] NCCL INFO Ring 23 : 0 -> 1 -> 0
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 02 : 1 -> 0 -> 1
n136-128-154:2121333:2121735 [1] NCCL INFO Trees [0] -1/-1/-1->1->0 [1] -1/-1/-1->1->0 [2] -1/-1/-1->1->0 [3] -1/-1/-1->1->0 [4] -1/-1/-1->1->0 [5] -1/-1/-1->1->0 [6] 0/-1/-1->1->-1 [7] 0/-1/-1->1->-1 [8] 0/-1/-1->1->-1 [9] 0/-1/-1->1->-1 [10] 0/-1/-1->1->-1 [11] 0/-1/-1->1->-1 [12] -1/-1/-1->1->0 [13] -1/-1/-1->1->0 [14] -1/-1/-1->1->0 [15] -1/-1/-1->1->0 [16] -1/-1/-1->1->0 [17] -1/-1/-1->1->0 [18] 0/-1/-1->1->-1 [19] 0/-1/-1->1->-1 [20] 0/-1/-1->1->-1 [21] 0/-1/-1->1->-1 [22] 0/-1/-1->1->-1 [23] 0/-1/-1->1->-1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 03 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 04 : 1 -> 0 -> 1
n136-128-154:2121333:2121735 [1] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 05 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 06 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 07 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 08 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 09 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 10 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 11 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 12 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 13 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 14 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 15 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 16 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 17 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 18 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 19 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 20 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 21 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 22 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Ring 23 : 1 -> 0 -> 1
n136-128-154:2121332:2121730 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] -1/-1/-1->0->1 [7] -1/-1/-1->0->1 [8] -1/-1/-1->0->1 [9] -1/-1/-1->0->1 [10] -1/-1/-1->0->1 [11] -1/-1/-1->0->1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1 [16] 1/-1/-1->0->-1 [17] 1/-1/-1->0->-1 [18] -1/-1/-1->0->1 [19] -1/-1/-1->0->1 [20] -1/-1/-1->0->1 [21] -1/-1/-1->0->1 [22] -1/-1/-1->0->1 [23] -1/-1/-1->0->1
n136-128-154:2121332:2121730 [0] NCCL INFO P2P Chunksize set to 524288
n136-128-154:2121333:2121735 [1] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2121333:2121743 [1] NCCL INFO [Proxy Service] Device 1 CPU core 40
n136-128-154:2121333:2121744 [1] NCCL INFO [Proxy Service UDS] Device 1 CPU core 105
n136-128-154:2121332:2121730 [0] NCCL INFO PROFILER/Plugin: Could not find: libnccl-profiler.so. 
n136-128-154:2121332:2121730 [0] NCCL INFO Check P2P Type isAllDirectP2p 1 directMode 0
n136-128-154:2121332:2121745 [0] NCCL INFO [Proxy Service] Device 0 CPU core 100
n136-128-154:2121332:2121746 [0] NCCL INFO [Proxy Service UDS] Device 0 CPU core 38
n136-128-154:2121333:2121735 [1] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2121333:2121735 [1] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2121332:2121730 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
n136-128-154:2121332:2121730 [0] NCCL INFO 24 coll channels, 24 collnet channels, 0 nvls channels, 32 p2p channels, 32 p2p channels per peer
n136-128-154:2121332:2121730 [0] NCCL INFO CC Off, workFifoBytes 1048576
n136-128-154:2121332:2121730 [0] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2121332:2121730 [0] NCCL INFO ncclCommInitRankConfig comm 0x46976f30 rank 0 nranks 2 cudaDev 0 nvmlDev 6 busId c5000 commId 0xdce05904dd40e8bb - Init COMPLETE
n136-128-154:2121332:2121730 [0] NCCL INFO Init timings - ncclCommInitRankConfig: rank 0 nranks 2 total 1.32 (kernels 0.13, alloc 0.20, bootstrap 0.77, allgathers 0.01, topo 0.07, graphs 0.00, connections 0.01, rest 0.13)
n136-128-154:2121333:2121735 [1] NCCL INFO TUNER/Plugin: Could not find: libnccl-tuner.so. Using internal tuner plugin.
n136-128-154:2121333:2121735 [1] NCCL INFO ncclCommInitRankConfig comm 0xec85c30 rank 1 nranks 2 cudaDev 1 nvmlDev 7 busId c9000 commId 0xdce05904dd40e8bb - Init COMPLETE
n136-128-154:2121333:2121735 [1] NCCL INFO Init timings - ncclCommInitRankConfig: rank 1 nranks 2 total 0.55 (kernels 0.12, alloc 0.21, bootstrap 0.00, allgathers 0.01, topo 0.07, graphs 0.00, connections 0.01, rest 0.13)
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 00/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 01/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 02/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 03/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 04/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 05/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 06/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 07/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 00/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 08/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 01/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 09/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 02/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 10/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 03/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 11/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 04/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 12/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 05/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 13/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 06/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 14/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 07/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 15/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 08/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 16/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 09/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 17/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 10/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 18/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 11/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 19/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 12/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 20/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 13/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 21/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 14/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 22/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 15/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Channel 23/0 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 16/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 17/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 18/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 19/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 20/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 21/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 22/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121332:2121748 [0] NCCL INFO Channel 23/0 : 0[6] -> 1[7] via P2P/CUMEM/read
n136-128-154:2121333:2121747 [1] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
n136-128-154:2121332:2121748 [0] NCCL INFO Connected all rings, use ring PXN 0 GDR 1
2025-12-09:02:47:39 INFO     [evaluator:559] Running loglikelihood requests
2025-12-09:02:47:39 INFO     [evaluator:559] Running loglikelihood requests
Passed argument batch_size = auto:1. Detecting largest batch size

Running loglikelihood requests:   0%|          | 0/20084 [00:00<?, ?it/s]Passed argument batch_size = auto:1. Detecting largest batch size
Determined largest batch size: 57
Determined largest batch size: 57

Running loglikelihood requests:   0%|          | 1/20084 [00:40<226:36:12, 40.62s/it]
Running loglikelihood requests:   0%|          | 58/20084 [00:45<3:15:35,  1.71it/s] 
Running loglikelihood requests:   1%|          | 115/20084 [00:50<1:37:01,  3.43it/s]
Running loglikelihood requests:   1%|          | 172/20084 [00:55<1:05:03,  5.10it/s]
Running loglikelihood requests:   1%|          | 229/20084 [00:59<49:51,  6.64it/s]  
Running loglikelihood requests:   1%|▏         | 286/20084 [01:04<41:23,  7.97it/s]
Running loglikelihood requests:   2%|▏         | 343/20084 [01:09<36:11,  9.09it/s]
Running loglikelihood requests:   2%|▏         | 400/20084 [01:13<32:49,  9.99it/s]
Running loglikelihood requests:   2%|▏         | 457/20084 [01:18<30:34, 10.70it/s]
Running loglikelihood requests:   3%|▎         | 514/20084 [01:22<28:59, 11.25it/s]
Running loglikelihood requests:   3%|▎         | 571/20084 [01:27<27:52, 11.66it/s]
Running loglikelihood requests:   3%|▎         | 628/20084 [01:31<27:01, 12.00it/s]
Running loglikelihood requests:   3%|▎         | 685/20084 [01:36<26:22, 12.26it/s]
Running loglikelihood requests:   4%|▎         | 742/20084 [01:40<25:53, 12.45it/s]
Running loglikelihood requests:   4%|▍         | 799/20084 [01:44<25:30, 12.60it/s]
Running loglikelihood requests:   4%|▍         | 856/20084 [01:49<25:11, 12.72it/s]
Running loglikelihood requests:   5%|▍         | 913/20084 [01:53<24:57, 12.80it/s]
Running loglikelihood requests:   5%|▍         | 970/20084 [01:58<24:44, 12.87it/s]
Running loglikelihood requests:   5%|▌         | 1027/20084 [02:02<24:33, 12.94it/s]
Running loglikelihood requests:   5%|▌         | 1084/20084 [02:06<24:22, 12.99it/s]
Running loglikelihood requests:   6%|▌         | 1141/20084 [02:11<24:12, 13.04it/s]
Running loglikelihood requests:   6%|▌         | 1198/20084 [02:15<24:03, 13.08it/s]
Running loglikelihood requests:   6%|▌         | 1255/20084 [02:19<23:54, 13.13it/s]
Running loglikelihood requests:   7%|▋         | 1312/20084 [02:23<23:47, 13.15it/s]
Running loglikelihood requests:   7%|▋         | 1369/20084 [02:28<23:39, 13.18it/s]
Running loglikelihood requests:   7%|▋         | 1426/20084 [02:32<23:32, 13.21it/s]
Running loglikelihood requests:   7%|▋         | 1483/20084 [02:36<23:24, 13.24it/s]
Running loglikelihood requests:   8%|▊         | 1540/20084 [02:41<23:18, 13.26it/s]
Running loglikelihood requests:   8%|▊         | 1597/20084 [02:45<23:10, 13.30it/s]
Running loglikelihood requests:   8%|▊         | 1654/20084 [02:49<23:03, 13.32it/s]
Running loglikelihood requests:   9%|▊         | 1711/20084 [02:53<22:56, 13.35it/s]
Running loglikelihood requests:   9%|▉         | 1768/20084 [02:58<22:49, 13.38it/s]
Running loglikelihood requests:   9%|▉         | 1825/20084 [03:02<22:42, 13.40it/s]
Running loglikelihood requests:   9%|▉         | 1882/20084 [03:06<22:37, 13.41it/s]
Running loglikelihood requests:  10%|▉         | 1939/20084 [03:10<22:30, 13.43it/s]
Running loglikelihood requests:  10%|▉         | 1996/20084 [03:15<22:24, 13.46it/s]
Running loglikelihood requests:  10%|█         | 2053/20084 [03:19<22:18, 13.47it/s]
Running loglikelihood requests:  11%|█         | 2110/20084 [03:23<22:11, 13.50it/s]
Running loglikelihood requests:  11%|█         | 2167/20084 [03:27<22:05, 13.52it/s]
Running loglikelihood requests:  11%|█         | 2224/20084 [03:31<21:59, 13.54it/s]
Running loglikelihood requests:  11%|█▏        | 2281/20084 [03:36<21:53, 13.56it/s]
Running loglikelihood requests:  12%|█▏        | 2338/20084 [03:40<21:46, 13.58it/s]
Running loglikelihood requests:  12%|█▏        | 2395/20084 [03:44<21:40, 13.60it/s]
Running loglikelihood requests:  12%|█▏        | 2452/20084 [03:48<21:34, 13.62it/s]
Running loglikelihood requests:  12%|█▏        | 2509/20084 [03:52<21:29, 13.63it/s]
Running loglikelihood requests:  13%|█▎        | 2566/20084 [03:56<21:22, 13.66it/s]
Running loglikelihood requests:  13%|█▎        | 2623/20084 [04:01<21:17, 13.67it/s]
Running loglikelihood requests:  13%|█▎        | 2680/20084 [04:05<21:11, 13.69it/s]
Running loglikelihood requests:  14%|█▎        | 2737/20084 [04:09<21:05, 13.71it/s]
Running loglikelihood requests:  14%|█▍        | 2794/20084 [04:13<21:00, 13.72it/s]
Running loglikelihood requests:  14%|█▍        | 2851/20084 [04:17<20:54, 13.74it/s]
Running loglikelihood requests:  14%|█▍        | 2908/20084 [04:21<20:48, 13.76it/s]
Running loglikelihood requests:  15%|█▍        | 2965/20084 [04:25<20:42, 13.78it/s]
Running loglikelihood requests:  15%|█▌        | 3022/20084 [04:30<20:37, 13.79it/s]
Running loglikelihood requests:  15%|█▌        | 3079/20084 [04:34<20:31, 13.81it/s]
Running loglikelihood requests:  16%|█▌        | 3136/20084 [04:38<20:26, 13.82it/s]
Running loglikelihood requests:  16%|█▌        | 3193/20084 [04:42<20:20, 13.84it/s]
Running loglikelihood requests:  16%|█▌        | 3250/20084 [04:46<20:17, 13.82it/s]
Running loglikelihood requests:  16%|█▋        | 3307/20084 [04:50<20:11, 13.85it/s]
Running loglikelihood requests:  17%|█▋        | 3364/20084 [04:54<20:06, 13.86it/s]
Running loglikelihood requests:  17%|█▋        | 3421/20084 [04:58<20:00, 13.88it/s]
Running loglikelihood requests:  17%|█▋        | 3478/20084 [05:02<19:54, 13.90it/s]
Running loglikelihood requests:  18%|█▊        | 3535/20084 [05:07<19:50, 13.91it/s]
Running loglikelihood requests:  18%|█▊        | 3592/20084 [05:11<19:44, 13.92it/s]
Running loglikelihood requests:  18%|█▊        | 3649/20084 [05:15<19:38, 13.95it/s]
Running loglikelihood requests:  18%|█▊        | 3706/20084 [05:19<19:33, 13.96it/s]
Running loglikelihood requests:  19%|█▊        | 3763/20084 [05:23<19:28, 13.97it/s]
Running loglikelihood requests:  19%|█▉        | 3820/20084 [05:27<19:22, 13.99it/s]
Running loglikelihood requests:  19%|█▉        | 3877/20084 [05:31<19:17, 14.00it/s]
Running loglikelihood requests:  20%|█▉        | 3934/20084 [05:35<19:12, 14.02it/s]
Running loglikelihood requests:  20%|█▉        | 3991/20084 [05:39<19:06, 14.03it/s]
Running loglikelihood requests:  20%|██        | 4048/20084 [05:43<19:01, 14.05it/s]
Running loglikelihood requests:  20%|██        | 4105/20084 [05:47<18:56, 14.06it/s]
Running loglikelihood requests:  21%|██        | 4162/20084 [05:51<18:50, 14.08it/s]
Running loglikelihood requests:  21%|██        | 4219/20084 [05:55<18:45, 14.09it/s]
Running loglikelihood requests:  21%|██▏       | 4276/20084 [05:59<18:40, 14.11it/s]
Running loglikelihood requests:  22%|██▏       | 4333/20084 [06:03<18:35, 14.12it/s]
Running loglikelihood requests:  22%|██▏       | 4390/20084 [06:07<18:30, 14.13it/s]
Running loglikelihood requests:  22%|██▏       | 4447/20084 [06:11<18:26, 14.13it/s]
Running loglikelihood requests:  22%|██▏       | 4504/20084 [06:15<18:20, 14.16it/s]
Running loglikelihood requests:  23%|██▎       | 4561/20084 [06:19<18:15, 14.17it/s]
Running loglikelihood requests:  23%|██▎       | 4618/20084 [06:23<18:06, 14.24it/s]
Running loglikelihood requests:  23%|██▎       | 4675/20084 [06:27<18:00, 14.27it/s]
Running loglikelihood requests:  24%|██▎       | 4732/20084 [06:31<17:53, 14.30it/s]
Running loglikelihood requests:  24%|██▍       | 4789/20084 [06:35<17:47, 14.32it/s]
Running loglikelihood requests:  24%|██▍       | 4846/20084 [06:39<17:41, 14.35it/s]
Running loglikelihood requests:  24%|██▍       | 4903/20084 [06:43<17:38, 14.34it/s]
Running loglikelihood requests:  25%|██▍       | 4960/20084 [06:47<17:35, 14.32it/s]
Running loglikelihood requests:  25%|██▍       | 5017/20084 [06:51<17:31, 14.32it/s]
Running loglikelihood requests:  25%|██▌       | 5074/20084 [06:55<17:27, 14.33it/s]
Running loglikelihood requests:  26%|██▌       | 5131/20084 [06:59<17:22, 14.34it/s]
Running loglikelihood requests:  26%|██▌       | 5188/20084 [07:03<17:17, 14.36it/s]
Running loglikelihood requests:  26%|██▌       | 5245/20084 [07:07<17:12, 14.37it/s]
Running loglikelihood requests:  26%|██▋       | 5302/20084 [07:11<17:08, 14.38it/s]
Running loglikelihood requests:  27%|██▋       | 5359/20084 [07:15<17:03, 14.38it/s]
Running loglikelihood requests:  27%|██▋       | 5416/20084 [07:19<16:58, 14.40it/s]
Running loglikelihood requests:  27%|██▋       | 5473/20084 [07:23<16:53, 14.41it/s]
Running loglikelihood requests:  28%|██▊       | 5530/20084 [07:27<16:48, 14.43it/s]
Running loglikelihood requests:  28%|██▊       | 5587/20084 [07:31<16:43, 14.44it/s]
Running loglikelihood requests:  28%|██▊       | 5644/20084 [07:35<16:39, 14.45it/s]
Running loglikelihood requests:  28%|██▊       | 5701/20084 [07:39<16:34, 14.47it/s]
Running loglikelihood requests:  29%|██▊       | 5758/20084 [07:42<16:29, 14.47it/s]
Running loglikelihood requests:  29%|██▉       | 5815/20084 [07:46<16:22, 14.53it/s]
Running loglikelihood requests:  29%|██▉       | 5872/20084 [07:50<16:15, 14.57it/s]
Running loglikelihood requests:  30%|██▉       | 5929/20084 [07:54<16:09, 14.60it/s]
Running loglikelihood requests:  30%|██▉       | 5986/20084 [07:58<16:04, 14.61it/s]
Running loglikelihood requests:  30%|███       | 6043/20084 [08:02<16:00, 14.62it/s]
Running loglikelihood requests:  30%|███       | 6100/20084 [08:06<15:57, 14.61it/s]
Running loglikelihood requests:  31%|███       | 6157/20084 [08:10<15:52, 14.62it/s]
Running loglikelihood requests:  31%|███       | 6214/20084 [08:14<15:48, 14.63it/s]
Running loglikelihood requests:  31%|███       | 6271/20084 [08:18<15:43, 14.63it/s]
Running loglikelihood requests:  32%|███▏      | 6328/20084 [08:21<15:39, 14.64it/s]
Running loglikelihood requests:  32%|███▏      | 6385/20084 [08:25<15:34, 14.66it/s]
Running loglikelihood requests:  32%|███▏      | 6442/20084 [08:29<15:30, 14.66it/s]
Running loglikelihood requests:  32%|███▏      | 6499/20084 [08:33<15:25, 14.68it/s]
Running loglikelihood requests:  33%|███▎      | 6556/20084 [08:37<15:20, 14.69it/s]
Running loglikelihood requests:  33%|███▎      | 6613/20084 [08:41<15:15, 14.71it/s]
Running loglikelihood requests:  33%|███▎      | 6670/20084 [08:45<15:11, 14.72it/s]
Running loglikelihood requests:  33%|███▎      | 6727/20084 [08:48<15:06, 14.74it/s]
Running loglikelihood requests:  34%|███▍      | 6784/20084 [08:52<15:02, 14.74it/s]
Running loglikelihood requests:  34%|███▍      | 6841/20084 [08:56<14:57, 14.76it/s]
Running loglikelihood requests:  34%|███▍      | 6898/20084 [09:00<14:52, 14.77it/s]
Running loglikelihood requests:  35%|███▍      | 6955/20084 [09:04<14:48, 14.77it/s]
Running loglikelihood requests:  35%|███▍      | 7012/20084 [09:08<14:44, 14.78it/s]
Running loglikelihood requests:  35%|███▌      | 7069/20084 [09:12<14:40, 14.79it/s]
Running loglikelihood requests:  35%|███▌      | 7126/20084 [09:15<14:32, 14.85it/s]
Running loglikelihood requests:  36%|███▌      | 7183/20084 [09:19<14:26, 14.89it/s]
Running loglikelihood requests:  36%|███▌      | 7240/20084 [09:23<14:20, 14.92it/s]
Running loglikelihood requests:  36%|███▋      | 7297/20084 [09:27<14:18, 14.89it/s]
Running loglikelihood requests:  37%|███▋      | 7354/20084 [09:31<14:14, 14.90it/s]
Running loglikelihood requests:  37%|███▋      | 7411/20084 [09:35<14:10, 14.90it/s]
Running loglikelihood requests:  37%|███▋      | 7468/20084 [09:38<14:06, 14.90it/s]
Running loglikelihood requests:  37%|███▋      | 7525/20084 [09:42<14:02, 14.91it/s]
Running loglikelihood requests:  38%|███▊      | 7582/20084 [09:46<13:57, 14.92it/s]
Running loglikelihood requests:  38%|███▊      | 7639/20084 [09:50<13:53, 14.93it/s]
Running loglikelihood requests:  38%|███▊      | 7696/20084 [09:54<13:49, 14.93it/s]
Running loglikelihood requests:  39%|███▊      | 7753/20084 [09:57<13:45, 14.95it/s]
Running loglikelihood requests:  39%|███▉      | 7810/20084 [10:01<13:41, 14.95it/s]
Running loglikelihood requests:  39%|███▉      | 7867/20084 [10:05<13:36, 14.96it/s]
Running loglikelihood requests:  39%|███▉      | 7924/20084 [10:09<13:32, 14.97it/s]
Running loglikelihood requests:  40%|███▉      | 7981/20084 [10:13<13:27, 14.98it/s]
Running loglikelihood requests:  40%|████      | 8038/20084 [10:16<13:23, 14.99it/s]
Running loglikelihood requests:  40%|████      | 8095/20084 [10:20<13:18, 15.01it/s]
Running loglikelihood requests:  41%|████      | 8152/20084 [10:24<13:13, 15.03it/s]
Running loglikelihood requests:  41%|████      | 8209/20084 [10:28<13:09, 15.04it/s]
Running loglikelihood requests:  41%|████      | 8266/20084 [10:32<13:05, 15.05it/s]
Running loglikelihood requests:  41%|████▏     | 8323/20084 [10:35<13:01, 15.05it/s]
Running loglikelihood requests:  42%|████▏     | 8380/20084 [10:39<12:56, 15.07it/s]
Running loglikelihood requests:  42%|████▏     | 8437/20084 [10:43<12:52, 15.08it/s]
Running loglikelihood requests:  42%|████▏     | 8494/20084 [10:47<12:48, 15.08it/s]
Running loglikelihood requests:  43%|████▎     | 8551/20084 [10:50<12:42, 15.13it/s]
Running loglikelihood requests:  43%|████▎     | 8608/20084 [10:54<12:36, 15.16it/s]
Running loglikelihood requests:  43%|████▎     | 8665/20084 [10:58<12:31, 15.19it/s]
Running loglikelihood requests:  43%|████▎     | 8722/20084 [11:02<12:28, 15.19it/s]
Running loglikelihood requests:  44%|████▎     | 8779/20084 [11:05<12:24, 15.18it/s]
Running loglikelihood requests:  44%|████▍     | 8836/20084 [11:09<12:21, 15.17it/s]
Running loglikelihood requests:  44%|████▍     | 8893/20084 [11:13<12:17, 15.17it/s]
Running loglikelihood requests:  45%|████▍     | 8950/20084 [11:17<12:14, 15.16it/s]
Running loglikelihood requests:  45%|████▍     | 9007/20084 [11:20<12:10, 15.17it/s]
Running loglikelihood requests:  45%|████▌     | 9064/20084 [11:24<12:06, 15.17it/s]
Running loglikelihood requests:  45%|████▌     | 9121/20084 [11:28<11:59, 15.23it/s]
Running loglikelihood requests:  46%|████▌     | 9178/20084 [11:32<11:54, 15.27it/s]
Running loglikelihood requests:  46%|████▌     | 9235/20084 [11:35<11:49, 15.29it/s]
Running loglikelihood requests:  46%|████▋     | 9292/20084 [11:39<11:46, 15.28it/s]
Running loglikelihood requests:  47%|████▋     | 9349/20084 [11:43<11:42, 15.28it/s]
Running loglikelihood requests:  47%|████▋     | 9406/20084 [11:47<11:38, 15.28it/s]
Running loglikelihood requests:  47%|████▋     | 9463/20084 [11:50<11:34, 15.29it/s]
Running loglikelihood requests:  47%|████▋     | 9520/20084 [11:54<11:30, 15.31it/s]
Running loglikelihood requests:  48%|████▊     | 9577/20084 [11:58<11:26, 15.32it/s]
Running loglikelihood requests:  48%|████▊     | 9634/20084 [12:01<11:22, 15.32it/s]
Running loglikelihood requests:  48%|████▊     | 9691/20084 [12:05<11:15, 15.38it/s]
Running loglikelihood requests:  49%|████▊     | 9748/20084 [12:09<11:09, 15.43it/s]
Running loglikelihood requests:  49%|████▉     | 9805/20084 [12:12<11:04, 15.47it/s]
Running loglikelihood requests:  49%|████▉     | 9862/20084 [12:16<10:59, 15.49it/s]
Running loglikelihood requests:  49%|████▉     | 9919/20084 [12:20<10:55, 15.51it/s]
Running loglikelihood requests:  50%|████▉     | 9976/20084 [12:23<10:52, 15.50it/s]
Running loglikelihood requests:  50%|████▉     | 10033/20084 [12:27<10:49, 15.49it/s]
Running loglikelihood requests:  50%|█████     | 10090/20084 [12:31<10:45, 15.48it/s]
Running loglikelihood requests:  51%|█████     | 10147/20084 [12:34<10:42, 15.48it/s]
Running loglikelihood requests:  51%|█████     | 10204/20084 [12:38<10:38, 15.48it/s]
Running loglikelihood requests:  51%|█████     | 10261/20084 [12:42<10:34, 15.49it/s]
Running loglikelihood requests:  51%|█████▏    | 10318/20084 [12:45<10:30, 15.49it/s]
Running loglikelihood requests:  52%|█████▏    | 10375/20084 [12:49<10:26, 15.49it/s]
Running loglikelihood requests:  52%|█████▏    | 10432/20084 [12:53<10:20, 15.54it/s]
Running loglikelihood requests:  52%|█████▏    | 10489/20084 [12:56<10:15, 15.58it/s]
Running loglikelihood requests:  53%|█████▎    | 10546/20084 [13:00<10:11, 15.60it/s]
Running loglikelihood requests:  53%|█████▎    | 10603/20084 [13:04<10:06, 15.63it/s]
Running loglikelihood requests:  53%|█████▎    | 10660/20084 [13:07<10:02, 15.64it/s]
Running loglikelihood requests:  53%|█████▎    | 10717/20084 [13:11<09:58, 15.66it/s]
Running loglikelihood requests:  54%|█████▎    | 10774/20084 [13:15<09:54, 15.66it/s]
Running loglikelihood requests:  54%|█████▍    | 10831/20084 [13:18<09:51, 15.64it/s]
Running loglikelihood requests:  54%|█████▍    | 10888/20084 [13:22<09:48, 15.63it/s]
Running loglikelihood requests:  54%|█████▍    | 10945/20084 [13:26<09:45, 15.62it/s]
Running loglikelihood requests:  55%|█████▍    | 11002/20084 [13:29<09:41, 15.63it/s]
Running loglikelihood requests:  55%|█████▌    | 11059/20084 [13:33<09:37, 15.63it/s]
Running loglikelihood requests:  55%|█████▌    | 11116/20084 [13:37<09:33, 15.63it/s]
Running loglikelihood requests:  56%|█████▌    | 11173/20084 [13:40<09:29, 15.64it/s]
Running loglikelihood requests:  56%|█████▌    | 11230/20084 [13:44<09:24, 15.69it/s]
Running loglikelihood requests:  56%|█████▌    | 11287/20084 [13:47<09:19, 15.73it/s]
Running loglikelihood requests:  56%|█████▋    | 11344/20084 [13:51<09:14, 15.77it/s]
Running loglikelihood requests:  57%|█████▋    | 11401/20084 [13:55<09:09, 15.79it/s]
Running loglikelihood requests:  57%|█████▋    | 11458/20084 [13:58<09:05, 15.81it/s]
Running loglikelihood requests:  57%|█████▋    | 11515/20084 [14:02<09:01, 15.83it/s]
Running loglikelihood requests:  58%|█████▊    | 11572/20084 [14:05<08:58, 15.80it/s]
Running loglikelihood requests:  58%|█████▊    | 11629/20084 [14:09<08:55, 15.79it/s]
Running loglikelihood requests:  58%|█████▊    | 11686/20084 [14:13<08:52, 15.79it/s]
Running loglikelihood requests:  58%|█████▊    | 11743/20084 [14:16<08:48, 15.79it/s]
Running loglikelihood requests:  59%|█████▉    | 11800/20084 [14:20<08:44, 15.78it/s]
Running loglikelihood requests:  59%|█████▉    | 11857/20084 [14:23<08:41, 15.78it/s]
Running loglikelihood requests:  59%|█████▉    | 11914/20084 [14:27<08:37, 15.78it/s]
Running loglikelihood requests:  60%|█████▉    | 11971/20084 [14:31<08:32, 15.83it/s]
Running loglikelihood requests:  60%|█████▉    | 12028/20084 [14:34<08:27, 15.87it/s]
Running loglikelihood requests:  60%|██████    | 12085/20084 [14:38<08:23, 15.89it/s]
Running loglikelihood requests:  60%|██████    | 12142/20084 [14:41<08:18, 15.92it/s]
Running loglikelihood requests:  61%|██████    | 12199/20084 [14:45<08:15, 15.93it/s]
Running loglikelihood requests:  61%|██████    | 12256/20084 [14:48<08:11, 15.92it/s]
Running loglikelihood requests:  61%|██████▏   | 12313/20084 [14:52<08:08, 15.91it/s]
Running loglikelihood requests:  62%|██████▏   | 12370/20084 [14:56<08:04, 15.91it/s]
Running loglikelihood requests:  62%|██████▏   | 12427/20084 [14:59<08:00, 15.93it/s]
Running loglikelihood requests:  62%|██████▏   | 12484/20084 [15:03<07:57, 15.93it/s]
Running loglikelihood requests:  62%|██████▏   | 12541/20084 [15:06<07:53, 15.94it/s]
Running loglikelihood requests:  63%|██████▎   | 12598/20084 [15:10<07:49, 15.95it/s]
Running loglikelihood requests:  63%|██████▎   | 12655/20084 [15:14<07:45, 15.95it/s]
Running loglikelihood requests:  63%|██████▎   | 12712/20084 [15:17<07:40, 16.00it/s]
Running loglikelihood requests:  64%|██████▎   | 12769/20084 [15:21<07:36, 16.04it/s]
Running loglikelihood requests:  64%|██████▍   | 12826/20084 [15:24<07:31, 16.07it/s]
Running loglikelihood requests:  64%|██████▍   | 12883/20084 [15:28<07:27, 16.10it/s]
Running loglikelihood requests:  64%|██████▍   | 12940/20084 [15:31<07:23, 16.12it/s]
Running loglikelihood requests:  65%|██████▍   | 12997/20084 [15:35<07:20, 16.11it/s]
Running loglikelihood requests:  65%|██████▍   | 13054/20084 [15:38<07:17, 16.08it/s]
Running loglikelihood requests:  65%|██████▌   | 13111/20084 [15:42<07:12, 16.12it/s]
Running loglikelihood requests:  66%|██████▌   | 13168/20084 [15:45<07:07, 16.16it/s]
Running loglikelihood requests:  66%|██████▌   | 13225/20084 [15:49<07:03, 16.18it/s]
Running loglikelihood requests:  66%|██████▌   | 13282/20084 [15:52<06:59, 16.20it/s]
Running loglikelihood requests:  66%|██████▋   | 13339/20084 [15:56<06:55, 16.22it/s]
Running loglikelihood requests:  67%|██████▋   | 13396/20084 [15:59<06:51, 16.24it/s]
Running loglikelihood requests:  67%|██████▋   | 13453/20084 [16:03<06:47, 16.26it/s]
Running loglikelihood requests:  67%|██████▋   | 13510/20084 [16:06<06:43, 16.28it/s]
Running loglikelihood requests:  68%|██████▊   | 13567/20084 [16:10<06:40, 16.28it/s]
Running loglikelihood requests:  68%|██████▊   | 13624/20084 [16:13<06:37, 16.27it/s]
Running loglikelihood requests:  68%|██████▊   | 13681/20084 [16:17<06:33, 16.26it/s]
Running loglikelihood requests:  68%|██████▊   | 13738/20084 [16:20<06:30, 16.26it/s]
Running loglikelihood requests:  69%|██████▊   | 13795/20084 [16:24<06:26, 16.27it/s]
Running loglikelihood requests:  69%|██████▉   | 13852/20084 [16:27<06:22, 16.27it/s]
Running loglikelihood requests:  69%|██████▉   | 13909/20084 [16:31<06:19, 16.28it/s]
Running loglikelihood requests:  70%|██████▉   | 13966/20084 [16:34<06:14, 16.33it/s]
Running loglikelihood requests:  70%|██████▉   | 14023/20084 [16:38<06:10, 16.36it/s]
Running loglikelihood requests:  70%|███████   | 14080/20084 [16:41<06:06, 16.39it/s]
Running loglikelihood requests:  70%|███████   | 14137/20084 [16:45<06:02, 16.41it/s]
Running loglikelihood requests:  71%|███████   | 14194/20084 [16:48<05:58, 16.45it/s]
Running loglikelihood requests:  71%|███████   | 14251/20084 [16:52<05:54, 16.47it/s]
Running loglikelihood requests:  71%|███████   | 14308/20084 [16:55<05:49, 16.51it/s]
Running loglikelihood requests:  72%|███████▏  | 14365/20084 [16:58<05:45, 16.53it/s]
Running loglikelihood requests:  72%|███████▏  | 14422/20084 [17:02<05:42, 16.54it/s]
Running loglikelihood requests:  72%|███████▏  | 14479/20084 [17:05<05:38, 16.55it/s]
Running loglikelihood requests:  72%|███████▏  | 14536/20084 [17:09<05:34, 16.57it/s]
Running loglikelihood requests:  73%|███████▎  | 14593/20084 [17:12<05:31, 16.58it/s]
Running loglikelihood requests:  73%|███████▎  | 14650/20084 [17:16<05:27, 16.60it/s]
Running loglikelihood requests:  73%|███████▎  | 14707/20084 [17:19<05:24, 16.58it/s]
Running loglikelihood requests:  74%|███████▎  | 14764/20084 [17:23<05:21, 16.56it/s]
Running loglikelihood requests:  74%|███████▍  | 14821/20084 [17:26<05:17, 16.57it/s]
Running loglikelihood requests:  74%|███████▍  | 14878/20084 [17:29<05:14, 16.58it/s]
Running loglikelihood requests:  74%|███████▍  | 14935/20084 [17:33<05:10, 16.59it/s]
Running loglikelihood requests:  75%|███████▍  | 14992/20084 [17:36<05:06, 16.60it/s]
Running loglikelihood requests:  75%|███████▍  | 15049/20084 [17:40<05:03, 16.61it/s]
Running loglikelihood requests:  75%|███████▌  | 15106/20084 [17:43<04:59, 16.65it/s]
Running loglikelihood requests:  75%|███████▌  | 15163/20084 [17:46<04:54, 16.71it/s]
Running loglikelihood requests:  76%|███████▌  | 15220/20084 [17:50<04:50, 16.73it/s]
Running loglikelihood requests:  76%|███████▌  | 15277/20084 [17:53<04:46, 16.77it/s]
Running loglikelihood requests:  76%|███████▋  | 15334/20084 [17:57<04:42, 16.79it/s]
Running loglikelihood requests:  77%|███████▋  | 15391/20084 [18:00<04:39, 16.81it/s]
Running loglikelihood requests:  77%|███████▋  | 15448/20084 [18:03<04:35, 16.84it/s]
Running loglikelihood requests:  77%|███████▋  | 15505/20084 [18:07<04:31, 16.85it/s]
Running loglikelihood requests:  77%|███████▋  | 15562/20084 [18:10<04:27, 16.87it/s]
Running loglikelihood requests:  78%|███████▊  | 15619/20084 [18:14<04:24, 16.89it/s]
Running loglikelihood requests:  78%|███████▊  | 15676/20084 [18:17<04:20, 16.90it/s]
Running loglikelihood requests:  78%|███████▊  | 15733/20084 [18:20<04:17, 16.92it/s]
Running loglikelihood requests:  79%|███████▊  | 15790/20084 [18:24<04:13, 16.97it/s]
Running loglikelihood requests:  79%|███████▉  | 15847/20084 [18:27<04:09, 17.00it/s]
Running loglikelihood requests:  79%|███████▉  | 15904/20084 [18:30<04:05, 17.02it/s]
Running loglikelihood requests:  79%|███████▉  | 15961/20084 [18:34<04:02, 17.02it/s]
Running loglikelihood requests:  80%|███████▉  | 16018/20084 [18:37<03:59, 17.01it/s]
Running loglikelihood requests:  80%|████████  | 16075/20084 [18:40<03:55, 16.99it/s]
Running loglikelihood requests:  80%|████████  | 16132/20084 [18:44<03:52, 17.00it/s]
Running loglikelihood requests:  81%|████████  | 16189/20084 [18:47<03:48, 17.05it/s]
Running loglikelihood requests:  81%|████████  | 16246/20084 [18:50<03:44, 17.09it/s]
Running loglikelihood requests:  81%|████████  | 16303/20084 [18:54<03:40, 17.15it/s]
Running loglikelihood requests:  81%|████████▏ | 16360/20084 [18:57<03:36, 17.18it/s]
Running loglikelihood requests:  82%|████████▏ | 16417/20084 [19:00<03:33, 17.21it/s]
Running loglikelihood requests:  82%|████████▏ | 16474/20084 [19:04<03:29, 17.24it/s]
Running loglikelihood requests:  82%|████████▏ | 16531/20084 [19:07<03:25, 17.27it/s]
Running loglikelihood requests:  83%|████████▎ | 16588/20084 [19:10<03:22, 17.29it/s]
Running loglikelihood requests:  83%|████████▎ | 16645/20084 [19:13<03:18, 17.32it/s]
Running loglikelihood requests:  83%|████████▎ | 16702/20084 [19:17<03:14, 17.35it/s]
Running loglikelihood requests:  83%|████████▎ | 16759/20084 [19:20<03:11, 17.37it/s]
Running loglikelihood requests:  84%|████████▎ | 16816/20084 [19:23<03:07, 17.39it/s]
Running loglikelihood requests:  84%|████████▍ | 16873/20084 [19:26<03:04, 17.39it/s]
Running loglikelihood requests:  84%|████████▍ | 16930/20084 [19:30<03:01, 17.37it/s]
Running loglikelihood requests:  85%|████████▍ | 16987/20084 [19:33<02:58, 17.37it/s]
Running loglikelihood requests:  85%|████████▍ | 17044/20084 [19:36<02:54, 17.37it/s]
Running loglikelihood requests:  85%|████████▌ | 17101/20084 [19:40<02:51, 17.41it/s]
Running loglikelihood requests:  85%|████████▌ | 17158/20084 [19:43<02:47, 17.48it/s]
Running loglikelihood requests:  86%|████████▌ | 17215/20084 [19:46<02:43, 17.52it/s]
Running loglikelihood requests:  86%|████████▌ | 17272/20084 [19:49<02:40, 17.56it/s]
Running loglikelihood requests:  86%|████████▋ | 17329/20084 [19:52<02:36, 17.58it/s]
Running loglikelihood requests:  87%|████████▋ | 17386/20084 [19:56<02:33, 17.59it/s]
Running loglikelihood requests:  87%|████████▋ | 17443/20084 [19:59<02:29, 17.63it/s]
Running loglikelihood requests:  87%|████████▋ | 17500/20084 [20:02<02:26, 17.66it/s]
Running loglikelihood requests:  87%|████████▋ | 17557/20084 [20:05<02:22, 17.68it/s]
Running loglikelihood requests:  88%|████████▊ | 17614/20084 [20:09<02:19, 17.72it/s]
Running loglikelihood requests:  88%|████████▊ | 17671/20084 [20:12<02:15, 17.75it/s]
Running loglikelihood requests:  88%|████████▊ | 17728/20084 [20:15<02:12, 17.78it/s]
Running loglikelihood requests:  89%|████████▊ | 17785/20084 [20:18<02:08, 17.83it/s]
Running loglikelihood requests:  89%|████████▉ | 17842/20084 [20:21<02:05, 17.88it/s]
Running loglikelihood requests:  89%|████████▉ | 17899/20084 [20:24<02:01, 17.91it/s]
Running loglikelihood requests:  89%|████████▉ | 17956/20084 [20:28<01:58, 17.95it/s]
Running loglikelihood requests:  90%|████████▉ | 18013/20084 [20:31<01:55, 17.98it/s]
Running loglikelihood requests:  90%|████████▉ | 18070/20084 [20:34<01:51, 17.99it/s]
Running loglikelihood requests:  90%|█████████ | 18127/20084 [20:37<01:48, 18.00it/s]
Running loglikelihood requests:  91%|█████████ | 18184/20084 [20:40<01:45, 18.05it/s]
Running loglikelihood requests:  91%|█████████ | 18241/20084 [20:43<01:41, 18.07it/s]
Running loglikelihood requests:  91%|█████████ | 18298/20084 [20:47<01:38, 18.09it/s]
Running loglikelihood requests:  91%|█████████▏| 18355/20084 [20:50<01:35, 18.14it/s]
Running loglikelihood requests:  92%|█████████▏| 18412/20084 [20:53<01:31, 18.21it/s]
Running loglikelihood requests:  92%|█████████▏| 18469/20084 [20:56<01:28, 18.23it/s]
Running loglikelihood requests:  92%|█████████▏| 18526/20084 [20:59<01:25, 18.30it/s]
Running loglikelihood requests:  93%|█████████▎| 18583/20084 [21:02<01:21, 18.34it/s]
Running loglikelihood requests:  93%|█████████▎| 18640/20084 [21:05<01:18, 18.36it/s]
Running loglikelihood requests:  93%|█████████▎| 18697/20084 [21:08<01:15, 18.44it/s]
Running loglikelihood requests:  93%|█████████▎| 18754/20084 [21:11<01:11, 18.48it/s]
Running loglikelihood requests:  94%|█████████▎| 18811/20084 [21:14<01:08, 18.56it/s]
Running loglikelihood requests:  94%|█████████▍| 18868/20084 [21:17<01:05, 18.63it/s]
Running loglikelihood requests:  94%|█████████▍| 18925/20084 [21:20<01:01, 18.72it/s]
Running loglikelihood requests:  95%|█████████▍| 18982/20084 [21:23<00:58, 18.77it/s]
Running loglikelihood requests:  95%|█████████▍| 19039/20084 [21:26<00:55, 18.82it/s]
Running loglikelihood requests:  95%|█████████▌| 19096/20084 [21:29<00:52, 18.88it/s]
Running loglikelihood requests:  95%|█████████▌| 19153/20084 [21:32<00:49, 18.97it/s]
Running loglikelihood requests:  96%|█████████▌| 19210/20084 [21:35<00:45, 19.03it/s]
Running loglikelihood requests:  96%|█████████▌| 19267/20084 [21:38<00:42, 19.14it/s]
Running loglikelihood requests:  96%|█████████▌| 19324/20084 [21:41<00:39, 19.21it/s]
Running loglikelihood requests:  96%|█████████▋| 19381/20084 [21:44<00:36, 19.27it/s]
Running loglikelihood requests:  97%|█████████▋| 19438/20084 [21:47<00:33, 19.33it/s]
Running loglikelihood requests:  97%|█████████▋| 19495/20084 [21:50<00:30, 19.43it/s]
Running loglikelihood requests:  97%|█████████▋| 19552/20084 [21:53<00:27, 19.52it/s]
Running loglikelihood requests:  98%|█████████▊| 19609/20084 [21:56<00:24, 19.63it/s]
Running loglikelihood requests:  98%|█████████▊| 19666/20084 [21:59<00:21, 19.72it/s]
Running loglikelihood requests:  98%|█████████▊| 19723/20084 [22:01<00:18, 19.88it/s]
Running loglikelihood requests:  98%|█████████▊| 19780/20084 [22:04<00:15, 20.06it/s]
Running loglikelihood requests:  99%|█████████▉| 19837/20084 [22:07<00:12, 20.30it/s]
Running loglikelihood requests:  99%|█████████▉| 19894/20084 [22:10<00:09, 20.53it/s]
Running loglikelihood requests:  99%|█████████▉| 19951/20084 [22:12<00:06, 20.82it/s]
Running loglikelihood requests: 100%|█████████▉| 20008/20084 [22:15<00:03, 21.18it/s]
Running loglikelihood requests: 100%|█████████▉| 20065/20084 [22:16<00:00, 26.63it/s]
Running loglikelihood requests: 100%|██████████| 20084/20084 [22:16<00:00, 15.03it/s]
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 00/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 01/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 02/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 03/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 04/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 05/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 06/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 07/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 08/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 09/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 10/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 11/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 12/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 13/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 14/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 15/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 16/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 17/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 18/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 19/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 20/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 21/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 22/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 23/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 24/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 25/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 26/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 27/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 28/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 29/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 30/1 : 1[7] -> 0[6] via P2P/CUMEM/read
n136-128-154:2121333:2123507 [1] NCCL INFO Channel 31/1 : 1[7] -> 0[6] via P2P/CUMEM/read
fatal: detected dubious ownership in repository at '/mnt/bn/life-mllm/users/cxr/quantization'
To add an exception for this directory, call:

	git config --global --add safe.directory /mnt/bn/life-mllm/users/cxr/quantization
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2121333:2121743 [1] NCCL INFO misc/socket.cc:915 -> 3
2025-12-09:03:11:30 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg), gen_kwargs: (None), limit: None, num_fewshot: 10, batch_size: auto (57)
|  Tasks  |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|hellaswag|      1|none  |    10|acc     |↑  |0.4808|±  |0.0050|
|         |       |none  |    10|acc_norm|↑  |0.6582|±  |0.0047|

[rank0]:[W1209 03:11:31.613980955 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2121332:2121745 [0] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:64 -> 3
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:81 -> 3
n136-128-154:2121332:2123566 [0] NCCL INFO misc/socket.cc:863 -> 3
n136-128-154:2121333:2121743 [1] NCCL INFO misc/socket.cc:915 -> 3
n136-128-154:2121333:2123511 [1] NCCL INFO comm 0xec85c30 rank 1 nranks 2 cudaDev 1 busId c9000 - Abort COMPLETE
n136-128-154:2121332:2123566 [0] NCCL INFO comm 0x46976f30 rank 0 nranks 2 cudaDev 0 busId c5000 - Abort COMPLETE
任务 hellaswag 评估完成！
Execution time: 34353.5 seconds
python: can't open file '/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/main_fg.py': [Errno 2] No such file or directory

==================================================
开始评估：任务=winogrande | 少样本数=5 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/winogrande.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:12:57 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-09:03:12:57 INFO     [__main__:440] Selected Tasks: ['winogrande']
2025-12-09:03:12:57 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:12:57 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:12:57 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:12:57 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:12:59 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:12:59.027525201 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
W1209 03:13:01.658000 2123579 site-packages/torch/distributed/elastic/multiprocessing/api.py:908] Sending process 2123629 closing signal SIGTERM
E1209 03:13:01.693000 2123579 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 1 (pid: 2123630) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:13:01
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2123630)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 winogrande 执行失败！

==================================================
开始评估：任务=gsm8k | 少样本数=4 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/gsm8k.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:14:18 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-09:03:14:18 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:14:18 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:14:18 INFO     [__main__:440] Selected Tasks: ['gsm8k']
2025-12-09:03:14:18 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:14:18 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:14:20 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:14:20.786197923 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
E1209 03:14:22.623000 2123829 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 0 (pid: 2123880) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
[1]:
  time      : 2025-12-09_03:14:22
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2123881)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:14:22
  host      : n136-128-154.byted.org
  rank      : 0 (local_rank: 0)
  exitcode  : 1 (pid: 2123880)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 gsm8k 执行失败！

==================================================
开始评估：任务=boolq | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/boolq.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:15:42 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-09:03:15:42 INFO     [__main__:440] Selected Tasks: ['boolq']
2025-12-09:03:15:42 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:15:42 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:15:42 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:15:42 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
2025-12-09:03:15:44 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:15:44.908560853 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
W1209 03:15:46.360000 2124043 site-packages/torch/distributed/elastic/multiprocessing/api.py:908] Sending process 2124095 closing signal SIGTERM
E1209 03:15:46.425000 2124043 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 1 (pid: 2124096) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:15:46
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2124096)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 boolq 执行失败！

==================================================
开始评估：任务=arc_challenge | 少样本数=25 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/arc_challenge.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:17:06 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-09:03:17:06 INFO     [__main__:440] Selected Tasks: ['arc_challenge']
2025-12-09:03:17:06 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:17:06 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:17:06 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:17:06 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
2025-12-09:03:17:07 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:17:08.627493384 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
W1209 03:17:10.309000 2124261 site-packages/torch/distributed/elastic/multiprocessing/api.py:908] Sending process 2124312 closing signal SIGTERM
E1209 03:17:10.344000 2124261 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 0 (pid: 2124311) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:17:10
  host      : n136-128-154.byted.org
  rank      : 0 (local_rank: 0)
  exitcode  : 1 (pid: 2124311)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 arc_challenge 执行失败！

==================================================
开始评估：任务=truthfulqa_mc1 | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/truthfulqa_mc1.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:18:31 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-09:03:18:31 INFO     [__main__:440] Selected Tasks: ['truthfulqa_mc1']
2025-12-09:03:18:31 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:18:31 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:18:31 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:18:31 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:18:32 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:18:33.427657854 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
W1209 03:18:35.243000 2124506 site-packages/torch/distributed/elastic/multiprocessing/api.py:908] Sending process 2124555 closing signal SIGTERM
E1209 03:18:35.261000 2124506 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 1 (pid: 2124556) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:18:35
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2124556)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 truthfulqa_mc1 执行失败！

==================================================
开始评估：任务=piqa | 少样本数=0 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/piqa.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:19:55 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-09:03:19:55 INFO     [__main__:440] Selected Tasks: ['piqa']
2025-12-09:03:19:55 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:19:55 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:19:55 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:19:55 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:19:56 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:19:57.410411438 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
E1209 03:19:59.189000 2124723 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 0 (pid: 2124772) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
[1]:
  time      : 2025-12-09_03:19:59
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2124773)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:19:59
  host      : n136-128-154.byted.org
  rank      : 0 (local_rank: 0)
  exitcode  : 1 (pid: 2124772)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 piqa 执行失败！

==================================================
开始评估：任务=hellaswag | 少样本数=10 | 模型=Qwen2.5-7B-quantization-fg
输出路径：results2/Qwen2.5-7B-quantization-fg/fg4/hellaswag.json
==================================================
The following values were not passed to `accelerate launch` and had defaults used instead:
		More than one GPU was found, enabling multi-GPU training.
		If this was unintended please pass in `--num_processes=1`.
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-12-09:03:21:21 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-09:03:21:21 INFO     [__main__:440] Selected Tasks: ['hellaswag']
2025-12-09:03:21:21 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:21:21 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:21:21 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-12-09:03:21:21 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'}
2025-12-09:03:21:22 WARNING  [accelerate.utils.other:513] Detected kernel version 5.4.143, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank1]:     hf_hub_download(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank1]:     resolved_config_file = cached_file(
[rank1]:                            ^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank1]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank1]:     resolved_files = [
[rank1]:                      ^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank1]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank1]:     resolved_file = try_to_load_from_cache(
[rank1]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank1]:     validate_repo_id(arg_value)
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank1]:     raise HFValidationError(
[rank1]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank1]: During handling of the above exception, another exception occurred:

[rank1]: Traceback (most recent call last):
[rank1]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank1]:   File "<frozen runpy>", line 88, in _run_code
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank1]:     cli_evaluate()
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank1]:     results = evaluator.simple_evaluate(
[rank1]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank1]:     return fn(*args, **kwargs)
[rank1]:            ^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank1]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank1]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank1]:     return cls(**args, **args2)
[rank1]:            ^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank1]:     self._get_config(
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank1]:     self._config = transformers.AutoConfig.from_pretrained(
[rank1]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank1]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank1]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank1]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank1]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank1]:     raise OSError(
[rank1]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 479, in cached_files
[rank0]:     hf_hub_download(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
[rank0]:     resolved_config_file = cached_file(
[rank0]:                            ^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 322, in cached_file
[rank0]:     file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 531, in cached_files
[rank0]:     resolved_files = [
[rank0]:                      ^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 532, in <listcomp>
[rank0]:     _get_cache_file_to_return(path_or_repo_id, filename, cache_dir, revision, repo_type)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/utils/hub.py", line 143, in _get_cache_file_to_return
[rank0]:     resolved_file = try_to_load_from_cache(
[rank0]:                     ^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 106, in _inner_fn
[rank0]:     validate_repo_id(arg_value)
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 154, in validate_repo_id
[rank0]:     raise HFValidationError(
[rank0]: huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. Use `repo_type` argument if needed.

[rank0]: During handling of the above exception, another exception occurred:

[rank0]: Traceback (most recent call last):
[rank0]:   File "<frozen runpy>", line 198, in _run_module_as_main
[rank0]:   File "<frozen runpy>", line 88, in _run_code
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 530, in <module>
[rank0]:     cli_evaluate()
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/__main__.py", line 449, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/utils.py", line 439, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/evaluator.py", line 230, in simple_evaluate
[rank0]:     lm = lm_eval.api.registry.get_model(model).create_from_arg_string(
[rank0]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/api/model.py", line 151, in create_from_arg_string
[rank0]:     return cls(**args, **args2)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 168, in __init__
[rank0]:     self._get_config(
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/quantization/lm-evaluation-harness/lm_eval/models/huggingface.py", line 527, in _get_config
[rank0]:     self._config = transformers.AutoConfig.from_pretrained(
[rank0]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
[rank0]:     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
[rank0]:     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
[rank0]:                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/transformers/configuration_utils.py", line 744, in _get_config_dict
[rank0]:     raise OSError(
[rank0]: OSError: Can't load the configuration of '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '/mnt/bn/life-mllm/users/cxr/quantization/models/Qwen2.5-7B-quantization-fg' is the correct path to a directory containing a config.json file
[rank0]:[W1209 03:21:23.252238985 ProcessGroupNCCL.cpp:1524] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
W1209 03:21:25.063000 2124940 site-packages/torch/distributed/elastic/multiprocessing/api.py:908] Sending process 2124990 closing signal SIGTERM
E1209 03:21:25.096000 2124940 site-packages/torch/distributed/elastic/multiprocessing/api.py:882] failed (exitcode: 1) local_rank: 1 (pid: 2124991) of binary: /mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/python
Traceback (most recent call last):
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/bin/accelerate", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/accelerate_cli.py", line 50, in main
    args.func(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 1272, in launch_command
    multi_gpu_launcher(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/accelerate/commands/launch.py", line 899, in multi_gpu_launcher
    distrib_run.run(args)
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/run.py", line 927, in run
    elastic_launch(
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 156, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/bn/life-mllm/users/cxr/zhy/miniconda3/envs/lm-evaluation-harness/lib/python3.11/site-packages/torch/distributed/launcher/api.py", line 293, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
lm_eval FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2025-12-09_03:21:25
  host      : n136-128-154.byted.org
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 2124991)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
警告：任务 hellaswag 执行失败！
Execution time: 34944.2 seconds