paddlenlp
6 строк · 502.0 Байт
1job_id,mp_degree,sharding_degree,pp_degree,dp_degree,sharding_stage,micro_batch_size,vpp_degree,use_recompute,recompute_granularity,acc_steps,global_batch_size,exec_time,interval_samples_per_second,max_mem_usage,error_info
25,4,2,1,1,2,4,1,True,full,1,8,72.38,4.74138,26130,
32,4,1,2,1,1,8,1,True,full,1,8,57.35,2.58279,27722,
41,8,1,1,1,2,1,1,True,full,8,8,55.32,2.3064,19050,
53,4,1,2,1,1,8,1,True,full_attn,1,8,45.29,,OOM,['Out of memory']
64,4,1,2,1,1,4,1,True,full_attn,2,8,55.15,,OOM,['Out of memory']