execution.log

2021-03-08 08:40:08.648464: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-03-08 08:40:08.648519: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Env init done

Env init done

2021-03-08 08:40:11.857681: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory
2021-03-08 08:40:11.857788: W tensorflow/stream_executor/cuda/cuda_driver.cc:326] failed call to cuInit: UNKNOWN ERROR (303)
2021-03-08 08:40:11.857821: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (phylo): /proc/driver/nvidia/version does not exist
2021-03-08 08:40:11.859150: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
-0.79 max: [6.6666665]
WARNING:tensorflow:From /home/panna/.local/lib/python3.6/site-packages/tensorflow/python/autograph/impl/api.py:382: ReplayBuffer.get_next (from tf_agents.replay_buffers.replay_buffer) is deprecated and will be removed in a future version.
Instructions for updating:
Use `as_dataset(..., single_deterministic_pass=False) instead.
2021-03-08 08:40:17.186217: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:176] None of the MLIR Optimization Passes are enabled (registered 2)
2021-03-08 08:40:17.188347: I tensorflow/core/platform/profile_utils/cpu_utils.cc:114] CPU Frequency: 2299995000 Hz
08:40:18.780764
WARNING:tensorflow:From /home/panna/.local/lib/python3.6/site-packages/tensorflow/python/util/dispatch.py:206: calling foldr_v2 (from tensorflow.python.ops.functional_ops) with back_prop=False is deprecated and will be removed in a future version.
Instructions for updating:
back_prop=False is deprecated. Consider using tf.stop_gradient instead.
Instead of:
results = tf.foldr(fn, elems, back_prop=False)
Use:
results = tf.nest.map_structure(tf.stop_gradient, tf.foldr(fn, elems))
step = 250: loss = 0.05002320557832718
step = 500: loss = 0.34140545129776
step = 750: loss = 0.2333659827709198
step = 1000: loss = 0.4673877954483032
step = 1000: Average Return = 0.5866666436195374 , Max Return = [6.6666665]
step = 1250: loss = 0.2031446099281311
step = 1500: loss = 0.2340516746044159
step = 1750: loss = 0.450368732213974
step = 2000: loss = 1.0548934936523438
step = 2000: Average Return = 1.2333338260650635 , Max Return = [6.6666665]
step = 2250: loss = 0.4321872591972351
step = 2500: loss = 0.6815603971481323
step = 2750: loss = 0.9786102771759033
step = 3000: loss = 1.26641845703125
step = 3000: Average Return = 1.9133334159851074 , Max Return = [6.6666665]
step = 3250: loss = 0.6741860508918762
step = 3500: loss = 0.35717058181762695
step = 3750: loss = 2.096916437149048
step = 4000: loss = 1.169739007949829
step = 4000: Average Return = 1.7133331298828125 , Max Return = [10.]
step = 4250: loss = 0.5211189985275269
step = 4500: loss = 0.49491608142852783
step = 4750: loss = 0.41227030754089355
step = 5000: loss = 0.4588063657283783
step = 5000: Average Return = 1.1333335638046265 , Max Return = [10.]
step = 5250: loss = 0.2242075800895691
step = 5500: loss = 0.20814892649650574
step = 5750: loss = 0.2564168870449066
step = 6000: loss = 0.503656268119812
step = 6000: Average Return = 1.7799994945526123 , Max Return = [10.]
step = 6250: loss = 1.2204421758651733
step = 6500: loss = 0.6546468734741211
step = 6750: loss = 0.654392421245575
step = 7000: loss = 0.06462401896715164
step = 7000: Average Return = 2.4466657638549805 , Max Return = [6.6666665]
step = 7250: loss = 1.2447171211242676
step = 7500: loss = 0.6505082845687866
step = 7750: loss = 0.6289389133453369
step = 8000: loss = 0.7228125929832458
step = 8000: Average Return = 2.6666669845581055 , Max Return = [10.]
step = 8250: loss = 1.0051984786987305
step = 8500: loss = 0.3522628843784332
step = 8750: loss = 0.14667892456054688
step = 9000: loss = 0.35849103331565857
step = 9000: Average Return = 0.8000000715255737 , Max Return = [6.6666665]
step = 9250: loss = 0.7273366451263428
step = 9500: loss = 0.463484525680542
step = 9750: loss = 0.45974236726760864
step = 10000: loss = 0.38805443048477173
step = 10000: Average Return = 2.4666669368743896 , Max Return = [10.]
11:03:05.464798
[-1.0,0.58666664,1.2333338,1.9133334,1.7133331,1.1333336,1.7799995,2.4466658,2.666667,0.8000001,2.46666]
Env init done

Env init done

-0.85 max: [6.6666665]
11:03:11.463457
step = 250: loss = 0.2767345905303955
step = 500: loss = 1.4647908210754395
step = 750: loss = 1.300001621246338
step = 1000: loss = 1.7469286918640137
step = 1000: Average Return = 1.3666669130325317 , Max Return = [10.]
step = 1250: loss = 1.2664101123809814
step = 1500: loss = 0.972542405128479
step = 1750: loss = 0.5776553153991699
step = 2000: loss = 1.1180860996246338
step = 2000: Average Return = 2.299999475479126 , Max Return = [10.]
step = 2250: loss = 1.2556381225585938
step = 2500: loss = 1.5738643407821655
step = 2750: loss = 0.952377200126648
step = 3000: loss = 0.3295539319515228
step = 3000: Average Return = 4.733333587646484 , Max Return = [10.]
step = 3250: loss = 0.4186340868473053
step = 3500: loss = 0.6309987902641296
step = 3750: loss = 1.288682460784912
step = 4000: loss = 1.5911448001861572
step = 4000: Average Return = 4.766667366027832 , Max Return = [10.]
step = 4250: loss = 1.1398624181747437
step = 4500: loss = 1.9380764961242676
step = 4750: loss = 0.7733728885650635
step = 5000: loss = 1.5966073274612427
step = 5000: Average Return = 4.366666793823242 , Max Return = [10.]
step = 5250: loss = 0.9867565631866455
step = 5500: loss = 1.0977829694747925
step = 5750: loss = 0.921516478061676
step = 6000: loss = 2.0307626724243164
step = 6000: Average Return = 4.166666507720947 , Max Return = [10.]
step = 6250: loss = 0.750316321849823
step = 6500: loss = 0.8605191111564636
step = 6750: loss = 0.3590172827243805
step = 7000: loss = 0.3722341060638428
step = 7000: Average Return = 6.0333333015441895 , Max Return = [10.]
step = 7250: loss = 2.1407976150512695
step = 7500: loss = 0.5337360501289368
step = 7750: loss = 1.238670825958252
step = 8000: loss = 0.4027865529060364
step = 8000: Average Return = 5.046667575836182 , Max Return = [10.]
step = 8250: loss = 0.6609500646591187
step = 8500: loss = 1.8798456192016602
step = 8750: loss = 0.4763595461845398
step = 9000: loss = 0.888209879398346
step = 9000: Average Return = 5.69999885559082 , Max Return = [10.]
step = 9250: loss = 1.3424888849258423
step = 9500: loss = 0.8961889743804932
step = 9750: loss = 0.9222241640090942
step = 10000: loss = 1.30999755859375
step = 10000: Average Return = 5.366666793823242 , Max Return = [10.]
13:27:13.533711
[-1.0,1.3666669,2.2999995,4.7333336,4.7666674,4.366667,4.1666665,6.0333333,5.0466676,5.699999,5.36666]
Env init done

Env init done

-0.8933334 max: [3.3333333]
13:27:19.717002
step = 250: loss = 0.24023084342479706
step = 500: loss = 0.16963031888008118
step = 750: loss = 0.2877616882324219
step = 1000: loss = 0.29541581869125366
step = 1000: Average Return = 2.3799996376037598 , Max Return = [10.]
step = 1250: loss = 1.0639243125915527
step = 1500: loss = 1.79276704788208
step = 1750: loss = 0.7998049259185791
step = 2000: loss = 0.7041166424751282
step = 2000: Average Return = 4.000000953674316 , Max Return = [10.]
step = 2250: loss = 2.6689882278442383
step = 2500: loss = 1.5168529748916626
step = 2750: loss = 1.038845419883728
step = 3000: loss = 1.153487205505371
step = 3000: Average Return = 5.4333295822143555 , Max Return = [10.]
step = 3250: loss = 0.9075444936752319
step = 3500: loss = 0.8624371290206909
step = 3750: loss = 1.2587206363677979
step = 4000: loss = 1.3234628438949585
step = 4000: Average Return = 6.266666412353516 , Max Return = [10.]
step = 4250: loss = 0.8783647418022156
step = 4500: loss = 0.6714491844177246
step = 4750: loss = 0.7765015363693237
step = 5000: loss = 0.842681884765625
step = 5000: Average Return = 6.599999904632568 , Max Return = [10.]
step = 5250: loss = 1.39273202419281
step = 5500: loss = 0.4411082863807678
step = 5750: loss = 0.7826348543167114
step = 6000: loss = 0.9544785022735596
step = 6000: Average Return = 6.4666666984558105 , Max Return = [10.]
step = 6250: loss = 1.4188833236694336
step = 6500: loss = 1.5583076477050781
step = 6750: loss = 0.8621350526809692
step = 7000: loss = 2.176117420196533
step = 7000: Average Return = 6.59999942779541 , Max Return = [10.]
step = 7250: loss = 0.6923227310180664
step = 7500: loss = 0.9701268672943115
step = 7750: loss = 0.7935593724250793
step = 8000: loss = 1.0581514835357666
step = 8000: Average Return = 5.333332538604736 , Max Return = [10.]
step = 8250: loss = 0.5569676160812378
step = 8500: loss = 1.258719563484192
step = 8750: loss = 0.819268524646759
step = 9000: loss = 0.9267340302467346
step = 9000: Average Return = 5.679999828338623 , Max Return = [10.]
step = 9250: loss = 1.8362185955047607
step = 9500: loss = 0.8901209831237793
step = 9750: loss = 0.3501448631286621
step = 10000: loss = 0.8270381689071655
step = 10000: Average Return = 5.899998664855957 , Max Return = [10.]
15:52:18.985329
[-1.0,2.3799996,4.000001,5.4333296,6.2666664,6.6,6.4666667,6.5999994,5.3333325,5.68,5.899998]
Env init done

Env init done

-0.94 max: 0.0
15:52:47.775880
step = 250: loss = 0.13269229233264923
step = 500: loss = 2.5572433471679688
step = 750: loss = 1.5515155792236328
step = 1000: loss = 0.9510169625282288
step = 1000: Average Return = 3.7000012397766113 , Max Return = [10.]
step = 1250: loss = 1.6508159637451172
step = 1500: loss = 1.726975440979004
step = 1750: loss = 1.7049555778503418
step = 2000: loss = 1.119105339050293
step = 2000: Average Return = 5.69999885559082 , Max Return = [10.]
step = 2250: loss = 1.4837725162506104
step = 2500: loss = 1.8610780239105225
step = 2750: loss = 2.2704885005950928
step = 3000: loss = 1.251682162284851
step = 3000: Average Return = 6.833334445953369 , Max Return = [10.]
step = 3250: loss = 1.0407384634017944
step = 3500: loss = 1.039856195449829
step = 3750: loss = 1.443272590637207
step = 4000: loss = 1.9327020645141602
step = 4000: Average Return = 5.799998760223389 , Max Return = [10.]
step = 4250: loss = 0.6760305762290955
step = 4500: loss = 1.3602712154388428
step = 4750: loss = 0.9655570387840271
step = 5000: loss = 1.16108238697052
step = 5000: Average Return = 6.433332443237305 , Max Return = [10.]
step = 5250: loss = 0.9161651134490967
step = 5500: loss = 1.0963587760925293
step = 5750: loss = 0.7293415069580078
step = 6000: loss = 0.9612120389938354
step = 6000: Average Return = 6.199998378753662 , Max Return = [10.]
step = 6250: loss = 2.006347894668579
step = 6500: loss = 1.271870732307434
step = 6750: loss = 1.3389642238616943
step = 7000: loss = 0.913934588432312
step = 7000: Average Return = 7.133335113525391 , Max Return = [10.]
step = 7250: loss = 2.060971260070801
step = 7500: loss = 1.0888835191726685
step = 7750: loss = 1.7452576160430908
step = 8000: loss = 0.8552207946777344
step = 8000: Average Return = 6.466665744781494 , Max Return = [10.]
step = 8250: loss = 1.772351861000061
step = 8500: loss = 1.0336304903030396
step = 8750: loss = 1.4157230854034424
step = 9000: loss = 0.5241016149520874
step = 9000: Average Return = 7.766668796539307 , Max Return = [10.]
step = 9250: loss = 1.881049394607544
step = 9500: loss = 1.263392686843872
step = 9750: loss = 1.0739028453826904
step = 10000: loss = 1.2079906463623047
step = 10000: Average Return = 6.4333319664001465 , Max Return = [10.]
18:18:03.885615
[-1.0,3.7000012,5.699999,6.8333344,5.7999988,6.4333324,6.1999984,7.133335,6.4666657,7.766669,6.43333]
Env init done

Env init done

-0.93333334 max: [3.3333333]
18:18:19.720056
step = 250: loss = 0.20429037511348724
step = 500: loss = 0.28736376762390137
step = 750: loss = 0.23765826225280762
step = 1000: loss = 0.32097506523132324
step = 1250: loss = 0.8859891295433044
step = 1500: loss = 0.6445247530937195
step = 1750: loss = 0.8082446455955505
step = 2000: loss = 0.37121111154556274
step = 2000: Average Return = 1.440000057220459 , Max Return = [10.]
step = 2250: loss = 0.0824584811925888
step = 2500: loss = 0.8423669338226318
step = 2750: loss = 0.2735166549682617
step = 3000: loss = 0.33731335401535034
step = 3250: loss = 0.2183823436498642
step = 3500: loss = 0.5766491889953613
step = 3750: loss = 0.05398193374276161
step = 4000: loss = 0.5444415807723999
step = 4000: Average Return = 1.7166677713394165 , Max Return = [10.]
step = 4250: loss = 0.5556185245513916
step = 4500: loss = 0.6980871558189392
step = 4750: loss = 0.9988212585449219
step = 5000: loss = 0.6671582460403442
step = 5250: loss = 0.7649472951889038
step = 5500: loss = 0.5337924957275391
step = 5750: loss = 0.8298157453536987
step = 6000: loss = 0.5502618551254272
step = 6000: Average Return = 1.3666669130325317 , Max Return = [10.]
step = 6250: loss = 0.7972943186759949
step = 6500: loss = 1.204728364944458
step = 6750: loss = 0.448628306388855
step = 7000: loss = 0.5473660826683044
step = 7250: loss = 0.5297995209693909
step = 7500: loss = 0.46717649698257446
step = 7750: loss = 0.5713541507720947
step = 8000: loss = 0.5213385820388794
step = 8000: Average Return = 1.766667366027832 , Max Return = [10.]
step = 8250: loss = 0.20148667693138123
step = 8500: loss = 0.7766113877296448
step = 8750: loss = 1.1434792280197144
step = 9000: loss = 1.0352274179458618
step = 9250: loss = 0.3671254813671112
step = 9500: loss = 0.5060466527938843
step = 9750: loss = 0.2071622908115387
step = 10000: loss = 0.6320611238479614
step = 10000: Average Return = 1.459999442100525 , Max Return = [6.6666665]
step = 10250: loss = 1.3074556589126587
step = 10500: loss = 0.6873796582221985
step = 10750: loss = 0.7725280523300171
step = 11000: loss = 1.7521049976348877
step = 11250: loss = 0.34143608808517456
step = 11500: loss = 0.394811749458313
step = 11750: loss = 1.3303232192993164
step = 12000: loss = 1.205603003501892
step = 12000: Average Return = 2.8566668033599854 , Max Return = [10.]
step = 12250: loss = 0.5006411671638489
step = 12500: loss = 0.8429521918296814
step = 12750: loss = 0.7890636324882507
step = 13000: loss = 1.1252052783966064
step = 13250: loss = 0.14436833560466766
step = 13500: loss = 1.2999271154403687
step = 13750: loss = 0.5532223582267761
step = 14000: loss = 0.616880476474762
step = 14000: Average Return = 2.6000008583068848 , Max Return = [10.]
step = 14250: loss = 0.7258633971214294
step = 14500: loss = 1.0502636432647705
step = 14750: loss = 1.0966925621032715
step = 15000: loss = 0.6505954265594482
step = 15250: loss = 1.2803590297698975
step = 15500: loss = 0.31356319785118103
step = 15750: loss = 1.2616504430770874
step = 16000: loss = 1.1511309146881104
step = 16000: Average Return = 1.6666667461395264 , Max Return = [10.]
step = 16250: loss = 0.4654921889305115
step = 16500: loss = 0.9716662764549255
step = 16750: loss = 0.7221649885177612
step = 17000: loss = 0.7529404759407043
step = 17250: loss = 1.236878752708435
step = 17500: loss = 1.0050129890441895
step = 17750: loss = 0.10234928876161575
step = 18000: loss = 1.074042558670044
step = 18000: Average Return = 1.6500000953674316 , Max Return = [10.]
step = 18250: loss = 0.39073795080184937
step = 18500: loss = 0.27855420112609863
step = 18750: loss = 0.9018405675888062
step = 19000: loss = 0.0979473888874054
step = 19250: loss = 1.069185733795166
step = 19500: loss = 0.2507420778274536
step = 19750: loss = 0.48329436779022217
step = 20000: loss = 0.31592893600463867
step = 20000: Average Return = 3.0499989986419678 , Max Return = [10.]
23:06:30.813783
[0.16166659,1.44,1.7166678,1.3666669,1.7666674,1.4599994,2.8566668,2.6000009,1.6666667,1.6500001,3.04999]
Env init done

Env init done

-0.87833333 max: [3.3333333]
23:06:38.380790
step = 250: loss = 0.36402902007102966
step = 500: loss = 1.704821228981018
step = 750: loss = 1.2215510606765747
step = 1000: loss = 1.3591500520706177
step = 1250: loss = 0.29267236590385437
step = 1500: loss = 0.8634306192398071
step = 1750: loss = 1.456955909729004
step = 2000: loss = 0.6574317216873169
step = 2000: Average Return = 3.266664981842041 , Max Return = [10.]
step = 2250: loss = 1.409839391708374
step = 2500: loss = 0.9837749600410461
step = 2750: loss = 0.4036138355731964
step = 3000: loss = 2.9150006771087646
step = 3250: loss = 1.4286397695541382
step = 3500: loss = 1.9597951173782349
step = 3750: loss = 0.9729163646697998
step = 4000: loss = 0.9156062602996826
step = 4000: Average Return = 4.166665554046631 , Max Return = [10.]
step = 4250: loss = 0.6780866384506226
step = 4500: loss = 0.7196153402328491
step = 4750: loss = 1.3663289546966553
step = 5000: loss = 1.6505787372589111
step = 5250: loss = 1.5129358768463135
step = 5500: loss = 1.2546136379241943
step = 5750: loss = 1.3494826555252075
step = 6000: loss = 0.9991614818572998
step = 6000: Average Return = 4.149998664855957 , Max Return = [10.]
step = 6250: loss = 1.6975147724151611
step = 6500: loss = 2.4522311687469482
step = 6750: loss = 1.4692113399505615
step = 7000: loss = 0.8174072504043579
step = 7250: loss = 0.5728964805603027
step = 7500: loss = 1.0579476356506348
step = 7750: loss = 0.35604315996170044
step = 8000: loss = 1.9559630155563354
step = 8000: Average Return = 4.500001907348633 , Max Return = [10.]
step = 8250: loss = 1.2773209810256958
step = 8500: loss = 0.7976764440536499
step = 8750: loss = 0.8844021558761597
step = 9000: loss = 1.064577341079712
step = 9250: loss = 0.5402304530143738
step = 9500: loss = 1.5444345474243164
step = 9750: loss = 0.4484555423259735
step = 10000: loss = 1.312760591506958
step = 10000: Average Return = 4.750001430511475 , Max Return = [10.]
step = 10250: loss = 1.6645638942718506
step = 10500: loss = 0.644810676574707
step = 10750: loss = 1.3506433963775635
step = 11000: loss = 0.738797664642334
step = 11250: loss = 1.6994272470474243
step = 11500: loss = 0.60289466381073
step = 11750: loss = 1.457413673400879
step = 12000: loss = 0.9924174547195435
step = 12000: Average Return = 4.766665458679199 , Max Return = [10.]
step = 12250: loss = 1.4732648134231567
step = 12500: loss = 0.6248756647109985
step = 12750: loss = 1.4413199424743652
step = 13000: loss = 1.3663407564163208
step = 13250: loss = 1.621224284172058
step = 13500: loss = 1.3468258380889893
step = 13750: loss = 0.748764157295227
step = 14000: loss = 1.0704174041748047
step = 14000: Average Return = 5.4666666984558105 , Max Return = [10.]
step = 14250: loss = 1.3587162494659424
step = 14500: loss = 0.3396352231502533
step = 14750: loss = 1.5064868927001953
step = 15000: loss = 1.1327307224273682
step = 15250: loss = 1.4573804140090942
step = 15500: loss = 0.7921531796455383
step = 15750: loss = 1.383971095085144
step = 16000: loss = 1.3433212041854858
step = 16000: Average Return = 3.849999189376831 , Max Return = [10.]
step = 16250: loss = 1.1946403980255127
step = 16500: loss = 1.4974879026412964
step = 16750: loss = 2.1958162784576416
step = 17000: loss = 1.522981882095337
step = 17250: loss = 0.7277896404266357
step = 17500: loss = 1.4846396446228027
step = 17750: loss = 0.9158337116241455
step = 18000: loss = 2.1394248008728027
step = 18000: Average Return = 4.400000095367432 , Max Return = [10.]
step = 18250: loss = 0.5425732731819153
step = 18500: loss = 0.6777477264404297
step = 18750: loss = 1.667750597000122
step = 19000: loss = 1.5582406520843506
step = 19250: loss = 0.3050576448440552
step = 19500: loss = 0.9446527361869812
step = 19750: loss = 0.5767049789428711
step = 20000: loss = 0.7294870615005493
step = 20000: Average Return = 3.666666269302368 , Max Return = [10.]
03:50:18.229299
[-0.98,3.266665,4.1666656,4.1499987,4.500002,4.7500014,4.7666655,5.4666667,3.8499992,4.4,3.666666]
Env init done

Env init done

-0.845 max: [6.6666665]
03:51:08.426621
step = 250: loss = 0.00721672922372818
step = 500: loss = 0.4496554732322693
step = 750: loss = 1.3461092710494995
step = 1000: loss = 0.7996984124183655
step = 1250: loss = 0.9401673078536987
step = 1500: loss = 1.5622949600219727
step = 1750: loss = 0.5674173831939697
step = 2000: loss = 0.9876878261566162
step = 2000: Average Return = 4.266661643981934 , Max Return = [10.]
step = 2250: loss = 2.0741419792175293
step = 2500: loss = 1.4587156772613525
step = 2750: loss = 1.255282998085022
step = 3000: loss = 1.6221791505813599
step = 3250: loss = 2.6992039680480957
step = 3500: loss = 1.2689790725708008
step = 3750: loss = 1.8243433237075806
step = 4000: loss = 2.441382646560669
step = 4000: Average Return = 6.083336353302002 , Max Return = [10.]
step = 4250: loss = 1.1368459463119507
step = 4500: loss = 0.7705471515655518
step = 4750: loss = 2.237320899963379
step = 5000: loss = 1.4811272621154785
step = 5250: loss = 2.03959321975708
step = 5500: loss = 1.0388059616088867
step = 5750: loss = 1.8503327369689941
step = 6000: loss = 0.6373528838157654
step = 6000: Average Return = 6.256669521331787 , Max Return = [10.]
step = 6250: loss = 1.9099981784820557
step = 6500: loss = 1.1512019634246826
step = 6750: loss = 0.767269492149353
step = 7000: loss = 1.0642223358154297
step = 7250: loss = 0.6686549186706543
step = 7500: loss = 0.9569675326347351
step = 7750: loss = 1.026012659072876
step = 8000: loss = 0.8713213801383972
step = 8000: Average Return = 6.199999809265137 , Max Return = [10.]
step = 8250: loss = 1.11724853515625
step = 8500: loss = 1.77738618850708
step = 8750: loss = 0.5571439862251282
step = 9000: loss = 0.5860779881477356
step = 9250: loss = 1.4035993814468384
step = 9500: loss = 1.591731071472168
step = 9750: loss = 0.5840834379196167
step = 10000: loss = 1.0351455211639404
step = 10000: Average Return = 6.249997138977051 , Max Return = [10.]
step = 10250: loss = 1.3736213445663452
step = 10500: loss = 0.4389837086200714
step = 10750: loss = 0.8155933618545532
step = 11000: loss = 0.6092913746833801
step = 11250: loss = 1.5689167976379395
step = 11500: loss = 1.0101604461669922
step = 11750: loss = 1.5725042819976807
step = 12000: loss = 0.7004793882369995
step = 12000: Average Return = 5.983333587646484 , Max Return = [10.]
step = 12250: loss = 0.5605868101119995
step = 12500: loss = 1.5038576126098633
step = 12750: loss = 1.0939576625823975
step = 13000: loss = 0.43774163722991943
step = 13250: loss = 0.22513306140899658
step = 13500: loss = 1.3363324403762817
step = 13750: loss = 1.6120256185531616
step = 14000: loss = 1.3513758182525635
step = 14000: Average Return = 5.116668224334717 , Max Return = [10.]
step = 14250: loss = 0.9040378332138062
step = 14500: loss = 0.9840198755264282
step = 14750: loss = 1.8888715505599976
step = 15000: loss = 0.7414798140525818
step = 15250: loss = 1.2282658815383911
step = 15500: loss = 0.9093819856643677
step = 15750: loss = 1.4005067348480225
step = 16000: loss = 0.6544770002365112
step = 16000: Average Return = 6.016666412353516 , Max Return = [10.]
step = 16250: loss = 1.4140242338180542
step = 16500: loss = 1.5849848985671997
step = 16750: loss = 0.9185817241668701
step = 17000: loss = 0.9095059633255005
step = 17250: loss = 1.9575047492980957
step = 17500: loss = 0.5553542375564575
step = 17750: loss = 0.6430754661560059
step = 18000: loss = 0.49921321868896484
step = 18000: Average Return = 6.649996757507324 , Max Return = [10.]
step = 18250: loss = 1.472233533859253
step = 18500: loss = 1.4349391460418701
step = 18750: loss = 1.276090383529663
step = 19000: loss = 0.7946022748947144
step = 19250: loss = 1.3341047763824463
step = 19500: loss = 1.2398366928100586
step = 19750: loss = 0.8045104742050171
step = 20000: loss = 1.0498859882354736
step = 20000: Average Return = 5.58333683013916 , Max Return = [10.]
08:35:35.004894
[-1.0,4.2666616,6.0833364,6.2566695,6.2,6.249997,5.9833336,5.116668,6.0166664,6.6499968,5.58333]
Env init done

Env init done

-0.965 max: 0.0
08:35:43.434069
step = 250: loss = 0.20714831352233887
step = 500: loss = 1.7413384914398193
step = 750: loss = 1.559330940246582
step = 1000: loss = 1.2623755931854248
step = 1250: loss = 0.8683977127075195
step = 1500: loss = 1.1255617141723633
step = 1750: loss = 1.6212852001190186
step = 2000: loss = 1.5928972959518433
step = 2000: Average Return = 5.133335590362549 , Max Return = [10.]
step = 2250: loss = 1.4697173833847046
step = 2500: loss = 1.205899715423584
step = 2750: loss = 0.9699415564537048
step = 3000: loss = 1.4207992553710938
step = 3250: loss = 1.8831958770751953
step = 3500: loss = 1.5428996086120605
step = 3750: loss = 1.3304977416992188
step = 4000: loss = 1.5857114791870117
step = 4000: Average Return = 5.350000381469727 , Max Return = [10.]
step = 4250: loss = 1.5348069667816162
step = 4500: loss = 1.4210362434387207
step = 4750: loss = 0.7811075448989868
step = 5000: loss = 0.9524795413017273
step = 5250: loss = 1.3141605854034424
step = 5500: loss = 1.9588649272918701
step = 5750: loss = 0.8790140748023987
step = 6000: loss = 1.441609501838684
step = 6000: Average Return = 6.083334445953369 , Max Return = [10.]
step = 6250: loss = 1.028193712234497
step = 6500: loss = 0.6859111785888672
step = 6750: loss = 1.0529022216796875
step = 7000: loss = 1.3916559219360352
step = 7250: loss = 1.4172296524047852
step = 7500: loss = 0.6826497316360474
step = 7750: loss = 0.7611171007156372
step = 8000: loss = 1.0974159240722656
step = 8000: Average Return = 5.966667652130127 , Max Return = [10.]
step = 8250: loss = 0.9960530996322632
step = 8500: loss = 1.8376679420471191
step = 8750: loss = 0.9722110033035278
step = 9000: loss = 1.7175354957580566
step = 9250: loss = 0.8765255212783813
step = 9500: loss = 1.1536331176757812
step = 9750: loss = 1.2323849201202393
step = 10000: loss = 0.8243929743766785
step = 10000: Average Return = 6.699998378753662 , Max Return = [10.]
step = 10250: loss = 1.1831226348876953
step = 10500: loss = 1.507006287574768
step = 10750: loss = 1.4437294006347656
step = 11000: loss = 1.7533957958221436
step = 11250: loss = 0.8490651249885559
step = 11500: loss = 1.7295305728912354
step = 11750: loss = 0.2534051537513733
step = 12000: loss = 1.1132051944732666
step = 12000: Average Return = 6.650000095367432 , Max Return = [10.]
step = 12250: loss = 0.8832569122314453
step = 12500: loss = 1.6384153366088867
step = 12750: loss = 1.4524065256118774
step = 13000: loss = 1.3958940505981445
step = 13250: loss = 0.7001972198486328
step = 13500: loss = 1.1284122467041016
step = 13750: loss = 1.879719853401184
step = 14000: loss = 0.6198452711105347
step = 14000: Average Return = 6.666662216186523 , Max Return = [10.]
step = 14250: loss = 1.3650321960449219
step = 14500: loss = 1.2165517807006836
step = 14750: loss = 1.6714704036712646
step = 15000: loss = 0.9130278825759888
step = 15250: loss = 0.9879443049430847
step = 15500: loss = 0.7368725538253784
step = 15750: loss = 1.39190673828125
step = 16000: loss = 0.9754049777984619
step = 16000: Average Return = 6.316667556762695 , Max Return = [10.]
step = 16250: loss = 1.2882659435272217
step = 16500: loss = 1.901224970817566
step = 16750: loss = 0.7742275595664978
step = 17000: loss = 1.7267693281173706
step = 17250: loss = 1.1089107990264893
step = 17500: loss = 1.236027717590332
step = 17750: loss = 0.7603294253349304
step = 18000: loss = 0.8714041709899902
step = 18000: Average Return = 6.7333292961120605 , Max Return = [10.]
step = 18250: loss = 1.008323073387146
step = 18500: loss = 2.2641849517822266
step = 18750: loss = 1.4199106693267822
step = 19000: loss = 1.5679770708084106
step = 19250: loss = 1.236276626586914
step = 19500: loss = 1.2272887229919434
step = 19750: loss = 2.2621967792510986
step = 20000: loss = 0.9320936799049377
step = 20000: Average Return = 6.316667079925537 , Max Return = [10.]
13:06:33.201362
[-0.73666674,5.1333356,5.3500004,6.0833344,5.9666677,6.6999984,6.65,6.666662,6.3166676,6.7333293,6.31666]
Env init done

Env init done

-0.87666667 max: [10.]
13:06:41.776417
step = 250: loss = 0.010169360786676407
step = 500: loss = 0.8318861722946167
step = 750: loss = 0.47494012117385864
step = 1000: loss = 0.4568924307823181
step = 1250: loss = 0.14558647572994232
step = 1500: loss = 0.2730354070663452
step = 1750: loss = 0.22296956181526184
step = 2000: loss = 0.3969948887825012
step = 2250: loss = 0.33139628171920776
step = 2500: loss = 0.3505862057209015
step = 2750: loss = 0.20526032149791718
step = 3000: loss = 0.21169200539588928
step = 3000: Average Return = 1.720001459121704 , Max Return = [10.]
step = 3250: loss = 0.26164281368255615
step = 3500: loss = 0.4881210923194885
step = 3750: loss = 0.6764389872550964
step = 4000: loss = 0.9711015224456787
step = 4250: loss = 0.08145751059055328
step = 4500: loss = 0.41699719429016113
step = 4750: loss = 0.9551596641540527
step = 5000: loss = 1.0675207376480103
step = 5250: loss = 0.3279018700122833
step = 5500: loss = 0.619437038898468
step = 5750: loss = 0.8411011695861816
step = 6000: loss = 0.1961994618177414
step = 6000: Average Return = 1.7777791023254395 , Max Return = [10.]
step = 6250: loss = 0.4852905869483948
step = 6500: loss = 1.1567976474761963
step = 6750: loss = 0.49857577681541443
step = 7000: loss = 0.1450810432434082
step = 7250: loss = 0.3685331642627716
step = 7500: loss = 0.3460591435432434
step = 7750: loss = 0.35328900814056396
step = 8000: loss = 0.49092912673950195
step = 8250: loss = 0.20936593413352966
step = 8500: loss = 0.7784585952758789
step = 8750: loss = 0.3793160021305084
step = 9000: loss = 0.4860304594039917
step = 9000: Average Return = 3.588887929916382 , Max Return = [10.]
step = 9250: loss = 1.3670756816864014
step = 9500: loss = 1.0767455101013184
step = 9750: loss = 0.9645108580589294
step = 10000: loss = 0.2873089909553528
step = 10250: loss = 0.6759707927703857
step = 10500: loss = 0.5354668498039246
step = 10750: loss = 0.41779348254203796
step = 11000: loss = 0.2858586311340332
step = 11250: loss = 1.0768986940383911
step = 11500: loss = 0.7424832582473755
step = 11750: loss = 1.1949526071548462
step = 12000: loss = 0.3858063220977783
step = 12000: Average Return = 2.168889045715332 , Max Return = [10.]
step = 12250: loss = 0.4831686019897461
step = 12500: loss = 0.5799262523651123
step = 12750: loss = 0.17946290969848633
step = 13000: loss = 0.7740209102630615
step = 13250: loss = 1.405666708946228
step = 13500: loss = 0.17486855387687683
step = 13750: loss = 0.7607550621032715
step = 14000: loss = 0.5495584607124329
step = 14250: loss = 0.9294725656509399
step = 14500: loss = 0.32320863008499146
step = 14750: loss = 0.7035871744155884
step = 15000: loss = 0.3649514615535736
step = 15000: Average Return = 1.5822231769561768 , Max Return = [6.6666665]
step = 15250: loss = 0.3206990957260132
step = 15500: loss = 0.6576478481292725
step = 15750: loss = 0.9873444437980652
step = 16000: loss = 0.6315022110939026
step = 16250: loss = 0.3711160719394684
step = 16500: loss = 0.9593236446380615
step = 16750: loss = 0.6875506639480591
step = 17000: loss = 1.281496286392212
step = 17250: loss = 0.3962264060974121
step = 17500: loss = 0.3227255344390869
step = 17750: loss = 0.44826042652130127
step = 18000: loss = 0.5341120362281799
step = 18000: Average Return = 2.057778835296631 , Max Return = [10.]
step = 18250: loss = 0.6059044599533081
step = 18500: loss = 0.2591707408428192
step = 18750: loss = 0.18248416483402252
step = 19000: loss = 0.4213995039463043
step = 19250: loss = 1.4620754718780518
step = 19500: loss = 0.7283973097801208
step = 19750: loss = 0.957650899887085
step = 20000: loss = 0.27080023288726807
step = 20250: loss = 1.2796244621276855
step = 20500: loss = 0.2258872389793396
step = 20750: loss = 1.34931218624115
step = 21000: loss = 0.5432032942771912
step = 21000: Average Return = 1.8000012636184692 , Max Return = [10.]
step = 21250: loss = 0.8148845434188843
step = 21500: loss = 0.26045554876327515
step = 21750: loss = 1.0229554176330566
step = 22000: loss = 0.5284585952758789
step = 22250: loss = 0.25926274061203003
step = 22500: loss = 0.5976047515869141
step = 22750: loss = 0.08766539394855499
step = 23000: loss = 0.2767016887664795
step = 23250: loss = 0.4092790484428406
step = 23500: loss = 1.035478115081787
step = 23750: loss = 0.9204162359237671
step = 24000: loss = 0.8216138482093811
step = 24000: Average Return = 1.3311116695404053 , Max Return = [10.]
step = 24250: loss = 0.4908120632171631
step = 24500: loss = 1.1161444187164307
step = 24750: loss = 0.6020159721374512
step = 25000: loss = 0.9446805715560913
step = 25250: loss = 0.19426682591438293
step = 25500: loss = 0.3037036657333374
step = 25750: loss = 0.8445931673049927
step = 26000: loss = 0.981245219707489
step = 26250: loss = 0.5102856159210205
step = 26500: loss = 0.54598069190979
step = 26750: loss = 0.37268784642219543
step = 27000: loss = 0.33090609312057495
step = 27000: Average Return = 1.591111660003662 , Max Return = [10.]
step = 27250: loss = 0.36472731828689575
step = 27500: loss = 0.36612650752067566
step = 27750: loss = 0.2794521152973175
step = 28000: loss = 1.2613322734832764
step = 28250: loss = 0.9600263833999634
step = 28500: loss = 0.47490882873535156
step = 28750: loss = 0.7264387607574463
step = 29000: loss = 0.40079817175865173
step = 29250: loss = 1.6318327188491821
step = 29500: loss = 0.7973394989967346
step = 29750: loss = 0.28851503133773804
step = 30000: loss = 0.8285247087478638
step = 30000: Average Return = 1.0155556201934814 , Max Return = [10.]
19:25:18.839313
[-1.0,1.7200015,1.7777791,3.588888,2.168889,1.5822232,2.0577788,1.8000013,1.3311117,1.5911117,1.015555]
Env init done

Env init done

-0.84000003 max: [10.]
19:25:27.562663
step = 250: loss = 0.04665771499276161
step = 500: loss = 0.645979642868042
step = 750: loss = 1.2678475379943848
step = 1000: loss = 0.7153573036193848
step = 1250: loss = 0.7988787889480591
step = 1500: loss = 0.6242499351501465
step = 1750: loss = 1.2152457237243652
step = 2000: loss = 3.1933224201202393
step = 2250: loss = 1.4814178943634033
step = 2500: loss = 0.8569775223731995
step = 2750: loss = 0.6123332977294922
step = 3000: loss = 0.6649959683418274
step = 3000: Average Return = 4.0333333015441895 , Max Return = [10.]
step = 3250: loss = 2.263606548309326
step = 3500: loss = 1.4902572631835938
step = 3750: loss = 0.779630184173584
step = 4000: loss = 0.7215322852134705
step = 4250: loss = 0.5273748636245728
step = 4500: loss = 1.3663911819458008
step = 4750: loss = 1.465315580368042
step = 5000: loss = 0.7715011835098267
step = 5250: loss = 0.3916049003601074
step = 5500: loss = 0.5920247435569763
step = 5750: loss = 0.8855323791503906
step = 6000: loss = 0.8167449235916138
step = 6000: Average Return = 4.87777853012085 , Max Return = [10.]
step = 6250: loss = 0.7589813470840454
step = 6500: loss = 0.349770188331604
step = 6750: loss = 0.6427603960037231
step = 7000: loss = 0.7564130425453186
step = 7250: loss = 0.716625988483429
step = 7500: loss = 1.2789649963378906
step = 7750: loss = 1.8169081211090088
step = 8000: loss = 1.814432144165039
step = 8250: loss = 1.2697278261184692
step = 8500: loss = 1.0671876668930054
step = 8750: loss = 1.387587308883667
step = 9000: loss = 0.45794057846069336
step = 9000: Average Return = 5.222219944000244 , Max Return = [10.]
step = 9250: loss = 0.34663379192352295
step = 9500: loss = 1.8781260251998901
step = 9750: loss = 0.9657644033432007
step = 10000: loss = 1.6018822193145752
step = 10250: loss = 0.9079001545906067
step = 10500: loss = 0.9430903196334839
step = 10750: loss = 0.9381492137908936
step = 11000: loss = 0.8938491344451904
step = 11250: loss = 1.0995402336120605
step = 11500: loss = 0.46888938546180725
step = 11750: loss = 1.4672118425369263
step = 12000: loss = 0.7612961530685425
step = 12000: Average Return = 4.8222222328186035 , Max Return = [10.]
step = 12250: loss = 1.1552449464797974
step = 12500: loss = 1.7839875221252441
step = 12750: loss = 0.5941104292869568
step = 13000: loss = 2.4149680137634277
step = 13250: loss = 0.32950663566589355
step = 13500: loss = 0.9163745641708374
step = 13750: loss = 0.896569550037384
step = 14000: loss = 0.6523663401603699
step = 14250: loss = 0.9005833864212036
step = 14500: loss = 1.346333622932434
step = 14750: loss = 0.3317261338233948
step = 15000: loss = 0.6268154382705688
step = 15000: Average Return = 5.944437026977539 , Max Return = [10.]
step = 15250: loss = 1.0081312656402588
step = 15500: loss = 1.6871057748794556
step = 15750: loss = 1.473912000656128
step = 16000: loss = 0.7961505055427551
step = 16250: loss = 0.2755456268787384
step = 16500: loss = 1.139377474784851
step = 16750: loss = 0.9299867153167725
step = 17000: loss = 0.5557854175567627
step = 17250: loss = 1.569650650024414
step = 17500: loss = 1.4194939136505127
step = 17750: loss = 1.0171570777893066
step = 18000: loss = 2.4368486404418945
step = 18000: Average Return = 5.677775859832764 , Max Return = [10.]
step = 18250: loss = 1.367164969444275
step = 18500: loss = 0.9799065589904785
step = 18750: loss = 1.2374852895736694
step = 19000: loss = 1.0978357791900635
step = 19250: loss = 0.27448979020118713
step = 19500: loss = 0.7859684228897095
step = 19750: loss = 0.25658681988716125
step = 20000: loss = 0.953184187412262
step = 20250: loss = 0.7949265837669373
step = 20500: loss = 0.8464541435241699
step = 20750: loss = 1.254571795463562
step = 21000: loss = 0.5224780440330505
step = 21000: Average Return = 4.744438648223877 , Max Return = [10.]
step = 21250: loss = 1.3753888607025146
step = 21500: loss = 1.6946568489074707
step = 21750: loss = 2.5006165504455566
step = 22000: loss = 0.9760310649871826
step = 22250: loss = 1.1448112726211548
step = 22500: loss = 2.209486722946167
step = 22750: loss = 1.5056450366973877
step = 23000: loss = 1.7630295753479004
step = 23250: loss = 0.6484242677688599
step = 23500: loss = 1.886527419090271
step = 23750: loss = 0.2801162302494049
step = 24000: loss = 0.9100450277328491
step = 24000: Average Return = 5.599998950958252 , Max Return = [10.]
step = 24250: loss = 0.7533604502677917
step = 24500: loss = 1.7969183921813965
step = 24750: loss = 0.9942283034324646
step = 25000: loss = 1.8606394529342651
step = 25250: loss = 1.9227333068847656
step = 25500: loss = 0.7966181635856628
step = 25750: loss = 0.4961821734905243
step = 26000: loss = 0.4958696961402893
step = 26250: loss = 0.608927845954895
step = 26500: loss = 1.4005892276763916
step = 26750: loss = 1.1677830219268799
step = 27000: loss = 1.2220964431762695
step = 27000: Average Return = 6.3444366455078125 , Max Return = [10.]
step = 27250: loss = 1.1161856651306152
step = 27500: loss = 0.624143123626709
step = 27750: loss = 1.0659735202789307
step = 28000: loss = 1.1037710905075073
step = 28250: loss = 0.9592800140380859
step = 28500: loss = 0.8587343096733093
step = 28750: loss = 0.41930723190307617
step = 29000: loss = 0.41283875703811646
step = 29250: loss = 0.931176483631134
step = 29500: loss = 0.21799398958683014
step = 29750: loss = 1.0131704807281494
step = 30000: loss = 1.3881959915161133
step = 30000: Average Return = 5.226665496826172 , Max Return = [10.]
01:52:06.075880
[-0.66222227,4.0333333,4.8777785,5.22222,4.822222,5.944437,5.677776,4.7444386,5.599999,6.3444366,5.226665]
Env init done

Env init done

-0.78888893 max: [6.6666665]
01:52:14.373673
step = 250: loss = 0.06107410043478012
step = 500: loss = 0.26998770236968994
step = 750: loss = 0.6238675713539124
step = 1000: loss = 0.9623085856437683
step = 1250: loss = 0.1584950089454651
step = 1500: loss = 1.47488534450531
step = 1750: loss = 1.800471544265747
step = 2000: loss = 1.6857409477233887
step = 2250: loss = 1.7264583110809326
step = 2500: loss = 0.40899568796157837
step = 2750: loss = 2.4414310455322266
step = 3000: loss = 1.3556292057037354
step = 3000: Average Return = 4.011109828948975 , Max Return = [10.]
step = 3250: loss = 1.9963431358337402
step = 3500: loss = 0.8548169136047363
step = 3750: loss = 1.5331777334213257
step = 4000: loss = 0.5274689197540283
step = 4250: loss = 0.6111419796943665
step = 4500: loss = 0.9533331990242004
step = 4750: loss = 2.042795181274414
step = 5000: loss = 0.7483835220336914
step = 5250: loss = 1.1473592519760132
step = 5500: loss = 0.539319634437561
step = 5750: loss = 0.927514910697937
step = 6000: loss = 1.6048210859298706
step = 6000: Average Return = 5.199997901916504 , Max Return = [10.]
step = 6250: loss = 0.8531596064567566
step = 6500: loss = 0.5827792882919312
step = 6750: loss = 0.3347373902797699
step = 7000: loss = 1.8470075130462646
step = 7250: loss = 0.964622437953949
step = 7500: loss = 1.0056962966918945
step = 7750: loss = 1.5391695499420166
step = 8000: loss = 1.6845099925994873
step = 8250: loss = 0.6348296403884888
step = 8500: loss = 1.2752798795700073
step = 8750: loss = 1.098633050918579
step = 9000: loss = 2.712280750274658
step = 9000: Average Return = 6.3999924659729 , Max Return = [10.]
step = 9250: loss = 0.6098355650901794
step = 9500: loss = 1.9026520252227783
step = 9750: loss = 1.9302232265472412
step = 10000: loss = 1.6451148986816406
step = 10250: loss = 0.7750967741012573
step = 10500: loss = 1.771236777305603
step = 10750: loss = 2.36197829246521
step = 11000: loss = 0.8843347430229187
step = 11250: loss = 1.2854268550872803
step = 11500: loss = 1.0783226490020752
step = 11750: loss = 1.6328045129776
step = 12000: loss = 0.7483181953430176
step = 12000: Average Return = 5.611107349395752 , Max Return = [10.]
step = 12250: loss = 1.267242670059204
step = 12500: loss = 0.6090630888938904
step = 12750: loss = 1.687625527381897
step = 13000: loss = 2.48938250541687
step = 13250: loss = 1.0369716882705688
step = 13500: loss = 1.9689953327178955
step = 13750: loss = 0.7834876179695129
step = 14000: loss = 0.8187060356140137
step = 14250: loss = 1.2605433464050293
step = 14500: loss = 1.3323040008544922
step = 14750: loss = 0.6224596500396729
step = 15000: loss = 1.4275662899017334
step = 15000: Average Return = 5.244438648223877 , Max Return = [10.]
step = 15250: loss = 1.220001220703125
step = 15500: loss = 1.0441076755523682
step = 15750: loss = 1.489040732383728
step = 16000: loss = 1.081411600112915
step = 16250: loss = 1.5445163249969482
step = 16500: loss = 1.6093385219573975
step = 16750: loss = 1.3447550535202026
step = 17000: loss = 1.816206932067871
step = 17250: loss = 1.8592867851257324
step = 17500: loss = 0.5951974391937256
step = 17750: loss = 0.7846128344535828
step = 18000: loss = 0.9813718795776367
step = 18000: Average Return = 6.277770519256592 , Max Return = [10.]
step = 18250: loss = 2.5553483963012695
step = 18500: loss = 1.4353870153427124
step = 18750: loss = 0.9112592339515686
step = 19000: loss = 1.3383662700653076
step = 19250: loss = 1.5445013046264648
step = 19500: loss = 1.4091947078704834
step = 19750: loss = 1.46927809715271
step = 20000: loss = 1.7022473812103271
step = 20250: loss = 1.0173134803771973
step = 20500: loss = 1.4807536602020264
step = 20750: loss = 1.1980385780334473
step = 21000: loss = 0.9097431302070618
step = 21000: Average Return = 5.555548191070557 , Max Return = [10.]
step = 21250: loss = 1.4027698040008545
step = 21500: loss = 0.8109081387519836
step = 21750: loss = 0.39946895837783813
step = 22000: loss = 1.9134889841079712
step = 22250: loss = 0.5963011980056763
step = 22500: loss = 1.1247749328613281
step = 22750: loss = 1.109840989112854
step = 23000: loss = 0.9825271368026733
step = 23250: loss = 1.656759262084961
step = 23500: loss = 0.8224987387657166
step = 23750: loss = 0.4444771707057953
step = 24000: loss = 1.9055356979370117
step = 24000: Average Return = 6.333327293395996 , Max Return = [10.]
step = 24250: loss = 1.7567239999771118
step = 24500: loss = 1.0808066129684448
step = 24750: loss = 0.5980773568153381
step = 25000: loss = 1.6408599615097046
step = 25250: loss = 0.7062506079673767
step = 25500: loss = 0.7547236680984497
step = 25750: loss = 1.13722825050354
step = 26000: loss = 1.069351077079773
step = 26250: loss = 1.148547887802124
step = 26500: loss = 0.7395274043083191
step = 26750: loss = 0.6065709590911865
step = 27000: loss = 0.894885778427124
step = 27000: Average Return = 6.499995231628418 , Max Return = [10.]
step = 27250: loss = 0.8291212320327759
step = 27500: loss = 0.5482382774353027
step = 27750: loss = 1.544506549835205
step = 28000: loss = 1.1086856126785278
step = 28250: loss = 2.422947406768799
step = 28500: loss = 1.3459465503692627
step = 28750: loss = 1.3131742477416992
step = 29000: loss = 1.3013641834259033
step = 29250: loss = 1.585262417793274
step = 29500: loss = 1.355830192565918
step = 29750: loss = 1.255224585533142
step = 30000: loss = 1.2334669828414917
step = 30000: Average Return = 6.411106586456299 , Max Return = [10.]
08:17:12.779606
[-1.0,4.01111,5.199998,6.3999925,5.6111073,5.2444386,6.2777705,5.555548,6.3333273,6.499995,6.411106]
Env init done

Env init done

-0.88111115 max: [3.3333333]
08:17:47.169938
step = 250: loss = 0.4379326105117798
step = 500: loss = 0.6200647354125977
step = 750: loss = 0.9924737811088562
step = 1000: loss = 1.043983817100525
step = 1250: loss = 0.8002381324768066
step = 1500: loss = 1.6987920999526978
step = 1750: loss = 1.9060595035552979
step = 2000: loss = 2.8077518939971924
step = 2250: loss = 2.4722630977630615
step = 2500: loss = 1.9850590229034424
step = 2750: loss = 0.6648116111755371
step = 3000: loss = 0.7076756954193115
step = 3000: Average Return = 5.388888359069824 , Max Return = [10.]
step = 3250: loss = 3.029576539993286
step = 3500: loss = 2.231161117553711
step = 3750: loss = 2.509631872177124
step = 4000: loss = 0.6226505637168884
step = 4250: loss = 1.381190299987793
step = 4500: loss = 0.9189131259918213
step = 4750: loss = 1.6528398990631104
step = 5000: loss = 1.5505375862121582
step = 5250: loss = 3.593531608581543
step = 5500: loss = 1.5022597312927246
step = 5750: loss = 1.8234643936157227
step = 6000: loss = 0.9365866184234619
step = 6000: Average Return = 5.766665458679199 , Max Return = [10.]
step = 6250: loss = 1.4683499336242676
step = 6500: loss = 1.3230669498443604
step = 6750: loss = 2.0462522506713867
step = 7000: loss = 0.926736056804657
step = 7250: loss = 1.1695969104766846
step = 7500: loss = 0.9429693222045898
step = 7750: loss = 1.7499488592147827
step = 8000: loss = 1.6495217084884644
step = 8250: loss = 0.8088089227676392
step = 8500: loss = 1.093807578086853
step = 8750: loss = 1.2088794708251953
step = 9000: loss = 2.0623905658721924
step = 9000: Average Return = 5.722218036651611 , Max Return = [10.]
step = 9250: loss = 1.5768890380859375
step = 9500: loss = 1.21498441696167
step = 9750: loss = 1.049600601196289
step = 10000: loss = 0.4816528856754303
step = 10250: loss = 0.6890310645103455
step = 10500: loss = 1.0476083755493164
step = 10750: loss = 1.3284659385681152
step = 11000: loss = 1.304552674293518
step = 11250: loss = 1.0897316932678223
step = 11500: loss = 2.0162112712860107
step = 11750: loss = 1.4028929471969604
step = 12000: loss = 3.2898025512695312
step = 12000: Average Return = 6.355551719665527 , Max Return = [10.]
step = 12250: loss = 1.6695704460144043
step = 12500: loss = 2.212437629699707
step = 12750: loss = 1.15142023563385
step = 13000: loss = 0.9939554333686829
step = 13250: loss = 1.3375523090362549
step = 13500: loss = 0.6911270618438721
step = 13750: loss = 1.8888282775878906
step = 14000: loss = 1.8330795764923096
step = 14250: loss = 0.661145031452179
step = 14500: loss = 0.6070329546928406
step = 14750: loss = 1.8071119785308838
step = 15000: loss = 0.7639176845550537
step = 15000: Average Return = 6.922216892242432 , Max Return = [10.]
step = 15250: loss = 1.1189343929290771
step = 15500: loss = 1.2422492504119873
step = 15750: loss = 1.3634839057922363
step = 16000: loss = 2.3816370964050293
step = 16250: loss = 1.21486234664917
step = 16500: loss = 2.174771785736084
step = 16750: loss = 1.2442151308059692
step = 17000: loss = 0.899353563785553
step = 17250: loss = 1.9189345836639404
step = 17500: loss = 1.4498918056488037
step = 17750: loss = 1.6446428298950195
step = 18000: loss = 0.8950115442276001
step = 18000: Average Return = 5.8333306312561035 , Max Return = [10.]
step = 18250: loss = 0.9094647765159607
step = 18500: loss = 0.9240560531616211
step = 18750: loss = 0.5698503255844116
step = 19000: loss = 0.6019395589828491
step = 19250: loss = 0.8073375225067139
step = 19500: loss = 0.7238661050796509
step = 19750: loss = 0.8784525990486145
step = 20000: loss = 1.1857185363769531
step = 20250: loss = 1.0445556640625
step = 20500: loss = 1.7678992748260498
step = 20750: loss = 1.2340564727783203
step = 21000: loss = 1.3115694522857666
step = 21000: Average Return = 6.8333282470703125 , Max Return = [10.]
step = 21250: loss = 1.1041923761367798
step = 21500: loss = 1.3767492771148682
step = 21750: loss = 0.8507475852966309
step = 22000: loss = 0.8288719654083252
step = 22250: loss = 0.7583259344100952
step = 22500: loss = 0.8862956166267395
step = 22750: loss = 2.0361509323120117
step = 23000: loss = 0.906578004360199
step = 23250: loss = 0.934680163860321
step = 23500: loss = 1.1596813201904297
step = 23750: loss = 1.3107032775878906
step = 24000: loss = 1.4051178693771362
step = 24000: Average Return = 5.588885307312012 , Max Return = [10.]
step = 24250: loss = 0.9154711961746216
step = 24500: loss = 1.4554030895233154
step = 24750: loss = 0.9941956400871277
step = 25000: loss = 0.8951914310455322
step = 25250: loss = 1.245667576789856
step = 25500: loss = 0.95930415391922
step = 25750: loss = 1.1073620319366455
step = 26000: loss = 1.5797438621520996
step = 26250: loss = 1.163436770439148
step = 26500: loss = 0.9873896837234497
step = 26750: loss = 1.5859588384628296
step = 27000: loss = 1.1194398403167725
step = 27000: Average Return = 7.033328533172607 , Max Return = [10.]
step = 27250: loss = 1.1918176412582397
step = 27500: loss = 1.461033821105957
step = 27750: loss = 1.3749314546585083
step = 28000: loss = 0.603244423866272
step = 28250: loss = 0.6834431290626526
step = 28500: loss = 1.09086012840271
step = 28750: loss = 1.551951289176941
step = 29000: loss = 1.0461711883544922
step = 29250: loss = 1.4860624074935913
step = 29500: loss = 1.0319116115570068
step = 29750: loss = 0.5895490646362305
step = 30000: loss = 1.551926851272583
step = 30000: Average Return = 6.444439888000488 , Max Return = [10.]
14:41:48.964971
[-0.94666666,5.3888884,5.7666655,5.722218,6.3555517,6.922217,5.8333306,6.8333282,5.5888853,7.0333285,6.4444]
Env init done

Env init done

-0.90666664 max: [3.3333333]
14:42:01.230573
step = 250: loss = 0.08868028968572617
step = 500: loss = 0.4461771845817566
step = 750: loss = 0.3211944103240967
step = 1000: loss = 0.2842726707458496
step = 1250: loss = 0.21805480122566223
step = 1500: loss = 0.4210200905799866
step = 1750: loss = 0.7696995139122009
step = 2000: loss = 0.5987036228179932
step = 2250: loss = 0.3452948331832886
step = 2500: loss = 0.5113660097122192
step = 2750: loss = 0.6859134435653687
step = 3000: loss = 0.4545109272003174
step = 3250: loss = 0.8733481168746948
step = 3500: loss = 0.6059455275535583
step = 3750: loss = 1.2034639120101929
step = 4000: loss = 1.0164076089859009
step = 4000: Average Return = 1.4950000047683716 , Max Return = [10.]
step = 4250: loss = 0.2954798936843872
step = 4500: loss = 1.3489720821380615
step = 4750: loss = 2.204350471496582
step = 5000: loss = 1.9071650505065918
step = 5250: loss = 0.4607490301132202
step = 5500: loss = 0.36513251066207886
step = 5750: loss = 0.22982805967330933
step = 6000: loss = 0.45461413264274597
step = 6250: loss = 1.750640630722046
step = 6500: loss = 1.6423835754394531
step = 6750: loss = 0.7142256498336792
step = 7000: loss = 1.0724377632141113
step = 7250: loss = 0.5212492942810059
step = 7500: loss = 0.7572054862976074
step = 7750: loss = 0.8621436357498169
step = 8000: loss = 0.4769972860813141
step = 8000: Average Return = 1.0900007486343384 , Max Return = [6.6666665]
step = 8250: loss = 0.4547531008720398
step = 8500: loss = 0.3294416069984436
step = 8750: loss = 0.23424413800239563
step = 9000: loss = 0.3556637763977051
step = 9250: loss = 0.2109001725912094
step = 9500: loss = 0.5972678661346436
step = 9750: loss = 0.8424475193023682
step = 10000: loss = 1.3414578437805176
step = 10250: loss = 0.431890606880188
step = 10500: loss = 0.25782132148742676
step = 10750: loss = 0.7739942669868469
step = 11000: loss = 0.5692156553268433
step = 11250: loss = 0.5918735265731812
step = 11500: loss = 0.20778340101242065
step = 11750: loss = 0.4348730742931366
step = 12000: loss = 0.689373254776001
step = 12000: Average Return = 2.324997663497925 , Max Return = [10.]
step = 12250: loss = 0.23093920946121216
step = 12500: loss = 0.5874316692352295
step = 12750: loss = 0.7917271852493286
step = 13000: loss = 0.11138550937175751
step = 13250: loss = 0.5518483519554138
step = 13500: loss = 1.1065479516983032
step = 13750: loss = 0.49558401107788086
step = 14000: loss = 3.0012900829315186
step = 14250: loss = 0.7649136781692505
step = 14500: loss = 0.31054484844207764
step = 14750: loss = 0.355389267206192
step = 15000: loss = 0.7682172060012817
step = 15250: loss = 2.259671688079834
step = 15500: loss = 1.258624792098999
step = 15750: loss = 0.6378340721130371
step = 16000: loss = 1.2483623027801514
step = 16000: Average Return = 2.5249974727630615 , Max Return = [10.]
step = 16250: loss = 1.267967700958252
step = 16500: loss = 0.03418104350566864
step = 16750: loss = 0.11512628197669983
step = 17000: loss = 0.42842525243759155
step = 17250: loss = 1.0228369235992432
step = 17500: loss = 0.5355032086372375
step = 17750: loss = 1.667161464691162
step = 18000: loss = 0.3869501054286957
step = 18250: loss = 1.6339097023010254
step = 18500: loss = 0.6729444265365601
step = 18750: loss = 1.4164478778839111
step = 19000: loss = 0.8570012450218201
step = 19250: loss = 1.5721659660339355
step = 19500: loss = 0.5391863584518433
step = 19750: loss = 0.41564878821372986
step = 20000: loss = 0.15954044461250305
step = 20000: Average Return = 1.4250003099441528 , Max Return = [6.6666665]
step = 20250: loss = 1.394667625427246
step = 20500: loss = 0.4892366826534271
step = 20750: loss = 0.186107337474823
step = 21000: loss = 0.3790428042411804
step = 21250: loss = 0.42550399899482727
step = 21500: loss = 1.0227941274642944
step = 21750: loss = 0.6932241916656494
step = 22000: loss = 1.3253426551818848
step = 22250: loss = 0.5859295129776001
step = 22500: loss = 0.3842217028141022
step = 22750: loss = 0.4324541687965393
step = 23000: loss = 0.5472666621208191
step = 23250: loss = 0.49262285232543945
step = 23500: loss = 1.377821922302246
step = 23750: loss = 0.21463358402252197
step = 24000: loss = 0.6170156598091125
step = 24000: Average Return = 1.9183335304260254 , Max Return = [10.]
step = 24250: loss = 0.7306761741638184
step = 24500: loss = 0.22209644317626953
step = 24750: loss = 0.6619057059288025
step = 25000: loss = 0.7050836086273193
step = 25250: loss = 0.7978166341781616
step = 25500: loss = 0.7800395488739014
step = 25750: loss = 0.5297650098800659
step = 26000: loss = 0.7300921678543091
step = 26250: loss = 0.4097300171852112
step = 26500: loss = 0.17183610796928406
step = 26750: loss = 0.6286258697509766
step = 27000: loss = 1.237509846687317
step = 27250: loss = 1.1674902439117432
step = 27500: loss = 0.4342513680458069
step = 27750: loss = 0.5158432126045227
step = 28000: loss = 0.4893050789833069
step = 28000: Average Return = 1.0416672229766846 , Max Return = [6.6666665]
step = 28250: loss = 3.120698928833008
step = 28500: loss = 1.6313657760620117
step = 28750: loss = 0.4755975008010864
step = 29000: loss = 0.7982155084609985
step = 29250: loss = 0.849483847618103
step = 29500: loss = 1.0515412092208862
step = 29750: loss = 0.9727374911308289
step = 30000: loss = 0.15165451169013977
step = 30250: loss = 1.4395157098770142
step = 30500: loss = 0.646480917930603
step = 30750: loss = 0.484824538230896
step = 31000: loss = 0.34700044989585876
step = 31250: loss = 0.4896501898765564
step = 31500: loss = 0.4718291759490967
step = 31750: loss = 0.28523874282836914
step = 32000: loss = 0.10918173938989639
step = 32000: Average Return = 2.011664628982544 , Max Return = [6.6666665]
step = 32250: loss = 0.4473716914653778
step = 32500: loss = 0.4129820764064789
step = 32750: loss = 0.875533938407898
step = 33000: loss = 0.4328276515007019
step = 33250: loss = 0.7000693082809448
step = 33500: loss = 1.2321562767028809
step = 33750: loss = 0.8897255659103394
step = 34000: loss = 0.36530691385269165
step = 34250: loss = 0.8617887496948242
step = 34500: loss = 0.24835631251335144
step = 34750: loss = 1.581032395362854
step = 35000: loss = 0.3728236258029938
step = 35250: loss = 0.0849539190530777
step = 35500: loss = 0.478556752204895
step = 35750: loss = 1.3251757621765137
step = 36000: loss = 0.5510165095329285
step = 36000: Average Return = 2.5349979400634766 , Max Return = [10.]
step = 36250: loss = 0.6509281992912292
step = 36500: loss = 0.7479464411735535
step = 36750: loss = 1.4026997089385986
step = 37000: loss = 0.3208140730857849
step = 37250: loss = 1.4197067022323608
step = 37500: loss = 0.1828368753194809
step = 37750: loss = 0.42722001671791077
step = 38000: loss = 1.6332032680511475
step = 38250: loss = 0.6066389083862305
step = 38500: loss = 0.6559997797012329
step = 38750: loss = 0.7211947441101074
step = 39000: loss = 0.2976451516151428
step = 39250: loss = 1.4157295227050781
step = 39500: loss = 0.07494951784610748
step = 39750: loss = 0.7013304829597473
step = 40000: loss = 2.1036436557769775
step = 40000: Average Return = 1.1500006914138794 , Max Return = [10.]
23:18:32.481975
[-0.9616667,1.495,1.0900007,2.3249977,2.5249975,1.4250003,1.9183335,1.0416672,2.0116646,2.534998,1.150000]
Env init done

Env init done

-0.8158333 max: [10.]
23:18:43.467296
step = 250: loss = 0.01765352673828602
step = 500: loss = 1.7632665634155273
step = 750: loss = 0.36360883712768555
step = 1000: loss = 0.8992934226989746
step = 1250: loss = 1.9334090948104858
step = 1500: loss = 1.0114277601242065
step = 1750: loss = 0.4373265504837036
step = 2000: loss = 1.0094587802886963
step = 2250: loss = 0.5647995471954346
step = 2500: loss = 0.6820322871208191
step = 2750: loss = 2.2315750122070312
step = 3000: loss = 2.624368190765381
step = 3250: loss = 0.8258888721466064
step = 3500: loss = 1.382821798324585
step = 3750: loss = 1.5198602676391602
step = 4000: loss = 0.6243478059768677
step = 4000: Average Return = 4.633336067199707 , Max Return = [10.]
step = 4250: loss = 1.0324136018753052
step = 4500: loss = 0.32902634143829346
step = 4750: loss = 0.5505704879760742
step = 5000: loss = 1.896557331085205
step = 5250: loss = 1.5587981939315796
step = 5500: loss = 2.430081844329834
step = 5750: loss = 1.592457890510559
step = 6000: loss = 0.28579455614089966
step = 6250: loss = 2.162147045135498
step = 6500: loss = 0.9905539751052856
step = 6750: loss = 0.4653990864753723
step = 7000: loss = 1.4522662162780762
step = 7250: loss = 3.706596851348877
step = 7500: loss = 1.573846697807312
step = 7750: loss = 2.1035079956054688
step = 8000: loss = 2.3704559803009033
step = 8000: Average Return = 5.700003147125244 , Max Return = [10.]
step = 8250: loss = 0.5595638155937195
step = 8500: loss = 0.816997766494751
step = 8750: loss = 0.3968607485294342
step = 9000: loss = 0.9307065606117249
step = 9250: loss = 1.0284292697906494
step = 9500: loss = 1.6746330261230469
step = 9750: loss = 0.6764043569564819
step = 10000: loss = 1.132802128791809
step = 10250: loss = 1.3074116706848145
step = 10500: loss = 0.40419530868530273
step = 10750: loss = 0.24728140234947205
step = 11000: loss = 1.7113242149353027
step = 11250: loss = 0.6099467277526855
step = 11500: loss = 1.7643944025039673
step = 11750: loss = 1.679107427597046
step = 12000: loss = 0.9434517621994019
step = 12000: Average Return = 6.024999618530273 , Max Return = [10.]
step = 12250: loss = 2.0995349884033203
step = 12500: loss = 0.37241166830062866
step = 12750: loss = 0.6007979512214661
step = 13000: loss = 1.080013632774353
step = 13250: loss = 0.7414405941963196
step = 13500: loss = 1.8963567018508911
step = 13750: loss = 2.250326633453369
step = 14000: loss = 0.9933604598045349
step = 14250: loss = 0.34641510248184204
step = 14500: loss = 2.4467992782592773
step = 14750: loss = 1.9962890148162842
step = 15000: loss = 0.7574397325515747
step = 15250: loss = 1.4136472940444946
step = 15500: loss = 1.2782740592956543
step = 15750: loss = 1.0372111797332764
step = 16000: loss = 1.470908284187317
step = 16000: Average Return = 5.266665458679199 , Max Return = [10.]
step = 16250: loss = 1.6763408184051514
step = 16500: loss = 1.8401243686676025
step = 16750: loss = 1.8190648555755615
step = 17000: loss = 1.2050516605377197
step = 17250: loss = 1.8877705335617065
step = 17500: loss = 0.2664766013622284
step = 17750: loss = 1.3484771251678467
step = 18000: loss = 2.3042397499084473
step = 18250: loss = 2.2785263061523438
step = 18500: loss = 0.436523973941803
step = 18750: loss = 1.1153042316436768
step = 19000: loss = 0.4313579797744751
step = 19250: loss = 1.586195707321167
step = 19500: loss = 1.049817681312561
step = 19750: loss = 1.554350733757019
step = 20000: loss = 0.2912576496601105
step = 20000: Average Return = 5.524993896484375 , Max Return = [10.]
step = 20250: loss = 0.5804937481880188
step = 20500: loss = 0.5952728390693665
step = 20750: loss = 0.6872680187225342
step = 21000: loss = 0.5029420256614685
step = 21250: loss = 1.5186235904693604
step = 21500: loss = 1.2096669673919678
step = 21750: loss = 1.2881977558135986
step = 22000: loss = 0.7518119812011719
step = 22250: loss = 0.7079726457595825
step = 22500: loss = 0.9546799659729004
step = 22750: loss = 1.2685317993164062
step = 23000: loss = 2.0034422874450684
step = 23250: loss = 0.694658637046814
step = 23500: loss = 1.7365241050720215
step = 23750: loss = 0.23402139544487
step = 24000: loss = 1.041682243347168
step = 24000: Average Return = 5.225000381469727 , Max Return = [10.]
step = 24250: loss = 1.2327648401260376
step = 24500: loss = 1.369971513748169
step = 24750: loss = 0.791691780090332
step = 25000: loss = 1.0937694311141968
step = 25250: loss = 1.4241291284561157
step = 25500: loss = 0.9320458769798279
step = 25750: loss = 1.9693708419799805
step = 26000: loss = 0.3545684218406677
step = 26250: loss = 0.7900403738021851
step = 26500: loss = 0.5088592171669006
step = 26750: loss = 2.1776556968688965
step = 27000: loss = 0.7775853872299194
step = 27250: loss = 1.02488374710083
step = 27500: loss = 1.5752288103103638
step = 27750: loss = 0.4977715015411377
step = 28000: loss = 1.3575793504714966
step = 28000: Average Return = 6.458339214324951 , Max Return = [10.]
step = 28250: loss = 0.5161510109901428
step = 28500: loss = 0.5549390316009521
step = 28750: loss = 1.7531495094299316
step = 29000: loss = 0.9697239995002747
step = 29250: loss = 1.4126513004302979
step = 29500: loss = 0.9520043134689331
step = 29750: loss = 1.1367055177688599
step = 30000: loss = 1.2874407768249512
step = 30250: loss = 0.43577051162719727
step = 30500: loss = 1.0732916593551636
step = 30750: loss = 1.449009656906128
step = 31000: loss = 0.8303157687187195
step = 31250: loss = 0.6834304928779602
step = 31500: loss = 0.37096184492111206
step = 31750: loss = 1.5659549236297607
step = 32000: loss = 1.127070426940918
step = 32000: Average Return = 5.791667938232422 , Max Return = [10.]
step = 32250: loss = 0.7594379186630249
step = 32500: loss = 0.47785496711730957
step = 32750: loss = 0.958369255065918
step = 33000: loss = 0.871455192565918
step = 33250: loss = 0.49224650859832764
step = 33500: loss = 1.638082504272461
step = 33750: loss = 0.6385253667831421
step = 34000: loss = 1.2699240446090698
step = 34250: loss = 0.41660887002944946
step = 34500: loss = 0.5261278748512268
step = 34750: loss = 0.6746797561645508
step = 35000: loss = 1.828627347946167
step = 35250: loss = 1.37493896484375
step = 35500: loss = 1.9649995565414429
step = 35750: loss = 0.9241276979446411
step = 36000: loss = 1.3031208515167236
step = 36000: Average Return = 6.550004482269287 , Max Return = [10.]
step = 36250: loss = 1.0095961093902588
step = 36500: loss = 1.694111943244934
step = 36750: loss = 0.800670862197876
step = 37000: loss = 0.9307929873466492
step = 37250: loss = 0.42600640654563904
step = 37500: loss = 0.8254900574684143
step = 37750: loss = 1.7778470516204834
step = 38000: loss = 1.7637884616851807
step = 38250: loss = 2.071794033050537
step = 38500: loss = 0.846356213092804
step = 38750: loss = 0.9045599102973938
step = 39000: loss = 2.0433835983276367
step = 39250: loss = 1.6397314071655273
step = 39500: loss = 1.0390160083770752
step = 39750: loss = 1.794234275817871
step = 40000: loss = 0.7622160315513611
step = 40000: Average Return = 5.241666316986084 , Max Return = [10.]
07:54:48.757082
[-1.0,4.633336,5.700003,6.0249996,5.2666655,5.524994,5.2250004,6.458339,5.791668,6.5500045,5.241666]
Env init done

Env init done

-0.8874999 max: [10.]
07:54:58.163204
step = 250: loss = 0.2429385781288147
step = 500: loss = 0.5031553506851196
step = 750: loss = 0.26940101385116577
step = 1000: loss = 2.2902939319610596
step = 1250: loss = 0.7481698393821716
step = 1500: loss = 2.056835174560547
step = 1750: loss = 0.42962560057640076
step = 2000: loss = 2.016927480697632
step = 2250: loss = 2.4486472606658936
step = 2500: loss = 0.9827946424484253
step = 2750: loss = 1.08579683303833
step = 3000: loss = 2.056338310241699
step = 3250: loss = 1.0108723640441895
step = 3500: loss = 1.5218733549118042
step = 3750: loss = 2.3392653465270996
step = 4000: loss = 0.9036974906921387
step = 4000: Average Return = 6.100002288818359 , Max Return = [10.]
step = 4250: loss = 2.2095487117767334
step = 4500: loss = 1.776497483253479
step = 4750: loss = 0.7435029745101929
step = 5000: loss = 1.2366832494735718
step = 5250: loss = 1.8781614303588867
step = 5500: loss = 1.1109257936477661
step = 5750: loss = 1.214871883392334
step = 6000: loss = 1.268479824066162
step = 6250: loss = 2.2845025062561035
step = 6500: loss = 0.9059485197067261
step = 6750: loss = 2.2311453819274902
step = 7000: loss = 1.3866721391677856
step = 7250: loss = 1.348357915878296
step = 7500: loss = 0.6215039491653442
step = 7750: loss = 0.878498375415802
step = 8000: loss = 0.8308854103088379
step = 8000: Average Return = 5.558332920074463 , Max Return = [10.]
step = 8250: loss = 0.9401353597640991
step = 8500: loss = 1.266545295715332
step = 8750: loss = 0.5443564653396606
step = 9000: loss = 0.6373449563980103
step = 9250: loss = 1.3776490688323975
step = 9500: loss = 1.7632982730865479
step = 9750: loss = 2.240049362182617
step = 10000: loss = 0.8035531640052795
step = 10250: loss = 0.9654237031936646
step = 10500: loss = 1.7034895420074463
step = 10750: loss = 0.4128715395927429
step = 11000: loss = 1.112196683883667
step = 11250: loss = 1.0039950609207153
step = 11500: loss = 0.8290450572967529
step = 11750: loss = 1.0826094150543213
step = 12000: loss = 1.3663760423660278
step = 12000: Average Return = 5.591665267944336 , Max Return = [10.]
step = 12250: loss = 2.788555860519409
step = 12500: loss = 1.606220006942749
step = 12750: loss = 1.407238483428955
step = 13000: loss = 1.4929640293121338
step = 13250: loss = 0.6605954766273499
step = 13500: loss = 0.7308207154273987
step = 13750: loss = 1.2558437585830688
step = 14000: loss = 0.883604884147644
step = 14250: loss = 0.3342422842979431
step = 14500: loss = 1.465968132019043
step = 14750: loss = 1.7367162704467773
step = 15000: loss = 1.3403478860855103