num_sent_processes: 4 [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W10D-0.5000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W10D-0.5000r/shuffled_datasets [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W10D-0.5000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W10D-0.5000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.5, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W10D-0.5000r/shuffled_datasets Using cbow, negative sampling with 5 negative samples [03/12/24-20:28:40] Start training [03/12/24-20:28:40] Building vocabulary [03/12/24-20:29:29] Vocabulary size is 251084 [Shuffling 1] loss 1903701.3750 lr 0.5000 vocab_size 251084 (13.57s/23.43m) [Shuffling 2] loss 56105.7383 lr 0.4950 vocab_size 251084 (11.55s/21.76m) [Shuffling 3] loss 28146.7207 lr 0.4900 vocab_size 251084 (10.49s/20.62m) [Shuffling 4] loss 17989.4980 lr 0.4850 vocab_size 251084 (10.43s/20.03m) [Shuffling 5] loss 14906.4961 lr 0.4800 vocab_size 251084 (17.48s/22.02m) [Shuffling 6] loss 11671.0645 lr 0.4750 vocab_size 251084 (10.67s/21.46m) [Shuffling 7] loss 10039.7383 lr 0.4700 vocab_size 251084 (10.73s/21.06m) [Shuffling 8] loss 8983.9736 lr 0.4650 vocab_size 251084 (11.03s/20.83m) [Shuffling 9] loss 7644.4331 lr 0.4600 vocab_size 251084 (13.08s/21.04m) [Shuffling 10] loss 6572.3511 lr 0.4550 vocab_size 251084 (10.46s/20.76m) [Shuffling 11] loss 6093.1353 lr 0.4500 vocab_size 251084 (10.94s/20.61m) [Shuffling 12] loss 6219.2412 lr 0.4450 vocab_size 251084 (10.36s/20.40m) [Shuffling 13] loss 4734.2212 lr 0.4400 vocab_size 251084 (15.71s/20.91m) [Shuffling 14] loss 4681.2334 lr 0.4350 vocab_size 251084 (10.76s/20.76m) [Shuffling 15] loss 4477.0356 lr 0.4300 vocab_size 251084 (10.47s/20.60m) [Shuffling 16] loss 4467.1807 lr 0.4250 vocab_size 251084 (10.44s/20.45m) [Shuffling 17] loss 4126.0327 lr 0.4200 vocab_size 251084 (15.50s/20.82m) [Shuffling 18] loss 3592.0508 lr 0.4150 vocab_size 251084 (11.05s/20.73m) [Shuffling 19] loss 3581.3909 lr 0.4100 vocab_size 251084 (11.58s/20.70m) [Shuffling 20] loss 3648.9287 lr 0.4050 vocab_size 251084 (11.42s/20.66m) [Shuffling 21] loss 3441.0762 lr 0.4000 vocab_size 251084 (13.71s/20.81m) [Shuffling 22] loss 2985.4238 lr 0.3950 vocab_size 251084 (10.78s/20.71m) [Shuffling 23] loss 2991.6211 lr 0.3900 vocab_size 251084 (10.94s/20.64m) [Shuffling 24] loss 2673.3064 lr 0.3850 vocab_size 251084 (11.06s/20.59m) [Shuffling 25] loss 2662.5918 lr 0.3800 vocab_size 251084 (14.49s/20.77m) [Shuffling 26] loss 2619.9431 lr 0.3750 vocab_size 251084 (10.61s/20.68m) [Shuffling 27] loss 2536.6094 lr 0.3700 vocab_size 251084 (11.13s/20.63m) [Shuffling 28] loss 2146.4727 lr 0.3650 vocab_size 251084 (10.72s/20.56m) [Shuffling 29] loss 2517.7949 lr 0.3600 vocab_size 251084 (12.69s/20.61m) [Shuffling 30] loss 2438.0476 lr 0.3550 vocab_size 251084 (11.85s/20.61m) [Shuffling 31] loss 2171.4421 lr 0.3500 vocab_size 251084 (11.72s/20.61m) [Shuffling 32] loss 2198.3325 lr 0.3450 vocab_size 251084 (10.21s/20.52m) [Shuffling 33] loss 1962.7186 lr 0.3400 vocab_size 251084 (11.67s/20.51m) [Shuffling 34] loss 2025.4838 lr 0.3350 vocab_size 251084 (12.75s/20.56m) [Shuffling 35] loss 1971.5538 lr 0.3300 vocab_size 251084 (11.38s/20.54m) [Shuffling 36] loss 1808.9802 lr 0.3250 vocab_size 251084 (10.32s/20.47m) [Shuffling 37] loss 1775.3867 lr 0.3200 vocab_size 251084 (10.47s/20.41m) [Shuffling 38] loss 1741.7266 lr 0.3150 vocab_size 251084 (14.31s/20.53m) [Shuffling 39] loss 1695.2366 lr 0.3100 vocab_size 251084 (10.38s/20.46m) [Shuffling 40] loss 1672.7294 lr 0.3050 vocab_size 251084 (10.73s/20.42m) [Shuffling 41] loss 1743.8434 lr 0.3000 vocab_size 251084 (10.18s/20.36m) [Shuffling 42] loss 1675.8429 lr 0.2950 vocab_size 251084 (13.92s/20.45m) [Shuffling 43] loss 1449.9241 lr 0.2900 vocab_size 251084 (10.42s/20.39m) [Shuffling 44] loss 1730.1307 lr 0.2850 vocab_size 251084 (11.59s/20.39m) [Shuffling 45] loss 1745.9382 lr 0.2800 vocab_size 251084 (10.28s/20.34m) [Shuffling 46] loss 1528.4364 lr 0.2750 vocab_size 251084 (15.65s/20.48m) [Shuffling 47] loss 1440.9414 lr 0.2700 vocab_size 251084 (10.21s/20.42m) [Shuffling 48] loss 1136.0101 lr 0.2650 vocab_size 251084 (11.21s/20.41m) [Shuffling 49] loss 1286.1090 lr 0.2600 vocab_size 251084 (10.33s/20.36m) [Shuffling 50] loss 1338.9491 lr 0.2550 vocab_size 251084 (15.83s/20.49m) [Shuffling 51] loss 1416.7339 lr 0.2500 vocab_size 251084 (11.21s/20.48m) [Shuffling 52] loss 1249.3099 lr 0.2451 vocab_size 251084 (10.81s/20.44m) [Shuffling 53] loss 1307.3967 lr 0.2401 vocab_size 251084 (10.83s/20.42m) [Shuffling 54] loss 1194.9373 lr 0.2351 vocab_size 251084 (14.02s/20.49m) [Shuffling 55] loss 1387.9166 lr 0.2301 vocab_size 251084 (11.07s/20.46m) [Shuffling 56] loss 1334.6083 lr 0.2251 vocab_size 251084 (10.98s/20.44m) [Shuffling 57] loss 1111.5487 lr 0.2201 vocab_size 251084 (11.52s/20.43m) [Shuffling 58] loss 1423.3453 lr 0.2151 vocab_size 251084 (14.69s/20.52m) [Shuffling 59] loss 1128.9807 lr 0.2101 vocab_size 251084 (10.86s/20.49m) [Shuffling 60] loss 1029.2209 lr 0.2051 vocab_size 251084 (11.06s/20.47m) [Shuffling 61] loss 920.2974 lr 0.2001 vocab_size 251084 (10.45s/20.44m) [Shuffling 62] loss 1153.0449 lr 0.1951 vocab_size 251084 (13.07s/20.47m) [Shuffling 63] loss 1173.5817 lr 0.1901 vocab_size 251084 (9.98s/20.42m) [Shuffling 64] loss 965.6724 lr 0.1851 vocab_size 251084 (10.84s/20.40m) [Shuffling 65] loss 1151.9902 lr 0.1801 vocab_size 251084 (10.59s/20.37m) [Shuffling 66] loss 1019.2505 lr 0.1751 vocab_size 251084 (12.77s/20.40m) [Shuffling 67] loss 1012.7339 lr 0.1701 vocab_size 251084 (10.95s/20.38m) [Shuffling 68] loss 935.6664 lr 0.1651 vocab_size 251084 (11.62s/20.38m) [Shuffling 69] loss 1018.5585 lr 0.1601 vocab_size 251084 (11.03s/20.36m) [Shuffling 70] loss 1065.4287 lr 0.1551 vocab_size 251084 (12.03s/20.37m) [Shuffling 71] loss 795.1802 lr 0.1501 vocab_size 251084 (10.67s/20.34m) [Shuffling 72] loss 1012.8313 lr 0.1451 vocab_size 251084 (10.55s/20.32m) [Shuffling 73] loss 917.4474 lr 0.1401 vocab_size 251084 (10.89s/20.30m) [Shuffling 74] loss 947.3541 lr 0.1351 vocab_size 251084 (12.93s/20.33m) [Shuffling 75] loss 1004.7827 lr 0.1301 vocab_size 251084 (11.20s/20.32m) [Shuffling 76] loss 941.3488 lr 0.1251 vocab_size 251084 (10.73s/20.29m) [Shuffling 77] loss 854.0092 lr 0.1201 vocab_size 251084 (10.73s/20.27m) [Shuffling 78] loss 981.4775 lr 0.1151 vocab_size 251084 (11.90s/20.28m) [Shuffling 79] loss 882.3328 lr 0.1101 vocab_size 251084 (10.77s/20.26m) [Shuffling 80] loss 852.6889 lr 0.1051 vocab_size 251084 (10.22s/20.23m) [Shuffling 81] loss 968.0218 lr 0.1001 vocab_size 251084 (11.65s/20.23m) [Shuffling 82] loss 834.1906 lr 0.0951 vocab_size 251084 (12.06s/20.24m) [Shuffling 83] loss 945.8839 lr 0.0901 vocab_size 251084 (11.03s/20.23m) [Shuffling 84] loss 758.9522 lr 0.0851 vocab_size 251084 (10.81s/20.21m) [Shuffling 85] loss 822.7194 lr 0.0801 vocab_size 251084 (11.43s/20.21m) [Shuffling 86] loss 786.0580 lr 0.0751 vocab_size 251084 (12.52s/20.23m) [Shuffling 87] loss 842.3071 lr 0.0701 vocab_size 251084 (11.66s/20.23m) [Shuffling 88] loss 821.8576 lr 0.0651 vocab_size 251084 (11.69s/20.23m) [Shuffling 89] loss 912.2621 lr 0.0601 vocab_size 251084 (10.33s/20.20m) [Shuffling 90] loss 963.4045 lr 0.0551 vocab_size 251084 (11.22s/20.19m) [Shuffling 91] loss 838.7433 lr 0.0501 vocab_size 251084 (13.01s/20.22m) [Shuffling 92] loss 812.2385 lr 0.0451 vocab_size 251084 (12.02s/20.23m) [Shuffling 93] loss 907.4325 lr 0.0401 vocab_size 251084 (11.02s/20.22m) [Shuffling 94] loss 728.4090 lr 0.0351 vocab_size 251084 (10.94s/20.21m) [Shuffling 95] loss 932.0136 lr 0.0301 vocab_size 251084 (11.00s/20.19m) [Shuffling 96] loss 817.0662 lr 0.0251 vocab_size 251084 (12.55s/20.21m) [Shuffling 97] loss 792.8470 lr 0.0201 vocab_size 251084 (10.76s/20.20m) [Shuffling 98] loss 774.7592 lr 0.0151 vocab_size 251084 (10.38s/20.18m) [Shuffling 99] loss 731.4448 lr 0.0101 vocab_size 251084 (11.60s/20.18m) [Shuffling 100] loss 649.4588 lr 0.0051 vocab_size 251084 (14.43s/20.22m) [03/12/24-20:48:53] Training finished, training Time 20.22m