num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.5000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.5000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.5000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.5000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.5000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.5, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/29/24-16:27:03] Start training [03/29/24-16:27:03] Building vocabulary [03/29/24-16:27:41] Vocabulary size is 561580 [Shuffling 1] loss 2349800.0000 lr 0.5000 vocab_size 561580 (19.68s/33.43m) [Shuffling 2] loss 106162.7578 lr 0.4950 vocab_size 561580 (19.83s/33.55m) [Shuffling 3] loss 58562.7422 lr 0.4900 vocab_size 561580 (20.15s/33.77m) [Shuffling 4] loss 44532.3672 lr 0.4850 vocab_size 561580 (19.94s/33.80m) [Shuffling 5] loss 32923.3516 lr 0.4800 vocab_size 561580 (19.98s/33.82m) [Shuffling 6] loss 28199.8496 lr 0.4750 vocab_size 561580 (20.09s/33.87m) [Shuffling 7] loss 24085.7910 lr 0.4700 vocab_size 561580 (20.15s/33.92m) [Shuffling 8] loss 20175.6621 lr 0.4650 vocab_size 561580 (19.84s/33.89m) [Shuffling 9] loss 18090.5918 lr 0.4600 vocab_size 561580 (20.20s/33.94m) [Shuffling 10] loss 16975.0938 lr 0.4550 vocab_size 561580 (20.05s/33.95m) [Shuffling 11] loss 14323.1123 lr 0.4500 vocab_size 561580 (20.07s/33.96m) [Shuffling 12] loss 13136.5283 lr 0.4450 vocab_size 561580 (20.20s/33.99m) [Shuffling 13] loss 13122.0352 lr 0.4400 vocab_size 561580 (20.18s/34.01m) [Shuffling 14] loss 11658.9346 lr 0.4350 vocab_size 561580 (19.99s/34.00m) [Shuffling 15] loss 11205.0195 lr 0.4300 vocab_size 561580 (19.99s/34.00m) [Shuffling 16] loss 10314.4697 lr 0.4250 vocab_size 561580 (20.02s/34.00m) [Shuffling 17] loss 10679.4941 lr 0.4200 vocab_size 561580 (19.54s/33.95m) [Shuffling 18] loss 9822.7949 lr 0.4150 vocab_size 561580 (19.84s/33.94m) [Shuffling 19] loss 8323.8584 lr 0.4100 vocab_size 561580 (19.93s/33.93m) [Shuffling 20] loss 8859.8193 lr 0.4050 vocab_size 561580 (19.60s/33.90m) [Shuffling 21] loss 7820.8579 lr 0.4000 vocab_size 561580 (20.05s/33.91m) [Shuffling 22] loss 7929.9839 lr 0.3950 vocab_size 561580 (19.11s/33.84m) [Shuffling 23] loss 7552.5059 lr 0.3900 vocab_size 561580 (19.87s/33.84m) [Shuffling 24] loss 6872.8540 lr 0.3850 vocab_size 561580 (19.92s/33.84m) [Shuffling 25] loss 7045.7017 lr 0.3800 vocab_size 561580 (19.03s/33.78m) [Shuffling 26] loss 6599.4355 lr 0.3750 vocab_size 561580 (19.03s/33.72m) [Shuffling 27] loss 6822.4360 lr 0.3700 vocab_size 561580 (18.84s/33.66m) [Shuffling 28] loss 6469.6035 lr 0.3650 vocab_size 561580 (19.80s/33.66m) [Shuffling 29] loss 6253.2153 lr 0.3600 vocab_size 561580 (19.83s/33.66m) [Shuffling 30] loss 6503.1069 lr 0.3550 vocab_size 561580 (19.47s/33.64m) [Shuffling 31] loss 5950.5825 lr 0.3500 vocab_size 561580 (19.93s/33.65m) [Shuffling 32] loss 5887.6768 lr 0.3450 vocab_size 561580 (19.89s/33.65m) [Shuffling 33] loss 4992.4961 lr 0.3400 vocab_size 561580 (20.21s/33.67m) [Shuffling 34] loss 5824.9775 lr 0.3350 vocab_size 561580 (19.55s/33.66m) [Shuffling 35] loss 5493.0684 lr 0.3300 vocab_size 561580 (19.04s/33.62m) [Shuffling 36] loss 4970.3560 lr 0.3250 vocab_size 561580 (19.53s/33.61m) [Shuffling 37] loss 5172.6392 lr 0.3200 vocab_size 561580 (19.17s/33.58m) [Shuffling 38] loss 5083.1255 lr 0.3150 vocab_size 561580 (19.28s/33.56m) [Shuffling 39] loss 5181.3975 lr 0.3100 vocab_size 561580 (19.53s/33.55m) [Shuffling 40] loss 4463.0229 lr 0.3050 vocab_size 561580 (19.68s/33.55m) [Shuffling 41] loss 4482.9380 lr 0.3000 vocab_size 561580 (19.22s/33.53m) [Shuffling 42] loss 4973.5024 lr 0.2950 vocab_size 561580 (19.23s/33.51m) [Shuffling 43] loss 4438.1880 lr 0.2900 vocab_size 561580 (19.90s/33.51m) [Shuffling 44] loss 4141.1655 lr 0.2850 vocab_size 561580 (19.69s/33.51m) [Shuffling 45] loss 4390.1470 lr 0.2800 vocab_size 561580 (19.74s/33.51m) [Shuffling 46] loss 4320.3218 lr 0.2750 vocab_size 561580 (19.45s/33.50m) [Shuffling 47] loss 4258.7427 lr 0.2700 vocab_size 561580 (19.35s/33.49m) [Shuffling 48] loss 4007.8269 lr 0.2650 vocab_size 561580 (19.80s/33.49m) [Shuffling 49] loss 4039.8511 lr 0.2600 vocab_size 561580 (19.57s/33.49m) [Shuffling 50] loss 3888.5298 lr 0.2550 vocab_size 561580 (20.18s/33.50m) [Shuffling 51] loss 3586.8357 lr 0.2500 vocab_size 561580 (19.98s/33.51m) [Shuffling 52] loss 3685.4089 lr 0.2451 vocab_size 561580 (19.02s/33.49m) [Shuffling 53] loss 3601.8420 lr 0.2401 vocab_size 561580 (19.23s/33.47m) [Shuffling 54] loss 3727.8503 lr 0.2351 vocab_size 561580 (19.34s/33.46m) [Shuffling 55] loss 3988.9485 lr 0.2301 vocab_size 561580 (19.42s/33.45m) [Shuffling 56] loss 3608.7754 lr 0.2251 vocab_size 561580 (19.35s/33.44m) [Shuffling 57] loss 3556.7288 lr 0.2201 vocab_size 561580 (20.10s/33.46m) [Shuffling 58] loss 3708.7273 lr 0.2151 vocab_size 561580 (19.36s/33.45m) [Shuffling 59] loss 3368.8049 lr 0.2101 vocab_size 561580 (19.82s/33.45m) [Shuffling 60] loss 3643.5291 lr 0.2051 vocab_size 561580 (19.16s/33.43m) [Shuffling 61] loss 3178.2104 lr 0.2001 vocab_size 561580 (19.73s/33.44m) [Shuffling 62] loss 3234.0264 lr 0.1951 vocab_size 561580 (19.24s/33.42m) [Shuffling 63] loss 3800.3604 lr 0.1901 vocab_size 561580 (19.41s/33.42m) [Shuffling 64] loss 3265.3069 lr 0.1851 vocab_size 561580 (19.09s/33.40m) [Shuffling 65] loss 3578.7021 lr 0.1801 vocab_size 561580 (19.11s/33.39m) [Shuffling 66] loss 3415.0420 lr 0.1751 vocab_size 561580 (19.47s/33.38m) [Shuffling 67] loss 3093.8447 lr 0.1701 vocab_size 561580 (19.91s/33.39m) [Shuffling 68] loss 3087.1626 lr 0.1651 vocab_size 561580 (19.88s/33.39m) [Shuffling 69] loss 2991.8965 lr 0.1601 vocab_size 561580 (19.49s/33.39m) [Shuffling 70] loss 2956.0535 lr 0.1551 vocab_size 561580 (19.72s/33.39m) [Shuffling 71] loss 2900.4910 lr 0.1501 vocab_size 561580 (20.01s/33.40m) [Shuffling 72] loss 3098.8296 lr 0.1451 vocab_size 561580 (19.28s/33.39m) [Shuffling 73] loss 2897.4583 lr 0.1401 vocab_size 561580 (19.94s/33.40m) [Shuffling 74] loss 2740.8660 lr 0.1351 vocab_size 561580 (19.67s/33.40m) [Shuffling 75] loss 3044.4924 lr 0.1301 vocab_size 561580 (19.20s/33.39m) [Shuffling 76] loss 3108.2297 lr 0.1251 vocab_size 561580 (19.37s/33.38m) [Shuffling 77] loss 2709.0918 lr 0.1201 vocab_size 561580 (19.90s/33.39m) [Shuffling 78] loss 2779.1511 lr 0.1151 vocab_size 561580 (19.28s/33.38m) [Shuffling 79] loss 2673.1809 lr 0.1101 vocab_size 561580 (19.92s/33.39m) [Shuffling 80] loss 2952.0557 lr 0.1051 vocab_size 561580 (19.19s/33.38m) [Shuffling 81] loss 2572.4634 lr 0.1001 vocab_size 561580 (19.96s/33.38m) [Shuffling 82] loss 2929.0066 lr 0.0951 vocab_size 561580 (19.11s/33.37m) [Shuffling 83] loss 2674.5969 lr 0.0901 vocab_size 561580 (19.20s/33.36m) [Shuffling 84] loss 2891.9407 lr 0.0851 vocab_size 561580 (19.35s/33.36m) [Shuffling 85] loss 2641.9468 lr 0.0801 vocab_size 561580 (19.40s/33.35m) [Shuffling 86] loss 2838.1743 lr 0.0751 vocab_size 561580 (19.18s/33.34m) [Shuffling 87] loss 2714.9487 lr 0.0701 vocab_size 561580 (19.10s/33.33m) [Shuffling 88] loss 2431.9558 lr 0.0651 vocab_size 561580 (20.03s/33.34m) [Shuffling 89] loss 2758.9331 lr 0.0601 vocab_size 561580 (19.56s/33.34m) [Shuffling 90] loss 2542.0630 lr 0.0551 vocab_size 561580 (19.57s/33.34m) [Shuffling 91] loss 2802.8169 lr 0.0501 vocab_size 561580 (19.59s/33.34m) [Shuffling 92] loss 2464.0186 lr 0.0451 vocab_size 561580 (19.47s/33.33m) [Shuffling 93] loss 2662.8569 lr 0.0401 vocab_size 561580 (19.10s/33.33m) [Shuffling 94] loss 2748.7148 lr 0.0351 vocab_size 561580 (18.99s/33.31m) [Shuffling 95] loss 2793.7195 lr 0.0301 vocab_size 561580 (19.42s/33.31m) [Shuffling 96] loss 2902.8242 lr 0.0251 vocab_size 561580 (21.32s/33.34m) [Shuffling 97] loss 2763.5920 lr 0.0201 vocab_size 561580 (19.17s/33.33m) [Shuffling 98] loss 2431.7859 lr 0.0151 vocab_size 561580 (38.45s/33.65m) [Shuffling 99] loss 2231.7195 lr 0.0101 vocab_size 561580 (37.03s/33.94m) [Shuffling 100] loss 3028.5398 lr 0.0051 vocab_size 561580 (37.12s/34.23m) [03/29/24-17:01:17] Training finished, training Time 34.23m