num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.0250r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.0250r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.0250r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.0250r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_dhs/50W100D-0.0250r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.025, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/29/24-12:15:35] Start training [03/29/24-12:15:35] Building vocabulary [03/29/24-12:16:15] Vocabulary size is 561580 [Shuffling 1] loss 9546449.0000 lr 0.0250 vocab_size 561580 (22.24s/37.74m) [Shuffling 2] loss 7351225.5000 lr 0.0248 vocab_size 561580 (21.87s/37.43m) [Shuffling 3] loss 7243469.0000 lr 0.0245 vocab_size 561580 (22.32s/37.58m) [Shuffling 4] loss 6995936.0000 lr 0.0243 vocab_size 561580 (22.37s/37.67m) [Shuffling 5] loss 6719528.5000 lr 0.0240 vocab_size 561580 (22.44s/37.75m) [Shuffling 6] loss 6587287.5000 lr 0.0238 vocab_size 561580 (22.62s/37.86m) [Shuffling 7] loss 6421893.5000 lr 0.0235 vocab_size 561580 (22.29s/37.86m) [Shuffling 8] loss 6243554.0000 lr 0.0233 vocab_size 561580 (22.18s/37.83m) [Shuffling 9] loss 6464322.0000 lr 0.0230 vocab_size 561580 (21.71s/37.73m) [Shuffling 10] loss 6140986.0000 lr 0.0228 vocab_size 561580 (22.33s/37.74m) [Shuffling 11] loss 6336857.5000 lr 0.0225 vocab_size 561580 (21.60s/37.64m) [Shuffling 12] loss 6106036.0000 lr 0.0223 vocab_size 561580 (22.14s/37.64m) [Shuffling 13] loss 5898447.5000 lr 0.0220 vocab_size 561580 (22.38s/37.66m) [Shuffling 14] loss 5869468.5000 lr 0.0218 vocab_size 561580 (22.37s/37.69m) [Shuffling 15] loss 5960425.5000 lr 0.0215 vocab_size 561580 (21.43s/37.60m) [Shuffling 16] loss 5790519.5000 lr 0.0213 vocab_size 561580 (21.96s/37.58m) [Shuffling 17] loss 5847214.5000 lr 0.0210 vocab_size 561580 (21.25s/37.49m) [Shuffling 18] loss 5855177.5000 lr 0.0208 vocab_size 561580 (20.45s/37.34m) [Shuffling 19] loss 5750579.0000 lr 0.0205 vocab_size 561580 (21.21s/37.27m) [Shuffling 20] loss 5628053.0000 lr 0.0203 vocab_size 561580 (21.43s/37.23m) [Shuffling 21] loss 5836308.5000 lr 0.0200 vocab_size 561580 (20.66s/37.13m) [Shuffling 22] loss 5757415.0000 lr 0.0198 vocab_size 561580 (20.71s/37.04m) [Shuffling 23] loss 5753460.0000 lr 0.0195 vocab_size 561580 (20.37s/36.93m) [Shuffling 24] loss 5786589.0000 lr 0.0193 vocab_size 561580 (20.88s/36.87m) [Shuffling 25] loss 5684802.0000 lr 0.0190 vocab_size 561580 (20.89s/36.82m) [Shuffling 26] loss 5727314.0000 lr 0.0188 vocab_size 561580 (20.75s/36.76m) [Shuffling 27] loss 5483295.0000 lr 0.0185 vocab_size 561580 (21.53s/36.75m) [Shuffling 28] loss 5569387.0000 lr 0.0183 vocab_size 561580 (20.48s/36.68m) [Shuffling 29] loss 5642516.5000 lr 0.0180 vocab_size 561580 (20.70s/36.63m) [Shuffling 30] loss 5722695.0000 lr 0.0178 vocab_size 561580 (20.80s/36.59m) [Shuffling 31] loss 5620342.5000 lr 0.0175 vocab_size 561580 (20.54s/36.54m) [Shuffling 32] loss 5479314.0000 lr 0.0173 vocab_size 561580 (21.15s/36.52m) [Shuffling 33] loss 5608833.5000 lr 0.0170 vocab_size 561580 (20.83s/36.48m) [Shuffling 34] loss 5667891.0000 lr 0.0168 vocab_size 561580 (20.89s/36.45m) [Shuffling 35] loss 5242281.0000 lr 0.0165 vocab_size 561580 (21.21s/36.44m) [Shuffling 36] loss 5560222.5000 lr 0.0163 vocab_size 561580 (20.49s/36.40m) [Shuffling 37] loss 5659049.5000 lr 0.0160 vocab_size 561580 (20.20s/36.34m) [Shuffling 38] loss 5467279.0000 lr 0.0158 vocab_size 561580 (20.17s/36.29m) [Shuffling 39] loss 5457272.5000 lr 0.0155 vocab_size 561580 (20.22s/36.24m) [Shuffling 40] loss 5590138.0000 lr 0.0153 vocab_size 561580 (20.27s/36.19m) [Shuffling 41] loss 5380481.5000 lr 0.0150 vocab_size 561580 (20.16s/36.15m) [Shuffling 42] loss 5368417.0000 lr 0.0148 vocab_size 561580 (20.42s/36.11m) [Shuffling 43] loss 5485731.0000 lr 0.0145 vocab_size 561580 (20.89s/36.10m) [Shuffling 44] loss 5270039.0000 lr 0.0143 vocab_size 561580 (20.41s/36.07m) [Shuffling 45] loss 5404421.5000 lr 0.0140 vocab_size 561580 (19.79s/36.01m) [Shuffling 46] loss 5449027.5000 lr 0.0138 vocab_size 561580 (20.12s/35.97m) [Shuffling 47] loss 5385773.0000 lr 0.0135 vocab_size 561580 (20.09s/35.94m) [Shuffling 48] loss 5460952.0000 lr 0.0133 vocab_size 561580 (19.84s/35.89m) [Shuffling 49] loss 5400292.0000 lr 0.0130 vocab_size 561580 (20.37s/35.86m) [Shuffling 50] loss 5419948.0000 lr 0.0128 vocab_size 561580 (20.32s/35.84m) [Shuffling 51] loss 5467643.5000 lr 0.0126 vocab_size 561580 (20.14s/35.81m) [Shuffling 52] loss 5493889.0000 lr 0.0123 vocab_size 561580 (20.50s/35.79m) [Shuffling 53] loss 5466758.0000 lr 0.0121 vocab_size 561580 (20.40s/35.77m) [Shuffling 54] loss 5422375.5000 lr 0.0118 vocab_size 561580 (20.39s/35.75m) [Shuffling 55] loss 5283855.0000 lr 0.0116 vocab_size 561580 (20.31s/35.72m) [Shuffling 56] loss 5191813.5000 lr 0.0113 vocab_size 561580 (21.08s/35.73m) [Shuffling 57] loss 5231025.5000 lr 0.0111 vocab_size 561580 (20.55s/35.71m) [Shuffling 58] loss 5442201.5000 lr 0.0108 vocab_size 561580 (20.21s/35.69m) [Shuffling 59] loss 5425014.5000 lr 0.0106 vocab_size 561580 (20.47s/35.67m) [Shuffling 60] loss 5211471.0000 lr 0.0103 vocab_size 561580 (20.52s/35.66m) [Shuffling 61] loss 5218670.5000 lr 0.0101 vocab_size 561580 (20.56s/35.65m) [Shuffling 62] loss 5256467.0000 lr 0.0098 vocab_size 561580 (20.28s/35.63m) [Shuffling 63] loss 5421022.0000 lr 0.0096 vocab_size 561580 (20.73s/35.62m) [Shuffling 64] loss 5325983.0000 lr 0.0093 vocab_size 561580 (20.07s/35.60m) [Shuffling 65] loss 5270650.0000 lr 0.0091 vocab_size 561580 (20.15s/35.58m) [Shuffling 66] loss 5114171.5000 lr 0.0088 vocab_size 561580 (20.76s/35.57m) [Shuffling 67] loss 5084857.5000 lr 0.0086 vocab_size 561580 (20.68s/35.57m) [Shuffling 68] loss 5158277.5000 lr 0.0083 vocab_size 561580 (19.75s/35.54m) [Shuffling 69] loss 5359200.0000 lr 0.0081 vocab_size 561580 (20.20s/35.52m) [Shuffling 70] loss 5273286.5000 lr 0.0078 vocab_size 561580 (19.72s/35.49m) [Shuffling 71] loss 5214949.5000 lr 0.0076 vocab_size 561580 (20.21s/35.48m) [Shuffling 72] loss 5234558.5000 lr 0.0073 vocab_size 561580 (20.16s/35.46m) [Shuffling 73] loss 5356344.5000 lr 0.0071 vocab_size 561580 (20.06s/35.44m) [Shuffling 74] loss 5307176.5000 lr 0.0068 vocab_size 561580 (19.96s/35.42m) [Shuffling 75] loss 5016983.0000 lr 0.0066 vocab_size 561580 (20.72s/35.42m) [Shuffling 76] loss 5241427.0000 lr 0.0063 vocab_size 561580 (20.03s/35.40m) [Shuffling 77] loss 5146095.0000 lr 0.0061 vocab_size 561580 (20.06s/35.38m) [Shuffling 78] loss 5185883.0000 lr 0.0058 vocab_size 561580 (19.96s/35.37m) [Shuffling 79] loss 5254202.5000 lr 0.0056 vocab_size 561580 (19.83s/35.35m) [Shuffling 80] loss 5191791.0000 lr 0.0053 vocab_size 561580 (19.94s/35.33m) [Shuffling 81] loss 5218028.5000 lr 0.0051 vocab_size 561580 (19.85s/35.31m) [Shuffling 82] loss 5063029.5000 lr 0.0048 vocab_size 561580 (19.86s/35.29m) [Shuffling 83] loss 5334064.0000 lr 0.0046 vocab_size 561580 (19.66s/35.27m) [Shuffling 84] loss 5202629.5000 lr 0.0043 vocab_size 561580 (19.81s/35.25m) [Shuffling 85] loss 5298001.5000 lr 0.0041 vocab_size 561580 (19.90s/35.23m) [Shuffling 86] loss 5224969.0000 lr 0.0038 vocab_size 561580 (19.91s/35.22m) [Shuffling 87] loss 5251370.0000 lr 0.0036 vocab_size 561580 (19.89s/35.20m) [Shuffling 88] loss 5164843.5000 lr 0.0033 vocab_size 561580 (19.88s/35.18m) [Shuffling 89] loss 5113433.5000 lr 0.0031 vocab_size 561580 (20.02s/35.17m) [Shuffling 90] loss 5214559.5000 lr 0.0028 vocab_size 561580 (19.70s/35.15m) [Shuffling 91] loss 5259298.0000 lr 0.0026 vocab_size 561580 (19.72s/35.14m) [Shuffling 92] loss 4806520.0000 lr 0.0023 vocab_size 561580 (20.85s/35.14m) [Shuffling 93] loss 5107667.5000 lr 0.0021 vocab_size 561580 (19.70s/35.12m) [Shuffling 94] loss 5078823.5000 lr 0.0018 vocab_size 561580 (19.63s/35.10m) [Shuffling 95] loss 5178437.0000 lr 0.0016 vocab_size 561580 (19.74s/35.09m) [Shuffling 96] loss 5185518.0000 lr 0.0013 vocab_size 561580 (19.87s/35.07m) [Shuffling 97] loss 5239706.5000 lr 0.0011 vocab_size 561580 (20.46s/35.07m) [Shuffling 98] loss 5200798.0000 lr 0.0008 vocab_size 561580 (38.62s/35.38m) [Shuffling 99] loss 5158101.5000 lr 0.0006 vocab_size 561580 (37.83s/35.66m) [Shuffling 100] loss 5074135.0000 lr 0.0003 vocab_size 561580 (38.51s/35.95m) [03/29/24-12:51:32] Training finished, training Time 35.95m