num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.1000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.1000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.1000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.1000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.1000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.1, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-19:02:44] Start training [03/12/24-19:02:44] Building vocabulary [03/12/24-19:03:20] Vocabulary size is 426964 [Shuffling 1] loss 6519970.0000 lr 0.1000 vocab_size 426964 (19.22s/32.62m) [Shuffling 2] loss 5850717.5000 lr 0.0990 vocab_size 426964 (17.44s/31.15m) [Shuffling 3] loss 5781805.5000 lr 0.0980 vocab_size 426964 (17.12s/30.48m) [Shuffling 4] loss 5605533.0000 lr 0.0970 vocab_size 426964 (16.01s/29.68m) [Shuffling 5] loss 5486613.5000 lr 0.0960 vocab_size 426964 (16.88s/29.49m) [Shuffling 6] loss 5519983.0000 lr 0.0950 vocab_size 426964 (16.15s/29.16m) [Shuffling 7] loss 5444979.5000 lr 0.0940 vocab_size 426964 (16.14s/28.93m) [Shuffling 8] loss 5374084.5000 lr 0.0930 vocab_size 426964 (15.61s/28.64m) [Shuffling 9] loss 5383804.0000 lr 0.0920 vocab_size 426964 (15.67s/28.42m) [Shuffling 10] loss 5211450.0000 lr 0.0910 vocab_size 426964 (15.79s/28.27m) [Shuffling 11] loss 5282586.5000 lr 0.0900 vocab_size 426964 (15.52s/28.11m) [Shuffling 12] loss 5470979.0000 lr 0.0890 vocab_size 426964 (15.96s/28.03m) [Shuffling 13] loss 5003948.0000 lr 0.0880 vocab_size 426964 (16.88s/28.09m) [Shuffling 14] loss 5130793.0000 lr 0.0870 vocab_size 426964 (16.12s/28.04m) [Shuffling 15] loss 5255926.5000 lr 0.0860 vocab_size 426964 (16.35s/28.03m) [Shuffling 16] loss 5309530.5000 lr 0.0850 vocab_size 426964 (16.64s/28.05m) [Shuffling 17] loss 5369836.0000 lr 0.0840 vocab_size 426964 (16.23s/28.03m) [Shuffling 18] loss 5356788.5000 lr 0.0830 vocab_size 426964 (16.38s/28.02m) [Shuffling 19] loss 5104706.0000 lr 0.0820 vocab_size 426964 (16.17s/28.00m) [Shuffling 20] loss 4858496.5000 lr 0.0810 vocab_size 426964 (17.39s/28.07m) [Shuffling 21] loss 5285874.0000 lr 0.0800 vocab_size 426964 (15.99s/28.04m) [Shuffling 22] loss 5192319.0000 lr 0.0790 vocab_size 426964 (16.58s/28.04m) [Shuffling 23] loss 5273592.0000 lr 0.0780 vocab_size 426964 (16.84s/28.07m) [Shuffling 24] loss 5254416.0000 lr 0.0770 vocab_size 426964 (16.02s/28.04m) [Shuffling 25] loss 5266612.5000 lr 0.0760 vocab_size 426964 (16.16s/28.02m) [Shuffling 26] loss 5213316.5000 lr 0.0750 vocab_size 426964 (16.13s/28.00m) [Shuffling 27] loss 5272203.5000 lr 0.0740 vocab_size 426964 (16.21s/27.99m) [Shuffling 28] loss 5270368.0000 lr 0.0730 vocab_size 426964 (16.02s/27.96m) [Shuffling 29] loss 5191599.5000 lr 0.0720 vocab_size 426964 (16.17s/27.95m) [Shuffling 30] loss 5232018.0000 lr 0.0710 vocab_size 426964 (17.10s/27.99m) [Shuffling 31] loss 4906903.0000 lr 0.0700 vocab_size 426964 (16.26s/27.98m) [Shuffling 32] loss 5315710.5000 lr 0.0690 vocab_size 426964 (16.78s/27.99m) [Shuffling 33] loss 5148156.0000 lr 0.0680 vocab_size 426964 (15.88s/27.97m) [Shuffling 34] loss 5177304.0000 lr 0.0670 vocab_size 426964 (15.98s/27.94m) [Shuffling 35] loss 5171642.5000 lr 0.0660 vocab_size 426964 (16.69s/27.96m) [Shuffling 36] loss 5287346.0000 lr 0.0650 vocab_size 426964 (16.09s/27.94m) [Shuffling 37] loss 5078775.0000 lr 0.0640 vocab_size 426964 (15.60s/27.91m) [Shuffling 38] loss 5153599.5000 lr 0.0630 vocab_size 426964 (15.85s/27.88m) [Shuffling 39] loss 5202200.0000 lr 0.0620 vocab_size 426964 (16.37s/27.88m) [Shuffling 40] loss 5034169.0000 lr 0.0610 vocab_size 426964 (15.49s/27.85m) [Shuffling 41] loss 4989065.5000 lr 0.0600 vocab_size 426964 (15.19s/27.80m) [Shuffling 42] loss 5214162.5000 lr 0.0590 vocab_size 426964 (16.63s/27.81m) [Shuffling 43] loss 5134303.5000 lr 0.0580 vocab_size 426964 (16.83s/27.83m) [Shuffling 44] loss 5187135.5000 lr 0.0570 vocab_size 426964 (16.81s/27.85m) [Shuffling 45] loss 5137158.5000 lr 0.0560 vocab_size 426964 (15.79s/27.83m) [Shuffling 46] loss 5185249.5000 lr 0.0550 vocab_size 426964 (16.48s/27.83m) [Shuffling 47] loss 5155309.5000 lr 0.0540 vocab_size 426964 (16.90s/27.85m) [Shuffling 48] loss 5052752.0000 lr 0.0530 vocab_size 426964 (16.12s/27.85m) [Shuffling 49] loss 5190666.0000 lr 0.0520 vocab_size 426964 (16.77s/27.86m) [Shuffling 50] loss 5075349.5000 lr 0.0510 vocab_size 426964 (16.19s/27.86m) [Shuffling 51] loss 5199018.0000 lr 0.0500 vocab_size 426964 (16.10s/27.85m) [Shuffling 52] loss 5042297.0000 lr 0.0491 vocab_size 426964 (16.50s/27.85m) [Shuffling 53] loss 4947260.5000 lr 0.0481 vocab_size 426964 (16.12s/27.84m) [Shuffling 54] loss 5136523.5000 lr 0.0471 vocab_size 426964 (16.60s/27.85m) [Shuffling 55] loss 5098366.0000 lr 0.0461 vocab_size 426964 (15.87s/27.84m) [Shuffling 56] loss 5149195.0000 lr 0.0451 vocab_size 426964 (15.83s/27.82m) [Shuffling 57] loss 4595576.5000 lr 0.0441 vocab_size 426964 (16.81s/27.84m) [Shuffling 58] loss 5189011.0000 lr 0.0431 vocab_size 426964 (16.66s/27.85m) [Shuffling 59] loss 5035480.0000 lr 0.0421 vocab_size 426964 (15.71s/27.83m) [Shuffling 60] loss 4836037.0000 lr 0.0411 vocab_size 426964 (16.60s/27.84m) [Shuffling 61] loss 4915677.5000 lr 0.0401 vocab_size 426964 (15.70s/27.82m) [Shuffling 62] loss 5098975.0000 lr 0.0391 vocab_size 426964 (16.09s/27.81m) [Shuffling 63] loss 4789105.0000 lr 0.0381 vocab_size 426964 (16.51s/27.82m) [Shuffling 64] loss 5026591.5000 lr 0.0371 vocab_size 426964 (16.44s/27.82m) [Shuffling 65] loss 5042684.5000 lr 0.0361 vocab_size 426964 (16.25s/27.82m) [Shuffling 66] loss 4989478.5000 lr 0.0351 vocab_size 426964 (15.74s/27.80m) [Shuffling 67] loss 4873860.5000 lr 0.0341 vocab_size 426964 (15.99s/27.80m) [Shuffling 68] loss 4883313.0000 lr 0.0331 vocab_size 426964 (16.24s/27.79m) [Shuffling 69] loss 4746431.5000 lr 0.0321 vocab_size 426964 (16.63s/27.80m) [Shuffling 70] loss 4850097.5000 lr 0.0311 vocab_size 426964 (16.55s/27.81m) [Shuffling 71] loss 5049076.0000 lr 0.0301 vocab_size 426964 (16.33s/27.81m) [Shuffling 72] loss 4842568.0000 lr 0.0291 vocab_size 426964 (16.26s/27.81m) [Shuffling 73] loss 4957804.0000 lr 0.0281 vocab_size 426964 (16.35s/27.81m) [Shuffling 74] loss 4937300.5000 lr 0.0271 vocab_size 426964 (16.96s/27.82m) [Shuffling 75] loss 4514941.0000 lr 0.0261 vocab_size 426964 (17.27s/27.84m) [Shuffling 76] loss 4821852.5000 lr 0.0251 vocab_size 426964 (15.37s/27.82m) [Shuffling 77] loss 4895221.5000 lr 0.0241 vocab_size 426964 (15.69s/27.81m) [Shuffling 78] loss 4858259.0000 lr 0.0231 vocab_size 426964 (16.90s/27.82m) [Shuffling 79] loss 4848768.5000 lr 0.0221 vocab_size 426964 (15.40s/27.80m) [Shuffling 80] loss 4933785.5000 lr 0.0211 vocab_size 426964 (15.79s/27.79m) [Shuffling 81] loss 4967731.5000 lr 0.0201 vocab_size 426964 (16.11s/27.78m) [Shuffling 82] loss 4840736.0000 lr 0.0191 vocab_size 426964 (15.55s/27.77m) [Shuffling 83] loss 4769607.5000 lr 0.0181 vocab_size 426964 (15.77s/27.76m) [Shuffling 84] loss 4715250.5000 lr 0.0171 vocab_size 426964 (16.81s/27.77m) [Shuffling 85] loss 4759796.5000 lr 0.0161 vocab_size 426964 (15.21s/27.75m) [Shuffling 86] loss 4578865.0000 lr 0.0151 vocab_size 426964 (16.43s/27.75m) [Shuffling 87] loss 4775591.0000 lr 0.0141 vocab_size 426964 (15.28s/27.73m) [Shuffling 88] loss 4819357.5000 lr 0.0131 vocab_size 426964 (14.79s/27.70m) [Shuffling 89] loss 4830548.5000 lr 0.0121 vocab_size 426964 (15.64s/27.69m) [Shuffling 90] loss 4871511.5000 lr 0.0111 vocab_size 426964 (15.56s/27.68m) [Shuffling 91] loss 4713378.0000 lr 0.0101 vocab_size 426964 (15.25s/27.66m) [Shuffling 92] loss 4785956.0000 lr 0.0091 vocab_size 426964 (15.40s/27.64m) [Shuffling 93] loss 4806198.0000 lr 0.0081 vocab_size 426964 (15.15s/27.63m) [Shuffling 94] loss 4823096.0000 lr 0.0071 vocab_size 426964 (14.58s/27.60m) [Shuffling 95] loss 4783767.5000 lr 0.0061 vocab_size 426964 (15.22s/27.58m) [Shuffling 96] loss 4758469.0000 lr 0.0051 vocab_size 426964 (14.95s/27.56m) [Shuffling 97] loss 4837063.0000 lr 0.0041 vocab_size 426964 (14.68s/27.53m) [Shuffling 98] loss 4666102.0000 lr 0.0031 vocab_size 426964 (15.31s/27.52m) [Shuffling 99] loss 4708189.5000 lr 0.0021 vocab_size 426964 (18.62s/27.56m) [Shuffling 100] loss 4785213.0000 lr 0.0011 vocab_size 426964 (31.59s/27.82m) [03/12/24-19:30:33] Training finished, training Time 27.82m