num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/5W100D-0.1000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/5W100D-0.1000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/5W100D-0.1000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/5W100D-0.1000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/5W100D-0.1000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.1, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-19:30:40] Start training [03/12/24-19:30:40] Building vocabulary [03/12/24-19:31:13] Vocabulary size is 426964 [Shuffling 1] loss 7616076.5000 lr 0.1000 vocab_size 426964 (16.72s/28.42m) [Shuffling 2] loss 6157696.5000 lr 0.0990 vocab_size 426964 (16.41s/28.17m) [Shuffling 3] loss 6244905.5000 lr 0.0980 vocab_size 426964 (16.18s/27.95m) [Shuffling 4] loss 5853205.5000 lr 0.0970 vocab_size 426964 (15.86s/27.71m) [Shuffling 5] loss 5888524.0000 lr 0.0960 vocab_size 426964 (15.81s/27.55m) [Shuffling 6] loss 5792016.5000 lr 0.0950 vocab_size 426964 (16.07s/27.51m) [Shuffling 7] loss 5750786.0000 lr 0.0940 vocab_size 426964 (15.86s/27.44m) [Shuffling 8] loss 5609713.0000 lr 0.0930 vocab_size 426964 (16.07s/27.43m) [Shuffling 9] loss 5295289.5000 lr 0.0920 vocab_size 426964 (16.49s/27.50m) [Shuffling 10] loss 5586894.0000 lr 0.0910 vocab_size 426964 (15.08s/27.31m) [Shuffling 11] loss 5698693.5000 lr 0.0900 vocab_size 426964 (14.56s/27.09m) [Shuffling 12] loss 5620903.0000 lr 0.0890 vocab_size 426964 (15.25s/26.99m) [Shuffling 13] loss 5680840.0000 lr 0.0880 vocab_size 426964 (15.18s/26.91m) [Shuffling 14] loss 5742256.0000 lr 0.0870 vocab_size 426964 (15.10s/26.82m) [Shuffling 15] loss 5544804.0000 lr 0.0860 vocab_size 426964 (15.13s/26.75m) [Shuffling 16] loss 5611197.5000 lr 0.0850 vocab_size 426964 (15.47s/26.73m) [Shuffling 17] loss 5510222.5000 lr 0.0840 vocab_size 426964 (16.34s/26.79m) [Shuffling 18] loss 5719323.5000 lr 0.0830 vocab_size 426964 (15.66s/26.78m) [Shuffling 19] loss 5666702.5000 lr 0.0820 vocab_size 426964 (15.00s/26.72m) [Shuffling 20] loss 5529984.5000 lr 0.0810 vocab_size 426964 (15.34s/26.69m) [Shuffling 21] loss 5618876.5000 lr 0.0800 vocab_size 426964 (16.56s/26.76m) [Shuffling 22] loss 5676281.0000 lr 0.0790 vocab_size 426964 (15.10s/26.71m) [Shuffling 23] loss 5610216.0000 lr 0.0780 vocab_size 426964 (14.70s/26.64m) [Shuffling 24] loss 5651319.5000 lr 0.0770 vocab_size 426964 (15.15s/26.60m) [Shuffling 25] loss 5566846.0000 lr 0.0760 vocab_size 426964 (15.96s/26.63m) [Shuffling 26] loss 5475455.5000 lr 0.0750 vocab_size 426964 (15.16s/26.60m) [Shuffling 27] loss 5474611.0000 lr 0.0740 vocab_size 426964 (15.11s/26.56m) [Shuffling 28] loss 5535674.0000 lr 0.0730 vocab_size 426964 (15.08s/26.53m) [Shuffling 29] loss 5504570.5000 lr 0.0720 vocab_size 426964 (15.75s/26.54m) [Shuffling 30] loss 5582834.5000 lr 0.0710 vocab_size 426964 (15.18s/26.52m) [Shuffling 31] loss 5703781.0000 lr 0.0700 vocab_size 426964 (14.99s/26.49m) [Shuffling 32] loss 5545654.5000 lr 0.0690 vocab_size 426964 (16.38s/26.53m) [Shuffling 33] loss 5521118.0000 lr 0.0680 vocab_size 426964 (14.95s/26.50m) [Shuffling 34] loss 5442617.5000 lr 0.0670 vocab_size 426964 (15.60s/26.50m) [Shuffling 35] loss 5378377.0000 lr 0.0660 vocab_size 426964 (15.42s/26.49m) [Shuffling 36] loss 5378904.5000 lr 0.0650 vocab_size 426964 (15.06s/26.47m) [Shuffling 37] loss 5615319.5000 lr 0.0640 vocab_size 426964 (15.39s/26.46m) [Shuffling 38] loss 5496750.0000 lr 0.0630 vocab_size 426964 (16.16s/26.49m) [Shuffling 39] loss 5338635.5000 lr 0.0620 vocab_size 426964 (15.04s/26.47m) [Shuffling 40] loss 5511617.0000 lr 0.0610 vocab_size 426964 (15.54s/26.47m) [Shuffling 41] loss 5633185.5000 lr 0.0600 vocab_size 426964 (16.93s/26.52m) [Shuffling 42] loss 5184882.5000 lr 0.0590 vocab_size 426964 (16.19s/26.55m) [Shuffling 43] loss 5285525.5000 lr 0.0580 vocab_size 426964 (15.85s/26.56m) [Shuffling 44] loss 5324909.5000 lr 0.0570 vocab_size 426964 (15.19s/26.54m) [Shuffling 45] loss 5329468.0000 lr 0.0560 vocab_size 426964 (15.79s/26.55m) [Shuffling 46] loss 5375152.0000 lr 0.0550 vocab_size 426964 (15.90s/26.56m) [Shuffling 47] loss 5324046.5000 lr 0.0540 vocab_size 426964 (14.96s/26.54m) [Shuffling 48] loss 5362057.5000 lr 0.0530 vocab_size 426964 (15.76s/26.54m) [Shuffling 49] loss 5521577.0000 lr 0.0520 vocab_size 426964 (15.23s/26.53m) [Shuffling 50] loss 5250165.0000 lr 0.0510 vocab_size 426964 (14.84s/26.51m) [Shuffling 51] loss 5223370.5000 lr 0.0500 vocab_size 426964 (15.49s/26.50m) [Shuffling 52] loss 5333026.0000 lr 0.0491 vocab_size 426964 (16.46s/26.53m) [Shuffling 53] loss 5216573.0000 lr 0.0481 vocab_size 426964 (15.88s/26.54m) [Shuffling 54] loss 5308199.5000 lr 0.0471 vocab_size 426964 (14.97s/26.52m) [Shuffling 55] loss 5200108.0000 lr 0.0461 vocab_size 426964 (16.12s/26.54m) [Shuffling 56] loss 5206328.0000 lr 0.0451 vocab_size 426964 (16.17s/26.56m) [Shuffling 57] loss 5203778.5000 lr 0.0441 vocab_size 426964 (14.93s/26.54m) [Shuffling 58] loss 5257932.0000 lr 0.0431 vocab_size 426964 (14.78s/26.51m) [Shuffling 59] loss 5185883.0000 lr 0.0421 vocab_size 426964 (15.46s/26.51m) [Shuffling 60] loss 5242276.0000 lr 0.0411 vocab_size 426964 (14.90s/26.49m) [Shuffling 61] loss 5321947.0000 lr 0.0401 vocab_size 426964 (14.86s/26.47m) [Shuffling 62] loss 5106376.5000 lr 0.0391 vocab_size 426964 (16.44s/26.50m) [Shuffling 63] loss 5263136.0000 lr 0.0381 vocab_size 426964 (14.73s/26.47m) [Shuffling 64] loss 5169705.5000 lr 0.0371 vocab_size 426964 (16.22s/26.49m) [Shuffling 65] loss 5201674.5000 lr 0.0361 vocab_size 426964 (16.65s/26.52m) [Shuffling 66] loss 4906939.0000 lr 0.0351 vocab_size 426964 (16.09s/26.53m) [Shuffling 67] loss 5194147.0000 lr 0.0341 vocab_size 426964 (16.82s/26.56m) [Shuffling 68] loss 5099580.5000 lr 0.0331 vocab_size 426964 (16.10s/26.57m) [Shuffling 69] loss 5206167.5000 lr 0.0321 vocab_size 426964 (15.64s/26.57m) [Shuffling 70] loss 5175441.0000 lr 0.0311 vocab_size 426964 (15.74s/26.58m) [Shuffling 71] loss 5209177.5000 lr 0.0301 vocab_size 426964 (15.73s/26.58m) [Shuffling 72] loss 5077558.0000 lr 0.0291 vocab_size 426964 (15.80s/26.58m) [Shuffling 73] loss 5152244.0000 lr 0.0281 vocab_size 426964 (16.77s/26.61m) [Shuffling 74] loss 5156147.5000 lr 0.0271 vocab_size 426964 (15.99s/26.62m) [Shuffling 75] loss 4947013.0000 lr 0.0261 vocab_size 426964 (15.80s/26.62m) [Shuffling 76] loss 4955556.0000 lr 0.0251 vocab_size 426964 (15.68s/26.62m) [Shuffling 77] loss 5134069.5000 lr 0.0241 vocab_size 426964 (15.32s/26.62m) [Shuffling 78] loss 5135518.0000 lr 0.0231 vocab_size 426964 (15.22s/26.61m) [Shuffling 79] loss 5138557.5000 lr 0.0221 vocab_size 426964 (15.87s/26.61m) [Shuffling 80] loss 5053268.5000 lr 0.0211 vocab_size 426964 (15.37s/26.61m) [Shuffling 81] loss 4992400.0000 lr 0.0201 vocab_size 426964 (14.85s/26.59m) [Shuffling 82] loss 5136673.5000 lr 0.0191 vocab_size 426964 (14.71s/26.57m) [Shuffling 83] loss 4997953.5000 lr 0.0181 vocab_size 426964 (15.36s/26.57m) [Shuffling 84] loss 5044947.5000 lr 0.0171 vocab_size 426964 (14.36s/26.54m) [Shuffling 85] loss 4897772.5000 lr 0.0161 vocab_size 426964 (16.58s/26.56m) [Shuffling 86] loss 5063080.5000 lr 0.0151 vocab_size 426964 (15.38s/26.56m) [Shuffling 87] loss 4964702.0000 lr 0.0141 vocab_size 426964 (14.29s/26.53m) [Shuffling 88] loss 4988800.5000 lr 0.0131 vocab_size 426964 (14.56s/26.51m) [Shuffling 89] loss 4968428.5000 lr 0.0121 vocab_size 426964 (15.20s/26.51m) [Shuffling 90] loss 5069223.5000 lr 0.0111 vocab_size 426964 (14.50s/26.49m) [Shuffling 91] loss 4928936.0000 lr 0.0101 vocab_size 426964 (14.75s/26.47m) [Shuffling 92] loss 4795590.5000 lr 0.0091 vocab_size 426964 (15.10s/26.46m) [Shuffling 93] loss 4893705.5000 lr 0.0081 vocab_size 426964 (14.95s/26.45m) [Shuffling 94] loss 4971215.0000 lr 0.0071 vocab_size 426964 (17.12s/26.48m) [Shuffling 95] loss 4860509.5000 lr 0.0061 vocab_size 426964 (32.40s/26.78m) [Shuffling 96] loss 4846771.5000 lr 0.0051 vocab_size 426964 (30.55s/27.03m) [Shuffling 97] loss 4861170.5000 lr 0.0041 vocab_size 426964 (40.84s/27.46m) [Shuffling 98] loss 4853169.5000 lr 0.0031 vocab_size 426964 (31.68s/27.73m) [Shuffling 99] loss 4857522.0000 lr 0.0021 vocab_size 426964 (31.42s/27.98m) [Shuffling 100] loss 4812382.5000 lr 0.0011 vocab_size 426964 (32.06s/28.24m) [03/12/24-19:58:54] Training finished, training Time 28.24m