num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W100D-0.1000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W100D-0.1000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W100D-0.1000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W100D-0.1000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W100D-0.1000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.1, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-19:59:00] Start training [03/12/24-19:59:00] Building vocabulary [03/12/24-19:59:33] Vocabulary size is 426964 [Shuffling 1] loss 6977918.5000 lr 0.1000 vocab_size 426964 (20.28s/34.36m) [Shuffling 2] loss 5571443.0000 lr 0.0990 vocab_size 426964 (19.81s/33.96m) [Shuffling 3] loss 5199137.5000 lr 0.0980 vocab_size 426964 (19.30s/33.55m) [Shuffling 4] loss 5422201.5000 lr 0.0970 vocab_size 426964 (18.68s/33.09m) [Shuffling 5] loss 5598246.5000 lr 0.0960 vocab_size 426964 (19.11s/32.95m) [Shuffling 6] loss 5527609.0000 lr 0.0950 vocab_size 426964 (19.19s/32.88m) [Shuffling 7] loss 5295090.5000 lr 0.0940 vocab_size 426964 (18.98s/32.79m) [Shuffling 8] loss 5049363.0000 lr 0.0930 vocab_size 426964 (20.08s/32.94m) [Shuffling 9] loss 5465353.5000 lr 0.0920 vocab_size 426964 (18.80s/32.82m) [Shuffling 10] loss 5019065.5000 lr 0.0910 vocab_size 426964 (19.38s/32.83m) [Shuffling 11] loss 5622579.5000 lr 0.0900 vocab_size 426964 (19.52s/32.85m) [Shuffling 12] loss 5645819.0000 lr 0.0890 vocab_size 426964 (17.36s/32.57m) [Shuffling 13] loss 5546137.0000 lr 0.0880 vocab_size 426964 (19.09s/32.56m) [Shuffling 14] loss 5408557.5000 lr 0.0870 vocab_size 426964 (18.79s/32.51m) [Shuffling 15] loss 5732185.5000 lr 0.0860 vocab_size 426964 (18.71s/32.46m) [Shuffling 16] loss 5680744.5000 lr 0.0850 vocab_size 426964 (19.29s/32.48m) [Shuffling 17] loss 5709338.0000 lr 0.0840 vocab_size 426964 (18.95s/32.46m) [Shuffling 18] loss 5702988.5000 lr 0.0830 vocab_size 426964 (17.84s/32.34m) [Shuffling 19] loss 5517909.5000 lr 0.0820 vocab_size 426964 (18.47s/32.29m) [Shuffling 20] loss 5821690.5000 lr 0.0810 vocab_size 426964 (18.56s/32.25m) [Shuffling 21] loss 5830165.0000 lr 0.0800 vocab_size 426964 (18.73s/32.23m) [Shuffling 22] loss 5672672.0000 lr 0.0790 vocab_size 426964 (18.03s/32.15m) [Shuffling 23] loss 5642386.5000 lr 0.0780 vocab_size 426964 (18.43s/32.12m) [Shuffling 24] loss 5834988.5000 lr 0.0770 vocab_size 426964 (18.53s/32.09m) [Shuffling 25] loss 5295958.5000 lr 0.0760 vocab_size 426964 (18.52s/32.06m) [Shuffling 26] loss 5608242.5000 lr 0.0750 vocab_size 426964 (18.92s/32.06m) [Shuffling 27] loss 5812261.0000 lr 0.0740 vocab_size 426964 (18.66s/32.05m) [Shuffling 28] loss 5454248.0000 lr 0.0730 vocab_size 426964 (17.91s/31.99m) [Shuffling 29] loss 4754018.0000 lr 0.0720 vocab_size 426964 (19.85s/32.05m) [Shuffling 30] loss 5532770.0000 lr 0.0710 vocab_size 426964 (19.16s/32.06m) [Shuffling 31] loss 5033941.0000 lr 0.0700 vocab_size 426964 (19.05s/32.07m) [Shuffling 32] loss 5333005.0000 lr 0.0690 vocab_size 426964 (19.18s/32.08m) [Shuffling 33] loss 5097244.5000 lr 0.0680 vocab_size 426964 (18.98s/32.09m) [Shuffling 34] loss 5310298.0000 lr 0.0670 vocab_size 426964 (18.89s/32.09m) [Shuffling 35] loss 5324458.5000 lr 0.0660 vocab_size 426964 (18.85s/32.08m) [Shuffling 36] loss 5386723.5000 lr 0.0650 vocab_size 426964 (19.11s/32.09m) [Shuffling 37] loss 5373458.5000 lr 0.0640 vocab_size 426964 (18.73s/32.08m) [Shuffling 38] loss 5079094.0000 lr 0.0630 vocab_size 426964 (18.67s/32.07m) [Shuffling 39] loss 5414815.5000 lr 0.0620 vocab_size 426964 (18.40s/32.05m) [Shuffling 40] loss 5049858.0000 lr 0.0610 vocab_size 426964 (18.90s/32.05m) [Shuffling 41] loss 4959089.5000 lr 0.0600 vocab_size 426964 (19.69s/32.08m) [Shuffling 42] loss 5275331.0000 lr 0.0590 vocab_size 426964 (18.76s/32.08m) [Shuffling 43] loss 5211968.0000 lr 0.0580 vocab_size 426964 (17.87s/32.04m) [Shuffling 44] loss 5090267.0000 lr 0.0570 vocab_size 426964 (18.07s/32.01m) [Shuffling 45] loss 5169250.5000 lr 0.0560 vocab_size 426964 (18.60s/32.00m) [Shuffling 46] loss 5076476.0000 lr 0.0550 vocab_size 426964 (18.41s/31.98m) [Shuffling 47] loss 5351355.0000 lr 0.0540 vocab_size 426964 (19.02s/31.99m) [Shuffling 48] loss 5134047.0000 lr 0.0530 vocab_size 426964 (18.38s/31.97m) [Shuffling 49] loss 5074255.0000 lr 0.0520 vocab_size 426964 (19.19s/31.98m) [Shuffling 50] loss 5407643.0000 lr 0.0510 vocab_size 426964 (19.48s/32.00m) [Shuffling 51] loss 4961870.5000 lr 0.0500 vocab_size 426964 (19.06s/32.01m) [Shuffling 52] loss 5020284.5000 lr 0.0491 vocab_size 426964 (18.43s/32.00m) [Shuffling 53] loss 5015211.0000 lr 0.0481 vocab_size 426964 (18.51s/31.98m) [Shuffling 54] loss 4907325.5000 lr 0.0471 vocab_size 426964 (18.73s/31.98m) [Shuffling 55] loss 5165220.0000 lr 0.0461 vocab_size 426964 (19.05s/31.99m) [Shuffling 56] loss 5153716.5000 lr 0.0451 vocab_size 426964 (19.32s/32.00m) [Shuffling 57] loss 5097389.0000 lr 0.0441 vocab_size 426964 (18.83s/32.00m) [Shuffling 58] loss 4986504.5000 lr 0.0431 vocab_size 426964 (19.02s/32.00m) [Shuffling 59] loss 5132455.0000 lr 0.0421 vocab_size 426964 (18.87s/32.00m) [Shuffling 60] loss 5045211.5000 lr 0.0411 vocab_size 426964 (18.71s/32.00m) [Shuffling 61] loss 4591938.0000 lr 0.0401 vocab_size 426964 (19.37s/32.01m) [Shuffling 62] loss 4894570.5000 lr 0.0391 vocab_size 426964 (19.02s/32.02m) [Shuffling 63] loss 4855232.0000 lr 0.0381 vocab_size 426964 (18.89s/32.02m) [Shuffling 64] loss 4843413.5000 lr 0.0371 vocab_size 426964 (18.95s/32.02m) [Shuffling 65] loss 4594517.0000 lr 0.0361 vocab_size 426964 (19.01s/32.02m) [Shuffling 66] loss 4853488.5000 lr 0.0351 vocab_size 426964 (18.41s/32.01m) [Shuffling 67] loss 4861976.5000 lr 0.0341 vocab_size 426964 (18.39s/32.00m) [Shuffling 68] loss 4974045.5000 lr 0.0331 vocab_size 426964 (18.96s/32.00m) [Shuffling 69] loss 4822225.0000 lr 0.0321 vocab_size 426964 (19.06s/32.01m) [Shuffling 70] loss 4777177.0000 lr 0.0311 vocab_size 426964 (19.06s/32.01m) [Shuffling 71] loss 4632253.5000 lr 0.0301 vocab_size 426964 (19.02s/32.02m) [Shuffling 72] loss 4635836.0000 lr 0.0291 vocab_size 426964 (18.76s/32.01m) [Shuffling 73] loss 4831696.0000 lr 0.0281 vocab_size 426964 (18.71s/32.01m) [Shuffling 74] loss 4605877.0000 lr 0.0271 vocab_size 426964 (18.61s/32.00m) [Shuffling 75] loss 4861431.5000 lr 0.0261 vocab_size 426964 (19.66s/32.02m) [Shuffling 76] loss 4642500.0000 lr 0.0251 vocab_size 426964 (19.45s/32.03m) [Shuffling 77] loss 4645953.5000 lr 0.0241 vocab_size 426964 (18.36s/32.02m) [Shuffling 78] loss 4628594.5000 lr 0.0231 vocab_size 426964 (18.13s/32.01m) [Shuffling 79] loss 4587994.5000 lr 0.0221 vocab_size 426964 (19.59s/32.02m) [Shuffling 80] loss 4640355.0000 lr 0.0211 vocab_size 426964 (18.95s/32.02m) [Shuffling 81] loss 4811040.0000 lr 0.0201 vocab_size 426964 (18.75s/32.02m) [Shuffling 82] loss 4483875.5000 lr 0.0191 vocab_size 426964 (19.69s/32.04m) [Shuffling 83] loss 4658715.0000 lr 0.0181 vocab_size 426964 (18.96s/32.04m) [Shuffling 84] loss 4178246.2500 lr 0.0171 vocab_size 426964 (19.25s/32.05m) [Shuffling 85] loss 4408181.5000 lr 0.0161 vocab_size 426964 (19.30s/32.05m) [Shuffling 86] loss 4515101.5000 lr 0.0151 vocab_size 426964 (18.53s/32.05m) [Shuffling 87] loss 4586145.0000 lr 0.0141 vocab_size 426964 (19.06s/32.05m) [Shuffling 88] loss 4539172.0000 lr 0.0131 vocab_size 426964 (18.93s/32.05m) [Shuffling 89] loss 3997032.5000 lr 0.0121 vocab_size 426964 (19.62s/32.06m) [Shuffling 90] loss 4544311.0000 lr 0.0111 vocab_size 426964 (19.09s/32.07m) [Shuffling 91] loss 4508314.0000 lr 0.0101 vocab_size 426964 (17.69s/32.05m) [Shuffling 92] loss 4046238.2500 lr 0.0091 vocab_size 426964 (18.96s/32.05m) [Shuffling 93] loss 4231532.5000 lr 0.0081 vocab_size 426964 (18.37s/32.04m) [Shuffling 94] loss 4438155.0000 lr 0.0071 vocab_size 426964 (17.93s/32.02m) [Shuffling 95] loss 4263619.0000 lr 0.0061 vocab_size 426964 (19.48s/32.03m) [Shuffling 96] loss 4489444.5000 lr 0.0051 vocab_size 426964 (18.58s/32.03m) [Shuffling 97] loss 4204875.0000 lr 0.0041 vocab_size 426964 (27.00s/32.17m) [Shuffling 98] loss 4447506.5000 lr 0.0031 vocab_size 426964 (34.59s/32.43m) [Shuffling 99] loss 4484617.0000 lr 0.0021 vocab_size 426964 (34.52s/32.69m) [Shuffling 100] loss 4375214.0000 lr 0.0011 vocab_size 426964 (52.38s/33.24m) [03/12/24-20:32:14] Training finished, training Time 33.24m