num_sent_processes: 4 [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/5W10D-0.1000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/5W10D-0.1000r/shuffled_datasets [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/5W10D-0.1000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/5W10D-0.1000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/5W10D-0.1000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.1, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-18:38:18] Start training [03/12/24-18:38:18] Building vocabulary [03/12/24-18:39:11] Vocabulary size is 251084 [Shuffling 1] loss 5607566.5000 lr 0.1000 vocab_size 251084 (13.13s/22.77m) [Shuffling 2] loss 5103551.0000 lr 0.0990 vocab_size 251084 (11.20s/21.20m) [Shuffling 3] loss 4904336.0000 lr 0.0980 vocab_size 251084 (10.49s/20.27m) [Shuffling 4] loss 4810648.5000 lr 0.0970 vocab_size 251084 (10.38s/19.77m) [Shuffling 5] loss 4718834.5000 lr 0.0960 vocab_size 251084 (21.91s/23.30m) [Shuffling 6] loss 4765223.5000 lr 0.0950 vocab_size 251084 (10.14s/22.39m) [Shuffling 7] loss 4688349.0000 lr 0.0940 vocab_size 251084 (10.30s/21.78m) [Shuffling 8] loss 4614223.5000 lr 0.0930 vocab_size 251084 (11.22s/21.51m) [Shuffling 9] loss 4703707.5000 lr 0.0920 vocab_size 251084 (14.14s/21.84m) [Shuffling 10] loss 4696339.5000 lr 0.0910 vocab_size 251084 (10.56s/21.51m) [Shuffling 11] loss 4598309.5000 lr 0.0900 vocab_size 251084 (10.58s/21.24m) [Shuffling 12] loss 4537863.5000 lr 0.0890 vocab_size 251084 (10.92s/21.07m) [Shuffling 13] loss 4589076.5000 lr 0.0880 vocab_size 251084 (14.80s/21.41m) [Shuffling 14] loss 4712185.0000 lr 0.0870 vocab_size 251084 (10.27s/21.18m) [Shuffling 15] loss 4604748.5000 lr 0.0860 vocab_size 251084 (10.30s/20.97m) [Shuffling 16] loss 4495977.5000 lr 0.0850 vocab_size 251084 (10.43s/20.81m) [Shuffling 17] loss 4580600.0000 lr 0.0840 vocab_size 251084 (14.90s/21.10m) [Shuffling 18] loss 4643648.0000 lr 0.0830 vocab_size 251084 (10.24s/20.93m) [Shuffling 19] loss 4573692.0000 lr 0.0820 vocab_size 251084 (10.28s/20.78m) [Shuffling 20] loss 4628000.5000 lr 0.0810 vocab_size 251084 (11.55s/20.75m) [Shuffling 21] loss 4664654.0000 lr 0.0800 vocab_size 251084 (14.41s/20.95m) [Shuffling 22] loss 4647113.0000 lr 0.0790 vocab_size 251084 (10.79s/20.86m) [Shuffling 23] loss 4655322.5000 lr 0.0780 vocab_size 251084 (10.70s/20.77m) [Shuffling 24] loss 4687471.0000 lr 0.0770 vocab_size 251084 (10.83s/20.69m) [Shuffling 25] loss 4462161.0000 lr 0.0760 vocab_size 251084 (14.26s/20.85m) [Shuffling 26] loss 4491043.0000 lr 0.0750 vocab_size 251084 (10.77s/20.78m) [Shuffling 27] loss 4767868.0000 lr 0.0740 vocab_size 251084 (10.53s/20.69m) [Shuffling 28] loss 4627831.0000 lr 0.0730 vocab_size 251084 (10.23s/20.60m) [Shuffling 29] loss 4529459.0000 lr 0.0720 vocab_size 251084 (14.71s/20.76m) [Shuffling 30] loss 4557134.0000 lr 0.0710 vocab_size 251084 (10.46s/20.68m) [Shuffling 31] loss 4567979.5000 lr 0.0700 vocab_size 251084 (10.49s/20.61m) [Shuffling 32] loss 4568608.0000 lr 0.0690 vocab_size 251084 (10.70s/20.55m) [Shuffling 33] loss 4543689.0000 lr 0.0680 vocab_size 251084 (14.56s/20.69m) [Shuffling 34] loss 4483040.5000 lr 0.0670 vocab_size 251084 (10.14s/20.61m) [Shuffling 35] loss 4577320.0000 lr 0.0660 vocab_size 251084 (11.65s/20.60m) [Shuffling 36] loss 4651064.0000 lr 0.0650 vocab_size 251084 (10.25s/20.53m) [Shuffling 37] loss 4506591.5000 lr 0.0640 vocab_size 251084 (15.48s/20.69m) [Shuffling 38] loss 4687739.0000 lr 0.0630 vocab_size 251084 (10.73s/20.64m) [Shuffling 39] loss 4569705.5000 lr 0.0620 vocab_size 251084 (10.56s/20.59m) [Shuffling 40] loss 4630517.5000 lr 0.0610 vocab_size 251084 (10.62s/20.54m) [Shuffling 41] loss 4489189.5000 lr 0.0600 vocab_size 251084 (15.78s/20.71m) [Shuffling 42] loss 4476479.0000 lr 0.0590 vocab_size 251084 (10.31s/20.64m) [Shuffling 43] loss 4585034.5000 lr 0.0580 vocab_size 251084 (10.84s/20.60m) [Shuffling 44] loss 4446546.5000 lr 0.0570 vocab_size 251084 (11.39s/20.59m) [Shuffling 45] loss 4399828.5000 lr 0.0560 vocab_size 251084 (12.89s/20.63m) [Shuffling 46] loss 4539546.5000 lr 0.0550 vocab_size 251084 (10.33s/20.57m) [Shuffling 47] loss 4480405.0000 lr 0.0540 vocab_size 251084 (11.49s/20.56m) [Shuffling 48] loss 4640781.0000 lr 0.0530 vocab_size 251084 (11.81s/20.57m) [Shuffling 49] loss 4542418.5000 lr 0.0520 vocab_size 251084 (11.44s/20.55m) [Shuffling 50] loss 4495597.5000 lr 0.0510 vocab_size 251084 (11.38s/20.54m) [Shuffling 51] loss 4494408.0000 lr 0.0500 vocab_size 251084 (11.75s/20.54m) [Shuffling 52] loss 4345178.5000 lr 0.0491 vocab_size 251084 (11.83s/20.54m) [Shuffling 53] loss 4464456.5000 lr 0.0481 vocab_size 251084 (11.40s/20.53m) [Shuffling 54] loss 4513614.5000 lr 0.0471 vocab_size 251084 (10.76s/20.50m) [Shuffling 55] loss 4493371.5000 lr 0.0461 vocab_size 251084 (13.14s/20.54m) [Shuffling 56] loss 4466283.0000 lr 0.0451 vocab_size 251084 (10.22s/20.50m) [Shuffling 57] loss 4519461.5000 lr 0.0441 vocab_size 251084 (13.82s/20.56m) [Shuffling 58] loss 4410075.0000 lr 0.0431 vocab_size 251084 (11.35s/20.54m) [Shuffling 59] loss 4492719.5000 lr 0.0421 vocab_size 251084 (10.36s/20.50m) [Shuffling 60] loss 4455808.0000 lr 0.0411 vocab_size 251084 (10.04s/20.46m) [Shuffling 61] loss 4474439.5000 lr 0.0401 vocab_size 251084 (14.86s/20.54m) [Shuffling 62] loss 4602468.5000 lr 0.0391 vocab_size 251084 (10.63s/20.51m) [Shuffling 63] loss 4474255.0000 lr 0.0381 vocab_size 251084 (11.35s/20.50m) [Shuffling 64] loss 4304009.0000 lr 0.0371 vocab_size 251084 (10.57s/20.47m) [Shuffling 65] loss 4641076.0000 lr 0.0361 vocab_size 251084 (15.31s/20.56m) [Shuffling 66] loss 4494844.0000 lr 0.0351 vocab_size 251084 (10.49s/20.53m) [Shuffling 67] loss 4398895.0000 lr 0.0341 vocab_size 251084 (10.65s/20.50m) [Shuffling 68] loss 4512666.5000 lr 0.0331 vocab_size 251084 (11.25s/20.49m) [Shuffling 69] loss 4464630.0000 lr 0.0321 vocab_size 251084 (15.46s/20.58m) [Shuffling 70] loss 4454206.5000 lr 0.0311 vocab_size 251084 (10.75s/20.56m) [Shuffling 71] loss 4444336.5000 lr 0.0301 vocab_size 251084 (10.61s/20.53m) [Shuffling 72] loss 4453803.0000 lr 0.0291 vocab_size 251084 (10.47s/20.50m) [Shuffling 73] loss 4337245.0000 lr 0.0281 vocab_size 251084 (16.43s/20.61m) [Shuffling 74] loss 4495448.0000 lr 0.0271 vocab_size 251084 (10.50s/20.58m) [Shuffling 75] loss 4399961.0000 lr 0.0261 vocab_size 251084 (10.34s/20.54m) [Shuffling 76] loss 4439011.5000 lr 0.0251 vocab_size 251084 (11.61s/20.54m) [Shuffling 77] loss 4286164.0000 lr 0.0241 vocab_size 251084 (16.10s/20.63m) [Shuffling 78] loss 4461304.5000 lr 0.0231 vocab_size 251084 (11.69s/20.63m) [Shuffling 79] loss 4428704.0000 lr 0.0221 vocab_size 251084 (10.45s/20.60m) [Shuffling 80] loss 4394673.5000 lr 0.0211 vocab_size 251084 (10.82s/20.58m) [Shuffling 81] loss 4469294.5000 lr 0.0201 vocab_size 251084 (12.37s/20.59m) [Shuffling 82] loss 4352492.0000 lr 0.0191 vocab_size 251084 (13.40s/20.63m) [Shuffling 83] loss 4521076.5000 lr 0.0181 vocab_size 251084 (10.33s/20.60m) [Shuffling 84] loss 4487729.5000 lr 0.0171 vocab_size 251084 (10.40s/20.57m) [Shuffling 85] loss 4302050.0000 lr 0.0161 vocab_size 251084 (12.38s/20.58m) [Shuffling 86] loss 4454384.0000 lr 0.0151 vocab_size 251084 (12.66s/20.60m) [Shuffling 87] loss 4580400.0000 lr 0.0141 vocab_size 251084 (11.67s/20.59m) [Shuffling 88] loss 4456350.5000 lr 0.0131 vocab_size 251084 (10.29s/20.57m) [Shuffling 89] loss 4336866.0000 lr 0.0121 vocab_size 251084 (12.34s/20.58m) [Shuffling 90] loss 4439886.0000 lr 0.0111 vocab_size 251084 (12.46s/20.59m) [Shuffling 91] loss 4237507.5000 lr 0.0101 vocab_size 251084 (11.58s/20.58m) [Shuffling 92] loss 4405025.0000 lr 0.0091 vocab_size 251084 (10.10s/20.55m) [Shuffling 93] loss 4369281.0000 lr 0.0081 vocab_size 251084 (12.92s/20.57m) [Shuffling 94] loss 4282467.0000 lr 0.0071 vocab_size 251084 (11.22s/20.56m) [Shuffling 95] loss 4326854.5000 lr 0.0061 vocab_size 251084 (11.29s/20.56m) [Shuffling 96] loss 4509823.0000 lr 0.0051 vocab_size 251084 (10.60s/20.54m) [Shuffling 97] loss 4421838.0000 lr 0.0041 vocab_size 251084 (13.76s/20.57m) [Shuffling 98] loss 4382060.0000 lr 0.0031 vocab_size 251084 (11.41s/20.56m) [Shuffling 99] loss 4363784.0000 lr 0.0021 vocab_size 251084 (10.33s/20.54m) [Shuffling 100] loss 4555403.5000 lr 0.0011 vocab_size 251084 (12.67s/20.55m) [03/12/24-18:58:52] Training finished, training Time 20.56m