num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W10D-0.1000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W10D-0.1000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W10D-0.1000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W10D-0.1000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W10D-0.1000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.1, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-18:04:52] Start training [03/12/24-18:04:52] Building vocabulary [03/12/24-18:05:12] Vocabulary size is 232626 [Shuffling 1] loss 5921129.0000 lr 0.1000 vocab_size 232626 (8.18s/13.96m) [Shuffling 2] loss 5283279.0000 lr 0.0990 vocab_size 232626 (8.39s/14.13m) [Shuffling 3] loss 5119356.0000 lr 0.0980 vocab_size 232626 (8.72s/14.37m) [Shuffling 4] loss 5169776.0000 lr 0.0970 vocab_size 232626 (8.40s/14.36m) [Shuffling 5] loss 4887854.5000 lr 0.0960 vocab_size 232626 (8.62s/14.43m) [Shuffling 6] loss 5141533.5000 lr 0.0950 vocab_size 232626 (8.37s/14.40m) [Shuffling 7] loss 4846506.5000 lr 0.0940 vocab_size 232626 (8.51s/14.42m) [Shuffling 8] loss 4898521.5000 lr 0.0930 vocab_size 232626 (8.35s/14.40m) [Shuffling 9] loss 4788714.0000 lr 0.0920 vocab_size 232626 (8.61s/14.43m) [Shuffling 10] loss 4944940.5000 lr 0.0910 vocab_size 232626 (8.27s/14.40m) [Shuffling 11] loss 4865069.0000 lr 0.0900 vocab_size 232626 (8.40s/14.39m) [Shuffling 12] loss 4738668.5000 lr 0.0890 vocab_size 232626 (8.49s/14.40m) [Shuffling 13] loss 4983020.0000 lr 0.0880 vocab_size 232626 (8.40s/14.39m) [Shuffling 14] loss 4788236.5000 lr 0.0870 vocab_size 232626 (8.32s/14.38m) [Shuffling 15] loss 4931725.0000 lr 0.0860 vocab_size 232626 (8.32s/14.37m) [Shuffling 16] loss 4717745.0000 lr 0.0850 vocab_size 232626 (8.39s/14.36m) [Shuffling 17] loss 4828405.0000 lr 0.0840 vocab_size 232626 (8.38s/14.36m) [Shuffling 18] loss 4808572.0000 lr 0.0830 vocab_size 232626 (8.28s/14.35m) [Shuffling 19] loss 4795717.5000 lr 0.0820 vocab_size 232626 (8.33s/14.34m) [Shuffling 20] loss 4665681.5000 lr 0.0810 vocab_size 232626 (8.47s/14.35m) [Shuffling 21] loss 4934074.0000 lr 0.0800 vocab_size 232626 (8.36s/14.34m) [Shuffling 22] loss 4550125.0000 lr 0.0790 vocab_size 232626 (8.56s/14.35m) [Shuffling 23] loss 4805104.0000 lr 0.0780 vocab_size 232626 (8.30s/14.34m) [Shuffling 24] loss 4851702.0000 lr 0.0770 vocab_size 232626 (8.25s/14.33m) [Shuffling 25] loss 4855096.0000 lr 0.0760 vocab_size 232626 (8.44s/14.33m) [Shuffling 26] loss 4612863.5000 lr 0.0750 vocab_size 232626 (8.29s/14.33m) [Shuffling 27] loss 4712112.0000 lr 0.0740 vocab_size 232626 (8.32s/14.32m) [Shuffling 28] loss 4747485.0000 lr 0.0730 vocab_size 232626 (8.36s/14.32m) [Shuffling 29] loss 4716015.0000 lr 0.0720 vocab_size 232626 (8.30s/14.31m) [Shuffling 30] loss 4641280.5000 lr 0.0710 vocab_size 232626 (8.20s/14.30m) [Shuffling 31] loss 4683484.5000 lr 0.0700 vocab_size 232626 (8.31s/14.30m) [Shuffling 32] loss 4679767.5000 lr 0.0690 vocab_size 232626 (8.25s/14.29m) [Shuffling 33] loss 4654778.0000 lr 0.0680 vocab_size 232626 (8.39s/14.29m) [Shuffling 34] loss 4798108.0000 lr 0.0670 vocab_size 232626 (8.39s/14.29m) [Shuffling 35] loss 4656971.5000 lr 0.0660 vocab_size 232626 (8.50s/14.30m) [Shuffling 36] loss 4856850.5000 lr 0.0650 vocab_size 232626 (8.37s/14.30m) [Shuffling 37] loss 4729962.5000 lr 0.0640 vocab_size 232626 (8.27s/14.29m) [Shuffling 38] loss 4660341.5000 lr 0.0630 vocab_size 232626 (8.30s/14.29m) [Shuffling 39] loss 4643632.5000 lr 0.0620 vocab_size 232626 (7.95s/14.27m) [Shuffling 40] loss 4758282.0000 lr 0.0610 vocab_size 232626 (8.23s/14.27m) [Shuffling 41] loss 4711254.5000 lr 0.0600 vocab_size 232626 (8.25s/14.26m) [Shuffling 42] loss 4666383.0000 lr 0.0590 vocab_size 232626 (8.38s/14.26m) [Shuffling 43] loss 4748800.0000 lr 0.0580 vocab_size 232626 (8.43s/14.27m) [Shuffling 44] loss 4766535.5000 lr 0.0570 vocab_size 232626 (8.22s/14.26m) [Shuffling 45] loss 4820274.0000 lr 0.0560 vocab_size 232626 (8.22s/14.25m) [Shuffling 46] loss 4627804.5000 lr 0.0550 vocab_size 232626 (8.38s/14.26m) [Shuffling 47] loss 4636653.0000 lr 0.0540 vocab_size 232626 (8.21s/14.25m) [Shuffling 48] loss 4822030.5000 lr 0.0530 vocab_size 232626 (8.19s/14.24m) [Shuffling 49] loss 4760158.5000 lr 0.0520 vocab_size 232626 (8.43s/14.25m) [Shuffling 50] loss 4570214.5000 lr 0.0510 vocab_size 232626 (8.11s/14.24m) [Shuffling 51] loss 4496357.5000 lr 0.0500 vocab_size 232626 (8.35s/14.24m) [Shuffling 52] loss 4673168.0000 lr 0.0491 vocab_size 232626 (8.35s/14.24m) [Shuffling 53] loss 4612550.5000 lr 0.0481 vocab_size 232626 (8.27s/14.24m) [Shuffling 54] loss 4552646.5000 lr 0.0471 vocab_size 232626 (8.30s/14.24m) [Shuffling 55] loss 4741207.5000 lr 0.0461 vocab_size 232626 (8.40s/14.24m) [Shuffling 56] loss 4561024.0000 lr 0.0451 vocab_size 232626 (8.32s/14.24m) [Shuffling 57] loss 4688023.0000 lr 0.0441 vocab_size 232626 (8.29s/14.23m) [Shuffling 58] loss 4539717.5000 lr 0.0431 vocab_size 232626 (8.36s/14.24m) [Shuffling 59] loss 4679895.0000 lr 0.0421 vocab_size 232626 (8.34s/14.24m) [Shuffling 60] loss 4528657.0000 lr 0.0411 vocab_size 232626 (8.27s/14.23m) [Shuffling 61] loss 4577652.0000 lr 0.0401 vocab_size 232626 (8.36s/14.23m) [Shuffling 62] loss 4690589.0000 lr 0.0391 vocab_size 232626 (8.25s/14.23m) [Shuffling 63] loss 4637712.5000 lr 0.0381 vocab_size 232626 (8.31s/14.23m) [Shuffling 64] loss 4549886.5000 lr 0.0371 vocab_size 232626 (8.32s/14.23m) [Shuffling 65] loss 4542564.5000 lr 0.0361 vocab_size 232626 (8.20s/14.23m) [Shuffling 66] loss 4644582.5000 lr 0.0351 vocab_size 232626 (8.40s/14.23m) [Shuffling 67] loss 4677186.0000 lr 0.0341 vocab_size 232626 (8.22s/14.22m) [Shuffling 68] loss 4522287.0000 lr 0.0331 vocab_size 232626 (8.27s/14.22m) [Shuffling 69] loss 4571248.5000 lr 0.0321 vocab_size 232626 (8.59s/14.23m) [Shuffling 70] loss 4619351.5000 lr 0.0311 vocab_size 232626 (8.31s/14.23m) [Shuffling 71] loss 4593535.0000 lr 0.0301 vocab_size 232626 (8.33s/14.23m) [Shuffling 72] loss 4781224.0000 lr 0.0291 vocab_size 232626 (8.32s/14.23m) [Shuffling 73] loss 4503784.0000 lr 0.0281 vocab_size 232626 (8.41s/14.23m) [Shuffling 74] loss 4623409.5000 lr 0.0271 vocab_size 232626 (8.67s/14.24m) [Shuffling 75] loss 4706418.0000 lr 0.0261 vocab_size 232626 (8.35s/14.24m) [Shuffling 76] loss 4615850.5000 lr 0.0251 vocab_size 232626 (8.23s/14.23m) [Shuffling 77] loss 4595900.5000 lr 0.0241 vocab_size 232626 (8.40s/14.24m) [Shuffling 78] loss 4505922.0000 lr 0.0231 vocab_size 232626 (8.37s/14.24m) [Shuffling 79] loss 4617937.5000 lr 0.0221 vocab_size 232626 (8.24s/14.23m) [Shuffling 80] loss 4584620.5000 lr 0.0211 vocab_size 232626 (8.42s/14.24m) [Shuffling 81] loss 4561289.5000 lr 0.0201 vocab_size 232626 (8.54s/14.24m) [Shuffling 82] loss 4630168.0000 lr 0.0191 vocab_size 232626 (8.25s/14.24m) [Shuffling 83] loss 4587570.0000 lr 0.0181 vocab_size 232626 (8.29s/14.24m) [Shuffling 84] loss 4528835.0000 lr 0.0171 vocab_size 232626 (8.34s/14.24m) [Shuffling 85] loss 4474055.0000 lr 0.0161 vocab_size 232626 (8.39s/14.24m) [Shuffling 86] loss 4461278.5000 lr 0.0151 vocab_size 232626 (8.46s/14.24m) [Shuffling 87] loss 4503402.5000 lr 0.0141 vocab_size 232626 (8.24s/14.24m) [Shuffling 88] loss 4601168.5000 lr 0.0131 vocab_size 232626 (8.29s/14.24m) [Shuffling 89] loss 4530835.5000 lr 0.0121 vocab_size 232626 (8.33s/14.24m) [Shuffling 90] loss 4376987.5000 lr 0.0111 vocab_size 232626 (8.36s/14.24m) [Shuffling 91] loss 4580036.0000 lr 0.0101 vocab_size 232626 (8.50s/14.24m) [Shuffling 92] loss 4458424.5000 lr 0.0091 vocab_size 232626 (8.27s/14.24m) [Shuffling 93] loss 4455015.5000 lr 0.0081 vocab_size 232626 (8.34s/14.24m) [Shuffling 94] loss 4583773.5000 lr 0.0071 vocab_size 232626 (8.39s/14.24m) [Shuffling 95] loss 4594125.5000 lr 0.0061 vocab_size 232626 (8.34s/14.24m) [Shuffling 96] loss 4494070.5000 lr 0.0051 vocab_size 232626 (8.18s/14.24m) [Shuffling 97] loss 4568931.0000 lr 0.0041 vocab_size 232626 (8.27s/14.23m) [Shuffling 98] loss 4520152.5000 lr 0.0031 vocab_size 232626 (7.74s/14.22m) [Shuffling 99] loss 4388186.0000 lr 0.0021 vocab_size 232626 (7.82s/14.22m) [Shuffling 100] loss 4470635.0000 lr 0.0011 vocab_size 232626 (19.76s/14.41m) [03/12/24-18:19:16] Training finished, training Time 14.41m