num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/5W100D-0.0250r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/5W100D-0.0250r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/5W100D-0.0250r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/5W100D-0.0250r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/5W100D-0.0250r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.025, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-17:09:04] Start training [03/12/24-17:09:04] Building vocabulary [03/12/24-17:09:11] Vocabulary size is 40498 [Shuffling 1] loss 2593395.7500 lr 0.0250 vocab_size 40498 (2.91s/4.96m) [Shuffling 2] loss 2058495.7500 lr 0.0248 vocab_size 40498 (2.94s/4.99m) [Shuffling 3] loss 2017120.3750 lr 0.0245 vocab_size 40498 (2.91s/4.99m) [Shuffling 4] loss 1991067.8750 lr 0.0243 vocab_size 40498 (2.92s/4.99m) [Shuffling 5] loss 2112339.2500 lr 0.0240 vocab_size 40498 (2.88s/4.98m) [Shuffling 6] loss 2005182.0000 lr 0.0238 vocab_size 40498 (2.86s/4.96m) [Shuffling 7] loss 2022216.6250 lr 0.0235 vocab_size 40498 (2.95s/4.97m) [Shuffling 8] loss 2012844.0000 lr 0.0233 vocab_size 40498 (2.90s/4.97m) [Shuffling 9] loss 1935975.7500 lr 0.0230 vocab_size 40498 (2.90s/4.97m) [Shuffling 10] loss 1998475.5000 lr 0.0228 vocab_size 40498 (2.91s/4.97m) [Shuffling 11] loss 2032235.0000 lr 0.0225 vocab_size 40498 (2.91s/4.97m) [Shuffling 12] loss 1969994.8750 lr 0.0223 vocab_size 40498 (3.02s/4.99m) [Shuffling 13] loss 2006550.8750 lr 0.0220 vocab_size 40498 (2.92s/4.99m) [Shuffling 14] loss 2050725.6250 lr 0.0218 vocab_size 40498 (2.95s/4.99m) [Shuffling 15] loss 1967175.3750 lr 0.0215 vocab_size 40498 (2.86s/4.98m) [Shuffling 16] loss 2020402.2500 lr 0.0213 vocab_size 40498 (2.96s/4.99m) [Shuffling 17] loss 1971287.8750 lr 0.0210 vocab_size 40498 (2.85s/4.98m) [Shuffling 18] loss 2059690.3750 lr 0.0208 vocab_size 40498 (2.92s/4.98m) [Shuffling 19] loss 1957492.8750 lr 0.0205 vocab_size 40498 (2.96s/4.99m) [Shuffling 20] loss 2033538.1250 lr 0.0203 vocab_size 40498 (2.91s/4.99m) [Shuffling 21] loss 2015402.6250 lr 0.0200 vocab_size 40498 (2.94s/4.99m) [Shuffling 22] loss 1957870.0000 lr 0.0198 vocab_size 40498 (2.88s/4.99m) [Shuffling 23] loss 2042570.6250 lr 0.0195 vocab_size 40498 (2.92s/4.99m) [Shuffling 24] loss 2050043.6250 lr 0.0193 vocab_size 40498 (2.97s/4.99m) [Shuffling 25] loss 2002709.2500 lr 0.0190 vocab_size 40498 (2.89s/4.99m) [Shuffling 26] loss 1968208.3750 lr 0.0188 vocab_size 40498 (2.97s/4.99m) [Shuffling 27] loss 1987478.8750 lr 0.0185 vocab_size 40498 (2.89s/4.99m) [Shuffling 28] loss 2008129.3750 lr 0.0183 vocab_size 40498 (3.01s/4.99m) [Shuffling 29] loss 2013833.8750 lr 0.0180 vocab_size 40498 (2.98s/5.00m) [Shuffling 30] loss 2053078.8750 lr 0.0178 vocab_size 40498 (2.91s/5.00m) [Shuffling 31] loss 1938791.7500 lr 0.0175 vocab_size 40498 (2.96s/5.00m) [Shuffling 32] loss 1998927.7500 lr 0.0173 vocab_size 40498 (2.92s/5.00m) [Shuffling 33] loss 1962509.5000 lr 0.0170 vocab_size 40498 (3.00s/5.00m) [Shuffling 34] loss 1999626.6250 lr 0.0168 vocab_size 40498 (2.94s/5.00m) [Shuffling 35] loss 1902864.5000 lr 0.0165 vocab_size 40498 (2.99s/5.01m) [Shuffling 36] loss 1980212.8750 lr 0.0163 vocab_size 40498 (2.98s/5.01m) [Shuffling 37] loss 1969682.6250 lr 0.0160 vocab_size 40498 (2.97s/5.01m) [Shuffling 38] loss 2008832.5000 lr 0.0158 vocab_size 40498 (2.97s/5.01m) [Shuffling 39] loss 1965049.8750 lr 0.0155 vocab_size 40498 (2.92s/5.01m) [Shuffling 40] loss 2125759.5000 lr 0.0153 vocab_size 40498 (2.88s/5.01m) [Shuffling 41] loss 1960352.2500 lr 0.0150 vocab_size 40498 (2.89s/5.01m) [Shuffling 42] loss 1987054.5000 lr 0.0148 vocab_size 40498 (2.88s/5.01m) [Shuffling 43] loss 2008139.0000 lr 0.0145 vocab_size 40498 (2.89s/5.00m) [Shuffling 44] loss 2026869.1250 lr 0.0143 vocab_size 40498 (2.91s/5.00m) [Shuffling 45] loss 1969352.8750 lr 0.0140 vocab_size 40498 (2.95s/5.00m) [Shuffling 46] loss 1998597.2500 lr 0.0138 vocab_size 40498 (2.79s/5.00m) [Shuffling 47] loss 1987259.3750 lr 0.0135 vocab_size 40498 (2.86s/5.00m) [Shuffling 48] loss 1950181.0000 lr 0.0133 vocab_size 40498 (2.86s/5.00m) [Shuffling 49] loss 1941124.3750 lr 0.0130 vocab_size 40498 (2.89s/4.99m) [Shuffling 50] loss 1979202.7500 lr 0.0128 vocab_size 40498 (2.93s/4.99m) [Shuffling 51] loss 1936871.3750 lr 0.0126 vocab_size 40498 (2.82s/4.99m) [Shuffling 52] loss 1977807.7500 lr 0.0123 vocab_size 40498 (2.94s/4.99m) [Shuffling 53] loss 2001466.6250 lr 0.0121 vocab_size 40498 (2.86s/4.99m) [Shuffling 54] loss 1988873.2500 lr 0.0118 vocab_size 40498 (2.82s/4.99m) [Shuffling 55] loss 1985206.3750 lr 0.0116 vocab_size 40498 (2.89s/4.99m) [Shuffling 56] loss 2070593.7500 lr 0.0113 vocab_size 40498 (2.81s/4.98m) [Shuffling 57] loss 1969304.8750 lr 0.0111 vocab_size 40498 (2.91s/4.98m) [Shuffling 58] loss 2027991.2500 lr 0.0108 vocab_size 40498 (2.87s/4.98m) [Shuffling 59] loss 2023720.0000 lr 0.0106 vocab_size 40498 (2.81s/4.98m) [Shuffling 60] loss 1937674.5000 lr 0.0103 vocab_size 40498 (2.83s/4.98m) [Shuffling 61] loss 2109274.5000 lr 0.0101 vocab_size 40498 (2.81s/4.97m) [Shuffling 62] loss 1898267.1250 lr 0.0098 vocab_size 40498 (2.92s/4.97m) [Shuffling 63] loss 1985510.7500 lr 0.0096 vocab_size 40498 (2.80s/4.97m) [Shuffling 64] loss 2040408.6250 lr 0.0093 vocab_size 40498 (2.84s/4.97m) [Shuffling 65] loss 1971794.7500 lr 0.0091 vocab_size 40498 (2.84s/4.97m) [Shuffling 66] loss 1962227.7500 lr 0.0088 vocab_size 40498 (2.83s/4.97m) [Shuffling 67] loss 2019145.2500 lr 0.0086 vocab_size 40498 (2.89s/4.96m) [Shuffling 68] loss 1978850.0000 lr 0.0083 vocab_size 40498 (2.81s/4.96m) [Shuffling 69] loss 1889499.6250 lr 0.0081 vocab_size 40498 (2.87s/4.96m) [Shuffling 70] loss 1943704.5000 lr 0.0078 vocab_size 40498 (2.86s/4.96m) [Shuffling 71] loss 2031654.8750 lr 0.0076 vocab_size 40498 (2.84s/4.96m) [Shuffling 72] loss 1931159.0000 lr 0.0073 vocab_size 40498 (2.92s/4.96m) [Shuffling 73] loss 2003353.0000 lr 0.0071 vocab_size 40498 (2.89s/4.96m) [Shuffling 74] loss 2080672.8750 lr 0.0068 vocab_size 40498 (2.89s/4.96m) [Shuffling 75] loss 1957078.5000 lr 0.0066 vocab_size 40498 (2.85s/4.96m) [Shuffling 76] loss 1977806.3750 lr 0.0063 vocab_size 40498 (2.91s/4.96m) [Shuffling 77] loss 1922220.6250 lr 0.0061 vocab_size 40498 (2.98s/4.96m) [Shuffling 78] loss 1912648.6250 lr 0.0058 vocab_size 40498 (2.86s/4.96m) [Shuffling 79] loss 2027796.3750 lr 0.0056 vocab_size 40498 (2.90s/4.96m) [Shuffling 80] loss 1961856.0000 lr 0.0053 vocab_size 40498 (2.89s/4.96m) [Shuffling 81] loss 2000354.6250 lr 0.0051 vocab_size 40498 (2.90s/4.96m) [Shuffling 82] loss 1955213.0000 lr 0.0048 vocab_size 40498 (2.95s/4.96m) [Shuffling 83] loss 1979632.5000 lr 0.0046 vocab_size 40498 (2.96s/4.96m) [Shuffling 84] loss 2015754.0000 lr 0.0043 vocab_size 40498 (2.91s/4.96m) [Shuffling 85] loss 1997510.6250 lr 0.0041 vocab_size 40498 (2.89s/4.96m) [Shuffling 86] loss 1969086.5000 lr 0.0038 vocab_size 40498 (2.93s/4.96m) [Shuffling 87] loss 2022304.3750 lr 0.0036 vocab_size 40498 (3.01s/4.96m) [Shuffling 88] loss 2040407.2500 lr 0.0033 vocab_size 40498 (3.02s/4.97m) [Shuffling 89] loss 1970093.2500 lr 0.0031 vocab_size 40498 (2.92s/4.97m) [Shuffling 90] loss 1969797.2500 lr 0.0028 vocab_size 40498 (2.89s/4.97m) [Shuffling 91] loss 1977466.3750 lr 0.0026 vocab_size 40498 (2.96s/4.97m) [Shuffling 92] loss 1978427.7500 lr 0.0023 vocab_size 40498 (2.97s/4.97m) [Shuffling 93] loss 2029762.8750 lr 0.0021 vocab_size 40498 (2.79s/4.97m) [Shuffling 94] loss 2000290.5000 lr 0.0018 vocab_size 40498 (2.91s/4.97m) [Shuffling 95] loss 1960687.6250 lr 0.0016 vocab_size 40498 (2.88s/4.97m) [Shuffling 96] loss 2047256.1250 lr 0.0013 vocab_size 40498 (2.90s/4.97m) [Shuffling 97] loss 1956467.2500 lr 0.0011 vocab_size 40498 (2.91s/4.97m) [Shuffling 98] loss 2051693.8750 lr 0.0008 vocab_size 40498 (2.83s/4.96m) [Shuffling 99] loss 1935797.1250 lr 0.0006 vocab_size 40498 (5.86s/5.01m) [Shuffling 100] loss 2093914.7500 lr 0.0003 vocab_size 40498 (2.83s/5.01m) [03/12/24-17:14:05] Training finished, training Time 5.01m