num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/50W10D-0.0250r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/50W10D-0.0250r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/50W10D-0.0250r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/50W10D-0.0250r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_Small/50W10D-0.0250r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.025, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-17:03:30] Start training [03/12/24-17:03:30] Building vocabulary [03/12/24-17:03:37] Vocabulary size is 40498 [Shuffling 1] loss 2166590.2500 lr 0.0250 vocab_size 40498 (3.04s/5.18m) [Shuffling 2] loss 2080868.1250 lr 0.0248 vocab_size 40498 (3.07s/5.21m) [Shuffling 3] loss 2099358.2500 lr 0.0245 vocab_size 40498 (3.11s/5.25m) [Shuffling 4] loss 1940365.6250 lr 0.0243 vocab_size 40498 (3.10s/5.26m) [Shuffling 5] loss 2071147.1250 lr 0.0240 vocab_size 40498 (3.12s/5.27m) [Shuffling 6] loss 1972311.8750 lr 0.0238 vocab_size 40498 (3.07s/5.27m) [Shuffling 7] loss 1948627.1250 lr 0.0235 vocab_size 40498 (3.07s/5.26m) [Shuffling 8] loss 2011695.6250 lr 0.0233 vocab_size 40498 (3.06s/5.26m) [Shuffling 9] loss 1901076.7500 lr 0.0230 vocab_size 40498 (3.16s/5.27m) [Shuffling 10] loss 1939365.6250 lr 0.0228 vocab_size 40498 (3.07s/5.27m) [Shuffling 11] loss 1947215.5000 lr 0.0225 vocab_size 40498 (3.02s/5.26m) [Shuffling 12] loss 1930013.1250 lr 0.0223 vocab_size 40498 (3.12s/5.26m) [Shuffling 13] loss 1999364.5000 lr 0.0220 vocab_size 40498 (3.08s/5.26m) [Shuffling 14] loss 1939273.8750 lr 0.0218 vocab_size 40498 (3.12s/5.27m) [Shuffling 15] loss 1941383.8750 lr 0.0215 vocab_size 40498 (3.10s/5.27m) [Shuffling 16] loss 1979849.7500 lr 0.0213 vocab_size 40498 (3.07s/5.27m) [Shuffling 17] loss 1889892.3750 lr 0.0210 vocab_size 40498 (3.07s/5.27m) [Shuffling 18] loss 1911320.0000 lr 0.0208 vocab_size 40498 (3.08s/5.27m) [Shuffling 19] loss 2011368.0000 lr 0.0205 vocab_size 40498 (3.09s/5.27m) [Shuffling 20] loss 1901965.8750 lr 0.0203 vocab_size 40498 (3.11s/5.27m) [Shuffling 21] loss 1947882.8750 lr 0.0200 vocab_size 40498 (3.04s/5.26m) [Shuffling 22] loss 1920208.6250 lr 0.0198 vocab_size 40498 (3.07s/5.26m) [Shuffling 23] loss 1949709.6250 lr 0.0195 vocab_size 40498 (3.05s/5.26m) [Shuffling 24] loss 1969668.6250 lr 0.0193 vocab_size 40498 (3.06s/5.26m) [Shuffling 25] loss 1940818.5000 lr 0.0190 vocab_size 40498 (3.04s/5.26m) [Shuffling 26] loss 1973886.8750 lr 0.0188 vocab_size 40498 (3.09s/5.26m) [Shuffling 27] loss 1913558.7500 lr 0.0185 vocab_size 40498 (3.04s/5.25m) [Shuffling 28] loss 1952109.8750 lr 0.0183 vocab_size 40498 (3.10s/5.26m) [Shuffling 29] loss 1963662.2500 lr 0.0180 vocab_size 40498 (3.02s/5.25m) [Shuffling 30] loss 1953960.3750 lr 0.0178 vocab_size 40498 (3.09s/5.25m) [Shuffling 31] loss 1830330.5000 lr 0.0175 vocab_size 40498 (3.11s/5.25m) [Shuffling 32] loss 1923498.3750 lr 0.0173 vocab_size 40498 (3.05s/5.25m) [Shuffling 33] loss 2012873.1250 lr 0.0170 vocab_size 40498 (3.09s/5.25m) [Shuffling 34] loss 1889503.6250 lr 0.0168 vocab_size 40498 (3.06s/5.25m) [Shuffling 35] loss 1857326.0000 lr 0.0165 vocab_size 40498 (3.07s/5.25m) [Shuffling 36] loss 1920079.5000 lr 0.0163 vocab_size 40498 (3.05s/5.25m) [Shuffling 37] loss 1933574.2500 lr 0.0160 vocab_size 40498 (3.04s/5.25m) [Shuffling 38] loss 1797766.0000 lr 0.0158 vocab_size 40498 (3.07s/5.25m) [Shuffling 39] loss 1901828.5000 lr 0.0155 vocab_size 40498 (3.01s/5.25m) [Shuffling 40] loss 1855567.6250 lr 0.0153 vocab_size 40498 (3.09s/5.25m) [Shuffling 41] loss 1909557.1250 lr 0.0150 vocab_size 40498 (2.98s/5.24m) [Shuffling 42] loss 1941669.5000 lr 0.0148 vocab_size 40498 (3.01s/5.24m) [Shuffling 43] loss 1933867.7500 lr 0.0145 vocab_size 40498 (3.05s/5.24m) [Shuffling 44] loss 1859373.6250 lr 0.0143 vocab_size 40498 (3.04s/5.24m) [Shuffling 45] loss 1942383.2500 lr 0.0140 vocab_size 40498 (3.09s/5.24m) [Shuffling 46] loss 1938259.7500 lr 0.0138 vocab_size 40498 (3.02s/5.24m) [Shuffling 47] loss 1906026.2500 lr 0.0135 vocab_size 40498 (3.08s/5.24m) [Shuffling 48] loss 1864060.1250 lr 0.0133 vocab_size 40498 (3.10s/5.24m) [Shuffling 49] loss 1925618.1250 lr 0.0130 vocab_size 40498 (2.97s/5.24m) [Shuffling 50] loss 1914029.3750 lr 0.0128 vocab_size 40498 (3.14s/5.24m) [Shuffling 51] loss 1958656.5000 lr 0.0126 vocab_size 40498 (2.97s/5.23m) [Shuffling 52] loss 1977259.0000 lr 0.0123 vocab_size 40498 (3.07s/5.23m) [Shuffling 53] loss 1905462.1250 lr 0.0121 vocab_size 40498 (3.02s/5.23m) [Shuffling 54] loss 1893544.1250 lr 0.0118 vocab_size 40498 (2.97s/5.23m) [Shuffling 55] loss 1912997.2500 lr 0.0116 vocab_size 40498 (3.08s/5.23m) [Shuffling 56] loss 1901226.1250 lr 0.0113 vocab_size 40498 (2.99s/5.23m) [Shuffling 57] loss 1950069.6250 lr 0.0111 vocab_size 40498 (3.09s/5.23m) [Shuffling 58] loss 1874915.3750 lr 0.0108 vocab_size 40498 (3.01s/5.23m) [Shuffling 59] loss 1944249.3750 lr 0.0106 vocab_size 40498 (3.11s/5.23m) [Shuffling 60] loss 1941538.5000 lr 0.0103 vocab_size 40498 (3.17s/5.23m) [Shuffling 61] loss 1929014.5000 lr 0.0101 vocab_size 40498 (3.03s/5.23m) [Shuffling 62] loss 1928904.7500 lr 0.0098 vocab_size 40498 (3.15s/5.23m) [Shuffling 63] loss 1922253.3750 lr 0.0096 vocab_size 40498 (3.02s/5.23m) [Shuffling 64] loss 1852095.5000 lr 0.0093 vocab_size 40498 (3.15s/5.23m) [Shuffling 65] loss 1925860.5000 lr 0.0091 vocab_size 40498 (3.06s/5.23m) [Shuffling 66] loss 1916683.0000 lr 0.0088 vocab_size 40498 (3.01s/5.23m) [Shuffling 67] loss 1936263.0000 lr 0.0086 vocab_size 40498 (3.09s/5.23m) [Shuffling 68] loss 1939847.5000 lr 0.0083 vocab_size 40498 (3.04s/5.23m) [Shuffling 69] loss 1846393.2500 lr 0.0081 vocab_size 40498 (3.04s/5.23m) [Shuffling 70] loss 1875232.3750 lr 0.0078 vocab_size 40498 (3.01s/5.23m) [Shuffling 71] loss 1875403.6250 lr 0.0076 vocab_size 40498 (3.09s/5.23m) [Shuffling 72] loss 1868293.2500 lr 0.0073 vocab_size 40498 (3.00s/5.23m) [Shuffling 73] loss 1921533.3750 lr 0.0071 vocab_size 40498 (3.08s/5.23m) [Shuffling 74] loss 1905969.0000 lr 0.0068 vocab_size 40498 (3.07s/5.23m) [Shuffling 75] loss 1890906.2500 lr 0.0066 vocab_size 40498 (3.01s/5.23m) [Shuffling 76] loss 1928297.3750 lr 0.0063 vocab_size 40498 (3.10s/5.23m) [Shuffling 77] loss 1939262.8750 lr 0.0061 vocab_size 40498 (3.00s/5.23m) [Shuffling 78] loss 1876794.5000 lr 0.0058 vocab_size 40498 (2.98s/5.23m) [Shuffling 79] loss 1910037.2500 lr 0.0056 vocab_size 40498 (3.10s/5.23m) [Shuffling 80] loss 1926734.6250 lr 0.0053 vocab_size 40498 (3.03s/5.23m) [Shuffling 81] loss 1902979.0000 lr 0.0051 vocab_size 40498 (3.02s/5.23m) [Shuffling 82] loss 1893692.6250 lr 0.0048 vocab_size 40498 (3.02s/5.22m) [Shuffling 83] loss 1901121.3750 lr 0.0046 vocab_size 40498 (3.10s/5.23m) [Shuffling 84] loss 1988777.1250 lr 0.0043 vocab_size 40498 (2.99s/5.22m) [Shuffling 85] loss 1896513.0000 lr 0.0041 vocab_size 40498 (3.07s/5.22m) [Shuffling 86] loss 1938457.2500 lr 0.0038 vocab_size 40498 (3.02s/5.22m) [Shuffling 87] loss 1864276.3750 lr 0.0036 vocab_size 40498 (3.06s/5.22m) [Shuffling 88] loss 1882492.2500 lr 0.0033 vocab_size 40498 (3.03s/5.22m) [Shuffling 89] loss 1903656.8750 lr 0.0031 vocab_size 40498 (3.01s/5.22m) [Shuffling 90] loss 1903119.0000 lr 0.0028 vocab_size 40498 (3.10s/5.22m) [Shuffling 91] loss 1876546.7500 lr 0.0026 vocab_size 40498 (2.97s/5.22m) [Shuffling 92] loss 1892744.2500 lr 0.0023 vocab_size 40498 (3.05s/5.22m) [Shuffling 93] loss 1948274.0000 lr 0.0021 vocab_size 40498 (3.02s/5.22m) [Shuffling 94] loss 1906760.2500 lr 0.0018 vocab_size 40498 (2.96s/5.22m) [Shuffling 95] loss 1851397.0000 lr 0.0016 vocab_size 40498 (3.03s/5.22m) [Shuffling 96] loss 1954138.1250 lr 0.0013 vocab_size 40498 (5.07s/5.25m) [Shuffling 97] loss 1953066.8750 lr 0.0011 vocab_size 40498 (4.01s/5.27m) [Shuffling 98] loss 1874973.0000 lr 0.0008 vocab_size 40498 (5.08s/5.30m) [Shuffling 99] loss 1877152.6250 lr 0.0006 vocab_size 40498 (9.07s/5.40m) [Shuffling 100] loss 1770742.1250 lr 0.0003 vocab_size 40498 (8.03s/5.48m) [03/12/24-17:08:59] Training finished, training Time 5.48m