num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.5000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.5000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.5, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.5000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.5000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.5000r/shuffled_datasets Using cbow, negative sampling with 5 negative samples [03/12/24-21:09:57] Start training [03/12/24-21:09:57] Building vocabulary [03/12/24-21:10:46] Vocabulary size is 251084 [Shuffling 1] loss 1128012.1250 lr 0.5000 vocab_size 251084 (14.07s/24.25m) [Shuffling 2] loss 45928.9609 lr 0.4950 vocab_size 251084 (12.58s/23.03m) [Shuffling 3] loss 25472.3086 lr 0.4900 vocab_size 251084 (13.14s/22.93m) [Shuffling 4] loss 19503.4785 lr 0.4850 vocab_size 251084 (13.03s/22.84m) [Shuffling 5] loss 12141.2461 lr 0.4800 vocab_size 251084 (13.44s/22.92m) [Shuffling 6] loss 11668.5137 lr 0.4750 vocab_size 251084 (13.28s/22.93m) [Shuffling 7] loss 9828.9766 lr 0.4700 vocab_size 251084 (13.45s/22.98m) [Shuffling 8] loss 8593.8994 lr 0.4650 vocab_size 251084 (13.55s/23.03m) [Shuffling 9] loss 7791.9399 lr 0.4600 vocab_size 251084 (13.28s/23.02m) [Shuffling 10] loss 6720.1880 lr 0.4550 vocab_size 251084 (13.33s/23.03m) [Shuffling 11] loss 6184.1826 lr 0.4500 vocab_size 251084 (13.39s/23.04m) [Shuffling 12] loss 5974.7407 lr 0.4450 vocab_size 251084 (13.30s/23.04m) [Shuffling 13] loss 5243.9604 lr 0.4400 vocab_size 251084 (13.54s/23.08m) [Shuffling 14] loss 4965.0586 lr 0.4350 vocab_size 251084 (13.32s/23.07m) [Shuffling 15] loss 4481.1323 lr 0.4300 vocab_size 251084 (12.86s/23.02m) [Shuffling 16] loss 4550.7983 lr 0.4250 vocab_size 251084 (12.21s/22.91m) [Shuffling 17] loss 4506.2896 lr 0.4200 vocab_size 251084 (12.49s/22.84m) [Shuffling 18] loss 3858.9612 lr 0.4150 vocab_size 251084 (13.09s/22.83m) [Shuffling 19] loss 3430.1467 lr 0.4100 vocab_size 251084 (12.70s/22.78m) [Shuffling 20] loss 3757.7959 lr 0.4050 vocab_size 251084 (13.37s/22.80m) [Shuffling 21] loss 3672.3655 lr 0.4000 vocab_size 251084 (13.26s/22.81m) [Shuffling 22] loss 3423.1130 lr 0.3950 vocab_size 251084 (13.36s/22.82m) [Shuffling 23] loss 2735.1392 lr 0.3900 vocab_size 251084 (13.39s/22.84m) [Shuffling 24] loss 2880.2600 lr 0.3850 vocab_size 251084 (12.66s/22.80m) [Shuffling 25] loss 2864.5303 lr 0.3800 vocab_size 251084 (12.43s/22.75m) [Shuffling 26] loss 2575.9795 lr 0.3750 vocab_size 251084 (12.70s/22.72m) [Shuffling 27] loss 2670.6987 lr 0.3700 vocab_size 251084 (13.07s/22.72m) [Shuffling 28] loss 2734.3662 lr 0.3650 vocab_size 251084 (12.31s/22.67m) [Shuffling 29] loss 2739.4834 lr 0.3600 vocab_size 251084 (13.16s/22.67m) [Shuffling 30] loss 2452.6392 lr 0.3550 vocab_size 251084 (13.74s/22.71m) [Shuffling 31] loss 2332.5181 lr 0.3500 vocab_size 251084 (13.44s/22.73m) [Shuffling 32] loss 2171.1060 lr 0.3450 vocab_size 251084 (13.13s/22.73m) [Shuffling 33] loss 2224.4707 lr 0.3400 vocab_size 251084 (13.18s/22.73m) [Shuffling 34] loss 2070.7407 lr 0.3350 vocab_size 251084 (13.48s/22.75m) [Shuffling 35] loss 1865.2025 lr 0.3300 vocab_size 251084 (13.89s/22.78m) [Shuffling 36] loss 2013.7780 lr 0.3250 vocab_size 251084 (13.17s/22.78m) [Shuffling 37] loss 1830.1483 lr 0.3200 vocab_size 251084 (13.46s/22.80m) [Shuffling 38] loss 1827.9969 lr 0.3150 vocab_size 251084 (12.59s/22.77m) [Shuffling 39] loss 1906.2184 lr 0.3100 vocab_size 251084 (18.87s/23.01m) [Shuffling 40] loss 1799.1742 lr 0.3050 vocab_size 251084 (12.58s/22.98m) [Shuffling 41] loss 1900.5304 lr 0.3000 vocab_size 251084 (12.28s/22.94m) [Shuffling 42] loss 1920.7417 lr 0.2950 vocab_size 251084 (12.69s/22.92m) [Shuffling 43] loss 1721.3949 lr 0.2900 vocab_size 251084 (12.62s/22.89m) [Shuffling 44] loss 1802.7391 lr 0.2850 vocab_size 251084 (12.73s/22.87m) [Shuffling 45] loss 1580.4688 lr 0.2800 vocab_size 251084 (13.53s/22.89m) [Shuffling 46] loss 1774.2993 lr 0.2750 vocab_size 251084 (12.83s/22.87m) [Shuffling 47] loss 1645.3217 lr 0.2700 vocab_size 251084 (12.90s/22.86m) [Shuffling 48] loss 1308.1624 lr 0.2650 vocab_size 251084 (13.82s/22.88m) [Shuffling 49] loss 1671.9568 lr 0.2600 vocab_size 251084 (13.49s/22.89m) [Shuffling 50] loss 1458.5829 lr 0.2550 vocab_size 251084 (13.64s/22.91m) [Shuffling 51] loss 1559.2418 lr 0.2500 vocab_size 251084 (13.59s/22.92m) [Shuffling 52] loss 1664.9960 lr 0.2451 vocab_size 251084 (13.30s/22.92m) [Shuffling 53] loss 1574.5294 lr 0.2401 vocab_size 251084 (13.40s/22.92m) [Shuffling 54] loss 1349.2711 lr 0.2351 vocab_size 251084 (13.97s/22.94m) [Shuffling 55] loss 1541.6320 lr 0.2301 vocab_size 251084 (13.89s/22.96m) [Shuffling 56] loss 1351.6167 lr 0.2251 vocab_size 251084 (13.81s/22.98m) [Shuffling 57] loss 1507.5693 lr 0.2201 vocab_size 251084 (12.87s/22.97m) [Shuffling 58] loss 1309.0967 lr 0.2151 vocab_size 251084 (13.36s/22.97m) [Shuffling 59] loss 1325.6868 lr 0.2101 vocab_size 251084 (12.82s/22.96m) [Shuffling 60] loss 1215.6489 lr 0.2051 vocab_size 251084 (13.61s/22.97m) [Shuffling 61] loss 1265.7198 lr 0.2001 vocab_size 251084 (13.64s/22.98m) [Shuffling 62] loss 1222.4368 lr 0.1951 vocab_size 251084 (13.92s/22.99m) [Shuffling 63] loss 1254.3403 lr 0.1901 vocab_size 251084 (13.24s/22.99m) [Shuffling 64] loss 1224.1884 lr 0.1851 vocab_size 251084 (12.52s/22.97m) [Shuffling 65] loss 1267.9658 lr 0.1801 vocab_size 251084 (12.76s/22.96m) [Shuffling 66] loss 1255.9929 lr 0.1751 vocab_size 251084 (13.09s/22.95m) [Shuffling 67] loss 1240.8123 lr 0.1701 vocab_size 251084 (13.11s/22.95m) [Shuffling 68] loss 1365.4199 lr 0.1651 vocab_size 251084 (12.92s/22.94m) [Shuffling 69] loss 1147.6504 lr 0.1601 vocab_size 251084 (13.61s/22.95m) [Shuffling 70] loss 1108.8890 lr 0.1551 vocab_size 251084 (13.27s/22.95m) [Shuffling 71] loss 1128.0178 lr 0.1501 vocab_size 251084 (12.97s/22.94m) [Shuffling 72] loss 953.6534 lr 0.1451 vocab_size 251084 (13.58s/22.95m) [Shuffling 73] loss 1074.3362 lr 0.1401 vocab_size 251084 (13.46s/22.96m) [Shuffling 74] loss 1179.3834 lr 0.1351 vocab_size 251084 (13.48s/22.96m) [Shuffling 75] loss 1337.7524 lr 0.1301 vocab_size 251084 (13.27s/22.96m) [Shuffling 76] loss 1046.2671 lr 0.1251 vocab_size 251084 (13.57s/22.97m) [Shuffling 77] loss 1158.6459 lr 0.1201 vocab_size 251084 (13.67s/22.98m) [Shuffling 78] loss 1239.2551 lr 0.1151 vocab_size 251084 (13.30s/22.98m) [Shuffling 79] loss 1105.0631 lr 0.1101 vocab_size 251084 (13.68s/22.98m) [Shuffling 80] loss 1101.9230 lr 0.1051 vocab_size 251084 (13.28s/22.98m) [Shuffling 81] loss 1134.0149 lr 0.1001 vocab_size 251084 (13.52s/22.99m) [Shuffling 82] loss 1249.9348 lr 0.0951 vocab_size 251084 (13.21s/22.99m) [Shuffling 83] loss 1059.8582 lr 0.0901 vocab_size 251084 (13.33s/22.99m) [Shuffling 84] loss 1024.4617 lr 0.0851 vocab_size 251084 (12.83s/22.98m) [Shuffling 85] loss 1188.1182 lr 0.0801 vocab_size 251084 (12.68s/22.97m) [Shuffling 86] loss 1086.2274 lr 0.0751 vocab_size 251084 (12.81s/22.96m) [Shuffling 87] loss 876.6033 lr 0.0701 vocab_size 251084 (12.77s/22.95m) [Shuffling 88] loss 1047.8480 lr 0.0651 vocab_size 251084 (12.48s/22.93m) [Shuffling 89] loss 764.0626 lr 0.0601 vocab_size 251084 (13.82s/22.94m) [Shuffling 90] loss 972.9272 lr 0.0551 vocab_size 251084 (12.59s/22.93m) [Shuffling 91] loss 951.3919 lr 0.0501 vocab_size 251084 (12.61s/22.92m) [Shuffling 92] loss 1105.7744 lr 0.0451 vocab_size 251084 (12.41s/22.90m) [Shuffling 93] loss 964.9193 lr 0.0401 vocab_size 251084 (12.51s/22.89m) [Shuffling 94] loss 1010.3130 lr 0.0351 vocab_size 251084 (12.91s/22.89m) [Shuffling 95] loss 968.4359 lr 0.0301 vocab_size 251084 (12.42s/22.87m) [Shuffling 96] loss 987.7718 lr 0.0251 vocab_size 251084 (12.78s/22.86m) [Shuffling 97] loss 948.0942 lr 0.0201 vocab_size 251084 (12.56s/22.85m) [Shuffling 98] loss 850.2766 lr 0.0151 vocab_size 251084 (12.46s/22.84m) [Shuffling 99] loss 945.2841 lr 0.0101 vocab_size 251084 (12.69s/22.83m) [Shuffling 100] loss 1046.9340 lr 0.0051 vocab_size 251084 (12.62s/22.82m) [03/12/24-21:32:47] Training finished, training Time 22.82m