num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W100D-0.5000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W100D-0.5000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W100D-0.5000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W100D-0.5000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_Medium/5W100D-0.5000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.5, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-19:41:10] Start training [03/12/24-19:41:10] Building vocabulary [03/12/24-19:41:29] Vocabulary size is 232626 [Shuffling 1] loss 2130007.2500 lr 0.5000 vocab_size 232626 (9.41s/16.00m) [Shuffling 2] loss 87965.5000 lr 0.4950 vocab_size 232626 (9.31s/15.92m) [Shuffling 3] loss 41859.3672 lr 0.4900 vocab_size 232626 (9.40s/15.94m) [Shuffling 4] loss 26539.8652 lr 0.4850 vocab_size 232626 (9.34s/15.93m) [Shuffling 5] loss 20149.8184 lr 0.4800 vocab_size 232626 (9.32s/15.92m) [Shuffling 6] loss 14105.9902 lr 0.4750 vocab_size 232626 (9.44s/15.94m) [Shuffling 7] loss 10266.8193 lr 0.4700 vocab_size 232626 (9.38s/15.94m) [Shuffling 8] loss 9775.7295 lr 0.4650 vocab_size 232626 (9.48s/15.97m) [Shuffling 9] loss 7500.3477 lr 0.4600 vocab_size 232626 (9.26s/15.94m) [Shuffling 10] loss 6959.3354 lr 0.4550 vocab_size 232626 (9.36s/15.94m) [Shuffling 11] loss 6264.0127 lr 0.4500 vocab_size 232626 (9.25s/15.92m) [Shuffling 12] loss 5710.2881 lr 0.4450 vocab_size 232626 (9.24s/15.91m) [Shuffling 13] loss 5130.7266 lr 0.4400 vocab_size 232626 (9.27s/15.90m) [Shuffling 14] loss 4635.9478 lr 0.4350 vocab_size 232626 (9.27s/15.89m) [Shuffling 15] loss 4781.6421 lr 0.4300 vocab_size 232626 (9.09s/15.86m) [Shuffling 16] loss 3699.8750 lr 0.4250 vocab_size 232626 (9.31s/15.86m) [Shuffling 17] loss 3466.7327 lr 0.4200 vocab_size 232626 (9.36s/15.86m) [Shuffling 18] loss 3861.2195 lr 0.4150 vocab_size 232626 (9.07s/15.84m) [Shuffling 19] loss 2972.2566 lr 0.4100 vocab_size 232626 (9.25s/15.83m) [Shuffling 20] loss 2845.0422 lr 0.4050 vocab_size 232626 (9.33s/15.84m) [Shuffling 21] loss 2757.0898 lr 0.4000 vocab_size 232626 (9.26s/15.83m) [Shuffling 22] loss 2936.8293 lr 0.3950 vocab_size 232626 (9.13s/15.82m) [Shuffling 23] loss 2264.8220 lr 0.3900 vocab_size 232626 (9.31s/15.82m) [Shuffling 24] loss 2347.9978 lr 0.3850 vocab_size 232626 (9.05s/15.80m) [Shuffling 25] loss 2125.0703 lr 0.3800 vocab_size 232626 (9.33s/15.80m) [Shuffling 26] loss 1903.5343 lr 0.3750 vocab_size 232626 (9.31s/15.81m) [Shuffling 27] loss 1977.0009 lr 0.3700 vocab_size 232626 (9.13s/15.80m) [Shuffling 28] loss 1985.5427 lr 0.3650 vocab_size 232626 (9.05s/15.78m) [Shuffling 29] loss 1799.7797 lr 0.3600 vocab_size 232626 (9.27s/15.78m) [Shuffling 30] loss 1598.9543 lr 0.3550 vocab_size 232626 (9.31s/15.78m) [Shuffling 31] loss 1710.6979 lr 0.3500 vocab_size 232626 (9.07s/15.77m) [Shuffling 32] loss 1520.6401 lr 0.3450 vocab_size 232626 (9.23s/15.77m) [Shuffling 33] loss 1480.5367 lr 0.3400 vocab_size 232626 (9.30s/15.77m) [Shuffling 34] loss 1562.1626 lr 0.3350 vocab_size 232626 (8.97s/15.76m) [Shuffling 35] loss 1274.8352 lr 0.3300 vocab_size 232626 (9.24s/15.76m) [Shuffling 36] loss 1343.7112 lr 0.3250 vocab_size 232626 (9.05s/15.75m) [Shuffling 37] loss 1368.9839 lr 0.3200 vocab_size 232626 (9.11s/15.74m) [Shuffling 38] loss 1339.6725 lr 0.3150 vocab_size 232626 (9.06s/15.73m) [Shuffling 39] loss 1423.4369 lr 0.3100 vocab_size 232626 (9.14s/15.73m) [Shuffling 40] loss 1244.9291 lr 0.3050 vocab_size 232626 (9.36s/15.73m) [Shuffling 41] loss 1013.5470 lr 0.3000 vocab_size 232626 (9.27s/15.73m) [Shuffling 42] loss 1206.2115 lr 0.2950 vocab_size 232626 (9.11s/15.73m) [Shuffling 43] loss 1035.8224 lr 0.2900 vocab_size 232626 (9.03s/15.72m) [Shuffling 44] loss 1143.1392 lr 0.2850 vocab_size 232626 (9.31s/15.72m) [Shuffling 45] loss 1080.7710 lr 0.2800 vocab_size 232626 (9.19s/15.72m) [Shuffling 46] loss 1010.1437 lr 0.2750 vocab_size 232626 (9.36s/15.72m) [Shuffling 47] loss 1101.1633 lr 0.2700 vocab_size 232626 (9.26s/15.73m) [Shuffling 48] loss 903.4739 lr 0.2650 vocab_size 232626 (9.33s/15.73m) [Shuffling 49] loss 1106.0648 lr 0.2600 vocab_size 232626 (9.13s/15.72m) [Shuffling 50] loss 1013.3000 lr 0.2550 vocab_size 232626 (9.15s/15.72m) [Shuffling 51] loss 965.6396 lr 0.2500 vocab_size 232626 (9.16s/15.72m) [Shuffling 52] loss 854.6349 lr 0.2451 vocab_size 232626 (9.34s/15.72m) [Shuffling 53] loss 646.2496 lr 0.2401 vocab_size 232626 (9.32s/15.73m) [Shuffling 54] loss 956.5663 lr 0.2351 vocab_size 232626 (9.12s/15.72m) [Shuffling 55] loss 1007.6876 lr 0.2301 vocab_size 232626 (9.10s/15.72m) [Shuffling 56] loss 1025.0658 lr 0.2251 vocab_size 232626 (9.15s/15.71m) [Shuffling 57] loss 884.1504 lr 0.2201 vocab_size 232626 (9.12s/15.71m) [Shuffling 58] loss 902.3724 lr 0.2151 vocab_size 232626 (9.37s/15.72m) [Shuffling 59] loss 792.5801 lr 0.2101 vocab_size 232626 (9.21s/15.71m) [Shuffling 60] loss 862.4982 lr 0.2051 vocab_size 232626 (9.14s/15.71m) [Shuffling 61] loss 895.7087 lr 0.2001 vocab_size 232626 (9.18s/15.71m) [Shuffling 62] loss 843.3292 lr 0.1951 vocab_size 232626 (9.16s/15.71m) [Shuffling 63] loss 898.9628 lr 0.1901 vocab_size 232626 (9.18s/15.71m) [Shuffling 64] loss 836.9489 lr 0.1851 vocab_size 232626 (9.12s/15.70m) [Shuffling 65] loss 730.4285 lr 0.1801 vocab_size 232626 (9.16s/15.70m) [Shuffling 66] loss 911.5357 lr 0.1751 vocab_size 232626 (9.15s/15.70m) [Shuffling 67] loss 728.1187 lr 0.1701 vocab_size 232626 (9.14s/15.70m) [Shuffling 68] loss 769.3087 lr 0.1651 vocab_size 232626 (9.19s/15.70m) [Shuffling 69] loss 844.1339 lr 0.1601 vocab_size 232626 (9.16s/15.70m) [Shuffling 70] loss 836.9929 lr 0.1551 vocab_size 232626 (9.30s/15.70m) [Shuffling 71] loss 639.2880 lr 0.1501 vocab_size 232626 (9.39s/15.70m) [Shuffling 72] loss 753.3270 lr 0.1451 vocab_size 232626 (9.19s/15.70m) [Shuffling 73] loss 694.0881 lr 0.1401 vocab_size 232626 (9.19s/15.70m) [Shuffling 74] loss 695.8395 lr 0.1351 vocab_size 232626 (9.16s/15.70m) [Shuffling 75] loss 696.6674 lr 0.1301 vocab_size 232626 (9.20s/15.70m) [Shuffling 76] loss 804.3797 lr 0.1251 vocab_size 232626 (9.24s/15.70m) [Shuffling 77] loss 833.2824 lr 0.1201 vocab_size 232626 (9.22s/15.70m) [Shuffling 78] loss 658.8561 lr 0.1151 vocab_size 232626 (9.18s/15.70m) [Shuffling 79] loss 703.0532 lr 0.1101 vocab_size 232626 (9.19s/15.70m) [Shuffling 80] loss 629.2811 lr 0.1051 vocab_size 232626 (9.33s/15.70m) [Shuffling 81] loss 644.7045 lr 0.1001 vocab_size 232626 (9.19s/15.70m) [Shuffling 82] loss 676.0820 lr 0.0951 vocab_size 232626 (9.16s/15.70m) [Shuffling 83] loss 640.8853 lr 0.0901 vocab_size 232626 (9.13s/15.70m) [Shuffling 84] loss 650.6938 lr 0.0851 vocab_size 232626 (9.15s/15.69m) [Shuffling 85] loss 586.9995 lr 0.0801 vocab_size 232626 (9.37s/15.70m) [Shuffling 86] loss 584.1915 lr 0.0751 vocab_size 232626 (9.37s/15.70m) [Shuffling 87] loss 549.9361 lr 0.0701 vocab_size 232626 (9.34s/15.70m) [Shuffling 88] loss 638.3906 lr 0.0651 vocab_size 232626 (9.11s/15.70m) [Shuffling 89] loss 601.6389 lr 0.0601 vocab_size 232626 (9.13s/15.70m) [Shuffling 90] loss 582.0392 lr 0.0551 vocab_size 232626 (9.12s/15.70m) [Shuffling 91] loss 702.2888 lr 0.0501 vocab_size 232626 (9.14s/15.69m) [Shuffling 92] loss 577.8828 lr 0.0451 vocab_size 232626 (9.12s/15.69m) [Shuffling 93] loss 683.9448 lr 0.0401 vocab_size 232626 (9.22s/15.69m) [Shuffling 94] loss 809.0721 lr 0.0351 vocab_size 232626 (9.10s/15.69m) [Shuffling 95] loss 556.3814 lr 0.0301 vocab_size 232626 (9.07s/15.69m) [Shuffling 96] loss 688.2901 lr 0.0251 vocab_size 232626 (8.95s/15.68m) [Shuffling 97] loss 910.7628 lr 0.0201 vocab_size 232626 (8.96s/15.68m) [Shuffling 98] loss 757.0499 lr 0.0151 vocab_size 232626 (19.96s/15.86m) [Shuffling 99] loss 606.5114 lr 0.0101 vocab_size 232626 (20.92s/16.06m) [Shuffling 100] loss 500.1147 lr 0.0051 vocab_size 232626 (21.15s/16.25m) [03/12/24-19:57:25] Training finished, training Time 16.25m