num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.5000r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.5000r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.5000r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.5000r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 10, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile1k/50W10D-0.5000r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.5, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-20:56:51] Start training [03/12/24-20:56:51] Building vocabulary [03/12/24-20:57:23] Vocabulary size is 426964 [Shuffling 1] loss 2979571.7500 lr 0.5000 vocab_size 426964 (14.59s/24.84m) [Shuffling 2] loss 97274.6484 lr 0.4950 vocab_size 426964 (14.15s/24.48m) [Shuffling 3] loss 47601.6094 lr 0.4900 vocab_size 426964 (14.38s/24.49m) [Shuffling 4] loss 31642.8906 lr 0.4850 vocab_size 426964 (14.19s/24.41m) [Shuffling 5] loss 25099.8359 lr 0.4800 vocab_size 426964 (14.65s/24.52m) [Shuffling 6] loss 19819.1152 lr 0.4750 vocab_size 426964 (14.52s/24.56m) [Shuffling 7] loss 17860.7422 lr 0.4700 vocab_size 426964 (14.86s/24.66m) [Shuffling 8] loss 14753.1943 lr 0.4650 vocab_size 426964 (16.35s/25.05m) [Shuffling 9] loss 12998.0469 lr 0.4600 vocab_size 426964 (14.23s/24.96m) [Shuffling 10] loss 11576.3252 lr 0.4550 vocab_size 426964 (13.99s/24.86m) [Shuffling 11] loss 10894.9229 lr 0.4500 vocab_size 426964 (14.60s/24.86m) [Shuffling 12] loss 10299.9482 lr 0.4450 vocab_size 426964 (14.06s/24.78m) [Shuffling 13] loss 8590.1758 lr 0.4400 vocab_size 426964 (14.66s/24.80m) [Shuffling 14] loss 8649.6973 lr 0.4350 vocab_size 426964 (14.36s/24.77m) [Shuffling 15] loss 7652.7158 lr 0.4300 vocab_size 426964 (14.55s/24.77m) [Shuffling 16] loss 7386.3081 lr 0.4250 vocab_size 426964 (14.48s/24.77m) [Shuffling 17] loss 7136.1113 lr 0.4200 vocab_size 426964 (14.91s/24.80m) [Shuffling 18] loss 6552.7661 lr 0.4150 vocab_size 426964 (14.60s/24.81m) [Shuffling 19] loss 6787.8350 lr 0.4100 vocab_size 426964 (14.02s/24.76m) [Shuffling 20] loss 5873.9668 lr 0.4050 vocab_size 426964 (14.51s/24.76m) [Shuffling 21] loss 5421.7646 lr 0.4000 vocab_size 426964 (14.84s/24.78m) [Shuffling 22] loss 5907.9023 lr 0.3950 vocab_size 426964 (14.33s/24.76m) [Shuffling 23] loss 6008.7192 lr 0.3900 vocab_size 426964 (15.43s/24.83m) [Shuffling 24] loss 5195.0747 lr 0.3850 vocab_size 426964 (15.67s/24.91m) [Shuffling 25] loss 5249.8003 lr 0.3800 vocab_size 426964 (14.46s/24.90m) [Shuffling 26] loss 4898.2471 lr 0.3750 vocab_size 426964 (14.62s/24.90m) [Shuffling 27] loss 4327.8989 lr 0.3700 vocab_size 426964 (15.04s/24.92m) [Shuffling 28] loss 4769.3765 lr 0.3650 vocab_size 426964 (14.57s/24.92m) [Shuffling 29] loss 4880.4546 lr 0.3600 vocab_size 426964 (14.95s/24.94m) [Shuffling 30] loss 4481.5439 lr 0.3550 vocab_size 426964 (15.39s/24.98m) [Shuffling 31] loss 4659.7476 lr 0.3500 vocab_size 426964 (14.37s/24.97m) [Shuffling 32] loss 4421.9619 lr 0.3450 vocab_size 426964 (15.93s/25.03m) [Shuffling 33] loss 4188.7261 lr 0.3400 vocab_size 426964 (15.04s/25.05m) [Shuffling 34] loss 4546.6421 lr 0.3350 vocab_size 426964 (14.56s/25.04m) [Shuffling 35] loss 4328.2842 lr 0.3300 vocab_size 426964 (14.63s/25.04m) [Shuffling 36] loss 4456.7251 lr 0.3250 vocab_size 426964 (15.13s/25.06m) [Shuffling 37] loss 4612.2378 lr 0.3200 vocab_size 426964 (14.69s/25.06m) [Shuffling 38] loss 3810.5813 lr 0.3150 vocab_size 426964 (14.70s/25.06m) [Shuffling 39] loss 4489.7544 lr 0.3100 vocab_size 426964 (14.33s/25.04m) [Shuffling 40] loss 4492.8267 lr 0.3050 vocab_size 426964 (15.05s/25.05m) [Shuffling 41] loss 3877.0552 lr 0.3000 vocab_size 426964 (15.46s/25.08m) [Shuffling 42] loss 4203.3389 lr 0.2950 vocab_size 426964 (14.86s/25.09m) [Shuffling 43] loss 4556.4487 lr 0.2900 vocab_size 426964 (14.63s/25.09m) [Shuffling 44] loss 3664.6670 lr 0.2850 vocab_size 426964 (16.31s/25.15m) [Shuffling 45] loss 4232.4751 lr 0.2800 vocab_size 426964 (14.38s/25.13m) [Shuffling 46] loss 3699.7969 lr 0.2750 vocab_size 426964 (14.97s/25.14m) [Shuffling 47] loss 3727.7090 lr 0.2700 vocab_size 426964 (14.50s/25.13m) [Shuffling 48] loss 3964.6721 lr 0.2650 vocab_size 426964 (14.35s/25.12m) [Shuffling 49] loss 3399.6521 lr 0.2600 vocab_size 426964 (14.89s/25.12m) [Shuffling 50] loss 3376.2507 lr 0.2550 vocab_size 426964 (15.36s/25.14m) [Shuffling 51] loss 3118.7073 lr 0.2500 vocab_size 426964 (14.77s/25.14m) [Shuffling 52] loss 3803.5452 lr 0.2451 vocab_size 426964 (14.10s/25.12m) [Shuffling 53] loss 2867.8428 lr 0.2401 vocab_size 426964 (14.52s/25.11m) [Shuffling 54] loss 3589.5417 lr 0.2351 vocab_size 426964 (14.58s/25.11m) [Shuffling 55] loss 3010.2698 lr 0.2301 vocab_size 426964 (14.70s/25.11m) [Shuffling 56] loss 3151.5085 lr 0.2251 vocab_size 426964 (14.73s/25.11m) [Shuffling 57] loss 3208.8525 lr 0.2201 vocab_size 426964 (14.83s/25.11m) [Shuffling 58] loss 3278.2839 lr 0.2151 vocab_size 426964 (14.49s/25.10m) [Shuffling 59] loss 2586.0764 lr 0.2101 vocab_size 426964 (15.00s/25.11m) [Shuffling 60] loss 2660.6006 lr 0.2051 vocab_size 426964 (14.23s/25.10m) [Shuffling 61] loss 2770.9519 lr 0.2001 vocab_size 426964 (15.31s/25.11m) [Shuffling 62] loss 2793.5723 lr 0.1951 vocab_size 426964 (14.95s/25.12m) [Shuffling 63] loss 2587.3750 lr 0.1901 vocab_size 426964 (15.13s/25.13m) [Shuffling 64] loss 2774.6431 lr 0.1851 vocab_size 426964 (14.99s/25.13m) [Shuffling 65] loss 2733.8923 lr 0.1801 vocab_size 426964 (14.34s/25.12m) [Shuffling 66] loss 2654.5537 lr 0.1751 vocab_size 426964 (14.78s/25.12m) [Shuffling 67] loss 2376.9045 lr 0.1701 vocab_size 426964 (15.22s/25.14m) [Shuffling 68] loss 2639.6404 lr 0.1651 vocab_size 426964 (14.71s/25.13m) [Shuffling 69] loss 2496.8477 lr 0.1601 vocab_size 426964 (14.37s/25.12m) [Shuffling 70] loss 2277.2551 lr 0.1551 vocab_size 426964 (14.70s/25.12m) [Shuffling 71] loss 2277.4324 lr 0.1501 vocab_size 426964 (15.31s/25.14m) [Shuffling 72] loss 2368.9043 lr 0.1451 vocab_size 426964 (14.46s/25.13m) [Shuffling 73] loss 1904.5956 lr 0.1401 vocab_size 426964 (14.44s/25.12m) [Shuffling 74] loss 2243.6716 lr 0.1351 vocab_size 426964 (14.63s/25.12m) [Shuffling 75] loss 2112.5566 lr 0.1301 vocab_size 426964 (14.96s/25.12m) [Shuffling 76] loss 2089.9534 lr 0.1251 vocab_size 426964 (16.04s/25.15m) [Shuffling 77] loss 1992.3027 lr 0.1201 vocab_size 426964 (14.50s/25.15m) [Shuffling 78] loss 2079.8699 lr 0.1151 vocab_size 426964 (15.02s/25.15m) [Shuffling 79] loss 2108.3545 lr 0.1101 vocab_size 426964 (14.17s/25.14m) [Shuffling 80] loss 2056.6736 lr 0.1051 vocab_size 426964 (14.12s/25.13m) [Shuffling 81] loss 1942.9506 lr 0.1001 vocab_size 426964 (14.93s/25.13m) [Shuffling 82] loss 2167.7834 lr 0.0951 vocab_size 426964 (15.03s/25.14m) [Shuffling 83] loss 1956.5576 lr 0.0901 vocab_size 426964 (14.85s/25.14m) [Shuffling 84] loss 1860.9050 lr 0.0851 vocab_size 426964 (14.74s/25.14m) [Shuffling 85] loss 1954.8406 lr 0.0801 vocab_size 426964 (14.58s/25.13m) [Shuffling 86] loss 2383.2717 lr 0.0751 vocab_size 426964 (14.10s/25.12m) [Shuffling 87] loss 1815.6180 lr 0.0701 vocab_size 426964 (14.44s/25.12m) [Shuffling 88] loss 2122.4912 lr 0.0651 vocab_size 426964 (14.25s/25.11m) [Shuffling 89] loss 1804.7616 lr 0.0601 vocab_size 426964 (14.21s/25.10m) [Shuffling 90] loss 1935.0122 lr 0.0551 vocab_size 426964 (14.31s/25.09m) [Shuffling 91] loss 1864.3099 lr 0.0501 vocab_size 426964 (14.25s/25.08m) [Shuffling 92] loss 1870.5901 lr 0.0451 vocab_size 426964 (13.99s/25.07m) [Shuffling 93] loss 1993.0562 lr 0.0401 vocab_size 426964 (14.31s/25.06m) [Shuffling 94] loss 1824.1761 lr 0.0351 vocab_size 426964 (14.31s/25.05m) [Shuffling 95] loss 2074.1306 lr 0.0301 vocab_size 426964 (14.30s/25.05m) [Shuffling 96] loss 1858.6656 lr 0.0251 vocab_size 426964 (14.37s/25.04m) [Shuffling 97] loss 1603.8906 lr 0.0201 vocab_size 426964 (14.97s/25.04m) [Shuffling 98] loss 1859.3983 lr 0.0151 vocab_size 426964 (14.04s/25.03m) [Shuffling 99] loss 2023.4545 lr 0.0101 vocab_size 426964 (13.99s/25.02m) [Shuffling 100] loss 1717.6626 lr 0.0051 vocab_size 426964 (14.52s/25.02m) [03/12/24-21:21:53] Training finished, training Time 25.02m