num_sent_processes: 4 [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.0250r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.0250r/shuffled_datasets [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.0250r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 50, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.0250r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.025, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_tile5k/50W100D-0.0250r/shuffled_datasets Using cbow, negative sampling with 5 negative samples [03/12/24-18:14:16] Start training [03/12/24-18:14:16] Building vocabulary [03/12/24-18:15:07] Vocabulary size is 251084 [Shuffling 1] loss 6191828.5000 lr 0.0250 vocab_size 251084 (14.35s/24.78m) [Shuffling 2] loss 4997348.5000 lr 0.0248 vocab_size 251084 (13.62s/24.17m) [Shuffling 3] loss 4431577.0000 lr 0.0245 vocab_size 251084 (14.51s/24.47m) [Shuffling 4] loss 4680318.0000 lr 0.0243 vocab_size 251084 (13.20s/24.07m) [Shuffling 5] loss 4689345.5000 lr 0.0240 vocab_size 251084 (13.36s/23.89m) [Shuffling 6] loss 4330696.5000 lr 0.0238 vocab_size 251084 (13.66s/23.85m) [Shuffling 7] loss 4547859.5000 lr 0.0235 vocab_size 251084 (13.47s/23.77m) [Shuffling 8] loss 4436850.0000 lr 0.0233 vocab_size 251084 (13.39s/23.70m) [Shuffling 9] loss 4491010.5000 lr 0.0230 vocab_size 251084 (14.15s/23.79m) [Shuffling 10] loss 4253299.0000 lr 0.0228 vocab_size 251084 (13.56s/23.76m) [Shuffling 11] loss 4355816.5000 lr 0.0225 vocab_size 251084 (13.51s/23.72m) [Shuffling 12] loss 4321357.5000 lr 0.0223 vocab_size 251084 (13.38s/23.68m) [Shuffling 13] loss 4291078.0000 lr 0.0220 vocab_size 251084 (13.48s/23.65m) [Shuffling 14] loss 4353339.5000 lr 0.0218 vocab_size 251084 (13.10s/23.59m) [Shuffling 15] loss 4422516.0000 lr 0.0215 vocab_size 251084 (13.07s/23.53m) [Shuffling 16] loss 4338148.0000 lr 0.0213 vocab_size 251084 (13.28s/23.49m) [Shuffling 17] loss 4122147.7500 lr 0.0210 vocab_size 251084 (14.27s/23.56m) [Shuffling 18] loss 4252033.0000 lr 0.0208 vocab_size 251084 (13.57s/23.56m) [Shuffling 19] loss 4044038.0000 lr 0.0205 vocab_size 251084 (14.27s/23.62m) [Shuffling 20] loss 4166882.2500 lr 0.0203 vocab_size 251084 (13.49s/23.60m) [Shuffling 21] loss 4187032.0000 lr 0.0200 vocab_size 251084 (13.26s/23.57m) [Shuffling 22] loss 4318252.5000 lr 0.0198 vocab_size 251084 (13.08s/23.53m) [Shuffling 23] loss 4144325.0000 lr 0.0195 vocab_size 251084 (13.27s/23.51m) [Shuffling 24] loss 4030231.7500 lr 0.0193 vocab_size 251084 (13.47s/23.50m) [Shuffling 25] loss 4106241.7500 lr 0.0190 vocab_size 251084 (13.20s/23.48m) [Shuffling 26] loss 4109419.7500 lr 0.0188 vocab_size 251084 (13.69s/23.49m) [Shuffling 27] loss 4231992.0000 lr 0.0185 vocab_size 251084 (13.18s/23.46m) [Shuffling 28] loss 4035556.2500 lr 0.0183 vocab_size 251084 (13.54s/23.46m) [Shuffling 29] loss 4282512.5000 lr 0.0180 vocab_size 251084 (13.84s/23.48m) [Shuffling 30] loss 4173896.0000 lr 0.0178 vocab_size 251084 (13.39s/23.47m) [Shuffling 31] loss 4024902.5000 lr 0.0175 vocab_size 251084 (13.97s/23.49m) [Shuffling 32] loss 4093344.2500 lr 0.0173 vocab_size 251084 (13.25s/23.48m) [Shuffling 33] loss 4208232.0000 lr 0.0170 vocab_size 251084 (13.20s/23.46m) [Shuffling 34] loss 3995076.5000 lr 0.0168 vocab_size 251084 (13.80s/23.47m) [Shuffling 35] loss 4026527.5000 lr 0.0165 vocab_size 251084 (12.98s/23.44m) [Shuffling 36] loss 4188781.0000 lr 0.0163 vocab_size 251084 (13.12s/23.43m) [Shuffling 37] loss 4125749.7500 lr 0.0160 vocab_size 251084 (13.42s/23.42m) [Shuffling 38] loss 4136265.0000 lr 0.0158 vocab_size 251084 (13.06s/23.40m) [Shuffling 39] loss 4011751.2500 lr 0.0155 vocab_size 251084 (13.01s/23.38m) [Shuffling 40] loss 4028265.0000 lr 0.0153 vocab_size 251084 (13.17s/23.37m) [Shuffling 41] loss 4202974.0000 lr 0.0150 vocab_size 251084 (13.43s/23.36m) [Shuffling 42] loss 3896680.5000 lr 0.0148 vocab_size 251084 (14.10s/23.39m) [Shuffling 43] loss 4069869.7500 lr 0.0145 vocab_size 251084 (13.14s/23.37m) [Shuffling 44] loss 4051022.0000 lr 0.0143 vocab_size 251084 (13.75s/23.38m) [Shuffling 45] loss 3939573.5000 lr 0.0140 vocab_size 251084 (13.41s/23.38m) [Shuffling 46] loss 4063334.5000 lr 0.0138 vocab_size 251084 (13.04s/23.36m) [Shuffling 47] loss 4177377.0000 lr 0.0135 vocab_size 251084 (13.74s/23.37m) [Shuffling 48] loss 4070894.7500 lr 0.0133 vocab_size 251084 (13.17s/23.36m) [Shuffling 49] loss 4194273.0000 lr 0.0130 vocab_size 251084 (13.87s/23.37m) [Shuffling 50] loss 3995488.5000 lr 0.0128 vocab_size 251084 (13.43s/23.37m) [Shuffling 51] loss 3962706.7500 lr 0.0126 vocab_size 251084 (13.84s/23.38m) [Shuffling 52] loss 3931395.2500 lr 0.0123 vocab_size 251084 (13.54s/23.38m) [Shuffling 53] loss 3980444.5000 lr 0.0121 vocab_size 251084 (13.35s/23.38m) [Shuffling 54] loss 3721272.0000 lr 0.0118 vocab_size 251084 (14.10s/23.39m) [Shuffling 55] loss 4041320.5000 lr 0.0116 vocab_size 251084 (13.43s/23.39m) [Shuffling 56] loss 4027878.2500 lr 0.0113 vocab_size 251084 (13.07s/23.38m) [Shuffling 57] loss 4081452.0000 lr 0.0111 vocab_size 251084 (13.06s/23.37m) [Shuffling 58] loss 3899262.5000 lr 0.0108 vocab_size 251084 (13.40s/23.36m) [Shuffling 59] loss 4194309.0000 lr 0.0106 vocab_size 251084 (13.37s/23.36m) [Shuffling 60] loss 4020976.0000 lr 0.0103 vocab_size 251084 (13.55s/23.36m) [Shuffling 61] loss 4019601.7500 lr 0.0101 vocab_size 251084 (13.26s/23.36m) [Shuffling 62] loss 4120363.0000 lr 0.0098 vocab_size 251084 (13.96s/23.37m) [Shuffling 63] loss 3819670.0000 lr 0.0096 vocab_size 251084 (13.37s/23.37m) [Shuffling 64] loss 4076706.7500 lr 0.0093 vocab_size 251084 (13.88s/23.38m) [Shuffling 65] loss 3997399.7500 lr 0.0091 vocab_size 251084 (13.28s/23.37m) [Shuffling 66] loss 4094280.5000 lr 0.0088 vocab_size 251084 (13.82s/23.38m) [Shuffling 67] loss 3911323.0000 lr 0.0086 vocab_size 251084 (13.55s/23.38m) [Shuffling 68] loss 3956501.7500 lr 0.0083 vocab_size 251084 (13.36s/23.38m) [Shuffling 69] loss 3958331.2500 lr 0.0081 vocab_size 251084 (12.99s/23.36m) [Shuffling 70] loss 4001384.2500 lr 0.0078 vocab_size 251084 (13.32s/23.36m) [Shuffling 71] loss 3889047.5000 lr 0.0076 vocab_size 251084 (13.16s/23.35m) [Shuffling 72] loss 3991230.0000 lr 0.0073 vocab_size 251084 (13.51s/23.35m) [Shuffling 73] loss 3963165.2500 lr 0.0071 vocab_size 251084 (13.00s/23.34m) [Shuffling 74] loss 3981677.5000 lr 0.0068 vocab_size 251084 (13.08s/23.33m) [Shuffling 75] loss 3834415.5000 lr 0.0066 vocab_size 251084 (13.11s/23.32m) [Shuffling 76] loss 4009298.5000 lr 0.0063 vocab_size 251084 (12.97s/23.31m) [Shuffling 77] loss 3890496.0000 lr 0.0061 vocab_size 251084 (13.38s/23.31m) [Shuffling 78] loss 3919856.5000 lr 0.0058 vocab_size 251084 (13.15s/23.31m) [Shuffling 79] loss 3860693.0000 lr 0.0056 vocab_size 251084 (14.34s/23.32m) [Shuffling 80] loss 4081199.5000 lr 0.0053 vocab_size 251084 (13.95s/23.33m) [Shuffling 81] loss 3916263.0000 lr 0.0051 vocab_size 251084 (13.55s/23.34m) [Shuffling 82] loss 3928805.5000 lr 0.0048 vocab_size 251084 (13.21s/23.33m) [Shuffling 83] loss 3833325.7500 lr 0.0046 vocab_size 251084 (13.75s/23.34m) [Shuffling 84] loss 3894715.7500 lr 0.0043 vocab_size 251084 (13.85s/23.34m) [Shuffling 85] loss 3993402.2500 lr 0.0041 vocab_size 251084 (13.96s/23.35m) [Shuffling 86] loss 4020776.7500 lr 0.0038 vocab_size 251084 (13.77s/23.36m) [Shuffling 87] loss 3922738.7500 lr 0.0036 vocab_size 251084 (13.85s/23.37m) [Shuffling 88] loss 3854569.7500 lr 0.0033 vocab_size 251084 (13.53s/23.37m) [Shuffling 89] loss 4036002.0000 lr 0.0031 vocab_size 251084 (13.13s/23.36m) [Shuffling 90] loss 3773623.0000 lr 0.0028 vocab_size 251084 (14.07s/23.37m) [Shuffling 91] loss 3846545.0000 lr 0.0026 vocab_size 251084 (13.07s/23.36m) [Shuffling 92] loss 3912224.7500 lr 0.0023 vocab_size 251084 (13.65s/23.37m) [Shuffling 93] loss 3793121.7500 lr 0.0021 vocab_size 251084 (13.20s/23.36m) [Shuffling 94] loss 3885649.0000 lr 0.0018 vocab_size 251084 (13.77s/23.37m) [Shuffling 95] loss 3713900.7500 lr 0.0016 vocab_size 251084 (13.96s/23.37m) [Shuffling 96] loss 3826531.2500 lr 0.0013 vocab_size 251084 (13.47s/23.37m) [Shuffling 97] loss 3667060.5000 lr 0.0011 vocab_size 251084 (14.32s/23.39m) [Shuffling 98] loss 3760563.0000 lr 0.0008 vocab_size 251084 (13.65s/23.39m) [Shuffling 99] loss 3866963.0000 lr 0.0006 vocab_size 251084 (13.15s/23.38m) [Shuffling 100] loss 3892887.7500 lr 0.0003 vocab_size 251084 (14.16s/23.39m) [03/12/24-18:37:40] Training finished, training Time 23.39m