num_sent_processes: 4 [0] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Large/5W100D-0.0250r/shuffled_datasets [1] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Large/5W100D-0.0250r/shuffled_datasets [2] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Large/5W100D-0.0250r/shuffled_datasets [3] Creating shuffled datasets in /scratch/gz5hp/tfbs_region2vec_models/expr_universe_Large/5W100D-0.0250r/shuffled_datasets {'num_shuffle': 100, 'embed_dim': 100, 'context_len': 5, 'nworkers': 6, 'save_freq': -1, 'save_dir': '/scratch/gz5hp/tfbs_region2vec_models/expr_universe_Large/5W100D-0.0250r', 'resume': '', 'train_alg': 'cbow', 'min_count': 5, 'neg_samples': 5, 'init_lr': 0.025, 'min_lr': 0.0001, 'lr_mode': 'linear', 'milestones': [], 'hier_softmax': False, 'update_vocab': 'once', 'seed': 0} Using cbow, negative sampling with 5 negative samples [03/12/24-17:40:42] Start training [03/12/24-17:40:42] Building vocabulary [03/12/24-17:41:05] Vocabulary size is 287225 [Shuffling 1] loss 7003937.0000 lr 0.0250 vocab_size 287225 (13.45s/22.79m) [Shuffling 2] loss 5400054.0000 lr 0.0248 vocab_size 287225 (13.19s/22.58m) [Shuffling 3] loss 5115420.0000 lr 0.0245 vocab_size 287225 (13.05s/22.43m) [Shuffling 4] loss 4675998.0000 lr 0.0243 vocab_size 287225 (13.16s/22.41m) [Shuffling 5] loss 4638052.5000 lr 0.0240 vocab_size 287225 (13.04s/22.35m) [Shuffling 6] loss 4696942.5000 lr 0.0238 vocab_size 287225 (13.23s/22.37m) [Shuffling 7] loss 4628057.0000 lr 0.0235 vocab_size 287225 (13.35s/22.41m) [Shuffling 8] loss 4595316.0000 lr 0.0233 vocab_size 287225 (13.36s/22.44m) [Shuffling 9] loss 4473129.0000 lr 0.0230 vocab_size 287225 (13.30s/22.45m) [Shuffling 10] loss 4527997.5000 lr 0.0228 vocab_size 287225 (12.86s/22.39m) [Shuffling 11] loss 4467524.5000 lr 0.0225 vocab_size 287225 (13.09s/22.38m) [Shuffling 12] loss 4245874.5000 lr 0.0223 vocab_size 287225 (13.37s/22.40m) [Shuffling 13] loss 4312850.5000 lr 0.0220 vocab_size 287225 (13.02s/22.38m) [Shuffling 14] loss 4468664.5000 lr 0.0218 vocab_size 287225 (12.96s/22.35m) [Shuffling 15] loss 4320156.5000 lr 0.0215 vocab_size 287225 (13.00s/22.33m) [Shuffling 16] loss 4184142.0000 lr 0.0213 vocab_size 287225 (13.22s/22.33m) [Shuffling 17] loss 4342559.0000 lr 0.0210 vocab_size 287225 (13.04s/22.32m) [Shuffling 18] loss 4421856.5000 lr 0.0208 vocab_size 287225 (13.17s/22.32m) [Shuffling 19] loss 4302401.5000 lr 0.0205 vocab_size 287225 (12.98s/22.31m) [Shuffling 20] loss 4085359.2500 lr 0.0203 vocab_size 287225 (13.23s/22.31m) [Shuffling 21] loss 4109800.5000 lr 0.0200 vocab_size 287225 (13.15s/22.31m) [Shuffling 22] loss 4154564.7500 lr 0.0198 vocab_size 287225 (13.18s/22.32m) [Shuffling 23] loss 3960590.2500 lr 0.0195 vocab_size 287225 (13.31s/22.33m) [Shuffling 24] loss 4135237.2500 lr 0.0193 vocab_size 287225 (13.11s/22.32m) [Shuffling 25] loss 4040582.5000 lr 0.0190 vocab_size 287225 (12.96s/22.31m) [Shuffling 26] loss 4186106.0000 lr 0.0188 vocab_size 287225 (13.15s/22.31m) [Shuffling 27] loss 4076660.7500 lr 0.0185 vocab_size 287225 (13.08s/22.31m) [Shuffling 28] loss 4121569.7500 lr 0.0183 vocab_size 287225 (13.04s/22.30m) [Shuffling 29] loss 4013154.7500 lr 0.0180 vocab_size 287225 (12.88s/22.28m) [Shuffling 30] loss 3980294.0000 lr 0.0178 vocab_size 287225 (13.05s/22.28m) [Shuffling 31] loss 4209556.0000 lr 0.0175 vocab_size 287225 (13.22s/22.28m) [Shuffling 32] loss 4005797.5000 lr 0.0173 vocab_size 287225 (13.08s/22.28m) [Shuffling 33] loss 4081410.7500 lr 0.0170 vocab_size 287225 (13.02s/22.27m) [Shuffling 34] loss 4192864.0000 lr 0.0168 vocab_size 287225 (13.10s/22.27m) [Shuffling 35] loss 3961941.2500 lr 0.0165 vocab_size 287225 (12.98s/22.27m) [Shuffling 36] loss 4277460.5000 lr 0.0163 vocab_size 287225 (12.70s/22.25m) [Shuffling 37] loss 4054719.7500 lr 0.0160 vocab_size 287225 (12.90s/22.24m) [Shuffling 38] loss 4136922.2500 lr 0.0158 vocab_size 287225 (13.02s/22.23m) [Shuffling 39] loss 4012446.7500 lr 0.0155 vocab_size 287225 (12.98s/22.23m) [Shuffling 40] loss 3960372.0000 lr 0.0153 vocab_size 287225 (13.43s/22.24m) [Shuffling 41] loss 3953246.2500 lr 0.0150 vocab_size 287225 (13.25s/22.25m) [Shuffling 42] loss 4054746.2500 lr 0.0148 vocab_size 287225 (13.08s/22.24m) [Shuffling 43] loss 3954718.7500 lr 0.0145 vocab_size 287225 (13.15s/22.25m) [Shuffling 44] loss 4109278.7500 lr 0.0143 vocab_size 287225 (13.02s/22.24m) [Shuffling 45] loss 4303499.0000 lr 0.0140 vocab_size 287225 (13.02s/22.24m) [Shuffling 46] loss 3855948.5000 lr 0.0138 vocab_size 287225 (13.24s/22.24m) [Shuffling 47] loss 4109240.0000 lr 0.0135 vocab_size 287225 (13.02s/22.24m) [Shuffling 48] loss 4021555.0000 lr 0.0133 vocab_size 287225 (13.16s/22.24m) [Shuffling 49] loss 3973256.0000 lr 0.0130 vocab_size 287225 (13.17s/22.24m) [Shuffling 50] loss 3930617.2500 lr 0.0128 vocab_size 287225 (13.20s/22.25m) [Shuffling 51] loss 3841173.0000 lr 0.0126 vocab_size 287225 (13.31s/22.25m) [Shuffling 52] loss 3926613.5000 lr 0.0123 vocab_size 287225 (13.13s/22.25m) [Shuffling 53] loss 4016367.0000 lr 0.0121 vocab_size 287225 (13.08s/22.25m) [Shuffling 54] loss 3878329.7500 lr 0.0118 vocab_size 287225 (13.16s/22.25m) [Shuffling 55] loss 3935380.5000 lr 0.0116 vocab_size 287225 (13.04s/22.25m) [Shuffling 56] loss 3984647.0000 lr 0.0113 vocab_size 287225 (13.12s/22.25m) [Shuffling 57] loss 4052973.2500 lr 0.0111 vocab_size 287225 (13.10s/22.25m) [Shuffling 58] loss 3952553.0000 lr 0.0108 vocab_size 287225 (13.00s/22.25m) [Shuffling 59] loss 4047244.2500 lr 0.0106 vocab_size 287225 (13.10s/22.25m) [Shuffling 60] loss 4056052.5000 lr 0.0103 vocab_size 287225 (13.08s/22.25m) [Shuffling 61] loss 3998152.0000 lr 0.0101 vocab_size 287225 (13.07s/22.24m) [Shuffling 62] loss 3937571.2500 lr 0.0098 vocab_size 287225 (13.03s/22.24m) [Shuffling 63] loss 3869056.2500 lr 0.0096 vocab_size 287225 (13.07s/22.24m) [Shuffling 64] loss 3903927.0000 lr 0.0093 vocab_size 287225 (13.21s/22.24m) [Shuffling 65] loss 3945123.5000 lr 0.0091 vocab_size 287225 (13.09s/22.24m) [Shuffling 66] loss 3911111.7500 lr 0.0088 vocab_size 287225 (13.24s/22.25m) [Shuffling 67] loss 3945173.2500 lr 0.0086 vocab_size 287225 (13.26s/22.25m) [Shuffling 68] loss 3963858.2500 lr 0.0083 vocab_size 287225 (13.25s/22.25m) [Shuffling 69] loss 3911632.5000 lr 0.0081 vocab_size 287225 (13.04s/22.25m) [Shuffling 70] loss 3936850.0000 lr 0.0078 vocab_size 287225 (13.18s/22.25m) [Shuffling 71] loss 4031483.5000 lr 0.0076 vocab_size 287225 (12.96s/22.25m) [Shuffling 72] loss 4039325.2500 lr 0.0073 vocab_size 287225 (13.09s/22.25m) [Shuffling 73] loss 3870686.5000 lr 0.0071 vocab_size 287225 (13.19s/22.25m) [Shuffling 74] loss 3984838.5000 lr 0.0068 vocab_size 287225 (13.08s/22.25m) [Shuffling 75] loss 3942732.7500 lr 0.0066 vocab_size 287225 (13.28s/22.25m) [Shuffling 76] loss 3802633.2500 lr 0.0063 vocab_size 287225 (13.32s/22.26m) [Shuffling 77] loss 4144807.0000 lr 0.0061 vocab_size 287225 (13.14s/22.26m) [Shuffling 78] loss 3795754.0000 lr 0.0058 vocab_size 287225 (13.40s/22.26m) [Shuffling 79] loss 3792117.7500 lr 0.0056 vocab_size 287225 (13.54s/22.27m) [Shuffling 80] loss 3926745.5000 lr 0.0053 vocab_size 287225 (13.08s/22.27m) [Shuffling 81] loss 4001142.7500 lr 0.0051 vocab_size 287225 (13.01s/22.27m) [Shuffling 82] loss 3848615.5000 lr 0.0048 vocab_size 287225 (13.03s/22.27m) [Shuffling 83] loss 3965796.0000 lr 0.0046 vocab_size 287225 (13.13s/22.27m) [Shuffling 84] loss 3818687.2500 lr 0.0043 vocab_size 287225 (13.06s/22.26m) [Shuffling 85] loss 3850338.7500 lr 0.0041 vocab_size 287225 (13.05s/22.26m) [Shuffling 86] loss 3825991.5000 lr 0.0038 vocab_size 287225 (12.98s/22.26m) [Shuffling 87] loss 3908890.7500 lr 0.0036 vocab_size 287225 (13.08s/22.26m) [Shuffling 88] loss 3877989.2500 lr 0.0033 vocab_size 287225 (13.11s/22.26m) [Shuffling 89] loss 3796131.5000 lr 0.0031 vocab_size 287225 (12.96s/22.26m) [Shuffling 90] loss 3858048.0000 lr 0.0028 vocab_size 287225 (13.04s/22.25m) [Shuffling 91] loss 4022595.5000 lr 0.0026 vocab_size 287225 (13.13s/22.25m) [Shuffling 92] loss 3797790.7500 lr 0.0023 vocab_size 287225 (13.23s/22.26m) [Shuffling 93] loss 4117803.5000 lr 0.0021 vocab_size 287225 (13.18s/22.26m) [Shuffling 94] loss 3818213.7500 lr 0.0018 vocab_size 287225 (12.90s/22.25m) [Shuffling 95] loss 3958913.0000 lr 0.0016 vocab_size 287225 (14.29s/22.27m) [Shuffling 96] loss 3944020.2500 lr 0.0013 vocab_size 287225 (13.07s/22.27m) [Shuffling 97] loss 3796053.0000 lr 0.0011 vocab_size 287225 (26.25s/22.50m) [Shuffling 98] loss 3863099.7500 lr 0.0008 vocab_size 287225 (26.21s/22.72m) [Shuffling 99] loss 3855720.5000 lr 0.0006 vocab_size 287225 (26.29s/22.94m) [Shuffling 100] loss 3889076.7500 lr 0.0003 vocab_size 287225 (26.02s/23.14m) [03/12/24-18:03:51] Training finished, training Time 23.14m