-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathnohup_llm-llm_alinet.txt
351 lines (339 loc) · 15.8 KB
/
nohup_llm-llm_alinet.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
load arguments: {'training_data': '../../datasets/', 'output': '../../output/results/Paper/eCommerceData/', 'dataset_division': '721_5fold', 'embedding_module': 'AliNet', 'alignment_module': 'mapping', 'search_module': 'greedy', 'layer_dims': [500, 400, 300], 'init': 'xavier', 'ent_l2_norm': True, 'rel_l2_norm': True, 'learning_rate': 0.001, 'optimizer': 'Adam', 'max_epoch': 2000, 'batch_size': 3000, 'neg_margin': 1.5, 'neg_margin_balance': 0.1, 'dropout': 0.0, 'neg_sampling': 'truncated', 'neg_triple_num': 10, 'truncated_epsilon': 0.98, 'truncated_freq': 10, 'batch_threads_num': 2, 'test_threads_num': 4, 'ordered': True, 'start_valid': 10, 'eval_freq': 10, 'stop_metric': 'hits1', 'eval_metric': 'inner', 'csls': 10, 'top_k': [1, 5, 10, 50], 'is_save': False, 'eval_norm': False, 'min_rel_win': 50, 'start_augment': 2, 'rel_param': 0.01, 'num_features_nonzero': 0, 'sim_th': 0.0, 'k': 20}
AliNet
<openea.modules.args.args_hander.ARGs object at 0x7fe44517e748>
read relation triples: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/rel_triples_1
read relation triples: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/rel_triples_2
read attribute triples: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/attr_triples_1
read attribute triples: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/attr_triples_2
read links: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/721_5fold/1/train_links
read links: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/721_5fold/1/valid_links
read links: ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/721_5fold/1/test_links
Number of rt_dict: 3553
Number of hr_dict: 2618
entity relations dict: 3553
Number of av_dict: 3346
entity attributes dict: 3346
KG statistics:
Number of entities: 3556
Number of relations: 3
Number of attributes: 6
Number of relation triples: 27366
Number of attribute triples: 15798
Number of local relation triples: 27366
Number of local attribute triples: 15798
Number of rt_dict: 3553
Number of hr_dict: 2618
entity relations dict: 3553
Number of av_dict: 3346
entity attributes dict: 3346
KG statistics:
Number of entities: 3556
Number of relations: 3
Number of attributes: 6
Number of relation triples: 27366
Number of attribute triples: 15798
Number of local relation triples: 27366
Number of local attribute triples: 15798
Number of rt_dict: 3553
Number of hr_dict: 2618
entity relations dict: 3553
Number of av_dict: 3346
entity attributes dict: 3346
KG statistics:
Number of entities: 3556
Number of relations: 3
Number of attributes: 6
Number of relation triples: 27366
Number of attribute triples: 15798
Number of local relation triples: 27366
Number of local attribute triples: 15798
Number of rt_dict: 3553
Number of hr_dict: 2618
entity relations dict: 3553
Number of av_dict: 3346
entity attributes dict: 3346
KG statistics:
Number of entities: 3556
Number of relations: 3
Number of attributes: 6
Number of relation triples: 27366
Number of attribute triples: 15798
Number of local relation triples: 27366
Number of local attribute triples: 15798
../../output/results/Paper/eCommerceData/ ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/ ['..', '..', 'datasets', 'Ontologies', 'Paper', 'eCommerceData', 'LLM-LLM'] 721_5fold/1/ AliNet
results output folder: ../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/
triples num 27366
head ent num 3553
total ent num 3556
ave outs: 7
additional triples: 2964
triples num 27366
head ent num 3553
total ent num 3556
ave outs: 7
additional triples: 2964
before enhanced: 27366 27366
after enhanced: 0 0
before removing unlinked triples: 54732
after removing unlinked triples: 47626
generating one-adj costs time: 0.2643s
before removing unlinked triples: 27366
after removing unlinked triples: 23813
total 2-hop neighbors: 17236
total 2-hop relation patterns: 1
selected relation patterns: 0
selected 2-hop neighbors: 0
before removing unlinked triples: 27366
after removing unlinked triples: 23813
total 2-hop neighbors: 17236
total 2-hop relation patterns: 1
selected relation patterns: 0
selected 2-hop neighbors: 0
generating one-adj costs time: 0.0280s
save adj data to ../../datasets/Ontologies/Paper/eCommerceData/LLM-LLM/721_5fold/1/alinet_saved_data.pkl
Getting AliNet model...
epoch 1, loss: 3620.3589, cost time: 10.5865s
epoch 2, loss: 2475.7974, cost time: 4.3748s
epoch 3, loss: 2354.9788, cost time: 4.5036s
epoch 4, loss: 2237.9309, cost time: 4.4118s
epoch 5, loss: 2050.4990, cost time: 3.6879s
epoch 6, loss: 1787.9716, cost time: 4.7020s
epoch 7, loss: 1547.1216, cost time: 5.0460s
epoch 8, loss: 1403.9934, cost time: 4.2249s
epoch 9, loss: 1292.9674, cost time: 5.1094s
epoch 10, loss: 1188.0707, cost time: 4.8289s
quick results: hits@[1, 5, 10, 50] = [59.831 74.719 78.652 85.393]%, time = 3.798 s
neighbors num 71
finding neighbors for sampling costs time: 7.2522s
epoch 11, loss: 2246.3989, cost time: 5.5836s
epoch 12, loss: 2077.4182, cost time: 5.5273s
epoch 13, loss: 1874.1085, cost time: 4.8963s
epoch 14, loss: 1746.7297, cost time: 4.9189s
epoch 15, loss: 1601.6036, cost time: 5.4229s
epoch 16, loss: 1536.6080, cost time: 5.1662s
epoch 17, loss: 1425.2612, cost time: 4.4514s
epoch 18, loss: 1289.6121, cost time: 5.8659s
epoch 19, loss: 1139.9733, cost time: 5.4174s
epoch 20, loss: 1003.5168, cost time: 4.7654s
quick results: hits@[1, 5, 10, 50] = [75.281 86.798 89.045 91.854]%, time = 4.184 s
neighbors num 71
finding neighbors for sampling costs time: 6.1106s
epoch 21, loss: 943.5159, cost time: 5.7779s
epoch 22, loss: 845.8942, cost time: 6.1371s
epoch 23, loss: 772.2697, cost time: 6.3774s
epoch 24, loss: 648.6059, cost time: 5.3433s
epoch 25, loss: 602.0616, cost time: 4.6561s
epoch 26, loss: 545.1234, cost time: 5.3215s
epoch 27, loss: 521.7786, cost time: 5.8154s
epoch 28, loss: 478.9961, cost time: 5.2246s
epoch 29, loss: 436.0201, cost time: 5.4663s
epoch 30, loss: 396.6273, cost time: 5.5229s
quick results: hits@[1, 5, 10, 50] = [79.494 90.169 91.854 95.506]%, time = 4.318 s
neighbors num 71
finding neighbors for sampling costs time: 7.0266s
epoch 31, loss: 444.7978, cost time: 5.5522s
epoch 32, loss: 420.5357, cost time: 5.6756s
epoch 33, loss: 397.6171, cost time: 5.3751s
epoch 34, loss: 363.9829, cost time: 4.4478s
epoch 35, loss: 346.6456, cost time: 4.9663s
epoch 36, loss: 343.2030, cost time: 5.6395s
epoch 37, loss: 325.2182, cost time: 5.5615s
epoch 38, loss: 306.1501, cost time: 5.0433s
epoch 39, loss: 294.2536, cost time: 5.0001s
epoch 40, loss: 285.6620, cost time: 4.7070s
quick results: hits@[1, 5, 10, 50] = [82.303 91.011 92.978 97.753]%, time = 3.585 s
neighbors num 71
finding neighbors for sampling costs time: 6.4464s
epoch 41, loss: 275.5436, cost time: 4.5668s
epoch 42, loss: 271.9646, cost time: 5.4941s
epoch 43, loss: 251.6716, cost time: 5.5867s
epoch 44, loss: 260.0086, cost time: 4.6023s
epoch 45, loss: 250.8354, cost time: 5.5303s
epoch 46, loss: 239.3159, cost time: 4.4514s
epoch 47, loss: 234.6142, cost time: 5.3908s
epoch 48, loss: 228.8320, cost time: 4.2122s
epoch 49, loss: 220.0099, cost time: 5.1749s
epoch 50, loss: 215.6472, cost time: 4.3739s
quick results: hits@[1, 5, 10, 50] = [83.708 92.135 94.944 98.034]%, time = 4.319 s
neighbors num 71
finding neighbors for sampling costs time: 5.8482s
epoch 51, loss: 210.3225, cost time: 4.3136s
epoch 52, loss: 209.8564, cost time: 3.5571s
epoch 53, loss: 201.2299, cost time: 4.1269s
epoch 54, loss: 199.6874, cost time: 4.0754s
epoch 55, loss: 189.5571, cost time: 4.1250s
epoch 56, loss: 186.0333, cost time: 4.1247s
epoch 57, loss: 189.5635, cost time: 3.9100s
epoch 58, loss: 181.8619, cost time: 3.7954s
epoch 59, loss: 175.7481, cost time: 4.0347s
epoch 60, loss: 174.7465, cost time: 4.4986s
quick results: hits@[1, 5, 10, 50] = [83.708 93.258 95.225 98.034]%, time = 3.860 s
neighbors num 71
finding neighbors for sampling costs time: 5.3586s
epoch 61, loss: 169.8700, cost time: 4.0469s
epoch 62, loss: 163.5400, cost time: 4.3994s
epoch 63, loss: 162.1381, cost time: 3.7988s
epoch 64, loss: 156.8748, cost time: 4.4223s
epoch 65, loss: 159.6613, cost time: 4.2958s
epoch 66, loss: 154.3425, cost time: 3.8322s
epoch 67, loss: 154.1969, cost time: 3.8342s
epoch 68, loss: 149.3124, cost time: 4.3622s
epoch 69, loss: 148.1142, cost time: 3.8040s
epoch 70, loss: 145.9396, cost time: 3.4543s
quick results: hits@[1, 5, 10, 50] = [84.831 92.416 94.944 98.315]%, time = 3.129 s
neighbors num 71
finding neighbors for sampling costs time: 5.4455s
epoch 71, loss: 151.4725, cost time: 4.2385s
epoch 72, loss: 145.7953, cost time: 3.8238s
epoch 73, loss: 147.2370, cost time: 4.3866s
epoch 74, loss: 144.3473, cost time: 3.7862s
epoch 75, loss: 139.0311, cost time: 4.0700s
epoch 76, loss: 139.5867, cost time: 3.7020s
epoch 77, loss: 133.8102, cost time: 4.1466s
epoch 78, loss: 137.0190, cost time: 3.7795s
epoch 79, loss: 135.8420, cost time: 4.1758s
epoch 80, loss: 134.5052, cost time: 3.8881s
quick results: hits@[1, 5, 10, 50] = [85.112 92.416 94.382 97.472]%, time = 4.690 s
neighbors num 71
finding neighbors for sampling costs time: 4.8306s
epoch 81, loss: 137.2161, cost time: 4.0999s
epoch 82, loss: 130.4837, cost time: 3.6963s
epoch 83, loss: 124.9557, cost time: 4.1286s
epoch 84, loss: 131.6749, cost time: 4.2230s
epoch 85, loss: 129.8868, cost time: 4.3904s
epoch 86, loss: 126.6799, cost time: 3.9301s
epoch 87, loss: 127.0044, cost time: 3.6477s
epoch 88, loss: 131.3909, cost time: 4.5122s
epoch 89, loss: 126.4274, cost time: 4.1019s
epoch 90, loss: 131.2718, cost time: 3.7337s
quick results: hits@[1, 5, 10, 50] = [85.674 92.697 93.82 96.629]%, time = 4.767 s
neighbors num 71
finding neighbors for sampling costs time: 5.1537s
epoch 91, loss: 125.6738, cost time: 3.5013s
epoch 92, loss: 127.0056, cost time: 4.1111s
epoch 93, loss: 124.3005, cost time: 4.2841s
epoch 94, loss: 119.6807, cost time: 4.2228s
epoch 95, loss: 123.3989, cost time: 4.0632s
epoch 96, loss: 121.4284, cost time: 4.4382s
epoch 97, loss: 121.8250, cost time: 4.2620s
epoch 98, loss: 115.2719, cost time: 3.9405s
epoch 99, loss: 120.9247, cost time: 4.1583s
epoch 100, loss: 123.6502, cost time: 3.9227s
quick results: hits@[1, 5, 10, 50] = [86.236 92.978 94.382 96.629]%, time = 6.338 s
neighbors num 71
finding neighbors for sampling costs time: 4.7756s
epoch 101, loss: 118.7169, cost time: 3.9516s
epoch 102, loss: 116.2324, cost time: 4.4126s
epoch 103, loss: 116.6931, cost time: 3.7633s
epoch 104, loss: 117.4386, cost time: 4.6476s
epoch 105, loss: 115.7653, cost time: 4.5585s
epoch 106, loss: 122.7212, cost time: 4.8533s
epoch 107, loss: 119.4260, cost time: 3.9291s
epoch 108, loss: 119.6620, cost time: 4.3402s
epoch 109, loss: 116.0626, cost time: 4.3555s
epoch 110, loss: 113.8082, cost time: 4.8266s
quick results: hits@[1, 5, 10, 50] = [86.517 92.978 94.101 96.91 ]%, time = 5.549 s
neighbors num 71
finding neighbors for sampling costs time: 5.6745s
epoch 111, loss: 118.2101, cost time: 4.6359s
epoch 112, loss: 115.6178, cost time: 4.2134s
epoch 113, loss: 109.6461, cost time: 4.4857s
epoch 114, loss: 112.1668, cost time: 4.7399s
epoch 115, loss: 117.8100, cost time: 4.2868s
epoch 116, loss: 114.6137, cost time: 4.7430s
epoch 117, loss: 111.7353, cost time: 4.6292s
epoch 118, loss: 115.3570, cost time: 4.6268s
epoch 119, loss: 110.6412, cost time: 3.6624s
epoch 120, loss: 115.9459, cost time: 4.3795s
quick results: hits@[1, 5, 10, 50] = [86.517 93.258 94.101 96.91 ]%, time = 5.799 s
neighbors num 71
finding neighbors for sampling costs time: 6.4470s
epoch 121, loss: 110.6397, cost time: 4.0493s
epoch 122, loss: 113.6991, cost time: 3.8816s
epoch 123, loss: 110.7214, cost time: 4.2800s
epoch 124, loss: 114.8969, cost time: 3.8931s
epoch 125, loss: 115.7212, cost time: 4.4249s
epoch 126, loss: 109.4515, cost time: 4.2657s
epoch 127, loss: 113.8161, cost time: 4.3803s
epoch 128, loss: 109.2766, cost time: 4.3081s
epoch 129, loss: 110.1367, cost time: 4.3195s
epoch 130, loss: 108.0009, cost time: 4.1708s
quick results: hits@[1, 5, 10, 50] = [86.798 93.258 94.944 97.191]%, time = 5.349 s
neighbors num 71
finding neighbors for sampling costs time: 6.2246s
epoch 131, loss: 110.9293, cost time: 5.0222s
epoch 132, loss: 108.1420, cost time: 4.2532s
epoch 133, loss: 113.1321, cost time: 3.7131s
epoch 134, loss: 108.6787, cost time: 4.3571s
epoch 135, loss: 113.5535, cost time: 3.8368s
epoch 136, loss: 109.9165, cost time: 4.7490s
epoch 137, loss: 108.2783, cost time: 4.6926s
epoch 138, loss: 109.5551, cost time: 4.5836s
epoch 139, loss: 113.9775, cost time: 3.8628s
epoch 140, loss: 108.3394, cost time: 4.3040s
quick results: hits@[1, 5, 10, 50] = [86.798 93.258 94.944 97.472]%, time = 5.331 s
neighbors num 71
finding neighbors for sampling costs time: 6.4665s
epoch 141, loss: 107.7553, cost time: 4.4834s
epoch 142, loss: 106.2764, cost time: 4.1555s
epoch 143, loss: 111.6630, cost time: 3.9443s
epoch 144, loss: 109.5018, cost time: 5.0899s
epoch 145, loss: 110.1623, cost time: 4.6881s
epoch 146, loss: 108.0657, cost time: 4.4675s
epoch 147, loss: 106.2904, cost time: 4.4065s
epoch 148, loss: 111.5968, cost time: 4.9016s
epoch 149, loss: 107.1238, cost time: 4.9118s
epoch 150, loss: 109.8090, cost time: 4.4768s
quick results: hits@[1, 5, 10, 50] = [87.079 93.258 94.944 97.472]%, time = 4.452 s
neighbors num 71
finding neighbors for sampling costs time: 5.2730s
epoch 151, loss: 108.3644, cost time: 4.8887s
epoch 152, loss: 105.2942, cost time: 4.3844s
epoch 153, loss: 108.5329, cost time: 3.9318s
epoch 154, loss: 101.8747, cost time: 4.3775s
epoch 155, loss: 108.8560, cost time: 4.5638s
epoch 156, loss: 105.8217, cost time: 4.0843s
epoch 157, loss: 108.8825, cost time: 4.2289s
epoch 158, loss: 109.7220, cost time: 3.7527s
epoch 159, loss: 106.4258, cost time: 4.4061s
epoch 160, loss: 109.5191, cost time: 4.1371s
quick results: hits@[1, 5, 10, 50] = [87.64 93.539 94.944 97.472]%, time = 5.318 s
neighbors num 71
finding neighbors for sampling costs time: 5.1661s
epoch 161, loss: 105.7598, cost time: 4.7681s
epoch 162, loss: 104.5650, cost time: 4.2615s
epoch 163, loss: 102.7794, cost time: 4.3299s
epoch 164, loss: 106.4876, cost time: 4.0843s
epoch 165, loss: 110.6335, cost time: 4.1821s
epoch 166, loss: 105.6639, cost time: 4.4078s
epoch 167, loss: 107.1873, cost time: 4.5920s
epoch 168, loss: 107.0185, cost time: 4.3938s
epoch 169, loss: 105.8546, cost time: 3.9550s
epoch 170, loss: 110.3599, cost time: 4.3577s
quick results: hits@[1, 5, 10, 50] = [87.64 93.539 94.944 97.753]%, time = 4.846 s
neighbors num 71
finding neighbors for sampling costs time: 5.4986s
epoch 171, loss: 105.6144, cost time: 4.5895s
epoch 172, loss: 104.1621, cost time: 3.8111s
epoch 173, loss: 105.0451, cost time: 3.8848s
epoch 174, loss: 102.9796, cost time: 3.8803s
epoch 175, loss: 109.0330, cost time: 4.2735s
epoch 176, loss: 107.5017, cost time: 4.2900s
epoch 177, loss: 105.7386, cost time: 4.2367s
epoch 178, loss: 105.3641, cost time: 3.9378s
epoch 179, loss: 108.2007, cost time: 3.6382s
epoch 180, loss: 103.5817, cost time: 3.7533s
quick results: hits@[1, 5, 10, 50] = [87.64 93.258 95.506 97.753]%, time = 3.624 s
== should early stop ==
== training stop ==
accurate results: hits@[1, 5, 10, 50] = [86.981 94.229 95.707 98.381]%, mr = 4.280, mrr = 0.902429, time = 4.967 s
accurate results with csls: csls=10, hits@[1, 5, 10, 50] = [88.318 95.426 96.904 99.156]%, mr = 2.396, mrr = 0.915035, time = 4.882 s
Results saved!
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg1_ent_ids saved.
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg2_ent_ids saved.
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg1_rel_ids saved.
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg2_rel_ids saved.
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg1_attr_ids saved.
../../output/results/Paper/eCommerceData/AliNet/LLM-LLM/721_5fold/1/20231020224346/kg2_attr_ids saved.
Embeddings saved!
Total run time = 1277.959 s.