Skip to content

Commit cda16e2

Browse files
committed
fix: update Gemini configuration parameters and test report
- Adjusted temperature and top_p values for various models in the Gemini configuration to enhance performance and output quality. - Updated the pentester model to use `gemini-2.5-flash`, reflecting changes in pricing and capabilities. - Revised the test report to include updated success rates and average latencies, ensuring accurate performance metrics for all agents. - Enhanced overall test results with improved latency measurements across multiple test cases.
1 parent 5cdd01b commit cda16e2

File tree

2 files changed

+334
-338
lines changed

2 files changed

+334
-338
lines changed

backend/pkg/providers/gemini/config.yml

Lines changed: 19 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
simple:
22
model: gemini-2.0-flash-lite
3-
temperature: 0.5
4-
top_p: 0.8
3+
temperature: 0.7
4+
top_p: 0.95
55
n: 1
66
max_tokens: 4000
77
price:
@@ -10,8 +10,8 @@ simple:
1010

1111
simple_json:
1212
model: gemini-2.0-flash-lite
13-
temperature: 0.5
14-
top_p: 0.8
13+
temperature: 0.7
14+
top_p: 0.95
1515
n: 1
1616
max_tokens: 3000
1717
json: true
@@ -41,8 +41,8 @@ assistant:
4141

4242
generator:
4343
model: gemini-2.5-pro
44-
temperature: 0.6
45-
top_p: 0.6
44+
temperature: 0.8
45+
top_p: 0.95
4646
n: 1
4747
max_tokens: 12000
4848
reasoning:
@@ -53,8 +53,6 @@ generator:
5353

5454
refiner:
5555
model: gemini-2.5-flash
56-
temperature: 0.7
57-
top_p: 0.8
5856
n: 1
5957
max_tokens: 8000
6058
reasoning:
@@ -75,8 +73,8 @@ adviser:
7573

7674
reflector:
7775
model: gemini-2.0-flash
78-
temperature: 0.8
79-
top_p: 0.8
76+
temperature: 0.6
77+
top_p: 0.95
8078
n: 1
8179
max_tokens: 4000
8280
price:
@@ -85,8 +83,8 @@ reflector:
8583

8684
searcher:
8785
model: gemini-2.0-flash
88-
temperature: 0.7
89-
top_p: 0.8
86+
temperature: 0.6
87+
top_p: 0.95
9088
n: 1
9189
max_tokens: 5000
9290
price:
@@ -95,8 +93,8 @@ searcher:
9593

9694
enricher:
9795
model: gemini-2.0-flash
98-
temperature: 0.7
99-
top_p: 0.8
96+
temperature: 0.6
97+
top_p: 0.95
10098
n: 1
10199
max_tokens: 5000
102100
price:
@@ -105,8 +103,8 @@ enricher:
105103

106104
coder:
107105
model: gemini-2.5-pro
108-
temperature: 0.2
109-
top_p: 0.1
106+
temperature: 0.8
107+
top_p: 0.95
110108
n: 1
111109
max_tokens: 8000
112110
reasoning:
@@ -117,8 +115,6 @@ coder:
117115

118116
installer:
119117
model: gemini-2.5-flash-lite
120-
temperature: 0.4
121-
top_p: 0.5
122118
n: 1
123119
max_tokens: 6000
124120
reasoning:
@@ -128,13 +124,13 @@ installer:
128124
output: 0.4
129125

130126
pentester:
131-
model: gemini-2.5-flash-lite
132-
temperature: 0.6
133-
top_p: 0.7
127+
model: gemini-2.5-flash
128+
temperature: 0.8
129+
top_p: 0.95
134130
n: 1
135131
max_tokens: 6000
136132
reasoning:
137133
effort: medium
138134
price:
139-
input: 0.1
140-
output: 0.4
135+
input: 0.3
136+
output: 2.5

0 commit comments

Comments
 (0)