Skip to content

Improve CUTEst benchmarks #1283

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 15 commits into
base: cutest
Choose a base branch
from
+711 −83
Open

Improve CUTEst benchmarks #1283

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
464694b
omjulia
arnavk23 Jun 29, 2025
1c5e355
Update Manifest.toml
arnavk23 Jun 30, 2025
865b25b
manifest
arnavk23 Jul 3, 2025
5dff3e9
formatted using JuliaFormatter
arnavk23 Jul 5, 2025
1ca3b09
removing deprecated CUTEst.select
arnavk23 Jul 7, 2025
de171d3
Update Project.toml
arnavk23 Jul 7, 2025
f120007
safe_solvers
arnavk23 Jul 12, 2025
2a12062
Update update.jl
arnavk23 Jul 14, 2025
4ab2f11
Update make.jl
arnavk23 Jul 14, 2025
28a035d
Update pages.jl
arnavk23 Jul 14, 2025
0056c1b
Update SciMLBenchmarks.jl
arnavk23 Jul 14, 2025
5002f1c
Improve CUTEst benchmarks with chunked processing and robust error ha…
arnavk23 Jul 14, 2025
923e3a1
Make CUTEst benchmarks extremely conservative to prevent OOM
arnavk23 Jul 14, 2025
544f5a2
Fix CUTEst benchmark filtering and timeout issues
arnavk23 Jul 14, 2025
c02c978
changes
arnavk23 Jul 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions benchmarks/OptimizationCUTEst/Manifest.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1652,6 +1652,12 @@ git-tree-sha1 = "887579a3eb005446d514ab7aeac5d1d027658b8f"
uuid = "e7412a2a-1a6e-54c0-be00-318e2571c051"
version = "1.3.5+1"

[[deps.OMJulia]]
deps = ["DataFrames", "DataStructures", "LightXML", "Random", "ZMQ"]
git-tree-sha1 = "5f2b4eb7fed3c1ac9108c72996bd1ac47d1ac940"
uuid = "0f4fe800-344e-11e9-2949-fb537ad918e1"
version = "0.3.2"

[[deps.OpenBLAS32_jll]]
deps = ["Artifacts", "CompilerSupportLibraries_jll", "JLLWrappers", "Libdl"]
git-tree-sha1 = "6065c4cff8fee6c6770b277af45d5082baacdba1"
Expand Down
1 change: 1 addition & 0 deletions benchmarks/OptimizationCUTEst/Project.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ CUTEst = "1b53aba6-35b6-5f92-a507-53c67d53f819"
DataFrames = "a93c6f00-e57d-5684-b7b6-d8193f3e46c0"
Ipopt = "b6b21f68-93f8-5de0-b562-5493be1d77c9"
NLPModels = "a4795742-8479-5a88-8948-cc11e1c8c1a6"
OMJulia = "0f4fe800-344e-11e9-2949-fb537ad918e1"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is openmodelica here?

Copy link
Author

@arnavk23 arnavk23 Jul 3, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as the error on Vaibhav's pr is the error on (IJulia, SciMLBenchmark, OMJulia, Plot) and OMJulia is not there.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the wrong benchmark set

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay. So what do you think of the error on Vaibhav's pr.

ERROR: LoadError: Failed to precompile SciMLBenchmarks [31c91b34-3c75-11e9-0341-95557aab0344] to "/cache/julia-buildkite-plugin/depots/5b300254-1738-4989-ae0a-f4d2d937f953/compiled/v1.9/SciMLBenchmarks/jl_Xe9X2k".

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

show the error?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this : commit

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That commit doesn't add openmodelica at all.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That has what I have been saying chris but the error points out to openmodelica.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the latest error https://buildkite.com/julialang/scimlbenchmarks-dot-jl/builds/3412#0197d4d8-ee5a-4269-ab8f-1fae086e1c49 and it does not point to openmodelica. Nor is openmodelica installed at all. Nor should it be: these benchmarks are not of DAEs, there is no modelica here.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, will look into it and try again.

Optimization = "7f7a1694-90dd-40f0-9382-eb1efda571ba"
OptimizationMOI = "fd9f6733-72f4-499f-8506-86b2bdd0dea1"
OptimizationNLPModels = "064b21be-54cf-11ef-1646-cdfee32b588f"
Expand Down