Skip to content

Commit ce3c323

Browse files
patk-motionalpatk-motional
authored
Merge pull request #274 from motional/nuplan-devkit-v1.2-release
Nuplan devkit v1.2 release
2 parents 630f9d3 + 3966f55 commit ce3c323

File tree

355 files changed

+15012
-2742
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

355 files changed

+15012
-2742
lines changed

‎Dockerfile

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -48,20 +48,20 @@ ENV NUPLAN_MAPS_ROOT=/data/sets/nuplan/maps \
4848

4949
RUN bash -c 'mkdir -p {$NUPLAN_MAPS_ROOT,$NUPLAN_DATA_ROOT,$NUPLAN_EXP_ROOT}'
5050

51-
ARG NUPLAN_DATA_ROOT_S3_URL
52-
ARG NUPLAN_MAPS_ROOT_S3_URL
51+
ARG NUPLAN_CHALLENGE_DATA_ROOT_S3_URL
52+
ARG NUPLAN_CHALLENGE_MAPS_ROOT_S3_URL
5353
ARG NUPLAN_SERVER_S3_ROOT_URL
5454
ARG S3_TOKEN_DIR
5555
ARG NUPLAN_DATA_STORE
5656

5757
ENV NUPLAN_DATA_ROOT $NUPLAN_DATA_ROOT
5858
ENV NUPLAN_MAPS_ROOT $NUPLAN_MAPS_ROOT
59-
ENV NUPLAN_DB_FILES /data/sets/nuplan/nuplan-v1.1/mini
59+
ENV NUPLAN_DB_FILES /data/sets/nuplan/nuplan-v1.1/splits/mini
6060
ENV NUPLAN_MAP_VERSION "nuplan-maps-v1.0"
6161
ENV NUPLAN_DATA_STORE $NUPLAN_DATA_STORE
6262
ENV NUPLAN_S3_PROFILE "default"
63-
ENV NUPLAN_DATA_ROOT_S3_URL $NUPLAN_DATA_ROOT_S3_URL
64-
ENV NUPLAN_MAPS_ROOT_S3_URL $NUPLAN_MAPS_ROOT_S3_URL
63+
ENV NUPLAN_DATA_ROOT_S3_URL $NUPLAN_CHALLENGE_DATA_ROOT_S3_URL
64+
ENV NUPLAN_MAPS_ROOT_S3_URL $NUPLAN_CHALLENGE_MAPS_ROOT_S3_URL
6565
ENV NUPLAN_SERVER_S3_ROOT_URL $NUPLAN_SERVER_S3_ROOT_URL
6666
ENV S3_TOKEN_DIR $S3_TOKEN_DIR
6767

‎Jenkinsfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ pipeline{
4949
BAZEL_OPTS = "--local_cpu_resources=8 --jobs=8 --remote_cache=http://bazel-cache.ci.motional.com:80 --remote_upload_local_results=true"
5050

5151
NUPLAN_DATA_ROOT = "/data/sets/nuplan"
52-
NUPLAN_DB_FILES = "/data/sets/nuplan/nuplan-v1.1/mini"
52+
NUPLAN_DB_FILES = "/data/sets/nuplan/nuplan-v1.1/splits/mini"
5353
NUPLAN_MAPS_ROOT = "/data/sets/nuplan/maps"
5454
NUPLAN_MAP_VERSION = "nuplan-maps-v1.0"
5555
NUPLAN_EXP_ROOT = "/tmp/exp/nuplan"

‎docs/README.md

Lines changed: 13 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -29,15 +29,24 @@ ______________________________________________________________________
2929

3030
</div>
3131

32+
______________________________________________________________________
33+
## Sensor Data Release
34+
#### IMPORTANT: The file structure has changed! Please check [Dataset Setup](https://github.com/motional/nuplan-devkit/blob/master/docs/dataset_setup.md) page for the updated file structure.
35+
- The nuPlan sensor data for the v1.1 dataset has been released. Please download the latest dataset from the nuPlan [page](https://www.nuscenes.org/nuplan#download).
36+
- Due to the size of the sensor data, it will be released gradually. This first set of sensor data are the blobs corresponding to nuPlan mini.
37+
- A short tutorial for the sensor data is provided `nuplan_sensor_data_tutorial.ipynb` to get you started.
3238
______________________________________________________________________
3339
## Planning challenges
34-
#### The nuPlan Planning Competition is live!
35-
#### The challenge will be presented as part of the [New Advances On Autonomous Driving](https://opendrivelab.com/event/cvpr23_ADworkshop) workshop at CVPR 2023
36-
#### The nuPlan Dataset v1.1 has been released. Please download the latest dataset from the nuPlan [page](https://www.nuscenes.org/nuplan#download).
40+
#### IMPORTANT: The Planning Challenge will be using devkit version 1.2 from now on. Submissions generated from version v1.1 should remain compatible. However, please double-check by submitting to the warm-up phase.
41+
- The nuPlan Planning Competition is live!
42+
- The challenge will be presented as part of the [New Advances On Autonomous Driving](https://opendrivelab.com/event/cvpr23_ADworkshop) workshop at CVPR 2023
43+
- The nuPlan Dataset v1.1 has been released. Please download the latest dataset from the nuPlan [page](https://www.nuscenes.org/nuplan#download).
3744
______________________________________________________________________
3845

3946
## Changelog
40-
- February 15th 2023
47+
- April 25th 2023
48+
* v1.2 Devkit: The nuPlan sensor data have been released! Improved feature caching and nuBoard dashboard functionality. Changed dataset file structure, data interfaces now allow retrieval of sensor data. Pinned several packages including hydra, numpy and sqlalchemy.
49+
- January 20th 2023
4150
* v1.1 Devkit: The official nuPlan Challenge Release. Optimized training caching, simulation improvements, shapely 2.0 update.
4251
- Oct 13th 2022
4352
* v1.1 Dataset: Full nuPlan dataset - improved route plan, traffic light status, mission goal and more!

‎nuplan/common/utils/testing/__init__.py renamed to ‎docs/__init__.py

File renamed without changes.

‎docs/baselines.md

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,4 +27,18 @@ go based on the distance between itself and a given agent. Of course, it is wise
2727

2828
Hence, the IDMPlanner uses breadth-first search to find the path towards the mission goal, and the IDM policy describes how far along that path the planner should be.
2929

30-
Link to the [code](https://github.com/motional/nuplan-devkit/blob/master/nuplan/planning/simulation/planner/idm_planner.py)
30+
Link to the [code](https://github.com/motional/nuplan-devkit/blob/master/nuplan/planning/simulation/planner/idm_planner.py)
31+
32+
## UrbanDriverOpenLoopModel (MLPlanner)
33+
The UrbanDriverOpenLoopModel functions as an example trained machine learning planner using the `MLPlanner` interface.
34+
The implementation is an open-loop version of L5Kit's [implementation](https://github.com/woven-planet/l5kit/blob/master/l5kit/l5kit/planning/vectorized/open_loop_model.py)
35+
of ["Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradients"](https://woven-planet.github.io/l5kit/urban_driver.html)
36+
adapted to the nuPlan framework.
37+
38+
The model processes vectorized agent and map inputs into local feature descriptors that
39+
are passed to a global attention mechanism for yielding a predicted ego trajectory. The model is trained using imitation
40+
learning to match expert trajectories available in the nuPlan dataset. Some amount of data augmentation is performed on
41+
the agents and expert trajectory provided during training to mitigate data distribution drift encountered during
42+
closed-loop simulation.
43+
44+
Link to the [code](https://github.com/motional/nuplan-devkit/blob/master/nuplan/planning/training/modeling/models/urban_driver_open_loop_model.py)

‎docs/competition.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -12,10 +12,10 @@ The main focus of the nuPlan planning challenge is to evaluate a motion planning
1212
### Competition Timeline
1313

1414
* January 30th, 2023 - Warm-up phase and Test phase opens for submission
15-
* May 18th, 2023 - Competition closes
16-
* May 19th, 2023 - Finalists are announced and invited to share their code with us for verification
15+
* May 19th, 2023 - Competition closes
16+
* May 26th, 2023 - Finalists are announced and invited to share their code with us for verification
1717
* June 2th, 2023 - Winners are announced
18-
* June 18th, 2023 - The competition results are presented at the [New Advances On Autonomous Driving](https://opendrivelab.com/event/cvpr23_ADworkshop) workshop at CVPR 2023
18+
* June 18th, 2023 - The competition results are presented at the [End-to-End Autonomous Driving](https://opendrivelab.com/event/cvpr23_ADworkshop) workshop at CVPR 2023
1919

2020

2121
### How to enter
@@ -76,7 +76,7 @@ and the data is not taken from the test split. The metrics and the overall score
7676

7777
Start: January 30th, 2023
7878

79-
End: May 18th, 2023
79+
End: May 19th, 2023
8080

8181
#### Test Phase
8282
The results from the test phase will be used to determine the winners of each challenge. All submissions will be evaluated on a
@@ -87,7 +87,7 @@ submit a maximum of three submissions.
8787

8888
Start: January 30th, 2023
8989

90-
End: May 18th, 2023
90+
End: May 19th, 2023
9191

9292
### Challenges
9393

‎docs/dataset_setup.md

Lines changed: 34 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -33,16 +33,40 @@ The final hierarchy should look as follows (depending on the splits downloaded a
3333
│   └── 9.17.1937
3434
│   └── map.gpkg
3535
└── nuplan-v1.1
36-
   ├── mini
37-
   │ ├── 2021.05.12.22.00.38_veh-35_01008_01518.db
38-
   │ ├── 2021.06.09.17.23.18_veh-38_00773_01140.db
39-
   │ ├── ...
40-
   │ └── 2021.10.11.08.31.07_veh-50_01750_01948.db
41-
   └── trainval
42-
   ├── 2021.05.12.22.00.38_veh-35_01008_01518.db
43-
   ├── 2021.06.09.17.23.18_veh-38_00773_01140.db
44-
   ├── ...
45-
   └── 2021.10.11.08.31.07_veh-50_01750_01948.db
36+
   ├── splits
37+
   │ ├── mini
38+
   │ │ ├── 2021.05.12.22.00.38_veh-35_01008_01518.db
39+
   │ │ ├── 2021.06.09.17.23.18_veh-38_00773_01140.db
40+
   │ │ ├── ...
41+
   │ │ └── 2021.10.11.08.31.07_veh-50_01750_01948.db
42+
   │ └── trainval
43+
   │ ├── 2021.05.12.22.00.38_veh-35_01008_01518.db
44+
   │ ├── 2021.06.09.17.23.18_veh-38_00773_01140.db
45+
   │ ├── ...
46+
   │ └── 2021.10.11.08.31.07_veh-50_01750_01948.db
47+
   └── sensor_blobs
48+
   ├── 2021.05.12.22.00.38_veh-35_01008_01518
49+
   │ ├── CAM_F0
50+
   │ │ ├── c082c104b7ac5a71.jpg
51+
   │ │ ├── af380db4b4ca5d63.jpg
52+
   │ │ ├── ...
53+
   │ │ └── 2270fccfb44858b3.jpg
54+
   │ ├── CAM_B0
55+
   │ ├── CAM_L0
56+
   │ ├── CAM_L1
57+
   │ ├── CAM_L2
58+
   │ ├── CAM_R0
59+
   │ ├── CAM_R1
60+
   │ ├── CAM_R2
61+
   │ └──MergedPointCloud
62+
   │ ├── 03fafcf2c0865668.pcd
63+
   │ ├── 5aee37ce29665f1b.pcd
64+
   │ ├── ...
65+
   │ └── 5fe65ef6a97f5caf.pcd
66+
   │
67+
   ├── 2021.06.09.17.23.18_veh-38_00773_01140
68+
   ├── ...
69+
   └── 2021.10.11.08.31.07_veh-50_01750_01948
4670
```
4771

4872
If you want to use another folder, you can set the corresponding [environment variable](https://github.com/motional/nuplan-devkit/blob/master/docs/installation.md).

‎nuplan/cli/db_cli.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@
1515
cli = typer.Typer()
1616

1717
NUPLAN_DATA_ROOT = os.getenv('NUPLAN_DATA_ROOT', "/data/sets/nuplan/")
18-
NUPLAN_DB_VERSION = f'{NUPLAN_DATA_ROOT}/nuplan-v1.1/mini/2021.07.16.20.45.29_veh-35_01095_01486.db'
18+
NUPLAN_DB_VERSION = f'{NUPLAN_DATA_ROOT}/nuplan-v1.1/splits/mini/2021.07.16.20.45.29_veh-35_01095_01486.db'
1919

2020

2121
def _ensure_file_downloaded(data_root: str, potentially_remote_path: str) -> str:

‎nuplan/cli/test/__init__.py

Whitespace-only changes.

‎nuplan/common/actor_state/test/BUILD

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ py_library(
1414
"//nuplan/common/actor_state:agent",
1515
"//nuplan/common/actor_state:car_footprint",
1616
"//nuplan/common/actor_state:ego_state",
17+
"//nuplan/common/actor_state:ego_temporal_state",
1718
"//nuplan/common/actor_state:oriented_box",
1819
"//nuplan/common/actor_state:state_representation",
1920
"//nuplan/common/actor_state:tracked_objects_types",

0 commit comments

Comments
 (0)