Issue after DataCite 99 millions records added?

[yhan818]

I had no issue to run the code until today. I have tried a few times, and all failed. The most recent change is OpenAlex added 99 millions DataCite records on Nov 1.

works_published_2023 <-oa_fetch(
entity="works",

institutions.ror=c("03m2x1q45"), # UArizona
#institutions.ror=c("00cvxb145"), # University of Washington

from_publication_date ="2023-01-01",
to_publication_date = "2023-12-31",
)

Error message:
Error in tibble::as_tibble():
! Column name id must not be duplicated.
Use .name_repair to specify repair.
Caused by error in repaired_names():
! Names must be unique.
✖ These names are duplicated:

• "id" at locations 1 and 23.
  Run rlang::last_trace() to see where the error occurred.

[trangdata]

Hi @yhan818, we fixed this in the latest release of openalexR. Could you re-install the latest version please?

# install.packages("openalexR")
library(openalexR)
packageVersion("openalexR")
#> [1] '2.0.2'

works_published_2023 <- oa_fetch(
  entity = "works",
  institutions.ror = c("03m2x1q45"), # UArizona
  from_publication_date = "2023-12-01",
  to_publication_date = "2023-12-02",
  verbose = TRUE
)
#> Requesting url: https://api.openalex.org/works?filter=institutions.ror%3A03m2x1q45%2Cfrom_publication_date%3A2023-12-01%2Cto_publication_date%3A2023-12-02
#> Getting 1 page of results with a total of 156 records...

^{Created on 2025-11-07 with reprex v2.1.1}

[yhan818]

If I would like to get data version 2 (walden), in web interface, you select "xpac" to turn it on for "Data Version 2". Using openAlexR, will you do this? (The number does not seem right)

works_count <-oa_fetch(
entity="works",
institutions.ror=c("03m2x1q45"), # UArizona

#institutions.ror=c("03efmqc40"), # ASU
#institutions.ror=c("05x2bcf33"), # Carnegie Mellon University (CMU)
#institutions.ror=c("05hs6h993"), # Michigan State University (MSU)
#institutions.ror=c("00cvxb145"), # University of Washington

options = list("data-version" = 2),

from_publication_date ="2024-01-01",
to_publication_date = "2024-12-31",
count_only = TRUE
)

[trangdata]

Hi @yhan818, my understanding is that "xpac" includes only the "additional" entries compared to version 1. If you're doing this filter interactively on the web interface, you won't see the entries that are already in version 1.

Right now, because Walden is the default, you don't need options = list("data-version" = 2),. Nonetheless, your code should work for what you need.

library(openalexR)
oa_fetch(
  entity = "works",
  institutions.ror = "03m2x1q45", # UArizona
  # options = list("data-version" = 2),
  from_publication_date = "2024-01-01",
  to_publication_date = "2024-12-31",
  count_only = TRUE
)
#> $count
#> [1] 7937
#> 
#> $db_response_time_ms
#> [1] 16
#> 
#> $page
#> [1] 1
#> 
#> $per_page
#> [1] 1
#> 
#> $groups_count
#> NULL

^{Created on 2025-11-17 with reprex v2.1.1}