Code

Workflow: CSV to parquet#841

Code

Merged

hendrikmakait merged 35 commits intomaincoiled/benchmarks:mainfrom

738-continued-csv-to-parquetcoiled/benchmarks:738-continued-csv-to-parquetCopy head branch name to clipboard

May 23, 2023

Commits

Commits on Mar 21, 2023

• Add matplotlib arxiv workflow

  jrbourbeau

  committed
  3a76080

  Copy full SHA for 3a76080

• Remove stray print

  jrbourbeau

  committed
  5aedaca

  Copy full SHA for 5aedaca

• Merge branch 'main' of https://github.com/coiled/coiled-runtime into embarrassing-parallel

  jrbourbeau

  committed
  e185e5d

  Copy full SHA for e185e5d

• Update fixture name

  jrbourbeau

  committed
  95585d4

  Copy full SHA for 95585d4

• Only use requester_pays for test_embarassingly_parallel

  jrbourbeau

  committed
  10a529b

  Copy full SHA for 10a529b

Commits on Mar 22, 2023

• Rerun CI

  jrbourbeau

  committed
  4504020

  Copy full SHA for 4504020

Commits on Mar 23, 2023

• Update instance type

  jrbourbeau

  committed
  96e66f5

  Copy full SHA for 96e66f5

• Run workflows on demand and during nightly cron job

  jrbourbeau

  committed
  0779b48

  Copy full SHA for 0779b48

Commits on Mar 27, 2023

• Use specific range of years

  jrbourbeau

  committed
  7fb6792

  Copy full SHA for 7fb6792

• Merge branch 'main' of https://github.com/coiled/coiled-runtime into embarrassing-parallel

  jrbourbeau

  committed
  437eb0b

  Copy full SHA for 437eb0b

• Light asserts

  jrbourbeau

  committed
  e4851df

  Copy full SHA for e4851df

Commits on Mar 28, 2023

• add workflow

  douglasdavis

  committed
  2657885

  Copy full SHA for 2657885

• show something with use of pytest -s

  douglasdavis

  committed
  6eb04d6

  Copy full SHA for 6eb04d6

• Merge remote-tracking branch 'origin/main' into add-workflow-from-csv-to-parquet2

  douglasdavis

  committed
  6f4c04e

  Copy full SHA for 6f4c04e

• rm unnecessary noqa comments

  douglasdavis

  committed
  222c695

  Copy full SHA for 222c695

• var name

  douglasdavis

  committed
  fc40687

  Copy full SHA for fc40687

• adjust tests.yml based on James' suggestion

  douglasdavis

  committed
  670e3cc

  Copy full SHA for 670e3cc

Commits on Mar 29, 2023

• write some parquet to s3

  douglasdavis

  committed
  16b0277

  Copy full SHA for 16b0277

Commits on Apr 6, 2023

• this version actually passes

  douglasdavis

  committed
  b557bc5

  Copy full SHA for b557bc5

• check if read works

  douglasdavis

  committed
  ccedaf8

  Copy full SHA for ccedaf8

Commits on Apr 11, 2023

• works with some excluded files

  douglasdavis

  committed
  37120c3

  Copy full SHA for 37120c3

• rm unnecessary line

  douglasdavis

  committed
  b3cfbaa

  Copy full SHA for b3cfbaa

Commits on May 10, 2023

• Resolve merge conflict

  milesgranger

  committed
  ca7df93

  Copy full SHA for ca7df93

• Refactoring [skip ci]

  milesgranger

  committed
  cdca5de

  Copy full SHA for cdca5de

• Just use hardcoded bad files

  milesgranger

  committed
  6a93130

  Copy full SHA for 6a93130

• Use dtype and converters to avoid hard-coded bad_files

  milesgranger

  committed
  e2b070e

  Copy full SHA for e2b070e

• Reset tests.yml to main

  milesgranger

  committed
  5b58925

  Copy full SHA for 5b58925

Commits on May 11, 2023

• Use default instance types

  milesgranger

  committed
  a753aea

  Copy full SHA for a753aea

• Update cluster_kwargs.yaml

  Show description for 6e9fc7f
  

  milesgranger

  and

  ncclementi

  authored
  6e9fc7f

  Copy full SHA for 6e9fc7f

• Set pyarrow string conversion

  milesgranger

  committed
  db73e85

  Copy full SHA for db73e85

Commits on May 15, 2023

• Reduce worker count

  milesgranger

  committed
  ed1d9e3

  Copy full SHA for ed1d9e3

• Try only fixing floats

  milesgranger

  committed
  e3145c6

  Copy full SHA for e3145c6

Commits on May 16, 2023

• Remove config dataframe.convert-string

  Show description for 19606da
  milesgranger

  committed
  19606da

  Copy full SHA for 19606da

Commits on May 17, 2023

• Adjust for fjetter's feedback

  milesgranger

  committed
  e701cc1

  Copy full SHA for e701cc1

Commits on May 22, 2023

• Use float64 instead of Float64

  milesgranger

  committed
  530d35c

  Copy full SHA for 530d35c