Stream NOAA GEFS GRIB to parquet

Usage

noaa_gefs(
  date = Sys.Date(),
  cycle = "00",
  threads = 70,
  gdal_ops = "",
  s3 = arrow::s3_bucket("drivers", endpoint_override = "data.ecoforecast.org"),
  max_horizon = 840,
  purge = TRUE,
  quiet = FALSE,
  dest = ".",
  locations = paste0("https://github.com/eco4cast/neon4cast-noaa-download/",
    "raw/master/noaa_download_site_list.csv"),
  name_pattern = "noaa/gefs-v12/stage1/{cycle_int}/{nice_date}/part-0.parquet"
)

Arguments

date: date forecast is issued
cycle: hour forecast is issued (00, 06, 12, 18)
threads: parallel processes to run
gdal_ops: options to GDAL (e.g. compression)
s3: an S3 bucket address, from arrow::s3_bucket
max_horizon: maximum horizon
purge: logical, clear downloaded/converted tif?
quiet: logical, verbose output?
dest: destination directory
locations: where to access a list of download sites (lat/long)
name_pattern: Naming pattern for upload bucket (glue format)

Value

invisibly, the processx log

Examples

if (FALSE) { # interactive()
noaa_gefs()
}