Code

DRAFT failed inserts recovery#139

Code

Draft

lukeindykiewicz wants to merge 28 commits intomastersnowplow-incubator/snowplow-bigquery-loader:masterfrom feature/failed-inserts-recoverysnowplow-incubator/snowplow-bigquery-loader:feature/failed-inserts-recoveryCopy head branch name to clipboard

+627-157

Commits

Commits on Nov 5, 2020

• Create the stub for readign from GCS and writing to pub/sub

  lukeindykiewicz

  committed
  8c16d84

  Copy full SHA for 8c16d84

Commits on Nov 12, 2020

• Add recovery steps

  lukeindykiewicz

  committed
  6ddd52e

  Copy full SHA for 6ddd52e

Commits on Nov 13, 2020

• Parse json and filter bucket

  lukeindykiewicz

  committed
  910fc78

  Copy full SHA for 910fc78

• Use values from config

  lukeindykiewicz

  committed
  717e053

  Copy full SHA for 717e053

Commits on Nov 14, 2020

• Bump to 0.6.2-rc1

  lukeindykiewicz

  committed
  8f8f613

  Copy full SHA for 8f8f613

Commits on Nov 16, 2020

• Add more logging

  lukeindykiewicz

  committed
  9d29238

  Copy full SHA for 9d29238

• Bump to 0.6.2-rc2

  lukeindykiewicz

  committed
  67ad2fb

  Copy full SHA for 67ad2fb

• Fix gcs path

  lukeindykiewicz

  committed
  d1cc980

  Copy full SHA for d1cc980

• Bump to 0.6.2-rc3

  lukeindykiewicz

  committed
  02a67af

  Copy full SHA for 02a67af

• Fix pubsub producer config

  lukeindykiewicz

  committed
  d93a54e

  Copy full SHA for d93a54e

• Bump to 0.6.2-rc4

  lukeindykiewicz

  committed
  6ef950a

  Copy full SHA for 6ef950a

• Add more logging

  lukeindykiewicz

  committed
  c954749

  Copy full SHA for c954749

• Bump to 0.6.2-rc5

  lukeindykiewicz

  committed
  a34d24f

  Copy full SHA for a34d24f

Commits on Nov 17, 2020

• Modify event version + use full column name

  lukeindykiewicz

  committed
  05ef0fb

  Copy full SHA for 05ef0fb

• Bump to 0.6.2-rc6

  lukeindykiewicz

  committed
  0eb652a

  Copy full SHA for 0eb652a

Commits on Nov 18, 2020

• Fix column name

  chuwy

  committed
  7af2dad

  Copy full SHA for 7af2dad

• Bump to 0.6.2-rc7

  chuwy

  committed
  230655c

  Copy full SHA for 230655c

• Bring event_version fix back

  chuwy

  committed
  e63f94b

  Copy full SHA for e63f94b

• [WIP] Common: migrate from Travis to GH actions (close #142)

  chuwy

  committed
  644b130

  Copy full SHA for 644b130

• [DELETEME] Keep only repeater publishing

  chuwy

  committed
  cca8c58

  Copy full SHA for cca8c58

• Bump to 0.6.2-rc8

  chuwy

  committed
  ae69e45

  Copy full SHA for ae69e45

• Switch to contexts

  chuwy

  committed
  ba50264

  Copy full SHA for ba50264

• Make column names configurable

  chuwy

  committed
  06d570d

  Copy full SHA for 06d570d

• Bump to 0.6.2-rc9

  chuwy

  committed
  a064ce1

  Copy full SHA for a064ce1

• Implement counters and additional sink, fix concatenated file

  chuwy

  committed
  b765359

  Copy full SHA for b765359

• Bump to 0.6.2-rc10

  chuwy

  committed
  a98be19

  Copy full SHA for a98be19

• Fix a file pipe

  chuwy

  committed
  25380d8

  Copy full SHA for 25380d8

• Bump to 0.6.2-rc11

  chuwy

  committed
  5c3a933

  Copy full SHA for 5c3a933