Skip to content

Commit

Permalink
Offset dailyDelay to 04:10 to allow GCS transfers to complete (#216)
Browse files Browse the repository at this point in the history
  • Loading branch information
stephen-soltesz committed Dec 13, 2019
1 parent 4a1e5b5 commit 36886ce
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion reproc/dispatch.go
Original file line number Diff line number Diff line change
Expand Up @@ -271,7 +271,10 @@ queueLoop:
return maxDate, nil
}

var dailyDelay = 3 * time.Hour
// dailyDelay is set to 4 hours and 10 minutes to allow time for the maximum
// possible pusher delay for the previous day, plus several GCS transfer jobs to
// complete. At 04:10 UTC, the daily parsing should be possible.
var dailyDelay = 4*time.Hour + 10*time.Minute

// findNextRecentDay finds an appropriate date to start daily processing.
func findNextRecentDay(start time.Time, skip int) time.Time {
Expand Down

0 comments on commit 36886ce

Please sign in to comment.