Update usage scheduler according to FF

[mustard-mh]

Description

Add FF usage_update_scheduler_duration to control repeat duration of usage data update

• Default is 15m, see ops
• Feature Flag [non-production]

Related Issue(s)

Fixes EXP-1768

How to test

• Create workspace, stop workspace
• Usage page should show workspace was stopped after you stop it after 1 minute (based on FF setting)
• Update FF should affect scheduler, after 4 minutes (max: proxy polling 3m + usage polling 1m). You can check usage logs via kubectl logs -f usage-<tab tab> -c usage | code -

You could try run script below in DevTool > Terminal to fetch usage data automatically. Don't forget to update your organization ID in data

const data = {"jsonrpc":"2.0","id":2,"method":"listUsage","params":{"attributionId":"team:d1d0637b-d605-443a-81ef-4631ea08fd92","from":1711900800000,"to":1724060799999,"order":0,"pagination":{"perPage":50,"page":1}}}
const listUsage = () => window._gp.gitpodService.server.listUsage(data.params).then(d => console.log(d))
listUsage()
setInterval(listUsage, 60 * 1000)

Unit tests

Unit tests should pass, see server_test.go, there's a command to exec tests. But tests is flaky because of timing, jobs may exec during each ticker we grab the value. We only need to make sure it can pass one time.

✅ Dashboard test result for 2m

Documentation

Preview status

Gitpod was successfully deployed to your preview environment.

• 🏷️ Name - hw-exp-1768
• 🔗 URL - hw-exp-1768.preview.gitpod-dev.com/workspaces.
• 📚 Documentation - See our internal documentation for information on how to interact with your preview environment.
• 📦 Version - hw-EXP-1768-gha.24563
• 🗒️ Logs - GCP Logs Explorer

Build Options

Build

• /werft with-werft
  Run the build with werft instead of GHA
• leeway-no-cache
• /werft no-test
  Run Leeway with --dont-test

Publish

• /werft publish-to-npm
• /werft publish-to-jb-marketplace

Installer

• analytics=segment
• with-dedicated-emulation
• workspace-feature-flags
  Add desired feature flags to the end of the line above, space separated

Preview Environment / Integration Tests

• /werft with-local-preview
  If enabled this will build install/preview
• /werft with-preview
• /werft with-large-vm
• /werft with-gce-vm
  If enabled this will create the environment on GCE infra
• /werft preemptible
  Saves cost. Untick this only if you're really sure you need a non-preemtible machine.
• with-integration-tests=all
  Valid options are all, workspace, webapp, ide, jetbrains, vscode, ssh. If enabled, with-preview and with-large-vm will be enabled.
• with-monitoring

/hold

[laushinka]

I think we want to keep it to 15 minutes for cloud, but 1 minute for Dedicated. Correct me if I'm wrong @svenefftinge

[mustard-mh]

The reason data is not updated every 15 minutes is because we have dashboard caches, not sure if we do want to remove caches, 1m should be fine for users

[mustard-mh]

We have to stop scheduler and restart again to update cron. Upstream PR robfig/cron#274 to add update method is there opened for 4 years already 🙈.

[mustard-mh]

Thank you @svenefftinge , will double check on dogfood