(Translated by https://www.hiragana.jp/)
⚓ T362785 Add host level instrumentation on webrequest
Page MenuHomePhabricator

Add host level instrumentation on webrequest
Closed, ResolvedPublic1 Estimated Story Points

Description

We want to report request volume metrics at host level, to track possible regressions post HAproxy migration.

We should extend the webrequest DQ job to generate these new metrics.

Done
  • update webrequest DQ job to report new quality metrics
  • version dump airflow dag deps to pick up the updated job

Event Timeline

Change #1019867 had a related patch set uploaded (by Gmodena; author: Gmodena):

[analytics/refinery/source@master] refinery-job: add webrequest instrumentation.

https://gerrit.wikimedia.org/r/1019867

gmodena set the point value for this task to 1.Apr 18 2024, 1:46 PM

Change #1019867 merged by jenkins-bot:

[analytics/refinery/source@master] refinery-job: add webrequest instrumentation.

https://gerrit.wikimedia.org/r/1019867

DQ job and airflow dag have been updated. Deployment requires a new release of refinery-source and a dag deployment on analytics.

Milimetric subscribed.

I deployed this and started the job, checking in now to make sure it runs.