[[ https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Pageviews | Pageviews and other datasets ]] are [[ https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest#Derived_streams | derived ]] from logs of all [[ https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Traffic/Webrequest | webrequests ]] served by WMF.
This has downsides:
- Webrequest logs are huge: filtering these consumes a lot of resources.
- The [[ https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-core/src/main/java/org/wikimedia/analytics/refinery/core/PageviewDefinition.java | definition of a pageview ]] is centralized and pattern based. It is difficult to evolve the definition as new needs arise.
Instead of searching for variously shaped needles in a huge haystack, we should provide standardized instrumentation tooling that allows products to produce a event when they consider a page to be 'viewed'.
=== See also
Please edit this list to keep track of use cases and relevant tasks as they arise
- {T368303}
- {T304362}
- {T113817}
- {T310732}
- {T336361}
- {T346463}
- {T366004}
- {T325544}
- {T184793}
- {T186728}