(Translated by https://www.hiragana.jp/)
⚓ T217792 Add wikitech (labswiki) to the sqoop list
Page MenuHomePhabricator

Add wikitech (labswiki) to the sqoop list
Closed, ResolvedPublic

Description

We can't currently do that as labswiki has been a 'different' wiki since a long time with its own database system, and is now trying to get back with others (see T167973 as hard dependency and T171570 as soft one).

Event Timeline

Future us: this parent/child graph is backwards, the blocking task of moving wikitech to a normal DB cluster is not done.

@Milimetric @JAllemandou Sorry for the driveby comment, can this task be closed?

Oh! Thanks for the reminder, this is now available but not included in the sqoop lists. I'll make a patch, easy enough. labswiki seems to be available in both the analytics replicas and cloud replicas (as labswiki_p in the latter)

Change #1058175 had a related patch set uploaded (by Milimetric; author: Milimetric):

[analytics/refinery@master] Add labswiki (wikitech) to the sqoop list

https://gerrit.wikimedia.org/r/1058175

Milimetric added a subscriber: VirginiaPoundstone.

@VirginiaPoundstone adding this to our sprint because it's basically a no-op and an easy resolution to an old task.

Change #1058175 merged by Milimetric:

[analytics/refinery@master] Add labswiki (wikitech) to the sqoop list

https://gerrit.wikimedia.org/r/1058175

Change #1075238 had a related patch set uploaded (by Joal; author: Joal):

[operations/puppet@production] Remove labswiki from HDFS imported dumps

https://gerrit.wikimedia.org/r/1075238

Change #1075238 merged by Ottomata:

[operations/puppet@production] Remove labswiki from HDFS imported dumps

https://gerrit.wikimedia.org/r/1075238

Now that labswiki is a normal database, on the s6 section, are we able to start dumping it, as per all of the other databases?
It looks like it has been excluded from dumps here: https://github.com/wikimedia/operations-puppet/blob/production/modules/snapshot/manifests/dumps/dblists.pp#L18

If we did that, then we wouldn't have to exclude it from the list of dumps imported to HDFS here: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1075238