[00:04:54] (03CR) 10Dzahn: [C: 032] wikiba.se: Fix docroot to /srv/se/wikiba/output [puppet] - 10https://gerrit.wikimedia.org/r/382894 (owner: 10Paladox) [00:07:22] Amir1: http://wikibase.wmflabs.org/ [00:13:20] 10Operations, 10DBA, 10Patch-For-Review, 10Wiki-Setup (Create): Create elections committee private wiki - https://phabricator.wikimedia.org/T174370#3666645 (10jrbs) >>! In T174370#3666568, @Reedy wrote: > Just needs scheduling, patches rebasing and someone to deploy it And, uh. How does one do all of thes... [00:14:00] 10Operations, 10DBA, 10Patch-For-Review, 10Wiki-Setup (Create): Create elections committee private wiki - https://phabricator.wikimedia.org/T174370#3666646 (10Reedy) >>! In T174370#3666645, @jrbs wrote: >>>! In T174370#3666568, @Reedy wrote: >> Just needs scheduling, patches rebasing and someone to deploy... [00:14:40] (03CR) 10Dzahn: "no "m"? Host electcom.m.wikimedia.org not found: 3(NXDOMAIN)" [dns] - 10https://gerrit.wikimedia.org/r/374385 (https://phabricator.wikimedia.org/T174370) (owner: 10Reedy) [00:16:43] (03PS1) 10Dzahn: add mobile domain for electomwikimedia [dns] - 10https://gerrit.wikimedia.org/r/382896 (https://phabricator.wikimedia.org/T174370) [00:18:27] 10Operations, 10DBA, 10Patch-For-Review, 10Wiki-Setup (Create): Create elections committee private wiki - https://phabricator.wikimedia.org/T174370#3559677 (10Dzahn) @jrbs: re: patches rebasing: git review -d ; git rebase -i origin/master; then if it fails "git rebase --continu... [00:19:08] (03PS2) 10Dzahn: add mobile domain for electcom.wikimedia [dns] - 10https://gerrit.wikimedia.org/r/382896 (https://phabricator.wikimedia.org/T174370) [00:19:30] (03CR) 10Dzahn: [C: 032] add mobile domain for electcom.wikimedia [dns] - 10https://gerrit.wikimedia.org/r/382896 (https://phabricator.wikimedia.org/T174370) (owner: 10Dzahn) [00:20:18] 10Operations, 10DBA, 10Patch-For-Review, 10Wiki-Setup (Create): Create elections committee private wiki - https://phabricator.wikimedia.org/T174370#3666654 (10Dzahn) added the mobile domain to DNS: https://electcom.m.wikimedia.org/ [00:25:20] 10Operations, 10LDAP-Access-Requests, 10WMF-NDA-Requests: Request to be added to the ldap/wmde group - https://phabricator.wikimedia.org/T177599#3664202 (10Dzahn) Hi, re: "to be able to contribute to AdvancedSearch" does this mean you want the +2 permissions to be able to merge changes in Gerrit in a wikid... [00:32:10] (03CR) 10Krinkle: [C: 031] Remove $stdlogo entirely [mediawiki-config] - 10https://gerrit.wikimedia.org/r/359037 (owner: 10Reedy) [00:32:53] (03CR) 10Krinkle: [C: 031] "Once this lands, we can also remove it from WikimediaIncubator.class.php." [mediawiki-config] - 10https://gerrit.wikimedia.org/r/359037 (owner: 10Reedy) [00:33:40] 10Operations, 10Traffic, 10Wikidata, 10wikiba.se, and 2 others: [Task] move wikiba.se webhosting to wikimedia misc-cluster - https://phabricator.wikimedia.org/T99531#3666662 (10Dzahn) - added self to project and projectadmin in wikidata-dev - created new instance "wikibase-stretch", replacing "wikibase" in... [00:40:39] 10Operations, 10Traffic, 10Wikidata, 10wikiba.se, and 2 others: [Task] move wikiba.se webhosting to wikimedia misc-cluster - https://phabricator.wikimedia.org/T99531#3666664 (10Dzahn) >>! In T99531#3663637, @Lydia_Pintscher wrote: > Let's stick with ensure => latest. Done "wikidata" LDAP group already... [00:53:46] 10Operations, 10monitoring: Uninstall ganglia from the fleet - https://phabricator.wikimedia.org/T177225#3666679 (10Dzahn) a:03Dzahn [00:54:03] 10Operations, 10monitoring: Uninstall ganglia from the fleet - https://phabricator.wikimedia.org/T177225#3651131 (10Dzahn) p:05Triage>03Normal [01:01:14] (03PS1) 10Dzahn: site: decom ganglia-web host, rm aggregators, rm phab include [puppet] - 10https://gerrit.wikimedia.org/r/382904 (https://phabricator.wikimedia.org/T177225) [01:05:38] (03PS1) 10Dzahn: osm: remove all ganglia support [puppet] - 10https://gerrit.wikimedia.org/r/382905 (https://phabricator.wikimedia.org/T177225) [01:06:02] (03PS2) 10Dzahn: osm: remove all ganglia support [puppet] - 10https://gerrit.wikimedia.org/r/382905 (https://phabricator.wikimedia.org/T177225) [01:10:59] (03PS1) 10Dzahn: postgresql: remove all ganglia support [puppet] - 10https://gerrit.wikimedia.org/r/382906 (https://phabricator.wikimedia.org/T177225) [01:14:08] (03PS1) 10Dzahn: ocg: remove all ganglia support [puppet] - 10https://gerrit.wikimedia.org/r/382907 (https://phabricator.wikimedia.org/T177225) [01:14:55] (03PS3) 10Foks: Initial configuration for electcomwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/374528 (https://phabricator.wikimedia.org/T174370) (owner: 10Urbanecm) [01:19:13] (03PS1) 10Dzahn: apache: remove ganglia monitoring [puppet] - 10https://gerrit.wikimedia.org/r/382909 (https://phabricator.wikimedia.org/T177225) [01:21:45] (03CR) 10Dzahn: [C: 031] contint: apt-get update before installing packages [puppet] - 10https://gerrit.wikimedia.org/r/382429 (owner: 10Hashar) [01:24:23] (03CR) 10Dzahn: "@Hashar i thought we were already on java 8 on the entire fleet now but this looks like jessie would still just install the 7 package." [puppet] - 10https://gerrit.wikimedia.org/r/382188 (https://phabricator.wikimedia.org/T168644) (owner: 10Paladox) [01:25:44] (03CR) 10Dzahn: "oh yea, sorry, in the past it was a long list of all the crons in Hiera that were disabled individually for the non-active DC but meanwhil" [puppet] - 10https://gerrit.wikimedia.org/r/382631 (https://phabricator.wikimedia.org/T176754) (owner: 10EddieGP) [01:26:36] (03PS10) 10Dzahn: contint: move from /mnt to /srv [puppet] - 10https://gerrit.wikimedia.org/r/312523 (https://phabricator.wikimedia.org/T146381) (owner: 10Hashar) [01:27:20] (03CR) 10Dzahn: [C: 031] contint: move from /mnt to /srv [puppet] - 10https://gerrit.wikimedia.org/r/312523 (https://phabricator.wikimedia.org/T146381) (owner: 10Hashar) [01:28:06] (03CR) 10Dzahn: [C: 031] "thanks for the ping, i'll do it right after weekend" [puppet] - 10https://gerrit.wikimedia.org/r/312523 (https://phabricator.wikimedia.org/T146381) (owner: 10Hashar) [01:35:46] (03PS4) 10Foks: Initial configuration for electcomwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/374528 (https://phabricator.wikimedia.org/T174370) (owner: 10Urbanecm) [02:14:36] (03PS1) 10Dzahn: udp2log: remove ganglia monitoring [puppet] - 10https://gerrit.wikimedia.org/r/382913 (https://phabricator.wikimedia.org/T177225) [02:17:04] (03PS1) 10Dzahn: bacula: remove ganglia backup sets [puppet] - 10https://gerrit.wikimedia.org/r/382914 (https://phabricator.wikimedia.org/T177225) [02:22:12] (03PS1) 10Dzahn: hhvm: remove ganglia monitoring [puppet] - 10https://gerrit.wikimedia.org/r/382915 (https://phabricator.wikimedia.org/T177225) [02:28:21] (03PS1) 10Dzahn: exim4/multiple roles: remove Ganglia exim stats [puppet] - 10https://gerrit.wikimedia.org/r/382916 (https://phabricator.wikimedia.org/T177225) [02:31:06] (03PS1) 10Dzahn: openstack: remove ganglia disk stats [puppet] - 10https://gerrit.wikimedia.org/r/382917 (https://phabricator.wikimedia.org/T177225) [02:34:35] (03PS1) 10Dzahn: authdns: remove ganglia support [puppet] - 10https://gerrit.wikimedia.org/r/382918 (https://phabricator.wikimedia.org/T177225) [02:37:27] (03PS1) 10Dzahn: cumin: drop ganglia::web role alias [puppet] - 10https://gerrit.wikimedia.org/r/382920 (https://phabricator.wikimedia.org/T177225) [02:40:12] (03PS1) 10Dzahn: zookeeper: remove jmxtrans for sending data to ganglia [puppet] - 10https://gerrit.wikimedia.org/r/382921 (https://phabricator.wikimedia.org/T177225) [02:44:16] (03PS1) 10Dzahn: memcached: remove ganglia monitoring [puppet] - 10https://gerrit.wikimedia.org/r/382922 (https://phabricator.wikimedia.org/T177225) [02:47:55] (03PS1) 10Dzahn: statsd: remove ganglia backend support [puppet] - 10https://gerrit.wikimedia.org/r/382923 (https://phabricator.wikimedia.org/T177225) [02:50:07] (03PS1) 10Dzahn: standard: decom ganglia plugin everywhere by default [puppet] - 10https://gerrit.wikimedia.org/r/382924 (https://phabricator.wikimedia.org/T177225) [02:52:55] (03PS1) 10Dzahn: standard: actually drop 'has_ganglia' param entirely [puppet] - 10https://gerrit.wikimedia.org/r/382926 (https://phabricator.wikimedia.org/T177225) [02:55:13] (03PS1) 10Dzahn: elasticsearch/logstash: drop ganglia monitoring [puppet] - 10https://gerrit.wikimedia.org/r/382927 (https://phabricator.wikimedia.org/T177225) [02:59:28] (03PS1) 10Dzahn: dnsrecursor: drop ganglia metrics support [puppet] - 10https://gerrit.wikimedia.org/r/382929 (https://phabricator.wikimedia.org/T177225) [03:04:31] 10Operations, 10monitoring, 10Patch-For-Review: Uninstall ganglia from the fleet - https://phabricator.wikimedia.org/T177225#3666747 (10Dzahn) @ottomata Hi, wondering what do you think should happen with `modules/confluent/manifests/kafka/mirror/jmxtrans.pp` and `modules/confluent/manifests/kafka/broker/jmxt... [03:13:19] (03PS1) 10Dzahn: pybal: support RunCommand everywhere, not just appservers? [puppet] - 10https://gerrit.wikimedia.org/r/382930 (https://phabricator.wikimedia.org/T177225) [03:21:27] (03PS1) 10Dzahn: hiera/wmflib: drop ganglia_clusters variable entirely? [puppet] - 10https://gerrit.wikimedia.org/r/382931 (https://phabricator.wikimedia.org/T177225) [03:23:22] (03PS2) 10Dzahn: hiera/wmflib: drop ganglia_clusters variable entirely? [puppet] - 10https://gerrit.wikimedia.org/r/382931 (https://phabricator.wikimedia.org/T177225) [03:28:41] PROBLEM - MariaDB Slave Lag: s1 on dbstore1002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 653.86 seconds [03:30:06] (03PS1) 10Dzahn: ganglia: delete ganglia-web classes and role [puppet] - 10https://gerrit.wikimedia.org/r/382932 (https://phabricator.wikimedia.org/T177225) [03:32:45] (03PS3) 10Dzahn: hiera/wmflib: drop ganglia_clusters variable entirely? [puppet] - 10https://gerrit.wikimedia.org/r/382931 (https://phabricator.wikimedia.org/T177225) [03:36:27] (03PS1) 10Dzahn: ganglia: delete the module [puppet] - 10https://gerrit.wikimedia.org/r/382933 (https://phabricator.wikimedia.org/T177225) [04:13:27] (03Draft2) 10Jayprakash12345: Add autopatrolled user group to sd.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382934 [04:13:55] (03PS3) 10Jayprakash12345: Add autopatrolled user group to sd.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382934 (https://phabricator.wikimedia.org/T177141) [04:20:51] RECOVERY - MariaDB Slave Lag: s1 on dbstore1002 is OK: OK slave_sql_lag Replication lag: 165.51 seconds [06:07:51] PROBLEM - Check Varnish expiry mailbox lag on cp4026 is CRITICAL: CRITICAL: expiry mailbox lag is 2083030 [07:02:08] 10Operations, 10Continuous-Integration-Infrastructure (shipyard), 10User-Joe: Unify production and CI docker image build process - https://phabricator.wikimedia.org/T177276#3666812 (10Legoktm) Some requirements of this build process: * Basic macro support: ** `{{ apt | package1 package2 }}` (in whatever synt... [08:01:32] PROBLEM - Router interfaces on cr1-eqord is CRITICAL: CRITICAL: host 208.80.154.198, interfaces up: 37, down: 1, dormant: 0, excluded: 0, unused: 0 [08:02:01] PROBLEM - Router interfaces on cr1-ulsfo is CRITICAL: CRITICAL: host 198.35.26.192, interfaces up: 66, down: 1, dormant: 0, excluded: 0, unused: 0 [08:22:51] RECOVERY - Router interfaces on cr1-eqord is OK: OK: host 208.80.154.198, interfaces up: 39, down: 0, dormant: 0, excluded: 0, unused: 0 [08:23:21] RECOVERY - Router interfaces on cr1-ulsfo is OK: OK: host 198.35.26.192, interfaces up: 68, down: 0, dormant: 0, excluded: 0, unused: 0 [08:26:22] PROBLEM - Router interfaces on cr1-ulsfo is CRITICAL: CRITICAL: host 198.35.26.192, interfaces up: 66, down: 1, dormant: 0, excluded: 0, unused: 0 [08:26:52] PROBLEM - Router interfaces on cr1-eqord is CRITICAL: CRITICAL: host 208.80.154.198, interfaces up: 37, down: 1, dormant: 0, excluded: 0, unused: 0 [08:30:49] (03CR) 10Zoranzoki21: [C: 031] Add autopatrolled user group to sd.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382934 (https://phabricator.wikimedia.org/T177141) (owner: 10Jayprakash12345) [08:39:01] RECOVERY - Router interfaces on cr1-eqord is OK: OK: host 208.80.154.198, interfaces up: 39, down: 0, dormant: 0, excluded: 0, unused: 0 [08:39:32] RECOVERY - Router interfaces on cr1-ulsfo is OK: OK: host 198.35.26.192, interfaces up: 68, down: 0, dormant: 0, excluded: 0, unused: 0 [08:59:38] Hello [09:11:52] (03CR) 10Volans: site: decom ganglia-web host, rm aggregators, rm phab include (031 comment) [puppet] - 10https://gerrit.wikimedia.org/r/382904 (https://phabricator.wikimedia.org/T177225) (owner: 10Dzahn) [09:16:31] (03CR) 10Volans: [C: 031] "LGTM" [puppet] - 10https://gerrit.wikimedia.org/r/382707 (owner: 10Muehlenhoff) [10:02:17] (03Draft2) 10Jayprakash12345: Enable NewUserMessage for SUL accounts too on dty.wiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382960 [10:02:55] (03PS3) 10Jayprakash12345: Enable NewUserMessage for SUL accounts too on dty.wiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382960 (https://phabricator.wikimedia.org/T177688) [10:11:41] (03Draft2) 10Jayprakash12345: Enable NewUserMessage for SUL accounts too on hi.wikiversity [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382964 [10:12:15] (03PS3) 10Jayprakash12345: Enable NewUserMessage for SUL accounts too on hi.wikiversity [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382964 (https://phabricator.wikimedia.org/T177690) [10:35:10] (03CR) 10Zoranzoki21: [C: 031] Enable NewUserMessage for SUL accounts too on hi.wikiversity [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382964 (https://phabricator.wikimedia.org/T177690) (owner: 10Jayprakash12345) [10:35:55] (03CR) 10Zoranzoki21: [C: 031] Enable NewUserMessage for SUL accounts too on dty.wiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382960 (https://phabricator.wikimedia.org/T177688) (owner: 10Jayprakash12345) [10:36:30] (03Abandoned) 10Paladox: Jenkins: Install java 8 on debian jessie [puppet] - 10https://gerrit.wikimedia.org/r/382188 (https://phabricator.wikimedia.org/T168644) (owner: 10Paladox) [14:40:28] (03PS7) 10Zoranzoki21: Enable Extension:Newsletter on hewiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/381537 (https://phabricator.wikimedia.org/T177151) [15:23:19] (03CR) 10Elukey: [C: 04-1] "I am pretty sure that the comment is old, we need this class to have graphite metrics :)" [puppet] - 10https://gerrit.wikimedia.org/r/382921 (https://phabricator.wikimedia.org/T177225) (owner: 10Dzahn) [16:03:36] 10Operations, 10LDAP-Access-Requests, 10WMF-NDA-Requests: Request to be added to the ldap/wmde group - https://phabricator.wikimedia.org/T177599#3667155 (10Aklapper) @Pablo-WMDE: You should be able to access L2 now [17:44:07] (03Draft2) 10Jayprakash12345: Enable mapframe on eswiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382988 [17:44:45] (03PS3) 10Jayprakash12345: Enable mapframe on eswiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382988 (https://phabricator.wikimedia.org/T177695) [19:01:35] (03CR) 10Gehel: [C: 031] "Thanks for the cleanup !" [puppet] - 10https://gerrit.wikimedia.org/r/382927 (https://phabricator.wikimedia.org/T177225) (owner: 10Dzahn) [21:20:31] (03CR) 10Zoranzoki21: [C: 031] Enable mapframe on eswiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382988 (https://phabricator.wikimedia.org/T177695) (owner: 10Jayprakash12345) [21:24:18] https://phabricator.wikimedia.org/T171027 ekk :( [22:04:20] (03PS1) 10Zoranzoki21: Modification of the default alias for namespace 828 "模块:" of zh.wikipedia [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383007 (https://phabricator.wikimedia.org/T165593) [22:09:02] (03CR) 10Zoranzoki21: [C: 031] db-eqiad.php: Set commonswiki on read only [mediawiki-config] - 10https://gerrit.wikimedia.org/r/382379 (https://phabricator.wikimedia.org/T176883) (owner: 10Marostegui) [22:27:36] (03PS1) 10Zoranzoki21: Migrate all old DB rows from windows-1252 to UTF-8 on several wikis: [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383012 (https://phabricator.wikimedia.org/T128151) [22:29:05] (03PS2) 10Zoranzoki21: Migrate all old DB rows from windows-1252 to UTF-8 on several wikis: [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383012 (https://phabricator.wikimedia.org/T128151) [22:29:20] (03CR) 10Reedy: [C: 04-2] "This... Does not migrate anything. It just changes the config" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383012 (https://phabricator.wikimedia.org/T128151) (owner: 10Zoranzoki21) [22:29:43] (03CR) 10Reedy: [C: 04-2] Migrate all old DB rows from windows-1252 to UTF-8 on several wikis: [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383012 (https://phabricator.wikimedia.org/T128151) (owner: 10Zoranzoki21) [22:30:58] (03Abandoned) 10Zoranzoki21: Migrate all old DB rows from windows-1252 to UTF-8 on several wikis: [mediawiki-config] - 10https://gerrit.wikimedia.org/r/383012 (https://phabricator.wikimedia.org/T128151) (owner: 10Zoranzoki21) [22:44:55] !log reedy@tin Synchronized php-1.31.0-wmf.2/includes/specials/SpecialBlock.php: T177705 (duration: 00m 49s) [22:45:02] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:45:03] T177705: REGRESSION - Option to suppress user accounts on blocks (hideuser) disappeared after migrating to oojs UI - https://phabricator.wikimedia.org/T177705 [22:46:09] !log reedy@tin Synchronized php-1.31.0-wmf.2/resources/: T177705 (duration: 00m 48s) [22:46:15] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log