[00:22:55] <wikibugs>	 (03Abandoned) 10Paladox: mediawiki_vagrant: Add support for stretch [puppet] - 10https://gerrit.wikimedia.org/r/405736 (https://phabricator.wikimedia.org/T180377) (owner: 10Paladox)
[00:32:44] <wikibugs>	 (03CR) 10Mark Bergsma: [C: 032] Test all branches of the Server constructor [debs/pybal] - 10https://gerrit.wikimedia.org/r/405296 (owner: 10Mark Bergsma)
[00:34:00] <wikibugs>	 (03PS3) 10Mark Bergsma: Test all branches of the Server constructor [debs/pybal] - 10https://gerrit.wikimedia.org/r/405296
[00:36:48] <wikibugs>	 (03PS3) 10Mark Bergsma: Add unit testing of monitor creation/loading [debs/pybal] - 10https://gerrit.wikimedia.org/r/405297
[00:39:28] <wikibugs>	 (03CR) 10Mark Bergsma: [C: 032] Add unit testing of monitor creation/loading [debs/pybal] - 10https://gerrit.wikimedia.org/r/405297 (owner: 10Mark Bergsma)
[00:40:04] <wikibugs>	 (03Merged) 10jenkins-bot: Add unit testing of monitor creation/loading [debs/pybal] - 10https://gerrit.wikimedia.org/r/405297 (owner: 10Mark Bergsma)
[00:41:38] <wikibugs>	 (03PS3) 10Mark Bergsma: Stop pybal on all failures to properly parse 'monitors' [debs/pybal] - 10https://gerrit.wikimedia.org/r/405298
[00:41:40] <wikibugs>	 (03PS4) 10Mark Bergsma: Fix Server testInitialize test case [debs/pybal] - 10https://gerrit.wikimedia.org/r/405308
[00:41:42] <wikibugs>	 (03PS2) 10Mark Bergsma: Add unit tests for Coordinator methods [debs/pybal] - 10https://gerrit.wikimedia.org/r/406478
[00:52:00] <wikibugs>	 (03CR) 10Ema: [C: 031] Stop pybal on all failures to properly parse 'monitors' [debs/pybal] - 10https://gerrit.wikimedia.org/r/405298 (owner: 10Mark Bergsma)
[00:53:13] <wikibugs>	 (03CR) 10Mark Bergsma: [C: 032] Stop pybal on all failures to properly parse 'monitors' [debs/pybal] - 10https://gerrit.wikimedia.org/r/405298 (owner: 10Mark Bergsma)
[00:54:05] <wikibugs>	 (03CR) 10Mark Bergsma: [C: 032] Fix Server testInitialize test case [debs/pybal] - 10https://gerrit.wikimedia.org/r/405308 (owner: 10Mark Bergsma)
[00:54:31] <wikibugs>	 (03Merged) 10jenkins-bot: Fix Server testInitialize test case [debs/pybal] - 10https://gerrit.wikimedia.org/r/405308 (owner: 10Mark Bergsma)
[01:36:57] <wikibugs>	 (03PS3) 10BBlack: eqsin: deeper configuration details [puppet] - 10https://gerrit.wikimedia.org/r/392639 (https://phabricator.wikimedia.org/T156027)
[01:37:33] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] eqsin: deeper configuration details [puppet] - 10https://gerrit.wikimedia.org/r/392639 (https://phabricator.wikimedia.org/T156027) (owner: 10BBlack)
[01:47:52] <wikibugs>	 10Operations, 10Puppet: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5 - https://phabricator.wikimedia.org/T185814#3925904 (10Krinkle) On which server are you seeing these logs?
[01:52:30] <wikibugs>	 10Operations, 10Patch-For-Review: provide a pxe-bootable rescue image - https://phabricator.wikimedia.org/T78135#3925999 (10fgiunchedi) Prerequisite to this work is to add a pxelinux menu (defaulting to d-i) that will also offer to wipe/rescue/etc
[02:09:49] <wikibugs>	 (03CR) 10TerraCodes: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[02:11:27] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable subpages in template namespace on huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[02:14:15] <Zackary>	 uh, is jerkins ok?
[02:14:19] <Zackary>	 https://integration.wikimedia.org/ci/job/operations-mw-config-php55lint/17915/console
[02:15:08] <paladox>	 Zackary hi nope
[02:15:13] <paladox>	 it's out of disk on that test
[02:15:41] <paladox>	 i pinged legoktm earlier today, but it's the weekend and all hands so it was unlikly he would have read that message
[02:19:54] <Zackary>	 ah, thanks
[02:33:21] <icinga-wm>	 PROBLEM - Check health of redis instance on 6481 on rdb2005 is CRITICAL: CRITICAL ERROR - Redis Library - can not ping 127.0.0.1 on port 6481
[02:34:21] <icinga-wm>	 RECOVERY - Check health of redis instance on 6481 on rdb2005 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6481 has 1 databases (db0) with 2868747 keys, up 5 minutes 6 seconds - replication_delay is 0
[02:35:21] <wikibugs>	 (03Draft2) 10Paladox: vagrant::mediawiki: Create /srv/mediawiki-vagrant/.vagrant/machines [puppet] - 10https://gerrit.wikimedia.org/r/406484 (https://phabricator.wikimedia.org/T180377)
[02:35:25] <wikibugs>	 (03Draft1) 10Paladox: vagrant::mediawiki: Create /srv/mediawiki-vagrant/.vagrant/machines [puppet] - 10https://gerrit.wikimedia.org/r/406484 (https://phabricator.wikimedia.org/T180377)
[02:47:28] <wikibugs>	 10Operations, 10Gerrit, 10Release-Engineering-Team: Add prometheus exporter to Gerrit - https://phabricator.wikimedia.org/T184086#3926059 (10Paladox) @demon do you want to add this plugin in your 2.14 patch or will you do a follow up adding this?
[03:00:26] <saper>	 https://integration.wikimedia.org/ci/job/mediawiki-core-php55lint/36847/console stderr: error: failed to write new configuration file .git/config.lock
[03:25:20] <icinga-wm>	 PROBLEM - MariaDB Slave Lag: s1 on dbstore1002 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 829.86 seconds
[03:53:21] <icinga-wm>	 RECOVERY - MariaDB Slave Lag: s1 on dbstore1002 is OK: OK slave_sql_lag Replication lag: 282.16 seconds
[04:16:10] <icinga-wm>	 PROBLEM - MariaDB Slave Lag: s6 on db1102 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 301.21 seconds
[04:31:11] <icinga-wm>	 PROBLEM - Check Varnish expiry mailbox lag on cp4021 is CRITICAL: CRITICAL: expiry mailbox lag is 2065177
[04:47:11] <icinga-wm>	 RECOVERY - MariaDB Slave Lag: s6 on db1102 is OK: OK slave_sql_lag Replication lag: 0.33 seconds
[06:45:21] <icinga-wm>	 PROBLEM - Check Varnish expiry mailbox lag on cp4022 is CRITICAL: CRITICAL: expiry mailbox lag is 2009374
[07:23:24] <wikibugs>	 (03PS50) 10TerraCodes: $wmf* -> $wmg* [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956)
[07:25:32] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] $wmf* -> $wmg* [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[08:30:15] <wikibugs>	 (03CR) 10Lokal Profil: Identify publisher with URI (031 comment) [dumps/dcat] - 10https://gerrit.wikimedia.org/r/386366 (https://phabricator.wikimedia.org/T178993) (owner: 10JakobVoss)
[09:25:20] <icinga-wm>	 RECOVERY - Check Varnish expiry mailbox lag on cp4022 is OK: OK: expiry mailbox lag is 6
[09:56:34] <ShakespeareFan00>	 https://la.wikisource.org/w/index.php?title=Pagina%3AAnniversaria_in_memoriam_reipublic%C3%A6_sacr%C3%A6_et_literari%C3%A6.djvu%2F2&type=revision&diff=84075&oldid=84074
[09:56:46] <ShakespeareFan00>	 I added a closing DIV tag which did not get saved to the page
[09:56:53] <ShakespeareFan00>	 WHAT the &^% is wrong ?
[10:50:48] <wikibugs>	 (03CR) 10Zoranzoki21: "Jenkins is jenkins.. recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[10:51:20] <wikibugs>	 (03CR) 10Zoranzoki21: "Jenkins please do" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[10:51:36] <wikibugs>	 (03CR) 10Zoranzoki21: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[10:53:14] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable subpages in template namespace on huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:09:42] <wikibugs>	 (03PS1) 10Urbanecm: Allow eliminators to undelete at urwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406486 (https://phabricator.wikimedia.org/T185829)
[11:13:33] <wikibugs>	 (03PS1) 10星耀晨曦: Set Portal and Portal talk namespace alias of zhwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866)
[11:13:42] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Set Portal and Portal talk namespace alias of zhwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[11:15:30] <wikibugs>	 (03CR) 10TerraCodes: [C: 031] Allow eliminators to undelete at urwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406486 (https://phabricator.wikimedia.org/T185829) (owner: 10Urbanecm)
[11:17:03] <wikibugs>	 (03PS2) 10TerraCodes: Set Portal and Portal talk namespace alias of zhwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[11:18:44] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Set Portal and Portal talk namespace alias of zhwiki [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[11:25:12] <wikibugs>	 (03CR) 10Jayprakash12345: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:26:23] <wikibugs>	 (03CR) 10Zoranzoki21: "> recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:26:54] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable subpages in template namespace on huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:27:51] <icinga-wm>	 PROBLEM - puppet last run on cp3036 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues
[11:28:34] <wikibugs>	 (03PS2) 10Jayprakash12345: Enable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:30:33] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Enable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:31:05] <wikibugs>	 (03CR) 10Zoranzoki21: "> Patch Set 2: Commit message was updated." [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:31:35] <wikibugs>	 (03PS3) 10Zoranzoki21: Reenable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813)
[11:33:46] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[11:40:07] <wikibugs>	 (03CR) 10星耀晨曦: "Why operations-mw-config-typos test build falied?" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[11:41:33] <wikibugs>	 (03CR) 10TerraCodes: [C: 031] "> Why operations-mw-config-typos test build falied?" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[11:57:50] <icinga-wm>	 RECOVERY - puppet last run on cp3036 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures
[11:58:01] <icinga-wm>	 PROBLEM - MariaDB Slave Lag: s6 on db1102 is CRITICAL: CRITICAL slave_sql_lag Replication lag: 306.13 seconds
[11:59:01] <icinga-wm>	 RECOVERY - MariaDB Slave Lag: s6 on db1102 is OK: OK slave_sql_lag Replication lag: 0.13 seconds
[12:42:08] <Hauskatze>	 marostegui: hola - T185795 ?
[12:42:08] <stashbot>	 T185795: Global rename of Ks-M9 → Stïnger: supervision needed - https://phabricator.wikimedia.org/T185795
[12:52:10] <wikibugs>	 (03CR) 10MarcoAurelio: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[12:54:15] <wikibugs>	 (03CR) 10MarcoAurelio: "Jenkins-Bot failure seems to be unrelated to the coding of this patch but an issue with zuul. Patch LGTM." [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[12:54:23] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[12:55:34] <wikibugs>	 (03CR) 10MarcoAurelio: "T185821 seems to be the issue" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[13:40:23] <wikibugs>	 (03CR) 10Zoranzoki21: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406476 (https://phabricator.wikimedia.org/T185660) (owner: 10Zoranzoki21)
[13:41:09] <wikibugs>	 (03CR) 10Zoranzoki21: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[13:43:12] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Reenable wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813) (owner: 10Zoranzoki21)
[13:44:48] <wikibugs>	 (03PS4) 10Zoranzoki21: Enable again wgNamespacesWithSubpages for huwikisource [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406474 (https://phabricator.wikimedia.org/T185813)
[13:51:19] <wikibugs>	 (03CR) 10TerraCodes: [C: 031] "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[13:51:21] <icinga-wm>	 RECOVERY - Check Varnish expiry mailbox lag on cp4021 is OK: OK: expiry mailbox lag is 8
[13:52:36] <wikibugs>	 (03CR) 10星耀晨曦: "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[13:52:58] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] $wmf* -> $wmg* [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[14:04:21] <wikibugs>	 (03CR) 10Zoranzoki21: [C: 031] $wmf* -> $wmg* [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[14:04:34] <wikibugs>	 (03CR) 10Zoranzoki21: [C: 031] "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[14:06:04] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] $wmf* -> $wmg* [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[14:24:19] <ShakespeareFan00>	 Ok
[14:24:28] <ShakespeareFan00>	 Another dissaperaing edit...
[14:24:29] <ShakespeareFan00>	 https://la.wikisource.org/w/index.php?title=Pagina:Hymnus_in_Romam.djvu/15&diff=next&oldid=84168
[14:24:49] <ShakespeareFan00>	 I tpyed the closing DIV , yet in saving it goes missing...
[14:24:56] <ShakespeareFan00>	 What's going on?
[14:28:03] <ShakespeareFan00>	 Anyone?
[14:30:19] <ShakespeareFan00>	 https://la.wikisource.org/w/index.php?title=Pagina%3AHymnus_in_Romam.djvu%2F17&type=revision&diff=84189&oldid=84170 
[14:30:31] <ShakespeareFan00>	 WHY is this eating the final DIV I add?
[14:30:52] <ShakespeareFan00>	 I type VALID input </div> and it just vanished complety on saving
[14:30:58] <ShakespeareFan00>	 This is NOT acceptable
[14:31:01] <icinga-wm>	 PROBLEM - puppet last run on elastic1045 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues
[14:31:37] <ShakespeareFan00>	 guillom: Afternoon
[14:31:40] <ShakespeareFan00>	 See above 
[14:34:10] <ShakespeareFan00>	 Did something in respect of the edit UI get updated recently?
[14:36:40] <ShakespeareFan00>	 Anyone?
[15:01:01] <icinga-wm>	 RECOVERY - puppet last run on elastic1045 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures
[15:55:25] <Jayprakash12345>	 hello
[15:55:43] <Jayprakash12345>	 Please see https://gerrit.wikimedia.org/r/#/c/406498/
[15:56:21] <Jayprakash12345>	 https://integration.wikimedia.org/ci/job/php55lint/54789/console
[15:56:33] <Jayprakash12345>	 15:40:29 fatal: sha1 file '.git/objects/pack/tmp_idx_2uRhpI' write error: No space left on device
[15:56:59] <Jayprakash12345>	 Why CI have not enugh memory?
[15:57:03] <paladox>	 Hi, ci has is not maintained by ops
[15:57:13] <paladox>	 it's maintained by releng.
[15:57:21] <paladox>	 and all of wmf is out for the all hands.
[15:57:34] <apergos>	 shit
[15:57:35] <Jayprakash12345>	 Oh
[15:57:55] <apergos>	 it's early sunday am for folks here (sf)
[15:58:22] <apergos>	 we need hashar I suppose
[15:59:25] <Jayprakash12345>	 Today I see the fails around 25+ time .
[16:01:33] <apergos>	 looks like it's been failing since yesterday around 3 pm
[16:02:16] <paladox>	 yep.
[16:02:24] <paladox>	 there's a task for this
[16:02:26] <apergos>	 I hate to say it but can you live with waiting til Monday?
[16:02:36] <apergos>	 it's just the php5 lint that's an issue
[16:02:48] <paladox>	 https://phabricator.wikimedia.org/T185821
[16:03:09] <paladox>	 apergos it's happening to any test that runs on ^^
[16:03:12] <saper>	 13 hours ago I noticed that as well
[16:03:33] <paladox>	 apergos https://phabricator.wikimedia.org/T185821#3926113
[16:03:48] <ShakespeareFan00>	 hi pladox
[16:04:00] <ShakespeareFan00>	 hi paladox
[16:04:05] <paladox>	 hi
[16:04:17] <ShakespeareFan00>	 Was something changed in the EditUI recently?
[16:04:33] <paladox>	 ShakespeareFan00 what's EditUI?
[16:04:35] <ShakespeareFan00>	 I ask.. 
[16:04:41] <ShakespeareFan00>	 paladox: Sorry typo
[16:04:50] <ShakespeareFan00>	 Editing user interface
[16:05:05] <apergos>	 paladox: great, as long as the team is aware of it 
[16:05:09] <ShakespeareFan00>	 I've got an edit on Latin Wikisource that vanished something
[16:05:28] <ShakespeareFan00>	 I added a closing </div> tag, which didn't get saved
[16:05:41] <paladox>	 Hmm, you mean wikieditor or visualeditor?
[16:05:44] <paladox>	 apergos yep
[16:05:51] <ShakespeareFan00>	 pladox: wikieditor
[16:05:55] <ShakespeareFan00>	 I don't use VE
[16:06:10] <ShakespeareFan00>	 Just the default wikitexteditor
[16:06:17] <ShakespeareFan00>	 thing you get as standard
[16:06:20] <paladox>	 ShakespeareFan00 https://github.com/wikimedia/mediawiki-extensions-WikiEditor
[16:06:41] <ShakespeareFan00>	 This is isn't an extension
[16:06:57] <ShakespeareFan00>	 This it the edit box when I click the Edit tab on a given page
[16:07:01] <paladox>	 ShakespeareFan00 wikieditor is an extension
[16:07:13] <ShakespeareFan00>	 sorry
[16:07:17] <paladox>	 wmf have visualeditor or wikieditor
[16:07:22] <ShakespeareFan00>	 I'm not understandting
[16:07:54] <ShakespeareFan00>	 You are saying the default in Mediawiki is wikieditor?
[16:08:16] <paladox>	 ShakespeareFan00 nope, the default editor is a basic one. But i think that's disabled on wmf.
[16:08:24] <paladox>	 ShakespeareFan00 also maybe file a task?
[16:08:28] <ShakespeareFan00>	 I did 
[16:08:32] <paladox>	 oh
[16:08:56] <ShakespeareFan00>	 https://phabricator.wikimedia.org/T185843
[16:09:42] <ShakespeareFan00>	 I was trying to determine if something changed recently which may have changed the hooks
[16:10:09] <ShakespeareFan00>	 because on Wikiosurce the standard wikieditor functions are altered to accomodate the header and footer
[16:10:11] <paladox>	 oh
[16:10:53] <ShakespeareFan00>	 meaning that the normal wikieditor when saving isn't getting what the user thinks it should be
[16:11:18] <ShakespeareFan00>	 Of course if Proofread page had any sanity it would place the headers and footers as entirely seperate content
[16:12:17] <ShakespeareFan00>	 and expecting a user to figure out precise handling interactions is a little unreasonable
[16:12:32] <paladox>	 Im not sure how to edit there
[16:12:40] <paladox>	 as i doin't use proofread.
[16:13:17] <ShakespeareFan00>	 paladox: TO edit a page you click Edit as you would on any other wiki
[16:13:28] <paladox>	 yep, but i doin't see any div's
[16:13:47] <ShakespeareFan00>	 What are you seeing when you edit this page?
[16:13:55] <paladox>	 I see <poem>
[16:14:06] <ShakespeareFan00>	 https://la.wikisource.org/wiki/Pagina:Hymnus_in_Romam.djvu/17
[16:14:13] <ShakespeareFan00>	 Is the problem page
[16:14:22] <ShakespeareFan00>	 In the toolbar at the top there should be a + icon
[16:14:36] <ShakespeareFan00>	 Click it and that will expand the Header/Footer sections.
[16:14:38] <paladox>	 yep
[16:14:46] <paladox>	 i see
[16:14:46] <paladox>	 <div style="text-align:center;">HYMNUS IN ROMAM
[16:14:51] <paladox>	 ----
[16:14:55] <paladox>	 </div>
[16:15:18] <ShakespeareFan00>	 At the bottom (i.e footer) you should see an unterminated <div style+"text-align:right"> blah... 
[16:15:23] <paladox>	 Also it seems that localisation is not working properly. I see latin at the bottom and not english.
[16:15:31] <paladox>	 oh found it
[16:15:58] <ShakespeareFan00>	 (re localisation: Check your Preferences, I found I had to set it up manually at LA.wikisource)
[16:16:30] <ShakespeareFan00>	 Paladox: I added a closing </div>, saved.. and went back to check it had saved.. and found it had not
[16:16:49] <ShakespeareFan00>	 So I am puzzled
[16:17:04] <ShakespeareFan00>	 I came in here because I thought something might have been updated 
[16:17:08] <paladox>	 ShakespeareFan00 it seems this is a bug
[16:17:14] <paladox>	 as it works if i put it after the 7
[16:17:28] <paladox>	 if i put it at the end where -- is, it dosen't save it
[16:17:34] <ShakespeareFan00>	 but not after the terminating dash?
[16:17:41] <ShakespeareFan00>	 Weird..
[16:17:49] <ShakespeareFan00>	 Feel free to add to the ticket then...
[16:18:09] <ShakespeareFan00>	 Does -- have any specfic markup meaning?
[16:18:42] <ShakespeareFan00>	 Well the dash at any rate?
[16:19:22] <paladox>	 ok
[16:20:35] <ShakespeareFan00>	 Also, I've I wrap the - 7 - sequnce in a template {{right|}} which should be generating a simmilar pair of DIV tags..
[16:20:42] <ShakespeareFan00>	 It saves...
[16:20:55] <ShakespeareFan00>	 So somewhere it's the dash that's breaking the save
[16:21:00] <ShakespeareFan00>	 Hmm
[16:21:14] <ShakespeareFan00>	 can we take further disscusion over to -tech ?
[16:21:38] <ShakespeareFan00>	 This isn't an operational matter now
[16:21:41] * ShakespeareFan00 out
[17:40:07] <Steinsplitter>	 hm... [Wm4KuQpAAEYAAAwAMrsAAAAI] 2018-01-28 17:39:24: Fatal exception of type "Wikimedia\Rdbms\DBQueryError"
[17:42:44] <Hauskatze>	 doing what Steinsplitter ? Special:Meow is not a valid special page :P
[17:43:22] <Steinsplitter>	 tyring to delete a tag on commons (no time to file a phab task now :P, will do later)
[17:44:30] <Hauskatze>	 Steinsplitter: I can do it for you if you'd like
[17:57:27] <marostegui>	 Hauskatze: You don't have to get blocked on me for T185795, any other opsen can  watch it. But it is unlikely this will be happening before Tuesday, we are all traveling between today and tuesday
[17:57:28] <stashbot>	 T185795: Global rename of Ks-M9 → Stïnger: supervision needed - https://phabricator.wikimedia.org/T185795
[17:57:58] <Hauskatze>	 marostegui: ok, but I don't know what 'opsen' is :)
[17:58:12] <marostegui>	 Hauskatze: Sorry, anyone from Operations :-)
[17:58:21] <Hauskatze>	 marostegui: vale :)
[17:58:23] <jynus>	 marostegui: Operations?
[17:58:35] <Hauskatze>	 yeah, well, dba right?
[17:58:39] <marostegui>	 Hauskatze: I am happy to help, but won't happen before Wednesday
[17:58:50] <Hauskatze>	 marostegui: not urgent
[17:59:06] <marostegui>	 Hauskatze: Cool :-)
[17:59:06] <jynus>	 marostegui: I think you mean SREs?
[17:59:17] <marostegui>	 jynus: yes
[18:00:23] <Hauskatze>	 translation of SREs please? :-)
[18:02:54] <jynus>	 Site Reliability Engineers
[18:03:03] <jynus>	 https://wikimediafoundation.org/wiki/Staff_and_contractors#Site_Reliability_Engineering
[18:03:34] <jynus>	 I was just teasing manuel while beeing technically correct :-P
[18:03:50] <Hauskatze>	 so mark or faidon right?
[18:04:17] <Hauskatze>	 anyway, not urgent, can wait until any of you is avalaible
[18:04:33] * Hauskatze goes to hold-up the fridge now
[18:58:52] <wikibugs>	 (03PS4) 10MarcoAurelio: Allow eswiki bureaucrats to add/remove 'accountcreator' [mediawiki-config] - 10https://gerrit.wikimedia.org/r/395775 (https://phabricator.wikimedia.org/T182201)
[20:14:23] <wikibugs>	 (03CR) 10TerraCodes: [C: 031] "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/392184 (https://phabricator.wikimedia.org/T45956) (owner: 10TerraCodes)
[20:18:40] <wikibugs>	 (03CR) 10TerraCodes: [C: 031] "recheck" [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406487 (https://phabricator.wikimedia.org/T184866) (owner: 10星耀晨曦)
[20:46:45] <wikibugs>	 (03CR) 10Zoranzoki21: "recheck" [puppet] - 10https://gerrit.wikimedia.org/r/392639 (https://phabricator.wikimedia.org/T156027) (owner: 10BBlack)
[20:47:17] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] eqsin: deeper configuration details [puppet] - 10https://gerrit.wikimedia.org/r/392639 (https://phabricator.wikimedia.org/T156027) (owner: 10BBlack)
[20:59:53] <akosiaris>	 !page jynus all dbs are dead!!!!!
[20:59:57] <akosiaris>	 lol
[21:00:03] * akosiaris joking
[21:00:42] <_joe_>	 !page akosiaris OTRS security update!
[21:01:18] <_joe_>	 this clearly doesn't work
[21:01:34] <moritzm>	 that's Groundhogs Day anyway
[21:25:11] <wikibugs>	 (03CR) 10Jayprakash12345: [C: 031] Set wgNamespaceRobotPolicies on ptwiki's NS_USER to noindex [mediawiki-config] - 10https://gerrit.wikimedia.org/r/406476 (https://phabricator.wikimedia.org/T185660) (owner: 10Zoranzoki21)
[21:59:22] <wikibugs>	 10Operations, 10Dumps-Generation: Reboot snapshot*, dumpsdata*, dataset1001, ms1001, francium - https://phabricator.wikimedia.org/T184443#3926943 (10ArielGlenn) 05Open>03Resolved Both snapshot1007 and dumpsdata1001 rebooted. Closing this ticket.
[22:18:53] <wikibugs>	 (03PS1) 10ArielGlenn: nicer usage message for icinga-downtime script [puppet] - 10https://gerrit.wikimedia.org/r/406532
[22:21:03] <wikibugs>	 (03CR) 10ArielGlenn: "Not yet tested, parking it here so we don't forget" [puppet] - 10https://gerrit.wikimedia.org/r/406532 (owner: 10ArielGlenn)
[22:26:30] <icinga-wm>	 PROBLEM - https://phabricator.wikimedia.org on phab1001 is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - string focus on bug not found on https://phabricator.wikimedia.org:443https://phabricator.wikimedia.org/ - 33594 bytes in 0.221 second response time
[22:27:16] <volans>	 https://phabricator.wikimedia.org/
[22:27:39] <apergos>	 _joe_: I'm here (:-P)
[22:29:05] <Sagan>	 that's why: https://phabricator.wikimedia.org/W727#8918
[22:29:34] <icinga-wm>	 ACKNOWLEDGEMENT - https://phabricator.wikimedia.org on phab1001 is CRITICAL: HTTP CRITICAL: HTTP/1.1 200 OK - string focus on bug not found on https://phabricator.wikimedia.org:443https://phabricator.wikimedia.org/ - 31891 bytes in 0.259 second response time daniel_zahn its ok, phab is up, content changed on front page
[22:30:08] <Sagan>	 mutante: next time take a string from a non text panel like https://phabricator.wikimedia.org/W6 ?
[22:30:14] <Sagan>	 mutante: something like "Closed Tasks"
[22:30:34] <Sagan>	 or something that mostly won't change, like "Activity Feed"?
[22:31:17] <_joe_>	 Sagan: why are you explaining that to mutante?
[22:31:37] <paravoid>	 because he acknowledged it? :)
[22:31:42] <mutante>	 it was supposed to be one that doesnt change often :)
[22:31:43] <Sagan>	 _joe_: he acknowledged the alert, so I assumed he is looking at it? :)
[22:37:50] <_joe_>	 it's interesting that the comment on the file for alerting says it will search "wikimedia", but then the check does search for "focus on bug"
[22:37:53] <_joe_>	 ...
[22:40:28] <Sagan>	 wikimedia can be bad, if there is "wikimedia error"
[22:41:29] <_joe_>	 Sagan: I actually think we should /not/ check for strings
[22:41:36] <_joe_>	 this is the second time it happens
[22:41:48] <_joe_>	 that's two times too many IMHO
[22:41:50] <_joe_>	 :)
[22:41:56] <Sagan>	 _joe_: what would you propose instead? :)
[22:42:18] <_joe_>	 otoh, using something like "closed tags" could change only if we upgrade phab
[22:42:30] <_joe_>	 and in that case, it's pretty obvious
[22:42:45] <Sagan>	 let's write andre an email that he broke phab :D
[22:42:48] <_joe_>	 Sagan: my idea would be not to check a string
[22:42:50] <_joe_>	 ahah 
[22:42:56] <Sagan>	 hm
[22:43:00] <_joe_>	 but I'm debated
[22:43:37] <_joe_>	 Sagan: if it was an error page, it would not yield a 200 OK response
[22:44:17] <Sagan>	 hm
[22:45:46] <_joe_>	 so yeah it's possible phab gets crazy and shows a page of garbage, but I see that as a pretty remote possibility.
[22:46:16] <apergos>	 I was thinking more of the opposite possibility, that it sends the 200 ok with however an empty body
[22:48:31] <_joe_>	 apergos: how can that happen?
[22:48:50] <wikibugs>	 (03PS1) 10Giuseppe Lavagetto: phabricator: stop monitoring strings that are editable [puppet] - 10https://gerrit.wikimedia.org/r/406533
[22:49:30] <_joe_>	 apergos: if php errors out you send out a blank page it also responds 500 Internal Server Error
[22:49:34] <apergos>	 something would be broken
[22:49:47] <_joe_>	 anyhow, PS is there ^^
[22:50:00] <wikibugs>	 (03PS6) 10Paladox: WIP: phabricator: Switch from apache to nginx [puppet] - 10https://gerrit.wikimedia.org/r/406243 (https://phabricator.wikimedia.org/T185644)
[22:50:10] <wikibugs>	 (03CR) 10Dzahn: [C: 031] phabricator: stop monitoring strings that are editable [puppet] - 10https://gerrit.wikimedia.org/r/406533 (owner: 10Giuseppe Lavagetto)
[22:52:39] <wikibugs>	 (03CR) 10Giuseppe Lavagetto: [C: 032] phabricator: stop monitoring strings that are editable [puppet] - 10https://gerrit.wikimedia.org/r/406533 (owner: 10Giuseppe Lavagetto)
[22:53:33] <wikibugs>	 (03CR) 10Dzahn: [C: 031] "..or we can make a Pastebin on Phab, add a test string, change privileges so it can't be edited anymore.. and then check the string again" [puppet] - 10https://gerrit.wikimedia.org/r/406533 (owner: 10Giuseppe Lavagetto)
[22:55:06] <wikibugs>	 10Operations, 10Operations-Software-Development, 10Continuous-Integration-Config: Puppet tox: properly lint both Py2 and Py3 files - https://phabricator.wikimedia.org/T184435#3927000 (10Volans)
[23:02:49] <icinga-wm>	 RECOVERY - https://phabricator.wikimedia.org on phab1001 is OK: HTTP OK: HTTP/1.1 200 OK - 31920 bytes in 0.213 second response time
[23:28:05] <wikibugs>	 10Operations, 10DC-Ops: determine/process/document bios firmware tracking/updating policies - https://phabricator.wikimedia.org/T141128#3927030 (10RobH)
[23:32:56] <wikibugs>	 (03PS2) 10Dzahn: nicer usage message for icinga-downtime script [puppet] - 10https://gerrit.wikimedia.org/r/406532 (owner: 10ArielGlenn)
[23:34:13] <wikibugs>	 (03CR) 10Dzahn: [C: 032] "thanks :) works" [puppet] - 10https://gerrit.wikimedia.org/r/406532 (owner: 10ArielGlenn)
[23:35:00] <mutante>	 apergos: i see you already did the wiki page edits, yay
[23:37:29] <icinga-wm>	 PROBLEM - HHVM rendering on mw2130 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[23:37:39] <mutante>	 Sagan: for now we removed the string check, it can still be debated whether we should add it back. one idea would be to use a pastebin that cant be edited. but the counter-argument was that would not actually monitor Maniphest but another app within phab
[23:38:16] <Sagan>	 hm. but before it did not monitor maniphest as well, by the way
[23:38:19] <icinga-wm>	 RECOVERY - HHVM rendering on mw2130 is OK: HTTP OK: HTTP/1.1 200 OK - 71643 bytes in 0.380 second response time
[23:42:50] <wikibugs>	 10Operations, 10monitoring: icinga ACK shows as CRIT when delivered via SMS - https://phabricator.wikimedia.org/T185862#3927049 (10Dzahn)
[23:43:40] <mutante>	 yes, that's true
[23:44:10] <mutante>	 Sagan: i think ideally it would login on phab 
[23:44:55] <mutante>	 could read a string it can only see after login
[23:51:01] <wikibugs>	 10Operations, 10monitoring: icinga ACK shows as CRIT when delivered via SMS - https://phabricator.wikimedia.org/T185862#3927070 (10Dzahn)
[23:55:30] <wikibugs>	 10Operations, 10monitoring: icinga ACK shows as CRIT when delivered via SMS - https://phabricator.wikimedia.org/T185862#3927073 (10Dzahn) ``` # 'notify-by-sms-gateway' command definitions define command{     command_name    host-notify-by-sms-gateway     command_line    echo "Host $HOSTALIAS$ is $HOSTSTATE$\nI...
[23:56:55] <wikibugs>	 10Operations, 10monitoring: icinga ACK shows as CRIT when delivered via SMS - https://phabricator.wikimedia.org/T185862#3927075 (10Dzahn) The problem is that we don't use "Notification Type: $NOTIFICATIONTYPE$" in the SMS-related notification commands,   We do in the IRC-related notification commands and in em...