[00:07:23] (03CR) 10Dzahn: [C: 04-2] "we just talked about this. it works now on the cloud VPS. it wasn't caused by missing ferm rule, so this isn't needed." [puppet] - 10https://gerrit.wikimedia.org/r/351546 (owner: 10Paladox) [00:07:40] (03Abandoned) 10Dzahn: gerrit: add firewall rule for nrpe (DO NOT MERGE) [puppet] - 10https://gerrit.wikimedia.org/r/351546 (owner: 10Paladox) [01:02:22] PROBLEM - Check health of redis instance on 6379 on rdb2001 is CRITICAL: CRITICAL: replication_delay is 1498266134 600 - REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 8461926 keys, up 2 minutes 13 seconds - replication_delay is 1498266134 [01:02:52] PROBLEM - Check health of redis instance on 6380 on rdb2003 is CRITICAL: CRITICAL ERROR - Redis Library - can not ping 127.0.0.1 on port 6380 [01:03:22] RECOVERY - Check health of redis instance on 6379 on rdb2001 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6379 has 1 databases (db0) with 8459067 keys, up 3 minutes 13 seconds - replication_delay is 0 [01:03:52] RECOVERY - Check health of redis instance on 6380 on rdb2003 is OK: OK: REDIS 2.8.17 on 127.0.0.1:6380 has 1 databases (db0) with 8455297 keys, up 3 minutes 47 seconds - replication_delay is 0 [01:58:15] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 10Shell: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376126 (10MF-Warburg) [01:59:04] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376138 (10Peachey88) [01:59:42] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376139 (10MF-Warburg) [02:11:31] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376126 (10Dcljr) //Note:// Link to request on Meta should be: https://meta.wikimedia.org/wiki/Requests_for_new_languages/Wikiversity_Hindi (The one with two slashes aft... [02:13:47] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376155 (10MF-Warburg) [02:19:03] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376161 (10Jayprakash12345) p:05Triage>03High Is it Possible to Create this Wikiversity before 15 July. Beacause the Third Hindi WikiConference announced for on 15 Jul... [03:05:30] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376126 (10Koavf) Is this really ready? I don't read Hindi but the main category has 84 subcategories and 25 are empty (many only have subcategories which are themselves e... [03:32:31] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376171 (10Jayprakash12345) @Koavf Sir, See Here [https://beta.wikiversity.org/wiki/States_of_Wikiversities]. We don't include Category. And By the way most of pages maded... [04:10:22] PROBLEM - mailman I/O stats on fermium is CRITICAL: CRITICAL - I/O stats: Transfers/Sec=323.30 Read Requests/Sec=3343.50 Write Requests/Sec=0.60 KBytes Read/Sec=38248.00 KBytes_Written/Sec=54.00 [04:19:23] RECOVERY - mailman I/O stats on fermium is OK: OK - I/O stats: Transfers/Sec=3.10 Read Requests/Sec=0.70 Write Requests/Sec=0.50 KBytes Read/Sec=35.60 KBytes_Written/Sec=12.00 [04:55:21] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376177 (10Koavf) >>! In T168765#3376171, @Jayprakash12345 wrote: > @Koavf Sir, See Here https://beta.wikiversity.org/wiki/States_of_Wikiversities. We don't include Catego... [06:17:58] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376126 (10Mahir256) @Koavf: I am not a Hindi speaker, but I can at least discern Devanagari text and the English loanwords in it. Your first link is to "Category:Intellig... [08:25:12] PROBLEM - Host elastic1017 is DOWN: PING CRITICAL - Packet loss = 100% [09:52:52] PROBLEM - Router interfaces on cr1-codfw is CRITICAL: CRITICAL: host 208.80.153.192, interfaces up: 120, down: 1, dormant: 0, excluded: 0, unused: 0BRxe-5/0/2: down - Core: cr2-ulsfo:xe-1/3/0 (Zayo, OGYX/124337//ZYO, 38.8ms) {#11541} [10Gbps wave]BR [09:53:02] PROBLEM - Router interfaces on cr2-ulsfo is CRITICAL: CRITICAL: host 198.35.26.193, interfaces up: 76, down: 1, dormant: 0, excluded: 0, unused: 0BRxe-1/3/0: down - Core: cr1-codfw:xe-5/0/2 (Zayo, OGYX/124337//ZYO, 38.8ms) {#?} [10Gbps wave]BR [09:54:52] RECOVERY - Router interfaces on cr1-codfw is OK: OK: host 208.80.153.192, interfaces up: 122, down: 0, dormant: 0, excluded: 0, unused: 0 [09:55:02] RECOVERY - Router interfaces on cr2-ulsfo is OK: OK: host 198.35.26.193, interfaces up: 78, down: 0, dormant: 0, excluded: 0, unused: 0 [12:16:00] (03PS3) 10Nemo bis: Make mailman filter messages with high X-Spam-Score by default [puppet] - 10https://gerrit.wikimedia.org/r/350429 (https://phabricator.wikimedia.org/T161082) [12:16:55] (03CR) 10Nemo bis: "Yes, holding would not be bad. I've switched the commit message to say "filter" as in the mailman code comment." [puppet] - 10https://gerrit.wikimedia.org/r/350429 (https://phabricator.wikimedia.org/T161082) (owner: 10Nemo bis) [14:02:17] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376328 (10Jayprakash12345) https://meta.wikimedia.org/wiki/Language_proposal_policy#Final_approval And https://meta.wikimedia.org/wiki/Language_committee/Handbook_%28comm... [15:39:52] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3376356 (10gh87) [16:12:22] PROBLEM - Nginx local proxy to apache on mw2144 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:12] RECOVERY - Nginx local proxy to apache on mw2144 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 613 bytes in 0.199 second response time [17:50:16] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376419 (10Dereckson) Your concerns are legitimate and there isn't any hurry to process this request. Could you address them to the langcom mailing list? You can subscrib... [17:50:30] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376422 (10Dereckson) p:05High>03Low [17:54:16] 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Create Wikiversity Hindi - https://phabricator.wikimedia.org/T168765#3376425 (10Dereckson) >>! In T168765#3376161, @Jayprakash12345 wrote: > Create this Wikiversity before 15 July. Beacause the Third Hindi WikiConference announced for on 15... [17:59:24] (03PS5) 10Paladox: planet: Update css and templates to be modern look [puppet] - 10https://gerrit.wikimedia.org/r/361190 [17:59:31] (03PS6) 10Paladox: planet: Update css and templates to be modern look [puppet] - 10https://gerrit.wikimedia.org/r/361190 [17:59:33] (03PS7) 10Paladox: planet: Update css and templates to be modern look [puppet] - 10https://gerrit.wikimedia.org/r/361190 [18:01:02] (03PS8) 10Paladox: planet: Update css and templates to be modern look [puppet] - 10https://gerrit.wikimedia.org/r/361190 [18:21:56] 10Operations, 10Ops-Access-Requests, 10Scoring-platform-team, 10User-Zppix: Graphite access for Zppix - https://phabricator.wikimedia.org/T168014#3376441 (10Halfak) I talked to @Zppix and @RStallman-legalteam. We're putting this on hold for now. Sorry for any extra work this caused. Please feel free to... [18:26:25] 10Operations, 10Ops-Access-Requests, 10Scoring-platform-team, 10User-Zppix: Graphite access for Zppix - https://phabricator.wikimedia.org/T168014#3353061 (10Dereckson) @Halfak A workaround could be to prepare public graphite graphs/dashboard useful for ORES, and so Zppix or any other can use them. [18:28:39] 10Operations, 10Ops-Access-Requests, 10Scoring-platform-team, 10User-Zppix: Graphite access for Zppix - https://phabricator.wikimedia.org/T168014#3376444 (10Halfak) Agreed. I was hoping to have @zppix do all of the work to get this set up (because I have like 4 jobs and waiting for me to do something is b... [18:42:34] 10Operations, 10DBA, 10cloud-services-team: Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3376445 (10Halfak) Hey folks! I've been traveling and just getting caught up. It looks like we ought to make a quick announcement for Wiki labels. I can get a notice out as soon as w... [20:08:22] PROBLEM - HHVM rendering on mw2126 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:09:22] RECOVERY - HHVM rendering on mw2126 is OK: HTTP OK: HTTP/1.1 200 OK - 75987 bytes in 0.380 second response time [22:05:55] 10Operations, 10DBA, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3376531 (10alanajjar) [22:20:41] (03PS1) 10Volans: Tests: convert unittest to pytest [software/cumin] - 10https://gerrit.wikimedia.org/r/361274 (https://phabricator.wikimedia.org/T154588) [22:23:27] robh: We (research) are currently running reader surveys that had some translations deployed during thursday's swat: https://gerrit.wikimedia.org/r/#/c/360889/ [22:23:27] Everything looked good after the deploy; however, the translation changes are no longer in place. [22:23:27] test (survey buttons should not be in English): https://ro.wikipedia.org/wiki/Special:Random?quicksurvey=true [22:23:27] They are correctly translated when requesting from mw2017.codfw.wmnet [22:23:28] How can we resolve this issue? Thanks [23:11:22] PROBLEM - HHVM rendering on mw2222 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:12:12] RECOVERY - HHVM rendering on mw2222 is OK: HTTP OK: HTTP/1.1 200 OK - 75987 bytes in 0.272 second response time [23:13:42] PROBLEM - pdfrender on scb1002 is CRITICAL: connect to address 10.64.16.21 and port 5252: Connection refused