[00:15:47] ok, I finaly found the problem witnh sql-toolserver and fixed it [00:15:52] :D [00:23:48] DaBPunkt: what was it? [00:24:24] Betacommand: the ip-binding in the mysql-config was outcommented for some reasons [00:35:02] Tim Landscheidt * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [00:54:03] nacht ts [01:33:51] 3(created) [ACC-243] I need to send a new public key to admin to update my ssh access account as I lost access to my old private key; ACC; Critical Support request <10https://jira.toolserver.org/browse/ACC-243> (Ahmed Medhat Mohamed) [01:51:02] [[w:en:User:Madman]] * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [02:22:56] 3(moved) [TS-1331] I need to send a new public key to admin to update my ssh access account as I lost access to my old private key <10https://jira.toolserver.org/browse/TS-1331> (Simon Walker) [02:22:57] 3(commented) [TS-1331] I need to send a new public key to admin to update my ssh access account as I lost access to my old private key <10https://jira.toolserver.org/browse/TS-1331> (Simon Walker) [02:34:02] aude * [Toolserver-l] Deadline for Wikimania submissions is Sunday [03:45:58] 3(resolved) [OSM-5] hstore operator ? no longer uses indexes <10https://jira.toolserver.org/browse/OSM-5> (Kai Krueger) [06:20:53] 3(commented) [ACCAPP-477] Account for hosting Wikipedia-OpenStreetMap integration tools <10https://jira.toolserver.org/browse/ACCAPP-477> [06:37:58] 3(updated) [ACCAPP-477] Account for hosting Wikipedia-OpenStreetMap integration tools <10https://jira.toolserver.org/browse/ACCAPP-477> [06:45:56] 3(commented) [ACCAPP-477] Account for hosting Wikipedia-OpenStreetMap integration tools <10https://jira.toolserver.org/browse/ACCAPP-477> (Kai Krueger) [07:51:21] [[Special:Log/newusers]] create 10 * Weiyi * (New user account) [07:54:51] [[User talk:Weiyi]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6856&rcid=9036 * Weiyi * (+11) (Created page with "abercrombie") [08:58:24] nfs is making problems again [10:57:01] Are the databases on sql-s1-user still importing ? [11:32:56] 3(created) [TS-1332] User database u_tb missing from sql-s1-user; Toolserver: Databases; Bug <10https://jira.toolserver.org/browse/TS-1332> (Topbanana) [11:44:02] Platonides * Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93 [11:49:53] 3(assigned) [TS-1332] User database u_tb missing from sql-s1-user <10https://jira.toolserver.org/browse/TS-1332> (DaB.) [12:08:02] DaB. * Re: [Toolserver-announce] [Toolserver-l] Maintenance at Wednesday [12:46:50] [[Toolserver:Autoconfirmed users]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6857&rcid=9037 * Savadkoohi * (+53) (Created page with "--~~~~Insert non-formatted text here") [12:51:38] [[Special:Log/newusers]] create 10 * Bailey Helton * (New user account) [12:52:34] [[User:Dab]] ! 10https://wiki.toolserver.org/w/index.php?diff=6858&oldid=6635&rcid=9039 * Bailey Helton * (+71) () [12:52:35] [[User talk:Gnuinux]] ! 10https://wiki.toolserver.org/w/index.php?diff=6859&oldid=6855&rcid=9040 * Bailey Helton * (+51) () [12:52:40] [[User:Savadkoohi]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6860&rcid=9041 * Savadkoohi * (+59) (Created page with "--~~~~") [12:53:03] [[User talk:Savadkoohi]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6861&rcid=9042 * Savadkoohi * (+73) (Created page with "[[--~~~~Link title]]") [12:53:47] [[Toolserver:Users]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6862&rcid=9043 * Savadkoohi * (+59) (Created page with "--~~~~") [12:54:09] [[Toolserver talk:Users]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6863&rcid=9044 * Savadkoohi * (+59) (Created page with "--~~~~") [13:30:39] Hello all [13:38:56] 3(resolved) [TS-1332] User database u_tb missing from sql-s1-user <10https://jira.toolserver.org/browse/TS-1332> (DaB.) [13:38:58] 3(assigned) [TS-1331] I need to send a new public key to admin to update my ssh access account as I lost access to my old private key <10https://jira.toolserver.org/browse/TS-1331> (DaB.) [13:41:52] 3(commented) [TS-1331] I need to send a new public key to admin to update my ssh access account as I lost access to my old private key <10https://jira.toolserver.org/browse/TS-1331> (DaB.) [13:43:54] 3(resolved) [TS-1281] problem with fr.wiki data base <10https://jira.toolserver.org/browse/TS-1281> (DaB.) [13:45:53] [[Toolserver:Autoconfirmed users]] ! 10https://wiki.toolserver.org/w/index.php?diff=6864&oldid=6857&rcid=9045 * Hydra * (+32) (Delete - Little or no meaning) [13:45:53] [[User:Savadkoohi]] ! 10https://wiki.toolserver.org/w/index.php?diff=6865&oldid=6860&rcid=9046 * Hydra * (+32) (Delete - Little or no meaning) [13:45:53] [[User talk:Savadkoohi]] ! 10https://wiki.toolserver.org/w/index.php?diff=6866&oldid=6861&rcid=9047 * Hydra * (+32) (Delete - Little or no meaning) [13:45:54] [[Toolserver:Users]] ! 10https://wiki.toolserver.org/w/index.php?diff=6867&oldid=6862&rcid=9048 * Hydra * (+32) (Delete - Little or no meaning) [13:45:55] [[Toolserver talk:Users]] ! 10https://wiki.toolserver.org/w/index.php?diff=6868&oldid=6863&rcid=9049 * Hydra * (+32) (Delete - Little or no meaning) [13:47:05] [[User:Hydra/vector.js]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6869&rcid=9050 * Hydra * (+112) (Using global JS) [13:47:05] [[User:Hydra/vector.css]] !N 10https://wiki.toolserver.org/w/index.php?oldid=6870&rcid=9051 * Hydra * (+98) (Using global CSS) [13:47:31] screw JS and CSS doesn't work :( [14:15:52] [[Special:Log/newusers]] create 10 * Nigelcox1961 * (New user account) [15:38:02] Sumana Harihareswara * [Toolserver-l] Deadline today: Submit a talk to Open Source Bridge, get WMF subsidy [16:15:52] 3(closed) [DRTRIGON-121] Subster bot 'error' parameter does not accept '\n' (like in default value) <10https://jira.toolserver.org/browse/DRTRIGON-121> (drtrigon) [16:26:57] 3(closed) [DRTRIGON-120] New bot script/part for opencv image recognition and classification <10https://jira.toolserver.org/browse/DRTRIGON-120> (drtrigon) [16:28:24] Do we hide user_touched or am I just going a little blind? :P [16:55:53] Jarry1250: yes, we do [16:56:38] Fari enough. [16:56:40] *Fair [17:20:41] (das Bazillenmutterschiff ist zurück — rettte sich wer kann!) [17:39:39] afk [19:05:43] is anyone here who can answer a question about maximum script run time on the toolservers? [19:08:39] Kai_WMDE: what kind of script? [19:08:45] a SQL query? [19:08:57] jeremyb: python [19:09:16] as i understand there is a maximum script run time for cronjobs [19:09:30] does this also apply to scripts ran from the shell? [19:10:17] you certainly must be familiar with SGE [19:10:26] have you read about it yet? [19:10:38] what kind of script is it? can it be checkpointed? [19:11:03] s/must/need to be/ [19:11:45] nope, didn't read about sge yet [19:12:18] it's a script that processes the pagecount statistics from dumps.wikimedia.org [19:12:54] so, actually it can be checkpointed [19:14:11] processing one file takes about 60 to 90 seconds incl. downloading it [19:14:31] but we need historical data from 2011 [19:14:56] so 24 * 365 files to process [19:15:33] results in about one week of working [19:18:48] jeremyb: ok, so job scheduling is what i need [19:23:06] jeremyb: sounds good. maybe you can also tell me if there are copies of the pagecount files from dumps.wikimedia.org located on a server in amsterdam? [19:23:33] * jeremyb reads up [19:24:40] Kai_WMDE: no idea. ask apergos [19:25:03] Kai_WMDE: /j #wikimedia-tech [19:25:14] (what are pagecount files anyway?) [19:25:28] page *views*? [19:25:41] jeremyb: exactly [19:26:20] jeremyb: actually hourly dumps of access logs [19:26:20] idk what kind of size files you're talking about but maybe it's worth it to just use AWS [19:26:31] right [19:26:44] http://open.blogs.nytimes.com/tag/aws/ [19:27:46] Kai_WMDE: /j #wikimedia-tech [19:50:32] Did something just die on the web servers? [19:51:37] Or it might be an account limit. Hmm, where would I find that exactly? [19:53:21] multichill: I'm pretty sure there's a command to check usage. 'sec [19:54:08] http://toolserver.org/~erfgoed/map/?srwithoutimage=1 won't load anymore :S [19:55:09] WORKSFORME [19:58:31] multichill: it's "quota -v" [19:59:19] That's disk usage. Not really what I meant. More like database usage. Number of open connections etc [19:59:39] Ah, misread XD [19:59:54] I'm sure there is, the ACC tool has a problem with it sometimes. Let me look again. [20:01:46] multichill: the limit is 15 connection/user/server [20:02:11] * matthewrbowker thought that, but wasn't sure :) [20:02:22] if there is a good reason if can be extended, but I prefer that the people move heavy-used-stuff to a MMP [20:02:26] Ok. Thanks DaBPunkt, where can i see the current usage? [20:02:29] It's a MMP [20:02:37] "erfgoed" [20:03:18] multichill: use rmytop to connect to the server and look how many open conection are there [20:03:28] "rmytop -h daphne" for example [20:04:28] Ah, thanks, I guess multiple users are playing around with the map right now :-) [20:04:34] you can also use "SHOW PROCESSLIST;" in mysql, but that is not very comfortable [20:05:09] DaBPunkt you particularly busy? [20:05:18] cause I would love to see them queries :p [20:05:34] multichill: if you need more connections for this MMP, you can request them in a jira-ticket if you like [20:06:16] It looks like something is blocking. The queries should only be a couple of seconds the most [20:07:13] ToAruShiroiNeko: there are douzends of toolserver-users taht can run queries for you (some very much better than me in SQL); why has it to be me? [20:07:22] +are [20:07:50] multichill: which server? [20:08:03] sql.toolserver.org [20:08:14] (userdb, username=erfgoed) [20:10:49] * multichill killed some of them [20:11:07] mm, looks not very crowded [20:11:41] Got 15 open connections for some reason [20:11:50] DaBPunkt I thought you had the queries already :) [20:12:21] tomorow is the last day for me to update my submission so I really want ot display the total deleted file count for commons and total deleted article count for en.wikipedia [20:12:47] ToAruShiroiNeko: ok, tell me what you need [20:13:02] ok [20:13:09] http://wikimania2012.wikimedia.org/wiki/Submissions/CLEF_2011#Artificial_Intelligence [20:13:16] I have outdated numbers there [20:13:27] "There are 1,259,001 deleted files on Commons" [20:13:32] I need an update for that number [20:13:57] I also would be interested in the number of deleted articles on en.wikipedia [20:14:02] as in mainspace deletes [20:16:08] multichill: I can't see where the problem is at the moment, sorry [20:16:25] I'm not sure either what's causing this [20:16:31] if the queries are fast for normal, they SHOULD be fast now too [20:16:32] I'll just leave it be for now [20:18:08] multichill: If this is a webtool, you should add a reasonable LIMIT:-statement, so the queries are killed if they run for to long [20:18:26] ToAruShiroiNeko: ok, let me see [20:24:54] ToAruShiroiNeko: from where you got the 1,259,001? [20:25:41] I believe you told me [20:25:51] I dont remember it was in september [20:28:55] you already have a query that counts deleted file types [20:29:03] couldnt that also return the deleted files? [20:29:25] there are 1539091 deleted files on commons at the moment [20:29:43] http://toolserver.org/~dab/queries/ToAruShiroiNekoA2.txt [20:29:45] ah [20:33:13] DaBPunkt great, now could you get me the number of deleted articles on en.wikipedia and perhaps the top 10 if possible? [20:33:22] the number of the deleted articles of enwp will take a moment [20:33:50] k [20:33:57] I only care about the main namespace :) [20:35:26] the problem is that there is not table fo deleted articles, only for deleted revisions; so I have to filter. [20:37:36] ToAruShiroiNeko: top 10 wikipedias? [20:39:25] yeah the top ten with most articles that appears on www.wikipedia.org [20:47:03] dewp:1014441 [20:47:05] frwp:517845 [20:47:06] itwp:428606 [20:47:08] plwp:327161 [20:47:09] eswp:752814 [20:47:11] ruwp:373430 [20:47:12] jawp:205484 [20:47:14] nlwp:217583 [20:47:15] ptwp:419129 [20:47:17] enwp is still running, I will ping you when it is done [20:47:50] enwp:2387906 [20:52:29] yay [20:52:57] ToAruShiroiNeko: www portals are not ordered by # of articles though [20:59:15] DaBPunkt one more thing can you get me the same number for current article count? Content pages exclude redirects [20:59:26] deleted content includes redirects [20:59:31] Danny_B|backup this is true [20:59:37] I just want to give the general picture [21:07:21] enwp:3933153 [21:07:22] dewp:1383695 [21:07:24] frwp:1226669 [21:07:25] itwp:909979 [21:07:27] plwp:885712 [21:07:28] eswp:878116 [21:07:30] ruwp:835022 [21:07:31] jawp:803157 [21:07:33] nlwp:1032487 [21:07:34] ptwp:885712 [21:09:45] DaBPunkt isnt that content pagesd? [21:10:00] pardon? [21:10:23] does that numbers include the redirects? [21:10:28] no [21:10:43] could you give me a count with the redirects and all other such exeptions [21:10:50] cause deleted pages does include deleted redirects [21:11:37] sure, wait a moment [21:15:41] enwp:9272208 [21:15:42] dewp:2337921 [21:15:44] frwp:2410253 [21:15:45] itwp:1350753 [21:15:47] plwp:1145943 [21:15:48] eswp:2190060 [21:15:50] ruwp:1733689 [21:15:51] jawp:1279097 [21:15:53] nlwp:1474132 [21:15:54] ptwp:1733689 [21:16:01] * Joan teaches DaBPunkt about pastebins. ;-) [21:16:55] ptwp:885712 plwp:885712 [21:16:57] is this true? [21:19:02] pardon? [21:19:45] DaBPunkt: they are the same number [21:20:38] so I think ToAruShiroiNeko was wondering whether they are actually the same or if you mixed up ptwp and plwp ;-) [21:21:12] yes, ptwiki_p has only 717771 [21:22:00] and 1283345 at the total count [21:23:33] DaBPunkt can you publish all these numbers as a text file so I can source? :) [21:29:20] ToAruShiroiNeko: http://toolserver.org/~dab/queries/ToAruShiroiNeko_stats.txt [21:41:19] ToAruShiroiNeko: anything else, or can I do some private stuff now? [21:54:29] * valhallasw shoves a bottle of beer towards DaBPunkt  [22:01:58] DaBPunkt only that I will get you a lot of beer at some point in my life [22:03:30] you have my thanks :) [22:04:23] mm [22:53:02] Dr. Trigon * Re: [Toolserver-l] How to silence qsub/qcronsub?