[00:16:34] !log devtools - unbreaking puppet run on the local deployment after it was broken since July due to changes in prod deployment_server role [00:16:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Devtools/SAL [09:58:59] [telegram] @bd (re @wmtelegram_bot: [irc] greg-g: because I'm never going to remember "wudele", https://doodle.toolforge.org/ now redirects to https://wudele.toolforge.org/ ;)) [09:59:19] [telegram] @bd808 Cheers ; it was already an alias in the directory https://hay.toolforge.org/directory/#/search/doodle (re @wmtelegram_bot: [irc] greg-g: because I'm never going to remember "wudele", https://doodle.toolforge.org/ now redirects to https://wudele.toolforge.org/ ;)) [10:49:06] !log admin disable puppet in cloudnet servers to merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/623569/ [10:49:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:09:15] !log admin [codfw1dev] rebooting cloudnet2002-dev after some network tests, to reset initial state (T261724) [11:09:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:09:20] T261724: cloudgw: evaluate / validate setup in codfw1dev - https://phabricator.wikimedia.org/T261724 [11:27:20] !log admin [codfw1dev] rebooting again cloudnet2002-dev after some network tests, to reset initial state (T261724) [11:27:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:27:25] T261724: cloudgw: evaluate / validate setup in codfw1dev - https://phabricator.wikimedia.org/T261724 [12:46:18] im getting "fatal error: newosproc" error when executing `kubectl get pods` on all my tools [12:46:29] full output is similar to this https://phabricator.wikimedia.org/T219070 [12:47:13] but idk how to fix it [12:53:29] which tool WhitePhosphorus ? [12:53:44] arturo tools.lziad & tools.lziad-cvnbot [13:02:53] WhitePhosphorus: I can't reproduce the error [13:02:55] https://www.irccloud.com/pastebin/zNoNdt6M/ [13:11:05] weird, i still encounter the error https://paste.ubuntu.com/p/FTcmTsSn72/ [13:11:12] maybe id try again later, ty anyways [13:34:59] !log admin adding drives on cloudcephosd100[1-3] to ceph osd pool [13:35:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:36:33] Am I allowed to manage multiple tools from a single account? [13:38:12] But I cannot upload my files (technically put) to my toolforge directory [13:38:25] * second account [13:40:23] !log admin adding drives on cloudcephosd101[0-2] to ceph osd pool [13:40:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:42:39] nokib: typically you would have one user/ssh account and then create a tool account per tool [13:43:19] (I'm not sure if I'm answering your question, sorry) [13:43:21] I created the tool accound "nokib-bot" [13:45:09] * from the same ssh account ("নকীব বট"). I can access my previous tool account files ("goodarticlebot") using sftp. But I cannot access the files (i.e putting the files) for "nokib-bot". [13:45:58] I would not expect the two different tools to be able to write to each other's dirs. I /would/ expect your personal login account to be able to write to both though. [13:46:34] andrewbogott But I cannot [13:47:07] * I cannot write on their own dirs [13:47:16] so, to confirm 'নকীব বট' is your personal login account, not a tool account? [13:47:26] And you can wrote to one tool dir but not the other? [13:47:29] Yes [13:47:44] That is my Bot account in bnwp [13:48:20] Yes, I can write on "goodarticlebot" but not on "nokib-bot" [13:49:34] andrewbogott become nokib-bot works perfectly which means I have no error in creating the tool account "nokib-bot". [13:53:21] I see files owned by 'nokibsarkar' is that you? [13:53:33] that user seems to be able to write files in both tool dirs [13:53:34] Yes [13:54:57] But I find the error something like "writing on the directory /data/project/nokib-bot is not permitted. Permission denied" [13:57:42] Here is what I see: [13:57:50] https://www.irccloud.com/pastebin/vjGe50oH/ [13:58:02] So the permissions themselves seem correct. [13:58:14] Have you confirmed that you can write to goodarticlebot with the exact workflow that you are using now? [13:58:21] What tools are you using to copy files? [13:59:25] sftp from PAWS [14:00:16] Actually I donot have any computer/laptop. So I use my smartphone for coding and PAWS terminal for uploading. [14:00:53] Did it answer you? [14:02:28] Yep, makes sense. I don't have any experience with that workflow though, so I may not be able to offer much more help. The PAWS account is not the same account that's used in toolforge so I'm surprised that any of this works :) [14:02:54] It may be that as other people wake up someone else will have a better suggestion [14:03:07] I think you can. Don't make me hopeless [14:03:13] Hello there! I've read I shouldn't make an introduction to my problem but it's my first time using IRC so I'm a bit confused.... I'm having difficulties with Pywikibot/Toolforge. Can someone experienced offer himself to help me via email? [14:04:19] Actually in paws terminal I use the command [14:04:59] I've read everything there is online (MediaWiki/WikiTech) about the subject and I don't really know where else to ask for help. [14:05:08] sftp -i private 'user@host:/data/project/tool' [14:06:03] If the tool="goodarticlebot" then I can use the command "put files" [14:06:39] Bigem: this is the right place to ask but you'll need to explain more about the problem you're having and then wait for someone with thoughts to respond. It might take a bit. [14:06:43] But if tool="nokib-bot" I cannot use "put *" which give me errors [14:07:31] nokib: and in this case 'user' is 'nokibsarkar'? and 'host' is ? [14:07:49] andrewbogott: Yes, but it might take me a while to describe my problem and since someone was already talking... Can I go on and write here, now? [14:07:58] login.tools.wmflab.org probabliy [14:08:04] Bigem: yes, or you can wait for a lull [14:08:50] I'll try to write it on one go then... [14:08:52] nokib: are you copying up new files, or files that already exist in the target dir? [14:09:06] Both [14:10:37] nokib: which user are you using? your own? [14:10:47] nokibsarkar [14:11:32] I see a lot of files don't have group write permission [14:11:40] andrewbogott I mean I assigned my public key to "nokibsarkar" which I use [14:11:55] and your access is based on the group [14:12:08] nokib: can you start with a new, unique filename (like 'testputthisfile.txt') [14:12:12] akoopal am I being target? [14:12:16] and then try to put that file into each account in turn? [14:12:23] nokib: yes [14:13:11] akoopal I didn't understand. Could you please give me some resources? [14:13:31] andrewbogott Ok I am trying that. [14:14:07] nokib: just looking at the unix file permissions. [14:14:20] akoopal 0755? [14:14:37] 755 means the user can write, the group cannot [14:14:47] the user is mostly the tooluser [14:15:02] akoopal group=? [14:15:08] although I see files owned by your account [14:15:18] Bigem: try here on IRC first, write whenever you want, but wait because it may take some time for people to respond. If you don't get any answers you can try in a few hours too. In the end if you have a hard time getting answers there you can try the other communication channels, see: https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_communication [14:15:20] can you ssh to tools-login easily? [14:15:37] the mailing list cloud@ can also be another venue to write your questions to if IRC doesn't work [14:15:40] Yes [14:15:57] do an ls -l in one of the project dirs [14:16:11] and also do (as your own acount) id -a [14:16:31] akoopal: it sounds like you agree with my theory that he should be able to put /new/ filenames and that the issue is conflicts with existing files that aren't group-writeable? [14:17:05] andrewbogott: likely: but also subdir permissions might be in the way :-) [14:17:18] yep, ok — just checking :) [14:20:22] andrewbogott how can i post pictures here? [14:20:52] I cannot copy the terminal with my device. [14:20:59] also wondering in the goodarticlebot dir why some files ended up with group wikidev, the group has sticky bit [14:21:53] akoopal I am unable to understand your last statement. [14:23:00] nokib: you can probably use https://phabricator.wikimedia.org/paste/ but please be careful not to paste passwords or keys [14:23:34] nokib: in your ls you see things like: [14:23:40] -rw-r--r-- 1 nokibsarkar tools.goodarticlebot 121 Jul 1 11:33 update.sh [14:23:43] -rw-r--r-- 1 tools.goodarticlebot tools.goodarticlebot 16966 Jun 25 05:03 user-config.py [14:23:58] Yes [14:24:03] for example update.sh is owned by you [14:24:10] Some more files though [14:24:15] and has group tools.goodarticlebot [14:24:44] Ok.... [14:24:48] user-config.py is owned by the user tools.goodarticlebot and also has the group tools.goodarticlebot [14:25:10] User=nokibsarkar? [14:25:28] Or user=tools.goodarticlebot? [14:25:40] user-config.py the second [14:25:45] as you see in the ls [14:25:58] update.sh has permissions -rw-r--r-- [14:26:24] which mean you (nokibsarkar) can read and write it [14:26:38] Ok.... [14:26:39] everybody in the group can only read it [14:26:47] and everybody else also can read it [14:27:06] group=tools.goodarticlebot? [14:27:16] yes [14:27:29] Ok.... [14:27:36] so although being in the group tools.goodarticlebot your account cannot write it [14:28:05] your account=nokibsarkar? [14:28:10] yes [14:28:21] and that is how you tftp [14:28:31] ehh, sftp [14:28:44] with nokibsarkar as account [14:29:07] 0755 = 0(nokibsarkar)(tools.goodarticlebot)(others)? [14:29:21] correct [14:29:47] that will translate to -rwxr-xr-x [14:30:10] bits, r=4, w=2, x=1 [14:30:13] -rwxr-xr-x = -nokib-group-others? [14:30:43] So, I'm trying to set up a find and replace pywikibot. I tried it on PAWS, it worked perfectly. Then I switched to ToolForge for it to be able to run continuously. I downloaded Git for Windows and I generated a ssh key. My account got accepted and I clonned pywikibot. I tried my script on the terminal and it worked good too. Then I set out to put [14:30:43] it on the job grid using jstart. Even though my work got accepted, nothing was happening. I checked the .err file and I saw that it had a problem while importing pywikibot. I tried reclonning many times hoping to fix that but nothing changed. So eventually I tried deleting all my home files, hoping to start from scratch so I could fix that. I was [14:30:44] left only with "replica.my.cnf". And then something was broken (because of the missing files and it started not working at all). Now I'm stuck. I can send you what it reads, if you want... [14:31:56] Bigem i had the same problem. But I solved it using virtual environment [14:32:06] nokib: yes, order is user group other [14:32:55] nokib, oh... If only I had asked here on time then. Because now that I've deleted those files, nothing works... [14:33:35] I have torn my hairs for that😀 [14:33:47] As soon as I login in on my tool account, I get this: [14:33:50] declare -x HOME="/data/project/smallem" [14:33:51] :st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:* [14:33:51] .tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35: [14:33:52] *.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:* [14:33:52] .xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:" [14:33:54] PATH="/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games" [14:33:59] USERNAME="tools.smallem" [14:34:01] mktmpenv" [14:34:27] What's that? [14:34:46] It won't let me even to use generate_user_files [14:34:49] Environment variables? [14:34:56] I don't know... [14:35:30] Delete all the files (keeping backup) [14:35:46] rm -rf * [14:35:52] might work [14:36:39] I've tried that many times. I even redownloaded git bash from scratch and made new global username/email/keys on git... [14:36:44] akoopal why i cannot upload new files? [14:36:57] Trying to reset everything from scratch. But... [14:37:07] I'll try to delete everything one more time. :P [14:37:09] as far as I see you should be able to upload new files [14:37:21] but not always replace files [14:38:40] Nope. Still the same thing. :( [14:39:09] Bigem pip install pywikibot [14:39:20] Install pywikibot [14:39:39] Using the command: pip install pywikibot [14:39:52] But I get that oververbose text message as soon as I log in. [14:40:02] That didn't happen before. [14:40:44] smallem@tools-sgebastion-07:~$ become smallem - I write this (smallem is my tool) [14:40:47] And then I get this: [14:41:01] declare -x HOME="/data/project/smallem" [14:41:01] :st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:* [14:41:02] .tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35: [14:41:02] *.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:* [14:41:03] .xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:" [14:41:05] PATH="/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games" [14:41:10] USERNAME="tools.smallem" [14:41:12] mktmpenv" [14:41:23] remove the portion "-l" at the end of the command [14:41:41] No. [14:41:48] It's not there [14:41:59] You are already in your tool account [14:42:05] It was part of my message here sent to you. [14:42:07] If I am not wrong [14:42:08] :p [14:42:11] Yes. [14:42:21] I get that text and I log in. [14:42:32] And I can clone the pywikibot thing. [14:42:46] But I can't generate the user page [14:42:46] pip install pywikibot [14:42:53] Give this command [14:43:12] Is it installing? [14:43:33] let me try [14:43:58] -bash: pip: command not found [14:44:17] Any way I can undelete the files? :p [14:44:22] Maybe that will help. [14:44:32] Or if you can show me what are your home files named [14:44:39] Maybe they're the same. [14:45:36] I believe they should be the same because I think they're automatically generated files. [14:45:50] The 2-3 ones I deleted. [14:50:58] Bigem python3 -m venv pwb [14:51:23] source pwb/bin/activate [14:51:42] pip3 install --upgrade pip [14:51:45] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Pywikibot But I read here that this method requires you to manually update it then [14:52:04] I did that [14:52:07] Shouldn't I be using this method: Using the shared Pywikibot files (recommended setup) [14:52:08] ? [14:52:41] Or is the docpage outdated? [14:53:53] Bigem Sorry. I cannot much help you. [14:54:26] No problem man. I'm really happy you tried. :)) [14:55:44] nokib, can you just tell me what your home files are named? [14:55:52] cd [14:55:54] ls [14:56:25] pywikibot-core [14:56:37] Is a folder [14:56:44] Yes. [14:56:48] Anything else? [14:57:06] pwb for virtual environment [14:57:10] Yes [14:57:15] What else? [14:57:23] Nothing else special [14:57:23] I bet you also have this: replica.my.cnf [14:57:37] And Logs? [14:57:41] That's not very special [14:58:13] And something else with API on its name? [14:58:14] These are commons so I skipped [14:58:26] Yeah, the commons are of interest to me. [14:58:32] No, no API [14:58:34] Because that's what I'm trying to restore [14:58:41] I deleted those and [14:58:48] now it malfunctions. :P [14:59:11] No it is malfunctioning for another reason probably [14:59:23] Because I did delete them thrice. [14:59:34] Were they auto recreated? [14:59:37] rm -rf * [14:59:45] Yes, they did [14:59:54] Mine didn't [15:00:05] You cannot delete replica.my.cnf [15:00:08] Yes. [15:00:15] That's the only one that was saved. [15:00:36] Logs are nothing special [15:01:06] Please try the command: pip3 [15:01:15] Okay then, if you insist. :P [15:01:22] Is the command found or not [15:01:35] Nope. [15:01:42] Should I create the virtual.... ? [15:01:50] python3 -m pip3 [15:01:57] Try it [15:02:21] no module named pip3 [15:02:42] python3 -m pjp [15:02:48] * pip [15:03:05] no module named pip :P [15:03:14] Oh no [15:03:33] Ok just create a virtual environment(venv) [15:03:55] I named it pwb (according to manual) [15:04:05] Yes. [15:04:09] Just did too. [15:04:21] Now I should follow the instructions there too I guess eh? [15:04:33] source pwb/bin/activate [15:05:03] Yes. [15:05:10] And now I'm installing those. [15:05:39] Did that work? [15:06:30] Wait... [15:07:03] If yes then enter the command : python3 [15:07:53] Then : import pywikibot [15:07:58] I need to clone the pywikibot-core for the last installation to complete. [15:08:03] So, just a sec. [15:10:59] Okay. Installation is complete. [15:11:02] What do I do now? [15:11:26] pip3 install pywikibot [15:11:39] Did it worked? [15:11:41] (pwb) tools.smallem@tools-sgebastion-07:~/pywikibot-core$ [15:11:42] Here? [15:11:49] No [15:12:06] cd "../" [15:12:25] (pwb) tools.smallem@tools-sgebastion-07:/data/project$ [15:12:27] Here? [15:12:31] Or without the pwb? [15:12:45] cd smallem [15:13:00] (pwb) tools.smallem@tools-sgebastion-07:~$ [15:13:08] Yes [15:13:37] I guess it installed it. [15:14:01] Now do you think it should work normally? [15:14:10] Now try:python3 [15:14:22] import pywikibot [15:14:45] SystemError: Parent module 'setuptools' not loaded, cannot perform relative import [15:15:08] (pwb) tools.smallem@tools-sgebastion-07:~$ python3 [15:15:09] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/__init__.py", line 25, in [15:15:12] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/config2.py", line 48, in [15:15:14] 666, in _load_unlocked [15:15:17] import_module [15:15:19] The whole text. :P [15:16:12] pip3 install pywikibot [15:16:49] Did you gave the command? [15:17:08] (pwb) tools.smallem@tools-sgebastion-07:~$ pip3 install pywikibot [15:17:09] ./pwb/lib/python3.5/site-packages/certifi-2020.6.20-py3.5.egg (from requests>=2.20.1->pywikibot) (2020.6.20) [15:17:10] ./pwb/lib/python3.5/site-packages/idna-2.10-py3.5.egg (from requests>=2.20.1->pywikibot) (2.10) [15:17:30] I guess it is already installed whatever that is. :P [15:17:44] ok... [15:17:58] What's the last line [15:18:31] That's the whole text it showed. [15:18:34] Now try: [15:19:27] python3 pywikibot-core/generate_user_files.py [15:20:17] (pwb) tools.smallem@tools-sgebastion-07:~$ python3 pywikibot-core/generate_user_files.py [15:20:17] line 197, in _import_with_no_user_config [15:20:19] from pywikibot import config2 as config [15:20:22] File "", line 666, in _load_unlocked [15:20:24] "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module [15:20:27] And here's where I get stuck. [15:21:17] pip3 install setuptools --upgrade [15:21:38] Ugrade the setuptools [15:21:49] *upgrade [15:21:54] Requirement already up-to-date: setuptools in ./pwb/lib/python3.5/site-packages (50.0.0) [15:22:23] I've read somewhere on the net that version 50.0.0 causes problems and you usually need to downgrade to 49. [15:22:34] I don't know if that has to do with me or not though. :/ [15:22:37] Ok then do that [15:22:51] The problem is I don't know how to downgrade. XD [15:23:20] I think --version 49.0.0 [15:23:31] Just that? [15:23:32] Parameter should work [15:23:34] Let me try. [15:24:05] (pwb) tools.smallem@tools-sgebastion-07:~$ --version 49.0.0 [15:24:09] pip3 install setuptools==49.0. [15:24:21] *49.0.0 [15:24:26] Try this [15:24:38] Yes. It worked. [15:24:46] Let me try autogenerating user files again [15:25:20] Now I get another error. [15:25:41] (pwb) tools.smallem@tools-sgebastion-07:~$ python3 pywikibot-core/generate_user_files.py [15:25:42] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/bot.py", line 878, in handle_args [15:25:44] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/__init__.py", line 1249, in Site [15:25:47] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/site/__init__.py", line 1705, in __init__ [15:25:49] "/mnt/nfs/labstore-secondary-tools-project/smallem/pywikibot-core/pywikibot/site/__init__.py", line 720, in __init__ [15:27:21] ls pywikibot-core [15:27:38] Let me show where is "setup.py" [15:27:49] Then run that script [15:28:24] (pwb) tools.smallem@tools-sgebastion-07:~$ ls pywikibot-core [15:28:25] Dockerfile-dev pywikibot.egg-info user-config.py.sample [15:28:35] So, here I should try again to autogenerate those files? [15:29:09] where is setup.py? [15:30:14] In pywikibot-core? [15:30:22] I don't quite understand your question. [15:30:59] !log tools.lexeme-forms deployed ef72c06ec8 (Manbhumi adjectives and adverbs) [15:31:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [15:31:55] It may be in your pywikibot-core directory [15:32:12] Yes [15:32:14] It is. [15:32:28] run that [15:32:29] Oh! I should run that script? [15:32:33] Oh, okay. [15:32:34] Wait. [15:33:09] Any error? [15:33:20] One easier question first: [15:33:34] How exactly do I write the path towards it so I can run it? :P [15:33:53] If it is in pywikibot-core. [15:34:10] python3 pywikibot-core/setup.py [15:34:18] ah! Python3 [15:34:21] I had missed that part. [15:34:23] Just a sec. [15:34:54] my battery is getting low. [15:34:58] (pwb) tools.smallem@tools-sgebastion-07:~$ python3 pywikibot-core/setup.py [15:34:59] open(filename) as f: [15:35:06] Phone is being hungry [15:35:22] XD I understand, no problem... :P [15:35:47] Ok tell me what happened? Any error? [15:35:56] I sent you the text above. [15:36:03] (pwb) tools.smallem@tools-sgebastion-07:~$ python3 pywikibot-core/setup.py [15:36:04] open(filename) as f: [15:36:06] Here. ^ [15:43:22] I'm guessing your battery run out... I'm waiting a bit, maybe you come back. :P [15:56:48] !help [15:56:48] If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-kanban [15:57:05] Bigem: do you have a question? [15:57:42] * bd808 sees a lot of backscroll with Bigem and nokib [15:58:14] I was talking with nokib about a problem I'm having but he left and... [15:58:36] It's the first time for me using Kiwi IRC so I'm a bit confused. Please bear with me. [15:58:53] Do I need to write everything from the beginning? :/ [15:59:27] +bd808 [16:00:11] Bigem: I see many lines of chat between you and nokib. But it looks like they have left [16:00:34] Bigem: You asked for help. So the question now is how can we help. :) [16:01:14] Oh I was having some problems setting up pywikibot in Toolforge. [16:02:33] I wanted to create a find a replace pywikibot. I made it, it worked fine when I used it from the terminal but when I tried using jstart it did nothing and the .err reported an error with "importing pywiki". [16:02:55] Hoping to solve it, I deleted all my home files and now everything is ruined. :P [16:03:19] !log tools.smallem Removed bad newline from .bash_profile [16:03:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.smallem/SAL [16:03:52] My idea was to reinstall everything from the beginning but I get a strange text file as soon as I log in in my toolaccount. [16:03:54] Bigem: ^ that !log message was me fixing your smallem tool's dotfiles [16:04:28] Oh... I guess it should be fixed now? [16:04:33] Let me try reloging in. [16:04:34] there was a newline after "export" which caused all that stuff to be printed after you did `become smallem` [16:05:25] Oh, yes... [16:05:28] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Pywikibot#Setup_pywikibot_on_Toolforge_(locally) -- that page should hopefully give a working recipe for setting up pywikibot for a Toolforge tool [16:05:47] Yes. I have nearly learned that page by heart now. :P [16:06:04] I should only auto-generate my user page now and it should be fine? [16:08:15] Bigem: it looks like you have been using both the shared pywikibot clone (because of the things you added to .bash_profile) and the virtual env option. Combining the two setups may be causing some strangeness. [16:08:55] Yes, that's very true. I tried everything because I was getting desperate to make it work. [16:09:37] I was hoping to just use the pywikibot clone but when I started getting that error on my job, I started frantically trying different options. [16:10:51] I'm sorry as I don't come from a technical background. I look out for two small wiki-s (SqWiki/SqQuote) and since we don't have a lot of tech savvy users, I deal with that part. [16:11:25] My intention was to make a bot to help those projects I admin. And I did. But I couldn't make it work with the Job Grid and... [16:11:50] Bigem: its ok :) we are all learning all the time [16:12:16] How can I make it work only with the shared pywikibot clone now? Do I need to delete anything? [16:12:47] I see mentions of errors running the script on the job grid, but I'm not seeing a paste of the exact error messages you saw [16:13:34] Wait just a second... I believe I have it copied somewhere... [16:14:04] Bigem: you could clean up the $HOME/pwb and $HOME/pywikibot-core, but let's see if we can get you to a working state before we start removing things [16:14:22] File "/data/project/shared/pywikibot/stable/scripts/replace.py", line 151, in [16:15:26] that looks like one line from a longer stack trace [16:16:08] Yes.. Unfortunately I don't have the full trace. I deleted the .err page when I deleted all my files. [16:16:30] Maybe I can try running the script again now in simulate mode and see what happens? [16:16:34] I just tried `python3 /data/project/shared/pywikibot/stable/scripts/version.py` as the smallem tool. It reports that you need to setup your config files. That should be possible by running `python3 /data/project/shared/pywikibot/stable/generate_user_files.py` [16:17:06] Yes. I couldn't do that anymore after deleting those files. I should be able to do that now after your fix I believe. [16:17:08] Just a second. [16:18:37] No. Unfortunately I still can't. [16:19:00] Bigem: what error message do you get? [16:19:27] tools.smallem@tools-sgebastion-07:~$ python3 /data/project/shared/pywikibot/stable/generate_user_files.py [16:19:27] pywikibot.handle_args(args) [16:19:30] File "/mnt/nfs/labstore-secondary-tools-project/pywikibot/public_html/core_stable/pywikibot/__init__.py", line 1249, in Site [16:19:32] **new_kwargs) [16:19:34] obj(*new_args, **new_kwargs) [16:20:20] Bigem: please use a pastebin, like https://paste.toolforge.org/, to share long errors and stack traces with us [16:20:48] * bd808 recreates the error [16:21:25] Oh, I didn't know that feature existed. [16:21:28] Sorry. [16:22:20] Bigem: no worries. Just another new thing you are learning :) irc is a strange old system with a lot of conventions that have developed over time [16:23:23] I'm going to try running `python3 /data/project/shared/pywikibot/stable/generate_user_files.py` as a completely different tool just to see what happens. I can't tell yet if something is strange about your tool or if the shared pywikibot code is broken. [16:23:45] Okay. Thank you! [16:24:20] Bigem: it is not just you! [16:25:03] https://paste.toolforge.org/view/b49b59a7 -- same errors from a completely different tool [16:25:52] so, now the mystery is what is up with the pywikibot/stable code today [16:26:10] Oh... So the fact that I deleted my directory files is totally unrelated... [16:26:15] home* [16:26:36] yeah, I think you just had some unfortunate timing [16:27:03] Hah! :P [16:34:33] bd808, so, basically I should just wait now? [16:35:54] Bigem: I'm trying to figure out what is broken in the stable branch, but I probably should just go poke some folks in the #pywikibot channel to take a look [16:37:19] I see. Okay then. I'm keeping the... chat? :P (still getting used to the terminology) open. [16:39:57] Bigem: I posted the paste of it blowing up in the #pywikibot channel. Not sure when someone might have time to look into it [16:41:43] bd808: Can I ask you one more question meanwhile? [16:41:50] sure :) [16:42:27] To set up a continuous job, you basically write jstart + wrapper script name, is that right? [16:44:03] Now, about the wrapper script... This is the script I use in the terminal (without a wrapping) and it works: python3 /data/project/shared/pywikibot/stable/scripts/replace.py -ns:0 -regex -nocase -summary:Rregullime\ automatike\ të\ gabimeve\ me\ [16:44:03] "\|\s*language\s*=\s*Abkhazian\b" "|language=ab" \ [16:44:26] (It has a lot more lines than that but they're logically the same.) [16:44:58] When wrapping it now, I just copy-pastied it in a file Name.sh [16:45:17] Is that all I need to do or do I need to add something more for the wrapper script to function correctly? [16:45:57] Bigem: you will also need to add a `#!/bin/bash` line at the top to tell the system that it is a bhas shell script and also `chmod a+x Name.sh` to mark the script as executable. [16:47:47] Okay, so I write `#!/bin/bash` + the original script, I save it and then I use the command chmod to mark the script and then I use jstart + Name.sh. [16:47:56] That's it? [16:48:21] sounds right to me, yes [16:48:40] hi folks, I'm looking for +1s on https://gerrit.wikimedia.org/r/c/operations/puppet/+/622557 as it affects metricsinfra (although no change in practice, as an heads up) [16:48:47] I'll likely merge it tomorrow EU morning [16:50:05] bd808, final question: In PAWS the script runs much more faster than in ToolForge. Is that okay? Also, any way of making it run faster? (Except for a better regex syntax.) [16:50:47] godog: seems ok, but I wonder how soon the metricsinfra and your config will need to diverge again [16:51:38] bd808: my plan is not to touch the default rules but add new rules files instead [16:51:53] Bigem: is the only place you have made it run in Toolforge so far from your ssh session directly? If so I think you will find that it does run faster on the job grid. [16:51:58] godog: +1 :) [16:52:25] bd808: \o/ thank you, will merge tomorrow [16:53:27] Bigem: the "bastion" servers that folks can ssh into in Toolforge have restrictions on the ram and cpu that each user gets which are lower than the limits in a PAWS container or on the Toolforge job grid and Kubernetes clusters. [16:56:09] bd808: Ah! I see. Okay then. No big deal for me or our community. Just curios because in PAWS it searched the whole project in less than 1 hour and in ToolForge it took around 3 hours (which is still good enough). But I'm yet to try it on the job grid because I had that problem (that hopefully will get fixed after I try adding that shebang line). [16:58:14] I guess that concludes it. Thank you a lot for your explanations! You have no idea how much you've calmed my distress. It has taken a lot of intensive studying/researching for me to get to this phase because, as I said, I don't have a technical background, and to have everything ruined just when you hope to start the work was... Terrible to say the [16:58:15] least. :P [16:59:14] I'll try generating my user script tomorrow, maybe it gets fixed until then. If not, can I try and contact you here personally in the following days? [17:00:35] Bigem: I wrote up the problem you found with generate_user_files.py as a bug in Phabricator -- T261771 -- Hopefully someone on the PWB team can make time to find the root problem there and fix it [17:00:36] T261771: generate_user_files.py failing on Toolforge's /data/project/shared/pywikibot/stable - https://phabricator.wikimedia.org/T261771 [17:02:07] Bigem: The best way to ask for help is with the !help keyword rather than looking for a particular person. But yes, I should be around most weekdays between 15:00 and 00:00 UTC [17:02:59] Okay. I'll keep that in mind. Thank you again and have a good day! :)) [18:18:34] !log admin adding drives on cloudcephosd100[3-5] to ceph osd pool [18:18:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [23:01:00] !log striker Deploying test build of Striker based on {{gerrit|623075}} [23:01:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Striker/SAL