Wednesday, 2018-06-27

*** owalsh_ has quit IRC00:00
*** owalsh- has joined #openstack-infra00:00
*** owalsh has quit IRC00:01
*** owalsh- is now known as owalsh00:01
*** eharney has quit IRC00:01
corvushow's this look? https://etherpad.openstack.org/p/8gFYuAwxXf00:03
*** pahuang has quit IRC00:04
clarkbcorvus: lgtm00:05
*** heyongli has quit IRC00:07
corvusoh my, jobs are running on b8 now, but 058 hasn't finished yet.  we have a race.00:07
*** heyongli has joined #openstack-infra00:07
clarkbpy36 isn't a quick one either, my money is on b800:08
corvusyeah, zuul thinks so too00:09
corvus15m vs 4m00:09
*** slaweq has joined #openstack-infra00:11
*** dingyichen has joined #openstack-infra00:11
corvusthere goes b800:15
*** slaweq has quit IRC00:15
clarkb5f has started jobs now too00:15
*** jamesmcarthur has joined #openstack-infra00:15
*** yolanda_ has quit IRC00:16
corvusw00t00:16
corvuswoulda liked to see the bounce, but i reckon we sort of did after the reconfig00:16
corvusthis is looking good enough i don't think we're going to do a paper bag revert, so i'll send the email now00:17
*** heyongli has quit IRC00:17
*** heyongli has joined #openstack-infra00:17
*** jamesmcarthur has quit IRC00:20
*** pahuang has joined #openstack-infra00:21
openstackgerritMerged openstack-infra/zuul master: Change test prints to log.info  https://review.openstack.org/55405800:24
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: log-inventory: set inventory_file if needed  https://review.openstack.org/57823400:25
corvuslooks like even 5f finished before 058 landed00:27
*** heyongli has quit IRC00:27
corvusthe post pipeline queue is getting smaller very quickly00:27
*** heyongli has joined #openstack-infra00:28
clarkbseems to be doing its job00:28
*** john_studarus_ has joined #openstack-infra00:31
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add inventory path to the zuul.executor job variable  https://review.openstack.org/57823500:36
*** heyongli has quit IRC00:37
*** heyongli has joined #openstack-infra00:38
*** lifeless has quit IRC00:38
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add inventory_file path to the zuul.executor job variable  https://review.openstack.org/57823500:39
johnsomzuul is giving me a red box with "//api/status:"00:39
openstackgerritIan Wienand proposed openstack-infra/zuul master: Export inventory_file from zuul.executor  https://review.openstack.org/57823700:40
clarkbmordred: ^ is this fallout from your js updates?00:40
clarkbjohnsom: confirmed it happens to me too00:40
*** Shrews has quit IRC00:40
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: log-inventory: set inventory_file if needed  https://review.openstack.org/57823400:40
clarkboh ya this will be fallout from those post jobs we have been watching00:40
clarkbsince we deploy the built js webpack stuff00:41
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: log-inventory: remove inventory_file usage  https://review.openstack.org/57823800:41
clarkbthe issue is that extra / I think. https://zuul.openstack.org/api/status works00:42
clarkboh its literally GETing https://api/status00:43
johnsomgrin00:43
openstackgerritPaul Belanger proposed openstack-infra/zuul master: WIP: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823000:44
*** lifeless has joined #openstack-infra00:45
*** pcichy has quit IRC00:45
*** pcichy has joined #openstack-infra00:45
*** Shrews has joined #openstack-infra00:46
clarkbok you can build in config which I assume wedon't do for the generic builds00:46
corvusit's not supposed to require config00:46
clarkbparams['source'] = url.searchParams.get('source_url') + '/' + 'status' is another option but we don't have a source_url parameter00:46
clarkbotherwise params['source'] = zuulService.getSourceUrl('status', tenant is how it would load the url I think00:47
clarkb return `${this.baseHref}/api/${filename}` is what we shoul dreturn from getSourceUrl in a whitelabled setup like ours00:47
corvusclarkb: i think this warrants an emergency revert unless you're working on an emergency fix?00:47
clarkbcorvus: I was trying to figure out if I could fix it for emergency fix but my thoughts above are as far as I'v egotten00:48
*** heyongli has quit IRC00:48
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: log-inventory: remove inventory_file usage  https://review.openstack.org/57823800:48
clarkbI'm ok with a revert unless maybe mordred or tristanc are more capable of emergency fixing00:48
*** heyongli has joined #openstack-infra00:48
corvustristanC: ^ thoughts?00:48
*** owalsh_ has joined #openstack-infra00:49
*** Dinesh_Bhor has joined #openstack-infra00:49
clarkbthis.baseHref = getBaseHrefFromPath(window.location.pathname)00:50
*** owalsh- has joined #openstack-infra00:50
*** pcichy has quit IRC00:50
corvusyeah, that should be the thing for us00:50
*** pcichy has joined #openstack-infra00:50
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Revert "Hide queue headers for empty queues when filtering"  https://review.openstack.org/57824100:52
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Revert "Upgrade from angularjs (v1) to angular (v6)"  https://review.openstack.org/57824200:52
clarkbreturn path.split('/').slice(0, -1).join('/') + '/' is what that does00:52
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add inventory_file path to the zuul.executor job variable  https://review.openstack.org/57823500:52
clarkbI'm wondering if that only sees the path component and not the full url00:53
*** owalsh has quit IRC00:53
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Don't add implied branch matchers to project-pipeline variants  https://review.openstack.org/57788100:54
*** owalsh_ has quit IRC00:54
clarkb"The pathname property sets or returns the pathname of a URL." ya I think that is the bug00:54
*** owalsh has joined #openstack-infra00:54
clarkbor maybe we intended to do a relative get00:54
*** owalsh- has quit IRC00:55
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Revert "Upgrade from angularjs (v1) to angular (v6)"  https://review.openstack.org/57824200:55
clarkbjquery seems to want a url for getJSON00:56
clarkbI think that is the mixup here but definitely well beyond my knowledge to know for sure00:57
*** heyongli has quit IRC00:58
*** heyongli has joined #openstack-infra00:58
*** Shrews has quit IRC01:00
ianwfungi: thanks ... http://mirror.iad.rax.openstack.org/debian-security/ looks about how i'd expect finaly01:02
*** Shrews has joined #openstack-infra01:02
fungiexcellent01:03
fungiat least it shouldn't take long to populate because it just accumulates packages between stable point releases01:03
*** pcichy has quit IRC01:05
openstackgerritClark Boylan proposed openstack-infra/zuul master: Use window.location.href for the href not pathname  https://review.openstack.org/57824301:06
*** Shrews has quit IRC01:08
openstackgerritPaul Belanger proposed openstack-infra/zuul master: WIP: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823001:08
*** heyongli has quit IRC01:08
*** heyongli has joined #openstack-infra01:08
*** pcichy has joined #openstack-infra01:10
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: fix status page flickering  https://review.openstack.org/57822601:11
tristanCcorvus: +1 for a revert, moreover I think we need to squash https://review.openstack.org/57822601:12
openstackgerritPaul Belanger proposed openstack-infra/zuul master: WIP: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823001:12
tristanCalternatively, maybe we could stop puppet like we did when the first js refactor also broke the zuul.openstack.org webui?01:13
tristanCand restore the previous html files01:14
*** Shrews has joined #openstack-infra01:14
clarkbtristanC: I think the problem is it is broken for other users too so revert is most appropriate01:14
corvustristanC: i don't understand what you mean about 57822601:14
clarkbI have approved the revert and we can clean up the implementation and try again01:14
clarkbI'm going to make dinner now but will check in in a bit to see if revert has done what we need01:15
tristanCcorvus: to reproduce the issue fix by 578226, use the zuul-build-dashboard output and click status, then job, then status then jobs repeatedely. Then un focus and focus again, you'll see a multiple status call happening at once.01:17
corvustristanC: right, but are you saying we should make sure that is included when we re-do the v6 conversion?01:18
*** heyongli has quit IRC01:18
tristanCcorvus: yes since this actually also affect single tenant setup01:19
*** heyongli has joined #openstack-infra01:19
corvustristanC: i agree.  seems like we should be able to get that in the un-revert.01:20
*** pcichy has quit IRC01:20
*** yamahata has quit IRC01:22
*** jesslampe has joined #openstack-infra01:25
*** caphrim007 has joined #openstack-infra01:28
*** hongbin has joined #openstack-infra01:28
*** xinliang_ has joined #openstack-infra01:28
*** edwarnicke has left #openstack-infra01:29
*** heyongli has quit IRC01:29
*** heyongli has joined #openstack-infra01:29
*** jesslampe has quit IRC01:29
xinliang_Hi, anyone knows why the arm64 debian node fails to resize root partition?01:30
xinliang_here is the growroot log: http://paste.openstack.org/show/724345/01:30
*** caphrim007 has quit IRC01:32
*** gongysh has joined #openstack-infra01:32
xinliang_ianw, do you know what's wrong?01:33
clarkbline 7 unsupported command is what Id try to find01:34
*** caphrim007 has joined #openstack-infra01:34
fungi| >>> line 7: unsupported command01:35
*** caphrim007_ has joined #openstack-infra01:35
fungiyeah, just spotted01:35
clarkbI want to say dib provides its own sfdisk script for this01:36
ianwohhh, hrm, something happened last time we had a grow failure, what was it ...01:37
Dinesh_BhorHi All, I am trying to configure devstack multi compute node environment for functional testing on the gate for tacker: https://github.com/openstack/tacker/blob/master/.zuul.yaml01:38
ianwahh, that was the dodgy label on the partition01:38
openstackgerritMerged openstack-infra/zuul master: Revert "Upgrade from angularjs (v1) to angular (v6)"  https://review.openstack.org/57824201:38
Dinesh_BhorCan anyone help to figure out what changes are required in these existing jobs?01:38
*** ramishra has joined #openstack-infra01:38
*** heyongli has quit IRC01:39
*** heyongli has joined #openstack-infra01:39
*** caphrim007 has quit IRC01:39
*** dchen has joined #openstack-infra01:41
*** dchen has quit IRC01:41
*** dchen has joined #openstack-infra01:42
*** Shrews has quit IRC01:42
*** pahuang has quit IRC01:43
*** dingyichen has quit IRC01:43
*** Shrews has joined #openstack-infra01:44
*** heyongli has quit IRC01:49
*** heyongli has joined #openstack-infra01:49
*** pcichy has joined #openstack-infra01:50
*** gyee has quit IRC01:51
*** john_studarus_ has quit IRC01:51
*** pahuang has joined #openstack-infra01:56
*** eernst has joined #openstack-infra01:59
*** heyongli has quit IRC01:59
*** heyongli has joined #openstack-infra02:00
*** pcichy_ has joined #openstack-infra02:01
*** eernst has quit IRC02:01
ianwthe "unsupported command" appears to be -> /dev/sda1 : start         2048 size        16384 type=C12A7328-F81F-11D2-BA4B-00A0C93EC93B uuid=65D40C00-00A6-4965-9BC1-0FAC317B03D0 name=""ESP""02:02
*** pcichy has quit IRC02:04
*** pcichy has joined #openstack-infra02:05
ianwxinliang_: hrrm, so GROWPART_RESIZER=sgdisk works.  my appetite for chasing why sfdisk seemingly screws up the "type" value for gpt disks is ... low02:07
*** pcichy_ has quit IRC02:08
*** pcichy has quit IRC02:09
*** bobh has quit IRC02:10
*** heyongli has quit IRC02:10
*** heyongli has joined #openstack-infra02:10
*** slaweq has joined #openstack-infra02:11
ianwxinliang_: are you editing /usr/bin/growpart?02:12
xinliang_ianw: sorry, not understand what you said..02:12
ianwdo you have that file open in vi on 103.20.251.146?02:13
xinliang_yes, I have that file. I'm not edit that file02:13
xinliang_I set -x to that file , this is the "growpart /dev/sda 3" output: http://paste.openstack.org/show/724348/02:14
ianwsfdisk --unit=S --dump /dev/sda02:15
ianwhttp://paste.openstack.org/show/724349/02:15
ianwthose types look totally whack02:15
*** slaweq has quit IRC02:16
*** gongysh has quit IRC02:16
xinliang_ianw: I'm not modify growpart, except adding set -x02:18
ianwyeah, sfdisk can't restore it's own dump02:18
xinliang_ianw: so do you know how to fix this issue?02:19
*** heyongli has quit IRC02:20
*** heyongli has joined #openstack-infra02:20
clarkbDinesh_Bhor: do you have specific concerns or problems?02:21
ianwxinliang_: well, i have some thoughts ... let me see if we can shoe-horn a later sfdisk on there and see if it works.  that will tell us if there's a fixed bug02:23
xinliang_ianw: ok, please02:23
Dinesh_Bhorclarkb: https://review.openstack.org/#/c/578170/ This is a trial patch but looks like it is failed to create the multi-node.02:23
*** sthussey has quit IRC02:24
xinliang_ianw: so this problem maybe "'type' value for gpt disks is low", right?02:25
*** tpatil has joined #openstack-infra02:25
clarkbDinesh_Bhor: the logs show it ran three nodes but that devstack failed on the two compute hosts02:27
clarkbDinesh_Bhor: to start my recommendation is you do two nodes, controller and compute to simplify things02:28
clarkbthen you can debug a single failing devstack run on the compute02:28
*** heyongli has quit IRC02:30
clarkbDinesh_Bhor: http://logs.openstack.org/70/578170/2/check/tacker-functional-devstack-multinode/905f024/compute1/logs/devstacklog.txt.gz#_2018-06-27_01_02_40_172 is the error on the one compute host I'm assuming that is a config bug but may be a devstack issue02:30
*** heyongli has joined #openstack-infra02:31
ianwxinliang_: well it appears to put in a whole uuid thing, not a partition type?02:32
clarkbDinesh_Bhor: appears to be attempting to use legacy neutron which mustve cleaned out the mutnauq code?02:33
Dinesh_Bhorclarkb: I see that function here: http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/neutron-legacy#n44002:34
*** Shrews has quit IRC02:34
clarkbya but isnt in lib/neutron but ut does attempt to source it earlier on02:35
*** gongysh has joined #openstack-infra02:35
clarkbif I had to guess a plugin enables q-something after that check so the function isnt loaded when it tries to run it02:35
clarkbq- is definitely not enabled in localrc for that node02:37
*** psachin has joined #openstack-infra02:38
clarkbbut is enabled in localrc for the co troller which is why it is happy I expect02:38
*** heyongli has quit IRC02:40
*** Shrews has joined #openstack-infra02:41
*** heyongli has joined #openstack-infra02:41
Dinesh_Bhorclarkb: okay, Thanks for digging into it. I will check this part.02:41
*** annp has joined #openstack-infra02:50
*** heyongli has quit IRC02:51
*** heyongli has joined #openstack-infra02:51
*** heyongli has quit IRC03:01
*** heyongli has joined #openstack-infra03:01
*** tpatil has quit IRC03:04
*** noama has joined #openstack-infra03:06
ianwxinliang_: hmm, think i found the issue in the quoting ...03:07
xinliang_really, great!03:08
openstackgerritXinliang Liu proposed openstack-infra/zuul-jobs master: Use debian-security mirror  https://review.openstack.org/57825903:09
*** hongbin has quit IRC03:11
ianwPartition name: '"ESP"' ... i think this is half our bug, and half util-linux's bug for not handling the quotes03:11
*** heyongli has quit IRC03:11
*** heyongli has joined #openstack-infra03:12
*** roman_g has quit IRC03:18
prometheanfire´`'"ESP"'`´03:19
prometheanfirejust in case you needed some more03:19
*** heyongli has quit IRC03:21
*** heyongli has joined #openstack-infra03:22
openstackgerritMerged openstack-dev/pbr master: Support python-requires metadata  https://review.openstack.org/57179503:23
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add inventory_file path to the zuul.executor job variable  https://review.openstack.org/57823503:29
ianwprometheanfire: i say we call our primary partition "☃" and just screw everything up :)03:29
prometheanfireianw: sgtm03:31
prometheanfirecan you do that with gpt (unicode partition names)?03:31
*** heyongli has quit IRC03:32
prometheanfire¨03:32
*** dklyle has quit IRC03:32
ianwi'm guessing you *could*, but seeing as sfdisk can't handle a quote, i'm also guessing it would not end at all well :)03:32
*** heyongli has joined #openstack-infra03:32
prometheanfireforgot that one, but that may be an umlaut, altgr03:33
prometheanfireI always just script out parted03:33
ianwpabelanger: appreciate it if you could confirm on https://review.openstack.org/578259 which sets up debian-security03:33
*** hongbin has joined #openstack-infra03:37
ianwdamn it, of course it goes right to heart of how we call things in dib :/03:38
*** heyongli has quit IRC03:42
*** heyongli has joined #openstack-infra03:42
*** hamzy has joined #openstack-infra03:47
*** lpetrut has joined #openstack-infra03:47
*** udesale has joined #openstack-infra03:50
*** noama has quit IRC03:50
*** agopi has quit IRC03:50
*** heyongli has quit IRC03:52
*** heyongli has joined #openstack-infra03:52
*** heyongli has quit IRC04:02
*** heyongli has joined #openstack-infra04:03
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't quote names with sgdisk  https://review.openstack.org/57826504:04
*** bhavik1 has joined #openstack-infra04:05
*** gongysh has quit IRC04:06
*** larainema has quit IRC04:08
ianwxinliang_: ^ and filed https://github.com/karelzak/util-linux/issues/65604:08
*** dklyle has joined #openstack-infra04:11
*** Shrews has quit IRC04:13
*** heyongli has quit IRC04:13
*** heyongli has joined #openstack-infra04:13
*** Shrews has joined #openstack-infra04:14
*** gongysh has joined #openstack-infra04:15
*** sree_ has joined #openstack-infra04:18
*** sree_ is now known as Guest1385004:19
*** bhavik1 has quit IRC04:22
*** Bhujay has joined #openstack-infra04:22
*** dhajare has joined #openstack-infra04:23
*** heyongli has quit IRC04:23
*** heyongli has joined #openstack-infra04:23
*** hongbin has quit IRC04:24
*** pahuang has quit IRC04:24
*** Bhujay has quit IRC04:24
*** Bhujay has joined #openstack-infra04:25
*** Bhujay has quit IRC04:26
openstackgerritMerged openstack-infra/zuul master: Don't reconfigure tenant on unprotected branch pushes  https://review.openstack.org/57653804:26
openstackgerritMerged openstack-infra/zuul master: Fix branch parsing in _event_pull  https://review.openstack.org/57737104:26
*** Bhujay has joined #openstack-infra04:27
*** ykarel has joined #openstack-infra04:27
*** viks_ has joined #openstack-infra04:27
viks_hi, i'm trying to run tempest only for keystone and swift using rally. But it does not succeed. it's giving the following error: 'ERROR rally.task.context EndpointNotFound: public endpoint for image service not found'04:27
viks_also the following error:04:27
viks_ " ERROR rally NoOptionError: No option 'img_dir' in section: 'scenario'"04:27
viks_I do have only swift setup along with keystone. Not able to figure out why it is trying to check image service endpoint and related settings. Can anyone please help me out?04:27
*** lpetrut has quit IRC04:27
*** heyongli has quit IRC04:33
*** heyongli has joined #openstack-infra04:33
*** jesslampe has joined #openstack-infra04:34
*** hwoarang has quit IRC04:40
*** pahuang has joined #openstack-infra04:41
*** psachin has quit IRC04:41
*** heyongli has quit IRC04:43
*** noama has joined #openstack-infra04:44
*** heyongli has joined #openstack-infra04:44
*** dklyle has quit IRC04:52
*** Shrews has quit IRC04:53
*** heyongli has quit IRC04:54
*** heyongli has joined #openstack-infra04:54
*** Shrews has joined #openstack-infra04:55
*** dklyle has joined #openstack-infra04:57
*** gongysh has quit IRC04:59
*** Bhujay has quit IRC05:00
*** Bhujay has joined #openstack-infra05:00
*** Bhujay has quit IRC05:01
*** Bhujay has joined #openstack-infra05:02
*** Bhujay has quit IRC05:03
*** heyongli has quit IRC05:04
*** heyongli has joined #openstack-infra05:04
*** iranzo has joined #openstack-infra05:13
*** heyongli has quit IRC05:14
*** heyongli has joined #openstack-infra05:15
*** dhajare has quit IRC05:15
*** tdasilva has quit IRC05:21
*** hwoarang has joined #openstack-infra05:23
*** janki has joined #openstack-infra05:24
*** heyongli has quit IRC05:24
*** heyongli has joined #openstack-infra05:25
*** tdasilva has joined #openstack-infra05:33
*** heyongli has quit IRC05:35
*** heyongli has joined #openstack-infra05:35
*** e0ne has joined #openstack-infra05:35
*** quiquell|off is now known as quiquell|rover05:36
*** gongysh has joined #openstack-infra05:36
*** e0ne has quit IRC05:36
*** heyongli has quit IRC05:45
*** heyongli has joined #openstack-infra05:45
*** Shrews has quit IRC05:46
*** yolanda_ has joined #openstack-infra05:47
*** Shrews has joined #openstack-infra05:48
*** dhajare has joined #openstack-infra05:51
*** pahuang has quit IRC05:53
*** heyongli has quit IRC05:55
*** heyongli has joined #openstack-infra05:55
*** heyongli has quit IRC06:05
*** hwoarang has quit IRC06:06
*** yolanda__ has joined #openstack-infra06:06
*** heyongli has joined #openstack-infra06:06
*** pahuang has joined #openstack-infra06:06
*** hwoarang has joined #openstack-infra06:06
xinliang_ianw: thanks06:06
*** andreas_s has joined #openstack-infra06:08
*** yolanda_ has quit IRC06:09
AJaegerianw: ready to merge https://review.openstack.org/577045 ? Or do you wait for anything with the nodepool grafana graphs?06:09
*** bhavik1 has joined #openstack-infra06:09
AJaegerviks_: for tempest, ask on #openstack-qa, for rally there should be a channel as well...06:09
*** yolanda__ has quit IRC06:14
*** heyongli has quit IRC06:16
*** heyongli has joined #openstack-infra06:16
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: openstack: decline request for labels un-available in current pool  https://review.openstack.org/57828806:19
*** threestrands has quit IRC06:19
*** ccamacho has joined #openstack-infra06:22
*** lpetrut has joined #openstack-infra06:24
*** larainema has joined #openstack-infra06:24
*** heyongli has quit IRC06:26
*** heyongli has joined #openstack-infra06:26
*** Bhujay has joined #openstack-infra06:27
*** namnh has joined #openstack-infra06:28
*** hashar has joined #openstack-infra06:28
*** dmellado has joined #openstack-infra06:29
*** yolanda__ has joined #openstack-infra06:30
*** jcoufal has joined #openstack-infra06:32
*** jcoufal_ has joined #openstack-infra06:36
*** heyongli has quit IRC06:36
*** heyongli has joined #openstack-infra06:37
*** Bhujay has quit IRC06:38
*** jcoufal has quit IRC06:39
*** nicolasbock has joined #openstack-infra06:40
*** quiquell|rover is now known as quique|rover|afk06:42
viks_@Ajaeger ok.. thanks06:43
*** pcaruana has joined #openstack-infra06:44
*** heyongli has quit IRC06:46
*** heyongli has joined #openstack-infra06:47
*** jesslampe has quit IRC06:48
*** yolanda__ has quit IRC06:50
*** egonzalez has joined #openstack-infra06:51
*** Hal has joined #openstack-infra06:52
*** Hal is now known as Guest4497606:53
*** yolanda__ has joined #openstack-infra06:53
*** yolanda__ is now known as yolanda06:53
*** andreas_s has quit IRC06:53
*** alexchadin has joined #openstack-infra06:54
*** udesale has quit IRC06:54
*** udesale has joined #openstack-infra06:55
*** heyongli has quit IRC06:57
*** heyongli has joined #openstack-infra06:57
*** udesale has quit IRC06:59
*** udesale has joined #openstack-infra07:00
*** andreas_s has joined #openstack-infra07:01
*** pcaruana has quit IRC07:02
*** peereb has joined #openstack-infra07:03
*** slaweq has joined #openstack-infra07:03
*** dpawlik has joined #openstack-infra07:03
*** peereb has quit IRC07:04
*** peereb has joined #openstack-infra07:04
*** Guest13850 has quit IRC07:05
*** peereb has quit IRC07:05
*** peereb has joined #openstack-infra07:06
*** andreas_s has quit IRC07:07
*** heyongli has quit IRC07:07
*** heyongli has joined #openstack-infra07:07
*** tesseract has joined #openstack-infra07:07
*** quique|rover|afk is now known as quiquell|rover07:08
*** andreas_s has joined #openstack-infra07:11
*** lpetrut has quit IRC07:12
*** heyongli has quit IRC07:17
*** heyongli has joined #openstack-infra07:18
*** andreas_s has quit IRC07:18
*** rpittau has quit IRC07:19
*** andreas_s has joined #openstack-infra07:19
quiquell|roverHello07:19
quiquell|roverIs there a way to know the cloud provider for a zuul's build ?07:19
*** rpittau has joined #openstack-infra07:21
*** andreas_s has quit IRC07:21
*** jaosorior has quit IRC07:23
*** andreas_s has joined #openstack-infra07:25
AJaegerquiquell|rover: sure - check zuul-info/inventory.yaml in your logs, e.g. http://logs.openstack.org/88/578288/1/check/tox-pep8/bf27ab6/zuul-info/inventory.yaml07:25
AJaegerquiquell|rover: that one run in Rackspace ("rax") in the "rax-ord" data center07:26
quiquell|roverAJaeger: Also found t he job-output.json.gz has the nodename07:26
AJaegerquiquell|rover: yeah, it's in many places...07:26
quiquell|roverAJaeger: Thanks a lot, inventory is the place to go07:27
quiquell|roverAJaeger: I see that zuuls /builds API has node_name: null, do you know why ?07:27
*** heyongli has quit IRC07:27
*** heyongli has joined #openstack-infra07:28
*** shardy has quit IRC07:28
*** zoli is now known as zoli|wfh07:28
*** zoli|wfh is now known as zoli07:28
*** Shrews has quit IRC07:29
*** shardy has joined #openstack-infra07:31
*** Shrews has joined #openstack-infra07:31
*** florianf|afk is now known as florianf07:31
AJaegerquiquell|rover: can't help with that07:34
quiquell|roverAJaeger: We always have a primary and secondarfy ?07:35
*** alexchadin has quit IRC07:35
quiquell|roverAJaeger: Nah forget about last question07:35
AJaeger;)07:35
*** heyongli has quit IRC07:38
*** heyongli has joined #openstack-infra07:38
*** tosky has joined #openstack-infra07:40
*** amoralej|off is now known as amoralej07:42
*** andreas_s has quit IRC07:43
*** alexchadin has joined #openstack-infra07:43
yamamotobuild-openstack-sphinx-docs doesn't use tox-siblings?07:45
*** jpena|off is now known as jpena07:46
yamamotoand thus released versions from pypi are used for dependencies? (vs master)07:46
*** andreas_s has joined #openstack-infra07:47
*** heyongli has quit IRC07:48
*** heyongli has joined #openstack-infra07:48
*** rcernin has quit IRC07:51
*** e0ne has joined #openstack-infra07:51
*** andreas_s has quit IRC07:51
*** andreas_s has joined #openstack-infra07:52
*** rcernin has joined #openstack-infra07:52
*** noama has quit IRC07:53
*** andreas_s has quit IRC07:56
*** pcaruana has joined #openstack-infra07:57
*** heyongli has quit IRC07:58
*** heyongli has joined #openstack-infra07:59
*** jpich has joined #openstack-infra08:02
*** heyongli has quit IRC08:08
*** heyongli has joined #openstack-infra08:09
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't quote names with sgdisk  https://review.openstack.org/57826508:10
*** andreas_s_ has joined #openstack-infra08:15
*** ykarel is now known as ykarel|lunch08:16
*** s-shiono has quit IRC08:17
*** heyongli has quit IRC08:19
*** heyongli has joined #openstack-infra08:19
*** slaweq has quit IRC08:20
*** ykarel|lunch has quit IRC08:20
*** ykarel|lunch has joined #openstack-infra08:21
*** lpetrut has joined #openstack-infra08:21
*** andreas_s_ has quit IRC08:21
*** andreas_s has joined #openstack-infra08:22
*** dtantsur|afk is now known as dtantsur08:22
*** ccamacho has quit IRC08:27
*** ccamacho has joined #openstack-infra08:27
*** heyongli has quit IRC08:29
*** bhavik1 has quit IRC08:29
*** heyongli has joined #openstack-infra08:29
*** andreas_s has quit IRC08:30
*** andreas_s has joined #openstack-infra08:30
*** jcoufal_ has quit IRC08:32
*** andreas_s has quit IRC08:36
*** andreas_s has joined #openstack-infra08:36
*** slaweq has joined #openstack-infra08:36
*** electrofelix has joined #openstack-infra08:38
*** heyongli has quit IRC08:39
*** heyongli has joined #openstack-infra08:39
*** andreas_s has quit IRC08:40
*** andreas_s has joined #openstack-infra08:43
*** ykarel|lunch is now known as ykarel08:45
*** e0ne has quit IRC08:46
*** rcernin has quit IRC08:47
*** shardy has quit IRC08:48
openstackgerritYAMAMOTO Takashi proposed openstack-infra/irc-meetings master: Cancel Tap as a service meeting  https://review.openstack.org/57832808:49
*** heyongli has quit IRC08:49
*** roman_g has joined #openstack-infra08:50
*** heyongli has joined #openstack-infra08:50
*** derekh has joined #openstack-infra08:52
*** shardy has joined #openstack-infra08:52
*** d0ugal has quit IRC08:54
*** jamesmcarthur has joined #openstack-infra08:55
*** alexchadin has quit IRC08:59
*** heyongli has quit IRC09:00
*** jamesmcarthur has quit IRC09:00
*** heyongli has joined #openstack-infra09:00
*** gfidente has joined #openstack-infra09:03
*** gfidente has joined #openstack-infra09:03
*** dchen has quit IRC09:04
quiquell|roverWhat projects are included at codesearch ?09:08
quiquell|roverI am missing tripleo-upgrades09:09
*** heyongli has quit IRC09:10
*** heyongli has joined #openstack-infra09:10
openstackgerritOliver Walsh proposed openstack/diskimage-builder master: WIP: Add DIB element to install NVIDIA GPU drivers  https://review.openstack.org/57322309:13
quiquell|roverAhh is there09:14
*** Dinesh_Bhor has quit IRC09:14
*** ianychoi has quit IRC09:14
*** ianychoi has joined #openstack-infra09:15
*** heyongli has quit IRC09:20
*** heyongli has joined #openstack-infra09:20
*** witek has joined #openstack-infra09:25
witekhello, could someone please help me with this change https://review.openstack.org/560849 ?09:27
witekit cannot get merged for some reason09:27
witekthe gate pipeline passes passes09:27
witekand the status changes to: `Ready to Submit`09:28
*** heyongli has quit IRC09:30
*** heyongli has joined #openstack-infra09:31
*** ykarel has quit IRC09:35
*** Bhujay has joined #openstack-infra09:38
*** ykarel has joined #openstack-infra09:39
*** heyongli has quit IRC09:41
*** heyongli has joined #openstack-infra09:41
*** alexchadin has joined #openstack-infra09:43
*** threestrands has joined #openstack-infra09:45
*** threestrands has quit IRC09:46
*** threestrands has joined #openstack-infra09:47
fricklerwitek: it needs a manual rebase because it is based on an old patchset of https://review.openstack.org/#/c/563087/ (PS8, while PS9 got merged)09:51
*** heyongli has quit IRC09:51
*** heyongli has joined #openstack-infra09:51
openstackgerritMerged openstack/diskimage-builder master: Add iscsi-boot element for CentOS images  https://review.openstack.org/54270809:54
fricklerinfra-root: ^^ this issue came up multiple times now, makes me wonder whether we have something lacking in the way gerrit+zuul handle mergeability checking now09:54
frickleror maybe we just need to document this situation better09:54
*** heyongli has quit IRC10:01
*** heyongli has joined #openstack-infra10:01
*** jcoufal has joined #openstack-infra10:05
*** heyongli has quit IRC10:11
*** heyongli has joined #openstack-infra10:12
*** jaosorior has joined #openstack-infra10:18
*** heyongli has quit IRC10:22
*** heyongli has joined #openstack-infra10:22
*** zoli is now known as zoli|lunch10:29
*** pcaruana has quit IRC10:31
*** heyongli has quit IRC10:32
*** heyongli has joined #openstack-infra10:32
tojuvoneHi, I just start working with openstack/fenix after creating it. To proceed with reviews I think I should be added to fenix-core. Can somebody help on this?10:33
*** namnh has quit IRC10:40
*** e0ne has joined #openstack-infra10:41
*** heyongli has quit IRC10:42
*** heyongli has joined #openstack-infra10:42
*** shardy has quit IRC10:44
witekfrickler: thanks10:47
*** alexchadin has quit IRC10:49
*** heyongli has quit IRC10:52
*** heyongli has joined #openstack-infra10:53
*** heyongli has quit IRC11:03
*** heyongli has joined #openstack-infra11:03
*** alexchadin has joined #openstack-infra11:10
*** heyongli has quit IRC11:13
*** heyongli has joined #openstack-infra11:13
*** tpsilva has joined #openstack-infra11:14
fricklertojuvone: done11:15
*** jpena is now known as jpena|lunch11:15
*** heyongli has quit IRC11:23
*** heyongli has joined #openstack-infra11:24
*** udesale has quit IRC11:24
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Add min_avail_hdd governor for zuul-executor  https://review.openstack.org/57794811:26
*** zoli|lunch is now known as zoli11:26
*** zoli is now known as zoli|wfh11:26
*** zoli|wfh is now known as zoli11:26
*** boden has joined #openstack-infra11:29
*** e0ne has quit IRC11:29
*** dpawlik has quit IRC11:33
*** heyongli has quit IRC11:33
*** heyongli has joined #openstack-infra11:34
*** ldnunes has joined #openstack-infra11:35
*** dpawlik has joined #openstack-infra11:36
*** amoralej is now known as amoralej|lunch11:37
tojuvonefrickler, thanks11:38
*** xinliang_ has quit IRC11:38
*** e0ne has joined #openstack-infra11:42
*** heyongli has quit IRC11:44
*** heyongli has joined #openstack-infra11:44
openstackgerritMerged openstack-infra/zuul-jobs master: Use debian-security mirror  https://review.openstack.org/57825911:47
*** Shrews has quit IRC11:48
*** Shrews has joined #openstack-infra11:50
*** heyongli has quit IRC11:54
*** heyongli has joined #openstack-infra11:54
*** alexchadin has quit IRC12:02
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Add zuul.child_jobs in ansible inventory file  https://review.openstack.org/57818112:04
openstackgerritPaul Belanger proposed openstack-infra/zuul master: WIP: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823012:04
*** heyongli has quit IRC12:04
*** heyongli has joined #openstack-infra12:04
*** dtantsur is now known as dtantsur|brb12:06
*** jpena|lunch is now known as jpena12:08
*** ttx has quit IRC12:09
*** jcoufal has quit IRC12:11
*** rh-jelabarre has joined #openstack-infra12:11
*** alexchadin has joined #openstack-infra12:14
*** heyongli has quit IRC12:14
*** heyongli has joined #openstack-infra12:15
*** shardy has joined #openstack-infra12:17
*** ispp has quit IRC12:20
*** ttx has joined #openstack-infra12:22
*** heyongli has quit IRC12:25
*** heyongli has joined #openstack-infra12:25
*** ykarel has quit IRC12:25
*** rlandy has joined #openstack-infra12:29
*** trown|outtypewww is now known as trown12:30
*** kgiusti has joined #openstack-infra12:34
*** zul has joined #openstack-infra12:35
*** heyongli has quit IRC12:35
*** heyongli has joined #openstack-infra12:35
*** gongysh has quit IRC12:37
*** ykarel has joined #openstack-infra12:39
*** mriedem has joined #openstack-infra12:39
*** ykarel has quit IRC12:39
*** ykarel has joined #openstack-infra12:40
*** auristor has quit IRC12:40
*** auristor has joined #openstack-infra12:42
*** zoli is now known as zoli|afk12:42
*** zul has quit IRC12:44
*** heyongli has quit IRC12:45
*** heyongli has joined #openstack-infra12:45
*** auristor has quit IRC12:46
*** myoung|off is now known as myoung12:47
*** emerson has quit IRC12:47
*** auristor has joined #openstack-infra12:47
*** jcoufal has joined #openstack-infra12:50
*** dhajare has quit IRC12:54
*** heyongli has quit IRC12:55
*** heyongli has joined #openstack-infra12:56
*** edmondsw has joined #openstack-infra12:57
*** edmondsw has quit IRC12:57
*** edmondsw has joined #openstack-infra12:57
*** hashar is now known as idoine12:59
*** panda|off is now known as panda13:00
*** zul has joined #openstack-infra13:00
*** Shrews has quit IRC13:00
*** quiquell|rover is now known as quique|rover|lch13:01
*** dpawlik has quit IRC13:03
*** heyongli has quit IRC13:06
*** heyongli has joined #openstack-infra13:06
*** dpawlik has joined #openstack-infra13:06
*** Shrews has joined #openstack-infra13:07
*** agopi has joined #openstack-infra13:07
toskyif a job is defined for a certain repository in-tree, and I want to move its definition to project-config (in order to use a global template), should I remove the job first from the repository, or will it be merged and I can remove it later?13:09
*** dhajare has joined #openstack-infra13:10
*** shardy has quit IRC13:14
*** heyongli has quit IRC13:16
*** heyongli has joined #openstack-infra13:16
*** ykarel is now known as ykarel|afk13:17
*** amoralej|lunch is now known as amoralej13:18
*** ykarel|afk has quit IRC13:23
*** e0ne has quit IRC13:26
fungiyamamoto: i believe build-openstack-sphinx-docs doesn't use tox at all (and follows the new pti guidelines instead), so tox-siblings wouldn't do much good13:26
*** heyongli has quit IRC13:26
*** heyongli has joined #openstack-infra13:26
fungiquique|rover|lch: master branches of all non-retired repositories should be included in codesearch, so if it's not there i'd consider that a bug. i can double-check in a bit13:27
fungifrickler: zuul switched to relying on gerrit's relatively new ability to determine mergeability of a change, but gerrit uses very subtle clues in its ui for that unfortunately (compared to the heavy-handed commenting zuul used to do, since that was basically the only signalling option available to it)13:29
*** alexchadin has quit IRC13:29
fungitosky: job names are globally-unique and zuul will enforce that, so if you try to add a new job to project-config with the same name as a job in your repo, it will reject that change13:30
fungithus, needs to either be removed from your repo first or renamed somewhere13:30
toskyfungi: that means that I should define my local version of the job with a different name, for example extending the original job?13:30
toskyso that I can test while waiting for the project-config change to be merged13:30
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Remove direct tagging from manila repositories  https://review.openstack.org/57838113:31
yamamotofungi: so, if something is broken due to a problem in siblings, i need to wait for it to be released on pypi with a fix?13:32
*** zoli|afk is now known as zoli|wfh13:32
fungitosky: yes, that should work13:32
toskyfungi: thanks13:32
*** zoli|wfh is now known as zoli13:32
fungiyamamoto: it sounds like an unusual scenario to me... your documentation builds need to rely on unreleased source code from another project?13:33
yamamotofungi: sort of. for autodoc.13:34
fungiyamamoto: i believe the docs builds will still use global upper-constraints.txt so if a recent release of some dependency is broken you may want to talk to the requirements team about excluding that newer version13:34
*** alexchadin has joined #openstack-infra13:34
*** dtantsur|brb is now known as dtantsur13:35
*** quique|rover|lch is now known as quiquell|rover13:35
*** ihar has joined #openstack-infra13:35
yamamotofungi: i guess excluding a version of neutron just for sphinx warnings is not acceptable13:36
*** heyongli has quit IRC13:36
*** heyongli has joined #openstack-infra13:37
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use window.location.href for the href not pathname  https://review.openstack.org/57824313:37
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: fix status page flickering  https://review.openstack.org/57822613:37
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Revert "Revert "Upgrade from angularjs (v1) to angular (v6)""  https://review.openstack.org/57838413:37
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838513:37
*** e0ne has joined #openstack-infra13:38
fungiyamamoto: oh, so your project is importing neutron during the sphinx build?13:39
yamamotofungi: yes13:39
fungiand it's installing neutron from pypi?13:40
yamamotofungi: i think so, yes13:41
*** priteau has joined #openstack-infra13:41
yamamotofungi: it used to use tox_install but these days it's using pypi i think13:41
fungithis might be something that needs to be worked around specially. i have a feeling the pti guidelines for documentation builds didn't take into account that you might want to import unreleased source code from one project while building documentation for another project13:42
fungimordred: dhellmann: ^ an interesting case study13:43
fungiit's probably going to need its own separate job13:43
mordredfungi: I don't think it's just PTI guidelines13:43
fungiwell, the typical build-sphinx workflow13:44
dhellmannugh, I wish we could just release neutron to avoid all of this special handling13:44
fungii mean, getting rtd to do something like that would be similarly challenging13:44
mordredconceptually I'd argue that a repo's documentatoin not being able to be built without unreleased source code from another repo is a bug that should be fixed - not one that should be accomodated - and the fact that tox_install scripts were subverting our requirements process before is not a reason for us to continue supporting the broken thing13:45
fungiyeah, i'm curious to know _why_ whatever project this is needs neutron installed just do do a docs build13:46
mordredif a project depends on another project, that dependency should be expressed in a requirements file somewhere. if that dependency is not expressed or is not expressable, that is a fundamental problem13:46
mordredand I agree with dhellmann - I really wish we could just release neutron and stop this special handling13:46
dhellmannmordred : you're arguing my position w.r.t. unit tests, too. I thought you used to "like" tox-siblings, etc.13:46
fungii think the bigger challenge is that plugins/drivers are tightly coupled to the development cycle of what they're plugging into right now13:47
*** heyongli has quit IRC13:47
mordredI *do* like tox-siblings - but tox-siblings is intended to provide a mechanism for additional vetting of pre-released content13:47
mordredit should not be a primary method of expressing dependencies13:47
dhellmannyamamoto : perhaps you can start a mailing list thread about this so we can ask the neutron team to consider changing their release model?13:47
*** heyongli has joined #openstack-infra13:47
fungiso to say don't consume unreleased neutron basically means plugins and drivers get to start development for neutron rocky support when neutron starts working on stein13:47
mordredall of the things *should* work without tox-siblings being involved13:47
yamamotoit's not only about neutron. we have the same issue with os-vif.13:47
yamamoto(we have a plugin for os-vif)13:48
mordredI think those things needto consider a cycle-with-intermediary release model13:48
* fungi was using neutron as an example in this case13:48
fungiso basically neutron, horizon, et cetera should be released more like libraries because they're being treated like libraries by their plugins/drivers?13:49
mordredyes13:49
fungimakes sense13:49
mordreddhellmann: I feel like I still need to do a better job of explaining what tox-siblings is there to help with and what it's not intended to do13:50
yamamotoin case of neutron i guess neutron-lib is supposed to be an answer but an intermediate solution might be useful13:51
mordredyamamoto: yah. if neutron-lib was sufficient for the plugin cases that would be wonderful - but it seems we're not there yet, yes?13:51
dhellmannyamamoto : os-vif does regular releases, so if you're relying on unreleased features you should probably not be doing that and should be asking the os-vif owners for even more frequent releases13:53
*** dpawlik has quit IRC13:53
*** john_studarus has quit IRC13:53
fungii wonder if tagging prereleases and publishing those to pypi would be an acceptable middle-ground13:53
*** dpawlik has joined #openstack-infra13:54
mordredwhy not just actual intermediary releases though? we already have service projects that do that - and we've got version numbering that should allow it to not be too crazy, yeah? or am I missing an issue (likely)13:55
*** bobh has joined #openstack-infra13:55
fungithat also seems fine if they're on board13:56
*** heyongli has quit IRC13:57
*** heyongli has joined #openstack-infra13:57
*** shardy has joined #openstack-infra13:59
*** eharney has joined #openstack-infra14:00
openstackgerritPetr Kovar proposed openstack-infra/irc-meetings master: Turn doc team meeting into office hours  https://review.openstack.org/57839814:03
*** udesale has joined #openstack-infra14:04
*** atarakt_ has joined #openstack-infra14:05
*** Shrews has quit IRC14:06
*** heyongli has quit IRC14:07
*** heyongli has joined #openstack-infra14:08
*** Shrews has joined #openstack-infra14:08
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838514:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: fix status page flickering  https://review.openstack.org/57822614:10
fungiquiquell|rover: i see tripleo-upgrade (singular, not upgrades plural) in the project selection list for the advanced search on codesearch.openstack.org14:12
fungiwhat were you trying which wasn't working?14:12
fungia working example search: http://codesearch.openstack.org/?q=pbr&i=nope&files=setup.py&repos=tripleo-upgrade14:13
*** Shrews has quit IRC14:17
*** heyongli has quit IRC14:17
AJaegeryamamoto: build-openstack-sphinx-docs should build without siblings installed. Create doc/requirememts.txt for it14:18
*** heyongli has joined #openstack-infra14:18
fungiit sounds like the project in question needs to have autodoc do some discovery of neutron functions referenced from that project's source code14:19
fungiand so wants neutron installed14:19
AJaegeryamamoto: there're also autodoc tools that work without the imports AFAIK - mordred, stephenfin might be able to help14:20
AJaegerfungi: now read full backscroll ;/14:20
*** lpetrut has quit IRC14:22
*** shardy has quit IRC14:22
*** jamesmcarthur has joined #openstack-infra14:24
bodenhi… is it valid to use multiple “Depends-On” in a patch to pull in patches from mulitple repos during zuul jobs?14:24
clarkbboden: yes14:24
fungiboden: yes, completely fine14:24
fungilots of changes do that14:24
bodenclarkb fungi cool thx14:25
*** dhajare has quit IRC14:25
fungiboden: just beware of accidentally adding dependency loops. the more complex your change dependency tree grows, the easier it is to lose track and accidentally create a cyclic dependency. if zuul encounters a cycle anywhere in a dependent change set, it will ignore all the changes in that set until the loop is removed14:26
bodenfungi ack.. I will try to keep an eye out for that14:26
*** jamesmcarthur has quit IRC14:27
*** jamesmcarthur has joined #openstack-infra14:27
*** heyongli has quit IRC14:28
*** heyongli has joined #openstack-infra14:28
*** threestrands has quit IRC14:30
*** Shrews has joined #openstack-infra14:32
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838514:32
*** felipemonteiro has joined #openstack-infra14:33
*** felipemonteiro_ has joined #openstack-infra14:34
*** janki has quit IRC14:35
dhellmannfungi : yeah, given pip's special needs when it comes to pre-releases I would prefer to just use regular releases. otherwise we're trading one special case for another.14:37
*** felipemonteiro_ has quit IRC14:37
*** rh-jelabarre has quit IRC14:37
*** felipemonteiro_ has joined #openstack-infra14:37
*** heyongli has quit IRC14:38
*** heyongli has joined #openstack-infra14:38
*** felipemonteiro has quit IRC14:38
mordred++14:39
*** alexchadin has quit IRC14:39
fungisure, we'd basically have to put the prerelease versions in upper-constraints.txt, which should work but what would get complicated is generating that constraints list to make sure that happens14:40
flaper87hey folks, I've been seeing some failures in a job for this patch that I'm not sure whether they are our fault or whether there's something happening with the CI system.  https://review.openstack.org/#/c/574233/14:41
flaper87specifically we're seeing: tripleo-ci-centos-7-scenario009-multinode-oooq finger://ze04.openstack.org/d816f2f1cc62476b89b98fbbe1825bfa : POST_FAILURE in 2h 14m 42s (non-voting)14:41
*** Bhujay has quit IRC14:41
flaper87any idea how I can debug this? Is this our fault? have I missed some important email coming from you?14:41
*** alexchadin has joined #openstack-infra14:41
* flaper87 checks os-dev again14:41
fungia lot of the time POST_FAILURE results are actually a secondary failure, and the job itself failed but the way it failed also caused something like log collection to fail too (perhaps because some expected logs weren't created)14:43
openstackgerritMerged openstack-infra/irc-meetings master: Turn doc team meeting into office hours  https://review.openstack.org/57839814:43
flaper87fungi: mmh, in that case, can we set a hold on these nodes again? Sorry for asking for this so much lately :/14:44
flaper87fungi: 574233 tripleo-ci-centos-7-scenario009-multinode-oooq14:44
clarkbflaper87: fungi usually I like to read the logs and identify any obvious time losses14:44
clarkbas a first step. Fairly often it is something obvious like download massive image or database migrations take 15 minutes now for some reason14:45
*** evrardjp has quit IRC14:45
*** evrardjp has joined #openstack-infra14:45
flaper87These are the logs of the last run: https://paste.ee/p/qbcqv14:46
flaper87this is the log* :P14:46
*** sthussey has joined #openstack-infra14:46
corvusflaper87: here are the logs: http://logs.openstack.org/33/574233/22/experimental/tripleo-ci-centos-7-scenario009-multinode-oooq/d816f2f/14:46
flaper87corvus: oh, nice!14:47
flaper87thanks14:47
corvuslooks like the console log is missing (as expected since that's the last thing that gets uploaded), but you have that in the pastebin14:47
flaper87corvus: did you have to do something to collect them or was it as easy as building the URL yourself?14:47
flaper87corvus: https://paste.ee/p/qbcqv this should be the console log14:48
corvusflaper87: found the url.  started at: logs.openstack.org/33/574233/14:48
flaper87corvus: thanks!14:48
flaper87I'll do that first if this happens again14:48
*** heyongli has quit IRC14:48
*** heyongli has joined #openstack-infra14:49
fungiyeah, looks like ara says the run phase did indeed fail14:49
fungihttp://logs.openstack.org/33/574233/22/experimental/tripleo-ci-centos-7-scenario009-multinode-oooq/d816f2f/ara-report/14:49
*** hamzy has quit IRC14:49
corvusbut most of the post playbook ran, so it's very likely that just the console log upload failed for some reason14:49
fungitoci_quickstart.sh seems to have terminated early according to that14:50
smcginnisI'm looking at un-retiring the openstack/operations-guide. Its core group had been openstack-docs-core, but now we want core rights to be for a subset of the newly proposed operations sig.14:50
smcginnisHow does one go about requesting a new gerrit group?14:50
mriedemgerrit dead?14:50
fungismcginnis: the group will still be there14:50
corvusflaper87: does this happen a lot for this job?14:50
smcginnismriedem: Works for me.14:50
fungismcginnis: oh, changing the group... just mention the new group name in the acl and it will get created14:51
mriedemi'm getting: "The page you requested was not found, or you do not have permission to view this page."14:51
mriedemwhile saving a comment14:51
smcginnisfungi: OK, thanks. Then request to have initial members added to it?14:51
flaper87corvus: no, it just started happening on Thur / Fri last week but, tbh, I didn't have much of  a clue on how to get the logs and we tried some things before reaching out14:51
mriedemnvm, refreshed14:51
clarkbinstall the undercloud took almost half an hour, prepare for containerized deployment another 5 minutes. Deploy the overcloud another half hour, this actually failed. Tripleo collect logs then fails after 15 minutes and has a broken callback plugin. I don't think that timed out it was just slow and broken in a couple places and failed14:51
smcginnismriedem: You didn't get the memo?14:51
clarkbflaper87: corvus ^14:51
mriedemsmcginnis: that i'm out?14:51
mriedem:(14:51
smcginnismriedem: Accounting glitch has been fixed.14:52
mriedemalright, it's been fun folks14:52
* mriedem leaves14:52
flaper87clarkb: corvus thanks a bunch, now we can debug this better14:52
*** caphrim007_ has quit IRC14:52
smcginnismriedem: You don't need to leave, just move your stuff to the basement.14:52
*** hongbin has joined #openstack-infra14:52
*** quiquell|rover is now known as quiquell|off14:52
*** hamzy has joined #openstack-infra14:52
clarkbflaper87: the actual failure is the deploy overcloud failure. The collect logs being broken is why we don't have complete logs I think (though job-output.txt shouldn't be affected by that)14:52
fungismcginnis: correct14:53
*** caphrim007_ has joined #openstack-infra14:53
*** hamzy has quit IRC14:53
smcginnisfungi: Perfect, thanks.14:53
*** hemna_ has joined #openstack-infra14:54
*** hamzy has joined #openstack-infra14:54
smcginnisfungi: There's an existing osops-core that I don't think is used anymore, but would require redoing most of its membership.14:57
*** mriedem is now known as mriedem_afk14:57
smcginnisfungi: It does have rights on a different set of repos, but I think they are dormant.14:57
smcginnisfungi: Would it be better to create a new group, or take over this existing one?14:58
*** heyongli has quit IRC14:58
fungiprobably reuse that one14:59
*** heyongli has joined #openstack-infra14:59
smcginnisfungi: Would you be able to remove all but Melvin and add me? https://review.openstack.org/#/admin/groups/1076,members14:59
clarkbsmcginnis: typically we try to have the groups self manage first15:00
*** camunoz has joined #openstack-infra15:00
smcginnisclarkb: Makes sense. So I should be able to speak to Melvin to have him modify it.15:00
*** tonytan4ever has joined #openstack-infra15:00
clarkbYup15:00
*** egonzalez has quit IRC15:02
*** evrardjp has quit IRC15:02
*** evrardjp has joined #openstack-infra15:03
*** zul has quit IRC15:05
*** Parvej has joined #openstack-infra15:06
*** janki has joined #openstack-infra15:08
*** heyongli has quit IRC15:09
*** rpioso|afk is now known as rpioso15:09
*** heyongli has joined #openstack-infra15:09
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844115:15
*** lpetrut has joined #openstack-infra15:15
*** kien_ has joined #openstack-infra15:17
*** heyongli has quit IRC15:19
*** heyongli has joined #openstack-infra15:19
smcginnisApparently that repo needs an additional manual step? ^15:22
smcginnis"All projects15:22
smcginnis  referenced within a Zuul configuration must first be added to the main15:22
smcginnis  configuration file by the Zuul administrator."15:22
corvussmcginnis: luckily, you're the zuul administrator :)15:23
smcginniscorvus: Oh, nifty! :)15:23
corvussmcginnis: https://docs.openstack.org/infra/manual/creators.html#add-project-to-zuul15:23
smcginnisWhere does that need to be added?15:23
smcginnisSorry, I should have read through there.15:24
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844115:25
*** jcoufal has quit IRC15:25
corvussmcginnis: that'll need to be its own change that lands first before the rest15:27
*** alexchadin has quit IRC15:27
smcginnisOh, OK.15:27
*** heyongli has quit IRC15:29
*** heyongli has joined #openstack-infra15:30
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844115:30
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Add openstack/operations-guide to zuul  https://review.openstack.org/57844915:30
*** edmondsw has quit IRC15:33
*** peereb has quit IRC15:35
*** lpetrut has quit IRC15:38
*** lpetrut has joined #openstack-infra15:39
*** heyongli has quit IRC15:39
*** heyongli has joined #openstack-infra15:40
*** gyee has joined #openstack-infra15:42
*** dpawlik has quit IRC15:44
*** cicisong has joined #openstack-infra15:48
*** pbourke has quit IRC15:48
*** heyongli has quit IRC15:50
*** heyongli has joined #openstack-infra15:50
*** mriedem_afk is now known as mriedem15:50
*** pbourke has joined #openstack-infra15:50
*** myoung is now known as myoung|biaf15:59
openstackgerritArtem Goncharov proposed openstack-infra/nodepool master: retire shade in favor of openstacksdk  https://review.openstack.org/57282916:00
*** heyongli has quit IRC16:00
*** heyongli has joined #openstack-infra16:00
*** lpetrut has quit IRC16:02
*** andreas_s has quit IRC16:05
*** jesslampe has joined #openstack-infra16:06
*** myoung|biaf is now known as myoung16:06
*** idoine is now known as hashar16:07
*** ramishra has quit IRC16:08
*** jamesmcarthur has quit IRC16:08
*** edmondsw has joined #openstack-infra16:09
*** heyongli has quit IRC16:10
*** heyongli has joined #openstack-infra16:11
*** tobasco is now known as tobasco_afk16:12
*** e0ne has quit IRC16:13
*** atarakt_ has quit IRC16:14
*** efried is now known as efried_rollin16:17
*** gfidente has quit IRC16:20
*** lpetrut has joined #openstack-infra16:20
*** heyongli has quit IRC16:20
*** heyongli has joined #openstack-infra16:21
*** apetrich has quit IRC16:21
*** apetrich has joined #openstack-infra16:21
*** hashar is now known as hasharAway16:28
*** tosky has quit IRC16:29
*** tosky has joined #openstack-infra16:29
*** jpich has quit IRC16:29
*** florianf is now known as florianf|afk16:30
*** heyongli has quit IRC16:31
*** heyongli has joined #openstack-infra16:31
*** panda is now known as panda|bike16:33
*** udesale has quit IRC16:33
*** tesseract has quit IRC16:34
*** felipemonteiro__ has joined #openstack-infra16:36
*** dpawlik has joined #openstack-infra16:38
*** dhajare has joined #openstack-infra16:40
*** felipemonteiro_ has quit IRC16:40
*** heyongli has quit IRC16:41
*** heyongli has joined #openstack-infra16:41
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove oslo.config job settings  https://review.openstack.org/57847816:42
*** dpawlik has quit IRC16:43
*** edmondsw has quit IRC16:43
*** dpawlik has joined #openstack-infra16:44
*** edmondsw has joined #openstack-infra16:44
*** edmondsw has quit IRC16:44
*** rlandy is now known as rlandy|brb16:45
bodenhi. I’m trying to get the networking-midonet zuul v3 jobs working in https://review.openstack.org/#/c/578212/  and debugging the tempest failures seen therein.. what I see is that the neuron-dynamic-routing dependency is installed ver 12.0.1 (http://logs.openstack.org/12/578212/2/check/networking-midonet-tempest-aio-ml2/3b38f51/job-output.txt.gz#_2018-06-27_13_35_16_104997), but its supposed to be installed from master as per16:47
bodenrequired-projects… feel like I’m missing something here.. Any ideas?16:47
clarkbboden: tempest runs its own installation in a virtualenv independent of the global install16:49
bodenclarkb hmm. I wasn’t aware of that.. any ideas how I would address this issue? I’m a bit confused16:49
fungiyeah, devstack should install neuron-dynamic-routing from source, presumably, but tempest may not install it from source in its own tox env?16:49
clarkbfungi: exactly16:50
clarkbdevstack installs a cloud using the specified sources. Then it installs tempest by running tox16:50
fungiwhy is tempest installing neuron-dynamic-routing? is there a tempest plugin in there which hasn't been extracted yet?16:50
clarkbI don't know if tempest has a mechanism for installing its deps from source based on job config, probably a question for the qa team16:50
clarkbfungi: that is my guess16:50
fungithe qa team will probably say "put your tempest plugin in its own package" ;)16:51
*** derekh has quit IRC16:51
*** heyongli has quit IRC16:51
*** heyongli has joined #openstack-infra16:52
bodenfungi so this could be a direct result of midonet not having pulled their tempest “stuff” into its own repo like many others did?16:53
fungiboden: if that's the reason neuron-dynamic-routing needs to be installed in the tempest env, then i'd say yes16:54
fungiyou're basically asking to install that one package multiple times in different contexts to use different parts of it. therein lies madness16:55
fungiboden: but as clarkb pointed out, this is better hashed out in #openstack-qa16:56
dhellmannI'm starting to move the zuul job settings for oslo.config from project-config to the file in the oslo.config repo. When I submit one of those patches, how do I know zuul is using the new config to test it? https://review.openstack.org/57848116:58
clarkbdhellmann: in the logs dir zuul-infra/iventory file it will show you the job inheritance config path16:58
dhellmannexcellent, thanks16:58
clarkbdhellmann: that path should have your oslo.config in it16:58
fungiyeal, tells you the repository, branch and filename i believe16:59
*** ssbarnea[m] has joined #openstack-infra17:00
*** ssbarnea has left #openstack-infra17:00
*** kien_ has quit IRC17:00
clarkbhrm weechat just disabled smartfilters on this channel17:00
clarkboh TIL about alt + -17:01
*** heyongli has quit IRC17:01
*** zoli is now known as zoli|gone17:02
*** heyongli has joined #openstack-infra17:02
*** zoli|gone is now known as zoli17:02
*** myoung is now known as myoung|lunch17:02
*** dtantsur is now known as dtantsur|afk17:04
fungiheh17:05
fungiyou'd never used the toggle (at least intentionally)?17:06
clarkbnope just alt + =17:06
*** rlandy|brb is now known as rlandy17:07
fungioh, huh yeah i normally do alt+=17:07
fungiwhat's the difference?17:07
fungithey seem to do the same thing to me17:07
*** dhajare has quit IRC17:08
* fungi finds the default keybinding docs17:08
fungioh, = is global, - is per buffer17:09
fungihttps://weechat.org/files/doc/devel/weechat_user.en.html#key_bindings_buffers_windows17:10
fungithe other day i accidentally toggled "mouse mode" on and could no longer use my pointer to highlight and copy for pasting into another window17:11
fungithat took a bit of reading about a feature i don't want17:11
funginow it's thoroughly disabled via configuration17:11
*** Guest44976 has quit IRC17:11
clarkbfungi: I toggle that one on accidently about once every other month17:12
clarkbI've learned /mouse disable and then /save17:12
*** heyongli has quit IRC17:12
clarkbbut don't know what I do to toggle it on17:12
*** heyongli has joined #openstack-infra17:12
fungialt+m i think is how it happened17:12
*** jpena is now known as jpena|off17:12
fungibut if you don't want it, you can /set weechat.look.mouse off17:12
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove oslo.config job settings  https://review.openstack.org/57847817:13
*** trown is now known as trown|lunch17:16
*** felipemonteiro__ has quit IRC17:16
*** felipemonteiro_ has joined #openstack-infra17:16
*** efried_rollin is now known as efried17:19
*** iranzo has quit IRC17:21
*** heyongli has quit IRC17:22
*** jklare has quit IRC17:22
*** heyongli has joined #openstack-infra17:22
*** calbers has quit IRC17:23
*** eharney has quit IRC17:23
*** jklare has joined #openstack-infra17:23
*** calbers has joined #openstack-infra17:24
*** eharney has joined #openstack-infra17:27
*** amoralej is now known as amoralej|off17:29
efriedIs this the right place to get help on sphinx builds via zuul?17:31
fungiefried: it can be... what's up?17:32
*** heyongli has quit IRC17:32
*** heyongli has joined #openstack-infra17:33
*** zul has joined #openstack-infra17:33
efriedfungi: The cyborg team is getting interested in putting a seqdiag into one of their specs.  But in your typical one-step-forward-two-steps-back fashion, we've found out that their specs aren't actually *building* anywhere.17:33
efriedat least as far as I can see.17:33
efriedI thought I could make it happen with this: https://review.openstack.org/#/c/578455/17:33
efried...which works for me locally - i.e. builds HTML files from the specs as one would expect17:34
efried...but which doesn't seem to be having any effect in the zuul build: http://logs.openstack.org/55/578455/1/check/build-openstack-sphinx-docs/38f2b5d/html/specs17:34
efriedI've sorta been assuming that the zuul doc build runs the `docs` tox job, but apparently that's not the case?17:35
efried(btw, another step backward is that this isn't using the new doc build process - that's another issue I'm sure we'll have to address soon)17:36
fungibuild-openstack-sphinx-docs implements the docs pti described at https://governance.openstack.org/tc/reference/project-testing-interface.html#documentation17:36
*** jamesmcarthur has joined #openstack-infra17:37
fungiso installs doc/requirements.txt and bindep.txt contents and then runs `sphinx-build -b html doc/source doc/build`17:37
fungiit doesn't interact with tox.ini in any way17:37
efriedI see.  So in order to build specs, we would actually have to move the specs into a subdir of doc/source17:37
efried(right now they're in doc/specs)17:37
fungiand/or use a separate job17:37
efriedWhat really ought to happen is for them to move their specs into cyborg-specs17:38
efriedbut apparently they're not gonna, for now.17:38
efriedOkay, fungi, thanks for the help.  I'll go off and do more things.17:38
*** larsks has joined #openstack-infra17:40
larsksHey folks. Sometimes, when I submit a review with a closes-bug: tag, the review never gets associated with the corresponding bug in launchpad.  What can cause that? And can I do something to make the review show up on the bug report (other than just leaving a comment)?17:41
*** heyongli has quit IRC17:42
*** heyongli has joined #openstack-infra17:43
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual master: Remove system-required instructions for creators  https://review.openstack.org/57731017:43
AJaegermordred, clarkb, fungi, what do you think of the above? ^ I tried wrapping my head around this for mordred ;)17:44
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Don't add implied branch matchers to project-pipeline variants  https://review.openstack.org/57788117:44
clarkblarsks: if our LP user doesn't have bug admin (or whatever the lp term is) for that project it can't do things like close bugs irc17:44
larsksclarkb: but's not even adding the comment to the bug report.  This is specifically for https://review.openstack.org/#/c/578498/, which fixes https://bugs.launchpad.net/kolla/+bug/1778963.17:45
openstackLaunchpad bug 1778963 in kolla "The horizon container does not properly re-run maintenance tasks when configuration is modified" [Undecided,In progress]17:45
*** auristor has quit IRC17:45
larsksI've had this happen with a number of other reviews, too, for other projects.17:45
fungilarsks: also, if the commit message footer isn't present in the first patchset, it won't comment until the change merges17:45
larsksfungi: the original commit message included the closes-bug tag.17:46
larsksI'm just wondering if I'm doing something wrong to cause this...17:46
fungilarsks: is it consistent on that project?17:46
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual master: Remove system-required instructions for creators  https://review.openstack.org/57731017:46
*** electrofelix has quit IRC17:46
*** jamesmcarthur has quit IRC17:47
larsksfungi: I can't say. I haven't submitted a bug against the kolla project recently.17:47
fungilarsks: what was the corresponding review for that bug?17:47
fungii can take a look in logs17:47
larsksfungi: https://review.openstack.org/#/c/578498/17:47
fungianother (less common) cause is if the user has multiple active gerrit accounts then the update_bug hook script can't reverse-resolve their openid to a particular lp account and breaks since it's unable to reassign the bugtask17:48
fungiand yet another common cause is sometimes the lp api just chokes and doesn't do what it's asked17:49
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use wildcard to apply system-required template  https://review.openstack.org/57730717:49
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use wildcard to apply system-required template  https://review.openstack.org/57730717:50
larsksfungi: e.g., the same thing happened on https://bugs.launchpad.net/tripleo/+bug/177702317:50
openstackLaunchpad bug 1777023 in tripleo "neutron::services::lbaas runs too late, causing deploy to fail" [Medium,In progress] - Assigned to Lars Kellogg-Stedman (larsks)17:50
clarkblarsks: [2018-06-27 17:39:34,169] [HookQueue-1] INFO  com.googlesource.gerrit.plugins.hooks.HookTask : hook[patchset-created] output: Regular users can assign and unassign only themselves and their teams. Only project owners, bug supervisors, drivers and release managers can assign others.17:51
fungilarsks: in the case of kolla, the bug supervisor is the kolla-drivers lp team which does not include our account17:51
clarkbI'm not completely sure that is your change as we don't seem to log the change or bug number but the timestamp matches up17:51
fungiso our gerrit is unable to reassign bugs for kolla17:51
clarkband that causes a traceback which crashes the update17:51
larsksI see.  Is that something that one would typically report to the upstream project as something that should be fixed?17:52
AJaegerconfig-core, I updated mordred's changes to use wildcards - could you review https://review.openstack.org/577307 and https://review.openstack.org/577310 together, please?17:52
clarkblarsks: yes17:52
clarkblarsks: I believe our projects creators doc in the infra manual should cover what is required17:52
larsksAwesome, I'll take a look and poke people.  Thanks!17:52
*** heyongli has quit IRC17:53
*** heyongli has joined #openstack-infra17:53
fungibasically one of the administrators in https://launchpad.net/~kolla-drivers/+members needs to add the https://launchpad.net/~hudson-openstack user to that team17:53
clarkbAJaeger: firefox is attempting to render the diff now :017:53
clarkbthis may be a local fetch and review change17:53
AJaegerclarkb: oh yeah - sorry, should have mentioned...17:53
larsksfungi: got it.17:54
*** auristor has joined #openstack-infra17:55
corvusdhellmann, fungi, clarkb, AJaeger, mordred: regarding the plan to move-template-invocations-out-of-project-config / python3 goal -- it occurs to me that the release jobs are different.  those pipelines don't deal with branches, so zuul is going to grab all of the relevant project stanzas.  so if we go with the approach of having a "publish-to-pypi-python3" template on master and "publish-to-pypi"17:56
corvustemplate on stable, for a release, zuul is going to collect both of those templates together and run both jobs.17:56
clarkboh right refs/tags doesn't contain branch info17:57
AJaegercorvus: oh... any other jobs to tread this way?17:57
AJaegercorvus: good catch!17:57
*** larsks has left #openstack-infra17:57
clarkbI want to say it is pipeline specific17:57
corvusAJaeger: anything that runs in a release or tag pipeline17:58
AJaegeryep17:58
corvusyeah, it's pipelines that don't have branches17:58
corvusi *think* that doesn't apply to post, because we know the target branch, but i want to double check that17:58
*** lpetrut has quit IRC17:59
fungispecific to the kind of ref, yeah17:59
corvusyeah, post is okay, it uses the target branch18:00
fungitags certainly aren't guaranteed to map to one and only one branch18:00
fungiso we can't reliably guess one for them18:00
*** edmondsw has joined #openstack-infra18:01
corvusi think there's two semi-independent questions here: 1) do we want to try to do run different release jobs for different "branches"?  and 2) do we want to configure that in-repo or not?18:02
fungiinstead we probably need to have some means of signalling in the repository which python to use when building release artifacts18:02
corvusfungi: yeah, alter my question #1 to include that possibility18:02
corvusi guess what i was really trying to ask is: 1) do we want to try to run different python versions to build releases off of different branches?18:03
fungiso projects which are wanting to use python3 can have some way to tell us that in some relevant file in the master branch and the job can choose the right python based on that18:03
*** heyongli has quit IRC18:03
*** heyongli has joined #openstack-infra18:03
fungii think the "why" we want that is so that we can default to exercising python3 on as many python-based jobs as possible, while accepting that some of our stable branches may indefinitely only be able to build artifacts under python218:04
fungii.e., too-old build dependencies, python2isms in setup.py, et cetera18:05
clarkbAJaeger: the two changes lgtm18:05
*** cfriesen has joined #openstack-infra18:05
AJaegerthanks, clarkb - hope I get another review for them to avoid merge conflicts and allow smaller changes ;)18:06
fungithough an interesting feature request there is... can zuul look at configuration in the content of a tagged repository state for pipelines which act on tag refs?18:06
*** janki has quit IRC18:06
fungithat might be insane/unworkable, just brainstorming18:06
*** edmondsw has quit IRC18:06
dhellmanncorvus : I suspect we're going to need to be able to run the python2 job on older branches, but I may be over cautious there18:07
corvusfungi: theoretically it could.  it would be somewhat resource intensive.18:07
cfriesenhope this is the right place to ask...I'm trying to figure out why https://review.openstack.org/#/c/578414/ isn't merged yet.  I don't see anything useful at zuul.openstack.org but maybe I'm not doing it right.18:07
dhellmannfungi : we could also just have 1 job that reads a config file in the repo itself, right?18:07
fungidhellmann: right, that's basically what i was suggesting initially18:07
dhellmannok, I have quickly skimmed the scrollback so I missed that18:08
AJaegercfriesen: is the "depends-on" change merged?18:09
fungicfriesen: https://review.openstack.org/578414 was approved at 15:58z but declares a depends-on for a change (in another project with which it seems to not share a change queue) which didn't merge until 16:03z18:09
dhellmanncorvus , fungi : it sounds like the simplest solution is what AJaeger proposes in https://review.openstack.org/#/c/578478/2/zuul.d/projects.yaml and just keep the release jobs in project-config along with the other things that we only want to have configured one time18:10
corvusfungi: essentially the process would be: ask the mergers for the in-repo config and dynamically reconfigure with cached config from all branches removed, and the newly read config added in.18:10
dhellmannalthough that doesn't help with the per-branch versioning question18:10
fungicfriesen: you might try reapproving 578414 by adding a new workflow +1 or getting the original approver to remove and readd theirs18:10
AJaegerdhellmann: I just gave that -1 quickly based on discussion here - can change that anytime ;)18:10
dhellmannAJaeger : ok, yeah. I thought that was the right approach but now I'm not so sure.18:11
clarkbcfriesen: 2018-06-27 15:58:27,054 DEBUG zuul.Pipeline.openstack.gate: Failed to enqueue changes ahead of <Change 0x7f2a34288ac8 578414,1> seems to be the underlying issue, looking t osee if I can find more data than that18:11
*** yolanda_ has joined #openstack-infra18:11
dhellmannwhat if I add branch specifiers to the old release jobs so they will run under stable branches up through rocky and then we disable it on master and do a hard-cut over to the python3 version during stein?18:12
dhellmannoh, we don't know the branch, that's the whole point, isn't it18:12
clarkbcfriesen: https://review.openstack.org/#/c/578413 is the depends on of 578414, they don't share a gate queue between those projects so 413 had to merge before you can enqueue 414 to the gate18:12
* dhellmann spins in circles18:12
clarkbcfriesen: if you approve 414 now it should enqueu18:12
corvusdhellmann: i think keeping all unbranched jobs in project-config is viable.  it's also viable to put them in repo with the caveat that if you change it in one branch, you need to backport that change.  but you can see with that you have the same potential problem either way in that regardless, there isn't a way to have a "branched release job".18:12
fungiclarkb: i _think_ that's the message it logs when the depends-on isn't merged yet and doesn't share a queue with the current change18:12
clarkbfungi: yup18:13
cfriesenclarkb: okay...what's the "proper" way to handle this sort of thing when there are dependencies between projects?18:13
cfriesenand thanks for the help18:13
*** heyongli has quit IRC18:13
dhellmanncorvus : are there other classes of jobs that are "unbranched" like the release jobs?18:13
AJaegercfriesen: if they share a queue: You're fine. If not, approve a change with "depends-on" only once the dependend one is in.18:13
dhellmannor maybe other "instances" not classes18:13
*** heyongli has joined #openstack-infra18:14
clarkbcfriesen: if you don't want them sharing a queue then you just have to approve them after they merge in series. If you are ok with them sharing a queue like nova cinder neutron etc then you can specify a common queue name in your config18:14
fungicfriesen: if you think these projects are likely to have interdependencies, you may want to declare a shared change queue for them18:14
clarkbcfriesen: let me find an example of that18:14
*** Shrews has quit IRC18:14
*** trown|lunch is now known as trown18:14
*** yolanda has quit IRC18:14
corvusdhellmann: i think it's anything that runs in the tag or release pipeline.  post doesn't have this issue (it knows the branch).  that makes docs publishing interesting -- you can have branched docs publishing jobs in the post pipeline, but the problem appears when you run the same job/jobs in release (you lose the branch context)18:15
fungicfriesen: sharing a queue means that zuul will guarantee they're tested as if they will merge serially (which brings some additional merge delays as it has to make sure the changes ahead do in fact merge first), but for fairly tightly-coupled projects that's often what you want18:15
*** Shrews has joined #openstack-infra18:15
cfriesenfungi: makes sense18:16
corvusdhellmann, clarkb, fungi, AJaeger: note that you *can* have branch specifiers for jobs that run on tags, but they would match the *tag* -- ie, you can say "run this on 2.x, run that on 3.x"18:16
clarkbcfriesen: https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/projects.yaml#n108 the queue: integrated there is how we set up the integrated gate between nova and friends. You can set queue: startlingx or similar on your projects to have them share one18:16
clarkbcorvus: ah18:16
dhellmanncorvus : ok, so that means the release notes jobs, the doc build jobs, and the packaging jobs18:16
*** e0ne has joined #openstack-infra18:16
corvusdhellmann: sounds about right18:16
dhellmannI'm inclined to encourage teams to just backport whatever changes they need to make those jobs work, but I don't have a good idea of what is included.18:16
dhellmannand to also say those need to stay configured in project-config so that they are only in one place and we don't end up with duplication18:17
dhellmannrunning multiple versions18:17
cfriesenclarkb: thanks18:17
fungidhellmann: aside from build-deps which lack python3 support (hopefully there aren't any?) that will probably work out okay18:17
dhellmannand at *that* point I wonder how much configuration we would actually be moving out of project-config18:17
AJaegercorvus, dhellmann: we don't run docs in release - only in post - so, we should be fine. Or do we have it in release anywhere?18:18
corvusdhellmann: yeah, if the process is "fix up your project to work with py3 in all branches, then flip the switch for the project as a whole" i think keeping those in p-c for now is the best fit.18:18
dhellmannwe may end up doing a lot less work if we just move the jobs that aren't in templates18:18
dhellmannAJaeger : it runs on tag events so we get docs that include the tagged version, right? or did we change that?18:18
dhellmannI know we do release notes that way still18:18
fungidhellmann: if there are projects which need to install their dependencies to be able to generate files they're embedding in an sdist or a wheel that might be a problem, but that seems like an edge case18:18
dhellmannfungi : hmm. do we still support that anywhere?18:19
fungii hope not?18:19
dhellmannthe new python3 packaging job would not support it18:19
AJaegerdhellmann: publish-openstack-sphinx-docs does not run on tags anymore18:20
dhellmannAJaeger : ah, good18:20
dhellmannstill18:20
AJaegerdhellmann: release-notes-jobs runs on tag - perhaps we should change that for symmetry?18:20
*** Parvej has quit IRC18:20
*** yamahata has joined #openstack-infra18:20
dhellmannpart of the reason for doing all of this moving around was to make it easier to change the jobs that we're now saying we don't want to move18:20
dhellmannwhich makes me think we should just drop that whole section of the plan18:21
*** myoung|lunch is now known as myoung18:21
*** rh-jelabarre has joined #openstack-infra18:22
dhellmannAJaeger : we need the release notes job to run on tag so that when we do a final release we combine the release notes for all of the pre-release versions into the final version18:22
*** bobh has quit IRC18:22
corvusdhellmann: still move the check/gate jobs in-repo?18:23
*** bobh has joined #openstack-infra18:23
dhellmanncorvus : we could, but doing that doesn't simplify anything having to do with the underlying goal so I'm less inclined to roll all of the work together into 1 goal18:23
*** heyongli has quit IRC18:23
dhellmannthose aren't the jobs we need them to change -- we need the packaging, doc, and release notes jobs changed18:24
clarkbyour goal specifically being python3 first18:24
*** heyongli has joined #openstack-infra18:24
*** dpawlik has quit IRC18:24
dhellmannyes18:24
corvusdhellmann: ok, wasn't sure what the expected work balance was between adding py3 test jobs to branches vs the others.18:24
corvussounds like it's mostly the others18:24
dhellmannmost of the projects already have at least some python3 test jobs18:24
*** dpawlik has joined #openstack-infra18:24
clarkbI still think infra should push back on changes that can/should go in repo particularly if projects are pinging us due to blocking them (when we aren't)18:24
dhellmannI'm OK with that18:24
corvusyeah, just doesn't have to be part of the tc goal :)18:25
dhellmannI just have trouble considering it a blocker for the python3 stuff18:25
dhellmannwe could that as a separate goal, even18:25
clarkbcorvus: dhellmann yup and doesn't have to happen all at once18:25
clarkbI think it will happen relatively quickly if we advertise it as an option18:26
dhellmannI have a nifty tool to figure out which bits can move, too18:26
dhellmannhttps://review.openstack.org/#/c/578194/18:26
*** Shrews has quit IRC18:28
dhellmannso we're left with a question about how to test the changes to the jobs18:28
smcginnisIf someone other than Andreas has a moment, I would appreciate it if I could get eyes on https://review.openstack.org/#/c/578449/ to get some follow on work moving.18:28
dhellmannif I switch the release notes build with a change in project-config, I can't test that until it is approved, right?18:28
dhellmannI guess someone could add it to a patch in repo18:28
*** dpawlik has quit IRC18:28
corvusdhellmann: yep, i think that's about it18:29
*** Shrews has joined #openstack-infra18:29
dhellmannhmm18:30
dhellmannok, so I guess I will work up the directions for doing that instead of the current plan18:30
dhellmanncorvus : does zuul not look at the commit being tagged to determine the jobs it should run?18:31
dhellmannlike if I propose a patch against master, I would expect it to read the zuul settings out of the master branch18:31
dhellmannand if I tag something, I would expect it to read the settings out of the commit being tagged18:31
*** e0ne has quit IRC18:32
*** Shrews has quit IRC18:33
fungidhellmann: nope, that's basically the fanciful feature request i posted earlier18:33
corvusdhellmann: zuul does not look at the content of the commit unless it changes zuul's configuration, and even then it merges that configuration with everything else.18:33
dhellmannfungi : well no wonder I'm always so confused about how it decides what to run :-)18:33
corvusbasically, zuul's configuration is global and exists outside of the context of any given commit18:33
*** Shrews has joined #openstack-infra18:33
*** heyongli has quit IRC18:34
*** heyongli has joined #openstack-infra18:34
dhellmannok. that's a different model than I understood18:35
corvusthat's at least somewhat necessary in order to implement things like "allow project-config to specify what jobs to run on nova changes".  but as discussed with fungi earlier, that doesn't have to be the end of the story.  :)18:36
corvusso fungi's suggestion is something we can do in v3 but couldn't in v218:37
corvusbut a potential change to v3 that also could have worked in v2 would be to try to figure out what "branch" the tag is on.  the question is, what if the answer comes back both "master and stable/foo"?18:38
corvusor "none"18:38
fungiand also comes with the potential for new security risks we'd want to think through _very_ carefully18:38
dhellmannFor a lot of cases, I would actually be happy enough just having individual jobs look at their own config files in the repo.18:38
fungithough i guess assuming we expect that security controls around pushing tags are at least as tight as around approving changes and pull requests, then that's probably not representing any new risks18:39
dhellmannthat makes the jobs more complicated, and I would need to modify the python3 job, again, but I could do that and then switch all projects using the python2 job to the python3 job in project-config if the default is python2 (which would be weird for a job called python3 so I guess I would rename it)18:39
dhellmannwe could probably define 1 role that all of the relevant jobs could use18:40
dhellmannbut even doing that doesn't make moving those job settings into the project tree make sense to me if we're going to have problems in the future switching from one job to another again18:41
dhellmannI guess we would have to just keep changing each job definition to look for new parameters18:41
*** rlandy is now known as rlandy|afk18:41
dhellmann(in the configuration file)18:41
openstackgerritMerged openstack-infra/project-config master: Add openstack/operations-guide to zuul  https://review.openstack.org/57844918:42
corvusyeah, that's a reasonable-sounding solution too.  gets at the question: "is the job 'build the package' or 'build the package a certain way'?"18:43
dhellmanncorvus : I appreciate you bringing this up before we got too far down the wrong path. At the same time, I feel like that's the 2nd (or more?) time it has happened sort of accidentally. How can I get some of your time to sit down with me (virtually or otherwise) to make sure we have a good plan before we all travel to denver?18:43
dhellmannideally the conversion for oslo would be done before we start anyone else, because the oslo team has agreed to go early and test all of this18:43
corvusdhellmann: heh, i had the same feeling and was thinking we should totally sit down in denver.  i should revise my mental timetable.  :)18:44
dhellmannyeah, I need to be ready to explain all of this to other people by then18:44
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844118:44
*** heyongli has quit IRC18:44
*** tobasco_afk is now known as tobasco18:44
*** heyongli has joined #openstack-infra18:44
*** e0ne has joined #openstack-infra18:44
*** felipemonteiro_ has quit IRC18:46
corvusdhellmann: i can certainly take a few hours and really dig into the proposal as written, and maybe have a call with you so we can say lots of words at each other which will hopefully increase understanding and give ample opportunity to catch pitfalls.  but also, i think proceeding with oslo.config early and exercising it will be important.  2 weeks ago, i was thinking about this a lot, and still18:48
corvusdidn't quite connect these two dots, until today when i was working on a change zuul branch matching code.  going through the process completely (ie oslo) is probably the best way to shake things out.18:48
dhellmannso the release job runs the build-python-release role from zuul-jobs which uses the release_python variable to determine which python to use. is there some way to set that variable from another role?18:48
dhellmannok, if we think things are really likely to break I will probably pick something other than oslo.config to test with; maybe oslo.i18n since we don't see many changes there18:49
corvusdhellmann: yes you can use the set_fact task in ansible to override the variable, but note that it will only have effect within the same playbook.18:49
*** felipemonteiro_ has joined #openstack-infra18:49
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844118:49
dhellmannok, so we can define a role that reads a file from the repo and uses it to set the variable and add that role to all of the playbooks that need it18:50
dhellmannand then adding the patch to set the configuration will be somewhat self-testing18:50
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Add min_avail_hdd governor for zuul-executor  https://review.openstack.org/57794818:50
fungithat should work, yes18:51
corvusdhellmann: it might be good to have a test case which isn't... perfect :)  ie, if we can make releases from an old branch which breaks under py3....18:51
dhellmannI don't know of any projects that actually break like that. I'm just assuming that there is one.18:51
fungiwould be easy enough to adjust the setup.py in the release-test repo to break if sys.version>=3 or something18:52
corvuswe will know after denver18:52
dhellmanndoes a task know what playbook is calling it?18:52
dhellmannfungi : oh, sure, good idea18:52
dhellmannI'm thinking of how this configuration file will work. We probably want a separate setting for each job, right? so if the job or playbook name is somehow knowable then the role can use that to decide which value to read out of the file18:53
corvusdhellmann: i'm sure there's a way, but that sounds sort of like a "layer violation"18:53
dhellmannalternatively we need a *separate* variable to tell the role what to read in every place we add the role to a playbook?18:54
dhellmannor it's all or nothing18:54
fungii feel like a single switch is probably fine?18:54
*** heyongli has quit IRC18:54
corvusall or nothing doesn't sound bad?  we're basically asserting that the project can be released under py3?18:54
fungithis is mostly as a workaround for not being able to exclude some older, frozen code18:54
dhellmannand the release notes build and the docs build and ...18:54
*** heyongli has joined #openstack-infra18:55
dhellmannso they may have to create a series of patches in order to turn the switch on18:55
dhellmannbut that's not the end of the world, I suppose18:55
fungiso you know, if you can't build tarballs under python3 on stable/pike and that means we also just don't build your stable/pike docs under python3, is that a problem?18:55
dhellmannI'm thinking about how to turn the flag on in the master branch, when several otherwise unrelated code changes may be needed to make it work18:56
fungiwe should be able to assume people will have the freedom to make master work, and then flip the "it's done" switch18:56
dhellmannyeah, that works for me18:56
dhellmannone hacky thing I've done before is look at the trove classifiers in setup.cfg18:56
fungithe tricky bit is that exercising release jobs on random repos isn't easy outside of actually tagging new releases18:56
corvusbasepython= in tox.ini could be a signal too18:56
dhellmannalthough that feels potentially dangerous in this case18:56
dhellmanncorvus : there are many instances of basepython in the file, so I'm not sure which one to use18:57
dhellmannfungi : yeah, we can encourage folks to turn the flag on and ask for an alpha tag18:57
dhellmannoh, actually, there's a check packaging job now18:57
fungiright, until tox 3.1 fixes the need to have basepython in every testenv18:57
dhellmannthat's part of the new job template18:57
corvusdhellmann: i was thinking if it showed up in plain old [testenv]18:57
dhellmanncorvus : yeah. it almost never will, though, because until tox 3.1 that will break all of the other envs18:58
dhellmannpy27 would use that unless there was an override, etc.18:58
dhellmannand only some of the projects are using explicit environments for the ones tox generates by default18:58
fungithe baseputhon feature is basically buggy/misimplemented18:58
fungier, basepython18:58
dhellmannyeah18:58
dhellmannso I think a new file is going to be the simplest thing to understand18:59
corvusoh neat, didn't know that.18:59
fungiin retrospect we shouldn't have started to rely on it18:59
dhellmannI will call it .openstack.ini and it will live in the root of the repo and we can put other things in it later18:59
fungiif you're a python3-only project and only test against the default available "python3" in a given context then basepython=python3 in your [testenv] works fine18:59
corvusdhellmann: could you add it as a new thing to setup.cfg?19:00
dhellmannI guess? it's not really setup.py or pbr related.19:00
dhellmannis there an ansible module for reading values out of yaml files?19:01
corvusyeah, you can read yaml, json, ini easily19:01
fungii'd also be wary of extending setup.cfg since that's also now something setuptools can use and we're trying to maintain reasonable parity between setuptools and pbr config section and option names in there19:01
dhellmannI know there's one for ini19:01
fungicould we stick a shebang in setup.py?19:02
fungiand then parse it19:02
dhellmannwhat's wrong with a new file that is clearly for our job settings?19:02
dhellmannmaybe .openstack-jobs.ini19:03
funginothing particularly, i suppose other than metafile fatigue19:03
fungiwe already put in confgs for setuptools/pbr, zuul, coverage, tox... what's one more?19:04
fungigit-review19:04
dhellmannhmm, there's an ini "plugin" but I don't see a module for reading from a file like that19:04
corvusit makes how you build an openstack project more openstack specific19:04
*** heyongli has quit IRC19:04
*** heyongli has joined #openstack-infra19:05
corvusto be fair, the alternative is "you just know to use python3" which isn't great19:05
dhellmann*ideally* it doesn't matter19:05
dhellmanncan I set variables in the zuul configuration files somehow?19:06
corvusi'm not too worried about this one.  i think the thing i'm most apprehensive about is if .openstack-jobs.ini becomes a thing that has more than just this setting.19:06
fungithat's sort of been my argument against some of the pti changes to stop building docs and sdists/wheels in tox is we've traded "here's a wrapper which does the special setup you're going to need" for "you need to do special things and they're documented over here"19:06
dhellmannthere's already a disconnect between what's in the repo and how to build it. Knowing the incantation of sphinx, for example.19:07
dhellmannright, exactly, fungi19:07
corvusdhellmann: yes, you can set "vars" on jobs, but that likely has the same branch context problems as changing the jobs themselves19:07
dhellmannah, yeah19:07
dhellmannof course19:07
funginot to bikeshed too hard on this, but maybe if the filename made it clear this was a single-purpose, transitional flag file?19:08
dhellmannlike at the end of the cycle we switch the jobs to use python3 by default and then ignore the file?19:08
fungiyou wouldn't even need a parser then, just test for the existence of .run-my-jobs-with-python3 (name to be chosen by someone better at this)19:09
dhellmannso maybe .python3-first.ini19:09
dhellmannah, yeah19:09
*** hasharAway is now known as hashar19:09
openstackgerritDean Troyer proposed openstack-infra/project-config master: Put StarlingX projects into a common gate queue  https://review.openstack.org/57853219:10
corvusi have to go forage for food now19:12
fungiand that way, once the job is obsolete, let projects know they're free to delete it at their convenience19:12
dhellmannyeah19:12
fungier, once the file is obsolete19:12
fungiwhich of course will result in somebody with a qq.com or 163.com e-mail address proposing deletion patches to 800 repositories19:13
fungibut whatever. cleanup like that is always going to involve mass changes19:13
dhellmannok, I'll spend a little time figuring out what changes are needed in the relevant jobs19:14
*** heyongli has quit IRC19:15
dhellmannI'll want to rename the job and the project-template, so that means duplicating some stuff until I can replace the use of the old name with the new one, I suppose19:15
*** heyongli has joined #openstack-infra19:15
dtroyerIs https://review.openstack.org/#/c/572793/ (creating git.starlingx.io) lacking something to move forward?  Possibly policy and not technical?19:15
fungior reviewer bandwidth19:17
dhellmanncorvus , fungi , clarkb : I have moved the goal description to https://etherpad.openstack.org/p/goal-python3-first so it will be easier to collaborate on changes to the process19:17
fungidtroyer: oh, i think it's also delayed waiting for someone to get an ssl cert issued19:18
dtroyerah, ok.  thanks19:19
*** Shrews has quit IRC19:21
fungiclarkb: not to heap yet one more cert purchase on you, but 572793 needs one19:22
clarkbya19:22
clarkbwill need to figure out the verification for that one too19:23
* clarkb checks whois19:23
clarkbsimiarly lacking whois contact info, will have to do dns based verification too19:23
*** heyongli has quit IRC19:25
*** heyongli has joined #openstack-infra19:25
*** Shrews has joined #openstack-infra19:26
clarkbdtroyer: fungi: I'll do that after lunch today, get hiera updated and approve the change19:27
fungithanks clarkb!19:28
clarkbdtroyer: fungi is there an update to project-config queued too to set the cgit-alias data?19:30
AJaegerclarkb: https://review.openstack.org/57280119:30
AJaegerclarkb: so, yes19:30
fungiexcellent19:30
fungithanks AJaeger!19:30
AJaegerdtroyer: a "needed-by" would have been nice to find that directly19:30
auristoras a result of the EU's GDPR whois is now useless19:31
fungiyep, we've noticed19:31
fungior at least increasingly useless19:31
fungiwhois for some of my .com/.net domains still have all my contact info, as does a domain i have in .is19:32
fungibut my .org domains are all now devoid of useful contact info19:32
auristorit depends on the registrar but if the registrar does business with EU persons it has little choice but to hide the data19:33
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use wildcard to apply system-required template  https://review.openstack.org/57730719:33
AJaegerclarkb: had to move the regex to the top for alphabetical order, could you review again, please? ^19:34
fungimy registrar is dyndns, now owned by oracle. i'm sure they do business with the eu, but some registrars are only filtering contact info for registrants with eu addresses19:34
clarkbauristor: my understadning is that they only have to remove it if requested19:34
clarkbauristor: and explain what the data is used for otherwise19:34
*** rh-jelabarre has quit IRC19:34
fungialso, yes, a lot of the registries within the eu are still publishing direct e-mail contact info for domains under their tlds and just removing them when requested by the registrant19:34
dhellmannfungi : regarding deleting that file, we basically can't until stable/rocky is closed. So, effectively never.19:35
dhellmannor at least far enough in the future that I don't expect to be around to remember to do it19:35
*** heyongli has quit IRC19:35
fungidhellmann: well, we can... keep in mind that the extended maintenance guidelines require those branches to keep up with changes in testing19:35
*** heyongli has joined #openstack-infra19:36
dhellmannso you're saying that we have to make all the old branches work under python 3 for packaging, docs, and release notes?19:36
dhellmannthat was not my plan.19:36
fungiwe could still set a deadline and if they don't fix the branches before then those jobs will stop being useful for them19:36
dhellmannI don't want to prevent releases from those older branches as a result of this transition.19:36
fungithe deadline could be when we retire xenial images, for example19:36
dhellmannwhen is that likely to be?19:37
fungiwe agreed we weren't going to keep tagging releases on em branches19:37
fungi(or so i thought?)19:37
dhellmannthey aren't "em" yet though19:37
fungisure, they reach em at the old "eol" date19:37
fungii assumed the transitional period to keep those files around was going to be on the order of 18-24 months19:38
dhellmannok, I was thinking end of cycle19:38
dhellmannso different expectations19:38
dhellmann18-24 months seems ok19:38
dhellmannI anticipate still being present to remember to do something then :-)19:38
*** jamesmcarthur has joined #openstack-infra19:38
fungibut you don't need to be. just put a #TODO comment in with the obsolescence date19:39
openstackgerritboden proposed openstack-infra/project-config master: increase timeout on neutron-lib periodic for vmware-nsx  https://review.openstack.org/57853919:40
fungican be the content of those flag files even... #TODO this file is scheduled to be obsolete after 2020-07-01, but check that <foo> is set to <bar> in <baz xyzzy quux> before removing19:40
dtroyerclarkb: thanks19:41
dtroyerAJaeger: roger that, thanks19:41
clarkbfungi: dtroyer the best part is I already filed an expense report for last weeks certs :P19:41
dhellmannfungi : oh, sure, good point19:41
clarkbthat will learn me19:41
AJaegerboden: could you rebase https://review.openstack.org/575399 , please?19:42
fungiclarkb: you filed that fast!19:42
fungii'll add the cname in dns19:43
fungior did you want to do that while you're in there adding the ca temporary record?19:43
fungiit'll be the same zone either way19:43
clarkbfungi: ya I can do both updates19:43
clarkbdon't need dns until that change has certs and is approved anyway19:43
clarkbfungi: I've found filing them right away is the best way to remember to file them :)19:44
*** Shrews has quit IRC19:44
fungii set a reminder on my calendar to file them during a normally free hour on the friday before payday19:45
*** heyongli has quit IRC19:45
*** heyongli has joined #openstack-infra19:46
fungisince it's less work for me to batch up the last two weeks' expenses19:46
*** jamesmcarthur has quit IRC19:46
clarkbI think I need to update certcheck to check airship and starlingx git certs too19:47
openstackgerritboden proposed openstack-infra/project-config master: remove lower constraints to vmware-nsx gate pipeline  https://review.openstack.org/57539919:47
fungioh, yep19:47
*** edmondsw has joined #openstack-infra19:50
*** Shrews has joined #openstack-infra19:53
*** jamesmcarthur has joined #openstack-infra19:54
*** edmondsw has quit IRC19:54
*** heyongli has quit IRC19:56
*** heyongli has joined #openstack-infra19:56
*** jamesmcarthur has quit IRC20:01
dhellmanncorvus , fungi , clarkb : I believe I have a complete new draft in https://etherpad.openstack.org/p/goal-python3-first when you have time to look it over20:02
dhellmannI left some of the old content there struck out to make the changes clearer20:02
*** jamesmcarthur has joined #openstack-infra20:03
*** heyongli has quit IRC20:06
*** heyongli has joined #openstack-infra20:06
*** eharney has quit IRC20:13
*** Hal has joined #openstack-infra20:14
*** tpsilva has quit IRC20:14
*** Hal is now known as Guest8066120:14
*** ihar has quit IRC20:16
*** heyongli has quit IRC20:16
*** heyongli has joined #openstack-infra20:17
*** boden has quit IRC20:17
*** dpawlik has joined #openstack-infra20:22
*** heyongli has quit IRC20:26
*** heyongli has joined #openstack-infra20:27
*** zul has quit IRC20:27
*** boden has joined #openstack-infra20:29
*** Guest80661 has quit IRC20:29
*** heyongli has quit IRC20:37
*** heyongli has joined #openstack-infra20:37
clarkbdtroyer: fungi just waiting on cert signing verification now20:38
clarkbI'm taking the hieradata lock20:40
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844120:40
*** jesslampe has quit IRC20:40
*** kgiusti has left #openstack-infra20:40
*** e0ne has quit IRC20:42
clarkbthe biggest downside to dns record verification so far is that you have no way to trigger the poll20:42
clarkbso you sit around waiting and hoping you copy pastad the record details properly20:43
*** jamesmcarthur has quit IRC20:43
*** yolanda_ has quit IRC20:43
*** yolanda_ has joined #openstack-infra20:44
*** heyongli has quit IRC20:47
*** heyongli has joined #openstack-infra20:47
*** jamesmcarthur has joined #openstack-infra20:49
openstackgerritColleen Murphy proposed openstack-infra/puppet-nodepool master: Update libxslt package name for Xenial  https://review.openstack.org/57751920:49
fungiyet one more thing where working with computers involves sitting around and waiting20:52
*** yolanda has joined #openstack-infra20:53
*** jamesmcarthur has quit IRC20:53
clarkbalright hiera lock released20:54
*** yolanda_ has quit IRC20:55
clarkbI've approved the puppet change20:55
*** trown is now known as trown|outtypewww20:55
*** camunoz has quit IRC20:56
clarkbDNS updated too20:57
*** boden has quit IRC20:57
*** heyongli has quit IRC20:57
lbragstado/ i went to push a trivial fix to openstack/python-keystoneclient-kerberos (which is apparently read-only), i assume we won't be able to do something like this? http://paste.openstack.org/show/724453/20:58
*** heyongli has joined #openstack-infra20:58
lbragstadit looks read-only because it's technically retired since keystoneauth1 took responsibility of the functionality20:58
*** yolanda_ has joined #openstack-infra20:59
johnsomIs there a link I can grab the latest nodepool xenial image? I want to use the exact image the gates are using in tracking down this nested virt kvm bug.20:59
johnsomI tried hunting for a link last night, but didn't find one.21:00
openstackgerritClark Boylan proposed openstack-infra/system-config master: Update certcheck to include new domains  https://review.openstack.org/57855621:00
clarkbjohnsom: https://nl01.openstack.org/images and https://nl02.openstack.org/images21:01
johnsomAwesome, thank you.21:01
clarkbjohnsom: we have distributed builders now so any given image will be on one of them21:01
clarkblbragstad: if it has been retired you'll have to unretire it21:02
fungiin the future the dashboard will hopefully be able to link to them too21:02
*** dpawlik has quit IRC21:02
fungi(nodepool images)21:02
lbragstadclarkb: ah - not a huge deal, just something i noticed when i stumbled across it21:02
*** dpawlik has joined #openstack-infra21:02
*** yolanda has quit IRC21:02
johnsomclarkb https times out and http gives a /images not found21:03
*** jtomasek has quit IRC21:03
clarkbjohnsom: oh sorry nb01 and nb0221:03
fungilbragstad: worth noting. proper retirement would remove all content except a readme21:03
clarkbNodepoolBuilder not NodepoolLauncher21:03
*** boden has joined #openstack-infra21:03
johnsomBingo, thanks21:04
lbragstadfungi: yeah - it looks like it was retired properly, but i noticed a bad link/reference in the readme :) http://paste.openstack.org/show/724453/21:04
*** zul has joined #openstack-infra21:05
clarkbjohnsom: the images use glean which will look for config drive data and configure root's ssh key. Or you can just modify the image slgihtly before you boot it21:05
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Match tag items against containing branches  https://review.openstack.org/57855721:06
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci master: Update Gemfile for Zuulv3  https://review.openstack.org/57752121:07
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci master: Add beaker tests for nodepool  https://review.openstack.org/57752221:07
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci master: Add beaker-rspec bindep dependencies  https://review.openstack.org/57855921:07
johnsomclarkb roger21:07
*** Hal has joined #openstack-infra21:07
fungilbragstad: ahh. yeah probably not worth the trouble to fix. we can assume the reader will have some common sense ;)21:07
lbragstad++ works for me21:07
*** heyongli has quit IRC21:07
*** Hal is now known as Guest6045721:07
dpawlikjohnsom: im here21:08
*** heyongli has joined #openstack-infra21:08
*** priteau has quit IRC21:10
*** zul has quit IRC21:12
openstackgerritClark Boylan proposed openstack-infra/project-config master: Add kata runtime and tests repos to zuul  https://review.openstack.org/57856221:14
openstackgerritClark Boylan proposed openstack-infra/project-config master: Add ubuntu job to new kata repos in zuul  https://review.openstack.org/57856321:14
*** ldnunes has quit IRC21:15
*** heyongli has quit IRC21:18
*** heyongli has joined #openstack-infra21:18
*** boden has quit IRC21:20
mriedemwhat does "ready to submit" mean? https://review.openstack.org/#/c/569149/21:25
mriedemi'm not sure what's holding that up21:26
clarkbmriedem: it means the votes are all in a state that allows submitting21:26
*** Guest60457 has quit IRC21:26
clarkb+2 verified +2 code review +1 workflow21:26
clarkbnot immediately sure why zuul didn't submit and merge it21:27
clarkbmriedem: the parent commit is for an older patchset so needs a rebase21:28
mriedemdone, thanks21:28
clarkbmriedem: since old patchsets can never merge (and in this case current patchset did merge) you can't merge it with that parent21:28
*** heyongli has quit IRC21:28
ianwcan anyone get to https://cn1.linaro.cloud:35357 ?21:28
*** heyongli has joined #openstack-infra21:28
clarkbianw: initial testing from here is no21:28
ianwyeah i think it's more than flaky network and actually gone away :/21:29
cmurphyo.0 are you expecting access to the admin interface?21:29
ianwcmurphy: just any sort of connection21:29
clarkbport 5000 also not talking21:30
ianwbut no, it should just be the keystone endpoint21:30
openstackgerritMerged openstack-infra/system-config master: Add git.starlingx.io  https://review.openstack.org/57279321:30
clarkband 44321:30
fungichina offline21:30
fungiback later21:30
ianwgema: ^ i will file something.  we still have a couple of active hosts though21:31
clarkbbah I think the starlingx change merged 20 seconds after the git update for systemconf was completed21:31
fungi:(21:32
funginext pulse21:32
*** jtomasek has joined #openstack-infra21:36
openstackgerritMerged openstack-infra/zuul master: executor: add inventory_file path to the zuul.executor job variable  https://review.openstack.org/57823521:37
*** felipemonteiro_ has quit IRC21:38
*** heyongli has quit IRC21:38
*** edmondsw has joined #openstack-infra21:38
*** heyongli has joined #openstack-infra21:39
openstackgerritMerged openstack-infra/zuul master: Add pause function to executor  https://review.openstack.org/57782721:40
*** myoung is now known as myoung|pto21:41
*** hashar has quit IRC21:42
*** agopi has quit IRC21:43
*** edmondsw has quit IRC21:43
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Match tag items against containing branches  https://review.openstack.org/57855721:45
*** tonytan4ever_brb has joined #openstack-infra21:45
*** tonytan4ever has quit IRC21:45
*** heyongli has quit IRC21:48
*** heyongli has joined #openstack-infra21:49
*** rcernin has joined #openstack-infra21:50
*** mriedem has quit IRC21:51
smcginnisMy next step patch for getting the operations guide docs going - https://review.openstack.org/#/c/578441/21:52
smcginnisNot time critical, but I do like to keep the momentum going. ;)21:52
clarkbI think we should try to get AJaeger/mordreds change in that conflicts with that first21:53
clarkbthen we can all rebase our changes21:54
clarkb(otherwise ajaeger/mordreds change will never merge)21:54
clarkboh maybe it i s already in /me checks21:54
clarkbhrm no, why isn't it in the conflicts with list anymore21:55
clarkbconfig-core https://review.openstack.org/#/c/577307/ is the change I am talking about above. It greatly simplifies our project-config zuul projects configuration btu is going to conflict with many things, smcginnis and I both have changes up that conflict with it I think21:56
clarkbwould probably be good if get another set of eyes on that and merge it21:56
smcginnisOh right, I looked at that one earlier.21:57
smcginnisAnd like last time it is locking up my browser. :/21:57
clarkbI had to fetch it locally and git diff in a terminal21:58
smcginnisSo looks like it doesn't conflict in code, but would conflict in intent since at least mine adds system-required which will either need to be removed with this patch if it comes second, or be cleaned up later.21:59
*** heyongli has quit IRC21:59
smcginnisI agree, good to get this through first.21:59
*** heyongli has joined #openstack-infra21:59
clarkbya I've got one up that will need to be rebased too, probably best to just rip the bandaid off :)21:59
dtroyerclarkb: no worries on timing, it took me this long to follow-up.  is systemconf on a periodic cycle?21:59
*** bobh has quit IRC22:00
smcginnisChange in mine prepped pending that one merging.22:00
clarkbdtroyer: yup it runs every 15 minutes (so is starting right now), but takes about 25 minutes to complete an update so really its every 30 minute sor so22:00
*** eharney has joined #openstack-infra22:02
ianwclarkb: looks ok to me ... but also don't feel like i know every possible thing that might go wrong with it either.  as you say, probably easiest to just try it and see22:03
clarkbianw: zuul should mostly check the syntax is correct22:04
clarkbI think its mostly safe to do22:04
clarkbdtroyer: https://git.starlingx.io/cgit is a thing now. Going to approve the project-config update to add projects to that alias now22:05
ianwyeah, i'm just a bit shy on "changes that touch basically every project" :)22:06
clarkbmnaser: as an FYI I am going to approve https://review.openstack.org/#/c/572801/1 which has a -1 from you bceause git.starlingx.io is a thing now22:07
smcginnisIt does get rid of quite a few lines from the file, which is kind of nice.22:08
clarkbsmcginnis: ya and simplifies setup for new projects too22:08
smcginnisThe department of redundancy reduction department would approve.22:08
openstackgerritMerged openstack-infra/zuul master: Add min_avail_hdd governor for zuul-executor  https://review.openstack.org/57794822:09
efriedfungi: https://governance.openstack.org/tc/reference/project-testing-interface.html#documentation <== this says the command for doc build is22:09
efriedsphinx-build -b html doc/source doc/build22:09
efriedbut is it in fact22:09
efriedsphinx-build -b html doc/source doc/build/html22:09
efried?22:09
*** heyongli has quit IRC22:09
*** heyongli has joined #openstack-infra22:09
smcginnisIt is build, but the chosen default build type is html.22:09
efriedsmcginnis: afaict this is causing built docs to go to doc/build/foo instead of doc/build/html/foo as I would have expected.22:10
smcginnisefried: So you could potentially have other build types under doc/build22:10
smcginnisefried: Hmm, that may be an issue with something in your conf.py.22:10
smcginnisefried: Which repo?22:10
efriedcyborg, but...22:11
efriedI'm trying to fix them up so their specs actually build.22:11
efriedso there's not actually an example out in the world yet.22:11
efriedunless you can tell something from http://logs.openstack.org/55/578455/2/check/build-openstack-sphinx-docs/aac4229/job-output.txt.gz -- I can't, looks like the commands themselves are suppressed.22:11
corvusclarkb: i reckon you can +W 577307; i would but i'm about to afk for a bit22:11
smcginnisefried: Is it cyborg, or cyborg-specs?22:11
efriedsmcginnis: cyborg (which is another story)22:12
clarkbcorvus: thanks, will get it22:12
*** Shrews has quit IRC22:12
clarkbhere goes22:12
efriedsmcginnis: We agree their specs should go in cyborg-specs, but they're keeping them in cyborg at least for the time being.  (So yeah, all of this is going to have to be redone for cyborg-specs probably in Stein, plus redirects galore...)22:12
smcginnisefried: Hmm, I don't think it should make a difference, but I see they are using oslosphinx instead of openstackdocstheme.22:13
efriedsmcginnis: I checked on that in nova-specs and nova, and those are the same22:13
efriedoh, no, nova is openstackdocstheme22:13
smcginnisefried: Oh, actually, I think you may be right on the output path needing to be doc/source/html.22:14
smcginnisefried: Just double checked the cinder docs job definition and it is specifying the html path.22:14
efriedsmcginnis: Okay, I'll make that change in the tox.ini (which is where I found it).  I think it's correct in the actual job, just the doc that's wrong.22:15
*** rlandy|afk is now known as rlandy22:15
efriedsmcginnis: If you can tell me where that doc lives, I can propose the edit22:16
fungipropose an update to the pti and let's see if it flies22:16
openstackgerritMerged openstack-infra/zuul master: Improve logging of GithubTriggerEvents  https://review.openstack.org/57501422:16
fungiefried: governance reference subdir22:16
smcginnisefried: Looks like there's a different issue there - http://logs.openstack.org/55/578455/2/check/build-openstack-sphinx-docs/aac4229/job-output.txt.gz#_2018-06-27_19_30_28_32750322:16
efriedsmcginnis: Yes, I got that all fixed up.22:17
efriedAnd the next one, and the next....22:17
smcginnisefried: Ah. ;)22:17
efriednew patch sets on the way in a sec...22:17
*** agopi has joined #openstack-infra22:17
*** dpawlik has quit IRC22:17
*** dpawlik has joined #openstack-infra22:18
*** heyongli has quit IRC22:19
*** heyongli has joined #openstack-infra22:20
*** kienha has joined #openstack-infra22:22
openstackgerritMerged openstack-infra/project-config master: Set up cgit aliases for StarlingX  https://review.openstack.org/57280122:22
efriedsmcginnis, fungi: https://review.openstack.org/578573 Fix doc output path in PTI reference22:22
*** Shrews has joined #openstack-infra22:22
*** dpawlik has quit IRC22:22
fungiefried: thanks! documentation is rarely perfect22:23
openstackgerritMerged openstack-infra/project-config master: Use wildcard to apply system-required template  https://review.openstack.org/57730722:23
smcginnisI suppose technically it was correct with what it stated before.22:23
efriedsmcginnis: Yes, it didn't actually *say* what the job itself does...22:23
smcginnisI think this is better for consistency though.22:23
efriedsmcginnis: Right, I used it as a cue to figure out how to fix up the tox.ini and get builds working locally, so it's useful for those to match.22:24
fungithe prose was right, the invocation it quoted was for sure wrong22:25
fungiand the prose while right, was still arguably misleading22:25
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844122:26
*** hongbin has quit IRC22:27
*** nicolasbock has quit IRC22:29
clarkbzuul seems to still be working after the system-required update22:29
openstackgerritMerged openstack-infra/zuul master: Fix missing dequeue on synchronized pull request  https://review.openstack.org/57735522:29
*** heyongli has quit IRC22:29
*** heyongli has joined #openstack-infra22:30
openstackgerritClark Boylan proposed openstack-infra/project-config master: Add kata runtime and tests repos to zuul  https://review.openstack.org/57856222:31
openstackgerritClark Boylan proposed openstack-infra/project-config master: Add ubuntu job to new kata repos in zuul  https://review.openstack.org/57856322:31
openstackgerritClark Boylan proposed openstack-infra/project-config master: Cleanup system-required stragglers  https://review.openstack.org/57857422:33
clarkbdtroyer: https://git.starlingx.io/cgit now with repos22:34
*** eharney has quit IRC22:35
*** heyongli has quit IRC22:40
*** heyongli has joined #openstack-infra22:40
*** jamesmcarthur has joined #openstack-infra22:40
*** jamesmcarthur has quit IRC22:45
*** heyongli has quit IRC22:50
*** kzaitsev1pi has joined #openstack-infra22:50
*** heyongli has joined #openstack-infra22:50
*** kzaitsev_pi has quit IRC22:52
funginow with happening22:52
*** Shrews has quit IRC22:55
*** Shrews has joined #openstack-infra22:58
*** heyongli has quit IRC23:00
*** heyongli has joined #openstack-infra23:00
mnaserclarkb: no problem regarding the approve -123:05
mnaserI’ll remove it once I’m near a computer for completeness23:05
mnaser:)23:05
fungiyou won't be able to remove it at this point since it's already merged23:06
dtroyerclarkb, fungi: thanks!  it looks good23:09
*** heyongli has quit IRC23:10
*** heyongli has joined #openstack-infra23:11
*** yolanda__ has joined #openstack-infra23:11
*** Shrews has quit IRC23:13
*** tonytan4ever_brb has quit IRC23:14
*** tonytan4ever has joined #openstack-infra23:14
*** Shrews has joined #openstack-infra23:15
*** yolanda_ has quit IRC23:15
*** ianychoi has quit IRC23:16
*** yolanda__ has quit IRC23:18
*** ianychoi has joined #openstack-infra23:19
*** boden has joined #openstack-infra23:20
*** yolanda has joined #openstack-infra23:20
*** heyongli has quit IRC23:21
*** heyongli has joined #openstack-infra23:21
*** yolanda_ has joined #openstack-infra23:21
*** yolanda has quit IRC23:24
*** boden has quit IRC23:24
*** yolanda__ has joined #openstack-infra23:25
*** edmondsw has joined #openstack-infra23:27
*** yolanda_ has quit IRC23:29
*** yolanda has joined #openstack-infra23:29
*** yolanda__ has quit IRC23:31
*** heyongli has quit IRC23:31
*** heyongli has joined #openstack-infra23:31
*** edmondsw has quit IRC23:32
*** mihalis68 has quit IRC23:34
*** tosky has quit IRC23:35
*** heyongli has quit IRC23:41
*** heyongli has joined #openstack-infra23:42
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: zk: retry initial zookeeper connection attempts  https://review.openstack.org/57604823:45
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: zk: use kazoo retry facilities  https://review.openstack.org/53620923:45
*** heyongli has quit IRC23:51
*** heyongli has joined #openstack-infra23:52
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: zk: retry initial zookeeper connection attempts  https://review.openstack.org/57604723:54
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: zk: use kazoo retry facilities  https://review.openstack.org/53553723:54
*** kienha has quit IRC23:57
*** alex_xu has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!