| dhill_ | EmilienM, well I used to specify --neutron-network-types and --neutron-tunnel-types ... those options are now gone | 00:29 |
|---|---|---|
| dhill_ | EmilienM, when I was deploying an overcloud | 00:30 |
| *** ipsecguy_ has quit IRC | 00:30 | |
| *** ipsecguy has joined #tripleo | 00:31 | |
| *** ipsecguy has quit IRC | 00:39 | |
| *** ipsecguy has joined #tripleo | 00:44 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 00:52 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 00:52 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Update OOOQ to ansible 2.2 https://review.openstack.org/398194 | 00:52 |
| *** limao has joined #tripleo | 01:06 | |
| *** fragatin_ has joined #tripleo | 01:12 | |
| *** fragatin_ has quit IRC | 01:14 | |
| *** fragatina has quit IRC | 01:15 | |
| *** fragatina has joined #tripleo | 01:15 | |
| *** jcoufal has quit IRC | 01:15 | |
| *** ayoung has quit IRC | 01:25 | |
| *** chem has quit IRC | 01:35 | |
| *** rajinir has quit IRC | 01:36 | |
| *** ctayal has joined #tripleo | 01:38 | |
| *** dmacpher has joined #tripleo | 01:49 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Speed up chroot checking loop https://review.openstack.org/410000 | 01:49 |
| *** dsneddon has quit IRC | 01:55 | |
| *** limao has quit IRC | 02:00 | |
| *** limao has joined #tripleo | 02:00 | |
| *** mburned is now known as mburned_out | 02:04 | |
| *** jeckersb is now known as jeckersb_gone | 02:06 | |
| *** fragatina has quit IRC | 02:06 | |
| EmilienM | bnemec: have we open a new bug for the ovb failures? | 02:07 |
| *** fragatina has joined #tripleo | 02:07 | |
| EmilienM | bnemec: I'm re-adding the alert | 02:16 |
| EmilienM | http://logs.openstack.org/58/379958/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/4b41da4/console.html#_2016-12-13_00_58_56_844407 | 02:16 |
| EmilienM | it still fails | 02:16 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova Placement API profile https://review.openstack.org/406309 | 02:20 |
| *** jkilpatr has quit IRC | 02:21 | |
| *** rhallisey has quit IRC | 02:27 | |
| *** bkopilov has quit IRC | 02:30 | |
| *** ctayal has quit IRC | 02:35 | |
| *** chlong has quit IRC | 02:45 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 02:49 |
| *** chlong has joined #tripleo | 02:59 | |
| *** sudipto has joined #tripleo | 03:07 | |
| *** sudipto_ has joined #tripleo | 03:10 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 03:10 |
| *** sudipto has quit IRC | 03:12 | |
| *** akuznetsov has joined #tripleo | 03:17 | |
| *** tzumainn has quit IRC | 03:18 | |
| *** pmannidi_ has joined #tripleo | 03:18 | |
| *** pmannidi has quit IRC | 03:19 | |
| *** yamahata has quit IRC | 03:20 | |
| *** sudipto has joined #tripleo | 03:23 | |
| *** sudswas__ has joined #tripleo | 03:23 | |
| *** sudipto_ has quit IRC | 03:24 | |
| *** sudipto has quit IRC | 03:24 | |
| *** sudswas__ has quit IRC | 03:24 | |
| *** sudipto has joined #tripleo | 03:24 | |
| *** akuznetsov has quit IRC | 03:24 | |
| *** sudipto_ has joined #tripleo | 03:24 | |
| *** mhenkel has joined #tripleo | 03:27 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 03:30 |
| *** mhenkel has quit IRC | 03:32 | |
| *** sudipto_ has quit IRC | 03:32 | |
| *** sudipto has quit IRC | 03:32 | |
| *** sudipto_ has joined #tripleo | 03:35 | |
| *** sudipto has joined #tripleo | 03:35 | |
| *** sudswas__ has joined #tripleo | 03:45 | |
| *** sudswas__ has quit IRC | 03:45 | |
| *** sudipto has quit IRC | 03:46 | |
| *** sudipto_ has quit IRC | 03:47 | |
| *** sudipto has joined #tripleo | 03:49 | |
| *** sudipto_ has joined #tripleo | 03:49 | |
| *** bkopilov has joined #tripleo | 03:50 | |
| *** sudipto_ has quit IRC | 04:05 | |
| *** sudipto has quit IRC | 04:05 | |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405625 | 04:06 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 04:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** links has joined #tripleo | 04:22 | |
| *** sudipto has joined #tripleo | 04:30 | |
| *** sudipto_ has joined #tripleo | 04:30 | |
| *** udesale has joined #tripleo | 04:32 | |
| *** ctayal has joined #tripleo | 04:41 | |
| *** dtrainor has quit IRC | 04:51 | |
| *** ctayal has quit IRC | 04:54 | |
| *** prateek has joined #tripleo | 05:03 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 05:10 |
| *** sudipto_ has quit IRC | 05:14 | |
| *** sudipto has quit IRC | 05:14 | |
| *** ctayal has joined #tripleo | 05:22 | |
| *** fragatina has quit IRC | 05:26 | |
| *** fragatina has joined #tripleo | 05:26 | |
| *** dsariel has quit IRC | 05:28 | |
| *** dtrainor has joined #tripleo | 05:33 | |
| *** dtrainor has quit IRC | 05:38 | |
| *** oshvartz has quit IRC | 05:38 | |
| *** ctayal has quit IRC | 05:52 | |
| *** nmathew has joined #tripleo | 05:57 | |
| *** masco has joined #tripleo | 06:01 | |
| apetrich | Morning | 06:04 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 06:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| *** rlandy has quit IRC | 06:11 | |
| *** ctayal has joined #tripleo | 06:12 | |
| *** ealcaniz has joined #tripleo | 06:23 | |
| *** links has quit IRC | 06:34 | |
| *** lmiccini has joined #tripleo | 06:34 | |
| *** dsariel has joined #tripleo | 06:36 | |
| *** links has joined #tripleo | 06:38 | |
| *** ealcaniz has quit IRC | 06:47 | |
| *** abregman has joined #tripleo | 06:52 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates: Manage disallow_iframe_embed https://review.openstack.org/409109 | 06:53 |
| *** jlinkes has joined #tripleo | 06:55 | |
| *** florianf has joined #tripleo | 06:56 | |
| *** dtrainor has joined #tripleo | 06:58 | |
| *** masco has quit IRC | 07:00 | |
| *** abehl has joined #tripleo | 07:00 | |
| *** saneax-_-|AFK is now known as saneax | 07:02 | |
| *** ramishra has quit IRC | 07:02 | |
| *** prateek has quit IRC | 07:03 | |
| *** prateek has joined #tripleo | 07:03 | |
| *** oshvartz has joined #tripleo | 07:04 | |
| *** mhenkel has joined #tripleo | 07:04 | |
| *** fragatin_ has joined #tripleo | 07:05 | |
| *** ramishra has joined #tripleo | 07:06 | |
| *** fragatin_ has quit IRC | 07:06 | |
| *** fragatin_ has joined #tripleo | 07:07 | |
| *** fragatina has quit IRC | 07:08 | |
| *** mhenkel has quit IRC | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 07:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| *** ramishra_ has joined #tripleo | 07:11 | |
| *** fragatin_ has quit IRC | 07:11 | |
| *** ramishra has quit IRC | 07:11 | |
| *** masco has joined #tripleo | 07:13 | |
| *** dsneddon_ has quit IRC | 07:16 | |
| *** dsneddon has joined #tripleo | 07:19 | |
| *** rasca has joined #tripleo | 07:20 | |
| *** ramishra_ has quit IRC | 07:23 | |
| *** ramishra has joined #tripleo | 07:25 | |
| *** iranzo has joined #tripleo | 07:29 | |
| *** iranzo has joined #tripleo | 07:29 | |
| *** dmacpher has quit IRC | 07:34 | |
| yolanda | hi, good morning. Can i get reviews on https://review.openstack.org/406895 and https://review.openstack.org/408456 ? | 07:36 |
| yolanda | same fixes that already landed in feature/v2 branch, but for the master branch | 07:36 |
| *** nyechiel has joined #tripleo | 07:43 | |
| *** tobias_fiberdata has joined #tripleo | 07:46 | |
| *** pgadiya has joined #tripleo | 07:46 | |
| *** yprokule has joined #tripleo | 07:51 | |
| d0ugal | hrm | 07:56 |
| d0ugal | so what can I do to help this CI issue? | 07:56 |
| *** ccamacho has joined #tripleo | 07:59 | |
| *** jaosorior has joined #tripleo | 07:59 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Show error when using invalid instackenv.json https://review.openstack.org/406139 | 08:01 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Poll nodes list while nodes are in progress state https://review.openstack.org/395637 | 08:02 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Relax requires when creating resources on remote nodes https://review.openstack.org/408303 | 08:02 |
| *** rcernin has joined #tripleo | 08:05 | |
| *** matbu has quit IRC | 08:05 | |
| *** matbu has joined #tripleo | 08:06 | |
| *** ealcaniz has joined #tripleo | 08:07 | |
| *** jprovazn has joined #tripleo | 08:07 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 08:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| *** pcaruana has joined #tripleo | 08:10 | |
| *** jaosorior has quit IRC | 08:12 | |
| *** jaosorior has joined #tripleo | 08:12 | |
| *** mhenkel has joined #tripleo | 08:14 | |
| *** Vijayendra has quit IRC | 08:14 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: WIP: Repositories setup role https://review.openstack.org/408162 | 08:15 |
| *** milan has joined #tripleo | 08:16 | |
| *** aufi has joined #tripleo | 08:18 | |
| sshnaidm | bkero, hi | 08:19 |
| *** ctayal_ has joined #tripleo | 08:21 | |
| *** rcernin has quit IRC | 08:22 | |
| *** ctayal has quit IRC | 08:22 | |
| *** rcernin has joined #tripleo | 08:25 | |
| *** jpena|off is now known as jpena | 08:25 | |
| *** bvandenh has joined #tripleo | 08:28 | |
| *** kodokuuu has joined #tripleo | 08:29 | |
| *** tremble has joined #tripleo | 08:30 | |
| *** ealcaniz has quit IRC | 08:30 | |
| *** rain has joined #tripleo | 08:32 | |
| *** rain is now known as leanderthal | 08:32 | |
| *** ealcaniz has joined #tripleo | 08:32 | |
| leanderthal | o/ tripleo | 08:32 |
| *** mcornea has joined #tripleo | 08:34 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 08:35 |
| *** fzdarsky|afk has joined #tripleo | 08:36 | |
| *** milan has quit IRC | 08:36 | |
| *** jpena is now known as jpena|off | 08:37 | |
| *** ealcaniz has quit IRC | 08:38 | |
| *** ealcaniz has joined #tripleo | 08:40 | |
| matbu | hi, can someone take a look at this https://review.openstack.org/#/c/408669/ | 08:41 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 08:41 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-docs: OVS DPDK deployment documentation https://review.openstack.org/395431 | 08:41 |
| *** ctayal_ has quit IRC | 08:42 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 08:43 |
| *** karimb has joined #tripleo | 08:46 | |
| *** karimb has left #tripleo | 08:47 | |
| *** jpena|off is now known as jpena | 08:50 | |
| *** ealcaniz has quit IRC | 08:51 | |
| *** bvandenh has quit IRC | 08:53 | |
| *** kodokuuu has quit IRC | 08:54 | |
| *** zoli|gone is now known as zoli | 08:56 | |
| *** jpich has joined #tripleo | 08:57 | |
| *** chem has joined #tripleo | 08:57 | |
| zoli | good morning | 08:57 |
| *** ealcaniz has joined #tripleo | 08:58 | |
| *** ohamada has joined #tripleo | 09:00 | |
| *** athomas has joined #tripleo | 09:02 | |
| *** fzdarsky|afk is now known as fzdarsky | 09:02 | |
| *** shardy has joined #tripleo | 09:04 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 09:04 |
| *** bvandenh has joined #tripleo | 09:05 | |
| *** panda|afk is now known as panda | 09:05 | |
| *** ealcaniz has quit IRC | 09:07 | |
| jaosorior | It seems that now the multinode gate is flaky too :( | 09:07 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 09:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| *** bvandenh has quit IRC | 09:11 | |
| *** kodokuu has joined #tripleo | 09:12 | |
| *** dbecker has joined #tripleo | 09:14 | |
| *** sudipto has joined #tripleo | 09:18 | |
| *** sudipto_ has joined #tripleo | 09:18 | |
| *** chem has quit IRC | 09:21 | |
| *** chem has joined #tripleo | 09:21 | |
| ccamacho | hey matbu good morning! I was checking https://review.openstack.org/#/c/403397/ locally and the deployment hangs when upgrading 1 controller and 1 compute, now it does not reach the upgrade steps. It hangs in a NetworkDeployment resource. Do you know what can I check/see to debug it? | 09:21 |
| *** zoli is now known as zoli|brb | 09:22 | |
| marios | ccamacho: o/ i was testing that also yesterday and i also got a stack timout eventually (hanging somewhere)... i was testing that with my one ontop i left a coment at https://review.openstack.org/#/c/408631/2 | 09:23 |
| *** akrivoka has joined #tripleo | 09:23 | |
| marios | ccamacho: i'd like to get to bottom of another issue today but hopefully try that again today and see if i can work out whatsup | 09:23 |
| marios | ccamacho: in my case i put cluster down on control2 and expected the validation step 0 to fail quickly but it didn't | 09:23 |
| marios | ccamacho: as you say, it just continued and is apparently hanging somewhere | 09:24 |
| ccamacho | marios morning man! Yeahp so the hanging isnt on your patch, neither matbu's, also yesterday ran the patch that I abandoned and also hangs (Was running before, it was my control group) | 09:26 |
| ccamacho | so I believe is even before.. | 09:26 |
| *** owalsh-afk is now known as owalsh | 09:27 | |
| ccamacho | Ill keep checking it and ill give you feedback if getting the root cause. | 09:27 |
| marios | ccamacho: thanks, i just reset my osp10 box so will take like 1.5 hours to deploy (beaker box, enough ram but 4-core virt host)... as i said i'll cycle back to upgrading that later | 09:28 |
| ccamacho | marios awesome | 09:29 |
| *** Vijayendra has joined #tripleo | 09:30 | |
| *** saibarspeis has joined #tripleo | 09:30 | |
| *** lucas-afk is now known as lucasagomes | 09:32 | |
| *** zoli|brb is now known as zoli | 09:34 | |
| *** gfidente has joined #tripleo | 09:34 | |
| *** limao_ has joined #tripleo | 09:39 | |
| *** limao has quit IRC | 09:41 | |
| *** derekh has joined #tripleo | 09:41 | |
| *** limao_ has quit IRC | 09:45 | |
| *** limao has joined #tripleo | 09:45 | |
| jaosorior | sshnaidm: the CI seems to have gotten further in a patch I saw, however, it failed with "no hosts vailable" | 09:47 |
| *** dtantsur|afk is now known as dtantsur | 09:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 09:47 |
| sshnaidm | jaosorior, yeah, I've updated the bug, there is not enough space on the disk, and ironic fails to deploy nodes | 09:48 |
| sshnaidm | jaosorior, trying to find now where we can delete something | 09:48 |
| *** milan has joined #tripleo | 09:50 | |
| sshnaidm | jaosorior, but it's about ovb only | 09:51 |
| sshnaidm | just noted that multinode jobs fail too | 09:52 |
| jaosorior | sshnaidm: they do | 09:52 |
| jaosorior | they keep timing out for some reason | 09:52 |
| sshnaidm | jaosorior, today I ran ovb-ha job and it succeeded, so it seems like something ci-related | 09:54 |
| jaosorior | sshnaidm: well, this doesn't look promising http://tripleo.org/cistatus.html | 09:54 |
| panda | all periodic jobs ran correctly (then failed for other reasons) | 09:55 |
| jaosorior | panda: nice! :D | 09:55 |
| panda | jaosorior: tripleo.org was rebooted yesterday, may something that gather informations did not start | 09:56 |
| panda | jaosorior: sshnaidm I think it's possible that the queue from yesteday is clogging the system, hence the disk space problem | 09:57 |
| panda | derekh: I know I wasn't of much help yesterday, but can you add my key again/create a user in the bastion for me ? I think I need to improve my knowledge there | 09:58 |
| sshnaidm | jaosorior, it's old data | 09:58 |
| derekh | panda: ahh, puppet reset the keys back I think, one sec | 09:58 |
| sshnaidm | jaosorior, but my status page is also stuck on yesterday.. today it's a bit better | 09:59 |
| sshnaidm | if you have vpn, you can look at http://10.35.7.190/ | 09:59 |
| *** paramite has joined #tripleo | 09:59 | |
| jaosorior | that is a very nice looking status page | 09:59 |
| sshnaidm | panda, it's images from nodepool, I doubt id if they depend on queue(?) | 10:00 |
| *** saibarspeis has quit IRC | 10:00 | |
| *** saibarspeis has joined #tripleo | 10:00 | |
| sshnaidm | panda, you can submit patch to tripleo-ci to add you as one of admins if you want | 10:01 |
| panda | jaosorior: do you have a link to a failing job ? | 10:01 |
| panda | sshnaidm: that's cheating :) | 10:01 |
| jaosorior | panda: I closed it, don't remember which it was | 10:02 |
| panda | jaosorior: d'oh | 10:02 |
| *** akrivoka has quit IRC | 10:02 | |
| jaosorior | I think it was this one https://review.openstack.org/#/c/409921/ | 10:03 |
| sshnaidm | all ha jobs fail because http://logs.openstack.org/58/379958/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/9d521cb/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz?level=ERROR | 10:03 |
| *** akrivoka has joined #tripleo | 10:03 | |
| *** hewbrocca_afk is now known as hewbrocca | 10:04 | |
| derekh | panda: you need to add you details here http://git.openstack.org/cgit/openstack/tripleo-incubator/tree/tripleo-cloud/tripleo-cd-admins and your key to the ssh-keys directory | 10:04 |
| derekh | panda: and while you at it add yourself here too http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo-cd-admins | 10:05 |
| sshnaidm | derekh, I think we can delete it: 8.1G -rw-------. 1 root root 8.0G Dec 13 09:49 swapfile | 10:05 |
| derekh | panda: the tripleo-incubator file is now only used for the bastion | 10:06 |
| sshnaidm | derekh, anyway we don't create and don't use swap | 10:06 |
| dtantsur | folks, can I get a 3rd +2 and +A on https://review.openstack.org/405435 please? | 10:06 |
| derekh | sshnaidm: ok | 10:06 |
| panda | derekh: ok | 10:07 |
| sshnaidm | panda, https://review.openstack.org/#/c/357217/ https://review.openstack.org/#/c/353103/ | 10:07 |
| panda | jaosorior: weird, the "no hosts available" error happens after the baremetal hosts are correctly created and registered by ironic | 10:07 |
| jaosorior | panda: so it's a nova issue? | 10:09 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 10:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| *** jlinkes has quit IRC | 10:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove swapfile form root dir to save space https://review.openstack.org/410131 | 10:10 |
| *** jlinkes has joined #tripleo | 10:10 | |
| sshnaidm | panda, derekh ^^ | 10:10 |
| *** akrivoka has quit IRC | 10:12 | |
| sshnaidm | but it's interesting what took so much space now that we don't have it even for non-ha job.. | 10:12 |
| *** akrivoka has joined #tripleo | 10:12 | |
| *** akrivoka has quit IRC | 10:12 | |
| *** akrivoka has joined #tripleo | 10:15 | |
| *** akrivoka has quit IRC | 10:15 | |
| *** links has quit IRC | 10:16 | |
| panda | sshnaidm: where do you see the error on disk space ? | 10:16 |
| sshnaidm | panda, <sshnaidm> all ha jobs fail because http://logs.openstack.org/58/379958/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/9d521cb/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz?level=ERROR | 10:16 |
| panda | sshnaidm: ah, so since on the same job I see http://logs.openstack.org/58/379958/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/9d521cb/console.html#_2016-12-13_06_35_06_668124 that means that node are actually created *AFTER* they are correctly registered to ironic ? | 10:19 |
| sshnaidm | panda, created, but not deployed | 10:20 |
| shardy | matbu: Hey, trying to work out the https://review.openstack.org/#/c/404831 failure - am I missing something or are we not using the stable/newton tht for the initial deploy? | 10:20 |
| *** akrivoka has joined #tripleo | 10:21 | |
| sshnaidm | panda, afaiu when overcloud starts, then ironic create a "master image" that tries to deploy on blank node (and fails to create it, because no space), let derekh correct me if I'm wrong | 10:21 |
| panda | sshnaidm: it's like a delayed provisioning, with the node created but no space allocated until the node has started deployment | 10:22 |
| panda | sshnaidm: ^ that was a question | 10:23 |
| sshnaidm | panda, I'm not sure I understand, why should it be allocated? | 10:24 |
| jtomasek | florianf: some tiny nits on the i18n patch | 10:26 |
| panda | sshnaidm: ok, my doubt is: why the errors does not show up in this part of the deployment http://logs.openstack.org/58/379958/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/9d521cb/console.html#_2016-12-13_06_35_06_668124 where the nodes are created, made available and registered correclty? | 10:26 |
| panda | sshnaidm: I was expecting to see error there, if there wasn't enough space to create the baremetal nodes. | 10:26 |
| *** limao has quit IRC | 10:27 | |
| matbu | shardy: actually we should have a tht master on this undercloud which handle newton OC images | 10:28 |
| sshnaidm | panda, because ironic didn't know that on its host no space for saving master-disk (which it didn't create yet). And I don't think it should, it's sysadmins duty to have enough disk space on the undercloud | 10:28 |
| *** bkopilov has quit IRC | 10:28 | |
| shardy | matbu: we don't expect tht master to work with newton images, we need to deploy with newton tht, then switch to master for the upgrade | 10:28 |
| matbu | shardy: so we need a newton UC | 10:29 |
| matbu | ? | 10:29 |
| sshnaidm | panda, maybe you are going to deploy only one of them, not all 4, and it's enough space for it - why not to deploy? | 10:29 |
| shardy | matbu: No, we just need to clone or install the newton tht | 10:29 |
| *** links has joined #tripleo | 10:29 | |
| shardy | matbu: locally I just have a tht_newton git checkout | 10:29 |
| shardy | then do overcloud deploy --tempates tht_newton | 10:29 |
| matbu | shardy: ack, but actually that should work | 10:29 |
| derekh | sshnaidm: panda havn't been following along properly, but I think what sshnaidm is say make sense, ironic doesn't try to use the space during the node registration, its only when the overcloud is being deployed that it tries to copy an image to /var/lib/ironic/master_images and fails | 10:29 |
| matbu | shardy: but agree, it will skip the possible failure due to this use case | 10:30 |
| matbu | shardy: i'll make the fix | 10:30 |
| shardy | matbu: thanks! I'm going to pull the patch locally and do some testing to try to get the remaining issues resolved | 10:31 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common: Validate the plan name before running https://review.openstack.org/407972 | 10:31 |
| panda | sshnaidm: derekh ok, this is what I meant with "delayed allocation", first it defines only, and it tries to use the space later. thanks. | 10:31 |
| derekh | sshnaidm: 2016-12-13 10:16:03.817258 | rm: cannot remove ‘/root/swapfile’: Operation not permitted | 10:32 |
| matbu | shardy: you mean the failure from yesterday ? | 10:32 |
| matbu | shardy: i think this is not related to upgrade | 10:32 |
| matbu | shardy: the recheck didn't retrigger the experimental jobs | 10:32 |
| shardy | matbu: I mean I want to see an end-to-end test of the deploy and upgrade working locally | 10:32 |
| shardy | as debugging will be much much faster than doing it in CI | 10:33 |
| matbu | shardy: ha k yep right :) | 10:33 |
| shardy | matbu: do you have any notes on how you've been testing the multinode deploy locally? | 10:33 |
| shardy | I think slagle had some at one point, if not I'll make notes as I go | 10:33 |
| matbu | shardy: nop, not for the multinode | 10:33 |
| shardy | matbu: Ok, I think we need to that so we can iterate faster, will grab a coffee then give it a go | 10:34 |
| matbu | shardy: but i used to deploy an undercloud and then i use the upgrade.yaml in the deploy command | 10:34 |
| *** saibarspeis has quit IRC | 10:34 | |
| shardy | Yeah I've been doing similar, but lets see if we can get the exact same thing as CI running | 10:35 |
| *** saibarspeis has joined #tripleo | 10:35 | |
| sshnaidm | derekh, I see..hmm.. | 10:36 |
| *** tosky has joined #tripleo | 10:39 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-incubator: Add gcerami to tripleo-cloud https://review.openstack.org/410156 | 10:39 |
| *** zoli is now known as zoli|lunch | 10:40 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Add gcerami to tripleo-cd-admins https://review.openstack.org/410157 | 10:40 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove swapfile form root dir to save space https://review.openstack.org/410131 | 10:43 |
| matbu | shardy: the only big diff i think it 's that we can't do the bootstrap nodes like in ci | 10:43 |
| * matbu grabs fooods | 10:44 | |
| kodokuu | Hi, is it possible to regenerate undercloud-passwords.conf ? | 10:44 |
| kodokuu | because I try to rewrite file but I have File contains no section headers. | 10:47 |
| derekh | sshnaidm: I think the swapfile is being used | 10:49 |
| derekh | sshnaidm: one of the zuul scripts must be setting it up | 10:49 |
| sshnaidm | derekh, yeah..I thought it has schg flag maybe | 10:49 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove dead mocks and dead code https://review.openstack.org/409130 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the keystone_pki cert generation from tripleoclient https://review.openstack.org/409198 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action https://review.openstack.org/398975 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused get_config_value function https://review.openstack.org/409255 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused delete image function https://review.openstack.org/409258 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused constant RESOURCE_REGISTRY_NAME https://review.openstack.org/409256 | 10:51 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove two unused Exception subclasses https://review.openstack.org/409257 | 10:51 |
| jaosorior | d0ugal: O_O | 10:51 |
| d0ugal | :) | 10:51 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 10:54 |
| *** masco has quit IRC | 10:59 | |
| jprovazn | gfidente, hi | 11:00 |
| kodokuu | someone can copy the header of undercloud-password.conf ? I guess I miss somthing | 11:01 |
| jprovazn | gfidente, when deploying ceph mds it seems mds service is not as happy as it should be, have you seen this? http://paste.openstack.org/show/592195/ | 11:01 |
| *** udesale has quit IRC | 11:02 | |
| gfidente | jprovazn looks like an auth problem | 11:04 |
| gfidente | jprovazn does the user have the credentials we expect it too? (try ceph auth list) | 11:05 |
| gfidente | *to | 11:05 |
| jprovazn | gfidente, http://paste.openstack.org/show/592196/ | 11:06 |
| d0ugal | akrivoka: did you see my comment on the commit message https://review.openstack.org/#/c/409350/ ? | 11:07 |
| akrivoka | d0ugal: yeah, just now | 11:07 |
| d0ugal | akrivoka: cool, fine for you to continue down this path, but it is more painful :) | 11:07 |
| akrivoka | d0ugal: I was going off the similar stuff I've seen in the client, though I totally see what you mean and agree with it | 11:08 |
| gfidente | jprovazn looks like it's missing the 'allow' keyword before metadata pool> | 11:08 |
| *** nmathew has quit IRC | 11:08 | |
| d0ugal | akrivoka: cool. the other code is like that for legacy reasons, the link is slowly being removed. | 11:08 |
| gfidente | can you try if that makes it to work? | 11:08 |
| jprovazn | gfidente, aha, I'll try update it manually | 11:09 |
| akrivoka | d0ugal: makes sense | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 11:10 |
| akrivoka | d0ugal: I also agree with your initial comment that this logic should be contained in workflows and not in the client... I just wonder if some more substantial changes are necessary in order to achieve that | 11:10 |
| d0ugal | akrivoka: yeah, that is a bigger problem :) | 11:11 |
| akrivoka | d0ugal: I'll leave it to your judgment if you thing that this fix is worth having, or is it making matters worse.. | 11:11 |
| d0ugal | akrivoka: it is just yet another reason I want jpich's JSON plan create :) | 11:11 |
| d0ugal | akrivoka: we can come back to that later, it is a much bigger issue than the one you are resolving. | 11:11 |
| *** masco has joined #tripleo | 11:11 | |
| akrivoka | d0ugal: JSON plan create? | 11:11 |
| jpich | d0ugal: Huh I'll start a thread about that I swear :-) | 11:12 |
| jpich | d0ugal: Do you know why Depends-On doesn't seem to be working on akrivoka's patch? | 11:12 |
| d0ugal | akrivoka: https://review.openstack.org/#/c/347830/ | 11:12 |
| d0ugal | jpich: I replied to your comment :) | 11:12 |
| jpich | oh! | 11:12 |
| * akrivoka looks | 11:12 | |
| *** sudipto has quit IRC | 11:12 | |
| *** sudipto_ has quit IRC | 11:12 | |
| d0ugal | akrivoka: The reason it isn't a workflow is that multiple steps are needed, since workflows don't accept the files. With that patch, we could send the workflow a giant json blob with all the templates. Then the workflow could handle all the logic | 11:13 |
| jpich | d0ugal: Hm... Ok so Depends-On only works for the non-UT jobs then? | 11:13 |
| d0ugal | akrivoka: otherwise the client needs to create the container, upload the files and trigger the plan create. A 3 step process. | 11:13 |
| d0ugal | jpich: Yeah, I think so. | 11:13 |
| jpich | d0ugal: Thanks for the info | 11:14 |
| d0ugal | jpich: but if it breaks the tests, I think it then breaks the package build - so the other jobs fail too | 11:14 |
| jpich | wow | 11:14 |
| d0ugal | jpich: (but that depends, not all packages run the tests during the build) | 11:14 |
| akrivoka | ok, I have to look how this ties into the plan import which I'm working on now... | 11:15 |
| d0ugal | akrivoka: :) | 11:15 |
| d0ugal | akrivoka: some people, I forget who, didn't like the JSON workflow - so it was blocked at the time. | 11:15 |
| d0ugal | However, I think we should revisit thatl | 11:15 |
| *** links has quit IRC | 11:15 | |
| d0ugal | that* | 11:15 |
| akrivoka | cool, I'll review | 11:16 |
| jpich | I think one of the concerns was with needing to update the mistral task size thing (giving the impression of abusing/misusing Mistral?) but we had to get that in for something else anyway since then | 11:16 |
| d0ugal | jpich: Yeah, I don't think that should be an issue. | 11:17 |
| jprovazn | gfidente, fixing perms manually probably helped, now the error is gone in logs, but mds is probably still down, http://paste.openstack.org/show/592197/ | 11:17 |
| d0ugal | jpich: btw, https://github.com/rdo-packages/tripleoclient-distgit/blob/rpm-master/python-tripleoclient.spec#L76 | 11:17 |
| jprovazn | gfidente, do I have to do an extra magic trick to revive it? | 11:17 |
| d0ugal | jpich: if you were curious, I realised I didn't know where or how it ran the tests. I am not sure what version of tripleo-common it will use - maybe depends-on will work in this case. It doesn't use tox. | 11:18 |
| jpich | d0ugal: Hm... Well we know the last released version is installed anyway, from the console logs... * tries to find another patch with a Depends-On * | 11:20 |
| *** jkilpatr has joined #tripleo | 11:21 | |
| *** amoralej|off is now known as amoralej | 11:25 | |
| derekh | sshnaidm: there is 4G available here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n117 | 11:25 |
| derekh | sshnaidm: that raw file is deleted, but its still setup as a loopback mount device at /dev/loop0 | 11:26 |
| derekh | sshnaidm: so the space isn't freed as the inode is still open | 11:27 |
| derekh | sshnaidm: losetup -d /dev/loop0 should free it up | 11:27 |
| sshnaidm | derekh, and how to delete it gracefully? | 11:27 |
| sshnaidm | derekh, ok, will try now | 11:27 |
| derekh | sshnaidm: also http://paste.openstack.org/show/592207/ | 11:28 |
| derekh | sshnaidm: the overcloud-full image is 3.8G after we update it with that function | 11:29 |
| derekh | sshnaidm: its 1.2 before | 11:29 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add transport_url parameter to heat config https://review.openstack.org/410171 | 11:30 |
| derekh | sshnaidm: I'm not sure why but maybe passing in -c to the " qemu-img convert -f raw -O qcow2 ${IMAGE/qcow2/raw} ${IMAGE}" command will help it | 11:30 |
| panda | luckyly we didn't get a promotion with an image that big | 11:32 |
| *** links has joined #tripleo | 11:32 | |
| panda | the one on the mirror is still 1.1G | 11:32 |
| jpich | d0ugal: FWIW I've been +2 without +A on your patches because I think nothing can pass CI right now (keeping track of them though) | 11:32 |
| derekh | panda: we wouldn't, we don't run the update function on the promote jobs, they get built from scratch | 11:32 |
| derekh | https://review.openstack.org/#/c/363630/ FTW ;-) | 11:33 |
| d0ugal | jpich: ah, thanks. I had thought I seen some things passing. I guess I should double check :) | 11:33 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove swapfile form root dir to save space https://review.openstack.org/410131 | 11:36 |
| *** sudipto has joined #tripleo | 11:36 | |
| *** sudipto_ has joined #tripleo | 11:36 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 11:37 |
| jpich | d0ugal: Ah, if I'm wrong feel free to poke me again or fix it yourself as you have :-) I'll keep an eye on how that one goes at least | 11:37 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 11:39 |
| sshnaidm | derekh, panda maybe it's time to suggest a larger images for infra, 20GB is not really plenty of space | 11:41 |
| gfidente | jprovazn did that work? | 11:43 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Adds basic internationalization support https://review.openstack.org/399626 | 11:44 |
| panda | sshnaidm: I may be missing something .. we provision nodes on rh1 right ? why is the space on the undercloud a problem ? | 11:44 |
| sshnaidm | panda, the undercloud image we get from infra, it's build every day by nodepool | 11:44 |
| *** Vijayendra has quit IRC | 11:45 | |
| sshnaidm | panda, it's actually our "slave" | 11:45 |
| derekh | sshnaidm: panda it uses the flavor we give it | 11:46 |
| derekh | | 18e29a9b-8b32-4b61-bc76-6346dc7468f2 | undercloud | 8192 | 40 | 0 | | 4 | 1.0 | True | | 11:46 |
| panda | sshnaidm: ok, but ironic is complaining because it's unable to get more space on rh1, right ? | 11:46 |
| sshnaidm | panda, yep | 11:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass hieradata for internal TLS for RabbitMQ https://review.openstack.org/409143 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: [WIP] Respond to multiple messages from workflow executions https://review.openstack.org/406178 | 11:46 |
| sshnaidm | derekh, oh.. so it's we who limit it to 40 | 11:46 |
| sshnaidm | derekh, then why to work hard, let's just increase the disk | 11:47 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Do Not Merge - test https://review.openstack.org/409932 | 11:48 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add network_config_hook interface to run-os-net-config.sh https://review.openstack.org/409342 | 11:48 |
| derekh | sshnaidm: yep, we do it intentionally because the SSD's on most of the rh1 compute nodes are 200G (I think), before increasing anything make sure it will fit | 11:48 |
| derekh | sshnaidm: we have overcommited storage on the compute nodes by a factor of 3, based on the assumtion not all the nodes will use all the storage we allocat them, e.g. ci compute nodes only use a fraction of what the flavor allows them | 11:50 |
| *** jkilpatr has quit IRC | 11:51 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Relax requires when creating resources on remote nodes https://review.openstack.org/408303 | 11:51 |
| jaosorior | d0ugal: any idea what's up with this failure when deleting a plan http://paste.openstack.org/show/592209/ ? | 11:53 |
| sshnaidm | derekh, well, so we should wait for RDO cloud I suppose, with its unlimited resources :) | 11:53 |
| derekh | sshnaidm: yup | 11:53 |
| d0ugal | jaosorior: Yeah, tripleoclient was broken. | 11:54 |
| d0ugal | jaosorior: https://review.openstack.org/#/c/408296/ | 11:54 |
| d0ugal | The fix is blocked by the CI issues | 11:54 |
| jaosorior | yeop | 11:54 |
| jaosorior | well, crap | 11:54 |
| panda | sshnaidm: stil don't understand how increasing undercloud space would help in this case | 11:55 |
| *** kodokuu has quit IRC | 11:55 | |
| sshnaidm | panda, because it's undercloud which is out of space | 11:57 |
| sshnaidm | panda, ironic try to create images on it | 11:57 |
| *** kodokuu has joined #tripleo | 11:59 | |
| *** prateek has quit IRC | 12:01 | |
| EmilienM | hello | 12:01 |
| panda | sshnaidm: but why if the nodes are on rh1 ? ... do ironic creates a 40G image for an overcloud nodes in the undercloud and then pushes it to an rh1 node ? | 12:01 |
| sshnaidm | panda, yep | 12:02 |
| * panda facepalms | 12:02 | |
| sshnaidm | panda, undercloud is also on rh1 | 12:02 |
| panda | the closer I get in this, the less I knows | 12:02 |
| *** markmc has quit IRC | 12:02 | |
| sshnaidm | panda, just in different tenant iirc | 12:02 |
| jprovazn | gfidente, the error message is gone after fixing perms, but mds was stuck in standby | 12:03 |
| panda | know | 12:03 |
| *** markmc has joined #tripleo | 12:03 | |
| jprovazn | gfidente, OC is redeploying no | 12:03 |
| jprovazn | *now | 12:03 |
| * EmilienM reads backlog | 12:03 | |
| EmilienM | should I go back to sleep? :) | 12:03 |
| panda | EmilienM: yes, and make it an hibernation until the end of winter | 12:03 |
| derekh | EmilienM: its all under control | 12:04 |
| panda | derekh: wasn't it all under compute ? | 12:04 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add CI matrix to THT https://review.openstack.org/409692 | 12:05 |
| derekh | lol | 12:05 |
| *** oshvartz has quit IRC | 12:07 | |
| *** nmathew has joined #tripleo | 12:07 | |
| EmilienM | derekh: "our best engineers are working on it" ? | 12:07 |
| derekh | panda: essentially the undercloud has 40G, to store a load of stuff, and 4 copies of the overcloud-full image, one in ~jenkins one in glance, one wasn't being cleaned up when it should have been and one in ironic (after it downloads it from glance), they all just don't fit | 12:08 |
| derekh | panda: and to add to the problem overcloud-full.qcow2 was 3.8G instead of 1.2G | 12:08 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 12:10 |
| *** jkilpatr has joined #tripleo | 12:10 | |
| panda | derekh: ah, thanks for the explanation, very clear | 12:10 |
| *** jaosorior is now known as jaosorior_brb | 12:10 | |
| derekh | so just that one image was using up about 33% of the overall storage available to the undercloud .... | 12:11 |
| panda | maybe we can also remove the one in ~jenkins after uploading it to glance | 12:11 |
| EmilienM | ccamacho: thx for the matrix, I was about doing it sometimes :-D | 12:11 |
| derekh | panda: we can't becasue thats the one we upload to the mirror server after a promote job | 12:11 |
| ccamacho | EmilienM np dude | 12:11 |
| derekh | panda: we'll actaully we could | 12:11 |
| derekh | panda: if we uploaded it from /var/lb/glance or somewhere | 12:12 |
| panda | derekh: exactly | 12:12 |
| derekh | panda: thats possible yes | 12:12 |
| *** pkovar has joined #tripleo | 12:12 | |
| *** adarazs is now known as adarazs_lunch | 12:13 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove files from undercloud to save space https://review.openstack.org/410131 | 12:14 |
| *** zoli|lunch is now known as zoli | 12:16 | |
| *** pgadiya has quit IRC | 12:17 | |
| * derekh toddles back to his IPv6 provision network | 12:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: updates: enable ssl https://review.openstack.org/402930 | 12:22 |
| *** dprince has joined #tripleo | 12:23 | |
| EmilienM | sshnaidm, panda, derekh: thanks guys. Let's approve https://review.openstack.org/410131 once it pass OVB jobs | 12:23 |
| derekh | EmilienM: makes sense | 12:24 |
| panda | EmilienM: I'm just the dumb clueless guy with a lot of annoying questions today. | 12:24 |
| *** rhallisey has joined #tripleo | 12:25 | |
| *** leanderthal has quit IRC | 12:25 | |
| EmilienM | panda: as long as we learn, we're not dumb :) | 12:26 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 12:28 |
| *** shardy is now known as shardy_lunch | 12:29 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Do Not Merge - test https://review.openstack.org/409932 | 12:32 |
| *** pkovar has quit IRC | 12:32 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 12:32 |
| *** dmacpher has joined #tripleo | 12:33 | |
| *** mburned_out is now known as mburned | 12:34 | |
| *** mburned is now known as mburned_out | 12:34 | |
| *** mburned_out is now known as mburned | 12:34 | |
| *** bvandenh has joined #tripleo | 12:34 | |
| *** leanderthal has joined #tripleo | 12:37 | |
| *** pkovar has joined #tripleo | 12:38 | |
| *** thrash|g0ne is now known as thrash | 12:38 | |
| skramaja | dtantsur: ping | 12:39 |
| dtantsur | skramaja, hi | 12:39 |
| skramaja | dtantsur: regarding the deploy steps for setting the boot parameters, IIUC deploy steps will be similar to clean steps - https://github.com/openstack/ironic/blob/95de92c63798830cc3f387909491eec635d116e0/ironic/drivers/modules/drac/raid.py#L686 | 12:40 |
| dtantsur | I suspect so | 12:41 |
| skramaja | dtantsur: in which case, we need to have the code in the IPA to modify the /etc/default/grub by passing args via deploy steps, but it will be invoked only only when the correspoding deploy step is enabled. | 12:42 |
| dtantsur | right, this is how I see it | 12:42 |
| skramaja | dtantsur: which eventually ends up in modifying the image (writing the file /etc/default/grub), which is not accepeted widely... | 12:43 |
| skramaja | but only difference is that it is not invoked by default.. | 12:44 |
| dtantsur | the things about deploy steps is that they can be pluggable (e.g. shipped with tripleo instead of upstream ironic) | 12:44 |
| skramaja | dtantsur: do you mean the invoking of deploy steps can be in tripleo or the implementation of deploy step (pythob code to write /etc/default/grub) can be in tripleo? | 12:46 |
| *** bkopilov has joined #tripleo | 12:46 | |
| dtantsur | the latter | 12:46 |
| *** Vijayendra has joined #tripleo | 12:47 | |
| *** pkovar has quit IRC | 12:48 | |
| skramaja | ok.. thats fair enough.. by seeing the examples of clean_steps, i was under the assumption that only invoking.. any examples that you can guide? | 12:48 |
| skramaja | dtantsur: ^ | 12:48 |
| dtantsur | I can't really give examples for a feature that is not even specified on paper yet | 12:49 |
| dtantsur | feel free to participate in defining it | 12:49 |
| *** pkovar has joined #tripleo | 12:49 | |
| skramaja | thanks dtantsur. i thought an example is available via clean_steps.. now i understood that, it is not.. | 12:50 |
| *** dprince has quit IRC | 12:52 | |
| *** dsariel has quit IRC | 12:54 | |
| openstackgerrit | Merged openstack/tripleo-common: Convert exceptions to strings when passing them to the Result class https://review.openstack.org/403673 | 12:57 |
| *** adarazs_lunch is now known as adarazs | 12:57 | |
| *** shardy_lunch is now known as shardy | 12:57 | |
| *** lucasagomes is now known as lucas-hungry | 12:58 | |
| EmilienM | d0ugal: do you think this newton bug https://bugs.launchpad.net/tripleo/+bug/1632013 might be related to this one that we fixed in Ocata ? https://bugs.launchpad.net/tripleo/+bug/1632013 | 12:59 |
| openstack | Launchpad bug 1632013 in tripleo "Tripleoclient should use the passwords generated by the Mistral workflow" [High,Fix released] - Assigned to Dougal Matthews (d0ugal) | 12:59 |
| thrash | can I get some +2 on this? https://review.openstack.org/#/c/398422/ | 12:59 |
| d0ugal | EmilienM: Yeah, it looks like it was marked fix released in october. | 13:00 |
| *** lblanchard has joined #tripleo | 13:02 | |
| EmilienM | d0ugal: it sounds like we still have a bug in newton | 13:03 |
| d0ugal | EmilienM: I don't follow. | 13:03 |
| d0ugal | EmilienM: oh, you linked to the same bug twice. | 13:03 |
| EmilienM | d0ugal: oops | 13:04 |
| EmilienM | d0ugal: sorry, so the newton bug is here: https://bugs.launchpad.net/tripleo/+bug/1649576 | 13:04 |
| openstack | Launchpad bug 1649576 in tripleo "User-defined AdminPassword is not correctly set in overcloudrc " [Undecided,Triaged] | 13:04 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Add monitoring and logging agents deployment to CI https://review.openstack.org/410210 | 13:04 |
| d0ugal | EmilienM: thanks, reading. | 13:04 |
| *** liverpooler has joined #tripleo | 13:05 | |
| d0ugal | EmilienM: interesting, I would be surprised, because if this is true, nothing would work :) | 13:05 |
| d0ugal | EmilienM: I'll try and reproduce, but I don't have a working env at the moment | 13:06 |
| *** saibarspeis has quit IRC | 13:08 | |
| *** saibarspeis has joined #tripleo | 13:08 | |
| EmilienM | d0ugal: mcornea reproduced the problem on newton | 13:08 |
| EmilienM | mcornea: can you describe how did you reproduce? | 13:08 |
| *** bfournie has quit IRC | 13:08 | |
| *** jayg|g0n3 is now known as jayg | 13:09 | |
| mcornea | EmilienM: d0ugal sure, pass an environment file containing AdminPassword: adminpass and then check the resulting overcloudrc; it's got OS_PASSWORD=8k2BZQ44pvxgTsaVTjFKVCQZ6 | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 13:10 |
| EmilienM | sounds like a bug indeed | 13:10 |
| d0ugal | EmilienM, mcornea - right, maybe there is a backport missing then. | 13:11 |
| EmilienM | d0ugal: there is one but really huge | 13:12 |
| EmilienM | oh but wait, we backported it | 13:12 |
| EmilienM | https://review.openstack.org/#/c/385327/ | 13:12 |
| d0ugal | Yeah, there must be something else :/ | 13:12 |
| *** oshvartz has joined #tripleo | 13:13 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart: Revert "Revert "Show team and repo badges on README"" https://review.openstack.org/409216 | 13:17 |
| *** zoli is now known as zoli|afk | 13:20 | |
| *** ansmith has joined #tripleo | 13:22 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 13:22 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 13:22 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Add a config file for single node HA with ceph https://review.openstack.org/336153 | 13:25 |
| thrash | d0ugal: EmilienM mcornea can we get the stack environment? | 13:25 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute https://review.openstack.org/400986 | 13:26 |
| thrash | d0ugal: i think it's in the generatepasswordsaction | 13:26 |
| thrash | the stack environment may not exist yet, so it generates a new password. | 13:26 |
| mcornea | thrash: I can share my environment if you want | 13:27 |
| thrash | d0ugal: https://github.com/openstack/tripleo-common/blob/stable/newton/tripleo_common/actions/parameters.py#L159 | 13:27 |
| d0ugal | thrash: yeah, it will always generate if there is no stack - but it should still use what is passed in an env | 13:27 |
| d0ugal | thrash: so that code looks fine to me. | 13:28 |
| thrash | d0ugal: that should already be there via the plan/mistral env yeah? | 13:28 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: add the containers prep role to the quickstart-extras https://review.openstack.org/400983 | 13:28 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute https://review.openstack.org/393348 | 13:29 |
| d0ugal | thrash: I don't understand | 13:29 |
| thrash | d0ugal: how/when does the env file get into either the mistral env or the stack env? | 13:30 |
| *** Vijayendra has quit IRC | 13:30 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Make the openvswitch 2.4->2.5 upgrade more robust https://review.openstack.org/399708 | 13:30 |
| thrash | d0ugal: sounds like it's not set where it should be, so a password is being generated. | 13:31 |
| d0ugal | thrash: tripleoclient does it during the merging and finding users environments I think | 13:31 |
| d0ugal | thrash: the plan is created before the user deploys, so it is always generated. | 13:31 |
| *** Vijayendra has joined #tripleo | 13:31 | |
| d0ugal | (unless a stack exists) | 13:31 |
| thrash | d0ugal: ok. | 13:31 |
| thrash | d0ugal: ahhh | 13:32 |
| thrash | d0ugal: I think I see the problem... | 13:32 |
| thrash | d0ugal: the AdminPassword that is set is done in the 'parameter_defaults' section, but what is in the passwords section is the generated password. | 13:33 |
| d0ugal | thrash: yeah, that is what I'd expect. | 13:33 |
| *** pradk has joined #tripleo | 13:33 | |
| d0ugal | thrash: brb, gotta take the dog out before the tripleo meeting | 13:33 |
| thrash | d0ugal: I'm missing something here... | 13:33 |
| thrash | d0ugal: I'll keep digging into mcornea's env | 13:33 |
| d0ugal | thrash: :) I can take a look in a bit | 13:34 |
| d0ugal | thrash: thanks | 13:34 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Repositories setup role https://review.openstack.org/408162 | 13:34 |
| *** trown|outtypewww is now known as trown | 13:35 | |
| akrivoka | EmilienM: do you know if it's possible to send a calendar invite for the deep dive? do I just invite the openstack-dev mailing list? | 13:40 |
| *** rlandy has joined #tripleo | 13:40 | |
| *** jpena is now known as jpena|lunch | 13:41 | |
| shardy | akrivoka: I think previously we just added details to https://etherpad.openstack.org/p/tripleo-deep-dive-topics and manually emailed the ML | 13:41 |
| EmilienM | akrivoka: don't do that | 13:42 |
| akrivoka | shardy: I already did that, but some folks expressed desire for a calendar invite | 13:42 |
| EmilienM | akrivoka: it will spam :D | 13:42 |
| *** limao has joined #tripleo | 13:42 | |
| akrivoka | k :) | 13:42 |
| EmilienM | akrivoka: you can ask in the etherpad who wants to be invited and put their email | 13:42 |
| EmilienM | akrivoka: you can already invite me ! | 13:42 |
| shardy | akrivoka: Yeah I don't think we want to mail the whole list - my workaround was just to create an appointment in my own calendar | 13:43 |
| *** bfournie has joined #tripleo | 13:44 | |
| *** amoralej is now known as amoralej|lunch | 13:44 | |
| *** limao_ has joined #tripleo | 13:44 | |
| *** dsariel has joined #tripleo | 13:45 | |
| akrivoka | ok, thanks guys | 13:45 |
| *** limao has quit IRC | 13:46 | |
| *** dsariel has quit IRC | 13:47 | |
| *** dsariel has joined #tripleo | 13:47 | |
| openstackgerrit | Flavio Percoco proposed openstack/puppet-tripleo: Sync the db as part of the glance-api install https://review.openstack.org/408163 | 13:48 |
| EmilienM | weekly meeting in 10 min, feel free to add off items https://etherpad.openstack.org/p/tripleo-meeting-items | 13:48 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute https://review.openstack.org/400986 | 13:49 |
| *** jkilpatr has quit IRC | 13:49 | |
| *** kjw3 has joined #tripleo | 13:49 | |
| openstackgerrit | Flavio Percoco proposed openstack/puppet-tripleo: Sync the db as part of the glance-api install https://review.openstack.org/408163 | 13:50 |
| *** prateek has joined #tripleo | 13:51 | |
| flaper87 | trown: btw, this is the proper fix for the docutils problem: https://review.openstack.org/#/c/409630/ | 13:52 |
| trown | flaper87: cool | 13:53 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add CI matrix to THT https://review.openstack.org/409692 | 13:56 |
| *** flepied has quit IRC | 13:56 | |
| *** jcoufal has joined #tripleo | 13:57 | |
| *** udesale has joined #tripleo | 13:58 | |
| *** ayoung has joined #tripleo | 13:58 | |
| EmilienM | tripleo meeting! | 13:59 |
| *** dprince has joined #tripleo | 14:02 | |
| *** jeckersb_gone is now known as jeckersb | 14:02 | |
| *** gchamoul is now known as gchamoul|afk | 14:04 | |
| *** gchamoul|afk is now known as gchamoul | 14:05 | |
| *** jkilpatr has joined #tripleo | 14:06 | |
| thrash | d0ugal: So, it gets pulled out of the stack_env correctly. But the mistral environment never gets updated, and it seems to be the winner on what the value should be. | 14:06 |
| *** morazi has joined #tripleo | 14:06 | |
| *** jkilpatr_ has joined #tripleo | 14:08 | |
| thrash | d0ugal: this is the problem area: https://github.com/openstack/tripleo-common/blob/stable/newton/tripleo_common/actions/parameters.py#L170-L174 | 14:08 |
| *** lucas-hungry is now known as lucasagomes | 14:08 | |
| *** jaosorior_brb is now known as jaosorior | 14:09 | |
| thrash | d0ugal: I think we should just be overwriting what's in the mistral env from the passwords dict that we get back from generate_overcloud_passwords | 14:09 |
| thrash | otherwise, what's in the mistral env will always win. | 14:10 |
| openstackgerrit | Merged openstack/tripleo-specs: Spec review: additional note on when to +2 https://review.openstack.org/407533 | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 14:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| thrash | d0ugal: so, if a password is later changed via an environment file, it will never be updated in the mistral env. | 14:10 |
| *** jkilpatr has quit IRC | 14:10 | |
| d0ugal | thrash: :/ it should be | 14:10 |
| d0ugal | I don't really understand | 14:10 |
| *** flepied has joined #tripleo | 14:11 | |
| thrash | d0ugal: let's talk after the meeting. | 14:11 |
| d0ugal | thrash: sure, I can probably track both if you want :) | 14:12 |
| *** egafford has joined #tripleo | 14:13 | |
| *** morazi has quit IRC | 14:14 | |
| *** Goneri has joined #tripleo | 14:15 | |
| thrash | d0ugal: fine with me. :) So, this line: https://github.com/openstack/tripleo-common/blob/stable/newton/tripleo_common/actions/parameters.py#L164 | 14:16 |
| thrash | d0ugal: that returns the correct password that was set in the env file. | 14:16 |
| thrash | but then in 172-174, it doesn't overwrite what's came from the mistral environment. | 14:17 |
| thrash | imho the mistral environment should be the lowest priority | 14:17 |
| d0ugal | It is. | 14:17 |
| thrash | no it isn't. :) | 14:17 |
| thrash | because of the 'if' statement. | 14:17 |
| d0ugal | thrash: https://github.com/openstack/tripleo-common/blob/stable/newton/tripleo_common/actions/templates.py#L220-L228 | 14:18 |
| thrash | that will only update the mistral environment if that password doesn't already exist in the mistral env | 14:18 |
| *** paramite has quit IRC | 14:18 | |
| d0ugal | thrash: the design was for the passwords part of the environment to never be updated. | 14:19 |
| thrash | d0ugal: but that's not in the call flow when the overcloudrc is generated | 14:19 |
| thrash | d0ugal: then that isn't the lowest priority | 14:19 |
| thrash | and like I said, that's not in play when the overcloudrc is generated. | 14:19 |
| thrash | if the mistral env is never updated, it will always win out here: https://github.com/openstack/tripleo-common/blob/stable/newton/tripleo_common/actions/parameters.py#L172-L174 | 14:20 |
| thrash | and that's what's returned. | 14:20 |
| *** dmsimard has quit IRC | 14:21 | |
| thrash | is the straight-up mistral env passwords | 14:21 |
| *** dmsimard has joined #tripleo | 14:21 | |
| *** Vijayendra has quit IRC | 14:21 | |
| dprince | flaper87: taling about db-syncs in the tripleo openstack-meeting FWIW | 14:21 |
| dprince | flaper87: check the logs there today for what bandini is doing | 14:22 |
| d0ugal | thrash: IMO the bug is that the get_passwords workflow is calling generate_passwords. | 14:22 |
| d0ugal | thrash: getting should never generate. | 14:22 |
| flaper87 | dprince: what hannel ? | 14:22 |
| thrash | d0ugal: so we need a read-only that will do the merge properly... | 14:22 |
| d0ugal | flaper87: #openstack-meeting-alt | 14:22 |
| flaper87 | gotcha | 14:23 |
| flaper87 | thanks | 14:23 |
| thrash | d0ugal: I still say there's a bug in the GeneratePasswordsAction though. :) | 14:23 |
| d0ugal | thrash: maybe, but I still don't understand it | 14:24 |
| d0ugal | thrash: user parameters go in parameter_defaults, not "passwords" | 14:25 |
| thrash | d0ugal: right... | 14:25 |
| *** dsneddon has quit IRC | 14:25 | |
| thrash | d0ugal: however, what I'm saying is that because of L172-174, if those are ever changed in parameter_defaults, it will *never* be reflected in the return from GeneratePasswordsAction | 14:25 |
| thrash | which to me is incorrect. | 14:26 |
| d0ugal | thrash: sure, then generate_passwords just shouldn't return anything | 14:26 |
| jaosorior | thrash: hey dude, did something change recently in the overcloud image build? It seems that nowadays the images contain the ipa-client package, but not the dependencies needed (kerberos and its utils are missing :/ ) | 14:26 |
| d0ugal | thrash: that is the mistake | 14:26 |
| d0ugal | thrash: because generate passwords shouldn't handle merging | 14:26 |
| *** pabelanger has left #tripleo | 14:27 | |
| *** morazi has joined #tripleo | 14:27 | |
| thrash | d0ugal: i think that's the problem. Since you don't think that should happen, you don't see a bug. Me not understanding the intent, I see a bug. :) | 14:27 |
| d0ugal | thrash: lol | 14:27 |
| thrash | jaosorior: in what way? how recent? | 14:27 |
| jaosorior | thrash: what do you mean in what way? | 14:28 |
| *** dmsimard has quit IRC | 14:28 | |
| jaosorior | thrash: well, did a deployment on the end of last week, and that's what I've been seeing :/ | 14:28 |
| *** dmsimard has joined #tripleo | 14:28 | |
| thrash | jaosorior: I guess you already said how... | 14:28 |
| d0ugal | thrash: at least I fixed this in ocata already - but the backport is probably a bit big. | 14:28 |
| *** dmsimard has quit IRC | 14:28 | |
| thrash | d0ugal: ack | 14:28 |
| d0ugal | thrash: well, almost fixed in Ocata, just needs CI to work :) https://review.openstack.org/#/c/398975/ | 14:29 |
| thrash | jaosorior: let me look, but I don't think the definitions have changed... It could be a packaging thing. | 14:29 |
| *** saneax is now known as saneax-_-|AFK | 14:29 | |
| jkilpatr_ | so I have a question about the default settings in overcloud images, I assume most of them are just imported from $distro | 14:29 |
| jkilpatr_ | ? | 14:29 |
| *** dmsimard has joined #tripleo | 14:30 | |
| jkilpatr_ | particularly I would like to change sshd's default settings so that it does not resolve hostnames of connecting users, it's a serious constraint when dns servers are slow | 14:30 |
| jkilpatr_ | for whatever reason. | 14:30 |
| trown | jkilpatr_: easiest thing to do would be to use virt-customize to make changes on the overcloud image before uploading to glance | 14:32 |
| thrash | jaosorior: it could have been an element. | 14:33 |
| jkilpatr_ | trown, that could work. Thanks | 14:33 |
| thrash | jaosorior: nothing major has changed as far as the base of the image build. | 14:34 |
| jaosorior | thrash: an element? | 14:34 |
| thrash | jaosorior: yeah... one of the dib elements used for building the image. | 14:34 |
| thrash | jaosorior: but my guess really is that the packaging for ipa-client changed and no longer automatically pulls those deps in. | 14:35 |
| *** ramishra has quit IRC | 14:35 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: docker: don't use custom run-os-net-config https://review.openstack.org/407289 | 14:35 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Don't rely on lsb_release for hosts template write https://review.openstack.org/407759 | 14:36 |
| *** amoralej|lunch is now known as amoralej | 14:36 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common: Add FreeIPA enrollment environment generator https://review.openstack.org/409165 | 14:36 |
| thrash | jaosorior: ipa-client requires krb5-workstation. that's all I see it pulling in. | 14:38 |
| thrash | jaosorior: and libkrb5.so | 14:38 |
| jaosorior | thrash: I just had to install it manually cause it didn't pull that, for some reason | 14:38 |
| thrash | jaosorior: yeah... that's on dib. :) | 14:38 |
| jaosorior | :( | 14:39 |
| thrash | the image build is just a wrapper around that. | 14:39 |
| *** egafford has quit IRC | 14:39 | |
| thrash | not sure what would have changed to affect that. It doesn't look like the packaging for ipa-client has changed... | 14:39 |
| jaosorior | nothing should have changed on that side :/ | 14:40 |
| thrash | jaosorior: let me run an image build and see what the logs tell me (if anything) | 14:41 |
| jaosorior | thrash: sure | 14:41 |
| *** paramite has joined #tripleo | 14:42 | |
| thrash | jaosorior: I assume you are using the yaml image build? --config-file? | 14:42 |
| jaosorior | thrash: I'm using the the images that come from master-tripleo-ci via quickstart. AFAIU they use that? | 14:44 |
| jaosorior | trown: ?? ^^ | 14:44 |
| thrash | jaosorior: ack | 14:44 |
| thrash | jaosorior: they do | 14:44 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [overcloud-deploy] Update deprecated references to heat https://review.openstack.org/409178 | 14:45 |
| *** ramishra has joined #tripleo | 14:46 | |
| *** jpena|lunch is now known as jpena | 14:46 | |
| *** udesale has quit IRC | 14:49 | |
| thrash | d0ugal: so, who's fixing this? :) | 14:50 |
| thrash | d0ugal: i think you're right... you've already fixed it for ocata... And I think a backport is warranted... | 14:52 |
| thrash | d0ugal: imo... | 14:52 |
| *** jprovazn has quit IRC | 14:54 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras: prep-network: add support to IPv6 topology https://review.openstack.org/400837 | 14:54 |
| *** abehl has quit IRC | 14:57 | |
| marios | matbu: hey sanity check https://review.openstack.org/#/c/408669/6 is tested by you locally? | 14:57 |
| marios | matbu: otherwise lgtm we can +A | 14:58 |
| mwhahaha | ccamacho: rather doing the transport_url construction in THT, have you look at doing it like https://review.openstack.org/#/c/409911/ in puppet-tripleo? It's more flexible especially as we look to possibly replace rabbit with amqp | 14:59 |
| *** tzumainn has joined #tripleo | 14:59 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Pin docutils version https://review.openstack.org/409794 | 15:01 |
| *** saibarspeis has quit IRC | 15:01 | |
| ccamacho | mwhahaha awesome, Ill abandon that patch then | 15:01 |
| matbu | marios: yep | 15:02 |
| ccamacho | mwhahaha Ill push it for heat | 15:02 |
| matbu | marios: i know this is like a blind review since nothing is testing it automaticaly :/ | 15:02 |
| *** ealcaniz has joined #tripleo | 15:03 | |
| mwhahaha | ccamacho: sounds good, let me know if you run into issues. we're testing transport_url in p-o-i so it should be good | 15:03 |
| thrash | jaosorior: I see krb5-workstation, krb5-libs... | 15:04 |
| jaosorior | thrash: that's strange, I tried an hour ago and had issues with it. Must be an issue on my side then | 15:04 |
| d0ugal | thrash: sure, it is quite a bit backport. | 15:05 |
| d0ugal | thrash: I can do it. | 15:05 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Move the overcloudrc generation from tripleoclient to a Mistral action https://review.openstack.org/410255 | 15:05 |
| *** jayg is now known as jayg|g0n3 | 15:05 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Move the overcloudrc generation from tripleoclient to a Mistral action https://review.openstack.org/410255 | 15:05 |
| thrash | jaosorior: I'm need to look at a more recent image though. | 15:05 |
| d0ugal | thrash: ^ | 15:05 |
| thrash | d0ugal: ack | 15:05 |
| d0ugal | thrash: looks like it cherry-picks cleanly! | 15:05 |
| thrash | d0ugal: awesome. | 15:06 |
| d0ugal | I'll need to test it... once I figure out how | 15:06 |
| thrash | d0ugal: hopefully the client does as well. :) | 15:06 |
| marios | matbu: yeah thanks man i know you usually run things was just sanity checking/due diligence as far as i can bar actually running it | 15:07 |
| d0ugal | thrash: nope :( | 15:07 |
| thrash | :| | 15:07 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test https://review.openstack.org/410108 | 15:08 |
| *** udesale has joined #tripleo | 15:08 | |
| *** nmathew- has joined #tripleo | 15:10 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 15:10 |
| *** udesale has quit IRC | 15:10 | |
| *** udesale has joined #tripleo | 15:10 | |
| *** nmathew has quit IRC | 15:11 | |
| marios | appreciate another pass of https://review.openstack.org/#/c/399708/ when you get a chance matbu | 15:13 |
| sshnaidm | derekh, panda I think we have a new problem, postci functions is stuck forever | 15:13 |
| *** chlong has quit IRC | 15:13 | |
| *** ealcaniz is now known as ealcaniz|Orange | 15:16 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove white space between print () in plan_management.py https://review.openstack.org/410262 | 15:17 |
| d0ugal | thrash: ^ need that to fix pep8 in newton | 15:19 |
| matbu | marios: ha yep i'll take a look | 15:23 |
| matbu | marios: i was testing your step0 review, but my undercloud is broken | 15:23 |
| marios | matbu: thanks for looking there.. .i concentrated on getting https://review.openstack.org/#/c/399708/ working today (yesterday the upgrade level nova compute param wasn't getting set because the heredoc had '') | 15:24 |
| *** prateek has quit IRC | 15:24 | |
| marios | matbu: so i didn't get to cycle back to https://review.openstack.org/#/c/408631/ - though i did reset my osp10 env to vanila ready for testing so will get to it tomorrow | 15:24 |
| *** jayg|g0n3 is now known as jayg | 15:25 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action https://review.openstack.org/410272 | 15:27 |
| d0ugal | thrash: ^ | 15:27 |
| derekh | sshnaidm: hmm, but the error with running out of space is gone? if yes I say we merge the fix and move onto the next problem (I'm assuming its not related doesn't look like it is) | 15:30 |
| *** prateek has joined #tripleo | 15:30 | |
| sshnaidm | derekh, yes, this error is gone | 15:30 |
| EmilienM | sshnaidm, derekh: I'm approving the patch, I saw some ovb jobs passing | 15:32 |
| derekh | EmilienM: sshnaidm I've A+'d it | 15:32 |
| EmilienM | ok | 15:32 |
| sshnaidm | great | 15:32 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Create nova_api db during the controller upgrade https://review.openstack.org/408669 | 15:33 |
| *** sanagikoki has joined #tripleo | 15:34 | |
| *** udesale has quit IRC | 15:34 | |
| *** aufi has quit IRC | 15:38 | |
| *** rhallisey has quit IRC | 15:38 | |
| *** zoli|afk is now known as zoli|wfh | 15:40 | |
| dmsimard | slagle, EmilienM: did we really get openstack-infra to give us 3 nodes in multinode job ? | 15:40 |
| EmilienM | dmsimard: yes, why not? | 15:41 |
| dmsimard | EmilienM: it was a big deal to move from 2 node to 3 node | 15:41 |
| EmilienM | as long as 1) we don't waste resources 2) have a use-case -- there is no blocker. | 15:42 |
| dmsimard | in terms of nodepool, it means they need to potentially pre-provision sets of nodes/images just for 3 nodes | 15:42 |
| *** links has quit IRC | 15:42 | |
| dmsimard | clarkb was blocking that hard iirc so just surprised we ended up getting it | 15:42 |
| *** brault_ has quit IRC | 15:42 | |
| EmilienM | dmsimard: https://review.openstack.org/#/c/393482/ | 15:43 |
| EmilienM | dmsimard: he +2-ed it :) | 15:43 |
| EmilienM | d0ugal: is it related to the AdminPassword thing? https://review.openstack.org/#/c/410255/ | 15:45 |
| d0ugal | EmilienM: Yup. | 15:45 |
| d0ugal | EmilienM: turns out it was a new issue, by chance I had a fix in Ocata for it. | 15:46 |
| dmsimard | nice | 15:46 |
| d0ugal | EmilienM: it also needs https://review.openstack.org/#/c/410272/ (but see the comment I added) | 15:46 |
| *** saneax-_-|AFK is now known as saneax | 15:48 | |
| *** etp has quit IRC | 15:49 | |
| *** sshnaidm is now known as sshnaidm|mtg | 15:49 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds output for failure cases to delete plan action https://review.openstack.org/407624 | 15:49 |
| EmilienM | d0ugal: thanks a lot :D | 15:50 |
| *** egafford has joined #tripleo | 15:52 | |
| *** Goneri has quit IRC | 15:55 | |
| *** dmarlin has joined #tripleo | 15:55 | |
| *** yprokule has quit IRC | 15:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-specs: Prepare tripleo-specs for Pike cycle https://review.openstack.org/410286 | 15:56 |
| EmilienM | d0ugal: feel free to +A https://review.openstack.org/#/c/410255/ when CI is green | 15:57 |
| EmilienM | d0ugal: same for https://review.openstack.org/#/c/398975/ | 15:57 |
| *** florianf has quit IRC | 15:58 | |
| *** chandankumar is now known as chandankumar|off | 15:58 | |
| EmilienM | d0ugal: should we set https://bugs.launchpad.net/tripleo/+bug/1649576 as duplicate then? | 15:58 |
| openstack | Launchpad bug 1649576 in tripleo "User-defined AdminPassword is not correctly set in overcloudrc " [High,Triaged] | 15:58 |
| *** rajinir has joined #tripleo | 15:59 | |
| *** florianf has joined #tripleo | 15:59 | |
| d0ugal | EmilienM: thanks, keeping an eye on CI | 16:00 |
| d0ugal | EmilienM: Yeah, duplicate makes sense I guess. It is a slight different bug, just happens that we fixed it at the same time. | 16:00 |
| EmilienM | mcornea: fyi ^ I closed your bug as dup do d0ugal's bug as it should fix it | 16:01 |
| mcornea | EmilienM: ack | 16:01 |
| *** jlinkes has quit IRC | 16:02 | |
| beagles | wth .. can't login to gerrit with my openid. Getting a page with "OpenID provider not permitted by site policy" | 16:03 |
| beagles | anybody ever see something like that before? | 16:03 |
| *** abregman has quit IRC | 16:04 | |
| *** rcernin has quit IRC | 16:04 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Implement stack update as mistral actions https://review.openstack.org/379516 | 16:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-specs: Prepare tripleo-specs for Pike cycle https://review.openstack.org/410286 | 16:08 |
| *** Goneri has joined #tripleo | 16:08 | |
| *** pcaruana has quit IRC | 16:09 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Install gcc to use upstream PXE https://review.openstack.org/410293 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Triaged] | 16:10 |
| * beagles checks infra.. seems something is afoot and being handled | 16:10 | |
| *** jaosorior has quit IRC | 16:12 | |
| *** tremble has quit IRC | 16:13 | |
| EmilienM | derekh, sshnaidm|mtg : removing the alert on ^ | 16:13 |
| *** jaosorior has joined #tripleo | 16:13 | |
| *** bfournie has left #tripleo | 16:16 | |
| thrash | jaosorior: I checked the latest images, and krb5-libs and krb5-workstation was present. Is there something else you expect to be there? | 16:17 |
| *** yamahata has joined #tripleo | 16:18 | |
| *** bfournie has joined #tripleo | 16:19 | |
| *** limao_ has quit IRC | 16:21 | |
| *** limao has joined #tripleo | 16:21 | |
| jaosorior | thrash: well, thats good! means that it's a messup on my side then | 16:21 |
| jaosorior | thrash: for some reason it was missing on my images | 16:21 |
| thrash | jaosorior: You might want to try either building them yourself or pull them again. | 16:22 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient: Fix plan delete https://review.openstack.org/408296 | 16:24 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Allow disabling manifests https://review.openstack.org/358865 | 16:25 |
| ansiwen | maybe someone can confirm, that this CI failure has nothing to do with my change, because again I don't find a problem besides "No valid host was found." http://logs.openstack.org/67/406167/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/5f5ee4e/console.html | 16:26 |
| jaosorior | thrash: I'll do that | 16:26 |
| jaosorior | thanks dude | 16:26 |
| thrash | jaosorior: no problemo | 16:26 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Block the workflow until the stack is COMPLETE or FAILED https://review.openstack.org/407741 | 16:27 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Add utility workflow to wait for stack COMPLETE or FAILED https://review.openstack.org/407740 | 16:27 |
| -openstackstatus- NOTICE: Launchpad SSO is not currently working, so logins to our services like review.openstack.org and wiki.openstack.org are failing; the admins at Canonical are looking into the issue but there is no estimated time for a fix yet. | 16:27 | |
| *** ChanServ changes topic to "Launchpad SSO is not currently working, so logins to our services like review.openstack.org and wiki.openstack.org are failing; the admins at Canonical are looking into the issue but there is no estimated time for a fix yet." | 16:27 | |
| EmilienM | bnemec, sshnaidm|mtg, derekh: sounds like we still have some CI failures | 16:28 |
| EmilienM | http://logs.openstack.org/42/409342/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/32aa8f6/console.html#_2016-12-13_13_50_52_765309 | 16:28 |
| *** jaosorior has quit IRC | 16:28 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Allow disabling manifests https://review.openstack.org/358865 | 16:28 |
| bnemec | EmilienM: How do you know? Didn't the disk cleanup patch just merge? | 16:28 |
| EmilienM | bnemec: they did manual cleanup no? | 16:29 |
| ansiwen | EmilienM: I have exactly the same error | 16:29 |
| EmilienM | bnemec: I'll wait end of day before closing this bug, making sure we're stable again with this patch merged | 16:29 |
| bnemec | EmilienM: It's not possible to manually clean this up. It's a problem on the undercloud vms. | 16:29 |
| bnemec | See http://logs.openstack.org/42/409342/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/32aa8f6/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz?level=ERROR | 16:29 |
| EmilienM | bnemec: ok. I was just a bit fast in closing it, I'll wait a bit | 16:29 |
| bnemec | That job failed on the disk space error. | 16:29 |
| bnemec | EmilienM: Maybe call it fix committed? | 16:30 |
| EmilienM | bnemec: sounds good | 16:30 |
| *** zaneb has quit IRC | 16:30 | |
| derekh | EmilienM: bnemec it hasn't merged yet https://review.openstack.org/#/c/410131/ | 16:30 |
| openstackgerrit | Alejandro Andreu proposed openstack/tripleo-puppet-elements: Install Curator from RPM in MidoNet element https://review.openstack.org/410301 | 16:31 |
| bnemec | Okay, maybe not fix committed then. :-) | 16:31 |
| derekh | fix queued | 16:31 |
| derekh | is that a thing | 16:31 |
| owalsh | are we using a undercloud for multiple deploys? swift tends to use up all the disk eventually... | 16:34 |
| *** Goneri has quit IRC | 16:34 | |
| pradk | is anyone seeing this error deploying undercloud https://paste.fedoraproject.org/505822/64685414/ ? | 16:35 |
| *** panda is now known as panda|bbl | 16:37 | |
| derekh | the only thing stopping me taking a hammer to a particular server at the moment is that I don't know what country its in | 16:39 |
| *** etp has joined #tripleo | 16:39 | |
| *** limao has quit IRC | 16:39 | |
| *** limao has joined #tripleo | 16:40 | |
| *** sshnaidm|mtg is now known as sshnaidm | 16:40 | |
| *** dsariel has quit IRC | 16:41 | |
| *** ealcaniz|Orange has quit IRC | 16:41 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add undercloud roles data and environment https://review.openstack.org/352037 | 16:45 |
| *** zaneb has joined #tripleo | 16:45 | |
| *** chlong has joined #tripleo | 16:45 | |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient: Deploy the undercloud with Heat https://review.openstack.org/351351 | 16:46 |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: Switch to openSUSE Leap 42.2 release by default https://review.openstack.org/409071 | 16:49 |
| *** zoli|wfh is now known as zoli|brb | 16:51 | |
| *** iranzo has quit IRC | 16:52 | |
| *** aufi has joined #tripleo | 16:52 | |
| *** lmiccini has quit IRC | 16:57 | |
| sshnaidm | derekh, you need a geoip :) | 16:58 |
| derekh | sshnaidm: ;-) | 16:59 |
| *** rcernin has joined #tripleo | 17:00 | |
| *** Slower_ is now known as Slower | 17:01 | |
| *** ChanServ changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 17:04 | |
| -openstackstatus- NOTICE: Canonical admins have resolved the issue with login.launchpad.net, so authentication should be restored now. | 17:04 | |
| *** kodokuu has quit IRC | 17:05 | |
| sshnaidm | derekh, I found a way to remove swapfile too, just swapoff /root/swapfile. Will do this in next patch too | 17:06 |
| shardy | owalsh: I often keep underclouds running for weeks at a time, upgrading often and doing numerous overcloud deploys every day | 17:07 |
| shardy | owalsh: have you uploaded a lot of new images? | 17:07 |
| shardy | with glance backed by swift that soon eats a lot of disk space, as the old images are renamed not deleted | 17:07 |
| owalsh | shardy: yea, lots of images | 17:09 |
| shardy | owalsh: try deleting some of the old ones you don't need :) | 17:09 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove swapfile from undercloud https://review.openstack.org/410323 | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 17:10 |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| *** akuznetsov has joined #tripleo | 17:10 | |
| *** flepied has quit IRC | 17:11 | |
| *** dsneddon has joined #tripleo | 17:12 | |
| *** mcornea has quit IRC | 17:14 | |
| *** zoli|brb is now known as zoli|wfh | 17:19 | |
| *** jpich has quit IRC | 17:19 | |
| *** akuznetsov has quit IRC | 17:21 | |
| *** masco has quit IRC | 17:22 | |
| *** fragatina has joined #tripleo | 17:22 | |
| *** hewbrocca is now known as hewbrocca_afk | 17:23 | |
| *** fragatina has quit IRC | 17:23 | |
| *** fragatina has joined #tripleo | 17:23 | |
| *** rcernin has quit IRC | 17:24 | |
| *** flepied has joined #tripleo | 17:25 | |
| *** bogdando has quit IRC | 17:25 | |
| *** fragatina has quit IRC | 17:26 | |
| *** fragatina has joined #tripleo | 17:26 | |
| *** rbowen has quit IRC | 17:27 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Use transport_url for heat https://review.openstack.org/410333 | 17:28 |
| *** akuznetsov has joined #tripleo | 17:30 | |
| *** ohamada has quit IRC | 17:33 | |
| *** athomas has quit IRC | 17:33 | |
| *** masco has joined #tripleo | 17:34 | |
| *** ccamacho has quit IRC | 17:35 | |
| *** rcernin has joined #tripleo | 17:35 | |
| *** rcernin has quit IRC | 17:35 | |
| *** fragatina has quit IRC | 17:35 | |
| *** b00tcat has quit IRC | 17:36 | |
| *** rbowen has joined #tripleo | 17:39 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Revert "Revert "Show team and repo badges on README"" https://review.openstack.org/409216 | 17:41 |
| *** fragatina has joined #tripleo | 17:41 | |
| *** fragatina has quit IRC | 17:42 | |
| *** akuznetsov has quit IRC | 17:42 | |
| *** fragatina has joined #tripleo | 17:42 | |
| *** akuznetsov has joined #tripleo | 17:43 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove dead mocks and dead code https://review.openstack.org/409130 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the keystone_pki cert generation from tripleoclient https://review.openstack.org/409198 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action https://review.openstack.org/398975 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused get_config_value function https://review.openstack.org/409255 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: [WIP] Respond to multiple messages from workflow executions https://review.openstack.org/406178 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused delete image function https://review.openstack.org/409258 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused constant RESOURCE_REGISTRY_NAME https://review.openstack.org/409256 | 17:43 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove two unused Exception subclasses https://review.openstack.org/409257 | 17:43 |
| *** nmathew- has quit IRC | 17:43 | |
| *** derekh has quit IRC | 17:43 | |
| * d0ugal drops mic and heads to his Red Hat christmas dinner | 17:44 | |
| shardy | enjoy d0ugal | 17:44 |
| *** yamahata has quit IRC | 17:45 | |
| *** prateek has quit IRC | 17:46 | |
| *** fragatina has quit IRC | 17:48 | |
| *** masco has quit IRC | 17:50 | |
| *** lucasagomes is now known as lucas-afk | 17:50 | |
| *** prateek has joined #tripleo | 17:51 | |
| *** jpena is now known as jpena|off | 17:52 | |
| *** milan has quit IRC | 17:57 | |
| *** akuznetsov has quit IRC | 18:05 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Use transport_url for heat https://review.openstack.org/410333 | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 18:10 |
| *** dtantsur is now known as dtantsur|afk | 18:10 | |
| *** dmacpher is now known as dmacpher-afk | 18:12 | |
| *** aufi has quit IRC | 18:12 | |
| EmilienM | can someone review slagle's work for 3-nodes CI jobs? | 18:16 |
| EmilienM | https://review.openstack.org/#/c/385160/ | 18:16 |
| EmilienM | https://review.openstack.org/#/c/385162/ | 18:16 |
| EmilienM | and https://review.openstack.org/#/c/397441/ | 18:17 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-specs: Prepare tripleo-specs for Pike cycle https://review.openstack.org/410286 | 18:17 |
| *** jprovazn has joined #tripleo | 18:19 | |
| openstackgerrit | Merged openstack/tripleo-specs: GUI Deployment Configuration improvements https://review.openstack.org/393365 | 18:23 |
| openstackgerrit | Merged openstack/tripleo-specs: Validations in TripleO Workflows https://review.openstack.org/393281 | 18:24 |
| *** yamahata has joined #tripleo | 18:25 | |
| *** pkovar has quit IRC | 18:29 | |
| *** fragatina has joined #tripleo | 18:29 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: move the undercloud deploy role from quickstart to quickstart-extras https://review.openstack.org/410353 | 18:33 |
| *** tosky has quit IRC | 18:36 | |
| *** rasca has quit IRC | 18:37 | |
| *** yamahata_ has joined #tripleo | 18:37 | |
| *** yamahata has quit IRC | 18:37 | |
| *** florianf has quit IRC | 18:39 | |
| shardy | matbu: Hey if you're still around, are you OK with me pushing to https://review.openstack.org/#/c/404831 or would you like me to create a new review? | 18:39 |
| shardy | I've started testing locally and have a few fixes nearly ready | 18:40 |
| *** ctayal has joined #tripleo | 18:42 | |
| *** shardy is now known as shardy_afk | 18:43 | |
| Slower | stevebaker!! | 18:44 |
| Slower | woah | 18:45 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Make libvirt_cpu_mode configurable, default to none when using qemu https://review.openstack.org/410358 | 18:52 |
| *** dsariel has joined #tripleo | 18:53 | |
| *** dprince has quit IRC | 18:54 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci: Default libvirt_cpu_mode to none when using qemu https://review.openstack.org/410359 | 18:54 |
| EmilienM | mwhahaha: quick question about transport_url | 18:55 |
| EmilienM | mwhahaha: if I do https://review.openstack.org/#/c/409911/6 but we still have old params in THT (for ex: ssl) who wins? | 18:55 |
| *** nyechiel has quit IRC | 18:55 | |
| mwhahaha | no one, no one wins :D | 18:56 |
| mwhahaha | so that's an oslo question | 18:56 |
| mwhahaha | I'd assume the newer one but that might be service specific | 18:56 |
| EmilienM | mwhahaha: i'm wondering if my patch ^ breaks SSL | 18:56 |
| EmilienM | I think yes. In any case, I need to change this 0/1 thing you did to be False/true. Wdyt? | 18:57 |
| mwhahaha | for the os_transport_url function? | 18:57 |
| mwhahaha | maybe | 18:57 |
| mwhahaha | i'm not sure which wins in the case of the ssl via url or the rabbit_use_ssl flag | 18:57 |
| mwhahaha | the rabbit_use_ssl flag is not deprecated in oslo | 18:57 |
| mwhahaha | at least afaik | 18:58 |
| EmilienM | oh ok | 18:58 |
| EmilienM | mwhahaha: so https://review.openstack.org/#/c/409911/ might be good to go | 18:58 |
| EmilienM | I'll test it again with rabbit/ssl | 18:58 |
| mwhahaha | i wasn't even aware of the ssl via url until someone pointed it out to me | 18:58 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Revert "Revert "Show team and repo badges on README"" https://review.openstack.org/409216 | 19:00 |
| *** fragatina has quit IRC | 19:01 | |
| *** fragatina has joined #tripleo | 19:01 | |
| *** fragatina has quit IRC | 19:02 | |
| *** fragatina has joined #tripleo | 19:02 | |
| slagle | EmilienM: can you elaborate on what you were asking me about HA with 3 nodes during the tripleo meeting? | 19:03 |
| *** ctayal has quit IRC | 19:03 | |
| dhill_ | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1649124 | 19:03 |
| openstack | Launchpad bug 1649124 in tripleo "Failure to launch neutron-openvswitch-agent after tripleo deployment" [Undecided,New] | 19:03 |
| slagle | EmilienM: since we have to use one of the nodes for the undercloud, i dont see how that would work honestly | 19:03 |
| EmilienM | slagle: I was asking of a 2-nodes overcloud would be enough to test Composable HA but I think we might need more | 19:04 |
| EmilienM | dhill_: ? | 19:04 |
| *** ctayal has joined #tripleo | 19:04 | |
| slagle | EmilienM: however, in my current 3-node job, i am actually using pacemaker and creating a cluster of 1, which is more coverage than we currently have in multinode (does not use pacemaker) | 19:04 |
| dhill_ | EmilienM, it affects newton and ocata | 19:04 |
| *** nyechiel has joined #tripleo | 19:04 | |
| EmilienM | slagle: so maybe in 3-node we could have a 2 clusters of 1? | 19:05 |
| slagle | EmilienM: yea, we could probably add another job that does that | 19:05 |
| *** leanderthal is now known as leanderthal|afk | 19:06 | |
| EmilienM | slagle: and we could run this job only when we touch the pacemaker profiles | 19:06 |
| *** dprince has joined #tripleo | 19:08 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 19:10 |
| *** rcernin has joined #tripleo | 19:14 | |
| *** akrivoka has quit IRC | 19:18 | |
| *** panda|bbl is now known as panda | 19:19 | |
| *** paramite has quit IRC | 19:21 | |
| *** milan has joined #tripleo | 19:23 | |
| *** artom has quit IRC | 19:26 | |
| *** fragatina has quit IRC | 19:30 | |
| *** fragatina has joined #tripleo | 19:30 | |
| *** sudipto has quit IRC | 19:31 | |
| *** sudipto_ has quit IRC | 19:31 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Add workaround step to avoid introspection failure https://review.openstack.org/408748 | 19:43 |
| *** zoli|wfh is now known as zoli|gone | 19:43 | |
| *** nyechiel has quit IRC | 19:45 | |
| *** fpan has quit IRC | 19:53 | |
| *** another_larsks has joined #tripleo | 20:02 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 20:10 |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| *** limao has quit IRC | 20:13 | |
| *** limao has joined #tripleo | 20:13 | |
| stevebaker | morning | 20:15 |
| *** amoralej is now known as amoralej|off | 20:17 | |
| stevebaker | dprince: hey, I have questions about hiera element vs hook | 20:17 |
| dprince | stevebaker: sure, whats up? | 20:18 |
| stevebaker | dprince: will the hiera element still be needed? I thought I would be able to build a heat-agents container without any hiera element things but it didn't work | 20:19 |
| dprince | stevebaker: no need for it anymore. I was planning on removing it | 20:20 |
| dprince | stevebaker: I haven't been using the hiera element with the undercloud installer FWIW | 20:21 |
| dprince | stevebaker: and it seems to work just fine there. In fact I've now eliminated instack entirely | 20:21 |
| *** prateek has quit IRC | 20:22 | |
| dprince | stevebaker: so we've go a no-elements base installer. If it isn't working in the heat-agents container I wonder what is missing | 20:23 |
| stevebaker | dprince: ok, I'll try again. is any of lines 80-93 needed? http://git.openstack.org/cgit/openstack/tripleo-common/tree/heat_docker_agent/configure_container.sh#n80 | 20:23 |
| stevebaker | dprince: thats awesome | 20:23 |
| *** ctayal has quit IRC | 20:23 | |
| stevebaker | dprince: one thing on my list is to propose a heat-all container to kolla and try to switch your undercloud install to use that | 20:24 |
| dprince | stevebaker: is 55-heat-config in you agents container? | 20:25 |
| dprince | stevebaker: [root@demo2 os-refresh-config]# rpm -qif ./configure.d/55-heat-config | 20:25 |
| dprince | Name : python-heat-agent | 20:25 |
| stevebaker | dprince: yep, all installed via packages | 20:25 |
| dprince | stevebaker: should be as I think that package is a pre-req. Just wondering if the version got messed up or something with an old version of that package (pre, 55-heat-config) | 20:26 |
| stevebaker | nothing would work without it | 20:26 |
| dprince | stevebaker: regarding lines 80-93 I think most of those can be deleted now too | 20:27 |
| dprince | stevebaker: because the heat-agent sub packages take care of almost all that now | 20:27 |
| stevebaker | dprince: ok, I was wondering specifically about the hiera.yaml template, and the /etc symlink | 20:28 |
| dprince | stevebaker: that is the one I'd have to double check | 20:28 |
| dprince | stevebaker: it may still be required for some odd reason | 20:28 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras: Add validate-undercloud role to perform idempotency and simple verification https://review.openstack.org/410386 | 20:29 |
| *** fpan has joined #tripleo | 20:31 | |
| *** fzdarsky has quit IRC | 20:32 | |
| *** another_larsks has quit IRC | 20:35 | |
| Ng | if I wanted to change some heat parameters for a deployed overcloud, what would be the correct way to feed the updated values into heat? | 20:35 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras: Add overcloud delete role https://review.openstack.org/402228 | 20:35 |
| jidar | Ng: fairly sure the answer is just by re-running the deployment | 20:38 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: [WIP] - Add basic documentation for overcloud-upgrade role https://review.openstack.org/409328 | 20:38 |
| jidar | unless you're trying to include new templates into the deployment, which might require changing up how you include the post-deployment | 20:38 |
| *** another_larsks has joined #tripleo | 20:38 | |
| Ng | jidar: hmm, interesting | 20:39 |
| Ng | I was rather hoping I could just feed in a small yaml with the changed paramters, and do a stack update :) | 20:39 |
| *** shardy_afk is now known as shardy | 20:40 | |
| jidar | I don't think you can include arbitrary changes like that | 20:40 |
| jidar | rather, atomic changes I mean | 20:40 |
| shardy | Ng: both are correct actually - you can re-run openstack overcloud deploy with some new -e changes.yaml | 20:41 |
| shardy | Ng: that does a PATCH update to the heat stack, so all existing parameters are remembered | 20:41 |
| jidar | so if I've got this huge deploy command in a script, (like deploy.sh) and want to include a new one I don't have to run all the original includes? | 20:41 |
| jidar | that's a deviation from the original design for sure | 20:42 |
| *** another_larsks has quit IRC | 20:42 | |
| shardy | Ng: it is also technically possible to do a patch update of just e.g one parameter_default etc direct via heat, including nested stacks, I blogged about that here | 20:42 |
| Ng | I don't think I've asked a single question recently that hasn't resulted in a shardy blog post reference :D | 20:42 |
| shardy | jidar: it's worked like this for a long time, but passing all -e files is a good idea | 20:42 |
| shardy | jidar: otherwise it can get confusing as the updates are layered | 20:43 |
| jidar | ah, gotcha when was this updated? osp9-ish? | 20:43 |
| shardy | I added "openstack stack environment show" which helps see the current state | 20:43 |
| jidar | let me find that blog real quick | 20:43 |
| shardy | http://hardysteven.blogspot.co.uk/2016/06/tripleo-partial-stack-updates.html | 20:44 |
| shardy | sorry it's there | 20:44 |
| *** dbecker has quit IRC | 20:44 | |
| shardy | that's not reccomended for non-developer usage tho | 20:44 |
| shardy | just showing how it works under the hood | 20:44 |
| Ng | shardy: noted, thanks | 20:44 |
| jidar | yea, I'll stick to just updating deploy.sh for now but was curious how it worked | 20:44 |
| Ng | actually, let me ask about what I actually want to be doing - setting parameters *during* the overcloud deploy | 20:45 |
| Ng | I need to know the ironic:nova node name mapping, which isn't discoverable ahead of time :/ | 20:45 |
| jidar | you can manually set them though | 20:45 |
| shardy | Ng: it is predictable if you pin the node placement | 20:45 |
| * shardy finds docs | 20:46 | |
| jidar | https://access.redhat.com/documentation/en/red-hat-openstack-platform/9/paged/director-installation-and-usage/chapter-6-configuring-advanced-customizations-for-the-overcloud | 20:47 |
| jidar | 6.3. CONTROLLING NODE PLACEMENT | 20:47 |
| shardy | http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/node_placement.html#create-an-environment-file-with-scheduler-hints | 20:47 |
| jidar | ah yea, the non-RHEL docs :) | 20:47 |
| shardy | jidar: well, this is an upstream channel ;) | 20:47 |
| jidar | indeed | 20:47 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add network_config_hook interface to run-os-net-config.sh https://review.openstack.org/409342 | 20:48 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Synchronize NetworkDeployment inputs for generic roles https://review.openstack.org/409341 | 20:48 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add custom roles data for deployed-server https://review.openstack.org/410390 | 20:48 |
| Ng | interesting | 20:48 |
| jidar | I hope to be getting a beefy server at home soon to be running something more upstream-ish | 20:48 |
| shardy | Ng: if you use that approach then you can know ahead of time what node exactly will be used e.g for "controller-0" | 20:48 |
| jidar | I don't suppose you can pin the specific MAC address of each node? | 20:49 |
| Ng | shardy: and being only hints, it will still deploy even if the suggested node doesn't exist? | 20:49 |
| shardy | Ng: there are other approaches such as passing a big map into all nodes, then looking it up based on some unique identifier | 20:49 |
| jidar | oh I see, you're updating the ironic node | 20:49 |
| jidar | so that's moot | 20:49 |
| shardy | Ng: No, we have a tripleo specific filter so the deploy will fail if the match doesn't work | 20:49 |
| Ng | ok | 20:50 |
| Ng | in this specific case, that may not matter, since quickstart creates nodes with the right names | 20:50 |
| Ng | they just don't get used in the right order | 20:50 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use OS::Heat::DeployedServer https://review.openstack.org/407203 | 20:51 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add custom roles data for deployed-server https://review.openstack.org/410390 | 20:51 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add network_config_hook interface to run-os-net-config.sh https://review.openstack.org/409342 | 20:51 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Synchronize NetworkDeployment inputs for generic roles https://review.openstack.org/409341 | 20:51 |
| *** myoung|bbl is now known as myoung | 20:51 | |
| shardy | Ng: ah, so yeah I think the approach in the docs will help there | 20:51 |
| shardy | maybe it'd be good if quickstart had a way to generate the environment file to just have all that line up | 20:51 |
| *** jprovazn has quit IRC | 20:52 | |
| Ng | yeah | 20:52 |
| jidar | +1 | 20:52 |
| Ng | I might look into doing that once I've figured out how the heck to get this feature done and landed | 20:52 |
| jidar | generating a template first that you can edit would be awesome | 20:52 |
| * Ng looks at Friday approaching with haste | 20:52 | |
| shardy | Ng: we agreed in the TripleO meeting today that the hard feature freeze will be ocata-3, so you have some time - is your blueprint/spec approved? | 20:53 |
| Ng | shardy: OSP has this Friday as a soft feature freeze | 20:53 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use deployed-server custom roles data in CI https://review.openstack.org/410392 | 20:55 |
| sshnaidm | does it look similar to anybody? "from neutron.db import model_base; ImportError: cannot import name model_base" | 21:01 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 21:01 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804 https://review.openstack.org/406167 | 21:01 |
| *** another_larsks has joined #tripleo | 21:02 | |
| Ng | heh, I can indeed confirm that the hints cause the deployment to fail if it can't find the right nodes :) | 21:03 |
| *** rbowen has quit IRC | 21:05 | |
| *** jkilpatr_ has quit IRC | 21:05 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras: prep-network: add support to IPv6 topology https://review.openstack.org/400837 | 21:06 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Move rabbit port to string instead of number. https://review.openstack.org/410395 | 21:07 |
| *** rbowen has joined #tripleo | 21:09 | |
| *** another_larsks has quit IRC | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 21:10 |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| *** another_larsks has joined #tripleo | 21:10 | |
| sshnaidm | libvirt segfault, wow.. we try to collect all possible errors this week I think | 21:10 |
| EmilienM | sshnaidm: yeah and it's not finished | 21:11 |
| EmilienM | dmsimard has been working on the qemu thing | 21:11 |
| EmilienM | we'll probably hit that soon if not already | 21:11 |
| dmsimard | I replied on the internal ML thread about it in case anyone wants to join.. :( | 21:12 |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Use transport_url for heat https://review.openstack.org/410333 | 21:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Move rabbit port to string instead of number. https://review.openstack.org/410395 | 21:14 |
| panda | sshnaidm: do you know where postci.log is supposed to be ? | 21:16 |
| sshnaidm | panda, what do you mean..? | 21:17 |
| sshnaidm | panda, it's usually in logs http://logs.openstack.org/31/410131/4/gate/gate-tripleo-ci-centos-7-nonha-multinode/0be9824/logs/postci.txt.gz | 21:17 |
| panda | sshnaidm: the file postci.log, can't find it | 21:17 |
| sshnaidm | panda, where are you looking? | 21:17 |
| panda | sshnaidm: not postci.txt.gz, postci.log, the output of the postci command | 21:18 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Validate vips when generating certificate too https://review.openstack.org/400364 | 21:18 |
| sshnaidm | panda, nice zuul script take all log files and make them as txt and then gzip them, so it's the same | 21:18 |
| *** ctayal has joined #tripleo | 21:19 | |
| sshnaidm | panda, https://github.com/openstack-infra/devstack-gate/blob/a211da5fc78b655022354334424179f9ff4a2ee3/functions.sh#L1026-L1026 | 21:21 |
| *** gfidente has quit IRC | 21:21 | |
| panda | sshnaidm: ok, so the previous verify did not fail for a postci problem .. it returned 0 correctly | 21:21 |
| *** jkilpatr_ has joined #tripleo | 21:21 | |
| sshnaidm | panda, sometimes it returns 0, but stuck forever.. no idea why it happens | 21:22 |
| panda | sshnaidm: it may be a problem on other point of the chain ... maybe testenv client does not terminate | 21:22 |
| panda | sshnaidm: where's the libvirt problem ? | 21:23 |
| *** shardy has quit IRC | 21:25 | |
| *** jayg is now known as jayg|g0n3 | 21:25 | |
| sshnaidm | panda, I suppose here https://review.openstack.org/#/c/410131/ | 21:25 |
| *** rajinir has quit IRC | 21:26 | |
| *** sanagikoki has quit IRC | 21:26 | |
| panda | bnemec: where did you see the libvirt crash ? | 21:29 |
| bnemec | panda: http://logs.openstack.org/31/410131/4/check/gate-tripleo-ci-centos-7-nonha-multinode/1f61bd6/logs/subnode-2/var/log/messages | 21:30 |
| *** chlong has quit IRC | 21:30 | |
| openstackgerrit | Merged openstack/tripleo-common: Get config files for all openstack* packages https://review.openstack.org/409106 | 21:31 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Install docker in overcloud-base element https://review.openstack.org/402255 | 21:35 |
| *** dsneddon has quit IRC | 21:35 | |
| sshnaidm | postci is stuck for hour, damn.. http://logs.openstack.org/23/410323/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/07c3d26/console.html#_2016-12-13_20_58_12_863569 | 21:35 |
| *** amoralej|off is now known as amoralej | 21:36 | |
| bnemec | Man, I leave for a week and everything is broken when I get back. :-P | 21:38 |
| panda | this is like one of those star trek episodes, now Q pops up and it was all a joke. | 21:38 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates: Introduce role-specific NodeUserData, use for docker https://review.openstack.org/408374 | 21:38 |
| *** dprince has quit IRC | 21:39 | |
| *** dprince has joined #tripleo | 21:39 | |
| *** panda is now known as panda|Zz | 21:42 | |
| *** egafford has quit IRC | 21:43 | |
| *** ansmith has quit IRC | 21:46 | |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: Switch to openSUSE Leap 42.2 release by default https://review.openstack.org/409071 | 21:47 |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: Switch to openSUSE Leap 42.2 release by default https://review.openstack.org/409071 | 21:48 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/410413 | 21:50 |
| *** another_larsks has quit IRC | 21:50 | |
| *** dprince has quit IRC | 21:50 | |
| *** another_larsks has joined #tripleo | 21:51 | |
| *** jcoufal has quit IRC | 21:57 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add custom roles data for deployed-server https://review.openstack.org/410390 | 21:58 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add network_config_hook interface to run-os-net-config.sh https://review.openstack.org/409342 | 21:58 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Synchronize NetworkDeployment inputs for generic roles https://review.openstack.org/409341 | 21:58 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add custom roles data for deployed-server https://review.openstack.org/410390 | 21:59 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add network_config_hook interface to run-os-net-config.sh https://review.openstack.org/409342 | 21:59 |
| *** trown is now known as trown|outtypewww | 21:59 | |
| *** ctayal has quit IRC | 22:00 | |
| *** amoralej is now known as amoralej|off | 22:01 | |
| *** ctayal has joined #tripleo | 22:04 | |
| bnemec | Hmm, all of the ha jobs are timing out after postci runs? | 22:05 |
| bnemec | Weird. | 22:05 |
| EmilienM | bnemec: do we know where exactly? | 22:07 |
| *** rajinir has joined #tripleo | 22:08 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: move the undercloud deploy role to quickstart-extras for composability https://review.openstack.org/410427 | 22:09 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 22:10 |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| *** milan has quit IRC | 22:10 | |
| *** dsneddon has joined #tripleo | 22:17 | |
| bnemec | EmilienM: Not sure. I see postci return 0, which is the last line of the function: http://logs.openstack.org/01/410301/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8087c38/logs/postci.txt.gz | 22:18 |
| bnemec | But a bunch of time later the job gets killed by the timeout: http://logs.openstack.org/01/410301/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8087c38/console.html#_2016-12-13_20_04_50_625658 | 22:19 |
| EmilienM | ouch | 22:19 |
| *** bfournie has quit IRC | 22:19 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci: Default libvirt_cpu_mode to none when using qemu https://review.openstack.org/410359 | 22:20 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Make libvirt_cpu_mode configurable, default to none when using qemu https://review.openstack.org/410358 | 22:20 |
| dmsimard | EmilienM: like this? ^ | 22:21 |
| EmilienM | dmsimard: excellent | 22:21 |
| EmilienM | dmsimard: thank you | 22:22 |
| *** dsneddon has quit IRC | 22:22 | |
| *** dsneddon_ has joined #tripleo | 22:22 | |
| dmsimard | I guess I should add a Depends-On from the tripleo-ci patch to the t-h-t patch | 22:22 |
| dmsimard | right ? | 22:22 |
| dmsimard | Since it now uses the parameter | 22:22 |
| EmilienM | yes | 22:22 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci: Default libvirt_cpu_mode to none when using qemu https://review.openstack.org/410359 | 22:22 |
| dmsimard | ^ | 22:22 |
| bnemec | We need something similar that will apply to the ovb jobs. | 22:24 |
| dmsimard | the cpu_mode stuff ? | 22:24 |
| bnemec | Yeah | 22:25 |
| dmsimard | feel free to piggy back on those :p | 22:25 |
| bnemec | We're still doing nested virt there for the tenant stack. | 22:25 |
| dmsimard | doesn't affect kvm nested virt, though | 22:25 |
| dmsimard | just qemu with default cpu_mode | 22:25 |
| *** jkilpatr_ has quit IRC | 22:25 | |
| bnemec | Yeah, we don't do nested kvm anywhere. | 22:25 |
| EmilienM | any way to see what fails in the postci thing? i'm failing | 22:26 |
| EmilienM | dmsimard: I'm also concerned about stable CI & qemu thing | 22:28 |
| EmilienM | we'll need to somehow backport that thing | 22:28 |
| dmsimard | no kidding | 22:28 |
| dmsimard | why do you think I'm flipping out on the ML about it | 22:28 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: move the undercloud deploy role to quickstart-extras for composability https://review.openstack.org/410427 | 22:29 |
| dmsimard | We need to backport whatever fixes we're doing down to mitaka | 22:29 |
| dmsimard | and not just backport it but release it too, because it's too late already, 7.3 with 2.6.0 are out already | 22:29 |
| EmilienM | bnemec: how can we do it for ovb in your opinion? | 22:34 |
| bnemec | EmilienM: Either a new env file that we pass for the ovb jobs, or add it to the minimal memory env since it's targeted at virt deploys. | 22:35 |
| EmilienM | bnemec: sounds good to me | 22:38 |
| EmilienM | dmsimard: do you mind if I patch over your patch | 22:38 |
| EmilienM | over https://review.openstack.org/410359 I mean | 22:38 |
| dmsimard | what do you mean, rebase a patch on top of my patch ? | 22:38 |
| dmsimard | or a new patchset ? | 22:38 |
| EmilienM | new PS | 22:39 |
| dmsimard | eh go ahead | 22:39 |
| EmilienM | thx | 22:39 |
| dmsimard | for the OVB thing ? | 22:39 |
| EmilienM | yea | 22:39 |
| EmilienM | so we fix all in one | 22:39 |
| dmsimard | go for it | 22:39 |
| EmilienM | cool | 22:39 |
| dmsimard | I'm just trying to fix things, I don't care for the credit :p | 22:39 |
| bnemec | You still get credit. New patch sets don't change the author, just the committer. | 22:40 |
| EmilienM | dmsimard: we are lucky nova::compute::libvirt hasn't changed since Mitaka :D | 22:41 |
| EmilienM | so we can use the same param everywhere :D | 22:41 |
| dmsimard | heh | 22:42 |
| * EmilienM brings positive vibes here | 22:42 | |
| dmsimard | I'm not sure lucky is the right word but sure | 22:42 |
| EmilienM | dmsimard: so because tripleo-ci is branchless, we need to use hiera in the tripleo-ci patch until the THT patch is merged and backported. That's something we changed with scenarios when we moved the envs into THT | 22:49 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Default libvirt_cpu_mode to none when using qemu https://review.openstack.org/410359 | 22:50 |
| dmsimard | SO MY PATCH WAS FINE | 22:50 |
| dmsimard | you lied to me | 22:50 |
| dmsimard | lol | 22:50 |
| EmilienM | dmsimard: for THT it's good to have the param | 22:51 |
| EmilienM | dmsimard: it makes things usable from CLI and UI | 22:51 |
| EmilienM | dmsimard: so in the future, people will be able to select which value for the param from the UI | 22:52 |
| *** jeckersb is now known as jeckersb_gone | 22:56 | |
| openstackgerrit | Merged openstack/diskimage-builder: Don't set the executable bit on dhcp-interface@.service https://review.openstack.org/409863 | 22:56 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 23:00 |
| *** bfournie has joined #tripleo | 23:02 | |
| *** jkilpatr_ has joined #tripleo | 23:04 | |
| *** kjw3 has quit IRC | 23:06 | |
| jrist | dtrainor: you around | 23:09 |
| jrist | dtrainor: wondering about cors/%(token_id) tricks/tips | 23:09 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649615 | 23:10 |
| openstack | Launchpad bug 1649615 in tripleo "Undercloud running out of disk space in CI" [Critical,Fix committed] | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Support copying sources from directory https://review.openstack.org/405369 | 23:11 |
| *** dsneddon_ is now known as dsneddon | 23:12 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Build role: support using sources from directory https://review.openstack.org/405369 | 23:12 |
| *** limao has quit IRC | 23:18 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Move adduser to debian element from debootstrap https://review.openstack.org/410458 | 23:26 |
| openstackgerrit | Merged openstack/diskimage-builder: Make dib-python use the default python for distro https://review.openstack.org/408288 | 23:28 |
| *** dhill_ has quit IRC | 23:33 | |
| *** dhill__ has joined #tripleo | 23:33 | |
| *** dsneddon has quit IRC | 23:40 | |
| *** dsneddon has joined #tripleo | 23:41 | |
| *** dsneddon has quit IRC | 23:44 | |
| *** liverpooler has quit IRC | 23:47 | |
| *** dhill__ has quit IRC | 23:50 | |
| *** dhill_ has joined #tripleo | 23:50 | |
| openstackgerrit | Merged openstack/diskimage-builder: Put MKFS_OPTS after filesystem type https://review.openstack.org/408408 | 23:58 |
| openstackgerrit | Merged openstack/diskimage-builder: DIB element to support cinder local attach/detach functionality https://review.openstack.org/385880 | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!