| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 00:00 |
|---|---|---|
| *** owalsh has quit IRC | 00:00 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: standalone run a post config to generate a clouds.yaml https://review.openstack.org/575597 | 00:04 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Action to perform container image prepare https://review.openstack.org/558972 | 00:11 |
| *** mhenkel_ has joined #tripleo | 00:23 | |
| *** mjturek has quit IRC | 00:24 | |
| *** sri_ has quit IRC | 00:24 | |
| *** sri_ has joined #tripleo | 00:24 | |
| *** atarlov has joined #tripleo | 00:26 | |
| *** mhenkel_ has quit IRC | 00:27 | |
| *** atarlov has quit IRC | 00:30 | |
| *** itlinux has quit IRC | 00:34 | |
| *** dxiri has quit IRC | 00:35 | |
| *** dbecker has joined #tripleo | 00:36 | |
| *** rpioso is now known as rpioso|afk | 00:38 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Reliably build the subnode_ip_pair https://review.openstack.org/575553 | 00:41 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Ensure appropriate ACL mask is set on CephX keyrings https://review.openstack.org/573383 | 00:48 |
| *** bfournie has joined #tripleo | 00:52 | |
| *** stevebaker has quit IRC | 00:59 | |
| *** stevebaker has joined #tripleo | 01:01 | |
| *** spsurya has joined #tripleo | 01:08 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 01:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| *** dbecker has quit IRC | 01:12 | |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Pass DockerCephDaemonImage to CephMgr https://review.openstack.org/577072 | 01:12 |
| openstackgerrit | Merged openstack/tripleo-common master: Use the standard messaging in the support workbook https://review.openstack.org/576173 | 01:12 |
| openstackgerrit | Merged openstack/tripleo-common master: Stop assuming all containers are plans https://review.openstack.org/566345 | 01:12 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Conditionally Enable Nuage VRS https://review.openstack.org/572653 | 01:14 |
| *** mrsoul_ has joined #tripleo | 01:17 | |
| *** Petersingh has joined #tripleo | 01:17 | |
| *** mschuppert has quit IRC | 01:20 | |
| *** rh-jelabarre has quit IRC | 01:21 | |
| *** yamahata has quit IRC | 01:22 | |
| *** Petersingh is now known as Petersingh|afk | 01:36 | |
| *** Petersingh|afk is now known as Petersingh | 01:40 | |
| *** fzdarsky_ has joined #tripleo | 01:45 | |
| *** dxiri has joined #tripleo | 01:46 | |
| *** fzdarsky has quit IRC | 01:49 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: [WIP] Native ZuulV3 TripleO CI job https://review.openstack.org/576956 | 01:50 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 02:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| *** mhenkel_ has joined #tripleo | 02:16 | |
| *** mhenkel_ has quit IRC | 02:21 | |
| *** tcw has quit IRC | 02:33 | |
| *** tcw has joined #tripleo | 02:37 | |
| openstackgerrit | Logan V proposed openstack/diskimage-builder master: Allow extra grub modules to be installed https://review.openstack.org/577338 | 02:37 |
| openstackgerrit | Sai Ram Peesapati proposed openstack/tripleo-heat-templates stable/ocata: Conditionally Enable Nuage VRS https://review.openstack.org/577339 | 02:39 |
| openstackgerrit | Sai Ram Peesapati proposed openstack/tripleo-heat-templates stable/newton: Conditionally Enable Nuage VRS https://review.openstack.org/577340 | 02:39 |
| *** psachin has joined #tripleo | 02:41 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare https://review.openstack.org/573476 | 02:55 |
| *** skramaja has joined #tripleo | 02:59 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Streamline variables passed in different environments https://review.openstack.org/573819 | 03:07 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 03:10 |
| *** dxiri has quit IRC | 03:12 | |
| *** moshele has joined #tripleo | 03:16 | |
| *** moshele has quit IRC | 03:22 | |
| *** Petersingh is now known as Petersingh|afk | 03:23 | |
| *** ykarel|away has joined #tripleo | 03:35 | |
| *** pdeore has joined #tripleo | 03:37 | |
| openstackgerrit | zenghui.shi proposed openstack/tripleo-docs master: Add BIOS settings doc https://review.openstack.org/577343 | 03:38 |
| openstackgerrit | zenghui.shi proposed openstack/python-tripleoclient master: Create commands for configuring BIOS on given nodes https://review.openstack.org/576471 | 03:38 |
| *** udesale has joined #tripleo | 03:45 | |
| *** psahoo has joined #tripleo | 03:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud"" https://review.openstack.org/575330 | 03:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs003: deploy with instack-undercloud https://review.openstack.org/576225 | 03:56 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 03:57 |
| *** ykarel|away is now known as ykarel | 04:02 | |
| *** Petersingh|afk is now known as Petersingh | 04:06 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 04:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** yamahata has joined #tripleo | 04:13 | |
| *** moshele has joined #tripleo | 04:15 | |
| *** Petersingh is now known as Petersingh|afk | 04:17 | |
| *** itlinux has joined #tripleo | 04:22 | |
| *** ratailor has joined #tripleo | 04:28 | |
| *** jaganathan has joined #tripleo | 04:28 | |
| *** mhenkel_ has joined #tripleo | 04:29 | |
| *** mhenkel_ has quit IRC | 04:33 | |
| *** mhenkel_ has joined #tripleo | 04:33 | |
| *** mhenkel_ has joined #tripleo | 04:34 | |
| *** Petersingh|afk is now known as Petersingh | 04:34 | |
| *** mhenkel__ has joined #tripleo | 04:37 | |
| *** mhenkel_ has quit IRC | 04:41 | |
| *** moshele has quit IRC | 04:41 | |
| *** mhenkel__ has quit IRC | 04:42 | |
| *** cshastri has joined #tripleo | 04:45 | |
| *** pgadiya has joined #tripleo | 04:46 | |
| *** spsurya has quit IRC | 04:48 | |
| *** ratailor has quit IRC | 04:54 | |
| *** ratailor_ has joined #tripleo | 04:54 | |
| *** yprokule has joined #tripleo | 04:59 | |
| *** janki has joined #tripleo | 05:01 | |
| *** janki has quit IRC | 05:06 | |
| *** paramite has joined #tripleo | 05:08 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 05:10 |
| *** zshi has quit IRC | 05:20 | |
| *** itlinux has quit IRC | 05:23 | |
| *** quiquell|off is now known as quiquell|rover | 05:37 | |
| *** dparkes has quit IRC | 05:41 | |
| *** zshi has joined #tripleo | 05:47 | |
| *** bogdando has joined #tripleo | 05:48 | |
| *** janki has joined #tripleo | 05:48 | |
| bogdando | o/ PTAL https://review.openstack.org/#/c/576498/ https://review.openstack.org/#/c/576086/ | 05:53 |
| *** mrsoul_ is now known as mschuppert | 05:55 | |
| bogdando | mandre, mwhahaha: hi folks, can we merge https://review.openstack.org/#/c/567800/ ? | 05:58 |
| bogdando | and hopefully start backorting the others sitting on top, once CI is passing | 05:58 |
| *** ramishra has joined #tripleo | 06:00 | |
| *** ksambor has joined #tripleo | 06:03 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 06:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| *** lvdombrkr has joined #tripleo | 06:10 | |
| *** brault has quit IRC | 06:15 | |
| *** Petersingh is now known as Petersingh|afk | 06:16 | |
| *** dparkes has joined #tripleo | 06:16 | |
| *** radeks has joined #tripleo | 06:21 | |
| *** brault has joined #tripleo | 06:23 | |
| *** nyechiel_ has joined #tripleo | 06:24 | |
| *** nyechiel has quit IRC | 06:24 | |
| quiquell|rover | bogdando: I am working on it, do you know what do we use opstools for ? | 06:26 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned https://review.openstack.org/576876 | 06:27 |
| *** bryan_att has quit IRC | 06:29 | |
| *** Petersingh|afk is now known as Petersingh | 06:29 | |
| *** bryan_att has joined #tripleo | 06:29 | |
| *** pcaruana has joined #tripleo | 06:30 | |
| *** cylopez has joined #tripleo | 06:31 | |
| *** sanjayu_ has joined #tripleo | 06:31 | |
| *** cylopez has left #tripleo | 06:32 | |
| *** ykarel_ has joined #tripleo | 06:34 | |
| *** tahini has quit IRC | 06:34 | |
| bogdando | quiquell|rover: sos report prolly, | 06:34 |
| *** ykarel has quit IRC | 06:36 | |
| *** ykarel_ is now known as ykarel | 06:38 | |
| *** ffiore has joined #tripleo | 06:45 | |
| *** mhenkel_ has joined #tripleo | 06:46 | |
| *** holser_ has joined #tripleo | 06:48 | |
| bogdando | bandini, dciabrin: hi, just wondering is 1592528 that sign of rabbitpocalypse? :D | 06:49 |
| bogdando | or there are more? | 06:49 |
| *** mhenkel_ has quit IRC | 06:49 | |
| *** mhenkel_ has joined #tripleo | 06:50 | |
| *** lvdombrkr89 has joined #tripleo | 06:50 | |
| dciabrin | bogdando, 1592528 and 1589684 are the two offenders | 06:51 |
| *** Haresh has joined #tripleo | 06:51 | |
| *** lvdombrkr has quit IRC | 06:53 | |
| bogdando | bandini: dciabrin: So indeed then | 06:53 |
| bogdando | those are the Messengers of it :) | 06:54 |
| bogdando | as we started exploring scale-out, which is disturbing to rabbit clusters, seems like totally expected to me | 06:54 |
| *** jpena|off is now known as jpena | 06:55 | |
| bogdando | And I believe it's time to revive the old effort for merging clusterlabs OCF RA with the upstreamed alternative, see https://blueprints.launchpad.net/fuel/+spec/upstream-rabbit-ocf | 06:55 |
| *** Petersingh is now known as Petersingh|afk | 06:55 | |
| bogdando | it lives here https://github.com/rabbitmq/rabbitmq-server-release/blob/master/scripts/rabbitmq-server-ha.ocf | 06:56 |
| bogdando | and needs some love, as it a kinda abandoned for quite a while | 06:56 |
| bogdando | I'm really sure merging it with that clusterlabs one would benefit all of us | 06:57 |
| *** quiquell|rover is now known as quique|rover|afk | 06:57 | |
| bogdando | bandini, dciabrin: If you're interested, let me know and invite to discussions :) | 06:57 |
| bogdando | I'd be glad to help | 06:57 |
| bogdando | that one had been *really* long and battle tested for destructive/failover scenarios | 06:58 |
| bogdando | let me try to find that topic for merging efforts... | 06:59 |
| dciabrin | bogdando, yep that thing is been waiting for too long | 06:59 |
| bogdando | indeed | 06:59 |
| dciabrin | bogdando, however i have the feeling that something else is at play here | 06:59 |
| bogdando | we cannot make those thousands of perished rabbits for nothing :D | 06:59 |
| dciabrin | bogdando, the issue appeaers even when we clean-stop pacemaker and rabbit | 06:59 |
| bogdando | s/make/leave | 06:59 |
| dciabrin | bogdando, so i'm still trying to figure out what has change so much lately that could trigger such a mess | 07:00 |
| bogdando | dciabrin: I think there maybe an "abstraction leak". A mess with neutron agents trying to recover and creating expected pressure on rabbit cluster, ideally should not interfere with control plane networking (and rabbit cluster connectivity), but seems it does, via involved OVS | 07:03 |
| bogdando | as a workaround, would be trying to use OVS-less control plane perhaps? | 07:03 |
| bogdando | for that test case, and see if that helps at least therabbit cluster to not break | 07:03 |
| *** florianf|afk is now known as florianf | 07:04 | |
| dciabrin | bogdando, well that's the thing it's not the cluster failing per-se. the cluster connection between the node is just fine, we don't see any obvious signs of temporary network failure (neither galera nor corosync experience anything either) | 07:04 |
| bogdando | I may be wrong though, I'm not too much sure OVS is involved in control plane network? (AFAIK, it is, when isolated networks) | 07:04 |
| dciabrin | bogdando, yes ovs is active | 07:05 |
| bogdando | dciabrin: hm, I saw there are some ovs flows issues in the bug comments or something | 07:05 |
| *** Goneri has joined #tripleo | 07:05 | |
| *** ccamacho has joined #tripleo | 07:06 | |
| bogdando | aside of that guess, I see no factors breaking CP connectivity and splitting rabbit cluster, indeed. But wait, let me just check logs :) | 07:06 |
| dciabrin | bogdando, yep but those are not breaking the internal network. we seemed to have confirmed that yesterday by pinging all the nodes. it broke some network namespaces and prevented keepalived ping pinging each others apparently | 07:06 |
| dciabrin | bogdando, ack thx | 07:06 |
| bogdando | that KA is another sad story | 07:07 |
| dciabrin | :) | 07:07 |
| bogdando | one cannot expect it recovering from network splits, right? | 07:07 |
| bogdando | I hope everyone uderstands that | 07:07 |
| dciabrin | bogdando, yeah that's the limit of 2-nodes failover, but it's been the case since ages | 07:08 |
| *** rcernin has quit IRC | 07:08 | |
| dciabrin | bogdando, so this morning i have a fresh env which supposedly has the exact same setup, and i'll try to make it break | 07:08 |
| bogdando | dciabrin: >what has change so much lately that could trigger such a mess | 07:09 |
| bogdando | attempts to start doing scale-outs? :D | 07:09 |
| dciabrin | bogdando, no, scale out and controller restarts have been there since day 1 in QE tests | 07:09 |
| bogdando | Oh, I didn't know that | 07:09 |
| bogdando | I thought there is yet any excessive automated destructive testing | 07:10 |
| dciabrin | yeah and our HA tests run controller restart as well, abrupt and clean restarts | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 07:10 |
| bogdando | nice to know | 07:10 |
| bogdando | then that's not so much bad) | 07:10 |
| *** tesseract has joined #tripleo | 07:11 | |
| *** Petersingh|afk is now known as Petersingh | 07:17 | |
| *** tosky has joined #tripleo | 07:18 | |
| *** rodolof has joined #tripleo | 07:21 | |
| *** ksambor has quit IRC | 07:26 | |
| *** pmannidi has quit IRC | 07:28 | |
| *** ksambor has joined #tripleo | 07:31 | |
| *** jistr|off is now known as jistr | 07:34 | |
| *** rodolof has quit IRC | 07:38 | |
| *** amoralej|off is now known as amoralej | 07:39 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned https://review.openstack.org/576876 | 07:40 |
| *** yprokule has quit IRC | 07:40 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Collectd QDR connection https://review.openstack.org/571152 | 07:41 |
| *** quique|rover|afk is now known as quiquell|rover | 07:42 | |
| *** rodolof has joined #tripleo | 07:42 | |
| *** Skyraven has joined #tripleo | 07:43 | |
| *** Petersingh is now known as Petersingh|lunch | 07:47 | |
| mhenkel_ | question: what is the easiest way to concatenate a string and an int in a HOT? is it: | 07:48 |
| mhenkel_ | list_join: | 07:48 |
| mhenkel_ | - '' | 07:48 |
| mhenkel_ | - - vlan | 07:48 |
| mhenkel_ | - "[{get_param: TenantNetworkVlanID}].each |String $val| { noop_resource($val) }" | 07:48 |
| mhenkel_ | or is there a more elegant way? | 07:48 |
| bogdando | dciabrin: basically, https://bugzilla.redhat.com/show_bug.cgi?id=1592528#c17 looks like it is isolated, including CP | 07:49 |
| openstack | bugzilla.redhat.com bug 1592528 in openstack-neutron "[OSP13] cannot launch instance(cannot bind port) and ping existing instance using floating IP after reboot of OC nodes" [Urgent,New] - Assigned to beagles | 07:49 |
| *** radeks has quit IRC | 07:49 | |
| dciabrin | bogdando, we still have the live env if you want to jump on it and try further commands live | 07:50 |
| dciabrin | bogdando, i'm currently writing a wrap-up of what we tested yesterday with beagles | 07:50 |
| *** moshele has joined #tripleo | 07:51 | |
| *** gfidente has joined #tripleo | 07:52 | |
| *** gfidente has quit IRC | 07:52 | |
| *** gfidente has joined #tripleo | 07:52 | |
| *** zoli|gone is now known as zoli | 07:53 | |
| *** kopecmartin has joined #tripleo | 07:55 | |
| *** jpich has joined #tripleo | 07:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 08:00 |
| *** akrivoka has joined #tripleo | 08:02 | |
| *** d0ugal_ has quit IRC | 08:03 | |
| *** moshele has quit IRC | 08:03 | |
| *** akrivoka has quit IRC | 08:04 | |
| *** d0ugal has joined #tripleo | 08:04 | |
| *** sshnaidm is now known as sshnaidm|off | 08:05 | |
| *** rcernin has joined #tripleo | 08:06 | |
| *** shardy has joined #tripleo | 08:08 | |
| *** akrivoka has joined #tripleo | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| *** akrivoka has quit IRC | 08:14 | |
| *** owalsh_ is now known as owalsh | 08:17 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: use the tq ansible.cfg for the undercloud install https://review.openstack.org/575535 | 08:17 |
| *** pkovar has joined #tripleo | 08:20 | |
| *** ykarel is now known as ykarel|lunch | 08:23 | |
| *** Petersingh|lunch is now known as Petersingh | 08:23 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Fix centos opstools repo deactivation https://review.openstack.org/577146 | 08:26 |
| *** cylopez has joined #tripleo | 08:29 | |
| *** yamahata has quit IRC | 08:32 | |
| *** skramaja has quit IRC | 08:33 | |
| *** dtantsur|afk is now known as dtantsur | 08:39 | |
| *** rcernin has quit IRC | 08:41 | |
| *** anande has joined #tripleo | 08:42 | |
| *** testing has joined #tripleo | 08:42 | |
| testing | Hi guys | 08:43 |
| *** derekh has joined #tripleo | 08:43 | |
| *** testing is now known as Guest49123 | 08:43 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-quickstart master: Allow custom host kernel params for libguestfs https://review.openstack.org/576772 | 08:43 |
| Guest49123 | Hello everyone. Is there a way for me to deploy overcloud without an undercloud provision node? | 08:43 |
| shardy | Guest49123: there is work in progress to enable a single-node mode where you can provision an all-in-one openstack without any additional undercloud node | 08:44 |
| shardy | but if you want to deploy more than one node then no, you need an undercloud node (it can be a VM) | 08:45 |
| Guest49123 | i have deployed openstack by using 3 servers, which one of it act as controller and 2 compute. Well if I wish to re-deploy it using tripleo. Do i need another node to act as undercloud ? | 08:46 |
| shardy | Guest49123: yes | 08:46 |
| Guest49123 | Okay, Got it. Another question. What is the major diff between tripleo and packstack ? Why is packstack not recommended for production deployment ? | 08:47 |
| shardy | Guest49123: packstack doesn't support HA or day2 operations like upgrades, which are generally things you want in production | 08:48 |
| shardy | some of the underlying tooling (puppet modules) is the same in TripleO | 08:48 |
| shardy | pacstack also doesn't support baremetal provisioning or many of the other features like validation, introspection, benchmarking etc that TripleO does | 08:49 |
| shardy | so it's not really a fair comparison | 08:49 |
| shardy | IMO | 08:49 |
| Guest49123 | Oh got it. So the best scenario would be allocating one more node as undercloud in my case. Hmm, thanks! | 08:49 |
| shardy | Guest49123: np! | 08:49 |
| *** Guest49123 has quit IRC | 08:51 | |
| *** colonwq has quit IRC | 08:52 | |
| *** ratailor__ has joined #tripleo | 08:53 | |
| *** ratailor_ has quit IRC | 08:57 | |
| *** salmankhan has joined #tripleo | 08:57 | |
| *** colonwq has joined #tripleo | 08:59 | |
| *** cylopez has left #tripleo | 09:00 | |
| quiquell|rover | Pufff new day new stuff, any idea on this ? http://logs.openstack.org/46/577146/2/check/tripleo-ci-centos-7-undercloud-oooq/450c092/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-06-22_08_47_38 | 09:03 |
| quiquell|rover | Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty value at | 09:03 |
| *** zoli is now known as zoli|lunch | 09:03 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 09:03 |
| quiquell|rover | at undercloud install | 09:03 |
| *** ykarel|lunch is now known as ykarel | 09:07 | |
| openstackgerrit | Michael Henkel proposed openstack/os-net-config master: vlan and linux_bond members for contrail vrouter https://review.openstack.org/577374 | 09:10 |
| quiquell|rover | mwhahaha: Do have any ideas on this ? http://logs.openstack.org/46/577146/2/check/tripleo-ci-centos-7-undercloud-oooq/450c092/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-06-22_08_47_38 | 09:12 |
| *** ykarel has quit IRC | 09:14 | |
| *** Damjanek has joined #tripleo | 09:15 | |
| *** shardy has quit IRC | 09:16 | |
| Damjanek | Hi. Where I should go, to get my change reviewed? The change is in openstack/tripleo-heat-templates. | 09:17 |
| *** shardy has joined #tripleo | 09:17 | |
| quiquell|rover | Damjanek: Take a lock at git review util, | 09:19 |
| Damjanek | quiquell|rover: I already commited to gerrit and the change went thru zuul. | 09:20 |
| quiquell|rover | if you login into review.openstack.org | 09:21 |
| quiquell|rover | Damjanek: You can check your changes | 09:21 |
| Damjanek | I already know that. | 09:21 |
| Damjanek | I need someone else to do the review of my change | 09:21 |
| quiquell|rover | Damjanek: Ahh ok, sorry :-) | 09:21 |
| Damjanek | And I'm not sure if this is a proper forum for that :) | 09:21 |
| quiquell|rover | Damjanek: It is | 09:22 |
| *** akrivoka has joined #tripleo | 09:22 | |
| numans | shardy, Hi, Is it possible to take a look at this one - https://review.openstack.org/#/c/576085/. It's a backport and bandini seems to be on PTO | 09:23 |
| Damjanek | https://review.openstack.org/#/c/576819 - this is the change then | 09:23 |
| *** anande has quit IRC | 09:24 | |
| *** salmankhan has quit IRC | 09:28 | |
| *** salmankhan has joined #tripleo | 09:31 | |
| *** sileht has quit IRC | 09:35 | |
| shardy | numans: ack will take a look | 09:38 |
| *** akrivoka has quit IRC | 09:41 | |
| shardy | Damjanek: Hi, lgtm, thanks for the patch | 09:43 |
| Damjanek | shardy: Thanks | 09:43 |
| quiquell|rover | Any expert on puppet-ironic here ? | 09:43 |
| shardy | quiquell|rover: not an expert but I did look and I wonder why the pick isn't finding '$pybasedir/drivers/modules/ipxe_config.template' | 09:44 |
| quiquell|rover | shardy: Looks like it's not installed | 09:45 |
| shardy | are we missing the ironic package in the config container or something? | 09:45 |
| shardy | Ok that would explain it then | 09:45 |
| quiquell|rover | shardy: Let me check | 09:45 |
| quiquell|rover | dtantsur: We have a puppet-ironic issue https://bugs.launchpad.net/tripleo/+bug/1778201 | 09:46 |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:46 |
| quiquell|rover | dtantsur: Any idea ? | 09:47 |
| shardy | quiquell|rover: why isn't the package installed? | 09:48 |
| *** ykarel has joined #tripleo | 09:49 | |
| quiquell|rover | shardy: It should be take from one of the DLRN repos ? | 09:50 |
| *** suuuper has joined #tripleo | 09:52 | |
| *** d0ugal has quit IRC | 09:55 | |
| *** d0ugal has joined #tripleo | 09:56 | |
| dtantsur | quiquell|rover: regression after https://github.com/openstack/puppet-ironic/commit/2ad919015906102043118a81e0df4ccf9d857f7a maybe? | 09:57 |
| quiquell|rover | dtantsur: I see there are tripleo jobs at puppet-ironic now, do they exercise this changes ? | 09:58 |
| dtantsur | quiquell|rover: they were added later. but they did pass | 09:58 |
| shardy | I was looking at that, I'm not sure why that would break the package install - it looks like none of the openstack packages got installed to me | 09:58 |
| dtantsur | actually, I don't get how this error could be caused by https://github.com/openstack/puppet-ironic/blob/master/manifests/drivers/pxe.pp#L102 | 09:59 |
| quiquell|rover | shardy: Can you point me to the package install (I am still alittle newbie) | 09:59 |
| dtantsur | the 2nd argument is surely non-empty | 09:59 |
| quiquell|rover | dtantsur: Maybe pybasedir is empty and it fails ? | 10:00 |
| dtantsur | quiquell|rover: $pybasedir is not expanded in puppet, it's the actual part of the value | 10:00 |
| shardy | https://github.com/puppetlabs/puppetlabs-stdlib/blob/master/lib/puppet/parser/functions/pick.rb#L30 | 10:01 |
| shardy | well it looks like it'll try to dereference it? | 10:01 |
| * shardy not a ruby expert ;) | 10:01 | |
| dtantsur | shardy: ehhmmm.. is it a new behavior? Oo | 10:01 |
| shardy | dtantsur: yes it is | 10:02 |
| shardy | https://github.com/puppetlabs/puppetlabs-stdlib/commit/227a2316a3048ad0ae61789ab5fcdf99b9f1c9e3#diff-c06eb94aab7551c12ac540857358c2cd | 10:02 |
| quiquell|rover | shardy, dtantsur: also it dereferencing the whole string I think, that's wrong | 10:02 |
| shardy | so perhaps we need to escape the $ or something | 10:02 |
| quiquell|rover | shardy: Have we update puppet ? | 10:02 |
| dtantsur | yeah, because it's really just a part of the value, I checked | 10:02 |
| quiquell|rover | shardy, dtantsur: or we always get the latest ? | 10:03 |
| shardy | quiquell|rover: puppet-stdlib seems to have broken us | 10:03 |
| quiquell|rover | shardy, dtantsur: maybe we need to fix the version of it | 10:03 |
| openstackgerrit | Michael Henkel proposed openstack/os-net-config master: vlan and linux_bond members for contrail vrouter https://review.openstack.org/577374 | 10:04 |
| quiquell|rover | shardy, dtantsur: the change is from three months ago | 10:04 |
| quiquell|rover | https://github.com/puppetlabs/puppetlabs-stdlib/blame/4445b08bb5dd367dafcfbb310f8cb6344a7570f3/lib/puppet/parser/functions/pick.rb#L30 | 10:04 |
| quiquell|rover | Did we update puppet ? | 10:04 |
| shardy | puppet != puppet-stdlib | 10:05 |
| * dtantsur dumps the findings to the bug | 10:05 | |
| quiquell|rover | dtantsur: Thanks | 10:06 |
| quiquell|rover | shardy, dtantsur: Do you know where do we set the puppet version ? | 10:06 |
| dtantsur | quiquell|rover: the only option I see (and keep in mind I'm not a puppet guru) is to expand $pybasedir on our side | 10:06 |
| shardy | we're running puppet-stdlib-4.25.2-0.20180622082303.81b95de.el7.noarch in that job | 10:06 |
| quiquell|rover | shardy: The change is from three months ago | 10:06 |
| dtantsur | we do know where python keeps its site-packages | 10:06 |
| shardy | quiquell|rover: the change I mentioned is from 15 hours ago | 10:07 |
| shardy | but I'm not sure exactly how it broke this | 10:07 |
| quiquell|rover | shardy: It's not this change https://github.com/puppetlabs/puppetlabs-stdlib/commit/1854a6b1a74109c6dea8eac5f6857bd8c789dc52 | 10:07 |
| dtantsur | well, the variable expansion was introduced in March indeed | 10:07 |
| dtantsur | maybe it was hidden by something before | 10:07 |
| quiquell|rover | That's what I mean | 10:07 |
| quiquell|rover | Or maybe we updated puppet | 10:08 |
| quiquell|rover | But they were doing a get_var always | 10:08 |
| quiquell|rover | so it have beign working like that for long | 10:08 |
| dtantsur | and I know the answer: the PR merged two days ago https://github.com/puppetlabs/puppetlabs-stdlib/pull/890 | 10:09 |
| dtantsur | s/days/hours/ | 10:09 |
| * dtantsur comments on https://github.com/puppetlabs/puppetlabs-stdlib/pull/890 | 10:09 | |
| quiquell|rover | dtantsur: That's it then | 10:10 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| dtantsur | quiquell|rover: as I said above, I think the fix is to provide the full path on our side | 10:10 |
| dtantsur | unless they'll revert the patch, which is unlikely | 10:11 |
| *** yprokule has joined #tripleo | 10:11 | |
| quiquell|rover | dtantsur: will try to add a review, give me a sec | 10:11 |
| dtantsur | yup | 10:11 |
| quiquell|rover | I will check all the pick calls | 10:12 |
| openstackgerrit | Sylvain Afchain proposed openstack/tripleo-heat-templates master: skydive external_deploy_task migration https://review.openstack.org/561274 | 10:13 |
| *** ksambor has quit IRC | 10:14 | |
| *** ksambor has joined #tripleo | 10:15 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 10:15 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: move cellv2 discovery from control plane services to compute services https://review.openstack.org/576481 | 10:16 |
| *** sileht has joined #tripleo | 10:17 | |
| *** ksambor1 has joined #tripleo | 10:18 | |
| *** Petersingh has quit IRC | 10:18 | |
| *** ksambor1 has left #tripleo | 10:18 | |
| *** rodolof has quit IRC | 10:20 | |
| *** rodolof has joined #tripleo | 10:20 | |
| *** ksambor has quit IRC | 10:21 | |
| quiquell|rover | dtantsur, shardy: https://review.openstack.org/#/c/577386/ | 10:23 |
| quiquell|rover | I see also some tripleo jobs quicking it :-) | 10:23 |
| quiquell|rover | dtantsur: Ups... :-) | 10:25 |
| quiquell|rover | dtantsur: What are the issue with pybasedir ? | 10:25 |
| dtantsur | quiquell|rover: is it a valid puppet variable? I really don't know | 10:25 |
| *** ksambor has joined #tripleo | 10:26 | |
| dtantsur | it does not look so | 10:26 |
| quiquell|rover | dtantsur: Maybe it get injected by us somehow, this was working before | 10:27 |
| quiquell|rover | dtantsur: Or it was just emitting literally the string ? | 10:27 |
| dtantsur | quiquell|rover: yes, it literally this string | 10:27 |
| dtantsur | * it is | 10:27 |
| quiquell|rover | dtantsur: I see... going to dig a little more | 10:27 |
| dtantsur | $ sudo grep pybasedir /etc/ironic/ironic.conf | wc -l | 10:27 |
| dtantsur | 12 | 10:27 |
| dtantsur | it's expanded by oslo.config when parsing the service's configuration optons | 10:28 |
| lyarwood | https://review.openstack.org/#/c/573740/ - any additional cores with an interest in ffu/upgrades able to +2+W this simple fix? | 10:28 |
| quiquell|rover | dtantsur: also http://codesearch.openstack.org/?q=pybasedir&i=nope&files=&repos= | 10:28 |
| etingof | speaking of simple fixes: +2+W is needed here as well -- https://review.openstack.org/#/c/528726/ | 10:29 |
| quiquell|rover | dtantsur: But we cannot use oslo.config inside puppet, we need to read the .conf from puppet ? | 10:30 |
| dtantsur | quiquell|rover: no, I think we should have to figure out this value.. it's essentially /usr/lib/python2.7/site-packages/ironic | 10:30 |
| quiquell|rover | dtantsur: We can try scaping it a | 10:30 |
| quiquell|rover | dtantsur: look http://git.openstack.org/cgit/openstack/compass-adapters/tree/chef/cookbooks/openstack-compute/spec/nova-common_spec.rb | 10:30 |
| dtantsur | quiquell|rover: this is chef (well, ruby), not puppet | 10:31 |
| quiquell|rover | dtantsur: ok | 10:32 |
| quiquell|rover | dtantsur: Maybe executing python -m site ? | 10:33 |
| *** waleedm has joined #tripleo | 10:34 | |
| *** dparkes has quit IRC | 10:36 | |
| *** dparkes has joined #tripleo | 10:36 | |
| dtantsur | quiquell|rover: yeah, and we may need a custom fact (https://puppet.com/docs/facter/3.9/custom_facts.html) for that | 10:36 |
| dtantsur | unless somebody knowing puppet for real tells me I'm wrong | 10:36 |
| quiquell|rover | dtantsur: Scaspaing \$ woulÃd help ? | 10:37 |
| quiquell|rover | dtantsur: We can try | 10:37 |
| dtantsur | quiquell|rover: I doubt it. it seems that they analyse the string contents | 10:37 |
| dtantsur | but we can try indeed | 10:38 |
| quiquell|rover | dtantsur: Let's at least discard it | 10:38 |
| quiquell|rover | dtantsur: Closes-Bug not working for launchpad, is because this is not a tripleo repo ? | 10:40 |
| dtantsur | quiquell|rover: yep, you need a bug against puppet-ironic | 10:41 |
| quiquell|rover | dtantsur: Ahh you are right | 10:41 |
| *** jaganathan has quit IRC | 10:41 | |
| *** dparkes has quit IRC | 10:41 | |
| dtantsur | quiquell|rover: or rather: add puppet-ironic to this bug | 10:41 |
| *** psachin` has joined #tripleo | 10:42 | |
| *** psachin has quit IRC | 10:42 | |
| quiquell|rover | dtantsur: Done | 10:43 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix broken README refs in getting started guide https://review.openstack.org/577391 | 10:44 |
| quiquell|rover | dtantsur: Do you we have periodic jobs for puppet-ironic ? | 10:46 |
| *** kbyrne has quit IRC | 10:49 | |
| *** zoli|lunch is now known as zoli | 10:49 | |
| *** kbyrne has joined #tripleo | 10:51 | |
| *** jaganathan has joined #tripleo | 10:51 | |
| dtantsur | no idea | 10:53 |
| *** honza has quit IRC | 10:55 | |
| *** jaganathan has quit IRC | 10:58 | |
| *** honza has joined #tripleo | 11:00 | |
| *** honza is now known as Guest71763 | 11:00 | |
| numans | shardy, thank you | 11:03 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| *** jpena is now known as jpena|lunch | 11:10 | |
| *** bkopilov has quit IRC | 11:14 | |
| *** quiquell|rover has quit IRC | 11:17 | |
| *** vpickard_ is now known as vpickard | 11:18 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Collectd QDR connection https://review.openstack.org/571152 | 11:19 |
| *** bfournie has quit IRC | 11:22 | |
| *** bfournie has joined #tripleo | 11:22 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-validations master: WIP - add initial role for containerized undercloud validations https://review.openstack.org/577397 | 11:23 |
| *** pradk has joined #tripleo | 11:25 | |
| *** jcoufal has joined #tripleo | 11:27 | |
| *** bfournie has quit IRC | 11:27 | |
| *** jaganathan has joined #tripleo | 11:30 | |
| *** jaganathan has quit IRC | 11:30 | |
| *** jaganathan has joined #tripleo | 11:31 | |
| *** udesale_ has joined #tripleo | 11:32 | |
| *** udesale_ has quit IRC | 11:33 | |
| *** udesale_ has joined #tripleo | 11:34 | |
| *** udesale has quit IRC | 11:34 | |
| *** moshele has joined #tripleo | 11:39 | |
| *** pdeore has quit IRC | 11:41 | |
| *** udesale_ has quit IRC | 11:42 | |
| *** quiquell has joined #tripleo | 11:42 | |
| *** quiquell is now known as quiquell|rover | 11:42 | |
| *** moshele has quit IRC | 11:43 | |
| *** pchavva has joined #tripleo | 11:44 | |
| *** waleedm has quit IRC | 11:44 | |
| *** jaganathan has quit IRC | 11:44 | |
| *** jaganathan has joined #tripleo | 11:45 | |
| *** raildo has joined #tripleo | 11:45 | |
| larsks | shardy: this is what I was thinking of in terms of handling puppet module patching: https://github.com/CCI-MOC/rhosp-director-config/blob/feature/patch-puppet-modules/templates/services/patch-puppet-modules.yaml | 11:49 |
| *** Goneri has quit IRC | 11:50 | |
| *** morazi has joined #tripleo | 11:52 | |
| shardy | larsks: lgtm - I was originally thinking we might be able to replace the current implementation e.g keep the same parameter name, but I guess this way it makes the new remove behavior explicit | 11:53 |
| *** asbishop has joined #tripleo | 11:54 | |
| shardy | it would be nice to replace the current DeployArtifacts stuff with a similar service implementation though | 11:54 |
| larsks | shardy: I think the puppet module patching requires a workflow that is distinct from just unpacking deployartifacts. We could implement another service that replicates the existing functionality. | 11:54 |
| *** morazi has quit IRC | 11:54 | |
| *** morazi has joined #tripleo | 11:55 | |
| larsks | That should be basically just like this, but simpler, because it can just download + unpack. | 11:55 |
| *** panda|off is now known as panda | 11:56 | |
| shardy | larsks: ack Ok sounds good | 11:56 |
| *** bfournie has joined #tripleo | 11:56 | |
| *** morazi has quit IRC | 11:59 | |
| *** morazi has joined #tripleo | 11:59 | |
| *** trown|outtypewww is now known as trown | 12:00 | |
| sri_ | shardy, silly question is control plane and provisioning is the same network right ? | 12:01 |
| *** lblanchard has joined #tripleo | 12:02 | |
| *** jpena|lunch is now known as jpena | 12:02 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: [DNM] To test Ic5cbbced85b083b15da1dbd28fb2f045f0954494 https://review.openstack.org/577400 | 12:03 |
| quiquell|rover | dtantsur: local reproducer has go beyond the undercloud install | 12:04 |
| dtantsur | nice! | 12:04 |
| quiquell|rover | dtantsur: I have also create a patch to test it Ic5cbbced85b083b15da1dbd28fb2f045f0954494 | 12:04 |
| quiquell|rover | sorry | 12:04 |
| quiquell|rover | dtantsur: https://review.openstack.org/#/c/577400/ | 12:04 |
| dtantsur | okay, let's see how the CI feels about it | 12:05 |
| quiquell|rover | dtantsur: But the unit test from puppet-ironic are not passing :-( | 12:05 |
| *** fultonj has joined #tripleo | 12:06 | |
| *** etingof has quit IRC | 12:07 | |
| *** liverpooler has joined #tripleo | 12:07 | |
| *** amoralej is now known as amoralej|lunch | 12:07 | |
| quiquell|rover | dtantsur: Do you know how to run locally the unit test from puppet-ironic ? | 12:07 |
| dtantsur | quiquell|rover: https://docs.openstack.org/puppet-openstack-guide/latest/contributor/testing.html | 12:08 |
| jistr | bogdando: can you please remove +A from https://review.openstack.org/#/c/575756 ? it probably doesn't solve the main issue and it would bring risk of breakage that would be difficult to deal with | 12:09 |
| bogdando | jistr: done | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| bogdando | jistr: then please block the backport ) | 12:10 |
| jistr | bogdando: thanks. yea i -1'd it too. On the backport there's also more discussion explaining why we're blocking it for now. | 12:10 |
| jistr | https://review.openstack.org/#/c/575758/ | 12:10 |
| shardy | sri_: yes, the ctlplane network is the provisioning network | 12:11 |
| *** liverpooler has quit IRC | 12:12 | |
| *** liverpooler has joined #tripleo | 12:13 | |
| *** fultonj has quit IRC | 12:16 | |
| *** dparkes has joined #tripleo | 12:18 | |
| *** etingof has joined #tripleo | 12:19 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Disable pid file usage in the swift_rsync container https://review.openstack.org/577403 | 12:19 |
| *** toure|gone is now known as toure | 12:20 | |
| *** moguimar has quit IRC | 12:21 | |
| *** moguimar has joined #tripleo | 12:23 | |
| *** tahini has joined #tripleo | 12:27 | |
| *** jaganathan has quit IRC | 12:27 | |
| *** rlandy has joined #tripleo | 12:28 | |
| *** jaganathan has joined #tripleo | 12:32 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Include --xattrs when creating the undercloud backup. https://review.openstack.org/577406 | 12:33 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add missing 'update_tasks' to the OVN dbs pacemaker service https://review.openstack.org/576085 | 12:33 |
| *** jcoufal has quit IRC | 12:36 | |
| *** etingof has quit IRC | 12:37 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs master: Docs adjustment for adding --xattrs to the UC backup/restore https://review.openstack.org/577407 | 12:38 |
| *** kopecmartin has quit IRC | 12:39 | |
| *** jaganathan has quit IRC | 12:41 | |
| *** jaganathan has joined #tripleo | 12:41 | |
| *** Haresh has quit IRC | 12:43 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM: Testing using zuul vxlan networking https://review.openstack.org/576645 | 12:45 |
| *** cshastri has quit IRC | 12:46 | |
| *** mmethot has quit IRC | 12:47 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Add NovaResumeGuestsStateOnHostBoot parameter https://review.openstack.org/577414 | 12:49 |
| quiquell|rover | dtantsur: Dummy question, do the unit test from puppet-ironic need to be run in a centos ? | 12:51 |
| quiquell|rover | I am runing it on my fedora | 12:51 |
| *** psahoo has quit IRC | 12:51 | |
| slagle | d0ugal: thrash rbrady : can we get some reviews on https://review.openstack.org/#/c/566699/. this is needed for the UI support for config-download | 12:52 |
| *** etingof has joined #tripleo | 12:52 | |
| d0ugal | slagle: sure | 12:52 |
| slagle | and https://review.openstack.org/#/c/566246/ | 12:52 |
| slagle | d0ugal: thanks | 12:53 |
| *** ratailor__ has quit IRC | 12:53 | |
| *** ratailor__ has joined #tripleo | 12:54 | |
| dtantsur | quiquell|rover: I certainly recall running them on fedora | 12:56 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 13:01 |
| quiquell|rover | dtantsur: Do I need to run tox before or something to get dependencies ? | 13:02 |
| shardy | quiquell|rover: I think for the puppet modules you run bundle install, check https://docs.openstack.org/puppet-openstack-guide/latest/contributor/testing.html | 13:03 |
| quiquell|rover | shardy: Have al ready do that but after rake spec a lot of test cases are failing | 13:04 |
| quiquell|rover | shardy: not related to the change, also reverting it make them fail too | 13:04 |
| quiquell|rover | shardy: Don't know if I am missing something | 13:04 |
| quiquell|rover | shardy: Running on fedora 28 | 13:04 |
| mwhahaha | quiquell|rover: did you figure out that problem? | 13:05 |
| quiquell|rover | mwhahaha: Yep, we have, we are trying to get a fix for it. | 13:05 |
| quiquell|rover | mwhahaha: All the info is in th ebug https://bugs.launchpad.net/tripleo/+bug/1778201 | 13:06 |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:06 |
| openstackgerrit | Matthias Runge proposed openstack/tripleo-heat-templates master: Enable collectd to connect to metrics QDR https://review.openstack.org/576057 | 13:06 |
| quiquell|rover | mwhahaha: Now a I am trying to run the unit test at my fedora 28 | 13:06 |
| *** paramite has quit IRC | 13:06 | |
| quiquell|rover | Unknown resource type: 'ironic::drivers::hardware_interface' (line: 1, column: 1) on node quiquell.usersys.redhat.com | 13:06 |
| quiquell|rover | DO I need to install ironic at my fedora ? | 13:06 |
| mwhahaha | quiquell|rover: sounds like an outdated puppet-ironic | 13:07 |
| quiquell|rover | mwhahaha: what do you mean ? | 13:07 |
| mwhahaha | quiquell|rover: unit tests don't install the software, so that's having module loading issues | 13:07 |
| quiquell|rover | mwhahaha: Just running the unit test like https://docs.openstack.org/puppet-openstack-guide/latest/contributor/testing.html#unit-tests | 13:07 |
| quiquell|rover | mwhahaha: using rvm | 13:07 |
| mwhahaha | quiquell|rover: which version of ruby | 13:08 |
| mwhahaha | i use 2.1.5 | 13:08 |
| quiquell|rover | 2.4. | 13:08 |
| mwhahaha | i haven't tried 2.4 | 13:08 |
| quiquell|rover | mwhahaha: Will try with yours | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| larsks | shardy: I see that there is a comment in common/post.yaml that says, "Artifacts config and HostPrepConfig is done on all roles, not only enabled_roles...". That suggests we can't actually replace it with a service template? | 13:11 |
| *** skramaja has joined #tripleo | 13:12 | |
| dtantsur | quiquell|rover: btw unit tests fail because \ gets into the final value | 13:13 |
| quiquell|rover | dtantsur: I know, just one to fix it locally first, I can add them and review | 13:13 |
| quiquell|rover | dtantsur: And if it works we are good (I think) | 13:13 |
| mwhahaha | quiquell|rover: so i think we need to have them rollback the fix in puppet stdlib | 13:13 |
| dtantsur | quiquell|rover: well, I'm not sure it will work.. | 13:13 |
| quiquell|rover | mwhahaha: Thats a big dutie for a small CI guy like me | 13:14 |
| dtantsur | mwhahaha: I thought of creating a fact that gets /usr/lib/python2.7/site-packages/ironic and just use it instead of relying on oslo.config substitution.. | 13:14 |
| shardy | larsks: Hmm good point - I'm not sure of that's such an issue now that the upgrades and deployment are all driven via ansible, but we'd need to test | 13:14 |
| mwhahaha | quiquell|rover: so we can pin stdlib to an older verion | 13:14 |
| mwhahaha | but let me poke binford2k | 13:14 |
| quiquell|rover | mwhahaha: Where do we pin it ? | 13:15 |
| mwhahaha | rdo | 13:15 |
| quiquell|rover | dtantsur: It would be cleaner, we can pin the version first and in parallel do the fact thing | 13:16 |
| *** leanderthal has joined #tripleo | 13:17 | |
| mwhahaha | rolling back a version is annoying but amoralej|lunch or jpena can probably help | 13:17 |
| *** mhenkel__ has joined #tripleo | 13:17 | |
| *** mmethot has joined #tripleo | 13:17 | |
| jpena | how can I help? | 13:17 |
| mwhahaha | jpena: we need to pin to an older version of puppetlabs-stdlib | 13:18 |
| mwhahaha | jpena: because https://github.com/puppetlabs/puppetlabs-stdlib/pull/890 broke us | 13:18 |
| jpena | mwhahaha: ok, not a big deal | 13:18 |
| jpena | so what would be the commit to pin to? | 13:19 |
| quiquell|rover | dtantsur: the scaping thing is working https://zuul.openstack.org/stream.html?uuid=36ca7fd37bc64558a8e298a0485f4cea&logfile=console.log | 13:19 |
| quiquell|rover | dtantsur: It's preping to deploy overcloud now | 13:20 |
| dtantsur | hmm, interesting. maybe oslo.config understands \ | 13:20 |
| *** jistr is now known as jistr|mtg | 13:20 | |
| *** mhenkel_ has quit IRC | 13:20 | |
| mwhahaha | jpena: https://github.com/puppetlabs/puppetlabs-stdlib | 13:20 |
| mwhahaha | er | 13:20 |
| *** mfedosin has quit IRC | 13:20 | |
| mwhahaha | jpena: 8ded9adb86184ea8e313963a05894c3060d81d7b | 13:20 |
| quiquell|rover | dtantsur: Let it finish and ensure that is working | 13:20 |
| dtantsur | ok | 13:21 |
| quiquell|rover | dtantsur: were do we see the generated content ? | 13:22 |
| *** myoung|off is now known as myoung|ruck | 13:22 | |
| quiquell|rover | dtantsur: I have also reproduced at my RDO cloud | 13:22 |
| quiquell|rover | myoung|ruck: Hello there | 13:22 |
| dtantsur | quiquell|rover: for non-containerized undercloud - logs/undercloud/etc/ironic/ironic.conf | 13:22 |
| *** amoralej|lunch is now known as amoralej | 13:22 | |
| dtantsur | for a containerized one - no idea at all. somewhere in some Very Obvious Place. | 13:22 |
| myoung|ruck | quiquell|rover: good morning, reading scrollback for a few, if you have a few mins we should sync. My ruckness for today starts now so I'm loading state presently. | 13:23 |
| mwhahaha | in /var/lib/config-data/puppet-generated/ironic | 13:23 |
| *** leanderthal has quit IRC | 13:23 | |
| myoung|ruck | quiquell|rover: if there are notes / details to read up on other than what's in the etherpad shoot me links :) | 13:23 |
| quiquell|rover | dtantsur: pxe_config_template=\$pybasedir/drivers/modules/ipxe_config.template | 13:23 |
| dtantsur | mwhahaha: omg, one day I'll remember it... | 13:23 |
| jpena | mwhahaha: do we have a bug number for this? | 13:24 |
| dtantsur | quiquell|rover: right, this \ worries me a bit | 13:24 |
| myoung|ruck | mwhahaha: o/ ahoy and good morning | 13:24 |
| mwhahaha | jpena: https://bugs.launchpad.net/tripleo/+bug/1778201 | 13:24 |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:24 |
| dtantsur | quiquell|rover: do you have a link to ironic-conductor logs? it probably logs the value is receives | 13:24 |
| quiquell|rover | dtantsur: Maybe it's just taking a default, how can we make sure that it's using this template really | 13:24 |
| quiquell|rover | myoung|ruck: ack, connecting to your bj in a few | 13:24 |
| quiquell|rover | dtantsur: Can share you with a tmate thing, it's a live system | 13:25 |
| dtantsur | quiquell|rover: if it uses iPXE, it uses this template. otherwise it would use PXE (and probably fail) | 13:25 |
| quiquell|rover | myoung|ruck: Give me a min. | 13:25 |
| *** dhill_ has joined #tripleo | 13:26 | |
| quiquell|rover | dtantsur: ssh paIh5Da6j4PbGnIoKkhRRbCkl@ln2.tmate.i | 13:26 |
| dtantsur | quiquell|rover: sorry, I don't really have time to dive in myself. let's wait for the CI then | 13:26 |
| mwhahaha | quiquell|rover: it's weird because the stdlib change doesn't break unit tests | 13:26 |
| jpena | mwhahaha: https://review.rdoproject.org/r/14432 | 13:26 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: [WIP] set mod_auth_openidc cache type to memcache https://review.openstack.org/577421 | 13:26 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo master: [WIP] pass list of memcache servers to keystone::federation::openidc https://review.openstack.org/577422 | 13:27 |
| myoung|ruck | quiquell|rover: no prob, i need a few mins as well | 13:28 |
| quiquell|rover | mwhahaha: Have you run them now, because the change is not at puppet-ironic | 13:28 |
| quiquell|rover | mwhahaha: And I don't think theere are periodic unit test jobs for it | 13:28 |
| *** rpioso|afk is now known as rpioso | 13:29 | |
| mwhahaha | quiquell|rover: yea i'm not seeing the failure in master which should test this | 13:29 |
| mwhahaha | quiquell|rover: i'll get it resolved today | 13:29 |
| quiquell|rover | mwhahaha: Cool :-), let as pin it to unblock CI | 13:29 |
| *** mcornea has joined #tripleo | 13:30 | |
| mwhahaha | quiquell|rover: it didn't show up in puppet-ironic because the test has a default value | 13:31 |
| * mwhahaha sighs | 13:31 | |
| quiquell|rover | mwhahaha: But we have the tripleo jobs there, are they failing ? | 13:32 |
| mwhahaha | they wouldn't until the packaging hit for stdlib | 13:32 |
| mwhahaha | it's a dependency issue outside of puppet-ironic | 13:32 |
| mwhahaha | we'll probably just get the stdlib change reverted | 13:32 |
| *** ramishra has quit IRC | 13:33 | |
| quiquell|rover | Ok the pining 8ded9adb86184ea8e313963a05894c3060d81d7b | 13:33 |
| quiquell|rover | I mean https://review.rdoproject.org/r/#/c/14432/1 | 13:34 |
| quiquell|rover | The commit is ok | 13:34 |
| openstackgerrit | Andrew Austin proposed openstack/tripleo-heat-templates master: Prevent Neutron L3 and Metadata agents from running when using OVN DVR. https://review.openstack.org/577219 | 13:34 |
| quiquell|rover | dtantsur: Going to abandon the scaping | 13:35 |
| dtantsur | ack | 13:35 |
| quiquell|rover | myoung|ruck: I am free now | 13:36 |
| *** leanderthal has joined #tripleo | 13:36 | |
| myoung|ruck | quiquell|rover: ok...i need 4-5 min | 13:36 |
| quiquell|rover | myoung|ruck: ack | 13:37 |
| myoung|ruck | quiquell|rover: coffee...is...nearly....done....brewing... | 13:37 |
| quiquell|rover | myoung|ruck: If coffe is the matter, you can take all the time you need, that's more important that any bug :-) | 13:37 |
| myoung|ruck | lol | 13:37 |
| openstackgerrit | Andrew Austin proposed openstack/puppet-tripleo master: [WIP] Add mechanism for cookie-based sessions in endpoints. https://review.openstack.org/577309 | 13:37 |
| *** jistr|mtg is now known as jistr | 13:37 | |
| myoung|ruck | I recall someone had a handy script to pull all the logs for a CI job... bogdando was it you? or tosky? someone pinged me yesterday and I didn't have a link handy | 13:39 |
| tosky | I think it was not me | 13:39 |
| tosky | of course wget -lL0 always work :) | 13:39 |
| bogdando | yes, here the script https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/getthelogs | 13:39 |
| bogdando | myoung|ruck: ^^ | 13:39 |
| *** ykarel has quit IRC | 13:40 | |
| *** ykarel has joined #tripleo | 13:40 | |
| Damjanek | shardy: About this change (https://review.openstack.org/#/c/576819/) - what needs to happen to get workflow +1? It's been a while since I was commiting anything to an Openstack project and I cannot recall. | 13:41 |
| shardy | Damjanek: it just needs another core reviewer to +2/A it, normally we require two cores before approving (same as most/all OpenStack projects) | 13:42 |
| *** marbindrakon has joined #tripleo | 13:42 | |
| Damjanek | ah. Ok | 13:42 |
| Damjanek | Thanks! | 13:42 |
| *** jistr is now known as jistr|mtg | 13:43 | |
| *** lblanchard has quit IRC | 13:45 | |
| *** tcw has quit IRC | 13:45 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add new modprobe element https://review.openstack.org/577170 | 13:46 |
| *** lukas__ has joined #tripleo | 13:47 | |
| lukas__ | Afternoon all | 13:48 |
| lukas__ | is containerised undercloud deployment in queens considered experimental? | 13:48 |
| *** mjturek has joined #tripleo | 13:51 | |
| shardy | lukas__: Yes on queens I believe so ref https://github.com/openstack/python-tripleoclient/blob/stable/queens/tripleoclient/v1/undercloud_deploy.py#L479 | 13:51 |
| *** bogdando has quit IRC | 13:51 | |
| shardy | work has continued this cycle towards making it fully supported | 13:51 |
| mwhahaha | lukas__: in queens it's experimental (and may not work) | 13:53 |
| mwhahaha | in rocky it will be supported | 13:53 |
| *** agopi has joined #tripleo | 13:54 | |
| *** tcw has joined #tripleo | 13:55 | |
| *** radeks has joined #tripleo | 13:56 | |
| *** vinaykns has joined #tripleo | 13:56 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Do not run nic template conversion on default tht location https://review.openstack.org/569272 | 13:57 |
| *** suuuper has quit IRC | 13:57 | |
| *** suuuper has joined #tripleo | 13:58 | |
| lukas__ | thanks shardy mwhahaha | 13:58 |
| *** jcoufal has joined #tripleo | 13:59 | |
| lukas__ | I'm having some issues with it (missing hostname/ip in public_url endpoints) | 13:59 |
| lukas__ | I guess I shall not bother and try rocky instead | 13:59 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Do not run nic template conversion on default tht location https://review.openstack.org/569272 | 14:01 |
| mwhahaha | lukas__: so it's been replaced in rocky with openstack tripleo deploy <extra options>. if you want a containerized undercloud you can just use openstack undercloud install --use-heat | 14:01 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Add openshift sti-builder image https://review.openstack.org/577426 | 14:02 |
| *** pkovar has quit IRC | 14:02 | |
| *** pkovar has joined #tripleo | 14:03 | |
| *** moguimar has quit IRC | 14:03 | |
| skramaja | could someone take a look this patch - https://review.openstack.org/#/c/567573/? | 14:03 |
| *** mhenkel__ has quit IRC | 14:04 | |
| *** moguimar has joined #tripleo | 14:04 | |
| *** mhenkel_ has joined #tripleo | 14:05 | |
| shardy | skramaja: done | 14:06 |
| sri_ | mwhahaha, I've tried using --use-heat last week but i got this error http://paste.openstack.org/show/723376/ | 14:07 |
| mwhahaha | sri_: sounds like outdated packages | 14:07 |
| skramaja | thanks shardy | 14:07 |
| mwhahaha | sri_: oh which undercloud.conf did you use? there's a new location | 14:08 |
| mwhahaha | sri_: make sure to use cp /usr/share/python-tripleoclient/undercloud.conf.sample ~/undercloud.conf | 14:08 |
| * mwhahaha will try and add a check for that later | 14:08 | |
| *** jistr|mtg is now known as jistr | 14:09 | |
| sri_ | mwhahaha, this is steps i used http://paste.openstack.org/show/724133/ | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| mwhahaha | sri_: does not work with queens | 14:10 |
| mwhahaha | sri_: like we just said, only master (rocky+) | 14:10 |
| sri_ | mwhahaha, oh, got it | 14:10 |
| *** ratailor__ has quit IRC | 14:11 | |
| *** ykarel is now known as ykarel|away | 14:14 | |
| *** pblaho has quit IRC | 14:16 | |
| *** ykarel|away has quit IRC | 14:16 | |
| *** ubijtsa has joined #tripleo | 14:18 | |
| *** ubijtsa is now known as assassin | 14:18 | |
| *** assassin has quit IRC | 14:18 | |
| *** janki has quit IRC | 14:19 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Add scenario011 to install ironic in the overcloud https://review.openstack.org/485261 | 14:19 |
| shardy | d0ugal: in a with-items loop is there any way to reference the current loop value in the publish value? | 14:20 |
| shardy | d0ugal: vs only in the inputs? | 14:21 |
| *** udesale has joined #tripleo | 14:21 | |
| d0ugal | shardy: iiuc, publishing happen only once at the end of all the with-items | 14:21 |
| d0ugal | shardy: What are you trying to do? Possibly a small sub-workflow is needed. | 14:22 |
| shardy | d0ugal: I'm trying to swift get/put on a list of files, to copy plan-samples/foo/*.yaml to the plan root | 14:23 |
| shardy | d0ugal: http://paste.openstack.org/show/724134/ | 14:23 |
| openstackgerrit | Merged openstack/diskimage-builder master: Remove redundant word https://review.openstack.org/576466 | 14:23 |
| shardy | d0ugal: yea I was wondering if a sub-workflow that can get/put one object would help | 14:23 |
| shardy | let me try that - can you do that in a workflow inline or only in a workbook? | 14:24 |
| *** dmacpher has joined #tripleo | 14:26 | |
| d0ugal | shardy: it needs to be at the workbook level | 14:26 |
| shardy | d0ugal: ack thanks, will give it a go now | 14:27 |
| d0ugal | shardy: we have been prepending with an underscore to mark it as internal - not ideal, but a start. | 14:27 |
| *** cdearborn has joined #tripleo | 14:29 | |
| *** leanderthal has quit IRC | 14:31 | |
| *** dxiri has joined #tripleo | 14:32 | |
| *** skramaja has quit IRC | 14:34 | |
| *** leanderthal has joined #tripleo | 14:35 | |
| *** jaganathan has quit IRC | 14:39 | |
| *** mfedosin has joined #tripleo | 14:45 | |
| *** yamahata has joined #tripleo | 14:46 | |
| shardy | d0ugal: nice, thanks - that worked! :) | 14:46 |
| lvdombrkr89 | shardy: hi. is there somewhere documented how to activate ipv6 prefix delegation on triple0? | 14:47 |
| d0ugal | shardy: Great | 14:47 |
| jpena | mwhahaha, quiquell|rover: the new puppet-stdlib package has been built | 14:47 |
| shardy | lvdombrkr89: didn't we already discuss this?! | 14:47 |
| mwhahaha | jpena: thanks | 14:47 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Do not run nic template conversion on default tht location https://review.openstack.org/569272 | 14:48 |
| shardy | lvdombrkr89: I don't think it's explicitly documented atm, you may need to use *ExtraConfig to control the puppet-neutron configuration, which is documented here: | 14:48 |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/node_config.html | 14:49 |
| shardy | lvdombrkr89: sounds like this may be a gap in our current ipv6 support | 14:49 |
| shardy | did you manage to speak with dsneddon about it? | 14:49 |
| haleyb | lvdombrkr89: regarding your ipv6 pd question from yesterday, it is working for me. ping me in #openstack-neutron | 14:50 |
| haleyb | nothing related to tripleo though | 14:50 |
| shardy | thanks haleyb - perhaps you can share details of the configuration as it may be something we need to support in tripleo? | 14:51 |
| lvdombrkr89 | shardy: im ping dsneddon yesterday twice but without luck | 14:53 |
| *** Skyraven has quit IRC | 14:53 | |
| *** moguimar has quit IRC | 14:53 | |
| haleyb | shardy: the first step is just changing a flag in neutron.conf - ipv6_pd_enabled=True - the rest is just the tenant creating a subnet with the right flags | 14:55 |
| *** zshi has quit IRC | 14:57 | |
| shardy | haleyb: Ok thanks for the info, doesn't seem to be supported in puppet-neutron afaics so that's probably the first step | 14:57 |
| *** rodolof has quit IRC | 14:58 | |
| *** rodolof has joined #tripleo | 14:59 | |
| *** afazekas has quit IRC | 15:00 | |
| *** afazekas has joined #tripleo | 15:00 | |
| *** quiquell|rover is now known as quiquell|off | 15:01 | |
| *** mhenkel__ has joined #tripleo | 15:05 | |
| *** lblanchard has joined #tripleo | 15:05 | |
| *** zshi has joined #tripleo | 15:06 | |
| *** sanjayu_ has quit IRC | 15:06 | |
| *** slaweq has quit IRC | 15:06 | |
| *** ksambor has quit IRC | 15:07 | |
| *** slaweq has joined #tripleo | 15:07 | |
| *** mhenkel_ has quit IRC | 15:08 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778201 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| *** sanjay__u has joined #tripleo | 15:11 | |
| *** itlinux has joined #tripleo | 15:11 | |
| *** moguimar has joined #tripleo | 15:14 | |
| larsks | Is there a way to get tripleo to "update" service templates? E.g., I've written a service template and deployed it, but there was an error. I've noticed that even if I fix the problem and re-run "overcloud deploy", it seems that the *original* template is still active, so I continue to get the same error despite having fixed it in the file. | 15:15 |
| shardy | larsks: are you passing a -e environment with a resource_registry referencing the fixed version? | 15:16 |
| shardy | that should be enough AFAIK | 15:16 |
| larsks | shardy: Yes. | 15:16 |
| larsks | shardy: maybe I am imagining things. There have been a *lot* of redeploys. Since it sounds like this isn't known behavior, I'll try to test it explicitly. | 15:17 |
| shardy | hmm, you can do openstack stack environment show overcloud to see the swift object and download it to check it's been updated, but I'm not sure what would cause it to not be updated | 15:17 |
| shardy | larsks: ack, the only thing I can think of is a typo in the resource_registry key or something | 15:18 |
| larsks | I am positive that's not the problem (because I'm only modifying the service template, not the corresponding environment file). I'll see if I can reproduce it. | 15:18 |
| *** lblanchard has quit IRC | 15:23 | |
| *** yprokule has quit IRC | 15:25 | |
| larsks | If I want to run some 'openstack' cli commands during postinstall, what's the best way to get admin credentials? | 15:26 |
| *** jcoufal has quit IRC | 15:28 | |
| mwhahaha | larsks: source overcloudrc | 15:29 |
| michchap | I see there's a bug around pick in the puppet modules, but I'm getting an error on every inifile-derived resource Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation) which might be from the latest puppetlabs-inifile commit | 15:29 |
| *** janki has joined #tripleo | 15:29 | |
| larsks | mwhahaha: where is overcloudrc located on the overcloud nodes? | 15:30 |
| mwhahaha | larsks: it's not, it's on the undercloud | 15:30 |
| *** jistr is now known as jistr|afk | 15:30 | |
| larsks | mwhahaha: I think you misread my question. | 15:30 |
| larsks | I want to do this as part of a NodeExtraConfigPost. | 15:30 |
| shardy | larsks: I think you can use external_deploy_tasks, sec | 15:30 |
| mwhahaha | larsks: "<larsks> If I want to run some 'openstack' cli commands during postinstall, what's the best way to get admin credentials?" you didnt' ask on the overcloud | 15:30 |
| larsks | mwhahaha: Anyway, I hope I have clarified the question. | 15:30 |
| mwhahaha | gotta be more specific | 15:31 |
| shardy | larsks: does it have to be NodeExtraConfigPost vs a service template? | 15:31 |
| mwhahaha | depends on the actions, i wouldn't necessarily use an opesntack cli command, what is it? | 15:31 |
| mwhahaha | michchap: logs? | 15:31 |
| larsks | shardy: I guess it could be a service template instead. | 15:31 |
| michchap | mwhahaha: I'm using local reproducer. 1 sec I'll put it somewhere | 15:32 |
| *** jistr|afk is now known as jistr | 15:32 | |
| larsks | mwhahaha: supporting keystone federation requires a number of resources to be created in keystone. I would like to make this part of the deploy process, and both my ruby-foo and patience are too weak to deal with creating appropriate keystone providers. | 15:32 |
| larsks | I was really hoping to just run a series of "openstack ..." commands at the end of the deploy process. | 15:33 |
| mwhahaha | larsks: well it needs to be done in providers, that's the correct way to configure these | 15:33 |
| mwhahaha | calling openstackcli is not the correct way to handle this | 15:33 |
| larsks | Well that's a terrible ui for operators and I'm looking for a better solution. | 15:33 |
| larsks | I'll just go hack something together. | 15:34 |
| mwhahaha | if it's in the providers, it can get rolled into the deployment | 15:34 |
| mwhahaha | you are hacking things together | 15:34 |
| mwhahaha | which is not ok | 15:34 |
| mwhahaha | if you need help with providers ask, don't just go straight to the hack | 15:34 |
| mwhahaha | since you're not actually providing details, it's hard to provide you solutions | 15:35 |
| *** ykarel|away has joined #tripleo | 15:35 | |
| larsks | shardy: did you have thoughts w/r/t doing this via a service template? | 15:35 |
| michchap | mwhahaha: here's undercloud_install: https://gist.githubusercontent.com/michaeltchapman/17cef626207eec00aaf80a424a374709/raw/3b8ceea7e2b1e6f8d866f5df2f1d2a4f47f844c3/gistfile1.txt | 15:38 |
| mwhahaha | michchap: ugh | 15:39 |
| *** lblanchard has joined #tripleo | 15:39 | |
| michchap | this is the commit that looks suspicious https://github.com/puppetlabs/puppetlabs-inifile/commit/4373d194bbde44d2d59be07b501f393c5c227b92 | 15:39 |
| mwhahaha | michchap: yea it's likely that | 15:39 |
| michchap | but I'm not ruling out pebkac since I'm still learning the repro script's libvirt mode | 15:39 |
| mwhahaha | michchap: no it's likely the glance_swift_config provider is doing something silly | 15:40 |
| michchap | mwhahaha: It's all our providers | 15:40 |
| larsks | mwhahaha: I see your point of view. As a developer, there is a Right Way to accomplish things. But I am working closely with operators who are absolutely *not* developers, and I am trying ti convince them that using tripleo is a step up from their existing cobbled-together environment. I would like to demonstrate that there is a clean way of adding features to a tripleo deployment locally. The reason I'm | 15:40 |
| mwhahaha | probably because we need to define that in our providers | 15:40 |
| larsks | trying to avoid puppet provides is that, from an operator point of view, that road is often too long to be practical. If my goal is simply "create an identity provider, creating a mapping, create a protocol", to accomplish that via providers means (a) learn puppet (b) learn ruby, because providers, (c) try to deploy patched puppet modules locally or (d) try to get the patches merged upsteam and wait for | 15:40 |
| larsks | packages, except that (d) then requires writing unit tests which means (e) learn how rspec works, when in the beginning all I wanted was to run some simple commands as part of the deploy process. | 15:40 |
| michchap | mwhahaha: anything deriving from inifile has the same error, so it's either in the boilerplace we copypaste or in some other common spot | 15:41 |
| larsks | And of course there's a good chance that it requires patches to t-h-t, puppet-tripleo, and at least one other module. | 15:41 |
| mwhahaha | larsks: hi, this is the development channel for current work. Since what they have is not officially supported, the correct way is to implement it. There are ways to hack in openstack commands however, upgrades will not work | 15:41 |
| larsks | Yup. | 15:42 |
| mwhahaha | larsks: so yes we can provide you with workarounds if you provide us with details as to what you are actually doing rahter than asking generic questions | 15:42 |
| mwhahaha | larsks: i have no context so the questions your asking me lead me to beleive you are doing something that is not ideal for the operator int he long team | 15:42 |
| mwhahaha | larsks: so please, my focus is getting support in the main line so others can benefit | 15:42 |
| larsks | I want to run openstack commands during the deploy process with admin credentials in environment (or in a generated clouds.yaml file or something). | 15:42 |
| larsks | That's really all I'm looking for. | 15:42 |
| mwhahaha | larsks: there is none, so you have to look to see how we pass the creds into other scripts | 15:43 |
| mwhahaha | larsks: there are ways, step 1) grep the code base. but long term you need to line up the development to get these features properly supported | 15:43 |
| mwhahaha | larsks: and that's not going away | 15:43 |
| larsks | No argument there. | 15:43 |
| larsks | We're definitely stuck with this. | 15:43 |
| mwhahaha | what's missing is upstream support for this configuration because it's been neglected and will continue to be if you keep hacking stuff in | 15:44 |
| mwhahaha | larsks: examples, https://github.com/openstack/tripleo-heat-templates/search?q=OS_USERNAME&unscoped_q=OS_USERNAME | 15:44 |
| mwhahaha | larsks: specifically if you just want to run a script, https://github.com/openstack/tripleo-heat-templates/blob/305d83ec7c44d97573f24a86c735b340a65f2991/extraconfig/post_deploy/undercloud_post.yaml is a good example | 15:45 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Filter qrouter containers from images validation script https://review.openstack.org/577459 | 15:46 |
| *** lvdombrkr89 has quit IRC | 15:48 | |
| *** mhenkel__ has quit IRC | 15:48 | |
| dsneddon | lvdombrkr89, I didn't see any pings from you yesterday. What are your questions about IPv6? | 15:48 |
| *** jistr is now known as jistr|off | 15:50 | |
| mwhahaha | michchap: filed a bug https://bugs.launchpad.net/tripleo/+bug/1778247 to track it | 15:54 |
| openstack | Launchpad bug 1778247 in tripleo "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,Triaged] | 15:54 |
| michchap | mwhahaha: thanks, sorry I should have done that, I came in here to see if anyone else had seen it. | 15:54 |
| *** larsks has left #tripleo | 15:55 | |
| *** Haresh has joined #tripleo | 15:55 | |
| *** panda is now known as panda|off | 15:59 | |
| mwhahaha | michchap: np just trying to get ahead of stuff. i'll also reproduce it because it's likely going to affect ci and we'll need to figure out how to fix the upstream module | 16:01 |
| *** tesseract has quit IRC | 16:02 | |
| *** pcaruana has quit IRC | 16:04 | |
| *** lukas__ has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778247 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1778247 in tripleo "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,Triaged] | 16:10 |
| *** ffiore has quit IRC | 16:14 | |
| *** holser_ has quit IRC | 16:17 | |
| *** mhenkel_ has joined #tripleo | 16:20 | |
| *** rbrady is now known as rbrady-afk | 16:21 | |
| *** slaweq has quit IRC | 16:21 | |
| *** mhenkel_ has quit IRC | 16:24 | |
| *** mjturek has quit IRC | 16:24 | |
| *** ykarel|away has quit IRC | 16:25 | |
| *** slaweq has joined #tripleo | 16:25 | |
| *** yamahata has quit IRC | 16:26 | |
| michchap | mwhahaha: I think it only errors when the section doesn't exist and needs to be created | 16:28 |
| mwhahaha | michchap: well that was what teh functionality was :D it's likely that we are missing a type inherience somewhere | 16:29 |
| *** zoli is now known as zoli|gone | 16:29 | |
| michchap | mwhahaha: does defaultto not carry through to the child? | 16:29 |
| *** radeks has quit IRC | 16:30 | |
| mwhahaha | they should | 16:30 |
| mwhahaha | but i wouldn't be shocked if they don't | 16:30 |
| *** jpich has quit IRC | 16:31 | |
| *** suuuper has quit IRC | 16:32 | |
| *** dtantsur is now known as dtantsur|afk | 16:37 | |
| *** slaweq has quit IRC | 16:38 | |
| *** jpena is now known as jpena|off | 16:43 | |
| *** yamahata has joined #tripleo | 16:47 | |
| *** psachin` has quit IRC | 16:48 | |
| *** derekh has quit IRC | 16:51 | |
| *** rpioso is now known as rpioso|eat | 16:59 | |
| *** trown is now known as trown|lunch | 17:03 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778247 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1778247 in tripleo "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,Triaged] | 17:10 |
| *** rodolof has quit IRC | 17:10 | |
| *** pchavva has quit IRC | 17:10 | |
| *** marbindrakon has quit IRC | 17:13 | |
| *** salmankhan has quit IRC | 17:20 | |
| *** cdearborn_ has joined #tripleo | 17:22 | |
| *** bfournie has quit IRC | 17:26 | |
| *** Haresh has quit IRC | 17:31 | |
| *** gfidente has quit IRC | 17:31 | |
| *** amoralej is now known as amoralej|off | 17:33 | |
| mwhahaha | michchap: https://github.com/puppetlabs/puppetlabs-inifile/pull/288/ | 17:35 |
| mwhahaha | michchap: i pinned in rdo so we should be ok soonish, but yea it's a problem | 17:35 |
| michchap | mwhahaha: cheers. I had a quick look but it was beyond my ruby skills. | 17:36 |
| *** cdearborn has quit IRC | 17:38 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add a way to override base path when file driver is used https://review.openstack.org/574812 | 17:44 |
| *** agopi has quit IRC | 17:48 | |
| *** agopi has joined #tripleo | 17:49 | |
| *** pchavva has joined #tripleo | 17:59 | |
| *** trown|lunch is now known as trown | 18:04 | |
| *** pkovar has quit IRC | 18:07 | |
| *** mcornea has quit IRC | 18:08 | |
| *** bfournie has joined #tripleo | 18:08 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778247 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1778247 in puppet-openstacklib "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 18:10 |
| *** mcornea has joined #tripleo | 18:20 | |
| *** itlinux has quit IRC | 18:23 | |
| *** mhenkel_ has joined #tripleo | 18:25 | |
| *** mhenkel_ has quit IRC | 18:25 | |
| *** mhenkel_ has joined #tripleo | 18:26 | |
| *** pchavva has quit IRC | 18:46 | |
| *** janki has quit IRC | 18:52 | |
| *** dmacpher has quit IRC | 18:54 | |
| *** colonwq has quit IRC | 18:55 | |
| *** colonwq has joined #tripleo | 18:59 | |
| *** pchavva has joined #tripleo | 19:01 | |
| *** artom has quit IRC | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778247 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1778247 in puppet-openstacklib "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 19:10 |
| *** yolanda__ has joined #tripleo | 19:12 | |
| *** yolanda_ has quit IRC | 19:16 | |
| *** yolanda__ has quit IRC | 19:18 | |
| *** morazi has quit IRC | 19:22 | |
| *** moshele has joined #tripleo | 19:27 | |
| *** liverpooler has quit IRC | 19:27 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Allow upgrade of custom roles https://review.openstack.org/577520 | 19:28 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Allow fast forward upgrade of custom roles https://review.openstack.org/577520 | 19:31 |
| *** cmurphy is now known as cmurphy_vacation | 19:31 | |
| *** udesale has quit IRC | 19:35 | |
| *** rpioso|eat is now known as rpioso | 19:39 | |
| *** atoth has quit IRC | 19:42 | |
| *** pchavva has quit IRC | 19:49 | |
| *** udesale has joined #tripleo | 19:49 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Adjust roles_data during FFU https://review.openstack.org/558081 | 19:51 |
| *** mmethot has quit IRC | 19:55 | |
| *** udesale has quit IRC | 19:58 | |
| *** mcornea has quit IRC | 19:58 | |
| *** morazi has joined #tripleo | 20:06 | |
| *** itlinux has joined #tripleo | 20:09 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Switch ansible tmp for local connections https://review.openstack.org/577544 | 20:09 |
| *** mcornea has joined #tripleo | 20:10 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778247 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1778247 in puppet-openstacklib "Could not evaluate: Invalid parameter force_new_section_creation(:force_new_section_creation)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 20:10 |
| *** moshele has quit IRC | 20:18 | |
| openstackgerrit | Sam Doran proposed openstack/tripleo-common master: Set ANSIBLE_REMOTE_TMP for undercloud group https://review.openstack.org/577550 | 20:25 |
| *** mmethot has joined #tripleo | 20:27 | |
| *** rh-jelabarre has joined #tripleo | 20:38 | |
| *** mcornea has quit IRC | 20:42 | |
| *** raildo has quit IRC | 20:52 | |
| *** rfolco_ has quit IRC | 21:00 | |
| *** trown is now known as trown|outtypewww | 21:07 | |
| *** bugzy_ has joined #tripleo | 21:07 | |
| *** asbishop has quit IRC | 21:09 | |
| *** holser_ has joined #tripleo | 21:10 | |
| *** bugzy has quit IRC | 21:11 | |
| *** yolanda has joined #tripleo | 21:15 | |
| mwhahaha | hmm the quickstart reproducer script is hanging on the waiting for nodes to be reachable but i can ssh into them | 21:22 |
| *** toure is now known as toure|gone | 21:25 | |
| mwhahaha | oh it's that ip address thing | 21:27 |
| *** ayoung has quit IRC | 21:31 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Persist ceph-ansible fetch_directory https://review.openstack.org/567782 | 21:33 |
| *** holser_ has quit IRC | 21:37 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: WIP/DNM: Persist ceph-ansible fetch_directory https://review.openstack.org/567782 | 21:38 |
| *** rh-jelabarre has quit IRC | 21:42 | |
| *** rodolof has joined #tripleo | 21:43 | |
| *** ayoung has joined #tripleo | 21:44 | |
| *** liverpooler has joined #tripleo | 21:48 | |
| *** pradk has quit IRC | 21:57 | |
| *** mhenkel_ has quit IRC | 21:57 | |
| *** eck` is now known as eck`gone | 21:59 | |
| *** cdearborn_ has quit IRC | 22:00 | |
| Damjanek | Howdy. Can someone with +2 can take a look at this: https://review.openstack.org/#/c/576819/ please? | 22:00 |
| *** eck`gone is now known as eck` | 22:00 | |
| *** eck` is now known as eck`gone | 22:01 | |
| *** eck`gone is now known as eck` | 22:01 | |
| *** hamzy_ has joined #tripleo | 22:06 | |
| *** hamzy has quit IRC | 22:08 | |
| *** etingof has quit IRC | 22:09 | |
| *** edmondsw has joined #tripleo | 22:09 | |
| *** edmondsw has quit IRC | 22:13 | |
| *** rh-jelabarre has joined #tripleo | 22:15 | |
| *** florianf has quit IRC | 22:24 | |
| *** rodolof has quit IRC | 22:25 | |
| *** rodolof has joined #tripleo | 22:25 | |
| *** rodolof has quit IRC | 22:30 | |
| *** ayoung has quit IRC | 22:33 | |
| *** pradk has joined #tripleo | 22:42 | |
| *** liverpooler has quit IRC | 22:42 | |
| *** mhenkel_ has joined #tripleo | 22:51 | |
| *** dxiri_ has joined #tripleo | 22:53 | |
| *** myoung has joined #tripleo | 22:53 | |
| *** pliu_ has joined #tripleo | 22:54 | |
| *** markmc` has joined #tripleo | 22:54 | |
| *** hewbrocc` has joined #tripleo | 22:54 | |
| *** mburned` has joined #tripleo | 22:54 | |
| *** rnoriega_ has joined #tripleo | 22:54 | |
| *** akrzos_ has joined #tripleo | 22:54 | |
| *** haleyb_ has joined #tripleo | 22:54 | |
| *** jjoyce has joined #tripleo | 22:54 | |
| *** _atoth has joined #tripleo | 22:54 | |
| *** rasca- has joined #tripleo | 22:54 | |
| *** lhinds|out has joined #tripleo | 22:55 | |
| *** lhinds has quit IRC | 22:56 | |
| *** aputtur_ has joined #tripleo | 22:56 | |
| *** mhenkel_ has quit IRC | 22:56 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Option to upload Octavia amphora img in RAW format https://review.openstack.org/577573 | 22:56 |
| *** hewbrocca_afk has quit IRC | 22:56 | |
| *** aputtur has quit IRC | 22:57 | |
| *** weshay_PTO has quit IRC | 22:57 | |
| *** weshay has joined #tripleo | 22:57 | |
| *** pliu has quit IRC | 22:57 | |
| *** markmc has quit IRC | 22:57 | |
| *** rasca has quit IRC | 22:57 | |
| *** dxiri has quit IRC | 22:57 | |
| myoung | mwhahaha: got the last 5/6 patches that were hung up on https://bugs.launchpad.net/tripleo/+bug/1778201 gate fails, I think that's all from today | 22:57 |
| openstack | Launchpad bug 1778201 in tripleo "os-refresh-config undercloud install Error: Evaluation Error: Error while evaluating a Function Call, pick(): must receive at least one non empty" [Critical,Fix released] - Assigned to Quique Llorente (quiquell) | 22:57 |
| *** mburned has quit IRC | 22:57 | |
| *** faceman has quit IRC | 22:57 | |
| *** akrzos has quit IRC | 22:57 | |
| *** fuzzball81 has quit IRC | 22:57 | |
| mwhahaha | yea i saw some green CI results come back so i think we're green now | 22:58 |
| *** rnoriega has quit IRC | 22:58 | |
| * myoung nods | 22:58 | |
| mwhahaha | the ones that weren't failing on pick failed on the ini settings stuff | 22:58 |
| *** haleyb has quit IRC | 22:58 | |
| *** myoung|ruck has quit IRC | 22:58 | |
| myoung | There was one more that I don't really understand yet, but it was isolated instance, rechecked and will watch | 22:58 |
| mwhahaha | link? | 22:58 |
| myoung | https://bugs.launchpad.net/tripleo/+bug/1778291 | 22:59 |
| openstack | Launchpad bug 1778291 in tripleo "/home/zuul/workspace/devstack-gate/functions.sh: line 184: declare: gate_hook: not found" [High,Triaged] | 22:59 |
| myoung | but haven't invested any time yet, was on a culling pass, logged it and moved on | 22:59 |
| mwhahaha | myoung: so that's usually a ping test failure in node setup | 22:59 |
| mwhahaha | myoung: check the end of http://logs.openstack.org/96/568696/6/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/a878363/logs/devstack-gate-setup-host.txt | 22:59 |
| mwhahaha | node couldn't ping the vexxhost mirror | 22:59 |
| mwhahaha | mnaser: -^ not sure if you guys monitor these types of failures | 23:00 |
| myoung | --- mirror02.ca-ymq-1.vexxhost.openstack.org ping statistics --- | 23:00 |
| myoung | 1 packets transmitted, 0 received, 100% packet loss, time 0ms | 23:00 |
| *** etingof has joined #tripleo | 23:00 | |
| myoung | eww | 23:00 |
| mwhahaha | i would wait more than 1 packet | 23:01 |
| mwhahaha | but that's just me | 23:01 |
| myoung | it's just started now, will have to see if repro | 23:01 |
| myoung | thx, adding to LP | 23:01 |
| mwhahaha | myoung: it's upstream infra problems | 23:01 |
| mwhahaha | i've noticed an increase in those | 23:01 |
| * myoung nods | 23:01 | |
| mwhahaha | not sure if they monitor thos | 23:01 |
| myoung | mwhahaha: ack | 23:02 |
| myoung | mwhahaha: dropping off, tgif, have good weekend. I'll check in on the rechecks but they all seemed to be UC install borked on pick() issue | 23:02 |
| mwhahaha | later | 23:02 |
| myoung | mwhahaha: you beat me to most of em | 23:02 |
| *** myoung is now known as myoung|off | 23:03 | |
| mnaser | mwhahaha: I don’t control | 23:05 |
| mnaser | The mirrors | 23:05 |
| mnaser | But I’ll ping infra-root to have a look | 23:05 |
| *** rlandy has quit IRC | 23:05 | |
| mwhahaha | mnaser: it's usually a node transit issue thats why i asked | 23:05 |
| mwhahaha | mnaser: though we should probably ensure >1 icmp before bailing :D | 23:06 |
| mnaser | I wonder if the instance is getting overwhelmed with traffic | 23:06 |
| mnaser | I don’t think the mirrors get that much load | 23:06 |
| mwhahaha | yea | 23:06 |
| mnaser | Oh infra collects data via cacti I think | 23:06 |
| mnaser | That might be helpful | 23:06 |
| fungi | we do indeed | 23:09 |
| fungi | look in particular at the eth0 traffic volumes | 23:10 |
| fungi | some of our providers (e.g., rackspace) cap bandwidth to nova instances based on the flavor used to boot them | 23:10 |
| fungi | if you see a characteristic overdrive sort of flattening (every plugged your guitar through an overdrive pedal and then into an oscilliscope? we're all scientists here!) then it's usually a sign we're running afoul of a bandwidth cap | 23:12 |
| *** etingof has quit IRC | 23:12 | |
| *** vinaykns has quit IRC | 23:12 | |
| *** dhill_ has quit IRC | 23:18 | |
| *** dxiri has joined #tripleo | 23:21 | |
| *** dxiri_ has quit IRC | 23:21 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Option to upload Octavia amphora img in RAW format https://review.openstack.org/577579 | 23:22 |
| *** etingof has joined #tripleo | 23:24 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Option to upload Octavia amphora img in RAW format https://review.openstack.org/577579 | 23:24 |
| *** tosky has quit IRC | 23:41 | |
| *** leanderthal has quit IRC | 23:44 | |
| *** rpioso is now known as rpioso|afk | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!