Tuesday, 2018-08-07

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401700:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534200:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)00:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]00:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)00:10
*** gbarros has quit IRC00:19
*** gbarros has joined #tripleo00:40
*** gbarros has quit IRC00:59
*** mrsoul has joined #tripleo01:01
*** mschuppert has quit IRC01:04
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534201:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)01:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]01:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)01:10
openstackgerritwes hayutin proposed openstack/tripleo-common master: Add config_download_timeout input  https://review.openstack.org/58635601:36
openstackgerritwes hayutin proposed openstack/python-tripleoclient master: Honor timeout with config-download  https://review.openstack.org/58635801:36
openstackgerritEmilien Macchi proposed openstack/paunch master: WIP podman support  https://review.openstack.org/58931201:39
*** gfidente|afk has quit IRC01:41
*** gbarros has joined #tripleo01:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Podman support for docker-puppet  https://review.openstack.org/58865501:51
*** mrsoul has quit IRC02:02
*** yolanda has quit IRC02:03
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401702:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534202:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]02:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)02:10
*** jtcressy has quit IRC02:26
*** tzumainn has quit IRC02:31
*** skramaja has joined #tripleo02:36
*** psachin has joined #tripleo02:41
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401703:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534203:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]03:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)03:10
*** ramishra has joined #tripleo03:16
*** gbarros has quit IRC03:26
*** saneax has joined #tripleo03:41
*** janki has joined #tripleo03:41
*** udesale has joined #tripleo03:48
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401704:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534204:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)04:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]04:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)04:10
*** ykarel has joined #tripleo04:35
*** pdeore has joined #tripleo04:52
*** Petersingh has joined #tripleo04:55
*** links has joined #tripleo04:57
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Add novajoin package to nova-compute image  https://review.openstack.org/58935204:57
*** ksambor has joined #tripleo05:00
*** bfournie has quit IRC05:04
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401705:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534205:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)05:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]05:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)05:10
*** ratailor has joined #tripleo05:11
*** shyambiradar has joined #tripleo05:12
*** agurenko has joined #tripleo05:13
*** diablo_rojo_phon has left #tripleo05:14
*** psachin has quit IRC05:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add neutron metadata agent to the undercloud  https://review.openstack.org/58935405:18
*** psachin has joined #tripleo05:26
*** jaosorior has quit IRC05:26
Tenguhello there05:27
ksamborhi05:28
Tenguhmmm. I think I'll never rememeber - is it check-rdo or rdo-check?05:31
*** anande has joined #tripleo05:37
*** hgogada has joined #tripleo05:38
*** anande has quit IRC05:38
*** anande has joined #tripleo05:39
*** shyambiradar has quit IRC05:39
*** shyambiradar has joined #tripleo05:39
*** moshele has joined #tripleo05:56
flaper87trown|outtypewww: I haven't seen that error before :/05:59
shyambiradarHi jaosorior06:01
*** apetrich has joined #tripleo06:01
shyambiradarAny thoughts you got on how to register keystone service during overcloud deployment?06:02
*** mschuppert has joined #tripleo06:04
*** jaosorior has joined #tripleo06:05
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071906:06
*** holser_ has joined #tripleo06:06
*** dxiri has quit IRC06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401706:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534206:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]06:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)06:10
*** holser_ has quit IRC06:11
*** quiquell has joined #tripleo06:21
*** jfrancoa has joined #tripleo06:31
*** anande has quit IRC06:32
jaosoriormandre: well, while I would really like novajoin to be used outside of tripleo. I don't think we're there yet.06:34
jaosoriorThat's why I submitted it for our overwrites06:34
quiquelljaosorior: What's novajoin ?06:35
*** pcaruana has joined #tripleo06:36
jaosoriorquiquell: a servic we wrote that automates server enrollments to FreeIPA06:36
shyambiradarjaosorior: Anything you got on my query?06:37
jaosoriorquiquell: so, it's tied to nova, and when you create a VM with nova (or a baremetal node if you're using the ironic backend), it'll automatically enroll the node to FreeIPA and create the relevant service entries06:37
jaosoriorshyambiradar: I didn't. What's up?06:37
jaosoriorquiquell: we use that for the TLS everywhere setup06:37
shyambiradarjaosorior: I am kind of blocked here :)06:38
quiquelljaosorior: FreeIPA sound like free beer06:38
jaosoriorquiquell: haha it sure does :D (someone should definitely create a beer for that project)06:38
shyambiradarjaosorior: Trying to figure out how to register keystone endpoints and service06:39
jaosoriorquiquell: in RedHat terms it's called IdM06:39
jaosoriorshyambiradar: so, your best bet is to do it via puppet06:39
jaosoriorshyambiradar: we do have utilities to run puppet inside the container06:39
shyambiradarok06:40
jaosoriorand from there you do have keystone credentials in order to create the service and the endpoint06:40
*** anande has joined #tripleo06:40
shyambiradargreat06:40
jaosoriorshyambiradar: you can also do it via ansible, however, it's not as straight forward06:40
shyambiradarI would prefer best way06:40
shyambiradarpuppet is good06:40
jaosoriorOK06:40
shyambiradarCan you refer to some doc?06:40
*** yolanda has joined #tripleo06:41
jaosorioryou'll need a similar entry than here: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/keystone.pp#L30306:41
jaosoriorwhere the *_enabled hiera entry is automatically generated for you, based on your service's name06:42
jaosoriorthe service name is the name you add in the heat template06:42
jaosoriorfor instance, this https://github.com/openstack/tripleo-heat-templates/blob/stable/ocata/puppet/services/keystone.yaml#L19006:43
shyambiradarbut mine is custom service06:43
shyambiradarI will add it in roles data06:43
jaosoriorright06:43
shyambiradarand it will get installed at step506:44
jaosoriorThis is how the manifest will look like: https://github.com/openstack/puppet-barbican/blob/master/manifests/keystone/auth.pp#L5206:44
chandankumarjaosorior: Hello06:44
jaosoriorshyambiradar: will your service be open source? (would be a little easier for me to help out)06:44
jaosoriorchandankumar: hello!06:44
chandankumarjaosorior: I need some help on this patch https://review.openstack.org/#/c/584368/15/roles/validate-tempest/defaults/main.yml@3506:44
chandankumarjaosorior: i needed this 192.168.24.1:8787/tripleomaster/centos-binary-tempest:current-tripleo-updated-2018080616305606:46
*** Petersingh is now known as Petersingh|afk06:46
shyambiradarjaosorior: At present it's not opensource06:46
chandankumarbut it is returning 192.168.24.1:8787/tripleomaster/centos-binary-tempest:959e1d7f755ee681b6f23b498d262a9e4dd6326f_4cbb1814-updated-2018080616305606:46
shyambiradarjaosorior: But we are official partners of redhat and will be certifying the plugins06:47
chandankumarjaosorior: I tried tag also but not working06:47
jaosoriorchandankumar: uhm.... I guess it's because we don't use "current" for the image, but instead the specific hash you're seeing.06:47
*** Petersingh|afk is now known as Petersingh06:50
jaosoriorshyambiradar: what version are you planning on using?06:50
chandankumarjaosorior: so what should i do there?06:50
jaosoriorrocky/osp14?06:50
shyambiradarRHOSP1306:51
shyambiradarjaosorior: RHOSP1306:51
shyambiradarjaosorior: We have done integration with RHOSP10 in last release06:51
jaosoriorchandankumar: would it always be current? or does it vary depending on the release?06:52
shyambiradarjaosorior: But in RHOSP13 it's containerized, you know things are changed06:52
shyambiradarjaosorior: I got some idea on this, but not much clear, I will complete basic things from my side06:53
*** saneax has quit IRC06:53
chandankumarjaosorior: nope, just need to use the proper tag for each release so that we have the latest tempest container06:54
jaosoriorshyambiradar: the other option is to use deploy_steps_tasks, and do it via ansible. you can use this module : https://docs.ansible.com/ansible/latest/modules/os_keystone_endpoint_module.html#os-keystone-endpoint-module  and populate the auth dictionary manually, in a similar manner to how octavia does it06:54
jaosoriorhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/octavia/octavia-deployment-config.yaml#L18206:54
jaosoriorchandankumar: to be honest I don't know how, maybe someone from #oooq could help?06:54
*** aufi has joined #tripleo06:54
shyambiradarjaosorior: ok06:55
jaosoriorshyambiradar: so yeah, that would be another option06:55
*** aufi has quit IRC06:55
*** aufi has joined #tripleo06:56
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Run emit_releases_file.py for all featuresets  https://review.openstack.org/58564906:59
*** shyambiradar has quit IRC07:00
*** shyambiradar has joined #tripleo07:00
*** trinaths has joined #tripleo07:03
shyambiradarjaosorior: Two things come in mind: 1. My existing code is in puppet, so introducing new devops tool in the same code does not looks good07:03
trinathsHi TripleO team, please have a glance at https://review.openstack.org/#/c/587491/ and help review the same.07:03
shyambiradarjaosorior: 2. I used this ansible module in our ansible scripts, but populating credentials is it possible during overcloud deploymet automatically?07:04
shyambiradarwithout manual intervention07:04
jaosoriorshyambiradar: yes07:04
*** gkadam has joined #tripleo07:04
jaosoriorshyambiradar: see the links I pointed you to07:05
jaosoriorthe octavia one specifically. That's how you get the credentials dynamically07:05
shyambiradarjaosorior: yes, I will look into it07:06
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: To test emit_releases_file.py at all featuresets  https://review.openstack.org/56044507:07
shyambiradarjaosorior: This looks good07:07
shyambiradarlet me explore both ways in detail07:07
shyambiradarThanks jaosorior07:07
*** amoralej|off is now known as amoralej07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401707:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534207:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]07:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)07:10
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates stable/queens: [DNM] To test emit_releases_file.py on all festuresets  https://review.openstack.org/58938007:10
*** hgogada has left #tripleo07:11
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates stable/pike: [DNM] To test emit_releases_file.py at all featuresets  https://review.openstack.org/58938107:12
*** hgogada has joined #tripleo07:12
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: To test emit_releases_file.py at all featuresets  https://review.openstack.org/56044507:13
*** shyambiradar has quit IRC07:13
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044507:13
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use local docker registry host for tempest container  https://review.openstack.org/58436807:13
ykarelchandankumar, ^^ Trying07:14
*** numans has joined #tripleo07:14
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: To test emit_releases_file.py at all featuresets  https://review.openstack.org/58938307:15
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Run emit_releases_file.py for all featuresets  https://review.openstack.org/58564907:18
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: [DNM] To test emit_releases_file.py at all featuresets  https://review.openstack.org/58938307:19
*** shyambiradar has joined #tripleo07:23
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Refactor timeout logic  https://review.openstack.org/58906807:25
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Mitigate lodash vulnerability  https://review.openstack.org/58938607:27
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Cleanup variables and toci_jobtype leftovers  https://review.openstack.org/58446507:27
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Replace TAGS with ansible var  https://review.openstack.org/58450807:27
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Refactor timeout logic  https://review.openstack.org/58906807:27
*** trinaths has quit IRC07:31
*** anande has quit IRC07:31
*** anande has joined #tripleo07:32
*** Petersingh is now known as Petersingh|lunch07:32
AeliaHello, concerning the scale issue I asked about yesterday, I have found more about it by looking into the heat stack state. Anybody can help me track what happens with this resource_type OS:Mistal:ExternalResource here -> https://gist.github.com/dabelenda/5ab01a1ecab808c0e9734741019443c0#file-heat-stack-state ?07:32
jaosoriorCould I get some reviews for https://review.openstack.org/#/c/588245/ https://review.openstack.org/#/c/588246/ and https://review.openstack.org/#/c/588291/  ?07:33
*** anande_ has joined #tripleo07:34
*** jpena|off is now known as jpena07:35
jaosoriorbandini, mandre ^^07:36
bandinijaosorior: in a call, will get to it in 20/30mins07:36
*** anande has quit IRC07:37
Tenguanyone for a small w+1 on https://review.openstack.org/#/c/588309/ ? :) thank youuu07:37
*** florianf has joined #tripleo07:38
Tenguthank you jaosorior :)07:39
*** tosky has joined #tripleo07:42
*** ykarel is now known as ykarel|lunch07:43
jaosoriorTengu: np07:44
*** waleedm has joined #tripleo07:45
*** jpich has joined #tripleo07:45
*** shyambiradar has quit IRC07:47
*** holser_ has joined #tripleo07:48
*** jaosorior has quit IRC07:49
*** saneax has joined #tripleo07:52
*** apetrich has quit IRC07:56
*** anande_ has quit IRC08:01
*** jaosorior has joined #tripleo08:02
*** kopecmartin has joined #tripleo08:03
jaosoriorbandini: thanks08:04
bandinide nada ;)08:04
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401708:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534208:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]08:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)08:10
*** rcernin has quit IRC08:11
*** akrivoka has joined #tripleo08:12
*** anande_ has joined #tripleo08:13
*** waleedm has quit IRC08:14
*** waleedm has joined #tripleo08:18
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading  https://review.openstack.org/57310208:19
*** trinaths_ has joined #tripleo08:23
*** bogdando has joined #tripleo08:30
*** owalsh_ is now known as owalsh08:33
*** panda|rover-ish is now known as panda|rover08:33
*** ykarel|lunch is now known as ykarel08:35
*** gfidente has joined #tripleo08:35
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Exit wait_for_stack_does_not_exist if the status is delete failed  https://review.openstack.org/58781808:45
*** derekh has joined #tripleo08:46
*** shyambiradar has joined #tripleo08:47
shyambiradarHi08:52
shyambiradarjaosorior:  Tengu: What is most used registry location for containers by customers?08:53
shyambiradarhttps://access.redhat.com/documentation/en-us/red_hat_openstack_platform/13/html/director_installation_and_usage/configuring-a-container-image-source08:53
shyambiradarregistry.access.redhat.com or local registry on undercloud or redhat satelite08:53
jaosoriornot sure08:53
Tengushyambiradar: well, with my previous job, I set up a Satellite and mirrored all the docker-hub images on it in order to get a stable interface.08:53
shyambiradarok08:54
Tengubut I was using the upstream, not downstream, so it's probably not a standard thing.08:54
Aeliathere are obvious issues with disk space usage by docker images too...08:55
jankijaosorior, hey08:55
jaosoriorjanki: sup08:55
shyambiradarTengu: ok08:56
*** salmankhan has joined #tripleo08:56
jankijaosorior, about https://review.openstack.org/#/c/579182/, is it ok if I push the edit in another patch? This is backported d/s because it was needed for z208:56
shyambiradarTengu: As I have a custom container I need to user local registry on undercloud08:56
jaosoriorjanki: Sure, I would hope that the fix is also backported though.08:57
Tengushyambiradar: probably yes.08:57
jankijaosorior, yes. will backport the fix as well. Can you help merge plz08:57
jaosoriorjanki: done08:58
trinaths_Team, can someone review this, https://review.openstack.org/#/c/587491/08:58
*** Petersingh|lunch is now known as Petersingh08:58
jankijaosorior, thanks :)08:58
*** chem has quit IRC08:58
*** jaosorior has quit IRC09:02
*** anande__ has joined #tripleo09:06
*** anande_ has quit IRC09:07
*** anande__ has quit IRC09:08
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Cleanup variables and toci_jobtype leftovers  https://review.openstack.org/58446509:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534209:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)09:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]09:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)09:10
shyambiradarjaosorior: Tengu: Does virtualbmc supports on ubuntu16?09:18
shyambiradarI used pxe_ssh on newton, I see virtualbmc now as pxe_ssh deprecated for power management drivers09:19
shyambiradarhttps://access.redhat.com/documentation/en-us/red_hat_openstack_platform/13/html/director_installation_and_usage/appe-Power_Management_Drivers09:19
Tengushyambiradar: hm, I use vbmc on a centos build server.09:20
Tengushyambiradar: it works as expected as a libvirt proxy. No idea for ubuntu, but it's simple python.09:21
Tengushould be OK.09:21
shyambiradarI have ubuntu16 kvm host09:21
shyambiradarTengu: Not able to install pip package of vbmc09:24
shyambiradar Can't rollback libvirt-python, nothing uninstalled.09:24
shyambiradarCommand "/usr/bin/python -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-6RfTz9/libvirt-python/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-SHYk29-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-build-6RfTz9/libvirt-python/09:24
shyambiradar--------------------------------09:24
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Set mysql connect timeout in the undercloud  https://review.openstack.org/58628209:25
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: fix pep8 check and made it generic  https://review.openstack.org/58858809:26
shyambiradarTengu: jaosorior: Looks like virtualbmc is designed for centos/rhel family09:26
shyambiradarNo ubuntu/debian footprint found online09:27
*** paramite has joined #tripleo09:27
Tenguwell, that would be weird, python runs on all platform....09:28
*** yprokule has joined #tripleo09:29
Tengushyambiradar: what python version are you using?09:29
Tengushyambiradar: you apparently miss some dependencies, like "python-pkgconfig", and probably libvirt dev headers.09:31
shyambiradarok09:31
Tengushyambiradar: Successfully installed libvirt-python-4.6.0 pyghmi-1.2.2 virtualbmc-1.3.009:31
shyambiradarpython 2.7.1209:32
Tengushyambiradar: had to install python-pkgconfig and libvirt-dev in my docker container.09:32
shyambiradarok09:32
shyambiradaron which os u tried?09:32
Tengushyambiradar: I just launched a docker container.09:32
Tengushyambiradar: `docker run --rm -ti ubuntu bash'  and installed python-pip + said dependencies.09:33
*** zoli is now known as zoli|lunch09:34
shyambiradarTengu: Trying09:35
shyambiradarthanks09:35
jankiCan I get some reviews for https://review.openstack.org/#/c/579182/ mandre marios jistr09:35
shyambiradarTengu: pkgconfig installed well09:36
shyambiradarbut09:36
shyambiradarroot@ubuntu-kvm-rhosp:~# apt install libvirt-dev09:36
shyambiradarReading package lists... Done09:36
shyambiradarBuilding dependency tree09:36
shyambiradarReading state information... Done09:36
shyambiradarSome packages could not be installed. This may mean that you have09:36
shyambiradarrequested an impossible situation or if you are using the unstable09:36
shyambiradardistribution that some required packages have not yet been created09:36
shyambiradaror been moved out of Incoming.09:36
shyambiradarThe following information may help to resolve the situation:09:36
shyambiradarThe following packages have unmet dependencies:09:36
shyambiradar libvirt-bin : Breaks: qemu-kvm (< 1:2.5+dfsg-5ubuntu10.20~)09:36
shyambiradar               Breaks: qemu-kvm:i386 (< 1:2.5+dfsg-5ubuntu10.20~)09:36
Tengushyambiradar: you might want to push that on some nopaste only service..09:37
Tengushyambiradar: ah, well, yes, you need a libvirt host, not pure kvm.09:37
*** colonwq has quit IRC09:37
*** Petersingh is now known as Petersingh|afk09:38
shyambiradarTengu: ohh09:38
shyambiradarTengu: What that means?09:38
Tengushyambiradar: vbmc is a "proxy" for libvirt commands/api09:38
*** colonwq has joined #tripleo09:38
Tengushyambiradar: well, instead of running kvm by itself, you need to use virsh and libvirt.09:39
Tengumeaning, in your current state, you can't use vbmc.09:39
shyambiradarI can use virsh09:39
shyambiradaron my host09:39
shyambiradarroot@ubuntu-kvm-rhosp:~# virsh list09:39
shyambiradar Id    Name                           State09:39
shyambiradar----------------------------------------------------09:39
shyambiradar 133   nfs_server                     running09:39
shyambiradar 135   overcloud2-controller          running09:39
shyambiradar 136   overcloud2-compute             running09:39
shyambiradar 142   new_undercloud                 running09:39
shyambiradar 147   undercloud_1309:39
shyambiradarroot@ubuntu-kvm-rhosp:~# systemctl status libvirtd09:40
shyambiradar● libvirt-bin.service - Virtualization daemon09:40
shyambiradar   Loaded: loaded (/lib/systemd/system/libvirt-bin.service; enabled; vendor preset: enabled)09:40
shyambiradar   Active: active (running) since Tue 2018-06-26 06:19:25 EDT; 1 months 11 days ago09:40
shyambiradar     Docs: man:libvirtd(8)09:40
shyambiradar           http://libvirt.org09:40
shyambiradar Main PID: 509 (libvirtd)09:40
Tengushyambiradar: well, apparently ubuntu isn't OK with that. you might drop qemu-kvm and replace it with the right binaries from libvirt.09:40
Tengushyambiradar: and, please, stop pasting tons of things on IRC, use http://paste.openstack.org/  :)09:41
shyambiradarTengu: Ok09:42
shyambiradarTengu: I installed undercloud on one kvm server09:42
jistrjanki: what about jaosorior's comment there regarding no_log? do you want to do that?09:43
jankijistr, he said to not log that line because of the password but I do want to log that line just not the password. Is there a way for that?09:44
*** chem has joined #tripleo09:44
shyambiradarTengu: I need to launch a rhel kvm server09:44
shyambiradarfor overcloud vms only09:44
shyambiradarI think that will work09:45
Tengunope.. just ensure you have libvirt installed and correctly configured.09:45
shyambiradarok09:45
Tenguno reason to have a rhel server for that. you need a full libvirt server, with whatever OS you want, as long as libvirt is working and you have the right dependencies for vbmc...09:46
TenguI'm using centos physical server on my own, because there's a package for vbmc and I have some other facilities, but ubuntu/debian/gentoo/others would be fine as well.09:46
*** saneax has quit IRC09:48
*** saneax has joined #tripleo09:48
honzajtomasek: do you recall what happened to node auto discovery/registration in the ui?  the workflows made it in but we never got around to implementing the ui for it...09:49
*** shyambiradar has quit IRC09:50
jtomasekhonza: in GUI we needed to update nodes registration to redux form first and then it was probably interrupted by end of the cycle and not re-prioritized for next09:50
jtomasekI think it should be possible to finish it in next cycle09:51
honzajtomasek: yes, that's it!09:51
*** shyambiradar has joined #tripleo09:51
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58941409:54
openstackgerritEmilien Macchi proposed openstack/paunch master: fix tox python3 overrides  https://review.openstack.org/57396009:56
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58941409:57
jankijistr, ?10:00
*** jfrancoa has quit IRC10:00
jistrjanki: sorry too many conversations :) Juan suggested no_log, like here:10:01
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/e64c10b9c13188f37e6f122475fe02280eaa6686/extraconfig/services/ipsec.yaml#L9010:01
jistrjanki: oh just the password... i don't think there will be an easy way10:01
*** jfrancoa has joined #tripleo10:01
jankijistr, ohk. That is an imp task and I want it to be logged. let me comment on gerrit10:02
openstackgerritMerged openstack/tripleo-docs master: Use full cidr for DeployedServerPortMap  https://review.openstack.org/58812310:02
openstackgerritEmilien Macchi proposed openstack/paunch master: python3: remove usage of 'long'  https://review.openstack.org/58929710:06
openstackgerritEmilien Macchi proposed openstack/paunch master: Add openstack-python35-jobs  https://review.openstack.org/58929810:06
openstackgerritEmilien Macchi proposed openstack/paunch master: fix tox python3 overrides  https://review.openstack.org/57396010:07
openstackgerritEmilien Macchi proposed openstack/paunch master: WIP podman support  https://review.openstack.org/58931210:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401710:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534210:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)10:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]10:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)10:10
*** hgogada has quit IRC10:25
*** Petersingh|afk is now known as Petersingh10:25
*** hgogada has joined #tripleo10:25
*** links has quit IRC10:27
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58941410:31
*** shyambiradar has quit IRC10:34
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58941410:34
*** trinaths_ has quit IRC10:35
*** Petersingh is now known as Petersingh|brb10:41
*** florianf has quit IRC10:44
*** jaosorior has joined #tripleo10:46
*** shyambiradar has joined #tripleo10:49
*** zoli|lunch is now known as zoli10:53
*** shyambiradar has quit IRC10:54
*** pdeore has quit IRC11:01
*** holser_ has quit IRC11:01
*** ansmith has quit IRC11:06
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401711:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534211:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)11:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]11:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)11:10
*** artom has joined #tripleo11:11
*** florianf has joined #tripleo11:11
*** udesale has quit IRC11:15
openstackgerritEmilien Macchi proposed openstack/paunch master: WIP podman support  https://review.openstack.org/58931211:17
jaosoriorEmilienM: cool!11:18
*** gfidente has quit IRC11:18
*** panda|rover is now known as panda|rover|lunc11:18
*** gfidente has joined #tripleo11:20
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Move the shebang to /usr/bin/python  https://review.openstack.org/58943211:27
*** gfidente has quit IRC11:28
*** gfidente has joined #tripleo11:30
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Move the shebang to /usr/bin/python  https://review.openstack.org/58943211:34
*** bogdando has quit IRC11:35
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58943411:38
*** slagle has joined #tripleo11:39
*** Petersingh|brb is now known as Petersingh11:40
*** shyambiradar has joined #tripleo11:41
*** abishop has joined #tripleo11:44
bandinijaosorior: mind looking at this one? https://review.openstack.org/#/c/589432/ (one-liner)11:45
*** colonwq has quit IRC11:52
openstackgerritEmilien Macchi proposed openstack/paunch master: WIP podman support  https://review.openstack.org/58931211:53
*** apetrich has joined #tripleo11:53
*** zul has joined #tripleo11:54
*** assassin has quit IRC11:55
*** colonwq has joined #tripleo11:56
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Replace toci ENV_VARS by ansible env_vars  https://review.openstack.org/58736011:56
bandiniEmilienM: if you have a min, mind taking a look at this one liner? https://review.openstack.org/#/c/589432/11:57
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Replace toci ENV_VARS by ansible env_vars  https://review.openstack.org/58736011:58
*** jaosorior has quit IRC11:59
*** assassin has joined #tripleo12:01
*** hgogada has quit IRC12:01
chandankumarEmilienM: Please have a look at this patch https://review.openstack.org/#/c/589129/12:02
*** raildo has joined #tripleo12:02
*** raildo has quit IRC12:03
*** edmondsw has joined #tripleo12:04
*** waleedm has quit IRC12:05
*** ratailor has quit IRC12:05
*** raildo has joined #tripleo12:06
*** raildo has quit IRC12:07
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move nodes_file and nodes_args to common.yaml  https://review.openstack.org/58571412:07
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move nodes_file and nodes_args to common.yaml  https://review.openstack.org/58571412:08
Tengubandini: hmm, wouldn't "/usr/bin/env python" be better?12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178401712:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178482212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534212:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1784017 in tripleo "Build of instance was re-scheduled: invalid argument: could not find capabilities for domaintype=kvm" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco)12:10
openstackLaunchpad bug 1784822 in tripleo "legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master fails contact ipmi" [Critical,Triaged]12:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)12:10
bandiniTengu: no. see the bug12:10
bandiniwe exec the script via kolla. env actually is what broke us12:10
Tengubandini: ok!12:11
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Replace TAGS with ansible var  https://review.openstack.org/58450812:12
*** tahini has quit IRC12:13
*** waleedm has joined #tripleo12:13
*** amoralej is now known as amoralej|lunch12:15
*** raildo has joined #tripleo12:15
*** jpena is now known as jpena|lunch12:15
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071912:16
*** panda|rover|lunc is now known as panda|rover12:16
*** jaosorior has joined #tripleo12:19
*** jaosorior has quit IRC12:27
weshayrfolco|ruck, https://review.openstack.org/#/c/587572/4 this needs a readme12:28
weshayrfolco|ruck, other than that.. let's get this through please12:28
weshaypanda|rover, ^12:28
sri_dsneddon, ack, I think that would be good to have12:29
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Cleanup variables and toci_jobtype leftovers  https://review.openstack.org/58446512:29
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Replace TAGS with ansible var  https://review.openstack.org/58450812:29
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944812:29
rfolco|ruckweshay, ack12:29
panda|roverrfolco|ruck: amd supports nested virtualization now ?12:31
weshayrfolco|ruck, panda|rover need one of you in 411356779812:31
panda|roverah yah12:33
*** thrash|g0ne is now known as thrash12:33
*** rbrady has joined #tripleo12:36
*** holser_ has joined #tripleo12:37
*** bfournie has joined #tripleo12:40
*** jaosorior has joined #tripleo12:42
*** sdoran_ has joined #tripleo12:49
*** sdoran has quit IRC12:50
*** jschlueter has quit IRC12:50
*** pliu has quit IRC12:50
*** weshay has quit IRC12:50
*** sdoran_ is now known as sdoran12:50
*** marios has quit IRC12:51
*** xteknoid has quit IRC12:53
*** bogdando has joined #tripleo12:53
Aeliasince now should be a better time, in the US, I will try again to ask. concerning the scale issue I asked about yesterday, I have found more about it by looking into the heat stack state. Anybody can help me track what happens with this resource_type OS:Mistal:ExternalResource here -> https://gist.github.com/dabelenda/5ab01a1ecab808c0e9734741019443c0#file-heat-stack-state ?12:53
*** Petersingh has quit IRC12:54
*** shyambiradar has quit IRC12:54
Aeliaor help me put everything in order so that the stack is no longer in error and I can actually run the scale up of the overcloud ?12:55
*** gbarros has joined #tripleo12:56
*** ccamacho has quit IRC12:58
openstackgerritChristian Schwede proposed openstack/tripleo-docs master: Add required Keepalived service to minimal Keystone example  https://review.openstack.org/58945912:58
*** jschlueter has joined #tripleo12:59
openstackgerritXiaojueGuan proposed openstack/tripleo-puppet-elements master: Add the project source code repository in README  https://review.openstack.org/58946012:59
therved0ugal: Seeing "Unknown column 'action_executions_v2.last_heartbeat'" in CI, is that a known issue?13:01
*** shyambiradar has joined #tripleo13:01
*** tzumainn has joined #tripleo13:02
*** ansmith has joined #tripleo13:03
*** janki has quit IRC13:03
*** janki has joined #tripleo13:04
*** skramaja has quit IRC13:08
toureRusure1#5413:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)13:10
*** shyambiradar has quit IRC13:10
*** trown|outtypewww is now known as trown13:12
*** ade_lee has quit IRC13:13
*** dciabrin has quit IRC13:16
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944813:18
*** weshay has joined #tripleo13:19
*** ykarel is now known as ykarel|away13:21
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates stable/queens: Disable pid file usage in the swift_rsync container  https://review.openstack.org/57712613:21
*** ccamacho has joined #tripleo13:28
*** jpena|lunch is now known as jpena13:30
*** ykarel|away has quit IRC13:31
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58943413:31
*** cdearborn has joined #tripleo13:31
*** amoralej|lunch is now known as amoralej13:32
*** lblanchard has joined #tripleo13:32
*** paramite has quit IRC13:32
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10""  https://review.openstack.org/58946913:35
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249513:36
ccamachohey EmilienM trown around?13:36
ccamachoquick question, im trying to remove some unused and duplicated code from oooq-extras (upgrade role), the thing is this repo is branchless and https://review.openstack.org/#/c/588451/ pass CI for master13:36
*** holser_ has quit IRC13:37
ccamachowhat do you recommend for checking if this break CI in other branches?13:37
*** holser__ has joined #tripleo13:37
jaosoriorccamacho: you could probably use test patches, and a depends-on to them13:37
d0ugaltherve: Sounds like you are missing a migration?13:37
d0ugaltherve: https://github.com/openstack/mistral/blob/master/mistral/db/sqlalchemy/migration/alembic_migrations/versions/027_add_last_heartbeat_to_action_execution.py13:38
*** moshele has quit IRC13:39
trownccamacho: I dont think upgrade role is used from oooq-extras13:39
trownccamacho: ignore that...13:40
ccamachotrown indeed, we use the tripleo-upgrade repo13:40
therved0ugal: It's in CI13:40
ccamachojaosorior Ill try that depends-on against older branches13:40
ccamachothanks!13:41
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: use retries when pulling image checksum  https://review.openstack.org/58788013:41
trownccamacho: ya... should have opened your patch before answering :P13:41
*** jcoufal has joined #tripleo13:42
*** mjturek has joined #tripleo13:43
*** paramite has joined #tripleo13:44
*** hgogada has joined #tripleo13:47
*** quiquell is now known as quiquell|off13:47
therved0ugal: That's the failure I understand from http://logs.openstack.org/82/586282/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/d036f89/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz13:50
therveBut it's so so bad to parse13:50
*** psachin has quit IRC13:51
*** quiquell|off has quit IRC13:51
therved0ugal: And according to that file the migration ran13:56
openstackgerritJiri Stransky proposed openstack/tripleo-common master: Remove container registry param from package_update_plan workflow  https://review.openstack.org/57118613:57
openstackgerritJiri Stransky proposed openstack/python-tripleoclient master: Remove --container-registry-file parameter from * upgrade clis  https://review.openstack.org/57089313:57
openstackgerritJiri Stransky proposed openstack/tripleo-common master: Remove container_registry parameter from update workflows  https://review.openstack.org/58948713:57
therveIt happened on other runs so it may be new13:58
Tengutherve: ah, also hitting that I think.14:00
jaosorior#startmeeting TripleO14:00
openstackMeeting started Tue Aug  7 14:00:48 2018 UTC and is due to finish in 60 minutes.  The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
openstackThe meeting name has been set to 'tripleo'14:00
jaosorior#topic agenda14:01
jaosorior* Review past action items14:01
jaosorior* One off agenda items14:01
jaosorior* Squad status14:01
jaosorior* Bugs & Blueprints14:01
jaosorior* Projects releases or stable backports14:01
jaosorior* Specs14:01
jaosorior* open discussion14:01
jaosoriorAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:01
jaosoriorSo, mwhahaha will be a little late today. So, here I am :D14:01
jaosoriorwho's around?14:01
rascao/14:01
Tengu«o/14:01
jistrhi o/14:01
ksamboro/14:01
panda|rovero/14:01
chemo/14:01
rfolco|rucko/14:01
ccamachohi!14:02
florianfo/14:02
jaosoriorHi everyone!14:02
d0ugalo/14:02
jaosorior#topic review past action items14:02
*** ade_lee has joined #tripleo14:03
jaosoriorNo past action items it seems14:03
weshay0/14:03
jaosorior#topic one off agenda items14:03
jaosorior#link https://etherpad.openstack.org/p/tripleo-meeting-items14:03
redroboto/14:03
jaosoriorSeems there are some entries in the one-off items. The first one being from mwhahaha14:04
jaosorior"PTG is coming up, so please make sure to add some topics for the PTG into the etherpad."14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-ptg-stein14:05
jaosoriorSo, folks, if you have any topics you wanna bring up in Denver (I sure do) please use that etherpad.14:05
jaosoriornext topic is from gfidente. Are you around?14:06
openstackgerritJose Luis Franco proposed openstack/tripleo-common stable/queens: Set known hosts when --limit is set.  https://review.openstack.org/58915014:06
gfidentejaosorior yeah I am not sure if we should re-submit that spec14:06
gfidentejaosorior cause it was approved in rocky but more the work will happen in stein14:06
jaosoriorgfidente: did you apply for an FFE?14:06
gfidentejaosorior the spec was approved for rocky already14:06
jaosoriorWhat's the state of the feature though?14:07
*** agurenko has quit IRC14:07
gfidentejaosorior I think we're halfway there14:07
mwhahahao/14:08
jaosoriorI would say it would be better to resubmit it14:08
*** myoung has joined #tripleo14:08
jristo/14:08
jaosoriormwhahaha: \o14:08
myoungo/14:08
gfidentejaosorior so to make a new spec in tripleo-specs point to the same launchpad blueprint?14:08
jaosorioryeah14:08
gfidenteok and regarding its contents, would just mention what development items are still missing?14:09
jfrancoao/ i'm late /o\14:09
jaosoriorgfidente: I'm honestly not sure. mwhahaha any opinion there?14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534214:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)14:10
*** ooolpbot has quit IRC14:10
mwhahahagfidente: no you don't need to resubmit14:10
mwhahahawe approved it in rocky, but we'll just keep the status update in blueprint so it won't be properly implemented until stein14:11
jaosoriormwhahaha: no strong opinion here, but wouldn't it be easier to resubmit it? that way the blueprint shows up in the release it lands?14:12
jtomaseko/14:12
mwhahahajaosorior: no because we did start some of the work in rocky i believe14:12
mwhahahajaosorior: i think there's a similar pattern in other openstack projects where the spec might be merge dbut the feature doesn't land until later14:12
mwhahahabecause it's a multi cycle effort14:12
jaosoriorI see14:12
mwhahahai believe we raised this topic in the review14:13
mwhahahaso you could update the spec with stein as the target in the spec14:13
Tengua bit like the validation framework.14:13
Tenguwon't be here for Stein either.14:13
holser__o/14:13
Tengualthough the spec should be approved for that release.14:14
jaosorioralright, that makes sense14:14
gfidentejaosorior mwhahaha so update blueprint and move the file in tripleo-specs from rocky to stein?14:14
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Insert break lines when showing FFWD upgrade operator warning.  https://review.openstack.org/58779314:14
*** thrash is now known as thrash|biab14:14
*** jrist has quit IRC14:15
*** ubijtsa has joined #tripleo14:15
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Insert break lines when showing FFWD upgrade operator warning.  https://review.openstack.org/58779314:16
mwhahahayea14:16
mwhahahaor we can update a reference that it won't land in stein14:16
mwhahahai would just leave it honestly14:16
fultonjo/ (late)14:17
mwhahahagfidente: feel free to propose a move if you want, i don't have strong opinion14:18
gfidentemwhahaha ack14:19
*** assassin has quit IRC14:19
jaosorioralright! well that's sorted out14:19
gfidentemwhahaha jaosorior thanks :D14:19
gfidentemwhahaha jaosorior I'll update the blueprint in LP only for now14:19
jaosoriorack14:19
mwhahahasounds good14:19
*** boazel has joined #tripleo14:20
jaosorior#topic Squad status14:20
jaosoriorci14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:20
jaosoriorupgrade14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:20
jaosoriorcontainers14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-containers-squad-status14:20
jaosoriorconfig-download14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-config-download-squad-status14:20
jaosoriorintegration14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:20
jaosoriorui/cli14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:20
jaosoriorvalidations14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:20
jaosoriornetworking14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:20
weshayoh my14:20
jaosoriorworkflows14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:20
jaosoriorsecurity14:20
jaosorior#link https://etherpad.openstack.org/p/tripleo-security-squad14:20
jaosoriorNo updates from the security squad14:20
weshayFYI.. master promoted :)14:20
jaosoriorAny Squad with something to report?14:21
jaosoriornice!14:21
myoung\o/14:21
Tenguweshay: wow14:21
*** vinaykns has joined #tripleo14:21
weshaygotta love Tengu :)14:21
weshaythanks :)14:21
jaosorior#topic bugs & blueprints14:24
jaosorior#link https://launchpad.net/tripleo/+milestone/rocky-rc114:24
vinayknsHello channel...I have a question regarding my overcloud deployment...my endpoint ssl doesn't match with vip address14:24
jaosoriorFor Rocky we currently have 42 (+0) blueprints and about 294 (+8) open Launchpad bugs.  294 rocky-rc1, 430 stein-1.  108 (+3) open Storyboard bugs.14:24
jaosorior#link https://storyboard.openstack.org/#!/project_group/7614:24
jaosoriorvinaykns: I can assist you with that after the meeting :)14:24
jaosoriorPlease note we are now in the RC phase so we should be working on fixing bugs and not landing additional features unless they have an FFE.14:24
*** dprince has joined #tripleo14:25
mwhahaharc time14:25
mwhahahaat least we had a promotion14:25
vinayknsjaosorior, sure..thx.!14:25
jaosorior#topic projects releases or stable backports14:26
mwhahahaEmilienM proposed stable releases this week14:26
*** rpioso|afk is now known as rpioso14:26
mwhahahaRC will be cut around the end of the month14:26
mwhahahathat's it on that14:26
jaosoriorso, we branch rocky on the end of the month?14:27
mwhahahaso we're trailing14:27
mwhahahaso official rc1 is at teh end of the month for everyone else14:27
mwhahahaif we're in a good spot we can probably shortly there after14:27
Tengu\o/14:27
*** jrist has joined #tripleo14:27
mwhahahait's likely around the PTG that we might cut an RC14:27
mwhahahadepends on the state of things14:27
mwhahahabut yes14:27
*** gkadam_ has joined #tripleo14:27
jaosoriorI see14:27
mwhahahathere is usually a dance around cutting branches for things like tripleo-common/tripleoclient14:28
mwhahahabecause it requires extra efforts for backports14:28
mwhahahaso we try not to drag it out too much14:28
jaosoriorMakes sense14:29
openstackgerritXiaojueGuan proposed openstack/puppet-pacemaker master: Add the project source code repository in README  https://review.openstack.org/58950114:29
jaosoriorSo, I had missed ths topic from myoung:14:29
jaosorior#topic CI Community Meeting starts immediately upon this meeting closing @ https://bluejeans.com/7050859455. This is our team's weekly "open office hours." All are welcome!  Ask/discuss anything, we don't bite. Agenda (add items freely) --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting.14:29
*** gkadam has quit IRC14:29
myoungjaosorior: thx, that is all :)14:30
jaosoriorthanks for the reminder :)14:30
jaosorior#topic specs14:30
jaosorior#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:30
mwhahahareview specs!14:30
touresl0w ping14:30
jaosorior#topic open discussion14:31
*** yolanda has quit IRC14:31
jaosoriorAnything folks want to bring up?14:31
mwhahahaweshay, panda|rover: are we going to fix the queens images?14:31
weshayFYI.. emails out to the list re: ovb 3rd party14:32
mwhahahaalso is there a bug for it?14:32
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: SSL support for haproxy -> novnc proxy connection  https://review.openstack.org/58941414:32
weshaymwhahaha, he had to refix that this morning14:32
weshayit's there now14:32
mwhahahaholser__: -^14:32
panda|roveryep14:32
weshaynot sure why it needed a refix14:32
mwhahahak14:32
weshaywell.. ci and infra are cursed14:32
Tenguit's a junkie, it just loves fixes.14:32
* Tengu runs away.14:32
* myoung groans14:32
Tengu:314:33
weshay+1 need more jokes14:33
openstackgerritXiaojueGuan proposed openstack/puppet-tripleo master: Add the project source code repository in README  https://review.openstack.org/58950414:33
*** dprince has quit IRC14:34
*** hgogada has quit IRC14:34
weshaytripleo-ci community mtg14:35
*** dprince has joined #tripleo14:35
jaosoriorSo... anything else folks want to bring up?14:36
holser__thanks mwhahaha14:36
*** dprince has quit IRC14:36
jaosoriorAlright, thanks everyone!14:36
jaosorior#endmeeting14:36
openstackMeeting ended Tue Aug  7 14:36:41 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:36
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-08-07-14.00.html14:36
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-08-07-14.00.txt14:36
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-08-07-14.00.log.html14:36
mwhahahathanks jaosorior14:36
*** dprince has joined #tripleo14:37
Tenguanyone from the "upgrade" team here? I have a CI issue linked to upgrade tasks, and would like to understand if the issue is due to my patch or not.14:37
Tenguthe log: http://logs.openstack.org/85/586285/5/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/e4f1640/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-08-07_09_45_16 - specifically it fails running this script: http://logs.openstack.org/85/586285/5/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/e4f1640/logs/undercloud/var/lib/heat-config/heat-config-script/14:37
*** dprince has quit IRC14:37
jristo/14:37
Tenguand it comes from this change: https://review.openstack.org/#/c/586285/14:37
jaosoriorvinaykns: so, what's up?14:38
*** ykarel has joined #tripleo14:38
*** yolanda has joined #tripleo14:38
*** dprince has joined #tripleo14:39
therveTengu: No it doesn't come from your change14:39
Tengutherve: "oufff".14:39
vinayknsjaosorior, I trying to deploy overcloud...but after completion I couldn't run any openstack commands...my api endpoint ssl doesn't match with vip address.14:40
*** waleedm has quit IRC14:40
Tengutherve: is there some open bug somewhere, or.. ?14:40
therveNo I think it's time to open one :)14:40
Tenguok :).14:40
jaosoriorvinaykns: what's the output?14:40
therveTengu: Want me to?14:41
Tengutherve: if you have all the needed stuff, would be great :).14:41
therveAlright doing it now14:41
vinayknsjaosorior: http://pastebin.test.redhat.com/62752414:41
jaosoriorvinaykns: did you set up a fixed external IP?14:42
jaosoriorvinaykns: by default, the deployment will choose a random IP address; if you want to use TLS, you should probably set up a fixed one, else you'll get these issues where the VIP doesn't match.14:42
jaosoriorvinaykns: here's some info on that http://tripleo.org/install/advanced_deployment/ssl.html#certificate-and-public-vip-configuration14:42
vinayknsjaosorior: Oh..kk...I haven't set up any fixed external IP.14:44
*** thrash|biab is now known as thrash14:44
therveTengu: https://bugs.launchpad.net/mistral/+bug/178583314:44
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Undecided,New]14:44
therved0ugal: ^^^14:44
vinayknsjaosorior: currently I don't need any tls support...if i want to remove that...how can i do that.14:44
jaosoriorvinaykns: it's not enabled by default. all you need to do not pass the TLS-related environment files.14:45
vinayknsjaosorior: so I guess removing the enable-tls.yaml file should solve the problem..?14:47
Tengutherve: thank you!14:47
jaosoriorvinaykns: and removing the tls-endpoints-* environment file.14:48
*** rasca is now known as rascasoft14:49
trownmandre: whoops didnt see there was already revert of revert... ya I  needed it to retest the other patch14:49
trownmandre: pretty sure the "new" issue I hit is just that we have openshift-ansible3.9 trying to install openshift3.1014:49
vinayknsjaosorior: you mean removing tls-endpoints-public-ip.yaml...from the overcloud deploy command..?14:49
jaosoriorvinaykns: yes14:49
vinayknsjaosorior: cool...thank you..!14:50
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Remove ceph-osd and update other Ceph packages if deployment succeeded  https://review.openstack.org/58861914:52
jaosoriorno biggie14:52
trownmandre: do you have any ideas what would be a good minimal validation that the openshift cluster we deploy actually functions? wrt shadower's comments on the THT patch https://review.openstack.org/#/c/582495/1014:52
mwhahahaweshay: so i think some efforts should go into making OVB more resilient to network failures14:53
gfidenteguys, I am trying to redeploy my undercloud with oooq and it's failing and overcloud_prepare_images with14:53
trownmandre: was thinking we should make a quickstart-extras role for that14:53
gfidente2018-08-07 14:22:15 | sudo: mistral-db-manage: command not found14:53
gfidenteanyone seen this before and has a quick fix?14:53
mwhahahaweshay: we can't solve for the  dupe ip problem tho14:53
weshaymwhahaha, k.. ya.. that is the ovb code itself, happy to look at that after we solve for the logs14:54
mwhahahaweshay: most of it is just bash in the cloud-init stuff, so we need to clean it up. it's still using neutron commands as well14:54
weshaypanda|rover, ^14:55
mwhahahaweshay: it might be beneficial to just port to python too, but that may be a bigger undertaking14:55
weshaylet's take note of that14:55
weshaypanda|rover, also.. you are right.. those logs are protected14:55
shadowertrown: a minimal non-destructive one would be: log in, run `oc status --suggest` and `oc get nodes --all-namespaces`.14:55
mwhahahaalso having a way to indicate that bmc is not ok is helpful14:55
weshaymwhahaha, agree14:55
weshaypanda|rover, let's get this into a card14:55
mwhahahawhen bnemec-pto comes back from pto we need to figure out where to host ovb as well, maybe get it under openstack/14:56
mwhahahathat's been a long outstanding issue14:56
shadowertrown: but a good end to end test would be something like: "--template=cakephp-mysql-example". That will trigger an image build and create a route. So you run that and verify that the app is deployed and can be accessed by its route.14:56
trownshadower: and as long as those commands have 0 exit code, we can consider it a success?14:56
trownah ok14:56
weshaypanda|rover, mwhahaha starting a card here https://trello.com/c/q6vkEfGu/896-ovb-improvements14:57
shadowertrown: um, I'm not sure what their exit codes are like. But they should not report any errors14:57
*** ykarel has quit IRC14:57
shadowertrown: e.g. "oc get pods --all-namespaces" lists a bunch of pods. They should all be in their READY state14:57
fultonjfyi: regarding rocky, there's a config-download/ceph-ansible bug 1769769 that i'm working on. i didn't file an FFE as it's a bug.14:58
openstackbug 1769769 in tripleo "ceph monitor scaling requires pesistence of ceph-ansible fetch directory" [High,Fix released] https://launchpad.net/bugs/1769769 - Assigned to John Fulton (jfulton-org)14:58
fultonjfyi: gfidente: ^ mwhahaha ^14:58
trownshadower: k, I have a deploy started with that THT patch, so I can at least manually confirm the update to 3.10 works or doesnt, then I will work on making it automated14:58
shadowerright14:58
trownshadower: thanks!14:58
shadowertrown: fwiw (a bunch of people talked about that in the past) we would love to have that kind of validation script in openshift-ansible14:58
trownshadower: ah like an openshift-ansible tempest14:59
shadowertrown: yea though ideally less complex. You can go a long way with just those three checks14:59
chandankumartrown: I am thinking of running e2e tests directly on subnode-215:00
chandankumarinstead of tempest for openshift15:00
thervemwhahaha: Should we downgrade mistral in the gate? I think the version recently bumped is breaking CI15:00
*** jaosorior has quit IRC15:01
trownshadower: cool, I can definitely look at adding something to openshift-ansible too15:01
*** panda|rover is now known as panda|backin2h15:01
trownchandankumar: ya that is what I was thinking, we have the "overcloud" node in the inventory, so we can just run a couple commands on it directly15:01
trownchandankumar: I was going to make a new role for it though15:01
*** ksambor has quit IRC15:02
chandankumartrown: or what about clubbing it with the valida-tempest role ?15:02
chandankumarwe are moving it from TQE to seperate repo15:02
mwhahahatherve: that's odd, do we have logs?15:03
thervemwhahaha: https://bugs.launchpad.net/tripleo/+bug/178583315:03
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Undecided,New]15:03
shadowertrown: btw have you made any progress on the openshift-ansible ci front?15:03
trownchandankumar: hmm I think putting it in its own role makes sense... at some point I think we just integrate it into the deploy... ie it is part of openshift-ansible and we just get it called with other openshift-ansible stuff in the deploy15:04
chandankumartrown: yes sounds right15:04
mwhahahaweshay: do we not have undercloud upgrades in the promotion pipeline?15:05
trownshadower: no :( ... I was on PTO last week, but I have yet to get a tenant based deploy to work any way/where15:05
mwhahahatherve: i'm not sure we can roll back a version, we could disable voting ont hat job for now15:05
therveAh yeah15:05
weshaymwhahaha, should fs3715:05
shadowertrown: ah right15:05
shadowertrown: anything I can help with?15:05
trownchandankumar: I just want to get something minimal, because the containerized 3.10 patch (WIP above the 3.10 THT patch) has green CI but never deployed openshift... so we need something relatively quickly if we want to keep that job green15:06
trownshadower: how do you set up your dev environment for tenant based openshift deploys?15:07
therveweshay: Do you have the logs for the last promotion?15:07
sri_beagles, quick question, I've enabled the dvr , but fip,qrouter namespace not created in compute nodes in stable queens release any known bugs, Because I've use dvr before in pike release that time I didn't see this issue15:08
beaglessri_: can you verify that the l3 agent was properly deployed to the compute node - ie. the l3 agent's container is running there?15:09
trownshadower: I have tried setting up a cloud on my dev machine using tripleo in various ways (dont really have enough space left over for the openshfit vms) and I have tried deploying directly to my rdo cloud tenant (ran into a ton of issues seemingly related to the older version of openstack deployed there, ie the heat template version is wrong etc)15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534215:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)15:10
chandankumartrown: I am see two things as a option currently https://github.com/openshift/origin/blob/master/hack/test-integration.sh and https://github.com/openshift/origin/blob/master/hack/test-end-to-end.sh15:11
*** pcaruana has quit IRC15:11
chandankumartrown: I am not sure these are packaged with the rpm15:11
weshayit's fs50 :(15:11
weshaytherve, mwhahaha referring to tripleo-ci-centos-7-containerized-undercloud-upgrades15:12
weshayya?15:12
therveweshay: Yep15:12
weshayhttps://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/master.ini#L15-L2715:12
weshaylast promotion did in fact blow it up15:12
weshay:(15:12
weshaypanda|backin2h, rfolco|ruck ^15:13
trownchandankumar: I am thinking way simpler for adding to the current tripleo job (fs33), like just the couple of commands above ^ `oc status --suggest` and `oc get nodes --all-namespaces` with some validation of the output if the exit codes alone arent sufficient15:14
trownchandankumar: for the first go really just looking for the most basic thing I can do to make the job red if it doesnt actually deploy openshift at all15:15
trownsince that is kind of a big deal for a job that is supposed to deploy openshift :P15:16
openstackgerritMerged openstack/tripleo-docs master: Document new push_destination behaviour  https://review.openstack.org/58843915:16
openstackgerritMerged openstack/tripleo-docs master: Document prepare modify image  https://review.openstack.org/58900315:16
weshaymwhahaha, sorry man.. fixing that now15:16
openstackgerritMerged openstack/tripleo-docs master: Add notes on the undercloud's autogenerated TLS setup  https://review.openstack.org/55321915:16
weshaygfidente, here15:17
gfidenteweshay hey thanks15:17
sri_beagles, is neutron_ovs_agent is l3 agent right ? http://paste.openstack.org/show/727540/15:17
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates stable/queens: Fix Neutron SFC environment file  https://review.openstack.org/58951515:18
rascasoftmyoung, https://code.engineering.redhat.com/gerrit/14631215:18
*** jfrancoa has quit IRC15:19
beaglessri_: the docker ps output doesn't look right15:19
beaglessri_: there should be an l3 agent running there.. is it running on baremetal by mistake?15:20
openstackgerritMerged openstack/tripleo-docs master: Trivial: update url to new url  https://review.openstack.org/56812315:20
sri_beagles, let me check15:20
gfidenteweshay fwiw, this is the prep_images log http://ix.io/1jym15:20
openstackgerritMerged openstack/tripleo-docs master: Notes warning for mixing multiple command line clients.  https://review.openstack.org/58919215:20
beaglessri_: you may be missing this patch https://review.openstack.org/#/c/573199/6/environments/neutron-ovs-dvr.yaml15:20
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071915:21
gfidenteweshay looks like it created the ironic nodes correctly, then failed to run mistral-db-manage as if the command wasn't installed15:21
weshayya.. that is odd.. seeing that in ci?15:21
*** jfrancoa has joined #tripleo15:21
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Fix confusing UC install failure message  https://review.openstack.org/58951615:22
sri_beagles, maybe,  I've deployed this stack long time ago15:22
beaglessri_: ah okay so that's probably it15:23
gfidenteweshay no in a local run15:24
gfidenteweshay I was using featureset04915:24
gfidenteis there another featureset I can compare with to see if I am missing any newly required var?15:25
sri_beagles, your right I didn't see that pach in my templates   thanks :)15:25
myoungrascasoft: ack, having a look, testing, and will merge15:25
beaglessri_: np15:25
*** saneax has quit IRC15:27
*** aufi has quit IRC15:28
weshaytherve, workbook not found?15:28
therveweshay: Yes15:28
weshayis that the error you are tracking on the upgrade job15:28
weshayk15:28
openstackgerritAlex Schultz proposed openstack/tripleo-common master: add lower-constraints job  https://review.openstack.org/55626515:28
openstackgerritJiri Stransky proposed openstack/tripleo-common master: Remove container_registry param from package update action  https://review.openstack.org/57118615:30
openstackgerritJiri Stransky proposed openstack/tripleo-common master: Remove container_registry parameter from update workflows  https://review.openstack.org/58948715:30
weshaymwhahaha, therve https://bugs.launchpad.net/tripleo/+bug/178584315:30
openstackLaunchpad bug 1785843 in tripleo "workbook not found, tripleo-ci-centos-7-containerized-undercloud-upgrades is failing" [Critical,Triaged]15:30
therveweshay: https://bugs.launchpad.net/tripleo/+bug/1785833 :)15:30
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Undecided,New]15:30
weshayworking on the job now.. what happened there, I thought we had the containerized undercloud upgrade covered15:31
weshaytherve, thanks15:31
mwhahahaweshay: https://bugs.launchpad.net/tripleo/+bug/1785833 already existed15:31
rascasoftmyoung++15:31
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable mistral tempest tests in fs027  https://review.openstack.org/56564215:32
*** ramishra has quit IRC15:34
openstackgerritMerged openstack/tripleo-docs master: Improve Tempest documentation  https://review.openstack.org/58914315:34
*** trinaths has joined #tripleo15:35
trinathsHi, please help review, https://review.openstack.org/#/c/587491/15:35
mwhahahaweshay: so since we hosed the upgrade job, i guess we need to switch it to non-voting15:35
*** mwhahaha changes topic to "Welcome to Rocky | CI Status: RED - undercloud upgrade job broken, OVB less questionable | https://docs.openstack.org/tripleo-docs/latest/"15:36
weshaymwhahaha, ur call.. +1 either way15:36
mwhahahawe'll need the fix to land in mistral and a promotion15:36
mwhahahaso i think thats our best sort term bet15:36
bandinid0ugal: do you know where we actually make use of the output generated by mistral within tripleo? (I.e. could we do something like https://review.openstack.org/#/c/586036/ for other things too?)15:37
weshaymwhahaha, doesn't mistral get updated w/o a promotion?15:37
* weshay looks15:37
mwhahahaweshay: not in containers15:37
mwhahaha?15:37
* mwhahaha doesn't remember15:37
mwhahahai recall it used to be in the ignorepkgs but i'm not sure it still is15:37
weshayya.. ur right15:37
*** dxiri has joined #tripleo15:38
weshayapetrich, toure https://review.openstack.org/#/c/589510/15:38
weshayrfolco|ruck, I need ur assistance15:39
rfolco|ruckweshay, how?15:39
weshayrfolco|ruck, jump on my blue for 5min15:40
rfolco|ruckweshay, sorry cleared cache, can you paste bj #15:42
mwhahahaweshay: therve: is the non-containerized upgrade OK or is it both?15:43
*** v1k0d3n has joined #tripleo15:44
*** jfrancoa has quit IRC15:44
toureweshay looking15:45
thervemwhahaha: I think both15:45
therveI don't think there is anything specific to containers15:45
mwhahahabut we don't run the instack undercloud upgrade in the gate right?15:45
* mwhahaha is just going to switch the containerized one to non-voting for now15:45
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates stable/queens: Don't run host_prep_tasks from {{role}}HostPrepDeployment  https://review.openstack.org/58952215:46
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Switch containerized undercloud upgrade job to nv  https://review.openstack.org/58952315:47
mwhahahaweshay: -^15:47
thervemwhahaha: Maybe in instack gate :)15:47
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Revert "Switch containerized undercloud upgrade job to nv"  https://review.openstack.org/58952415:48
mwhahahatherve: eh i don't care about the instack gate as much as everything else :D15:48
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Use local docker registry host for tempest container  https://review.openstack.org/58436815:48
openstackgerritJames Slagle proposed openstack/tripleo-common stable/queens: Fix overwriting downloaded config files  https://review.openstack.org/58952715:55
trinathsHi, please help review, https://review.openstack.org/#/c/587491/15:59
weshayrfolco|ruck, please review that and then we'll ping paul https://review.rdoproject.org/r/1524616:00
weshaytherve, mwhahaha fyi ^16:00
*** rbrady is now known as rbrady-afk16:01
mwhahahagah i'm so sick of these stupid conspiracy theory spammers on freenode :/16:01
*** jcoufal has quit IRC16:02
weshayit's not a conspiracy, it's for realz16:08
weshayrfolco|ruck, does that look right to you?16:09
rfolco|ruckweshay, don't you have to include it to a group of jobs ?16:09
* weshay looks16:09
rfolco|ruckweshay, you defined fs050 job but did not specify where you run it I think16:09
weshayrfolco|ruck, in the config repo?16:09
weshaymust be16:10
weshaylegacy mode SUCKS16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583316:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)16:10
rfolco|ruckzuul.d/zuul-legacy-project-templates.yaml16:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]16:10
rfolco|ruckweshay, I meant zuul.d/zuul-legacy-project-templates.yaml16:10
*** sri_ has quit IRC16:10
weshayrfolco|ruck, k.. thanks16:11
weshayupdating16:11
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Use fqdn for live_migration_inbound_addr  https://review.openstack.org/58953516:13
mwhahahaweshay: off the top of your head, do you know what the difference between trunk.rdoproject.org/centos7 and trunk.rdoproject.org/centos7-master is? is the former the deps and the latter is the openstack specific bits?16:15
* mwhahaha is trying to understand why we have both in the build-test-packages role in oooq-extras16:16
*** amoralej is now known as amoralej|off16:21
*** trinaths has quit IRC16:21
*** jpena is now known as jpena|off16:21
trownmwhahaha: I am pretty sure centos7-master is just a symlink of centos7 ... or maybe vice versa16:23
mwhahahatrown: i thought that, we seem to have conflicting confgs in build-test-packages16:23
* mwhahaha shrugs16:24
*** zoli is now known as zoli|gone16:24
*** zoli|gone is now known as zoli16:24
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Update build-test-package for non-centos7  https://review.openstack.org/58954016:24
trownmwhahaha: hmm... https://trunk.rdoproject.org/centos7/status_report.html and https://trunk.rdoproject.org/centos7-master/status_report.html do look exactly the same16:25
mwhahahayea so it seems that centos7 trails master but if you needed to build something against an older branch you'd likely want to use the branch specific url16:26
weshaymwhahaha, they should not be different afaik16:26
mwhahahai think the defaults for teh role probably need to be updated to be matching16:27
*** orange_julius has joined #tripleo16:27
mwhahahathe project.ini uses /centos7/ while the dlrn_base_url uses /centos7-<release>/16:27
*** jpich has quit IRC16:27
mwhahahaso if the dlrn_base_url can beused for both (and it probably should) that might be a better solution16:27
orange_juliusHello. Has anyone ever experienced issues with Keystone+ActiveDirectory and keystone sending out mutliple auth requests for a user? I'd imagine that keystone should only send out one authentication attempt (from the node which has the VIP)16:27
trownmwhahaha: ya I see in your patch what you are looking at... I wonder if we arent actually using that setting in project.ini at all16:27
mwhahahawe do define the baseurl bits elsewhere in the tasks16:28
mwhahahaso it's possible it's just ignored16:28
trownmwhahaha: since we disable the install test of dlrn16:28
*** boazel has left #tripleo16:28
trownmwhahaha: I think the dlrn baseurl in projects.ini is for specifying the repo to try to use for deps when doing the install test ... and we disable the install test since we are actually going to install the package later anyways16:30
mwhahahatrown: so do you think i should just swap out the url with the dlrn_base_url16:30
trownmwhahaha: ya I think we could put "foo" there and it will still work ... so making it consitent with other stuff so future us doesnt have to remember is probably best16:31
mwhahahak let me give that a shot16:31
weshayrfolco|ruck, I'm just going to nuke the non-periodic part16:32
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Update build-test-package for non-centos7  https://review.openstack.org/58954016:32
*** trown is now known as trown|lunch16:33
weshaymwhahaha, how far along are you w/ fedora support?16:37
mwhahahaweshay: still trying to get heat built16:37
mwhahahawhich is always fun16:37
*** gkadam_ has quit IRC16:38
*** gbarros has quit IRC16:39
*** bogdando has quit IRC16:41
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/pike: DNM, wes testing  https://review.openstack.org/58767616:41
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/pike: DNM, wes testing  https://review.openstack.org/58767616:41
*** vinaykns has quit IRC16:42
rfolco|ruckweshay, you still did not define where you run fs050, am I missing something ?16:44
*** moshele has joined #tripleo16:44
weshayrfolco|ruck, I just need it in periodic16:44
*** gbarros has joined #tripleo16:44
weshayrfolco|ruck, is that done in rdo-jobs or config?16:44
weshayafaict.. config16:45
weshaybut not sure anymore16:45
*** yprokule has quit IRC16:45
rfolco|ruckweshay, oh true, config/zuul.d/tripleo.yaml16:46
*** janki has quit IRC16:47
*** salmankhan has quit IRC16:48
*** holser__ has quit IRC16:52
weshayrfolco|ruck, https://review.rdoproject.org/r/1524916:52
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: DeployedServer support for cidr via get_attr  https://review.openstack.org/58812216:53
weshayrfolco|ruck, panda|backin2h you guys are not looking at the zuul queue16:54
weshaywe need to be16:54
weshayor at http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=116:55
weshay17 gate failures16:55
*** tosky has quit IRC16:57
*** sri_ has joined #tripleo16:57
*** hgogada has joined #tripleo16:59
*** derekh has quit IRC17:00
orange_juliusIs there anybody I can talk to about HA controllers + LDAP integration? Keystones seems to be forwarding the authenication request from Horizon x3 for every login. This is a huge issue when our lockout policy is 3 bad passwords =(17:03
*** hgogada has quit IRC17:06
*** panda|backin2h is now known as panda|rover17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534217:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583317:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]17:10
*** kopecmartin has quit IRC17:13
*** dtrainor has quit IRC17:16
*** dtrainor has joined #tripleo17:19
*** hgogada has joined #tripleo17:22
*** gfidente has quit IRC17:23
*** vinaykns has joined #tripleo17:30
*** trown|lunch is now known as trown17:42
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Adding ironic tests on fs001  https://review.openstack.org/56571617:44
openstackgerritMerged openstack/ansible-role-tripleo-cookiecutter master: Fixes for rpmlint  https://review.openstack.org/58924317:44
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Fix stackviz data  https://review.openstack.org/58246817:44
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Fix stackviz installation  https://review.openstack.org/58036117:45
*** moshele has quit IRC17:50
sri_beagles, If you have min can please look at this, I am facing a issue with floating ip in a dvr  http://paste.openstack.org/show/727565/17:50
sri_beagles, I am not getting any icmp responce, but when use provider_network setup and attach public ip to instance it's working fine17:52
sri_dsneddon, if you have min ^^18:03
*** rbrady-afk is now known as rbrady18:05
beaglessri_: might be that i'm missing something here but the principal difference between the two is one uses dhcp and sets the cidr and the other does not18:06
beaglessri_: is that corrrect? have you tried with setting the cidr on the one that causes the problem?18:06
*** gbarros has quit IRC18:06
sri_beagles, I've deleted the provider_network before I try ext-net18:08
sri_beagles, sorry I didn't understand your question, is it stange one type works and other dont18:08
sri_beagles, I tought maybe I need to updated my tempaltes, last time i've just added the pach18:09
beaglessri_: maybe I don't understand the question18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583318:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)18:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]18:10
beaglessri_: what do you see as the differecne between the two?18:10
*** saneax has joined #tripleo18:11
sri_beagles, with provider network i assigned the public ip directly to instance no router involved, can ping the instance , but with other netwrok ext-net net I added the ext-net to router gateway and private network when I ping the instance I am getting any reply18:14
sri_I can see the packets reaching fip namespnace and qrouter namespace18:15
sri_beagles, with tcpdump on the i can see only icmp echo request, no reply18:16
beaglessri_: I take it that the private subnet's been added to the router etc etc18:16
sri_beagles, yes18:16
* beagles can't recall just how far things might go if you don't18:16
weshayrfolco|ruck, overcloud-deploy18:17
weshaytags: overcloud-deploy18:17
beaglessri_: can you ping the VM from a DHCP namespace?18:23
beaglessri_: just wondering if there is something funky with the private subnet18:24
openstackgerritAlex Schultz proposed openstack/ansible-role-tripleo-cookiecutter master: Switch README to RST and add lint  https://review.openstack.org/58721818:24
sri_beagles, yes i can ping the vm from dhcp namespace18:26
beaglessri_: and can you ping the private ip from the qrouter namespace?18:28
beagles(the one with the dnat rule)18:28
sri_beagles, yes can ping from compute node qrouter ns18:29
beaglessri_: can you try this - recreate your ext-subnet and specify the 10.1.250.0/24 CIDR - ie neutron subnet-create --name ext-subnet \18:30
sri_beagles, I can ping the floating ip from fip ns18:30
beagles--enable_dhcp=False \18:30
beagles--allocation-pool start=10.1.250.5,end=10.1.250.250 \18:30
beagles--gateway 10.1.250.1 \18:30
beaglesext-net 10.1.250.0/2418:30
sri_beagles, I've created network with theatexact command18:34
*** paramite has quit IRC18:34
sri_beagles, http://paste.openstack.org/show/727570/18:34
beaglessri_: ah k . the prev paste didn't have that18:35
*** apetrich has quit IRC18:35
*** trozet has joined #tripleo18:35
trozetmwhahaha: are you aware of any new bug like this? https://paste.fedoraproject.org/paste/XwV0yjTa5PjxlIX604NAXw/raw18:36
mwhahahatrozet: no but that seemst o be a mismatch in tripleo-common and python-tripleoclient18:36
trozetmwhahaha: right...looking at recent changes to both18:38
sri_beagles, my bad, I think I am missing something very silly, I will do one thing I will create a stack without dvr and see everyting works as expected and maybe i need update the images and templates it's been while(40 days old)18:38
beaglesk18:38
mwhahahatrozet: it was renamed18:39
sri_beagles, thanks :)18:39
beaglessri_: np18:39
mwhahahatrozet: https://review.openstack.org/#/c/579918/18:39
trozetmwhahaha: oh: https://github.com/openstack/python-tripleoclient/blob/c5a8dbf267b69144c86a3e96a3e0965f3ab70eb3/tripleoclient/v1/container_image.py#L44218:40
trozetmwhahaha: looks like the same nedst o be done in python-tripleoclient?18:40
mwhahahalikely18:40
* mwhahaha blames mandre 18:40
* trozet wonders how this got promoted 18:40
mwhahahabecause we don't exercise that code in ci18:41
mwhahahatripleo* doesn't get promoted, it just gets merged18:41
*** vinaykns has quit IRC18:41
trozetmwhahaha: we pull the images from delorean/current-tripleo-rdo, those are promoted right?18:42
*** chem has quit IRC18:42
mwhahahatrozet: this is not code that ends up in there18:42
mwhahahatrozet: this is code from tripleo-common/python-tripleoclient which does not fall behind a promotion process18:42
mwhahahatrozet: the CI is the promotion process for tripleo code18:42
mwhahahaso once it's merged, it's available via tripleo-current18:43
trozetmwhahaha: so an undercloud image is produced in current-tripleo-rdo which is where this python-tripleoclient package came from, but you are saying that isnt part of the promotion process?18:43
*** chem has joined #tripleo18:43
mwhahahawe don't use the undercloud image18:44
mwhahahaso18:44
mwhahahano idea where that comes from18:44
mwhahahabut in terms of the normal promotion process, no i don't consider that to be18:44
trozetmwhahaha: ok i think weshay makes that for us18:44
mwhahahai guess it depends on how you setup your ci18:44
trozetmwhahaha: so you want me to file a bug on this and submit a patch to fix it?18:44
mwhahahatraditionally when we speak of the promotion process, we're talking about all the openstack* and dependencies and not tripleo bits18:45
mwhahahatrozet: plz file a bug18:45
mwhahahastevebaker: -^ tripleoclient container prepare is broken18:45
weshaytrozet, ya.. we still publish that image for you man.. but ur on the clock18:45
weshaythat will go away18:45
trozetweshay: what do we use instead, just the overcloud image?18:45
weshaytrozet, that's what we do18:46
trozetweshay: sure, should be fine18:46
*** paramite has joined #tripleo18:46
weshayya.. just remove a few packages18:46
*** vinaykns has joined #tripleo18:46
trozetweshay: you want me to switch that soon18:46
trozetweshay: then let you know when we are done?18:46
weshaytrozet, as long as things are working.. I don't care18:47
weshaybut if I have to fix something.. yes ;)18:47
weshayhow's that for a bs answer18:47
trozetweshay: haha18:47
mwhahahaeehhh no18:47
mwhahahayou should be starting from scratch like everyone else18:47
mwhahahabase os + install stuff18:48
weshaylolz18:48
mwhahahaovercloud images we're dropping the packages18:48
*** chem has quit IRC18:48
mwhahahaso you need to handle the package installation youreself18:48
*** chem has joined #tripleo18:48
trozetmwhahaha: why?18:48
weshaybecause you don't need anything installed18:49
weshaywhen you use containers18:49
weshay :)18:49
mwhahaha-^18:49
trozetweshay: yeah that is disabled in our deployments, until I can get it to work18:49
*** openstackgerrit has quit IRC18:49
weshayjebus18:49
mwhahahaprobably should get that to work soon18:49
*** openstackgerrit has joined #tripleo18:49
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: Add cleanup services for neutron  https://review.openstack.org/58956918:49
trozettheres only 1 of me..18:49
mwhahahawelcome to my world18:50
* weshay imagines trozet walking around w/ a late 80's cell phone brick complaining about containers 18:50
* weshay runs18:50
* mwhahaha goes back to trying to port heat to py3 packaging18:50
weshaytrozet, if there is only one of you.. then continue doing what you are doing and prep for centos-8 please18:50
*** moshele has joined #tripleo18:50
* weshay continues to run18:51
* weshay pauses for customer escalation18:51
* weshay continues to run18:51
mwhahahatrozet: so the undercloud installation/prepare bits are fairly straight forward to replace that image with18:51
trozetweshay: i'll just point out that our CI which is maintained by 1-2 people caught this OOO bug, and now im going to fix it too18:51
mwhahahatrozet: that's why we have tripleo-repos + yum install python-tripleoclient18:51
mwhahahatrozet: no one is asking you to fix it, file a bug so we can get the right people on it18:52
trozetmwhahaha: im not the right person :) ?18:52
trozeti need it fixed now18:52
trozetnow blocking OPNFV CI18:52
trozetso i'll fix it18:52
*** hgogada has quit IRC18:52
mwhahahatrozet: eh if you wanted to work on fixing CI to not use images that would probably be a better way to spend your time18:53
mwhahahabut sure, patches always welcome18:53
weshaytrozet, not sure what failed for you18:54
trozetmwhahaha: haha i cant fix the CI until it can pass CI witha  deployment, which it cant cuase of this18:54
weshaycontainer_images_prepare it looks like18:54
mwhahahatrozet: so if you were not using images, you could use a different repo in the mean time.18:55
mwhahahabut anyway18:55
* mwhahaha waits for patch to +218:55
mwhahahatrozet: alternatively, post bug + revert18:56
mwhahahathat's my preferred method to resolve blocking issues18:56
weshayya.. a bug would help18:56
trozetmwhahaha: ok i posted bug, and will revert18:56
openstackgerritTim Rozet proposed openstack/tripleo-common master: Revert "Add ability to filter container images to modify"  https://review.openstack.org/58957118:57
trozetmwhahaha, weshay^18:58
weshaytrozet, that bug has nothing to do w/ what image you are using18:59
weshaytrozet, you guys have job logs?19:00
trozetweshay: well the packages came from the undercloud.qcow2 image19:00
weshayof course19:00
trozetweshay: so it certainly has something to do with the image19:00
weshayother than being installed.. it doesnt19:00
trozetweshay: well yeah, that package was installed in the image we pulled, and it doesnt work cause of this bug19:01
weshaythat package is actionable19:02
trozetweshay: what do you mean by actionable?19:02
*** paramite has quit IRC19:05
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add apaches expires directive for js and css files  https://review.openstack.org/58957219:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178534219:10
openstackLaunchpad bug 1785342 in tripleo "public rdo-cloud connection failures are causing bmc setup issues intermittently" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583319:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]19:10
weshaymwhahaha, http://logs.openstack.org/76/587676/3/check/tripleo-ci-centos-7-containers-multinode/3980a5c/job-output.txt.gz#_2018-08-07_17_57_01_78750519:10
mwhahahaweshay: yes i know19:11
mwhahahaso turns out we never used dlrn_baseurl anywhere19:11
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: Add cleanup services for neutron  https://review.openstack.org/58956919:11
mwhahahaor we would have hit this19:11
weshayseems so19:13
weshaymwhahaha, http://codesearch.openstack.org/?q=artg_release&i=nope&files=&repos=19:13
weshayit's not defaulted19:13
weshaylolz19:13
openstackgerritRafael Folco proposed openstack/tripleo-quickstart-extras master: Fix libvirt_type kvm for overcloud deploy  https://review.openstack.org/58757219:14
mwhahahano defaults i guess19:14
mwhahahadat lazy loading19:14
mwhahahaanyway i just dropped it19:14
mwhahahaout of dlrn_baseurl19:14
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Update build-test-package for non-centos7  https://review.openstack.org/58954019:16
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: Add cleanup services for neutron  https://review.openstack.org/58956919:16
*** moshele has quit IRC19:18
*** apetrich has joined #tripleo19:33
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Remove dup config on tripleo-ci jobs  https://review.openstack.org/58865019:35
mwhahahaanyone remember if we dropped ceilometerclient19:50
mwhahahaor is it still a thing19:50
mwhahahait's retired19:50
* mwhahaha fixes openstach-heat spec19:50
mwhahahaHEH19:50
*** akrivoka has quit IRC19:52
weshaytrozet, when you have a sec, ping me I want to double check what is failing for you19:56
weshayopenstack overcloud container image prepare?19:56
mwhahahayea it was https://bugs.launchpad.net/tripleo/+bug/178587219:59
openstackLaunchpad bug 1785872 in tripleo "openstack overcloud container image prepare unexpected arg "append_tag"" [High,Triaged]19:59
*** holser_ has joined #tripleo19:59
mwhahahaweshay: you'd need to make sure you have tripleo-common from ~29 hours ago20:00
mwhahahawhen we landed that fix20:00
mwhahahaweshay: make sure it has https://review.openstack.org/#/c/579918/20:00
weshayoh.. the patches were out of sync for a bit?20:00
mwhahahano because it looks like client still uses the old param name20:00
weshaymwhahaha, ok..20:00
weshaytrozet, /me comparing your bug to http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#n4220:01
mwhahahawhich is the problem20:01
*** florianf has quit IRC20:01
trozetweshay: yeah not sure how CI passed20:01
*** raildo has quit IRC20:02
weshaytrozet, you running against pike?20:03
trozetweshay: no against master20:03
*** khyr0n has joined #tripleo20:04
weshaytrozet, k.. you are running different commands20:05
weshaywould be the first thing to look at20:05
weshayboth may be supported, but if the question is why did one ci pass vs.. another fail20:05
trozetweshay: we use a local docker registry, that may be a difference20:05
weshayas do we20:06
weshaydifferent ci system, different ci code you get different results at times20:06
*** raildo has joined #tripleo20:07
weshaytrozet, if you are using ansible, can we share the same role for prepping containers at least?20:08
*** dxiri has quit IRC20:08
trozetweshay: ours is python driven, so we depend on variables set by python to the ansible command20:09
trozetweshay: would take some changes to get it to work20:09
weshay to retry, use: --limit @/usr/share/opnfv-apex/ansible/playbooks/prepare_overcloud_containers.retry20:09
weshaythat's in the bug20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583320:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]20:10
trozetweshay: https://github.com/opnfv/apex/blob/master/lib/ansible/playbooks/prepare_overcloud_containers.yml#L2120:10
weshaytrozet, ya.. so if the role from upstream was imported20:11
weshayyou could just call the role there with what ever variables you wanted20:11
* mwhahaha would argue that the role from upstream isn't so importable20:11
trozetweshay: yeah, but we dont want to use oooqs20:11
weshaymwhahaha, if it's in the role path.. that's all you need20:11
weshaytrozet, you don't have to use oooq20:11
weshaymy lant20:11
mwhahahaweshay: yeaaaaaaaa it's more than that20:11
weshaya20:11
trozetLOL20:12
trozetmylanta20:12
weshaythat role is pretty small scoped20:12
weshay:)20:12
mwhahahaA LIKELY STORY20:12
trozetweshay: you tell me there is no crazy j2 filter20:12
trozetyou tell me20:12
weshayI could break that out into it's own role if that would help20:12
openstackgerritAlex Schultz proposed openstack/tripleo-common master: add lower-constraints job  https://review.openstack.org/55626520:12
weshaythe whole tripleo project is now based on crazy j2 filters20:12
trozetweshay: haha true20:12
trozetwho put the jinja in my bash20:13
weshayjebus20:13
weshaytrozet, how is shelling out from ansible any better20:13
trozetweshay: its not really20:13
weshay:)20:13
*** zul has quit IRC20:13
trozetweshay: this playbook patches docker containers on the fly and rebuilds them with patches from openstack gerrit20:14
trozetweshay: so i dont think its just a drop in replacment for waht you are pwning quickstart-extras20:14
weshaytrozet, that is what the role originally did20:14
weshaythat code is now in tripleo-common20:14
weshaybut what ever20:15
weshaythis conversation is boring after 3yrs :)20:15
weshayno offense20:15
*** lblanchard has quit IRC20:15
trozetweshay: https://bugs.launchpad.net/tripleo/+bug/1681575 RIP20:16
openstackLaunchpad bug 1681575 in tripleo "devmode incorrect default URL for openstack gerrit" [Medium,Triaged]20:16
weshaytrozet, openstack-dev list20:16
* weshay finds the email20:16
trozetweshay: yeah i mean we went down this road with installers, i did my nice presentationf or you and mwhahaha20:17
trozetweshay: we feel like this is a better option, so we stick with it20:17
weshayhttps://docs.openstack.org/tripleo-docs/latest/contributor/reproduce-ci.html20:17
weshaytrozet, fine20:17
*** ansmith has quit IRC20:17
weshaytrozet, mwhahaha it would be possible to split off a role to prep containers ala.. https://review.openstack.org/#/c/589568/20:18
weshayand work from there20:18
weshaytrozet, sharing ansible roles is a decent pattern to collobrate in these cases20:18
mwhahahaehh there are agruments for all of the above20:18
weshaybut .. keep on keep on20:18
mwhahahapersonally i'd rather we focus on the distinct areas that need to be configured and maybe expose ansible roles for them, but then the question of supportability comes in20:19
*** jtcressy has joined #tripleo20:19
mwhahahathere's recurring arguments over what we should really support20:19
mwhahahatechincally the tripleo commands themselves should be the things run but the complexity of those are killing us repeatedly20:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: devmode.sh has been upgraded  https://review.openstack.org/58409720:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: devmode.sh has been upgraded  https://review.openstack.org/58409720:20
jtcressyfultonj: Have you seen this before in the ceph-ansible playbook? It looks like its trying to inspect the docker containers for the monitors or rgw and it cant find the container by its id: https://hastebin.com/dojurojuke20:20
jtcressyfultonj: there *are* docker containers present for mon and rgw, so maybe it's loosing track of them?20:20
jtcressyalso, mwhahaha, if you have any ideas ^^^20:21
openstackgerritRafael Folco proposed openstack/tripleo-quickstart-extras master: Add test_reassign_port_between_servers to skip list  https://review.openstack.org/58960920:21
trozetweshay: but back to the CI thing, i think this  command should have failed, so did you double check that you were definitely using patch when it was deployed?20:22
weshaytrozet, this one? https://review.openstack.org/#/c/579918/20:23
trozetweshay: right20:24
weshaytrozet, patch is built here http://logs.openstack.org/18/579918/8/check/tripleo-ci-centos-7-containers-multinode/8afd997/logs/delorean_logs/c1/a9/c1a98389a1742a4b2c278b48ffc318259e8db900_dev/rpmbuild.log.txt.gz20:24
* weshay checks undercloud20:24
trozetweshay: as long as you did the openstack image prepare command, it should have failed20:24
weshayhttp://logs.openstack.org/18/579918/8/check/tripleo-ci-centos-7-containers-multinode/8afd997/logs/undercloud/var/log/yum.log.txt.gz20:24
weshayAug 06 07:23:55 Installed: openstack-tripleo-common-containers-9.2.1-0.20180806070030.c11523b.el7.noarch20:24
weshayAug 06 07:28:33 Updated: python2-tripleo-common-9.2.1-0.20180806072658.c1a9838.el7.noarch20:25
weshayAug 06 07:28:33 Updated: openstack-tripleo-common-containers-9.2.1-0.20180806072658.c1a9838.el7.noarch20:25
weshayAug 06 07:28:33 Updated: openstack-tripleo-common-9.2.1-0.20180806072658.c1a9838.el7.noarch20:25
mwhahahaweshay: yea but it depends on what patch was based on20:25
weshayya.. so help me find that patch you guy are concerned about20:26
*** khyr0n has quit IRC20:26
*** raildo has quit IRC20:28
trozetlooks like the revert is fixing things in Apex: https://gerrit.opnfv.org/gerrit/#/c/60711/20:29
trozet2018-08-07 12:58:37,616 INFO: TASK [Prepare generic docker registry image file] ******************************20:29
trozethttps://build.opnfv.org/ci/job/apex-deploy-virtual-master/1584/console20:29
*** jtcressy has quit IRC20:29
*** holser_ has quit IRC20:31
*** vinaykns has quit IRC20:33
weshaytrozet, you guys have logs? http://logs.openstack.org/18/579918/8/check/tripleo-ci-centos-7-containers-multinode/8afd997/logs/undercloud/var/log/yum.log.txt.gz20:33
weshayoops20:34
weshaytrozet, https://build.opnfv.org/ci/job/apex-deploy-virtual-master/1581/20:34
weshay?20:34
trozetweshay: yeah if you look at the build number there 2453, https://build.opnfv.org/ci/job/apex-verify-master/2453/ , apex-fetch-logs-master, hit that console output it will show you the links20:35
trozetweshay: thats if you want the overcloud logs20:35
weshayah nice20:36
weshayk20:36
weshaytrozet, /me wonders why you guys don't get setup as a proper third party20:36
trozetweshay: i'm trying20:38
trozetweshay: first priority is we are doing this thing with snapshots20:38
trozetweshay: so we have a promotion pipeline where if a deployment passes and passes functional testing, we save the deployed overcloud nodes as snapshots20:39
trozetweshay: then you can deploy the snapshots within 7 minutes or so20:39
trozetweshay: so in ODL gerrit, you can trigger us as 3rd party, we launch the promoted snapshots, and replace the ODL in the overcloud with the one from the ODL patch, then run tests against it20:39
trozetweshay: the networking-odl project in OpenStack wants to use this as 3rd party verification rather than waiting for tripleo deployment20:40
openstackgerritGoutham Pacha Ravi proposed openstack/puppet-tripleo master: Fix bind mount for manila-share  https://review.openstack.org/58963120:41
*** holser_ has joined #tripleo20:41
-openstackstatus- NOTICE: Due to a bug, Zuul has been unable to report on cherry-picked changes over the last 24 hours. This has now been fixed; if you encounter a cherry-picked change missing its results (or was unable to merge), please recheck now.20:44
*** apetrich has quit IRC20:45
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Create a Timesync service declaration  https://review.openstack.org/58667920:47
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: WIP: Add chrony time service  https://review.openstack.org/58811120:47
*** thrash is now known as thrash|g0ne20:51
weshaymwhahaha, EmilienM merge? https://review.openstack.org/#/c/589510/20:53
EmilienMweshay: I can't :(20:54
EmilienMweshay: and there is a -1 from Adriano!20:54
EmilienMwhich looks really valid20:54
mwhahahaDitto20:54
*** dprince has quit IRC20:56
*** slaweq has quit IRC20:58
weshayEmilienM, easy enough no?20:59
weshaytypie typie20:59
weshaylolz20:59
weshaywho am i20:59
*** rbrady has quit IRC21:02
*** jtcressy has joined #tripleo21:05
openstackgerritMerged openstack/puppet-pacemaker master: Deep_compare fix with location constraints and better debugging  https://review.openstack.org/58892221:06
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583321:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]21:10
weshayEmilienM, rfolco|ruck I think this is correct https://review.rdoproject.org/r/1525221:18
EmilienMweshay: heh, only +1 on this one...21:18
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071921:18
weshayWOOT21:18
weshayhe is NOT all powerful21:19
EmilienMhopefully not :D21:20
*** rfolco|ruck is now known as rfolco|off21:21
*** dxiri has joined #tripleo21:23
*** slaweq has joined #tripleo21:23
*** jtcressy has quit IRC21:24
*** jtcressy has joined #tripleo21:25
*** trown is now known as trown|outtypewww21:27
*** edmondsw has quit IRC21:29
*** abishop has quit IRC21:31
*** bfournie has quit IRC21:32
*** holser_ has quit IRC21:38
*** lblanchard has joined #tripleo21:41
openstackgerritSteve Baker proposed openstack/tripleo-common master: Rename argument back to append_tag  https://review.openstack.org/58964721:43
stevebakermwhahaha, trozet: here is a fix which won't require a revert https://review.openstack.org/58964721:45
mwhahahak21:46
*** bdodd has quit IRC21:56
*** slagle has quit IRC21:56
*** ade_lee has quit IRC22:00
*** owalsh_ has joined #tripleo22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583322:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]22:10
*** ooolpbot has quit IRC22:10
*** toure is now known as toure|gone22:10
*** owalsh has quit IRC22:12
*** owalsh- has joined #tripleo22:12
*** owalsh- is now known as owalsh22:13
*** beagles has quit IRC22:13
*** owalsh_ has quit IRC22:14
*** beagles has joined #tripleo22:20
*** rcernin has joined #tripleo22:20
*** cdearborn has quit IRC22:25
*** jtcressy has quit IRC22:30
openstackgerritMatt Young proposed openstack-infra/tripleo-ci master: Use fqdn for zuul projects  https://review.openstack.org/58782822:47
*** rpioso is now known as rpioso|afk22:54
*** edmondsw has joined #tripleo22:54
*** ansmith has joined #tripleo22:55
*** jtcressy has joined #tripleo22:57
*** edmondsw has quit IRC22:59
*** jtcressy has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178583323:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1785833 in tripleo "Failure in containerized-undercloud-upgrades trying to upgrade workbook" [Critical,Triaged]23:10
*** myoung has quit IRC23:14
*** pmannidi has joined #tripleo23:20

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!