| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 00:00 |
|---|---|---|
| *** deadnull_ has quit IRC | 00:03 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 00:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 00:10 |
| *** gbarros has quit IRC | 00:24 | |
| *** Goneri has quit IRC | 00:41 | |
| *** mhenkel_ has joined #tripleo | 00:49 | |
| *** dmacpher-afk has quit IRC | 00:51 | |
| *** mhenkel_ has quit IRC | 00:53 | |
| *** masterjcool has quit IRC | 00:59 | |
| *** limao has joined #tripleo | 01:09 | |
| *** dtantsur has quit IRC | 01:10 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 01:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 01:10 |
| *** katkapilatova has quit IRC | 01:10 | |
| *** masterjcool has joined #tripleo | 01:11 | |
| *** pblaho has quit IRC | 01:11 | |
| *** katkapilatova has joined #tripleo | 01:11 | |
| *** pblaho has joined #tripleo | 01:12 | |
| *** dtantsur has joined #tripleo | 01:14 | |
| *** mhenkel_ has joined #tripleo | 01:20 | |
| *** mhenkel_ has quit IRC | 01:24 | |
| *** mhenkel_ has joined #tripleo | 01:31 | |
| *** dmacpher has joined #tripleo | 01:34 | |
| *** mhenkel_ has quit IRC | 01:36 | |
| *** bkopilov has quit IRC | 01:38 | |
| *** bkopilov_ has quit IRC | 01:38 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-predictable-ctlplane-ips https://review.openstack.org/421010 | 01:45 |
| *** limao has quit IRC | 01:47 | |
| *** limao has joined #tripleo | 01:47 | |
| *** dixiaoli has joined #tripleo | 01:58 | |
| *** diana_clarke has joined #tripleo | 01:59 | |
| *** liverpooler has quit IRC | 02:03 | |
| diana_clarke | Here's a really easy review, if anyone is bored: https://review.openstack.org/#/c/450342/ (a one character typo I found while testing the tripleo upgrade commands) | 02:05 |
| *** thrash is now known as thrash|g0ne | 02:06 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 02:10 |
| *** yamahata has quit IRC | 02:14 | |
| *** mhenkel_ has joined #tripleo | 02:21 | |
| *** mhenkel_ has quit IRC | 02:23 | |
| *** mhenkel has quit IRC | 02:25 | |
| *** mhenkel has joined #tripleo | 02:27 | |
| *** mhenkel_ has joined #tripleo | 02:28 | |
| *** mhenkel has quit IRC | 02:31 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Ironic containers: chown /var/lib/ironic correctly https://review.openstack.org/451146 | 02:32 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Support multiple messages from get_passwords https://review.openstack.org/443053 | 02:36 |
| *** mhenkel has joined #tripleo | 02:38 | |
| *** mhenkel has quit IRC | 02:42 | |
| *** rlandy has quit IRC | 02:43 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Remove 'Controller' role references from overcloud.j2.yaml https://review.openstack.org/450975 | 02:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Modify pci_passthrough hiera value as string https://review.openstack.org/448600 | 02:47 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/ocata: Ignore os-cloud-config deprecation warning https://review.openstack.org/450890 | 02:48 |
| *** gbarros has joined #tripleo | 02:48 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 02:50 |
| *** bkopilov has joined #tripleo | 02:57 | |
| *** mhenkel has joined #tripleo | 02:58 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 03:10 |
| *** links has joined #tripleo | 03:12 | |
| *** dixiaoli has quit IRC | 03:18 | |
| *** dixiaoli has joined #tripleo | 03:26 | |
| *** psahoo has joined #tripleo | 03:39 | |
| *** udesale has joined #tripleo | 03:45 | |
| *** garyk has quit IRC | 04:00 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 04:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Only set EnableConfigPurge on major upgrades https://review.openstack.org/450887 | 04:12 |
| *** mdnadeem has joined #tripleo | 04:17 | |
| *** mhenkel__ has joined #tripleo | 04:21 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates stable/ocata: Modify pci_passthrough hiera value as string https://review.openstack.org/451168 | 04:22 |
| *** mhenkel has quit IRC | 04:24 | |
| *** dixiaoli has quit IRC | 04:30 | |
| *** gbarros has quit IRC | 04:39 | |
| *** garyk has joined #tripleo | 04:39 | |
| openstackgerrit | Peng Liu proposed openstack/puppet-tripleo master: Introduce profile to configure l2 gateway Neutron agent. https://review.openstack.org/451173 | 04:40 |
| *** garyk1 has joined #tripleo | 04:40 | |
| *** garyk has quit IRC | 04:40 | |
| *** garyk has joined #tripleo | 04:41 | |
| *** gkadam has joined #tripleo | 04:42 | |
| *** garyk has quit IRC | 04:42 | |
| *** garyk has joined #tripleo | 04:43 | |
| *** prateek has joined #tripleo | 04:45 | |
| *** garyk1 has quit IRC | 04:45 | |
| openstackgerrit | Peng Liu proposed openstack/tripleo-heat-templates master: Add l2gw neutron agent support https://review.openstack.org/451175 | 04:45 |
| *** iranzo has joined #tripleo | 04:49 | |
| *** iranzo has joined #tripleo | 04:49 | |
| *** ratailor has joined #tripleo | 04:54 | |
| *** mhenkel__ has quit IRC | 05:00 | |
| *** tzumainn has quit IRC | 05:06 | |
| *** remix_tj has quit IRC | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 05:10 |
| *** nyechiel has joined #tripleo | 05:21 | |
| *** ramishra has quit IRC | 05:30 | |
| *** dixiaoli has joined #tripleo | 05:31 | |
| *** dixiaoli has quit IRC | 05:34 | |
| *** ramishra has joined #tripleo | 05:35 | |
| *** limao has quit IRC | 05:38 | |
| *** limao_ has joined #tripleo | 05:38 | |
| *** rcernin has joined #tripleo | 05:39 | |
| *** lmiccini has joined #tripleo | 05:44 | |
| *** yamahata has joined #tripleo | 05:47 | |
| *** remix_tj has joined #tripleo | 05:47 | |
| *** garyk has quit IRC | 05:53 | |
| *** garyk has joined #tripleo | 05:53 | |
| *** dixiaoli has joined #tripleo | 05:58 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 06:10 |
| *** jaosorior has joined #tripleo | 06:14 | |
| *** lmiccini has quit IRC | 06:15 | |
| *** yprokule has joined #tripleo | 06:16 | |
| *** fragatin_ has joined #tripleo | 06:21 | |
| *** jprovazn has joined #tripleo | 06:22 | |
| *** pcaruana has joined #tripleo | 06:24 | |
| *** fragatina has quit IRC | 06:24 | |
| *** fragatin_ has quit IRC | 06:26 | |
| *** paramite has joined #tripleo | 06:27 | |
| *** lmiccini has joined #tripleo | 06:28 | |
| *** ealcaniz has joined #tripleo | 06:34 | |
| *** apetrich has quit IRC | 06:35 | |
| chem | marios: matbu hi, for https://review.openstack.org/#/c/434346/ I've got a patch that make it more "ansible" like, would you mind if I upload it, it would be easier for discutting it and we can easily revert it if you don't like it :) | 06:35 |
| *** apetrich has joined #tripleo | 06:35 | |
| chem | marios: matbu is that oki with you ? | 06:35 |
| *** fragatina has joined #tripleo | 06:36 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from delete_node https://review.openstack.org/446438 | 06:37 |
| matbu | chem: yep sure | 06:39 |
| matbu | chem: thanks man | 06:39 |
| *** fragatina has quit IRC | 06:40 | |
| *** fragatina has joined #tripleo | 06:40 | |
| marios | chem: o/ | 06:42 |
| marios | chem: please go ahead | 06:42 |
| *** fragatina has quit IRC | 06:42 | |
| marios | chem: do you think it will help with the comments from shardy/emilien? | 06:42 |
| *** bfournie has joined #tripleo | 06:43 | |
| marios | matbu: chem i don't see what we can do about the workaround, i mean, we didn't come up with it but were told 'this is how you can upgrade' | 06:43 |
| *** fragatina has joined #tripleo | 06:43 | |
| chem | marios: matbu yeap aggreed, we just going to try to make it "look" better and more manageable, but this hell has fall upon us, and there not much more we can do about it | 06:44 |
| *** florianf has joined #tripleo | 06:46 | |
| *** lihi has quit IRC | 06:46 | |
| *** oanson has quit IRC | 06:48 | |
| matbu | chem: yep im curious to see your changes :) | 06:48 |
| chem | matbu: hum ... I need to pull in marios' change and then i push | 06:49 |
| matbu | chem: yep marios add the release note yesterday | 06:51 |
| *** dmacpher has quit IRC | 06:51 | |
| *** prateek_ has joined #tripleo | 06:51 | |
| *** ukalifon has joined #tripleo | 06:52 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 06:52 |
| marios | matbu: chem release note not that important the conditional was the bigger thing | 06:52 |
| *** udesale__ has joined #tripleo | 06:52 | |
| chem | marios: matbu done :) | 06:52 |
| chem | marios: matbu shouldn't change anyting, just cosmetic | 06:53 |
| *** aufi has joined #tripleo | 06:53 | |
| marios | chem: heh nice :) to register them independeptly | 06:53 |
| marios | chem: will include it in today's runs | 06:53 |
| *** jkilpatr has quit IRC | 06:53 | |
| *** udesale has quit IRC | 06:53 | |
| *** prateek has quit IRC | 06:54 | |
| chem | marios: matbu I just -1 myself :) | 06:55 |
| chem | marios: matbu can you look at the comment, I think it's fishy | 06:55 |
| marios | chem: ack will look i also added question | 06:56 |
| matbu | chem: ack thx | 06:56 |
| mandre | mwhahaha: what did I break this time? | 06:57 |
| *** athomas has joined #tripleo | 06:57 | |
| *** hjensas has joined #tripleo | 06:57 | |
| *** pgadiya has joined #tripleo | 06:58 | |
| chem | marios: matbu I'm going to "inline" the package download to avoid the double "rm -rf", sounds good ? | 06:59 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Run introspection 20 nodes at a time https://review.openstack.org/439568 | 06:59 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: TESTING small batch https://review.openstack.org/449215 | 06:59 |
| *** dparkes has quit IRC | 06:59 | |
| matbu | chem: i added a comment about the rm | 06:59 |
| matbu | chem: we can manage the directory with ansible module instead of shell module | 07:00 |
| marios | matbu: chem are we sure about the python-openvswitch necessity as an independent? I mean we didn't used to have that | 07:00 |
| chem | marios: matbu I've got no clue of what I'm doing, just changing cosmetics :) | 07:01 |
| marios | chem: added note on the review too | 07:01 |
| matbu | marios: it was needed on previous test | 07:01 |
| marios | matbu: chem i think the --resolve to yumdownloader should pull in any extra things it needs | 07:01 |
| matbu | marios: not sure if it's still needed as part of the workaround | 07:02 |
| marios | matbu: right, ok, mainly calling it out as we have to work around that withitems and realised we didn't used to have that in the original workaround | 07:02 |
| chem | marios: matbu oki, so I just remove the loop and hardcode openvswitch ? | 07:03 |
| marios | matbu: chem in fact stil dont at https://review.openstack.org/#/c/450607/2/extraconfig/tasks/pacemaker_common_functions.sh | 07:03 |
| marios | matbu: chem and fwiw i tested that yesterday (coment on review ) | 07:03 |
| *** chem is now known as chem|brb | 07:04 | |
| *** brault has joined #tripleo | 07:04 | |
| matbu | marios: the --resolv doesn't pull the python-ovs afair | 07:06 |
| matbu | marios: but in all cases, i can test it this morning | 07:07 |
| matbu | i think i have a downstream deployment ready for that | 07:07 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 07:10 |
| marios | matbu: chem ack lets get this tested/landed asap but lets wait to see if shardy/emilien have any better suggestions too | 07:10 |
| *** jlinkes has joined #tripleo | 07:10 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS-everywhere: Enable for TLS libvirt live migration https://review.openstack.org/450726 | 07:11 |
| *** cylopez has joined #tripleo | 07:12 | |
| chem|brb | marios: commented on https://review.openstack.org/#/c/450607/2/extraconfig/tasks/pacemaker_common_functions.sh, still syntaxic sugar | 07:13 |
| *** chem|brb is now known as chem | 07:13 | |
| bandini | jaosorior: if you have a few mins https://review.openstack.org/#/c/425710/ should be a simple one | 07:14 |
| bandini | :) | 07:14 |
| *** tesseract has joined #tripleo | 07:14 | |
| chem | matbu: marios oki, we adjust it to look like that "--resolve openvswitch" and without the loop | 07:14 |
| *** dparkes has joined #tripleo | 07:15 | |
| *** prateek__ has joined #tripleo | 07:15 | |
| chem | matbu: marios pushing a new review in 58sec | 07:15 |
| matbu | chem: 58 s | 07:16 |
| jaosorior | bandini: it looks simple and fine, but it could be cleaned up. You wanna do that here or in another commit? | 07:16 |
| marios | chem: ack thanks | 07:17 |
| *** prateek_ has quit IRC | 07:18 | |
| *** suuuper has joined #tripleo | 07:18 | |
| *** aufi has quit IRC | 07:18 | |
| *** amoralej|off is now known as amoralej | 07:24 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from introspect manageable https://review.openstack.org/446065 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from provide workflow https://review.openstack.org/446049 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from introspect workflow https://review.openstack.org/446054 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from configure workflow https://review.openstack.org/446337 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from create_raid_configuration https://review.openstack.org/446339 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from provide_manageable_nodes https://review.openstack.org/446081 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from configure_manageable_nodes https://review.openstack.org/446338 | 07:26 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from deploy_plan https://review.openstack.org/446437 | 07:27 |
| *** fzdarsky has joined #tripleo | 07:29 | |
| *** pkovar has joined #tripleo | 07:33 | |
| chem | matbu: marios: 57 ... 58s | 07:38 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 07:38 |
| marios | chem: i think you have a clock skew issue | 07:39 |
| chem | marios: hehe | 07:39 |
| *** jpena|off is now known as jpena | 07:39 | |
| chem | matbu: marios: that's a lot of changes ... I've included the iteration over all the downloaded and the check for allready installed one. This should be a match for what is happening in https://review.openstack.org/#/c/450607/2/extraconfig/tasks/pacemaker_common_functions.sh | 07:40 |
| chem | matbu: marios: this is of course completly untested, going to add -1 workflow, and let's remove it when it's tested at least once :) | 07:40 |
| matbu | chem: the 58 sec is over... | 07:40 |
| chem | matbu: review pushed :) | 07:41 |
| matbu | chem: ack, thanks, no worries, i'll test it | 07:41 |
| chem | matbu: marios: I'm backporting it so that we can have a run in the upstream ci as well | 07:41 |
| matbu | chem: backporting now ? | 07:42 |
| *** jaganathan has joined #tripleo | 07:42 | |
| matbu | chem: i think you should wait a bit | 07:42 |
| chem | matbu: yeah, I was told by EmilienM that's the only way to get a upgrade test in the upstream ci | 07:42 |
| chem | matbu: that cost nothing and I'll add a big fat -1 workflow to it | 07:42 |
| bandini | jaosorior: I will clean it up now, thanks | 07:43 |
| matbu | chem: hm k, but idk if this case will be tested | 07:43 |
| chem | matbu: syntax will be at least | 07:43 |
| matbu | chem: but at least it will failed if you missed to declare variables or nits & typo | 07:43 |
| matbu | chem: yep :) | 07:43 |
| chem | matbu: life in upgrade is so complicated :) | 07:44 |
| marios | chem: ack on the testing and sure backport adn -1 it | 07:44 |
| matbu | lol | 07:44 |
| marios | chem: only because openvswitch hates us | 07:44 |
| chem | marios: right :) | 07:45 |
| jaosorior | lhinds: you around? | 07:45 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Allow users to specify the Introspection batch size https://review.openstack.org/451228 | 07:46 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/ocata: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/451231 | 07:48 |
| *** lucas-afk is now known as lucas-event | 07:49 | |
| *** dsariel has quit IRC | 07:50 | |
| *** aufi has joined #tripleo | 07:51 | |
| *** jpena is now known as jpena|off | 07:53 | |
| *** bogdando has joined #tripleo | 07:54 | |
| *** fzdarsky has quit IRC | 07:54 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support upgrades in multinode CI https://review.openstack.org/450784 | 07:55 |
| *** jaganathan has quit IRC | 07:56 | |
| *** jpena|off is now known as jpena | 07:59 | |
| openstackgerrit | mathieu bultel proposed openstack/puppet-tripleo master: Active Ntp if timedatectl is installed https://review.openstack.org/451233 | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| yolanda | hi, i have a problem on a test for a backport to newton: http://logs.openstack.org/51/450651/3/check/gate-tripleo-buildimage-overcloud-full-centos-7/d279374/console.html | 08:02 |
| yolanda | 2017-03-29 06:26:15.091392 | + os-svc-enable -n os-collect-config | 08:02 |
| yolanda | 2017-03-29 06:26:15.095582 | /usr/local/bin/os-svc-enable: line 56: map-services: command not found | 08:02 |
| yolanda | looks as there is some problem in the newton tests? my change seems to be unrelated | 08:03 |
| *** zzzeek has joined #tripleo | 08:03 | |
| *** shardy has joined #tripleo | 08:03 | |
| *** fzdarsky has joined #tripleo | 08:03 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-repos master: Add current-passed-ci repo to choices https://review.openstack.org/450901 | 08:04 |
| *** gfidente has joined #tripleo | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] | 08:10 |
| bogdando | folks, please merge https://review.openstack.org/#/c/448294/ | 08:10 |
| bogdando | PTAL https://review.openstack.org/#/c/450901/ | 08:10 |
| shardy | bogdando: I'm not sure on the logic here - current-tripleo is the pin we use for passed CI, because it's passed a set of periodic integration tests specific to tripleo | 08:12 |
| shardy | bogdando: Can you explain the requirement around current-passed-ci please? | 08:13 |
| *** dixiaoli has quit IRC | 08:13 | |
| lhinds | i am now jaosorior | 08:14 |
| bogdando | shardy: oooq has a datavar upgrade_delorean_hash which defaults to current-passed-ci. I hoped to reuse that choice for undercloud-deploy install script as well, to upgrade dlrn repos | 08:14 |
| bogdando | to me, relying on the current-passed-ci instead of current brings better experience to devs trying to spin up a stable env to test their patches w/o noise | 08:15 |
| jaosorior | lhinds: do you have any idea if, when TLS is enabled, the libvirt client takes into account libvirt.conf's TLS configurations? | 08:15 |
| jaosorior | lhinds: For instance, if I change the CA (through the ca_file parameter) in libvirt.conf, will that also be taken into account by the client? or is it only server side? | 08:15 |
| bogdando | shardy: putting it another way, current-passed-ci allow to not bring known CI issues into dev envs | 08:16 |
| bogdando | specifically, when installing undercloud with containers | 08:16 |
| bogdando | this follows up the chain of patches https://review.openstack.org/#/c/450792 | 08:16 |
| *** mcornea has joined #tripleo | 08:17 | |
| bogdando | shardy: but I'd like to clarify the current-tripleo vs current vs current-passed-ci, it is confusing | 08:17 |
| *** dixiaoli has joined #tripleo | 08:18 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: TLS-everywhere: Add resources for libvirt's cert for live migration https://review.openstack.org/450723 | 08:19 |
| shardy | bogdando: Ok sounds reasonable, it might be worth clarifying in the commit message, as IME most developers are focussed on what's tested in upstream CI | 08:19 |
| shardy | I guess for those focussed on RDO testing this may be more appropriate tho | 08:19 |
| bogdando | um, I thought passed-ci stands for upstream | 08:19 |
| lhinds | jaosorior: I might not be the best guy to check with here, we should check with richard jones or daniel berrange. I have an idea, but they would be more aware of caveats. | 08:19 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Qpid dispatch router puppet profile https://review.openstack.org/425710 | 08:20 |
| lhinds | jaosorior: richard rjones should be in #virt on freenode. | 08:20 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS-everywhere: Enable for TLS libvirt live migration https://review.openstack.org/450726 | 08:20 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Qpid dispatch router composable role https://review.openstack.org/423326 | 08:20 |
| lhinds | jaosorior: I want you to get the best info on this. | 08:20 |
| bogdando | shardy: https://www.redhat.com/archives/rdo-list/2015-December/msg00101.html "(current [1]) -> Delorean (current-passed-ci [2]) -> Stable > (rpm repository [3])" does this stand for downstream CI jobs? | 08:21 |
| jaosorior | lhinds: makes sense | 08:21 |
| jaosorior | lhinds: what's their timezone? | 08:21 |
| shardy | jaosorior: both UK based | 08:21 |
| lhinds | jaosorior : sorry wrong server, its #virt on irc.redhat.com | 08:21 |
| lhinds | jaosorior: just checked and his nick is in the channel | 08:22 |
| bogdando | shardy: recalling everything I've read on that topic, I expect passed-ci to stand for upstream CI... | 08:22 |
| shardy | bogdando: well unless we changed something fundamental with the transition to oooq it's not what we test in upstream CI | 08:23 |
| bogdando | yay | 08:23 |
| shardy | we test current-tripleo, overlaid with current for tripleo repos | 08:23 |
| bogdando | I'm gonna re read evereything now | 08:23 |
| shardy | and the periodic jobs promote current-tripleo (in theory every day, modulo bugs) | 08:23 |
| shardy | sshnaidm: Hey can you confirm that's still the case for oooq jobs? ^^ | 08:23 |
| *** abehl has joined #tripleo | 08:23 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-common master: Fix using old Swift rings when creating a new stack https://review.openstack.org/444219 | 08:23 |
| yolanda | hi shardy, can you help? i have a problem with the python-tripleoclient CI on newton | 08:24 |
| yolanda | the job is installing diskimage-builder from pip | 08:24 |
| yolanda | tox -evenv -- pip install $WORKSPACE/diskimage-builder | 08:24 |
| yolanda | this picks the latest tag of dib | 08:24 |
| yolanda | and newton does not work with it, we need to pin the tag, the same it's done on packages | 08:24 |
| *** fzdarsky has quit IRC | 08:24 | |
| shardy | yolanda: why is it installing dib via pip? | 08:25 |
| yolanda | don't know, just found it! | 08:25 |
| shardy | in the unit tests I guess? | 08:25 |
| yolanda | gate-tripleo-buildimage-overcloud-full-centos-7 job | 08:25 |
| yolanda | job is defined like that in jenkins | 08:25 |
| *** zoli|gone is now known as zoli | 08:25 | |
| *** fzdarsky has joined #tripleo | 08:26 | |
| shardy | Ok I'm not familiar with that job tbh, but all of our jobs except unit tests should use packages | 08:26 |
| yolanda | it's a functional one | 08:26 |
| bogdando | shardy: that's that I've been reading https://blogs.rdoproject.org/7834/delorean-openstack-packages-from-the-future https://www.rdoproject.org/blog/2016/05/newbie-in-rdo-2-rdo-trunk-from-a-bird-s-eye-view/ | 08:26 |
| shardy | yolanda: do you have a link? | 08:26 |
| shardy | to the failing job? | 08:26 |
| yolanda | http://logs.openstack.org/51/450651/3/check/gate-tripleo-buildimage-overcloud-full-centos-7/d279374/console.html | 08:26 |
| *** pkovar has quit IRC | 08:26 | |
| bogdando | shardy: "current-tripleo repo is managed by a set of jobs focused on testing TripleO installer on the current-passed-ci repo" . So it seems I have to adjust the choice for the current-tripleo to use current-passed-ci! | 08:27 |
| yolanda | shardy, and the job: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/tripleo.yaml#n119 | 08:27 |
| shardy | bogdando: I think those show that current-tripleo is promoted from builds based on current-passed-ci | 08:28 |
| shardy | bogdando: IOW current-passed-ci is earlier in the promotion pipeline and thus potentially less stable | 08:29 |
| shardy | RDO CI passes, then we do extra testing with tripleo and promote to current-tripleo | 08:29 |
| bogdando | ugh | 08:29 |
| shardy | https://www.rdoproject.org/blog/2016/05/newbie-in-rdo-2-rdo-trunk-from-a-bird-s-eye-view/ | 08:29 |
| shardy | bogdando: see the pipeline in the diagram there | 08:29 |
| shardy | bogdando: those blogs are quite old, so perhaps confirm in #rdo, but that is my understanding of it | 08:30 |
| *** gkadam is now known as gkadam-mtg | 08:30 | |
| shardy | trown|outtypewww is a good contact to discuss it with later | 08:30 |
| *** ukalifon has quit IRC | 08:31 | |
| bogdando | shardy: thank you, I'll figure that out | 08:31 |
| shardy | Can I get a review on https://review.openstack.org/#/c/450900/ stable backport please? | 08:32 |
| *** gkadam_ has joined #tripleo | 08:32 | |
| *** limao has joined #tripleo | 08:34 | |
| *** limao_ has quit IRC | 08:34 | |
| *** pkovar has joined #tripleo | 08:34 | |
| openstackgerrit | zenghui.shi proposed openstack/tripleo-heat-templates master: Add network sysctl tweaks for security https://review.openstack.org/451250 | 08:35 |
| *** karimb has joined #tripleo | 08:35 | |
| *** gkadam-mtg has quit IRC | 08:35 | |
| *** agurenko has quit IRC | 08:36 | |
| shardy | yolanda: So, I think this is another case of dib v2 breakage | 08:36 |
| shardy | yolanda: dib doesn't have a stable/newton branch, as we can see here: | 08:36 |
| shardy | http://logs.openstack.org/51/450651/3/check/gate-tripleo-buildimage-overcloud-full-centos-7/d279374/console.html#_2017-03-29_06_11_33_485079 | 08:36 |
| shardy | so it fails trying to use this deprecated/removed element: | 08:36 |
| yolanda | yes, dib is not providing stable branches | 08:36 |
| yolanda | and i don't think it's on the scope | 08:37 |
| shardy | http://logs.openstack.org/51/450651/3/check/gate-tripleo-buildimage-overcloud-full-centos-7/d279374/console.html#_2017-03-29_06_26_15_095582 | 08:37 |
| yolanda | shardy, so how can we make that ci work for oldest branches? looks as stable/newton, and maybe stable/ocata, may be broken? | 08:38 |
| shardy | yolanda: Ok, I'm not sure what the best approach is then - it's kinda unfortunate if they're not supporting branches that they'd deprecate and remove interfaces within the lifetime of non-EOL branches | 08:38 |
| shardy | yolanda: bnemec pushed some workarounds for some other repos, I assume we'll need to do something like carry the map-services element in stable/newton of some tripleo specific repo | 08:38 |
| yolanda | shardy, a nasty fix could be pinning pip install on this job, having conditionals for stable/newton, stable/ocata branches | 08:38 |
| shardy | yolanda: I wonder if there's actually a case for pinning dib in global requirements for all stable/newton | 08:39 |
| yolanda | so pip install "latest working tag for dib" | 08:39 |
| yolanda | indeed | 08:39 |
| *** karimb has quit IRC | 08:39 | |
| * shardy wonders how big the patch removing map-services dependency is and if we could backport it | 08:41 | |
| *** karimb has joined #tripleo | 08:41 | |
| yolanda | not sure if that's the only patch that fails | 08:42 |
| yolanda | dib v2 was a massive change | 08:42 |
| shardy | Yeah I guess there may be a bunch of issues :( | 08:42 |
| * shardy sighs | 08:42 | |
| *** karimb has quit IRC | 08:46 | |
| *** dixiaoli_ has joined #tripleo | 08:46 | |
| jistr | anyone succeeded deploying ocata with quickstart? | 08:46 |
| jistr | for me it fails on not being able to download image | 08:47 |
| jistr | there are no ocata images here https://buildlogs.cdn.centos.org/centos/7/cloud/x86_64/tripleo_images/ | 08:47 |
| *** apevec has joined #tripleo | 08:47 | |
| *** karimb has joined #tripleo | 08:48 | |
| *** dixiaoli has quit IRC | 08:48 | |
| shardy | jistr: strange, possibly a question for #rdo? | 08:48 |
| apevec | mandre, re. https://review.openstack.org/446511 - I can ninja merge https://review.rdoproject.org/r/6029 if you can be on standy to approve the former | 08:48 |
| shardy | jistr: FWIW I deployed master with quickstart, then build ocata overcloud-full images, which worked OK | 08:48 |
| apevec | just one Q: what is the justification for the backport? | 08:49 |
| yolanda | mm, shardy, i see dib is capped to 1.18.2 tag in global-requirements for newton | 08:49 |
| yolanda | but looks as the job is not picking it | 08:50 |
| apevec | Or any other OOO core ^ | 08:50 |
| yolanda | so it may be a matter of applying the upper constraints there | 08:50 |
| shardy | yolanda: aha | 08:50 |
| yolanda | i can send a fix | 08:50 |
| *** fzdarsky has quit IRC | 08:51 | |
| shardy | apevec: I can approve it, not passed some voting check jobs but I assume it'll go into the gate queue anyway | 08:51 |
| shardy | apevec: hey you may know, there's no ocata images at http://buildlogs-seed.centos.org/centos/7/cloud/x86_64/tripleo_images/ | 08:52 |
| shardy | any idea why those are missing? | 08:52 |
| *** salmankhan has joined #tripleo | 08:52 | |
| apevec | that's question for oooq folks, but I think they requested sync mapping long time ago | 08:53 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: add caching the GetParametersAction https://review.openstack.org/444220 | 08:53 |
| apevec | must be stuck in bugs.centos.org and needs some active pinging on centos-devel | 08:53 |
| shardy | apevec: Ok will follow up with oooq folks, thanks | 08:54 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Custom containerized undercloud deployments https://review.openstack.org/450792 | 08:54 |
| apevec | shardy, https://bugs.centos.org/view.php?id=12829 | 08:57 |
| mandre | apevec: not sure why the backport, could be because of a bug similar to https://bugs.launchpad.net/tripleo/+bug/1677062 that was not reported | 08:57 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 08:57 |
| bogdando | shardy, bnemec: so it's clear now for dlrn dev repos, thanks for assisting! I abandoned my patch to triple-repos for now to be resumed later perhaps, once rdo folks shifted the promotion pipeline for the current-tripleo vs current vs current-passed-ci... | 08:58 |
| apevec | mandre, oh so it is workaround for the REVIEW_RELEASE issue ?! | 08:58 |
| apevec | amoralej, ^ | 08:58 |
| shardy | apevec: thanks, will follow up with rlandy for an update | 08:58 |
| apevec | mandre, that should be fixed soon by amoralej, he found that shardy broke it :) | 08:59 |
| *** leanderthal|afk is now known as leanderthal | 08:59 | |
| shardy | apevec: I broke what?! | 08:59 |
| amoralej | apevec, i'm going to revert shardy's patch and then look for a better fix for local runs | 08:59 |
| amoralej | shardy https://review.openstack.org/#/c/443216/ | 08:59 |
| bogdando | one thing I got from the conversation tho it's better off using the tripleo-current here ! https://github.com/dprince/undercloud_containers/blob/master/doit.sh#L22 | 08:59 |
| mandre | apevec: aha! it was all shardy's fault :) | 08:59 |
| apevec | shardy, hehe that was to get your attention ;) | 08:59 |
| bogdando | in order to get more stable dev envs | 08:59 |
| amoralej | :) | 08:59 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: add caching the GetParametersAction https://review.openstack.org/444220 | 09:00 |
| shardy | Ugh, that was supposed to be a simple fix | 09:00 |
| amoralej | the entire purpose of REVIEW_RELEASE was to never mixed it with STABLE_RELEASE :) | 09:00 |
| shardy | apevec, amoralej: FWIW tripleo.sh is a developer tool, it's not acceptable to break CLI usage of it IMHO | 09:00 |
| shardy | hence my fix | 09:00 |
| apevec | yeah, so amoralej maybe fix first then revert | 09:01 |
| *** pgadiya has quit IRC | 09:01 | |
| amoralej | shardy, when using standalone you must just set REVIEW_RELEASE first | 09:01 |
| bogdando | btw, here is the containerized undercloud dev envs guide I'm testing right now, PTAL https://review.openstack.org/#/c/450792/2/roles/undercloud-deploy/README.md | 09:01 |
| shardy | yeah I would prefer that if possible, since many of us still use --delorean-build every day | 09:01 |
| shardy | amoralej: why should I do that? | 09:01 |
| amoralej | as probably you set STABLE_RELEASE | 09:01 |
| shardy | amoralej: for building trunk packages that has never been required | 09:01 |
| amoralej | because you can't infere REVIEW_RELEASE from STABLE_RELEASE | 09:02 |
| amoralej | shardy, initial patch was fixing something | 09:02 |
| shardy | amoralej: IIRC I didn't set STABLE_RELEASE | 09:02 |
| shardy | but I can re-test to be sure | 09:02 |
| bogdando | note, it works only within the scope of the suggested patch | 09:02 |
| *** dsariel has joined #tripleo | 09:02 | |
| shardy | I guess we'll have to start using quickstart for this soon anyway | 09:03 |
| garyk | EmilienM: after a lot of blood sweat and tears I am able to boot and overcloud controller and compute. praise the lord!!! | 09:03 |
| mandre | apevec: let's wait for trown|outtypewww's feedback on https://review.openstack.org/#/c/446511/ to see if it was supposed to be a workarounf for issue seen in https://bugs.launchpad.net/tripleo/+bug/1677062 | 09:04 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 09:04 |
| *** limao has quit IRC | 09:04 | |
| shardy | https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L422 | 09:04 |
| shardy | amoralej: can we just set it to an empty string and make that -z ? | 09:05 |
| *** karimb has quit IRC | 09:05 | |
| *** limao has joined #tripleo | 09:05 | |
| amoralej | shardy, i was thinking in setting REVIEW_RELEASE to "" by default | 09:05 |
| amoralej | i think that'd be enough | 09:05 |
| shardy | amoralej: cool, yeah that's fine, thanks :) | 09:05 |
| amoralej | shardy, i didn't realize of the "set -eu" | 09:06 |
| shardy | yeah that's the problem | 09:06 |
| *** pgadiya has joined #tripleo | 09:08 | |
| *** ccamacho has joined #tripleo | 09:08 | |
| *** hewbrocca_afk is now known as hewbrocca | 09:09 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Check deployed-server-environment rendering. DO NOT REVIEW https://review.openstack.org/451263 | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 09:10 |
| *** jaganathan has joined #tripleo | 09:10 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 09:11 |
| openstackgerrit | yolanda.robla proposed openstack/python-tripleoclient stable/newton: Support whole disk images in TripleO https://review.openstack.org/450651 | 09:11 |
| sshnaidm | shardy, yes, nothing changed with promotion | 09:11 |
| *** fzdarsky has joined #tripleo | 09:15 | |
| *** pmannidi has quit IRC | 09:16 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 09:18 |
| *** gkadam_ has quit IRC | 09:20 | |
| *** derekh has joined #tripleo | 09:20 | |
| *** jaganathan has quit IRC | 09:23 | |
| *** zoli is now known as zoli|lunch | 09:24 | |
| openstackgerrit | mathieu bultel proposed openstack/puppet-tripleo master: Active Ntp if timedatectl is installed https://review.openstack.org/451233 | 09:25 |
| jistr | shardy: fwiw re ocata images, using `--release tripleo-ci/ocata` works fine | 09:25 |
| jistr | at least wrt image download | 09:26 |
| * jistr doesn't want to jinx it | 09:26 | |
| *** yamahata has quit IRC | 09:27 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 09:27 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 09:28 |
| *** gkadam_ has joined #tripleo | 09:31 | |
| garyk | EmilienM: When I deploy a template I get CREATE_FAILED - which log can I look at for some extra hints on what has gone wrong? | 09:32 |
| ccamacho | Hey shardy Emilien, this got merged https://review.openstack.org/#/c/442170/ | 09:34 |
| ccamacho | and now jobs are failing with http://logs.openstack.org/70/442170/3/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/c86c4cb/console.html#_2017-03-28_01_00_23_562788 | 09:34 |
| ccamacho | so should we revert it of fix it with https://review.openstack.org/#/c/451263/ ?? | 09:34 |
| *** gkadam_ is now known as gkadam | 09:35 | |
| ccamacho | garyk, CI or local change? | 09:35 |
| ccamacho | garyk, http://tripleo.org/troubleshooting/troubleshooting-overcloud.html | 09:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Only set EnableConfigPurge on major upgrades https://review.openstack.org/450900 | 09:39 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/451292 | 09:39 |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: DNM: give me more debug https://review.openstack.org/450800 | 09:40 |
| garyk | ccamacho: thanks. will lok | 09:40 |
| therve | d0ugal, Do you know a little bit about StackUpdateManager? I'm trying to debug an issue, but somewhat stuck | 09:40 |
| ccamacho | garyk also http://hardysteven.blogspot.com.es/2015/04/debugging-tripleo-heat-templates.html | 09:41 |
| *** flepied has quit IRC | 09:41 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/451295 | 09:42 |
| chem | dsneddon: hi, do you have a few minute to discuss how best we could implement a transition during upgrade for https://github.com/openstack/tripleo-heat-templates/commit/a3f03eb307797ac5eef1251b9252e642db326e07 ? | 09:43 |
| garyk | ccamacho: that was very help. this seems to be the root cause - Error: resources.ComputeAllNodesValidationDeployment.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 1 . Any idea where to look now? | 09:43 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 09:45 |
| ccamacho | garyk run heat resource-list --nested-depth 5 overcloud | grep FAILED | 09:45 |
| ccamacho | find the id of the failed deployment and run | 09:45 |
| ccamacho | heat deployment-show <id> | 09:45 |
| ccamacho | it should display the stderr output | 09:45 |
| therve | ccamacho, "openstack stack failures list" is way nicer | 09:47 |
| ccamacho | aaa therve right there, but I have liberty box right now.. so there is no "openstack stack failures list" for me yet :P | 09:49 |
| ccamacho | therve, btw good morning man :) | 09:49 |
| ccamacho | mind to check this? | 09:49 |
| ccamacho | (11:34:58 AM) ccamacho: Hey shardy Emilien, this got merged https://review.openstack.org/#/c/442170/ | 09:49 |
| ccamacho | (11:34:58 AM) ccamacho: and now jobs are failing with http://logs.openstack.org/70/442170/3/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/c86c4cb/console.html#_2017-03-28_01_00_23_562788 | 09:49 |
| ccamacho | (11:34:58 AM) ccamacho: so should we revert it of fix it with https://review.openstack.org/#/c/451263/ ?? | 09:49 |
| ccamacho | simple fix but not sure what to do, propose a revert or fix it as it is.. | 09:49 |
| *** tosky has joined #tripleo | 09:49 | |
| garyk | ccamacho: http://paste.openstack.org/show/604631/ | 09:50 |
| shardy | ccamacho: Hmm, looking - that path should be rewritten in tripleoclient so something is wrong | 09:51 |
| therve | ccamacho, I think there is a trick for those j2 files | 09:51 |
| shardy | ccamacho: slagle had a fix for this, but perhaps it's not been backported to ocata, sec | 09:52 |
| garyk | ccamacho: thanks! 172.16.0.18 is not pingable. Local Network: 172.16.0.0/24 | 09:52 |
| shardy | ccamacho: we should check the CI job had https://review.openstack.org/#/q/Ib681729cc2728ca4b0486c14166b6b702edfcaab,n,z | 09:53 |
| ccamacho | shardy the patch in master failed but the job it was not voting and got merged https://review.openstack.org/#/c/442170/ | 09:53 |
| ccamacho | shardy this is the error on master http://logs.openstack.org/70/442170/3/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/c86c4cb/console.html#_2017-03-28_01_00_23_562788 | 09:54 |
| ccamacho | but we miss it and got merged | 09:54 |
| shardy | ccamacho: Yeah, I think we're using the master deployed-server-environment when deploying the ocata overcloud for the upgrade | 09:55 |
| therve | How many bugs are we going to get on that code path :/ | 09:55 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 09:55 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images https://review.openstack.org/448528 | 09:56 |
| shardy | therve: Yeah, I think we need to add a CI test that includes all the exiting corner-cases around environments, particularly since I've ended up nearly rewriting that code to fix bug #1635409 | 09:56 |
| openstack | bug 1635409 in tripleo "parameter_merge_strategies: merge behaves like overwrite" [High,In progress] https://launchpad.net/bugs/1635409 - Assigned to Steven Hardy (shardy) | 09:56 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Check deployed-server-environment rendering. https://review.openstack.org/451263 | 09:57 |
| ccamacho | shardy Ill check the job status on ^ | 09:57 |
| *** karimb has joined #tripleo | 09:59 | |
| shardy | ccamacho: that's using 1f46bd5 for tripleoclient, which should include the fix so perhaps we revert then work out the problem | 09:59 |
| ccamacho | shardy agreed, I wasnt sure what to do. | 10:00 |
| shardy | ccamacho: I was hoping it was just missing the tripleoclient fix, but it seems that's not the case | 10:00 |
| ccamacho | shardy, yeahp | 10:01 |
| shardy | ccamacho: can you please raise a bug, then we'll have to figure it out via local testing | 10:01 |
| ccamacho | shardy sure thing | 10:01 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Revert "Nic config mappings for deployed-server" https://review.openstack.org/451305 | 10:01 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order https://review.openstack.org/448602 | 10:02 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Drop scapy dependency https://review.openstack.org/430681 | 10:04 |
| *** akrivoka has joined #tripleo | 10:05 | |
| ccamacho | shardy fyi https://bugs.launchpad.net/tripleo/+bug/1677186 | 10:06 |
| openstack | Launchpad bug 1677186 in tripleo "Cant find deployed-server-environment.yaml" [Critical,Confirmed] | 10:06 |
| *** karimb has quit IRC | 10:07 | |
| shardy | ccamacho: ack, let me try to reproduce, I'm not sure why we don't catch the error then look in the /tmp path | 10:07 |
| shardy | it'd be helpful if we ran tripleoclient with --debug and saved the logs somewhere | 10:08 |
| *** flepied has joined #tripleo | 10:09 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add special case upgrade from openvswitch 2.5.0-14 https://review.openstack.org/450607 | 10:10 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 10:10 |
| bogdando | mwhahaha: that topic for logs collection is just gold. I'd like to join you on that effort | 10:10 |
| bogdando | but first I have to find the way out of the paper bag with my localhost dev envs experience ) | 10:11 |
| *** suuuper has quit IRC | 10:11 | |
| *** florianf has quit IRC | 10:13 | |
| *** florianf has joined #tripleo | 10:14 | |
| *** limao has quit IRC | 10:15 | |
| *** limao has joined #tripleo | 10:16 | |
| *** karimb has joined #tripleo | 10:16 | |
| *** udesale__ has quit IRC | 10:17 | |
| *** limao has quit IRC | 10:20 | |
| *** thrash|g0ne is now known as thrash | 10:22 | |
| *** suuuper has joined #tripleo | 10:24 | |
| *** adarazs is now known as adarazs_lunch | 10:26 | |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: SSHD Service extensions https://review.openstack.org/443113 | 10:28 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: SSHD Service extensions https://review.openstack.org/444622 | 10:29 |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: SSHD Service extensions https://review.openstack.org/443113 | 10:33 |
| jaosorior | mandre: now that the mod_ssl changes merged in kolla, and that we're bind mounting the whole /etc/httpd directory in keystone. Do we have already available the images for usage in TripleO? | 10:37 |
| marios | chem: see https://review.openstack.org/#/c/434346/12 | 10:38 |
| marios | chem: minor nit needs "" | 10:39 |
| *** fzdarsky has quit IRC | 10:39 | |
| chem | marios: ha, crap thanks | 10:41 |
| *** ratailor has quit IRC | 10:42 | |
| chem | marios: I'm going to remove this ":" altogether, I kinda remember having the issue even with quote | 10:42 |
| marios | chem: no i checked (I had similar issue)and we are already using it with quotes fyi, e.g. ./puppet/services/ceilometer-agent-notification.yaml:58: - name: "PreUpgrade step0,validation: Check service openstack-ceilometer-notification is running" | 10:43 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 10:43 |
| chem | marios: ack, oki will add quote then. Thanks | 10:44 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 10:45 |
| *** morazi has quit IRC | 10:46 | |
| *** milan has joined #tripleo | 10:47 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/ocata: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/451231 | 10:48 |
| *** karimb has quit IRC | 10:52 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Owl says: DO NOT MERGE! https://review.openstack.org/451330 | 10:55 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Ensure directory exists for certificates for httpd https://review.openstack.org/449536 | 10:59 |
| garyk | ccamacho: EmilienM: question - if i blow away the heat stack for over cloud can i run a new one or do i need to deploy the baremetal appliances again? | 11:00 |
| *** zoli|lunch is now known as zoli | 11:02 | |
| *** jkilpatr has joined #tripleo | 11:02 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change the directory for httpd certs/keys to be service-specific https://review.openstack.org/449558 | 11:04 |
| *** pkovar has quit IRC | 11:04 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Bind mount directories that contain the key/certs for keystone https://review.openstack.org/449569 | 11:06 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Fix stackviz data generation https://review.openstack.org/451335 | 11:06 |
| *** jkilpatr has quit IRC | 11:07 | |
| *** jkilpatr has joined #tripleo | 11:07 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 11:10 |
| amoralej | shardy, https://review.openstack.org/#/c/451265/ if you have a chance | 11:11 |
| akrivoka | the last of the plan import/export patches needs a final +A, if any of the tripleo cores are feeling generous: https://review.openstack.org/#/c/425858/ | 11:11 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool https://review.openstack.org/423340 | 11:15 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations stable/ocata: [trivial] Remove broken link https://review.openstack.org/451336 | 11:16 |
| *** bkopilov has quit IRC | 11:21 | |
| *** nenad has joined #tripleo | 11:24 | |
| EmilienM | sshnaidm: promotion is failing because consistent repo is out to date from one commit in instack-undercloud | 11:24 |
| EmilienM | amoralej: ^ fyi | 11:25 |
| *** karimb has joined #tripleo | 11:25 | |
| amoralej | EmilienM, we know it, we are workint to get it updated | 11:25 |
| amoralej | it should be soon | 11:25 |
| shardy | Is it expected that quickstart VMs get undefined on reboot of the host? | 11:26 |
| EmilienM | amoralej: ok thanks | 11:27 |
| EmilienM | amoralej: thanks for https://review.openstack.org/#/c/451265/ | 11:28 |
| EmilienM | amoralej: how can I help? Can I review something on this front? | 11:28 |
| garyk | is there a example of a very simple heat template where i can just create controllers? all i need to do is get the neutron service up and running | 11:29 |
| amoralej | EmilienM, we've disabled unit tests in nova in https://review.rdoproject.org/r/#/c/6062/ | 11:29 |
| garyk | EmilienM: ^ | 11:29 |
| shardy | garyk: yes you can deploy overcloud stacks without redefining any nodes | 11:30 |
| amoralej | and run head-only for it, so dlrn is catching up now | 11:30 |
| shardy | garyk: and yes you can do an all-in-one deployment of just a controller with Neutron services, see: | 11:30 |
| shardy | https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/composable_services.html | 11:31 |
| EmilienM | amoralej: wow 45 min :/ | 11:31 |
| amoralej | yeah... :( | 11:31 |
| EmilienM | amoralej: thanks for the heads-up and all the fixes :-) | 11:31 |
| shardy | garyk: check the roles_data.yaml in tripleo-heat-templates and copy the services you need into the list | 11:31 |
| EmilienM | amoralej: I'll follow https://trunk.rdoproject.org/centos7-master/report.html here then | 11:31 |
| shardy | garyk: the parameter_defaults you need here is just ControllerServices | 11:32 |
| *** karimb has quit IRC | 11:32 | |
| shardy | e.g not CustomControllerServices | 11:32 |
| garyk | shardy: thanks! | 11:32 |
| shardy | garyk: note we don't currently have dependencies between services, so you need to figure out the dependencies for the service in question e.g rabbit/DB etc | 11:32 |
| amoralej | EmilienM, i'm eager to get a new promotion, and i'm afraid https://bugs.launchpad.net/tripleo/+bug/1675384 will be a problem for RDO-CI promotion after upstream promotes new hash | 11:33 |
| openstack | Launchpad bug 1675384 in tripleo "Jobs failing in oooq when running "openstack baremetal configure boot"" [High,In progress] - Assigned to Alfredo Moralejo (amoralej) | 11:33 |
| shardy | and update the list accordingly | 11:33 |
| garyk | shardy: ok, thanks. i am just trying to get a very basic setup up and running. | 11:33 |
| shardy | garyk: ack, also see http://hardysteven.blogspot.co.uk/2016/08/tripleo-composable-services-101.html | 11:34 |
| shardy | I'd suggest getting the keystone-only example there working as a first step | 11:34 |
| rnoriega | EmilienM, thanks for your review here: https://review.openstack.org/#/c/444528/ | 11:34 |
| shardy | garyk: then add the neutron pieces you want | 11:34 |
| rnoriega | jaosorior, could you take a look at this? https://review.openstack.org/#/c/444528/ | 11:34 |
| shardy | garyk: you can just run overcloud deploy without any delete in most cases, it'll add the services to the existing deployment | 11:34 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Containerize etcd service https://review.openstack.org/447627 | 11:35 |
| *** lmiccini has quit IRC | 11:35 | |
| rnoriega | garyk, do you need baremetal? | 11:36 |
| *** morazi has joined #tripleo | 11:36 | |
| *** karimb has joined #tripleo | 11:37 | |
| *** abishop has joined #tripleo | 11:38 | |
| garyk | rnoriega: i am using virtual machines at the moment | 11:38 |
| mandre | jaosorior: we don't have container images with mod_ssl yet, cause if we rebuilt them now we'll see issues with the services where we don't bind mount the /etc/httpd directory yet | 11:38 |
| rnoriega | garyk, good! so you can use TripleO quickstart to start an environment really quick | 11:38 |
| garyk | i am using the fake_pxe and restarting vms when necessary | 11:38 |
| rnoriega | garyk, ah ok! so you've already got the "infrastructure" | 11:39 |
| rnoriega | garyk, nice, ping me if you need any help with your deployment | 11:39 |
| garyk | yeah, been battling for a week to to get something up and running. now its to get the controller and compute up and running | 11:39 |
| *** bfournie has quit IRC | 11:39 | |
| rnoriega | garyk, just FYI and future deployments: https://www.rdoproject.org/tripleo/ | 11:39 |
| *** maeca1 has joined #tripleo | 11:40 | |
| garyk | earlier run the heat stack failed as it was unable to ping a IP onthe neutron network. So I am trying to have the bare minimum template (which is challenging for someone who is not familiar with hit) | 11:40 |
| *** maeca1 has quit IRC | 11:40 | |
| mandre | jaosorior: and building only the keystone image will generate new base layers, which increase download time during CI, and fills up disk space on the deployed node | 11:40 |
| rnoriega | garyk, it's very easy, just download the repo, and execute | 11:40 |
| mandre | I'd like to avoid it if possible | 11:40 |
| rnoriega | garyk, I get that | 11:40 |
| garyk | rnoriega: thanks | 11:40 |
| rnoriega | garyk, no prob! | 11:41 |
| rnoriega | garyk, I might ping you if I have some troubles with l2gw stuff! :P :P | 11:42 |
| rnoriega | garyk, pliu and I are doing the TripleO integration of the project...if you are interesting on reviewing patches | 11:42 |
| *** karimb has quit IRC | 11:43 | |
| garyk | rnoriega: sure, will be happy to take a look | 11:43 |
| EmilienM | amoralej: because upstream doesn't use oooq ovb? | 11:43 |
| *** karimb has joined #tripleo | 11:44 | |
| jaosorior | mandre: so, for all httpd-based services we need to then start bind-mounting that? | 11:46 |
| mandre | jaosorior: exactly, I'll submit patches | 11:47 |
| *** gkadam is now known as gkadam-afk | 11:47 | |
| mandre | jaosorior: do you have the list of services we run over http? | 11:47 |
| amoralej | EmilienM, apparently that issue is only hit in oooq because of the way that nodes registration is done | 11:47 |
| jaosorior | mandre: not really | 11:49 |
| *** dixiaoli_ has quit IRC | 11:49 | |
| *** dixiaoli has joined #tripleo | 11:50 | |
| *** lmiccini has joined #tripleo | 11:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Fix reno for rabbitmq-user-check https://review.openstack.org/451352 | 11:51 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Get keystone session from keystoneauth and not python-keystoneclient https://review.openstack.org/451353 | 11:51 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Switch stackrc and undercloud.py to use Keystone v3 https://review.openstack.org/446752 | 11:52 |
| rnoriega | EmilienM, when integrating a Neutron service plugin + agent... do we have to create different release notes for each one?? or in the same release note two different features? | 11:53 |
| EmilienM | rnoriega: same reno is ok | 11:54 |
| *** rhallisey has joined #tripleo | 11:54 | |
| rnoriega | EmilienM, ok, thanks | 11:54 |
| *** dixiaoli has quit IRC | 11:54 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Fix reno for rabbitmq-user-check https://review.openstack.org/451352 | 11:55 |
| *** amoralej is now known as amoralej|lunch | 11:56 | |
| *** athomas has quit IRC | 11:57 | |
| slagle | ccamacho: is there a bug for this? https://review.openstack.org/#/c/451305/ | 11:57 |
| *** adarazs_lunch is now known as adarazs | 11:58 | |
| ccamacho | hey slagle, morning this one https://bugs.launchpad.net/tripleo/+bug/1677186 | 11:59 |
| openstack | Launchpad bug 1677186 in tripleo "Cant find deployed-server-environment.yaml" [Critical,Confirmed] | 11:59 |
| *** dmacpher has joined #tripleo | 11:59 | |
| *** karimb has quit IRC | 11:59 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Use stable release templates for all environments https://review.openstack.org/451361 | 12:00 |
| slagle | ccamacho: that may fix it ^ | 12:00 |
| slagle | ccamacho: shardy : assuming we fix this, do we expect the job to be passing? | 12:01 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Support multiple messages from delete_node https://review.openstack.org/446438 | 12:01 |
| *** athomas has joined #tripleo | 12:05 | |
| *** chlong has quit IRC | 12:05 | |
| ccamacho | slagle I have seen timeout and no valid hosts errors in other patches, I think at least the template error should be fixed, then we can check its current status. | 12:06 |
| *** karimb has joined #tripleo | 12:07 | |
| pradk | can i get reviews on https://review.openstack.org/#/c/450746/ and https://review.openstack.org/#/c/450798/ .. please | 12:08 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 12:10 |
| *** jayg|g0n3 is now known as jayg | 12:10 | |
| jaosorior | pradk: any idea why the containers job failed on those patches? | 12:11 |
| pradk | jaosorior, i grepped around, dint see anything related to the patch, we canrecheck and see | 12:12 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Remove kolla_config copy from aodh services https://review.openstack.org/451366 | 12:12 |
| EmilienM | mandre: like I asked to Slower last week, and we agreed with dprince ^ can you do them all in one single patch please? So we review it quickly and save CI resources | 12:13 |
| jaosorior | pradk: no biggie; I rechecked them. hopefully it was just a transcient error | 12:14 |
| *** gkadam-afk is now known as gkadam | 12:14 | |
| EmilienM | all the patches for removing kolla_config thing, we don't want 20 patches for it please | 12:14 |
| mandre | EmilienM: sure | 12:14 |
| EmilienM | thanks. | 12:14 |
| EmilienM | mandre: please stash them all, even the ones from Slower | 12:14 |
| EmilienM | I asked it in Friday but not sure it has been done yet. | 12:14 |
| mandre | EmilienM: yep, will do | 12:15 |
| EmilienM | thx | 12:15 |
| *** limao has joined #tripleo | 12:17 | |
| *** bfournie has joined #tripleo | 12:18 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order https://review.openstack.org/448602 | 12:19 |
| *** jprovazn has quit IRC | 12:19 | |
| *** limao_ has joined #tripleo | 12:20 | |
| *** dbecker has joined #tripleo | 12:21 | |
| *** akrivoka has quit IRC | 12:21 | |
| *** limao has quit IRC | 12:22 | |
| *** akrivoka has joined #tripleo | 12:24 | |
| *** udesale has joined #tripleo | 12:25 | |
| *** dprince has joined #tripleo | 12:26 | |
| *** janki has joined #tripleo | 12:27 | |
| *** liverpooler has joined #tripleo | 12:30 | |
| *** trown|outtypewww is now known as trown | 12:30 | |
| *** fultonj has joined #tripleo | 12:36 | |
| *** limao_ has quit IRC | 12:39 | |
| garyk | something is fishy - i am able to ssh into the compute node. but not into the controller. i can ping the controller. | 12:39 |
| *** limao has joined #tripleo | 12:39 | |
| garyk | i assume that there is no user/password that i can use to access via console. if i am mistaken please let me know | 12:40 |
| chem | marios: for https://review.openstack.org/448602 did you mean to set code review -1 on patch 6 ? | 12:40 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images https://review.openstack.org/448528 | 12:40 |
| *** liverpooler has quit IRC | 12:40 | |
| *** jpena is now known as jpena|lunch | 12:40 | |
| *** liverpooler has joined #tripleo | 12:40 | |
| *** liverpooler has quit IRC | 12:40 | |
| shardy | garyk: not by default, you can set a "backdoor" root or password via virt-customize though | 12:43 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Download overcloud_release rpm for mixed upgrade https://review.openstack.org/449349 | 12:43 |
| garyk | shardy: ok, thanks! | 12:44 |
| chem | marios: could you remove -1 https://review.openstack.org/#/c/450142/1, the patch landed on master. Thanks | 12:44 |
| *** liverpooler has joined #tripleo | 12:45 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 12:45 |
| *** jcoufal has joined #tripleo | 12:45 | |
| *** ansmith has joined #tripleo | 12:46 | |
| *** fultonj has quit IRC | 12:47 | |
| marios | chem: looking (just updated the ovs ansible minor nit) | 12:47 |
| *** pgadiya has quit IRC | 12:47 | |
| *** rlandy has joined #tripleo | 12:47 | |
| *** fultonj has joined #tripleo | 12:48 | |
| weshay | trown, not sure why this didn't work https://review.openstack.org/#/c/447653/ | 12:50 |
| trown | weshay: you changed the name of the file you are adding :P | 12:52 |
| trown | but not the cp command | 12:52 |
| weshay | heh.. late | 12:52 |
| trown | ya | 12:52 |
| *** gkadam has quit IRC | 12:53 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 12:54 |
| *** tzumainn has joined #tripleo | 12:56 | |
| *** mdnadeem has quit IRC | 12:56 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Add logging agents deployment to CI https://review.openstack.org/410210 | 12:57 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Add monitoring agents deployment to CI https://review.openstack.org/433931 | 12:57 |
| weshay | sshnaidm, make sure you add vxlan_networking to the config in the doc section in tripleo for https://review.openstack.org/#/c/446934/43/roles/undercloud-setup/templates/vxlan_networking.sh.j2 | 12:57 |
| weshay | bkero, ^ | 12:57 |
| * trown is really not sure that needs user docs | 12:58 | |
| *** panda is now known as panda|afk | 12:59 | |
| *** bkopilov has joined #tripleo | 12:59 | |
| *** limao has quit IRC | 13:00 | |
| *** psahoo has quit IRC | 13:01 | |
| *** limao has joined #tripleo | 13:01 | |
| weshay | adarazs, panda|afk, sshnaidm may I please have a review on https://review.openstack.org/#/c/442764/ | 13:02 |
| sshnaidm | weshay, looking | 13:02 |
| *** lucas-event is now known as lucasagomes | 13:03 | |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Adds service for managing securetty https://review.openstack.org/449148 | 13:03 |
| *** trown is now known as trown|brb | 13:04 | |
| weshay | rlandy, are the quotas in rdocloud such that we can crank up the concurrency? | 13:06 |
| rlandy | weshay: yes - just responded to the quotas ticket | 13:06 |
| weshay | rlandy, thanks | 13:07 |
| *** diana_clarke has left #tripleo | 13:08 | |
| shardy | rlandy: Hi! Do you have any update re https://bugs.centos.org/view.php?id=12829 ? | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 13:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 13:10 |
| shardy | rlandy: we were discussing it earlier, as the lack of quickstart images for ocata is causing some confusion | 13:10 |
| trozet | bnemec: do you mind reviewing this backport please? https://review.openstack.org/#/c/450003/ | 13:10 |
| *** jprovazn has joined #tripleo | 13:11 | |
| slagle | ccamacho: is the upgrades job on master patch going from ocata->master? | 13:11 |
| rlandy | shardy: no - I will ping our contact again. | 13:11 |
| *** karimb_ has joined #tripleo | 13:11 | |
| shardy | rlandy: sounds good, thanks! | 13:11 |
| dmsimard | sshnaidm, EmilienM: still need to merge https://review.openstack.org/#/c/448108/ | 13:11 |
| *** karimb has quit IRC | 13:12 | |
| *** pgadiya has joined #tripleo | 13:12 | |
| slagle | ccamacho: nm, i think it is. just seeing something weird locally i guess | 13:13 |
| *** pgadiya has quit IRC | 13:14 | |
| sshnaidm | dmsimard, can you please change directory path for ara report there? $LOCAL_WORKING_DIR/bin/ara generate html $LOGS_DIR/ara_oooq || true | 13:14 |
| trozet | slagle: maybe you could review the backport for me? https://review.openstack.org/#/c/450003/ | 13:14 |
| sshnaidm | dmsimard, because infra's ara report overwrite ours | 13:14 |
| dmsimard | sshnaidm: oh, good point | 13:15 |
| ccamacho | slagle, /me checking code because last time i checked its like you said, always from current-1 -> current | 13:15 |
| EmilienM | chem, marios: can someone explain me why we need this code in this file and not in neutron-ovs service? https://review.openstack.org/#/c/434346/14/puppet/services/tripleo-packages.yaml | 13:15 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html" https://review.openstack.org/448108 | 13:15 |
| EmilienM | dmsimard: why did you rebase it? | 13:15 |
| dmsimard | EmilienM: to remove the +W, see sshnaidm's comment above | 13:16 |
| slagle | ccamacho: yea, i think it does upgrade to master. just for some reason i saw it using newton->ocata in my local testing, so maybe my env is fubar'd | 13:16 |
| marios | EmilienM: well we need it to run before the yum update in the very least. so yeah we could move it and make it happen on step 1/2 | 13:16 |
| marios | EmilienM: but that sounds like progress from remove alltogether to move to new file | 13:16 |
| marios | EmilienM: ftr, we all agree, just that this is what we've been given for upgrade ovs 2.6 | 13:16 |
| * marios shrrugs | 13:16 | |
| EmilienM | marios: we shouldn't use tripleo-packages.yaml that way IMHO | 13:17 |
| EmilienM | it's not a file where we put workarounds imho | 13:17 |
| slagle | trozet: maybe i could :) | 13:17 |
| *** amoralej|lunch is now known as amoralej | 13:17 | |
| sshnaidm | dmsimard, I wonder if we should do this in collect-logs role in oooq. Or maybe already doing this..? | 13:17 |
| EmilienM | shardy: any thoughts? ^ | 13:17 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html", move report to ara_oooq https://review.openstack.org/448108 | 13:17 |
| marios | EmilienM: well we already have workarounds for nova for example right | 13:17 |
| marios | EmilienM: i mean granted, in the nova api manifest, but still | 13:17 |
| marios | EmilienM: so yeah we could move it to the openvswitch manifest | 13:17 |
| marios | EmilienM: and just make it run on step2 | 13:17 |
| EmilienM | marios: in nova profiles, no? | 13:17 |
| dmsimard | sshnaidm: I think ideally you'd have both devstack-gate and oooq report in the same window though | 13:17 |
| shardy | EmilienM: in general I agree, service specific tasks should go in the service template, e.g like the long list of things we had to do for nova | 13:17 |
| EmilienM | marios: that is what I asked. | 13:17 |
| EmilienM | I understand the workarounds, etc. Just put them in the right place, please. | 13:18 |
| marios | EmilienM: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L187-L266 | 13:18 |
| shardy | logically it doesn't matter, but I think folks will find stuff much easier if we put service specific hacks in the related service template | 13:18 |
| dmsimard | sshnaidm: okay, let me try something | 13:18 |
| EmilienM | shardy: yes, that. | 13:18 |
| EmilienM | marios: put it in https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-ovs-agent.yaml and other ovs profiles (dpdk?) and that's good. | 13:19 |
| *** links has quit IRC | 13:20 | |
| EmilienM | chem, marios: unless there is a good reason that I missed | 13:20 |
| slagle | ccamacho: yea it was something in my env fwiw. i was using the older toci_gate_test that still had newton hardcoded instead of the new toci_gate_test-orig.sh | 13:21 |
| *** limao has quit IRC | 13:22 | |
| *** limao has joined #tripleo | 13:22 | |
| *** toure|biab is now known as toure | 13:23 | |
| openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/451295 | 13:23 |
| *** pradk has quit IRC | 13:23 | |
| *** cdearborn has joined #tripleo | 13:23 | |
| *** fzdarsky has joined #tripleo | 13:24 | |
| chem | marios: I do the move to the suggested place by EmilienM | 13:25 |
| ccamacho | slagle, ack, Ill wait for your fix to pass Ill check the code in 30 mins :), and Ill abandon the other two. | 13:26 |
| EmilienM | chem: cool, thx, I'll review it again later so we can move forward on this one | 13:27 |
| marios | chem: ack thanks | 13:27 |
| marios | chem: remember needs to update step too (2 i guess) | 13:28 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support upgrades in multinode CI https://review.openstack.org/450784 | 13:29 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add deploy_multinode option to the featureset multinode config https://review.openstack.org/448278 | 13:30 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images https://review.openstack.org/448528 | 13:30 |
| rlandy | weshay: rdocloud jobs are starting now every thirty mins. 5 concurrent runs per job. | 13:31 |
| weshay | nice | 13:31 |
| *** salmankhan has quit IRC | 13:31 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html", move report to ara_oooq https://review.openstack.org/448108 | 13:32 |
| *** lblanchard has joined #tripleo | 13:32 | |
| chem | hum EmilienM, marios can we have neutron-ovs-agent.yaml, neutron-ovs-dpdk-agent.yaml, opendaylight-ovs.yaml independantly (with each requiring ovs) ? If you don't know, I will look into it further later | 13:32 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Refactor the toci-vxlan-networking script to be more correct https://review.openstack.org/446934 | 13:33 |
| *** jpich has joined #tripleo | 13:34 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Write user parameters environment to swift https://review.openstack.org/450264 | 13:34 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Write rhel registration parameters env to swift https://review.openstack.org/450708 | 13:34 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Write breakpoint cleanup env to swift https://review.openstack.org/450709 | 13:34 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Validate NtpServers during plan processing https://review.openstack.org/450263 | 13:34 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Add breakpoint cleanup env during plan processing https://review.openstack.org/450262 | 13:34 |
| *** trown|brb is now known as trown | 13:35 | |
| *** garyk has quit IRC | 13:36 | |
| slagle | shardy: ccamacho : https://review.openstack.org/#/c/451361/ got to starting the upgrade, but then that failed on some python-heat-agent packaging conflict | 13:36 |
| slagle | http://logs.openstack.org/61/451361/1/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/077b395/console.html#_2017-03-29_13_31_31_431432 | 13:36 |
| slagle | is that a known issue? | 13:36 |
| slagle | looks like it's trying to install an older python-heat-agent? | 13:37 |
| *** jcoufal has quit IRC | 13:37 | |
| EmilienM | chem: let me look | 13:37 |
| EmilienM | slagle: maybe https://review.openstack.org/#/c/451265/ ? | 13:38 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix to use correct config options for ssh user https://review.openstack.org/446289 | 13:38 |
| *** jaosorior has quit IRC | 13:38 | |
| slagle | EmilienM: maybe, what is REVIEW_RELEASE for? | 13:39 |
| EmilienM | chem: for dpdk I'm not sure, it includes ./neutron-ovs-agent.yaml | 13:39 |
| *** dmsimard is now known as dmsimard|afk | 13:39 | |
| ccamacho | slagle, right.. mm thats a new one, I saw same with the revert, checking it on the upgrades stand up right now. | 13:40 |
| EmilienM | slagle: the version of openstack without stable/ | 13:40 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-image-elements master: Add overcloud-secure element https://review.openstack.org/449122 | 13:40 |
| EmilienM | slagle: e.g. mitaka | 13:40 |
| *** chlong has joined #tripleo | 13:40 | |
| chem | EmilienM: I'm in a mtg right now. Will look harder in ~30/40min | 13:40 |
| shardy | EmilienM: doesn't that only cause problems with --delorean-build though? | 13:40 |
| shardy | this is just a patch to tripleo-ci | 13:40 |
| EmilienM | shardy: in the case of upgrading neutron-ovs-dpdk, will it run tasks from neutron-ovs-agent? | 13:41 |
| *** fzdarsky has quit IRC | 13:41 | |
| shardy | slagle: I'm not sure the heat-agents, there were problems because the repo moved which got fixed, then there were problems with many projects because of the way upstream tags releases after branching stable/foo | 13:41 |
| shardy | I'm not sure if either explains this tbh | 13:41 |
| slagle | shardy: ok, well i guess we can wait and see if the same error occurs on the revert | 13:42 |
| EmilienM | really easy fix (reno): https://review.openstack.org/#/c/451352/ | 13:42 |
| *** jaosorior has joined #tripleo | 13:43 | |
| *** limao has quit IRC | 13:43 | |
| shardy | EmilienM: No, because neutron-ovs-dpdk-agent.yaml doesn't expose any upgrade_tasks, it only instantiates a nested stack referencing the ../neutron-ovs-agent.yaml | 13:43 |
| shardy | EmilienM: which I guess is probably a bug | 13:43 |
| *** limao has joined #tripleo | 13:43 | |
| EmilienM | chem: ^ so you'll have to duplicate the tasks on the ovs services | 13:45 |
| *** jpena|lunch is now known as jpena | 13:45 | |
| EmilienM | can I have a review on tripleo-docs deployment guide please? Need approval: https://review.openstack.org/#/c/449684/ | 13:45 |
| chem | EmilienM: would some kind of inheritance be possible to avoid the repetition ? | 13:47 |
| *** jcoufal has joined #tripleo | 13:47 | |
| honza | jtomasek: let me know if you need/want help on the instackenv.json upload bug | 13:48 |
| shardy | chem: yes, we just need to reference upgrade_tasks in the same way we do config_settings | 13:48 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-ovs-dpdk-agent.yaml#L73 | 13:48 |
| shardy | chem: ^^ | 13:48 |
| jtomasek | honza: it would be great if you could investigate in that if you have time to do so | 13:48 |
| honza | jtomasek: I thought you said you were gonna try first? I'm happy to look into it today. | 13:49 |
| *** dciabrin has quit IRC | 13:49 | |
| chem | shardy: will look into that just after my meeting, thanks for the pointer | 13:49 |
| slagle | EmilienM: what is REVIEW_RELEASE used for though? anything other than dlrn build? | 13:49 |
| shardy | amoralej: ^^ | 13:49 |
| amoralej | slagle, not, review_release is only used in dlrn builds afaik | 13:50 |
| slagle | amoralej: ok, thanks | 13:50 |
| amoralej | slagle, i added it in https://review.openstack.org/#/c/441960/ | 13:51 |
| amoralej | you have the explanation in the commit message, let me know if you have any question | 13:51 |
| openstackgerrit | Merged openstack/tripleo-docs master: Basic structure of TripleO Deployment Guide https://review.openstack.org/449684 | 13:52 |
| jtomasek | I am realizing I need to leave shortly, so I can pick up wherever you end tomorrow | 13:52 |
| jtomasek | honza: ^ | 13:52 |
| honza | jtomasek: great :) | 13:54 |
| *** jrist has quit IRC | 13:55 | |
| *** jrist has joined #tripleo | 13:57 | |
| *** salmankhan has joined #tripleo | 13:58 | |
| *** Goneri has joined #tripleo | 13:58 | |
| weshay | rlandy, matbu not a big deal but I wonder if keeping the upgrade config in tqe/config would be easier | 14:00 |
| sshnaidm | mandre, hi | 14:00 |
| trozet | slagle: thanks | 14:00 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 14:00 |
| sshnaidm | mandre, I need your help, in your time | 14:00 |
| trozet | can someone please review: https://review.openstack.org/#/c/448831/ ? | 14:00 |
| sshnaidm | mandre, I try to run containers with network-isolation upstream and still fail | 14:01 |
| sshnaidm | jistr, ^ | 14:01 |
| *** janki has quit IRC | 14:02 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: WIP exclude tripleo-image-elements https://review.openstack.org/451416 | 14:02 |
| *** dciabrin has joined #tripleo | 14:02 | |
| sshnaidm | mandre, jistr I have a ready env with failed job there and can provide you credentials | 14:02 |
| mandre | sshnaidm: sorry I'm in the middle of a big refactoring, I'll ping you when I'm done | 14:03 |
| sshnaidm | mandre, sure, not urgent | 14:03 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-image-elements master: WIP test retiring repo https://review.openstack.org/450809 | 14:03 |
| *** eck` is now known as eck`gone | 14:03 | |
| *** eck`gone is now known as eck` | 14:03 | |
| *** limao has quit IRC | 14:04 | |
| *** limao has joined #tripleo | 14:05 | |
| slagle | shardy: ccamacho : the revert failed the same way as https://review.openstack.org/#/c/451361/ on the python-heat-agent packaging conflict | 14:07 |
| *** gbarros has joined #tripleo | 14:07 | |
| slagle | new bug i guess | 14:08 |
| ccamacho | slagle yeahp I already +A your fix, now the error is not related to the deployed-server-environment | 14:08 |
| *** dciabrin has quit IRC | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 14:10 |
| *** udesale has quit IRC | 14:11 | |
| jistr | sshnaidm, mandre: if there's still need to debug tomorrow, please ping me and i can join the effort. Today i have about 20 minutes left before 2 mtgs and EOD so i'd prefer not to fracture my attention right now. | 14:12 |
| sshnaidm | jistr, sure | 14:12 |
| * jistr actually deployed Ocata now and would like to try migration to pike/master containers to see what falls apart | 14:13 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-image-elements master: WIP remove unused elements https://review.openstack.org/450809 | 14:13 |
| sshnaidm | trown, do you know if image builder supports local repos like "baseurl=file:///opt/gating_repo"? Because it seems like some problem with it: http://logs.openstack.org/28/445228/7/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq-nv/57c94fb/logs/oooq/undercloud/home/jenkins/overcloud_image_build.log.txt.gz#_2017-03-29_06_35_27 | 14:13 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add option to pass a config file with full path to collect-logs.sh https://review.openstack.org/437711 | 14:13 |
| shardy | slagle: ack, Ok thanks, I guess we'll have to follow up in #rdo | 14:14 |
| shardy | slagle: we really need to get the upgrade job voting, and added to the periodic promotion :( | 14:15 |
| trown | sshnaidm: it just runs yum inside chroot with repos from outside chroot... so I dont see why it wouldnt work in theory... looking at your patches | 14:16 |
| *** yatinkarel has quit IRC | 14:17 | |
| sshnaidm | trown, chroot? so it won't work | 14:17 |
| trown | sshnaidm: ya DIB does everything via chroot | 14:17 |
| sshnaidm | trown, the repo is in original fs, not in chrooted | 14:17 |
| trown | sshnaidm: ya that is true of all our repos though | 14:17 |
| *** suuuper has quit IRC | 14:18 | |
| *** suuuper has joined #tripleo | 14:18 | |
| sshnaidm | trown, other repos are in internet | 14:18 |
| trown | sshnaidm: ah I see now... sorry a bit slow on that one | 14:19 |
| slagle | shardy: yea, agreed | 14:19 |
| slagle | shardy: otherwise people are lazy and just ignore it | 14:19 |
| slagle | of course I would *never* do that myself :) | 14:20 |
| trown | sshnaidm: how is tripleo.sh handling DLRN builds with image building then? | 14:20 |
| sshnaidm | trown, it ran python http server in repo directory | 14:20 |
| sshnaidm | trown, not I understand why.. | 14:20 |
| shardy | slagle: haha :) | 14:20 |
| trown | sshnaidm: ya DIB just copies the repo file into the chroot https://github.com/openstack/diskimage-builder/blob/958ea8a3372157fe62c3a2bb1fcd55a9cadedab1/diskimage_builder/elements/yum/extra-data.d/99-yum-repo-conf#L25 | 14:20 |
| sshnaidm | arrgh | 14:20 |
| EmilienM | slagle: have you seen this? http://logs.openstack.org/34/450734/1/check/gate-tripleo-ci-centos-7-multinode-upgrades/5223b5f/console.html#_2017-03-28_14_04_17_566576 | 14:21 |
| EmilienM | slagle: on https://review.openstack.org/#/c/450734 | 14:21 |
| shardy | EmilienM: yes slagle already posted a patch to fix it | 14:22 |
| EmilienM | I missed the train | 14:22 |
| shardy | https://bugs.launchpad.net/tripleo/+bug/1677186 | 14:22 |
| openstack | Launchpad bug 1677186 in tripleo "Cant find deployed-server-environment.yaml" [Critical,Confirmed] - Assigned to James Slagle (james-slagle) | 14:22 |
| EmilienM | thanks & sorry for noise | 14:22 |
| shardy | EmilienM: np :) | 14:22 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Upgrade to keystone v3 https://review.openstack.org/451431 | 14:23 |
| *** pradk has joined #tripleo | 14:24 | |
| *** limao has quit IRC | 14:25 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add blank newline at the end of file https://review.openstack.org/449028 | 14:25 |
| *** limao has joined #tripleo | 14:26 | |
| *** gbarros has quit IRC | 14:27 | |
| *** dciabrin has joined #tripleo | 14:27 | |
| *** abehl has quit IRC | 14:27 | |
| fultonj | anyone able to review https://review.openstack.org/#/c/442970 and https://review.openstack.org/#/c/448122 ? thanks | 14:29 |
| *** gbarros has joined #tripleo | 14:30 | |
| EmilienM | honza: nice work on https://review.openstack.org/#/c/451431/, thanks! | 14:31 |
| *** yatinkarel has joined #tripleo | 14:31 | |
| honza | +1 | 14:31 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Remove kolla_config copy from services https://review.openstack.org/451366 | 14:33 |
| fultonj | thanks shardy | 14:34 |
| shardy | fultonj: I was tempted to approve without waiting for the HA job but gfidente already rechecked so I guess lets wait for that to finish | 14:35 |
| bogdando | what is the way to install custom heat-agent hook? | 14:35 |
| fultonj | cool | 14:35 |
| bogdando | I do as pip install git+https://github.com/bogdando/heat-agents@bug/1668938 but it doesn't run install hook | 14:36 |
| shardy | bogdando: where does pip install to? | 14:36 |
| bogdando | shardy: undercloud dev env | 14:36 |
| shardy | bogdando: for testing I'd probably just virt-copy-in the hook to /usr/libexec/heat-config/hooks/foo | 14:36 |
| shardy | bogdando: ah, undercloud, I meant what path | 14:37 |
| bogdando | shardy: cirt-copy processes so long... | 14:37 |
| *** prateek__ has quit IRC | 14:37 | |
| shardy | bogdando: on the undercloud you can just copy the hook for testing, but you'll need a new package to test it in CI | 14:37 |
| bogdando | I'm, testing https://review.openstack.org/#/c/447623/. Copy in, would work, just wanted to ask if a better way | 14:38 |
| *** dsariel has quit IRC | 14:39 | |
| shardy | bogdando: the reason I asked about paths is AFAIK hardly anyone consumes heat-agents via pip, so I wondered if it's installing to the wrong place | 14:39 |
| shardy | mostly we consume that repo (well, all repos) via packages | 14:40 |
| *** apevec has left #tripleo | 14:40 | |
| shardy | bogdando: and you don't yet have the package I assume, unless you locally rebuilt the heat-agents with delorean adding your new subpackage | 14:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Sort ResourceGroup resource list https://review.openstack.org/450444 | 14:41 |
| shardy | bogdando: so yeah in that case I'd copy the file to test, or perhaps write a script that runs early in the deploy to copy it from gerrit | 14:41 |
| bogdando | shardy: if there is a CI job that triggers rebuilt on patches, I'd happily consume that | 14:41 |
| bogdando | shardy: yeah, that's the current WIP way to deploy undercloud and containers (and dev envs what I'm trying to add) | 14:42 |
| cschwede | Hi! I have another (short) fix that needs a review: https://review.openstack.org/#/c/444219/ | 14:42 |
| bogdando | shardy: https://review.openstack.org/#/c/419040/36/roles/undercloud-deploy/templates/undercloud-deploy.sh.j2 | 14:42 |
| bogdando | are there any magic dwarfs building packages for heat agents patches? | 14:44 |
| honza | EmilienM: is there anything we need to do in puppet-tripleo to make tripleo ui work with keystone v3? | 14:44 |
| bogdando | on review, not merged yet | 14:44 |
| shardy | bogdando: we build the packages for the tripleo-ci jobs but you'll need to land the heat-agents change first, then a packaging change similar to https://review.rdoproject.org/r/#/c/3235/ | 14:44 |
| bogdando | got it, thanks | 14:45 |
| adarazs | sshnaidm: I reviewed https://review.openstack.org/431567 | 14:45 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 14:45 |
| shardy | bogdando: IIRC bnemec had a location where delorean builds for under-review things was exposed, but I don't think it included the heat-agents repo | 14:45 |
| *** limao has quit IRC | 14:47 | |
| *** limao has joined #tripleo | 14:47 | |
| bnemec | No, it doesn't. | 14:47 |
| bnemec | It also appears to be rather unhappy right now. A lot of package builds are failing. :-/ | 14:48 |
| *** zoli is now known as zoli|mtg-afk | 14:49 | |
| *** gbarros has quit IRC | 14:49 | |
| bnemec | "Started 1 mo 9 days ago" That's a wee bit long for an RPM build... | 14:49 |
| weshay | need reviews on ci migration notes please https://review.openstack.org/#/c/450281/ | 14:50 |
| *** gbarros has joined #tripleo | 14:51 | |
| *** ealcaniz has quit IRC | 14:53 | |
| *** hewbrocca is now known as hewbrocca_afk | 14:54 | |
| bnemec | EmilienM: Can we merge https://review.openstack.org/#/c/450381/ so we are able to debug the ha and updates job timeouts? | 14:54 |
| EmilienM | bnemec: done, and thanks | 14:56 |
| *** rwsu has quit IRC | 14:56 | |
| bnemec | EmilienM: Thanks | 14:56 |
| *** cwolferh has quit IRC | 14:56 | |
| *** cwolferh has joined #tripleo | 14:57 | |
| *** leanderthal is now known as leanderthal|afk | 15:00 | |
| mandre | sshnaidm: I'm all yours | 15:00 |
| Ng | jpich: would you be able to look at https://review.openstack.org/#/c/446184 ? last of my current backport-of-something-you-+2'd :) | 15:00 |
| *** jistr is now known as jistr|mtg | 15:01 | |
| chem | shardy: EmilienM marios I let a big comment on the openvswitch upgrade review https://review.openstack.org/#/c/434346/14 . I kinda have a problem with opendaylight-ovs. If you have any input here, that's would be nice. All in all I think that boils down to having duplicate code or having it in tripleo-package. | 15:01 |
| sshnaidm | mandre, ssh -ttt centos@66.187.229.211 -A "ssh -ttt jenkins@192.168.101.14 'cd /opt/stack/new/tripleo-ci; bash'" | 15:02 |
| sshnaidm | mandre, I deployed containers job with single-nic net isolation | 15:02 |
| *** pblaho has quit IRC | 15:02 | |
| sshnaidm | mandre, although pingtest fails: /home/jenkins/overcloud_validate.log | 15:03 |
| sshnaidm | mandre, what do I miss..? | 15:03 |
| EmilienM | chem: ask trozet | 15:04 |
| trozet | chem: what's up? | 15:05 |
| trozet | chem: i filed a bugzilla to fix an issue when openvswitch is restarted, it automatically starts neutron OVS agent. Same issue? | 15:05 |
| *** rcernin has quit IRC | 15:05 | |
| shardy | chem: I'm a bit confused, if we can't have the common tasks in neutron-ovs-agent, how does having it in tripleo-packages help, when that's a common service to all roles, even if they have nothing at all to do with neutron? | 15:08 |
| *** limao has quit IRC | 15:08 | |
| *** limao has joined #tripleo | 15:09 | |
| jpich | Ng: Done, thank you for the backport | 15:09 |
| Ng | thanks! | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 15:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 15:10 |
| mandre | sshnaidm: when I deploy with net-iso, I'm also using net-single-nic-with-vlans, don't know if that's what you're missing | 15:11 |
| *** dmsimard|afk is now known as dmsimard | 15:11 | |
| sshnaidm | mandre, hmm.. you're right, seems like I missed it.. | 15:12 |
| shardy | chem: FWIW if we had to add a puppet/services/openvswitch.yaml which contained just upgrade_tasks I would be fine with that, and we wouldn't need to inherit anything, just make sure that "service" is enabled on roles where ovs is expected to be running | 15:12 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Enables increasing mariadb open files for noha deployments https://review.openstack.org/450003 | 15:12 |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/451292 | 15:12 |
| openstackgerrit | Merged openstack/instack-undercloud master: Create Heat API CFN endpoint https://review.openstack.org/448287 | 15:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add multinode deploy arg to the pre-deploy tasks https://review.openstack.org/448274 | 15:13 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix reno for rabbitmq-user-check https://review.openstack.org/451352 | 15:13 |
| mandre | sshnaidm: careful not to overwrite the properties defined in net-single-nic-with-vlans env with /opt/stack/new/tripleo-ci/test-environments/network-templates/network-environment.yaml | 15:14 |
| marios | ack thanks chem will check it | 15:16 |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud stable/ocata: Create Heat API CFN endpoint https://review.openstack.org/451453 | 15:16 |
| slagle | EmilienM: ^ | 15:16 |
| EmilienM | slagle: you fixed merged conflict :D | 15:17 |
| slagle | yes | 15:17 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:20 |
| *** pblaho has joined #tripleo | 15:20 | |
| *** aufi has quit IRC | 15:21 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:22 |
| *** yamahata has joined #tripleo | 15:22 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use stable release templates for all environments https://review.openstack.org/451361 | 15:23 |
| sshnaidm | weshay, panda|afk do we have featureset and ovb configs ready? | 15:23 |
| weshay | sshnaidm, there is one under review | 15:24 |
| weshay | sshnaidm, I guess I need to fix it up | 15:24 |
| weshay | sec | 15:24 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:24 |
| sshnaidm | weshay, I think we need to tag them as phase2 | 15:25 |
| weshay | k | 15:26 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:27 |
| *** limao has quit IRC | 15:29 | |
| *** limao has joined #tripleo | 15:30 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add featureset config for a containerised overcloud https://review.openstack.org/446151 | 15:31 |
| *** jlinkes has quit IRC | 15:31 | |
| weshay | sshnaidm, ^ | 15:31 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:32 |
| *** dparkes has quit IRC | 15:33 | |
| EmilienM | bnemec: can you paste your magic UI for zuul/ovb please? | 15:35 |
| EmilienM | bnemec: the link of the UI I mean | 15:35 |
| bnemec | EmilienM: http://zuul-status.nemebean.com/ ? | 15:35 |
| EmilienM | thx | 15:35 |
| EmilienM | bnemec: super useful again :D | 15:36 |
| EmilienM | bnemec: I wanted to check when 359215 would start and this UI is cool to see quickly, versus z.o.o | 15:36 |
| bnemec | EmilienM: I have a permanent tab dedicated to it. :-) | 15:36 |
| EmilienM | bnemec: would be nice to have it under ci status pages | 15:36 |
| EmilienM | bnemec: just a link maybe | 15:36 |
| EmilienM | bnemec: here tripleo.org | 15:37 |
| bnemec | Ah, been meaning to do that for a while. | 15:38 |
| *** panda|afk has left #tripleo | 15:38 | |
| bnemec | I keep forgetting to sit down and figure out exactly where it needs to go. | 15:38 |
| *** flepied has quit IRC | 15:38 | |
| EmilienM | bnemec: maybe we can ask dprince. Dan: where can we add a tab into tripleo.org website? | 15:39 |
| bnemec | I'm sure I can find it, I just haven't really looked. | 15:40 |
| dprince | https://github.com/dprince/tripleosphinx/blob/master/tripleosphinx/theme/tripleo/layout.html | 15:40 |
| dprince | EmilienM, bnemec: it is in that file I think | 15:40 |
| EmilienM | dprince: thanks! | 15:40 |
| *** mburned is now known as mburned_out | 15:41 | |
| *** mburned_out is now known as mburned | 15:41 | |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation https://review.openstack.org/448209 | 15:42 |
| EmilienM | bnemec: i'll send a pull request so you can remove it from your todo :) | 15:43 |
| EmilienM | bnemec, dprince: https://github.com/dprince/tripleosphinx/pull/3 | 15:46 |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo stable/newton: Fixes issues with raising mysql file limit https://review.openstack.org/451466 | 15:49 |
| bnemec | EmilienM: Cool, thanks | 15:49 |
| dprince | bnemec: could we perhaps host that report on tripleo.org instead? | 15:50 |
| *** iranzo has quit IRC | 15:50 | |
| dprince | where is it running | 15:50 |
| bnemec | dprince: It's a standalone web app, so it may not play well with the existing site. | 15:50 |
| bnemec | We could run it on a different port, I guess. | 15:50 |
| dprince | bnemec: I was simply thinking of adding the DNS entry | 15:50 |
| *** limao has quit IRC | 15:50 | |
| *** daveholland has joined #tripleo | 15:51 | |
| bnemec | dprince: Oh, yeah. It's hosted on rh1 now so that should be fine. | 15:51 |
| dprince | bnemec: this would be the 3rd location now. You wrote a standalone app. So did sshnaidm. | 15:51 |
| *** limao has joined #tripleo | 15:51 | |
| bnemec | It's at 66.187.229.179 | 15:51 |
| dprince | bnemec: its getting a bit distributed too. Which may become a maintenance problem at some point. But I get it. Sometimes static content is hard | 15:52 |
| dprince | bnemec: with the initial site I was very much careful to generate static content (which loads super fast) | 15:52 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Ignore libvirt start if running chrooted https://review.openstack.org/447000 | 15:53 |
| bnemec | Yeah, this came out of my frustration with the infra zuul status page and it's annoying auto-refresh. | 15:53 |
| sshnaidm | weshay, beside of containers config, do we have featuresets for ha, nonha, updates ovb jobs? | 15:53 |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Adds service for managing securetty https://review.openstack.org/449148 | 15:53 |
| EmilienM | dprince: you need to containerize the services :P | 15:53 |
| bnemec | But it doesn't really work as static content. | 15:54 |
| bnemec | Because stuff like the telnet links will get stale quickly. | 15:54 |
| daveholland | hi, not sure I'm in the right place to ask, but here goes. How can I find what "openstack overcloud update stack" does under the covers? I followed the code but got lost in tripleo_common/_stack_update.py. Is it like a node-by-node redeploy but with "yum update" thrown in? | 15:54 |
| dprince | EmilienM: just apache, yes. Its more about static vs dynamic content I think. | 15:54 |
| *** jlinkes has joined #tripleo | 15:55 | |
| *** pkovar has joined #tripleo | 15:55 | |
| shardy | daveholland: Hi, yeah that code could use some rework I think, but you're right it does a node by node update of the heat stack, and sets UpdateIdentifier so that yum_update.sh runs on each node | 15:55 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-heat-templates stable/ocata: Run cluster check on nodes configured in wsrep_cluster_address. https://review.openstack.org/451467 | 15:55 |
| weshay | sshnaidm, did you see the doc? | 15:56 |
| shardy | daveholland: it uses heat breakpoints to do the rolling update, which we can probably simplify in future as heat now supports rolling updates natively | 15:56 |
| sshnaidm | weshay, feature-configuration.rst? | 15:56 |
| weshay | ya | 15:56 |
| dprince | bnemec: I created an A record for zuul-status.tripleo.org. Once it hits the DNS servers it should be live. | 15:57 |
| weshay | sshnaidm, hrm.. that is missing pacemaker | 15:57 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-image-elements master: WIP remove unused elements https://review.openstack.org/450809 | 15:58 |
| *** tesseract has quit IRC | 15:58 | |
| *** fragatina has quit IRC | 16:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 16:00 |
| EmilienM | dprince: cool, do you want me to update the PR? | 16:00 |
| dprince | EmilienM: I got it ;) | 16:00 |
| EmilienM | oki | 16:00 |
| EmilienM | and fwiw, http://zuul-status.tripleo.org already works for me | 16:00 |
| daveholland | shardy: got it, thanks, do you happen to know if it reboots each node on the way? (e.g. to pick up libc security fixes) | 16:01 |
| dprince | EmilienM, bnemec: all pushed. Next site refresh should (in 10 minutes) should get this new link. | 16:01 |
| bnemec | dprince: Thanks | 16:01 |
| dprince | bnemec: thanks for the report | 16:01 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart master: Adding the mistral packages to tripleo-ci-master https://review.openstack.org/451468 | 16:02 |
| shardy | daveholland: No I don't think it does | 16:03 |
| shardy | daveholland: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/yum_update.sh#L136 | 16:03 |
| *** trown is now known as trown|lunch | 16:03 | |
| shardy | that's the script that gets run so you could in theory add a reboot (even with a parameter to make it a heat template option) | 16:04 |
| *** nenad has quit IRC | 16:04 | |
| shardy | daveholland: I seem to recall such a discussion previously and there may have been reasons why such an option was not added, I can't honestly remember | 16:04 |
| *** Goneri has quit IRC | 16:05 | |
| daveholland | OK. I'm trying to get "openstack overcloud update stack" working in a lab env and having problems, colleague suggests the "just yum update and reboot" which we could automate/serialise with Ansible, but I was trying to use the in-the-box method first :) | 16:05 |
| shardy | daveholland: that may not work as expected when pacemaker sees the reboot and fences the node ;) | 16:06 |
| daveholland | (the meta-problem is that when it goes wrong I have to wait hours for UPDATE_IN_PROGRESS to time out before I can try again) | 16:06 |
| daveholland | shardy: good point, better be a crm_standby in the mix too then ;) | 16:07 |
| *** maeca1 has joined #tripleo | 16:07 | |
| *** maeca1 has quit IRC | 16:07 | |
| shardy | daveholland: you can see there is some additional logic to handle pacemaker, so you'd need to do similar via ansible | 16:07 |
| shardy | also, we run the entire configuration phase after the yum update, e.g apply puppet etc, which may or may not be important depending on what gets updated | 16:07 |
| daveholland | ok that ensures config files are correct, got it | 16:08 |
| shardy | daveholland: if it's getting stuck for hours, I'd log onto each of the controllers and tail /var/log/messages to see where/why it gets stuck | 16:09 |
| shardy | daveholland: it's true the errors aren't that readily surfaced under those conditions right now, unfortunately | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 16:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 16:10 |
| *** limao has quit IRC | 16:12 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-docs master: Add openstackdocstheme dependency https://review.openstack.org/451474 | 16:12 |
| daveholland | in this particular case the yum update failed (ultimately due to a mistake with subscription-manager) and after the first node failed the overall update failed too, but it left some nodes UPDATE_IN_PROGRESS but not apparently doing anything - is there a way to clear those from the undercloud? | 16:12 |
| *** limao has joined #tripleo | 16:12 | |
| *** dmsimard is now known as dmsimard|afk | 16:13 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 16:14 |
| *** krtaylor has joined #tripleo | 16:14 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 16:15 |
| *** d0ugal has quit IRC | 16:17 | |
| amoralej | EmilienM, we just built required instack-undercloud version with gnocchi fix | 16:17 |
| EmilienM | yep | 16:18 |
| EmilienM | amoralej: I noticed | 16:18 |
| EmilienM | amoralej: and EXACTLY in the same time as OVB jobs started for Promotion | 16:18 |
| EmilienM | amoralej: like, at the same minute :D | 16:18 |
| EmilienM | amoralej: so now, let's see | 16:18 |
| amoralej | EmilienM, what jobs are now required for promotion? | 16:18 |
| amoralej | it's ovb? | 16:19 |
| EmilienM | amoralej: yes, ha nonha and updates | 16:19 |
| amoralej | oooq? | 16:19 |
| chem | shardy: EmilienM marios: so here the result of the discussion https://review.openstack.org/#/c/434346/16, it's untested yet but I would like input about obvious error, nit or otherwise plain wrong thing I did in there. Thanks a lot for the discussion :) | 16:19 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Allow custom undercloud initrd/vmlinuz https://review.openstack.org/447409 | 16:19 |
| *** gbarros has quit IRC | 16:21 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Define libvirt pool as a common meta role https://review.openstack.org/448543 | 16:21 |
| EmilienM | chem: do we really need https://review.openstack.org/#/c/434346/16/puppet/services/openvswitch-upgrade.yaml ? | 16:21 |
| EmilienM | why can't we just import the same logic as we have in neutron-ovs-agent | 16:21 |
| chem | EmilienM: well the upgrade tasks for opendaylight-ovs are not the same as in the neutron-ovs-agent | 16:22 |
| EmilienM | well https://review.openstack.org/#/c/434346/16/puppet/services/opendaylight-ovs.yaml looks very standard | 16:22 |
| EmilienM | restart OVS if installed... | 16:22 |
| EmilienM | I don't see any specifc bits for ODL | 16:23 |
| marios | chem: ack will check it but tomorrow we can test /me EOD | 16:23 |
| chem | EmilienM: yeap, but if you look at https://review.openstack.org/#/c/434346/16/puppet/services/neutron-ovs-agent.yaml then we will import the current neutron-agent upgrade_task into opendaylight which is may be not what we want | 16:24 |
| EmilienM | chem: what is the diff with https://review.openstack.org/#/c/434346/16/puppet/services/neutron-ovs-agent.yaml ? | 16:24 |
| *** daveholland has quit IRC | 16:24 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Remove kolla_config copy from services https://review.openstack.org/451366 | 16:24 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Restrict mongodb memory usage https://review.openstack.org/419090 | 16:25 |
| EmilienM | are we sure ODL doesn't require neutron ovs agent to be restarted? | 16:25 |
| chem | EmilienM: do you want to bj this it would be easier I think ? | 16:25 |
| chem | EmilienM: https://redhats.bluejeans.com/5369692477 if you want | 16:25 |
| *** gbarros has joined #tripleo | 16:26 | |
| *** paramite has quit IRC | 16:27 | |
| openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Add splay option to offset polling intervals https://review.openstack.org/451478 | 16:27 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 16:29 |
| EmilienM | trozet: ^ can you check with chem if we use neuton ovs agent when deploying ODL? | 16:29 |
| trozet | EmilienM, chem: no we explicitly disable it, but there is a bug where if openvswitch is restarted, it triggers neutron ovs agent to start. I filed a bz on this and a fix is posted (systemd fix) | 16:30 |
| chem | trozet: acks thanks | 16:30 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Re-run gnocchi and ceilometer upgrade in step 5 https://review.openstack.org/447735 | 16:32 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Stop deployment before jobs end https://review.openstack.org/450381 | 16:32 |
| shardy | chem: looks better, thanks, made a comment re map_merge | 16:33 |
| *** limao has quit IRC | 16:33 | |
| *** limao has joined #tripleo | 16:34 | |
| *** shardy has quit IRC | 16:35 | |
| chem | thanks shardy looking | 16:35 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 16:35 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Use openstack deploy to install the undercloud https://review.openstack.org/419040 | 16:36 |
| *** fragatina has joined #tripleo | 16:36 | |
| slagle | amoralej: can you look at https://bugs.launchpad.net/tripleo/+bug/1677278 ? | 16:38 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 16:38 |
| *** florianf has quit IRC | 16:39 | |
| *** d0ugal has joined #tripleo | 16:39 | |
| slagle | amoralej: we can't seem to upgrade from python-heat-agent* from ocata to openstack-heat-agents on master | 16:39 |
| amoralej | slagle, lemme check | 16:39 |
| slagle | amoralej: this is a little easier to read: http://paste.openstack.org/show/604704/ | 16:40 |
| *** gbarros_ has joined #tripleo | 16:41 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 16:41 |
| *** gbarros has quit IRC | 16:43 | |
| *** d0ugal has quit IRC | 16:43 | |
| *** bfournie has quit IRC | 16:44 | |
| *** yprokule has quit IRC | 16:45 | |
| *** mcornea has quit IRC | 16:46 | |
| *** jistr|mtg is now known as jistr | 16:47 | |
| amoralej | slagle, main problem is heat-agents upstream versioning, we | 16:47 |
| amoralej | both master and stable/ocata are 1.0.0 | 16:48 |
| amoralej | let me double check it | 16:48 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 16:48 |
| slagle | amoralej: yea | 16:48 |
| chem | trozet: he, sorry to bother you again, would you happen to know who is knowledgeable in neutron-ovs-dpkg-agent ? | 16:48 |
| slagle | amoralej: i think it's exasperated by the fact that we haven't promoted in so long | 16:48 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 16:48 |
| slagle | http://trunk.rdoproject.org/centos7/current-tripleo/ is actually older than https://trunk.rdoproject.org/centos7-ocata/current-tripleo/ | 16:49 |
| *** lucasagomes is now known as lucas-afk | 16:49 | |
| amoralej | slagle, the point is that latest build for ocata was newer than master and as version is the same, ocata won | 16:49 |
| amoralej | but i'm not sure if it takes it from promoted or current repo | 16:50 |
| *** pblaho has quit IRC | 16:50 | |
| *** lmiccini has quit IRC | 16:50 | |
| *** yamahata has quit IRC | 16:50 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Adds service for OpenDaylight DPDK + OVS https://review.openstack.org/419648 | 16:50 |
| amoralej | slagle, yes, it takes it from current-tripleo so we need a promotion | 16:51 |
| amoralej | and push new pre-release tag on heat-agents or it may happen again | 16:51 |
| *** shardy has joined #tripleo | 16:52 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 16:52 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| bkero | sshnaidm: Just doing some final touches on that ^ should be able to go in since we merged the vxlan network refactor earlier today | 16:54 |
| slagle | therve: can we get a pre-release tag on heat-agents, so it's always newer on master than ocata? | 16:54 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Adds service for OpenDaylight DPDK + OVS https://review.openstack.org/419648 | 16:54 |
| *** limao has quit IRC | 16:55 | |
| *** derekh has quit IRC | 16:57 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 16:57 |
| trozet | chem: no. I can try to answer your question if you have one, but i'm not an expert on ovs agent. amuller can point you to the right person | 16:58 |
| *** rhallisey has quit IRC | 16:58 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Write openstack bash completion for undercloud https://review.openstack.org/448606 | 16:58 |
| *** fragatin_ has joined #tripleo | 16:59 | |
| chem | trozet: ack, will bug amuller with a precise question, thank. | 16:59 |
| *** [1]cdearborn has joined #tripleo | 16:59 | |
| *** rhallisey has joined #tripleo | 17:00 | |
| *** fragatina has quit IRC | 17:02 | |
| *** zoli|mtg-afk is now known as zoli|gone | 17:02 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common stable/ocata: Fix typo in package_update.yaml https://review.openstack.org/440675 | 17:03 |
| *** chlong has quit IRC | 17:03 | |
| amoralej | slagle, i just explained it in https://bugs.launchpad.net/tripleo/+bug/1677278 | 17:03 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 17:03 |
| *** bfournie has joined #tripleo | 17:03 | |
| *** trown|lunch is now known as trown | 17:04 | |
| slagle | amoralej: thanks | 17:04 |
| bnemec | slagle: Hey, could you merge https://review.openstack.org/#/c/450902 ? None of those changes affect the ovb jobs so I'd rather not recheck just for that. | 17:05 |
| *** links has joined #tripleo | 17:07 | |
| *** pblaho has joined #tripleo | 17:07 | |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: DNM: give me more debug https://review.openstack.org/450800 | 17:07 |
| chem | shardy: would adding list_merge to heat require a bp ? | 17:07 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient master: Remove update abort https://review.openstack.org/449241 | 17:07 |
| slagle | bnemec: sure | 17:08 |
| bnemec | slagle: Thanks | 17:08 |
| EmilienM | oh I also reviewed it. Didn't see the messages here | 17:08 |
| chem | shardy: I would very much like to give it a shot, and was thinking that throwing a directly review was not the right thing to do. | 17:08 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Remove update abort https://review.openstack.org/449242 | 17:09 |
| EmilienM | chem: you want to ping Saravanan about DPDK | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 17:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 17:10 |
| chem | EmilienM: ack thanks | 17:10 |
| EmilienM | chem: skramaja (but afik in India so prob offline now) | 17:10 |
| *** akrivoka has quit IRC | 17:10 | |
| trozet | EmilienM, chem: you can also ask me about dpdk | 17:11 |
| chem | EmilienM: super thanks. He's allready in the reviewers list | 17:11 |
| chem | EmilienM: so what do you think :) | 17:11 |
| EmilienM | trozet: good to know :-) | 17:11 |
| chem | EmilienM: sorry | 17:11 |
| trozet | EmilienM, chem: just posted a patch to refactor dpdk + OOO: https://review.openstack.org/#/c/419648/ | 17:11 |
| chem | trozet: and have a look at my last comment that explain what I did new for dpdk | 17:12 |
| *** yamahata has joined #tripleo | 17:12 | |
| trozet | chem: which patch? | 17:13 |
| *** cdearborn has quit IRC | 17:13 | |
| chem | trozet: https://review.openstack.org/#/c/434346/17 | 17:13 |
| chem | trozet: and this is particular https://review.openstack.org/#/c/434346/17/puppet/services/neutron-ovs-dpdk-agent.yaml | 17:14 |
| chem | trozet: this basically import the neutron-ovs-agent upgrade tasks into dpdk one, before there was nothing there. | 17:14 |
| trozet | chem: looking | 17:14 |
| *** rwsu has joined #tripleo | 17:15 | |
| chem | trozet: added a comment about what the last patchset does for dpdk upgrade | 17:17 |
| chem | trozet: and now I have to go, let any insight in the review :) | 17:17 |
| trozet | chem: wait a sec if youc an | 17:18 |
| chem | trozet: ack | 17:18 |
| trozet | chem: this wont work with dpdk | 17:18 |
| *** links has quit IRC | 17:19 | |
| chem | trozet: ah, crap. | 17:19 |
| shardy | chem: Yeah I'd raise a heat blueprint, probably doesn't need a spec tho, just a way to track the patches | 17:20 |
| trozet | chem: you need this patch https://review.openstack.org/#/c/432165/ | 17:20 |
| shardy | chem: For this iteration in t-h-t I think yaql should work fine tho | 17:20 |
| *** jpena is now known as jpena|off | 17:20 | |
| trozet | shardy, chem: this is why openvswitch should be its own service per my RFE, I took the first step to doing that here: https://review.openstack.org/#/c/419648/ | 17:21 |
| chem | shardy: if you don't mind I try to give it a shoot to the heat bp and all. It would give me a break from upgrade :) | 17:21 |
| shardy | chem: sounds good! We can always add a FIXME comment near the yaql to remind us to swap it later, referencing the heat blueprint | 17:22 |
| shardy | sorry chem ^^ :) | 17:22 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Containerize etcd service https://review.openstack.org/447627 | 17:22 |
| chem | shardy: cool, will squeeze in first draft tomorrow. | 17:22 |
| chem | trozet: backtracking | 17:23 |
| trozet | shardy: oh sorry thought you were talking about the same thing chem and i were talking about | 17:23 |
| *** abehl has joined #tripleo | 17:24 | |
| chem | trozet: hum so no upgrade tasks are needed for dpdk beside taking care of proper openvswitch special case upgrade handling, rigth ? | 17:24 |
| *** jpich has quit IRC | 17:24 | |
| *** gbarros_ has quit IRC | 17:25 | |
| trozet | chem: OVS will need to be restarted | 17:25 |
| shardy | trozet: I'm fine with breaking out an openvswitch.yaml, but in your patch it's a bit strange that you have dpdk specific config_settings in the generic openvswitch.yaml? | 17:25 |
| trozet | chem: taht will be handled by the puppet module | 17:25 |
| trozet | shardy: those are OVS dpdk configurations | 17:25 |
| *** athomas has quit IRC | 17:25 | |
| trozet | shardy: single openvswitch service file to allow all configurations | 17:26 |
| trozet | shardy: eventually there will be some EnableDpdk in there, that would send a flag to ::vswitch to say enable dpdk or not | 17:26 |
| shardy | trozet: that's kind of contrary to the way composable services are supposed to work | 17:26 |
| chem | trozet: ack, so I'm going to compose the openvswitch upgrade into dpdk and remove the inherited task from the neutron-agent | 17:26 |
| trozet | shardy: but the ::vswitch module is also broken and needs some love | 17:27 |
| chem | trozet: thanks :) | 17:27 |
| shardy | chem: sounds good, add me as a reviewer, I think I can still remember how to review heat patches :) | 17:27 |
| chem | shardy: ack | 17:27 |
| trozet | shardy: what makes you think it is still not composable? I envision some generic OOO service like Dataplane: ./openvswitch.yaml | 17:28 |
| trozet | shardy: and you could also set Dataplane: ./vpp.yaml | 17:28 |
| *** dbecker has quit IRC | 17:29 | |
| shardy | trozet: I guess we can work it out in the review, but in general EnableFoo parameters make me worried, because we did that to selectively enable things in the old non-composable model, and often it's an indicator that a composable service should be broken up into multiple templates | 17:30 |
| trozet | shardy: dpdk isnt a service by itself | 17:30 |
| shardy | trozet: maybe that's not the case here, as it seems like several configurations of one service, vs a sevice with multiple backends (or is it?)? | 17:30 |
| trozet | shardy: but we could just look at if a dpdk setting is set we shoudl enable dpdk in OVS (it requires a reboot) | 17:31 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 17:32 |
| shardy | trozet: Ok, perhaps this is an acceptable case of EnableFoo, it just raises alarm bells for me :) | 17:32 |
| trozet | shardy: yeah multiple types of configurations for a single service | 17:32 |
| shardy | trozet: yeah, I guess that's OK, vs optional services configured via one template | 17:33 |
| trozet | shardy: yeah, the dpdk "service" doesnt really exist its a driver that needs to be loaded in the kernel, then you tell OVS enable dpdk, and OVS then tries to read the driver and NICs on the system that are bound to DPDK | 17:34 |
| chem | shardy: will add the fixme when I'll do the bp tomorrow. Now is time for leaving :) | 17:34 |
| shardy | chem: sounds good, have a nice evening! | 17:35 |
| chem | trozet: I've added you as a reviewer there | 17:35 |
| trozet | shardy: os-net-config will handle binding the NICs to dpdk and making sure the driver is loaded in the kernel | 17:35 |
| *** gbarros has joined #tripleo | 17:35 | |
| *** bogdando has quit IRC | 17:36 | |
| *** gfidente is now known as gfidente|afk | 17:36 | |
| *** tosky has quit IRC | 17:37 | |
| *** pkovar has quit IRC | 17:38 | |
| *** gbarros has quit IRC | 17:39 | |
| trozet | chem: thanks will respond | 17:41 |
| *** salmankhan has quit IRC | 17:44 | |
| *** trown is now known as trown|brb | 17:46 | |
| *** rhallisey has quit IRC | 17:46 | |
| *** chem is now known as chem_gone | 17:47 | |
| *** jprovazn has quit IRC | 17:49 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Add openstackdocstheme dependency https://review.openstack.org/451474 | 17:49 |
| *** hamzy has joined #tripleo | 17:50 | |
| *** pcaruana has quit IRC | 17:52 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 17:53 |
| *** trown|brb is now known as trown | 17:54 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 17:56 |
| *** rhallisey has joined #tripleo | 17:57 | |
| *** social has joined #tripleo | 17:58 | |
| *** chlong has joined #tripleo | 17:58 | |
| pradk | can i get a +A on this please https://review.openstack.org/#/c/450746/ | 17:59 |
| EmilienM | bnemec: I wonder if we should do that also https://review.openstack.org/#/c/447119/3/stack.sh | 18:00 |
| jrist | bnemec: before I get too far down the rabbit hole, how reasonable do you think this is to backport to newton? https://review.openstack.org/#/c/449192/ | 18:00 |
| bnemec | EmilienM: I thought someone said CentOS already turns it on by default. | 18:02 |
| EmilienM | jrist: someone requested for it? | 18:02 |
| jrist | EmilienM: yes | 18:02 |
| bnemec | I tried it on a Fedora box and it crashed in less than 24 hours too. | 18:02 |
| bnemec | But centos may be more stable. | 18:02 |
| bnemec | Should be, in fact. | 18:02 |
| EmilienM | mhh ok | 18:02 |
| bnemec | jrist: Assuming the enable_ui opt existed in Newton I don't see a problem with it. | 18:03 |
| jrist | yes it did | 18:03 |
| jrist | thanks bnemec | 18:03 |
| *** gbarros has joined #tripleo | 18:03 | |
| bnemec | The bug exists there too so it seems valid for backport. | 18:03 |
| bnemec | EmilienM: Not on in our compute nodes though: | 18:04 |
| bnemec | [heat-admin@overcloud-novacompute-22 ~]$ cat /sys/kernel/mm/ksm/run | 18:04 |
| bnemec | 0 | 18:04 |
| trown | bnemec: EmilienM ksm was enabled by default on my CentOS box | 18:05 |
| EmilienM | mhh | 18:05 |
| EmilienM | we could give it a try | 18:06 |
| bnemec | EmilienM: I'm not touching rh1 until ci stabilizes a _lot_. | 18:06 |
| bnemec | (well, except things intended to stabilize ci) | 18:06 |
| trown | has been running fine for me for 50 days... and actually longer because 50 days ago was a power outage in the building | 18:07 |
| *** amoralej is now known as amoralej|off | 18:07 | |
| *** chlong has quit IRC | 18:07 | |
| bnemec | Our ci has a way of finding the weakness in any system though. | 18:07 |
| bnemec | I'm fine with trying it at some point, but I don't think this is the right time. | 18:08 |
| *** dsneddon has quit IRC | 18:08 | |
| EmilienM | the benefit seems small though, clarkb saved 150MB | 18:08 |
| trown | ya, not saying we should turn it on in CI | 18:08 |
| EmilienM | and I don't think it will help us, since we don't spawn much VMs | 18:09 |
| EmilienM | unless we enable it on the OVB cloud | 18:09 |
| *** dsneddon has joined #tripleo | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 18:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 18:10 |
| bnemec | I'm not sure how much our ci would benefit anyway. I would bet that our pxe deploy method messes up the shared page marking. | 18:10 |
| bnemec | The hypervisor doesn't realize that we're using the same image everywhere. | 18:10 |
| slagle | ccamacho: can you drop your -1 from https://review.openstack.org/#/c/450734/ ? | 18:10 |
| *** myoung|remote has joined #tripleo | 18:11 | |
| *** myoung|remote is now known as myoung|alt | 18:11 | |
| *** jschlueter has quit IRC | 18:12 | |
| *** myoung has quit IRC | 18:12 | |
| *** rbrady is now known as rbrady-afk | 18:12 | |
| *** jschlueter has joined #tripleo | 18:14 | |
| *** myoung has joined #tripleo | 18:14 | |
| *** maeca1 has joined #tripleo | 18:15 | |
| *** maeca1 has quit IRC | 18:15 | |
| *** abehl has quit IRC | 18:19 | |
| *** myoung|alt has quit IRC | 18:19 | |
| *** toure is now known as toure|afk | 18:20 | |
| *** chlong has joined #tripleo | 18:21 | |
| *** suuuper has quit IRC | 18:22 | |
| hamzy | When I try and install instack-undercloud on CentOS7 and delorean-newton, I see the following dependency issue. When then snowballs into needing to pull a bunch of newer packages. http://paste.openstack.org/show/604720/ | 18:23 |
| hamzy | Is this a problem? | 18:23 |
| *** nyechiel has quit IRC | 18:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Revert "Include gate.repo in image building if exists" https://review.openstack.org/451508 | 18:24 |
| EmilienM | hamzy: http://trunk.rdoproject.org/centos7/delorean-deps.repo is not for newton | 18:25 |
| sshnaidm | trown, take a look please: https://review.openstack.org/451508 | 18:25 |
| *** maeca1 has joined #tripleo | 18:25 | |
| *** maeca1 has quit IRC | 18:25 | |
| EmilienM | hamzy: try: yum install -y centos-release-openstack-newton | 18:26 |
| hamzy | EmilienM, I was following https://docs.openstack.org/developer/tripleo-docs/environments/virtual.html in step 4 | 18:26 |
| trown | sshnaidm: is there a patch that makes it work? | 18:26 |
| sshnaidm | trown, no, working on this | 18:27 |
| trown | sshnaidm: since if we revert that, it will look like image building with a gated change is working, but it actually wont be including the change | 18:27 |
| EmilienM | hamzy: sudo curl -L -o /etc/yum.repos.d/delorean-current.repo https://trunk.rdoproject.org/centos7/current/delorean.repo | 18:27 |
| trown | sshnaidm: I would rather squash that revert into the change that makes it work | 18:27 |
| hamzy | I guess the part in white is for master instead? | 18:27 |
| EmilienM | hamzy: I think we should make it clear in doc that this command is not for stable branches | 18:27 |
| sshnaidm | trown, yeah, but with that building just fails | 18:27 |
| EmilienM | sshnaidm: I'm watching promotion jobs, it smells good | 18:28 |
| hamzy | thanks | 18:28 |
| bkero | Smell? | 18:28 |
| trown | sshnaidm: ya, I am saying I would prefer failing to false positive | 18:28 |
| sshnaidm | EmilienM, crossing fingers :) | 18:28 |
| sshnaidm | trown, we don't really declared this feature | 18:29 |
| *** trown is now known as trown|brb | 18:29 | |
| EmilienM | hamzy: if you want to change it, https://github.com/openstack/tripleo-docs | 18:30 |
| EmilienM | sshnaidm: how long does it takes once the 3 jobs finished? | 18:30 |
| EmilienM | sshnaidm: (to get promotion) | 18:30 |
| sshnaidm | EmilienM, a few hours acc. to previous experience | 18:30 |
| EmilienM | k | 18:30 |
| hamzy | EmilienM, sure thing | 18:32 |
| bnemec | hamzy: "Do not enable any other repos not explicitly marked for that release." | 18:32 |
| * bnemec is reminded that tripleo-repos needs to be a thing | 18:33 | |
| hamzy | bnemec, would another box be a good addition? | 18:33 |
| *** chlong has quit IRC | 18:34 | |
| openstackgerrit | Adam Harwell proposed openstack/diskimage-builder master: Use DIB_PYTHON_VERSION to run commands https://review.openstack.org/449721 | 18:35 |
| EmilienM | hamzy: probably | 18:37 |
| hamzy | that way at least it is consistent | 18:38 |
| *** maeca1 has joined #tripleo | 18:39 | |
| bnemec | It's a little weird to have a master branch admonition when everything not explicitly labelled stable relates to master. | 18:40 |
| *** maeca1 has quit IRC | 18:40 | |
| bnemec | This is really an example of how the manual repo setup sucks though. | 18:40 |
| hamzy | and "yum install -y centos-release-openstack-newton" is the automated repo setup? | 18:41 |
| bnemec | No, that won't do it either. | 18:42 |
| bnemec | The tool for it isn't packaged yet so it isn't quite ready for use. | 18:42 |
| bnemec | It will eventually make repo setup a one command operation, and the branch will be explicit. | 18:42 |
| hamzy | that would be helpful | 18:43 |
| EmilienM | slagle: fyi, we're about to get a promotion in the next hours | 18:44 |
| EmilienM | slagle: jobs are passing now | 18:44 |
| *** trown|brb is now known as trown | 18:45 | |
| *** openstackstatus has joined #tripleo | 18:46 | |
| *** ChanServ sets mode: +v openstackstatus | 18:46 | |
| *** morazi has quit IRC | 18:46 | |
| *** chlong has joined #tripleo | 18:49 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/newton: [Newton-only] Enable services in the major-upgrade-pacemaker step https://review.openstack.org/451512 | 18:49 |
| therve | slagle, Hum yeah, not sure how to do that but I'll look tomorrow | 18:50 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add NeutronDnsDomain heat option, undercloud fix https://review.openstack.org/451517 | 18:50 |
| weshay | bkero, hrm.. | 18:51 |
| weshay | just hit | 18:51 |
| weshay | TASK [undercloud-setup : Install the TripleO-CI VXLAN networking script] ******* | 18:51 |
| weshay | task path: /var/tmp/rhos-12/usr/local/share/ansible/roles/undercloud-setup/tasks/vxlan_networking.yml:3 | 18:51 |
| weshay | Wednesday 29 March 2017 14:50:38 -0400 (0:01:32.561) 0:37:56.880 ******* | 18:51 |
| weshay | fatal: [undercloud]: FAILED! => {"failed": true, "msg": "The conditional check 'vxlan_networking|bool or toci_vxlan_networking|bool' failed. The error was: error while evaluating conditional (vxlan_networking|bool or toci_vxlan_networking|bool): 'toci_vxlan_networking' is undefined\n\nThe error appears to have been in '/var/tmp/rhos-12/usr/local/share/ansible/roles/undercloud-setup/tasks/main.yml': line 21, column 3, but may\nbe elsewhere | 18:51 |
| weshay | in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Including vxlan_networking tasks\n ^ here\n"} | 18:51 |
| weshay | bkero, that should be reverted | 18:51 |
| bkero | toci_vxlan_networking undefined, huh | 18:52 |
| bkero | weshay: link to the job? | 18:52 |
| weshay | bkero, running locally | 18:52 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Revert "Refactor the toci-vxlan-networking script to be more correct" https://review.openstack.org/451518 | 18:52 |
| bkero | weshay: huh, that should be defined in roles/undercloud-setup/defaults/main.yml | 18:52 |
| weshay | ya.. I see it there | 18:54 |
| *** jcoufal has quit IRC | 18:54 | |
| bkero | Ahh, I see what happened. defaults.yml has 'vxlan_networking' but not 'toci_vxlan_networking'. I changed the name of that variable and left both in the task 'when' for legacy purposes until another review landed. | 18:54 |
| bkero | All that's needed is 'toci_vxlan_networking: false' until that lands | 18:55 |
| openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Add splay option to offset polling intervals https://review.openstack.org/451478 | 18:55 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Add httpchk for http services https://review.openstack.org/439052 | 18:57 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 18:57 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: fix toci-vxlan-networking error https://review.openstack.org/451520 | 18:58 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras master: undercloud-setup: Add default variable for toci_vxlan_networking https://review.openstack.org/451521 | 18:58 |
| bkero | weshay: oops, looks like we both submitted the same thing | 18:58 |
| weshay | bkero, meh.. can you check w/ trown or $core on how they want to proceed | 18:59 |
| bkero | Sure, let me write up a little explanation. | 18:59 |
| weshay | thanks | 18:59 |
| *** rwsu has quit IRC | 19:00 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Add supplemental node provisioner https://review.openstack.org/451523 | 19:00 |
| *** morazi has joined #tripleo | 19:01 | |
| *** jcoufal has joined #tripleo | 19:02 | |
| bkero | trown, sshnaidm, adarazs: Review 446934 landed that refactors the vxlan networking for multinode jobs. This review included the change that renamed the ansible variable 'toci_vxlan_networking' to simply 'vxlan_networking'. In the conditional to execute it, I left it as 'when: toci_vxlan_networking|bool or vxlan_networking|bool' since the change to the new variable in tripleo-ci has not landed (477142). The | 19:02 |
| bkero | failure is that toci_vxlan_networking is not defined in defaults/main.yml anymore, and ansible is complaining of an undefined variable. https://review.openstack.org/451521 adds that variable and fixes runs. | 19:02 |
| bkero | weshay: how's that? | 19:03 |
| *** gfidente|afk has quit IRC | 19:03 | |
| bkero | sshnaidm++ for quick review | 19:04 |
| bkero | trown++ for similar | 19:05 |
| weshay | bkero, thanks | 19:07 |
| EmilienM | sshnaidm: oh noes, ovb-updates job failed on pingtest http://paste.openstack.org/show/RRcKi0mz0kbH3e6rUDgA/ | 19:08 |
| *** milan has quit IRC | 19:08 | |
| bkero | weshay: thank you and sorry about that. I thought the CI jobs would have caught that. | 19:08 |
| EmilienM | sshnaidm: and we don't have logs to debug http://logs.openstack.org/15/359215/78/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/5c9b780/logs/ | 19:09 |
| sshnaidm | EmilienM, 137 is timeout, let's recheck again | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 19:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 19:10 |
| EmilienM | sshnaidm: mhh ok | 19:10 |
| EmilienM | sshnaidm: is it 1674770 ? | 19:10 |
| EmilienM | bnemec: I still see timeouts on ovb-updates. should it be fixed by https://bugs.launchpad.net/tripleo/+bug/1674770/comments/6 ? | 19:13 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 19:13 |
| *** artom_ has joined #tripleo | 19:13 | |
| sshnaidm | EmilienM, not sure, it was really close | 19:13 |
| *** artom has quit IRC | 19:13 | |
| *** artom_ has quit IRC | 19:13 | |
| EmilienM | yeah | 19:13 |
| bnemec | EmilienM: No, that won't fix the timeouts, it will just allow us to collect logs. | 19:13 |
| *** artom_ has joined #tripleo | 19:13 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 19:13 |
| EmilienM | bnemec: let's try agian | 19:14 |
| bnemec | You merged the patch earlier today that should allow us to debug the timeouts though. | 19:14 |
| bnemec | I haven't seen one happen since then, of course. | 19:14 |
| bnemec | Bleh, I take that back: http://logs.openstack.org/93/450893/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/98dd273/console.html | 19:14 |
| bnemec | The change didn't help though. :-( | 19:15 |
| bnemec | Oh, maybe the change isn't active yet: http://logs.openstack.org/93/450893/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/98dd273/console.html#_2017-03-29_00_53_27_133155 | 19:16 |
| EmilienM | and back into the queue :( | 19:16 |
| bnemec | Must have just missed the patch merging. | 19:17 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 19:17 |
| EmilienM | pradk: could you please reviw that? | 19:17 |
| EmilienM | it's one patch that could reduce the time of deployment | 19:17 |
| pradk | sure | 19:17 |
| *** salmankhan has joined #tripleo | 19:17 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Set auth flag so ceilometer auth is enabled https://review.openstack.org/451532 | 19:21 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Decouple ceilometer user create from API https://review.openstack.org/451533 | 19:22 |
| *** salmankhan has quit IRC | 19:22 | |
| pradk | EmilienM, ^^ lemme know what you think of that | 19:22 |
| EmilienM | pradk: i'll look soon | 19:23 |
| *** fragatin_ has quit IRC | 19:25 | |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Adds service for managing securetty https://review.openstack.org/449148 | 19:25 |
| *** fragatina has joined #tripleo | 19:26 | |
| openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Add splay option to offset polling intervals https://review.openstack.org/451478 | 19:28 |
| *** cylopez has quit IRC | 19:32 | |
| *** openstackgerrit has quit IRC | 19:33 | |
| *** karimb_ has quit IRC | 19:34 | |
| *** chlong has quit IRC | 19:34 | |
| *** karimb has joined #tripleo | 19:39 | |
| *** pkovar has joined #tripleo | 19:39 | |
| slagle | EmilienM: we could probably merge https://review.openstack.org/#/c/450734/. i've fixed the -1, but ccamacho is gone for the day | 19:41 |
| EmilienM | slagle: ok looking | 19:41 |
| slagle | EmilienM: it's up to you | 19:41 |
| *** morazi has quit IRC | 19:41 | |
| EmilienM | slagle: approved | 19:42 |
| *** artom_ has quit IRC | 19:44 | |
| *** toure|afk is now known as toure | 19:45 | |
| *** artom has joined #tripleo | 19:48 | |
| *** d0ugal has joined #tripleo | 19:50 | |
| pradk | EmilienM, hmm so regarding the ceilo user create.. that alone wont work loks like :( .. as ceilo::keystone::auth also sets up end point which we dont want | 19:50 |
| pradk | we could set configure_endpoint = false | 19:50 |
| pradk | but we would work without changig the default in puppet | 19:51 |
| pradk | wouldnt* | 19:51 |
| *** morazi has joined #tripleo | 19:53 | |
| *** openstackgerrit has joined #tripleo | 19:54 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv https://review.openstack.org/438746 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 19:54 |
| *** dprince has quit IRC | 19:55 | |
| bnemec | Go home everyone, you're not getting ci results today. ;-) | 19:55 |
| hamzy | EmilienM, so openstack-tripleo.noarch does not see to be built for delorean-ocata where it is for delorean-newton. openstack-tripleo contains the tripleo executable which instack-virt-setup needs. | 19:56 |
| slagle | bnemec: whoah whoah, i'm at the end of the queue | 19:56 |
| slagle | and i squashed some! | 19:56 |
| bnemec | slagle: 10.5 hours. I think that's a new record for the ovb queue. :-) | 19:57 |
| EmilienM | hopefully we can get the promotion inthe next round | 19:58 |
| slagle | why havent we killed the containers job yet??? | 19:58 |
| slagle | it always fails | 19:58 |
| openstackgerrit | Merged openstack/tripleo-common stable/ocata: Make fencing action parameter optional. https://review.openstack.org/446184 | 19:58 |
| slagle | it was added *way* prematurely | 19:58 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add ethernet support on external network https://review.openstack.org/437376 | 19:58 |
| openstackgerrit | Merged openstack/instack-undercloud master: Get keystone session from keystoneauth and not python-keystoneclient https://review.openstack.org/451353 | 19:59 |
| EmilienM | slagle: dprince started something but not sure aboutt he status now | 19:59 |
| slagle | EmilienM: i saw that, but that patch is a ways away from merging i think | 19:59 |
| EmilienM | yes | 19:59 |
| slagle | how is an ovb job going to finish under the timeout, with all those features turned on? | 19:59 |
| EmilienM | shardy: what is the progress on getting multinode jobs deploying containers? | 20:00 |
| *** d0ugal has quit IRC | 20:00 | |
| slagle | bnemec: if we get the queue up over 24 hours, we don't have to work on Friday, right? | 20:01 |
| EmilienM | slagle: no please don't do that :) | 20:01 |
| bnemec | slagle: Excuse me, I just remembered a whole bunch of tripleo-ci patches that need rebases. ;-) | 20:02 |
| *** sshnaidm is now known as sshnaidm|off | 20:04 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add log capturing support workflows https://review.openstack.org/405002 | 20:06 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Add overcloud support report command https://review.openstack.org/405001 | 20:06 |
| bnemec | Also, it's worth noting that combining ovb jobs doesn't fix the containers job. | 20:07 |
| bnemec | The latter needs to happen first. | 20:07 |
| slagle | EmilienM: bnemec : https://review.openstack.org/451546 | 20:08 |
| slagle | EmilienM: that never should have been added to begin with. so i'm politely moving it to the experimental queue instead of proposing a revert :) | 20:08 |
| bnemec | wfm | 20:09 |
| EmilienM | slagle: voted. | 20:09 |
| EmilienM | slagle: I'll email the list | 20:09 |
| *** artom has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 20:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 20:10 |
| EmilienM | slagle, bnemec: please add container jobs to cistatus so we can show folks that jobs is always red | 20:10 |
| bnemec | EmilienM: IMHO it's on the proposer of the new job to do that. | 20:11 |
| bnemec | It's why I put it on the adding ci jobs policy. | 20:11 |
| *** artom has joined #tripleo | 20:11 | |
| bnemec | Unless I'm mistaken you told them to do that like two weeks ago. | 20:11 |
| slagle | if they dont know this job is red, let's just remove it entirely | 20:12 |
| slagle | and it is on http://status-tripleoci.rhcloud.com/ already | 20:12 |
| *** artom_ has joined #tripleo | 20:13 | |
| *** artom has quit IRC | 20:14 | |
| bnemec | Also what he said ^ | 20:14 |
| *** gbarros has quit IRC | 20:15 | |
| *** Goneri has joined #tripleo | 20:17 | |
| *** flepied has joined #tripleo | 20:17 | |
| *** krtaylor has quit IRC | 20:20 | |
| EmilienM | sdake, Slower: do you have thoughts? | 20:21 |
| sdake | EmilienM thoughts on which part tripleoci? | 20:22 |
| *** jayg is now known as jayg|g0n3 | 20:23 | |
| *** pkovar has quit IRC | 20:23 | |
| EmilienM | sdake: damn, wrong ping sorry | 20:24 |
| EmilienM | sdake: my brain is broken for today. | 20:24 |
| EmilienM | stevebaker: any thoughts on our discussion? ^ | 20:25 |
| sdake | EmilienM no prob | 20:25 |
| *** shadower has quit IRC | 20:27 | |
| *** trown is now known as trown|outtypewww | 20:28 | |
| *** lyarwood has quit IRC | 20:28 | |
| *** lyarwood has joined #tripleo | 20:29 | |
| stevebaker | EmilienM, slagle: we're fully aware of where the ovb containers job is at, mandre has done a lot in this area | 20:30 |
| slagle | yea, i assumed that was the case | 20:31 |
| slagle | it's not as much about it not being stable, as it is that we just don't have capacity for a 4th ovb job | 20:32 |
| *** ansmith has quit IRC | 20:32 | |
| stevebaker | slagle: did dprince propose merging ha+nonha to bring that back down to 3? | 20:33 |
| slagle | stevebaker: yes. and no further progress | 20:33 |
| slagle | a few days have passed | 20:33 |
| bnemec | That doesn't solve the problem of the containers job not passing. | 20:33 |
| EmilienM | 5 days | 20:33 |
| EmilienM | and nothing | 20:33 |
| slagle | the quickest thing to do is to go back to 3 jobs | 20:33 |
| slagle | i'm doubtful that combining features from nonha and ha is really all that wise anyway | 20:33 |
| slagle | given timeouts | 20:34 |
| stevebaker | slagle: we could have that discussion in the review | 20:35 |
| stevebaker | https://review.openstack.org/#/c/449785/ | 20:35 |
| slagle | we could | 20:36 |
| slagle | in the meantime, let's fix our ci | 20:36 |
| slagle | while we discuss | 20:36 |
| stevebaker | EmilienM: I think the main issue with container jobs failures is pulling images from docker hub, dprince is setting up a registry in our cloud so we can better handle image downloads, also once this lands we have the option of building images on the fly in the job https://review.openstack.org/#/c/448300/ | 20:38 |
| EmilienM | stevebaker: i'm happy to see WIP | 20:39 |
| EmilienM | stevebaker: but we need a short term solution for now. | 20:39 |
| EmilienM | stevebaker: OVB queue is 11 hours now | 20:39 |
| EmilienM | if you have a better option, I'm all for it | 20:40 |
| *** brault is now known as brault|away | 20:40 | |
| stevebaker | I don't, switching to experimental for now seems like the only option | 20:43 |
| EmilienM | ok, good | 20:44 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Set auth flag so ceilometer auth is enabled https://review.openstack.org/451532 | 20:48 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add primary flag to roles https://review.openstack.org/451561 | 20:50 |
| *** rwsu has joined #tripleo | 20:50 | |
| *** karimb has quit IRC | 20:52 | |
| shardy | EmilienM: Hey reading scrollback, I've not looked closely at running the container jobs via multinode except for https://review.openstack.org/#/c/442614/ | 20:55 |
| shardy | EmilienM: the reason I stopped working on that is all the focus seems to be on the OVB container job and optimizing for that | 20:56 |
| EmilienM | shardy: we disabled it from check queue in short term | 20:56 |
| shardy | EmilienM: FWIW I think it would be better in the long term if we get infra help to enable docker cache/registry for multinode jobs, and switch to container enabled scenario tests like we do for puppet/upgrades | 20:56 |
| shardy | EmilienM: that's what we need by the end of this cycle IMO, but we probably need to fix the large slow download problem with infra help first | 20:57 |
| EmilienM | shardy: yes, step by step | 20:57 |
| shardy | we can reach out again to pabelanger and others in the upstream infra team work out how we can prioritize that | 20:57 |
| *** maeca1 has joined #tripleo | 20:58 | |
| *** maeca1 has quit IRC | 20:59 | |
| *** ccamacho has quit IRC | 21:04 | |
| *** rwsu has quit IRC | 21:06 | |
| *** rhallisey has quit IRC | 21:08 | |
| *** fragatin_ has joined #tripleo | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 21:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 21:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 21:10 |
| *** fragatina has quit IRC | 21:13 | |
| *** krtaylor has joined #tripleo | 21:14 | |
| *** rwsu has joined #tripleo | 21:20 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Disable ceilometer API https://review.openstack.org/450903 | 21:22 |
| *** dmacpher has quit IRC | 21:23 | |
| *** ccamacho has joined #tripleo | 21:24 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 21:25 |
| *** lblanchard has quit IRC | 21:25 | |
| *** artom_ has quit IRC | 21:25 | |
| *** artom_ has joined #tripleo | 21:26 | |
| *** bfournie has quit IRC | 21:28 | |
| *** jcoufal has quit IRC | 21:29 | |
| *** abishop has quit IRC | 21:30 | |
| *** ansmith has joined #tripleo | 21:33 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Don't hardcode jenkins user https://review.openstack.org/451575 | 21:34 |
| *** dmacpher has joined #tripleo | 21:35 | |
| *** rbrady-afk is now known as rbrady | 21:36 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv https://review.openstack.org/438746 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 21:38 |
| *** dmacpher has quit IRC | 21:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 21:42 |
| EmilienM | can someone review https://review.openstack.org/#/c/450939/ please? | 21:46 |
| * EmilienM on the long road to kill os-cloud-config from everywhere | 21:46 | |
| *** flepied has quit IRC | 21:49 | |
| *** shardy has quit IRC | 21:50 | |
| *** dmacpher has joined #tripleo | 21:53 | |
| bnemec | Do we have a bug open for that 'headers' problem in the client? | 21:58 |
| bnemec | It seems to be causing a lot of spurious failures. | 21:58 |
| * bnemec should probably check the critical bugs list before asking questions like that | 21:58 | |
| bnemec | Hmm, don't see a bug though, so the point stands. | 22:00 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add ceilometer ipmi agent https://review.openstack.org/430447 | 22:00 |
| EmilienM | bandini: see my comment on https://review.openstack.org/#/c/425710/ | 22:00 |
| EmilienM | bnemec: you'll notice the new format when you file a bug in launchpad. I changes the messages with the hope of getting more triaged bugs. | 22:01 |
| bnemec | EmilienM: Cool. I'm wondering if there's any bug open for this though. I don't see one. | 22:03 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add gnocchi to events dispatchers https://review.openstack.org/450798 | 22:04 |
| EmilienM | bnemec: I don't think I created one | 22:05 |
| bnemec | EmilienM: Okay, I'm opening one. | 22:05 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates https://review.openstack.org/451584 | 22:06 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Cinder: Add NexentaStor Support https://review.openstack.org/370956 | 22:08 |
| *** fragatin_ has quit IRC | 22:08 | |
| *** fragatina has joined #tripleo | 22:09 | |
| EmilienM | this patch might save us some minutes of deployment: https://review.openstack.org/#/c/434016/7 | 22:09 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Restrict mongodb memory usage https://review.openstack.org/419090 | 22:09 |
| *** jlinkes has quit IRC | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 22:10 |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 22:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,Triaged] | 22:10 |
| *** gbarros has joined #tripleo | 22:12 | |
| *** gbarros has quit IRC | 22:14 | |
| *** gbarros has joined #tripleo | 22:15 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add primary flag to roles https://review.openstack.org/451561 | 22:15 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Set auth flag so ceilometer auth is enabled https://review.openstack.org/451532 | 22:16 |
| * EmilienM off | 22:16 | |
| * bkero ewaves | 22:17 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common master: Nothing to see here https://review.openstack.org/451587 | 22:19 |
| *** rwsu has quit IRC | 22:23 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Do not install openstack-heat-agents https://review.openstack.org/451588 | 22:25 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Capture more of the bmc console log https://review.openstack.org/451591 | 22:28 |
| *** [1]cdearborn has quit IRC | 22:29 | |
| *** colonwq has quit IRC | 22:33 | |
| *** colonwq has joined #tripleo | 22:33 | |
| *** artom_ has quit IRC | 22:33 | |
| *** artom_ has joined #tripleo | 22:33 | |
| *** rwsu has joined #tripleo | 22:35 | |
| *** krtaylor has quit IRC | 22:38 | |
| *** pradk has quit IRC | 22:38 | |
| *** rbrady is now known as rbrady-afk | 22:44 | |
| *** gbarros has quit IRC | 22:55 | |
| *** gbarros has joined #tripleo | 22:56 | |
| *** bfournie has joined #tripleo | 22:57 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1674770 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677062 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1677278 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1677062 in tripleo "tripleo-common cannot be built in CI due to pull-puppet-modules" [Critical,Triaged] - Assigned to Alfredo Moralejo (amoralej) | 23:10 |
| openstack | Launchpad bug 1677278 in tripleo "upgrades: heat-agent package conflict on upgrade" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 23:10 |
| *** colonwq has quit IRC | 23:11 | |
| *** pmannidi has joined #tripleo | 23:14 | |
| *** colonwq has joined #tripleo | 23:14 | |
| *** chem_gone has quit IRC | 23:30 | |
| *** morazi has quit IRC | 23:31 | |
| *** dmacpher has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!