| *** ooolpbot has joined #tripleo | 00:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:11 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 00:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 00:11 |
| *** ooolpbot has quit IRC | 00:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 00:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 00:11 |
| *** ansiwen has quit IRC | 00:11 | |
| *** gregwork has quit IRC | 00:12 | |
| *** remix_tj has quit IRC | 00:12 | |
| *** afazekas has quit IRC | 00:12 | |
| *** thrash has joined #tripleo | 00:13 | |
| *** thrash has quit IRC | 00:13 | |
| *** thrash has joined #tripleo | 00:13 | |
| *** ansiwen has joined #tripleo | 00:13 | |
| *** jroll has quit IRC | 00:14 | |
| *** remix_tj has joined #tripleo | 00:14 | |
| *** afazekas has joined #tripleo | 00:17 | |
| *** Goneri has quit IRC | 00:20 | |
| *** gregwork has joined #tripleo | 00:21 | |
| *** karimb has quit IRC | 00:23 | |
| *** jroll has joined #tripleo | 00:25 | |
| *** gfidente|afk has quit IRC | 00:26 | |
| *** limao has joined #tripleo | 00:27 | |
| *** alee has joined #tripleo | 00:50 | |
| *** dmarlin has quit IRC | 01:07 | |
| *** ooolpbot has joined #tripleo | 01:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 01:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 01:11 |
| *** ooolpbot has quit IRC | 01:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 01:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 01:11 |
| *** ansmith_ has joined #tripleo | 01:19 | |
| *** ansmith has joined #tripleo | 01:19 | |
| *** Goneri has joined #tripleo | 01:34 | |
| *** itzikb has quit IRC | 01:37 | |
| *** Goneri has quit IRC | 01:45 | |
| *** saneax is now known as saneax-_-|AFK | 01:48 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Make collect_logs less error prone. https://review.openstack.org/418614 | 01:52 |
| *** ckyriakidou has quit IRC | 02:02 | |
| *** bana_k has quit IRC | 02:05 | |
| *** ansmith has quit IRC | 02:11 | |
| *** ansmith_ has quit IRC | 02:11 | |
| *** ooolpbot has joined #tripleo | 02:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 02:11 |
| *** ooolpbot has quit IRC | 02:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 02:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 02:11 |
| *** thrash is now known as thrash|g0ne | 02:20 | |
| *** chlong has quit IRC | 02:32 | |
| *** jeckersb_gone is now known as jeckersb | 02:43 | |
| *** jcoufal has joined #tripleo | 02:56 | |
| *** dsneddon_ has joined #tripleo | 03:11 | |
| *** ooolpbot has joined #tripleo | 03:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 03:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 03:11 |
| *** ooolpbot has quit IRC | 03:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 03:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 03:11 |
| *** dsneddon has quit IRC | 03:13 | |
| *** yamahata has quit IRC | 03:14 | |
| *** absubram has quit IRC | 03:18 | |
| *** absubram has joined #tripleo | 03:25 | |
| *** rlandy has quit IRC | 03:29 | |
| *** absubram has quit IRC | 03:31 | |
| *** jcoufal has quit IRC | 03:36 | |
| *** morazi is now known as morazi-afk | 03:41 | |
| *** dsneddon_ has quit IRC | 03:42 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 03:44 |
| *** kbyrne has quit IRC | 03:45 | |
| *** links has joined #tripleo | 03:47 | |
| *** kbyrne has joined #tripleo | 03:48 | |
| *** ramishra has quit IRC | 03:53 | |
| *** ramishra has joined #tripleo | 03:55 | |
| *** aparna has joined #tripleo | 03:57 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Revert "temprevert neutron "Don't create HA resources until needed" patch" https://review.openstack.org/417888 | 04:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Nova Placement API composable service https://review.openstack.org/406397 | 04:02 |
| *** newmember has quit IRC | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 04:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 04:11 |
| *** ooolpbot has quit IRC | 04:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 04:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 04:11 |
| *** yamahata has joined #tripleo | 04:15 | |
| *** padkrish has joined #tripleo | 04:17 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 04:17 |
| *** padkrish has quit IRC | 04:18 | |
| *** padkrish has joined #tripleo | 04:18 | |
| *** padkrish has quit IRC | 04:19 | |
| *** bana_k has joined #tripleo | 04:20 | |
| *** psahoo has joined #tripleo | 04:24 | |
| *** bana_k has quit IRC | 04:28 | |
| *** sudipto_ has joined #tripleo | 04:32 | |
| *** sudipto has joined #tripleo | 04:32 | |
| *** nmathew has joined #tripleo | 04:49 | |
| *** absubram has joined #tripleo | 04:55 | |
| *** absubram_ has joined #tripleo | 04:59 | |
| *** absubram has quit IRC | 04:59 | |
| *** absubram_ is now known as absubram | 04:59 | |
| *** ramishra has quit IRC | 05:03 | |
| *** ramishra has joined #tripleo | 05:05 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 05:08 |
| *** ooolpbot has joined #tripleo | 05:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 05:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 05:11 |
| *** ooolpbot has quit IRC | 05:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 05:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 05:11 |
| *** gkadam has joined #tripleo | 05:11 | |
| *** sudipto_ has quit IRC | 05:17 | |
| *** sudipto has quit IRC | 05:17 | |
| *** ramishra has quit IRC | 05:26 | |
| *** ramishra has joined #tripleo | 05:28 | |
| *** tzumainn has quit IRC | 05:29 | |
| *** bana_k has joined #tripleo | 05:33 | |
| *** prateek has joined #tripleo | 05:34 | |
| *** sudipto_ has joined #tripleo | 05:42 | |
| *** sudipto has joined #tripleo | 05:42 | |
| *** pkovar has joined #tripleo | 05:59 | |
| *** bkopilov has joined #tripleo | 06:06 | |
| *** skramaja has joined #tripleo | 06:07 | |
| *** ooolpbot has joined #tripleo | 06:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 06:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 06:11 |
| *** ooolpbot has quit IRC | 06:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 06:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 06:11 |
| *** pcaruana has joined #tripleo | 06:25 | |
| *** flepied has joined #tripleo | 06:34 | |
| *** pgadiya has joined #tripleo | 06:37 | |
| openstackgerrit | iswarya vakati proposed openstack/tripleo-validations: Removes unnecessary utf-8 encoding https://review.openstack.org/418728 | 06:39 |
| *** masco has joined #tripleo | 06:39 | |
| *** saneax-_-|AFK is now known as saneax | 06:45 | |
| *** pkovar has quit IRC | 06:49 | |
| *** florianf has joined #tripleo | 07:00 | |
| *** florianf has joined #tripleo | 07:00 | |
| *** dhill_ has quit IRC | 07:01 | |
| *** hjensas has quit IRC | 07:06 | |
| *** tesseract has joined #tripleo | 07:08 | |
| *** iranzo has joined #tripleo | 07:09 | |
| *** iranzo has joined #tripleo | 07:09 | |
| *** agurenko has joined #tripleo | 07:10 | |
| *** ooolpbot has joined #tripleo | 07:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 07:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 07:11 |
| *** ooolpbot has quit IRC | 07:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 07:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 07:11 |
| *** ealcaniz has joined #tripleo | 07:18 | |
| *** tremble has joined #tripleo | 07:19 | |
| *** tremble has quit IRC | 07:19 | |
| *** tremble has joined #tripleo | 07:19 | |
| *** udesale has joined #tripleo | 07:19 | |
| *** dhill_ has joined #tripleo | 07:23 | |
| *** ramishra has quit IRC | 07:27 | |
| *** ramishra has joined #tripleo | 07:29 | |
| *** rasca has joined #tripleo | 07:35 | |
| rasca | Morning guys! | 07:36 |
| matbu | o/ | 07:36 |
| *** dhill_ has quit IRC | 07:39 | |
| *** ramishra has quit IRC | 07:40 | |
| *** hewbrocca_afk is now known as hewbrocca | 07:43 | |
| *** dhill_ has joined #tripleo | 07:43 | |
| *** ramishra has joined #tripleo | 07:44 | |
| *** hjensas has joined #tripleo | 07:46 | |
| *** hjensas has quit IRC | 07:46 | |
| *** hjensas has joined #tripleo | 07:46 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates: Support for ScaleIO Cinder backend https://review.openstack.org/412089 | 07:47 |
| *** chem has joined #tripleo | 07:51 | |
| *** ramishra has quit IRC | 07:52 | |
| *** ebarrera has joined #tripleo | 07:52 | |
| *** aufi has joined #tripleo | 07:53 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Update docs for HA by default. https://review.openstack.org/418756 | 07:53 |
| *** ramishra has joined #tripleo | 07:54 | |
| *** bkopilov has quit IRC | 07:55 | |
| *** hogepodge has quit IRC | 07:56 | |
| *** aufi has quit IRC | 07:56 | |
| *** aufi has joined #tripleo | 07:56 | |
| *** abehl has joined #tripleo | 07:56 | |
| *** ccamacho has joined #tripleo | 07:57 | |
| *** pkovar has joined #tripleo | 07:59 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates: Automatically backup and restore Swift rings from the undercloud https://review.openstack.org/414460 | 08:02 |
| *** mcornea has joined #tripleo | 08:05 | |
| *** yamahata has quit IRC | 08:05 | |
| *** pkovar has quit IRC | 08:06 | |
| *** bana_k has quit IRC | 08:08 | |
| openstackgerrit | Merged openstack/tripleo-ui: Adds an id for the Login button for test automation https://review.openstack.org/409378 | 08:11 |
| *** ooolpbot has joined #tripleo | 08:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 08:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 08:11 |
| *** ooolpbot has quit IRC | 08:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 08:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 08:11 |
| *** cylopez has joined #tripleo | 08:13 | |
| *** ramishra has quit IRC | 08:15 | |
| *** ramishra has joined #tripleo | 08:17 | |
| *** dsariel has joined #tripleo | 08:17 | |
| *** flepied1 has joined #tripleo | 08:17 | |
| *** owalsh has joined #tripleo | 08:18 | |
| *** flepied has quit IRC | 08:19 | |
| *** jlinkes has joined #tripleo | 08:19 | |
| *** sudipto has quit IRC | 08:21 | |
| *** amoralej|off is now known as amorale | 08:22 | |
| *** sudipto_ has quit IRC | 08:23 | |
| *** sudipto has joined #tripleo | 08:23 | |
| *** sudipto_ has joined #tripleo | 08:23 | |
| openstackgerrit | Deepak Jon proposed openstack/python-tripleoclient: Removes unnecessary utf-8 encoding https://review.openstack.org/418770 | 08:31 |
| *** zoli|gone is now known as zoli|wfh | 08:34 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Add pacemaker composable upgrade steps https://review.openstack.org/403397 | 08:36 |
| *** panda|zZ is now known as panda | 08:46 | |
| *** pgadiya is now known as pgadiya|mtg | 08:50 | |
| *** pgadiya|mtg is now known as pgadiya | 08:50 | |
| *** jpich has joined #tripleo | 08:51 | |
| *** bkopilov has joined #tripleo | 08:51 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Composable upgrade steps for nova services https://review.openstack.org/418780 | 08:54 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Mark the baremetal workflows as failed when sending an ERROR https://review.openstack.org/418423 | 08:55 |
| jpich | florianf: Good morning! I have a question about https://review.openstack.org/#/c/417889/ | 08:56 |
| florianf | jpich: Good morning! Fire away! | 08:56 |
| jpich | florianf: I thought the point of having new deps separately was to get input from packagers before merging? Did I misunderstand? Is it so it can be packaged faster, before the main patch merges? | 08:56 |
| florianf | jpich: your're right | 08:57 |
| florianf | *you're | 08:57 |
| jpich | part 1? part 2? :-) | 08:57 |
| *** amorale is now known as amoralej | 08:58 | |
| florianf | jpich: You didn't misunderstand. I removed the workflow. Hope that will stop the merge | 08:58 |
| jpich | florianf: Oh, ok. I'll add a note to the "add dev docs" bug so we document this in there as well | 08:59 |
| *** zzzeek has quit IRC | 09:00 | |
| jpich | I'm not sure that removing the workflow will be enough to stop the merge | 09:00 |
| *** zzzeek has joined #tripleo | 09:00 | |
| jpich | I've seen people submit a new patch with e.g. a space change in the commit message to stop merges in the past, not sure if that still applies though | 09:00 |
| florianf | jpich: I shouldn't have started the workflow without input from the packaging folks. I'll add number80 as a reviewer. If it gets merged before that, we should probably revert? | 09:01 |
| florianf | jpich: And, yes, the purpose of separating the dep from the code was to make approving the dependency itself easier. | 09:01 |
| jpich | Yeah it seems to still be in the gate in zuul http://status.openstack.org/zuul/ | 09:02 |
| *** dsneddon has joined #tripleo | 09:02 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Add react-cookie https://review.openstack.org/417889 | 09:05 |
| *** jprovazn has joined #tripleo | 09:07 | |
| *** yprokule has joined #tripleo | 09:11 | |
| *** ooolpbot has joined #tripleo | 09:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 09:11 |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 09:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 09:11 |
| *** ooolpbot has quit IRC | 09:11 | |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 09:11 |
| *** jeckersb is now known as jeckersb_gone | 09:13 | |
| *** shardy has joined #tripleo | 09:13 | |
| *** jayg|g0n3 has quit IRC | 09:13 | |
| *** jeckersb_gone has quit IRC | 09:13 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: [WIP] Mark the baremetal workflows as failed when sending an ERROR https://review.openstack.org/418423 | 09:15 |
| *** mhenkel has joined #tripleo | 09:15 | |
| *** radez has quit IRC | 09:17 | |
| *** gfidente has joined #tripleo | 09:18 | |
| *** dmanchad|off is now known as dmanchad | 09:20 | |
| aparna | Hi shardy, Can you take a look at this dib patch https://review.openstack.org/#/c/396504/ when you have time? | 09:25 |
| *** milan has joined #tripleo | 09:28 | |
| jpich | jtomasek: Please read the comments on https://review.openstack.org/#/c/417889/ , this needs packager input first :( | 09:34 |
| jtomasek | jpich: sorry | 09:35 |
| jpich | jtomasek: No problems, florianf had the same issue! We need a better system to indicate this still waiting on other input... probably keeping at workflow-1 until we get the ack? | 09:36 |
| jtomasek | jpich: yeah, that could work | 09:36 |
| *** lucas-afk is now known as lucasagomes | 09:38 | |
| jpich | jtomasek: Just removing the workflow wasn't enough this morning, we had to do a rebase in order to create a new patchset... but this time it was still in the check gate so it looks like the flag was removed sufficiently early! yay | 09:39 |
| jtomasek | jpich: phew | 09:39 |
| jpich | I'll add the workflow -1 with an explanation for now | 09:39 |
| jpich | we'll see if that's enough :-) | 09:39 |
| jpich | florianf: you might find all this ^ amusing when you're back ;) | 09:42 |
| *** derekh has joined #tripleo | 09:42 | |
| *** karimb has joined #tripleo | 09:43 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 09:43 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Update app state when parameters get updated https://review.openstack.org/409825 | 09:43 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Environment parameters https://review.openstack.org/418798 | 09:43 |
| jtomasek | honza: ping when you're around | 09:44 |
| *** jpena|off is now known as jpena | 09:52 | |
| *** eglynn has joined #tripleo | 09:53 | |
| *** paramite has joined #tripleo | 09:54 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add basic example of loading kernel module before network config https://review.openstack.org/418809 | 09:57 |
| shardy | mhenkel: ^^ That's an example of a possible approach to loading a special kernel module before any network config | 09:58 |
| shardy | mhenkel: it's not tested, but hopefully illustrates the general approach | 09:58 |
| shardy | you're welcome to push fixes to that review if you'd like to make it a contrail specific example | 09:58 |
| mhenkel | shardy: Thanks! let me take a look and to some testing | 09:58 |
| *** jpena is now known as jpena|off | 10:06 | |
| *** jpena|off is now known as jpena | 10:06 | |
| *** karimb has quit IRC | 10:07 | |
| *** karimb has joined #tripleo | 10:09 | |
| *** ooolpbot has joined #tripleo | 10:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 10:11 |
| *** ooolpbot has quit IRC | 10:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 10:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 10:11 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 10:12 |
| *** udesale has quit IRC | 10:17 | |
| *** dsneddon has quit IRC | 10:18 | |
| *** prateek is now known as Prateek|afk | 10:24 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerize MySQL https://review.openstack.org/414601 | 10:28 |
| *** florianf has quit IRC | 10:29 | |
| *** agurenko_ has joined #tripleo | 10:33 | |
| *** agurenko has quit IRC | 10:33 | |
| *** florianf has joined #tripleo | 10:34 | |
| *** pkovar has joined #tripleo | 10:35 | |
| *** limao has quit IRC | 10:38 | |
| *** tosky has joined #tripleo | 10:40 | |
| openstackgerrit | Sanjay Upadhyay proposed openstack/os-net-config: Remove child members activation for OVS-DPDK bond https://review.openstack.org/417805 | 10:41 |
| *** dsneddon has joined #tripleo | 10:42 | |
| *** akrivoka has joined #tripleo | 10:42 | |
| *** karimb has quit IRC | 10:43 | |
| *** gfidente has quit IRC | 10:46 | |
| *** karimb has joined #tripleo | 10:49 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the baremetal workflows when sending a "FAILED" message https://review.openstack.org/418423 | 10:54 |
| *** agurenko has joined #tripleo | 10:54 | |
| *** agurenko_ has quit IRC | 10:55 | |
| owalsh | hi, who would be best to bother with questions about upgrades, and (I expect) composable upgrades? | 10:55 |
| marios | o/ owalsh hey shardy matbu chem mcornea me :) whats up | 10:56 |
| shardy | owalsh: Hey, yeah I'm happy to help if I can, what's up? | 10:58 |
| *** agurenko_ has joined #tripleo | 10:58 | |
| marios | shardy: o/ wasn't sure if you were still away hope you're feeling better | 10:59 |
| *** agurenko has quit IRC | 10:59 | |
| shardy | marios: Hey, thanks, yeah was off yesterday after feeling terrible all Monday but a little better today | 10:59 |
| marios | shardy: i'd like to harass you for something later if i can steal 5 mins (trying to make sense of jinja but mostly yaql for https://review.openstack.org/#/c/418344/ | 10:59 |
| marios | shardy: i came across your post at http://hardysteven.blogspot.com.cy/2016/10/tripleo-composablecustom-roles.html so i can at least get the j2 rendered files but still trying to work out how to dbug the yaql :) | 11:00 |
| matbu | marios: shardy i'm interested on "how to debug yaql" too :) | 11:01 |
| marios | shardy: ^^^ for that i mean "openstack overcloud plan create overcloud –templates my_tripleo_heat_templates" in particular | 11:01 |
| marios | shardy: ++ | 11:01 |
| shardy | marios: Oh, there's an easier way now, just to tox -e templates in t-h-t | 11:01 |
| shardy | s/to/do | 11:01 |
| shardy | it does the same rendering locally, dprince added it after I wrote that post | 11:02 |
| marios | shardy: really? /me looks | 11:02 |
| owalsh | cool, thanks guy. Let me see... the upgrade docs mention that the final converge step run puppet. Does this mean that puppet isn't run during the controller upgrade? | 11:02 |
| shardy | owalsh: for N->O upgrades that's not finally decided | 11:02 |
| marios | owalsh: yeah as with the previous upgrades workflow, during the actua 'ugprade your services' step the post-deploy steps (puppet run)) are no-opped | 11:03 |
| shardy | owalsh: for previous releases, we disabled puppet until all the computes were upgraded, because part of the upgrade was to pin the RPC version | 11:03 |
| marios | shardy: oh really? i thought we were going for the 2 steps still... (at least) | 11:03 |
| marios | shardy: i mean with a converge to actually apply the puppet | 11:03 |
| shardy | owalsh: but now we're using nova's ability to auto-detect the RPC version, so if that's proven to work, I think we can just apply puppet after the upgrade steps | 11:03 |
| marios | shardy: i thought we were only doing it in one step as part of the ci job | 11:03 |
| shardy | marios: well, we can, but I'm not sure we really have to | 11:03 |
| shardy | marios: yeah, we'll definitely do it in one step as part of the CI job, but it got me thinking, perhaps we no longer need to disable puppet at all for the controlplane upgrade | 11:04 |
| shardy | marios: what do you think? | 11:04 |
| shardy | it'd be much better if we could avoid the weird in-between state where things are upgraded but not converged | 11:04 |
| marios | shardy: hmm ok... so the immediate/obvious concern is the timeout (all in one). the other problem is the necessity to noop at least one (e.g. compute/ceph) node onto which you migrate workflows and then upgrade that next | 11:05 |
| shardy | and it'd also solve the problem of what to do re services which are e.g migrated under wsgi | 11:05 |
| shardy | we can just have puppet configure/start them | 11:05 |
| shardy | marios: yeah I think we can disable it for certain roles, but for pure controller roles, it'd be good to have the option of just letting puppet run? | 11:05 |
| shardy | marios: I'm expecting us to noop all upgrade things on the compute role | 11:06 |
| owalsh | shardy: yea, this weird in-between state will bite us in ocata | 11:06 |
| shardy | we just aren't doing that in CI | 11:06 |
| shardy | marios: and we can document how to do that for e.g CephStorage too, it's just a mapping to OS::Heat::None | 11:07 |
| marios | shardy: yes i can't immediately think of a reason not too assuming the time etc etc is OK. wondering if there is a problem with some puppet config applied on some nodes (e.g. all 'controllers') but no others yet (like 'computes') that maybe depend on eath other? | 11:07 |
| marios | shardy: but i guess we find that out by trying ^ | 11:07 |
| owalsh | shardy: we need the controller running the nova placement API before upgrading the computes | 11:07 |
| marios | shardy: i.e. before you'd get latest for all the things/nods... then apply config all at once at the end | 11:07 |
| shardy | marios: in those cases we could expose the ansible playbook for all roles, and folks can run the upgrade steps on each node | 11:07 |
| shardy | and/or we can push the same tasks onto the node so they're run via a script like before | 11:07 |
| cmyster | shardy: but is it bulks or one by one? | 11:08 |
| cmyster | say you have 2000 compute nodes | 11:08 |
| *** nyechiel_ has joined #tripleo | 11:08 | |
| shardy | cmyster: it'll be the same as before, we won't upgrade any of them | 11:08 |
| cmyster | so migrate? | 11:08 |
| shardy | we'll upgrade the control-plane, then stop, and enable operators to upgrade them one by one | 11:09 |
| shardy | or in batches, however they want | 11:09 |
| shardy | that's how it's worked for the past few releases | 11:09 |
| *** nmathew has quit IRC | 11:09 | |
| cmyster | ack | 11:09 |
| flaper87 | shardy: do you have 2 secs to review this? https://review.openstack.org/#/c/417706/ should be quick | 11:09 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add and fix environment files to create swap files/partitions https://review.openstack.org/418273 | 11:10 |
| shardy | owalsh: Ok, sounds like we'll be best to try running puppet - I'd much prefer we did tbh, as otherwise we've got a bunch of corner-cases already solved by puppet to fix | 11:10 |
| owalsh | shardy: what controls this? The value of UpgradeLevelNovaCompute? | 11:11 |
| shardy | marios: it sounds like from what owalsh is saying, the opposite is true, e.g it's fine to run with old computes, but we can't run with a partially upgraded controller and then upgrade the computes | 11:11 |
| *** ooolpbot has joined #tripleo | 11:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 11:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 11:11 |
| *** ooolpbot has quit IRC | 11:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 11:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 11:11 |
| marios | shardy: ack in which case it makes sense to go ahead apply config to controllers | 11:12 |
| shardy | owalsh: No, I think we'll deprecate that, as we just want to use "auto" | 11:12 |
| owalsh | marios: yes, ocata computes require the nova placement api to be running on the controller | 11:12 |
| marios | shardy: the whole run compute separately sounds like it is gaining favor then? (we've spoken about it before but sounds like you are backing that as the way forward?) | 11:12 |
| marios | shardy: in which case i can make https://review.openstack.org/#/c/418344/ much simpler | 11:12 |
| shardy | owalsh: that's still wired in, but can we just set the upgrade level to auto, then upgrade all the controllers, bring them back up, and upgrade the computes later? | 11:13 |
| marios | shardy: and not pass computes at all into the upgrade steps config | 11:13 |
| shardy | https://review.openstack.org/#/c/405241/1/puppet/services/nova-compute.yaml | 11:13 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Composable HA https://review.openstack.org/362389 | 11:13 |
| marios | shardy: but we still need to consider extracting the playbook and making it runnable by the operator (may mean e.g. splitting to a number of playbooks by step?) | 11:13 |
| shardy | marios: I don't think you need the exclude list at all, maybe we just add a conditional flag to roles_data | 11:14 |
| *** sudipto has quit IRC | 11:15 | |
| *** sudipto_ has quit IRC | 11:15 | |
| shardy | so the j2 rendering ignores e.g the Compute role | 11:15 |
| marios | shardy: yeah i considered adding something to roles_data initially (but then thought we neede dto specify 'a particula compute' and not 'all computes' | 11:15 |
| *** karimb_ has joined #tripleo | 11:15 | |
| shardy | no yaql required ;) | 11:15 |
| shardy | marios: I think at this point we need to go for the simplest possible way to get parity with the old upgrade experience | 11:15 |
| shardy | which is probably just a j2 flag which disables upgrades on Compute nodes? | 11:16 |
| *** milan has quit IRC | 11:16 | |
| shardy | we didn't support partially upgrading Compute nodes before, so I'd say that's a possible future RFE | 11:16 |
| *** karimb has quit IRC | 11:16 | |
| marios | shardy: indeed :) i was thinking of adding it here https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L609 to not pass in the compute servers at all (I guess I can just use a flag in the roles_data rather than trying to pattern match on name | 11:17 |
| shardy | marios: No, you can just add an if statement in major_upgrade_steps.j2.yaml | 11:17 |
| marios | shardy: ok is there an advantage doing it there instead? I mean the latter will have to run for every step of every node of every role | 11:18 |
| shardy | {% if role.upgrade_enabled|default(false) %} | 11:19 |
| shardy | marios: No, it'll run exactly once when the file is rendered by j2? | 11:19 |
| shardy | marios: the advantage is mainly we keep all upgrade logic in the same place | 11:19 |
| shardy | it seems simpler to me, but open to other ideas ;) | 11:19 |
| shardy | {% if role.upgrade_enabled|default(true) %} actually :) | 11:20 |
| marios | shardy: ok thanks i am stil confused by the j2 rendering it seems | 11:20 |
| shardy | marios: Ok, the way it works is we take the j2.yaml and render it once when we do the plan create | 11:20 |
| chem | shardy: if it's matching role then we could use the conditionals mechanism from heat and say if <some_env_var> is true then skip the creation of the resource, no jinja required. | 11:21 |
| shardy | at that point, we've got the option of doing stuff like conditionally excluding a role based on either the name or a flag defined in the roles_data.yaml | 11:21 |
| shardy | chem: we could, but wouldn't it be simpler to just have an optional flag in roles_data.yaml? | 11:21 |
| marios | shardy: i think i am confusing that my review at https://review.openstack.org/#/c/418344/1/puppet/major_upgrade_steps.j2.yaml has yaql that is evaluated for every step of every role | 11:22 |
| marios | shardy: the if clause you suggest is way above that and is actually for the j2 (for role in roles) | 11:22 |
| shardy | marios: yeah, exactly | 11:22 |
| shardy | it imposes zero runtime overhead on the upgrade | 11:22 |
| shardy | which is nice :) | 11:22 |
| shardy | marios: sec, let me test locally and paste the results | 11:23 |
| chem | shardy: marios I still don't get how we're going to upgrade compute 1 to 10 and then upgrade computer 11 to 20 and then ... | 11:23 |
| marios | shardy: ok great will change the review momentarily anyway ... I think we will need to also exclude ceph nodes/whetever but the really nice thing about this is the flag in roles_data.yaml so it is up to the operator what their roles are called and whether particular role should not be upgraded with the steps | 11:24 |
| shardy | chem: we aren't - previous versions couldn't do that, they just wrote a script and left it for the operator to drive? | 11:24 |
| marios | chem: the in batches thing is not worked out yet | 11:24 |
| shardy | chem: I think that has to be something we tackle in pike | 11:24 |
| marios | chem: shardy yeah exactly it will be some mechanism we use/from ansible or by whatever tooling we write to extract the playbooks and let the operator run them on the nodes | 11:25 |
| shardy | chem: and there's ways of doing it - e.g SoftwareDeploymentGroup already supports batched updates | 11:25 |
| shardy | chem: or, we can expose the ansible playbooks which also allows batched operations | 11:25 |
| chem | shardy: marios it was possible to do it by specifying 'nova-compute-[1-9]' and then 'nova-compute-1[0-9]' and so no .. on the cli | 11:25 |
| shardy | chem: via which command? | 11:25 |
| marios | chem: well there was a script that ran the script on particular non-controller | 11:25 |
| mcornea | shardy: marios how about disabling upgrades on custom roles? is this something that would be possible? | 11:26 |
| chem | shardy: upgrade-non-controller | 11:26 |
| marios | chem: the operator could just run that simultaneously on many nodes | 11:26 |
| shardy | chem: Yeah, I'm saying we just make that work exactly the same as before | 11:26 |
| marios | mcornea: yeah that is exactly what we will do it will be a flag in roles_data.yaml | 11:26 |
| shardy | nothing about composable upgrades changes that AFAICS | 11:26 |
| marios | mcornea: for the role | 11:26 |
| shardy | mcornea: Yeah, sec I'm about to push a patch which does exactly that | 11:26 |
| chem | shardy: so we land a script during the upgrade and keep the non controller script in place. Yeah, that sounds good to me. | 11:26 |
| marios | chem: the compute[1-9] bit maybe you are confusing witht the minor update where you could clear the breakpoints from multiple n odes | 11:27 |
| shardy | chem: Yeah, basically as a first step I think we do that | 11:27 |
| marios | shardy: oh | 11:27 |
| *** karimb has joined #tripleo | 11:27 | |
| matbu | i think the best thing to do, is to run ansible from the undercloud and just manage the node and roles with the inventory file | 11:27 |
| marios | shardy: i was going to update https://review.openstack.org/#/c/418344/ | 11:27 |
| *** karimb_ has quit IRC | 11:27 | |
| marios | shardy: but it sounds like you are getting a review out ? | 11:27 |
| *** dtantsur|afk is now known as dtantsur | 11:27 | |
| matbu | like we previoulsy tried with jistr | 11:27 |
| chem | shardy: marios so it's not necessary to "disable" any node from the upgrade, as we just make the non-controller upgrade a "depose a script in there" step | 11:28 |
| shardy | matbu: we run the risk or running out of time for ocata, but yes that's one option | 11:28 |
| shardy | matbu: my preference (for ocata) is to not change any of the compute upgrade stuff at all | 11:28 |
| shardy | just use the exact same scripts | 11:28 |
| matbu | shardy: yes, i don't think we would have to do that for ocata but for pike it would be nice | 11:28 |
| matbu | shardy: yes +1 | 11:29 |
| shardy | then we don't have to change any of the testing, docs etc etc | 11:29 |
| matbu | yes agree, and i think we are close | 11:29 |
| shardy | matbu: Yeah, agreed - lets get it tracked for pike, it would be nice | 11:29 |
| marios | chem: we will disable the upgrade on the roles for which you will set a particular flag in roles_data | 11:30 |
| marios | shardy: sorry, it wasn't clear to me | 11:30 |
| florianf | jpich, jtomasek: Looks like we really need a better system for this. :) | 11:30 |
| *** panda is now known as panda|lunch | 11:30 | |
| marios | shardy: are you putting a review out | 11:30 |
| marios | shardy: or should i update my reivew? | 11:30 |
| shardy | marios: I don't mind - I was about to do one, but if you're on it then go ahead | 11:30 |
| jpich | florianf: :) | 11:30 |
| marios | shardy: ok i will go ahead and update this one then rather than abandon it if its all the same to you | 11:31 |
| florianf | jpich, jtomasek: But at least we've sucessfully tested that a rebase might be the fastest way to stop it :-) | 11:32 |
| shardy | marios: cool, sounds good, thanks! | 11:32 |
| jpich | florianf: Yeah! And also if the workflow flag is removed during the 'check' tests then it's enough as well | 11:32 |
| jpich | Much learning | 11:32 |
| marios | thanks very much for your help shardy as always | 11:32 |
| mcornea | shardy: marios and doing the upgrade in batches or one by one would work for the custom roles as well? say I've got 2 networker nodes I want to upgrade them one by one so I keep one l3 agent running at a time so it can failover | 11:32 |
| marios | mcornea: well it would be operator driven (the upgrade those special nodes whatever they are) | 11:33 |
| florianf | jpich: yeah! such wow! | 11:33 |
| marios | mcornea: so yeah it should be possible | 11:33 |
| shardy | Yeah, we provide the choice to either upgrade all the custom roles, or do nothing and expose/deploy a script with the upgrade tasks instead | 11:33 |
| mcornea | sounds great, thanks | 11:35 |
| *** dsneddon has quit IRC | 11:38 | |
| *** jpena is now known as jpena|longlunch | 11:45 | |
| openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo: Explicitly set service URLs in the UI config https://review.openstack.org/388592 | 11:47 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Fix error path for tools/process-templates.py https://review.openstack.org/418879 | 11:47 |
| *** jkilpatr has quit IRC | 11:48 | |
| shardy | marios: ^^ hey I found a problem with using tox -e templates to test the j2 templates, that's the fix | 11:48 |
| shardy | it breaks when you make a mistake and the j2 rendering blows up | 11:48 |
| marios | shardy: ack thanks for letting me know... i was about to post the review and then test the j2 (worried about the indentation if it is all ok) | 11:50 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add disable_upgrade flag to roles_data.yaml https://review.openstack.org/418344 | 11:51 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add and fix environment files to create swap files/partitions https://review.openstack.org/418273 | 11:51 |
| marios | shardy: ah already spotted on error at https://review.openstack.org/#/c/418344/2/puppet/major_upgrade_steps.j2.yaml | 11:54 |
| marios | shardy: i'll need to split it into two ifs | 11:54 |
| shardy | marios: Yeah you have to be careful with indentation, as you can't necessarily indent the j2 blocks without breaking the yaml | 11:54 |
| marios | shardy: ack well i have a way to render it at least now thanks will update in a bit | 11:55 |
| *** panda|lunch is now known as panda | 11:55 | |
| honza | jtomasek: hey, how can i help? | 11:58 |
| *** arxcruz has quit IRC | 12:01 | |
| *** zoli|wfh is now known as zoli|lunch | 12:02 | |
| *** masco has quit IRC | 12:04 | |
| *** tzumainn has joined #tripleo | 12:06 | |
| *** jkilpatr has joined #tripleo | 12:09 | |
| *** morazi-afk has quit IRC | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 12:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 12:11 |
| *** ooolpbot has quit IRC | 12:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 12:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 12:11 |
| jtomasek | honza: when I run shrinkwrap it does changes such as this http://paste.openstack.org/show/594547/ | 12:16 |
| *** jkilpatr has quit IRC | 12:16 | |
| jtomasek | honza: how do you avoid it? | 12:16 |
| *** mcornea_ has joined #tripleo | 12:17 | |
| *** mcornea has quit IRC | 12:19 | |
| honza | jtomasek: are you still using npm 2? | 12:19 |
| *** arxcruz has joined #tripleo | 12:20 | |
| jtomasek | honza: I am, is that it? | 12:20 |
| *** gfidente has joined #tripleo | 12:22 | |
| *** gfidente has quit IRC | 12:22 | |
| *** gfidente has joined #tripleo | 12:22 | |
| EmilienM | hello | 12:23 |
| *** jeckersb_gone has joined #tripleo | 12:25 | |
| *** jayg|g0n3 has joined #tripleo | 12:25 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add disable_upgrade flag to roles_data.yaml https://review.openstack.org/418344 | 12:26 |
| *** jayg|g0n3 has quit IRC | 12:29 | |
| *** jkilpatr has joined #tripleo | 12:29 | |
| *** jayg|g0n3 has joined #tripleo | 12:29 | |
| shardy | morning EmilienM! | 12:29 |
| *** jeckersb_gone has quit IRC | 12:29 | |
| honza | jtomasek: no idea why it's doing that; can't reproduce --- try running "npm cache clean" before shrinkwrap | 12:29 |
| *** jeckersb_gone has joined #tripleo | 12:30 | |
| honza | jtomasek: npm version 2.15.9 | 12:30 |
| honza | jtomasek: npm people say you should treat the shrinkwrap file as an opaque binary file :D | 12:31 |
| jtomasek | honza: yarn is a way to go imho :) | 12:32 |
| *** radez has joined #tripleo | 12:32 | |
| honza | jtomasek: don't start | 12:32 |
| jtomasek | lol | 12:32 |
| *** ccamacho is now known as ccamacho|lunch | 12:32 | |
| honza | jtomasek: i'm not opposed except for all the infra changes we'd need to make | 12:33 |
| jtomasek | yeah | 12:33 |
| jtomasek | honza: https://github.com/npm/npm/issues/9550 | 12:35 |
| honza | jtomasek: your google-fu is better than mine | 12:36 |
| openstackgerrit | Merged openstack/tripleo-quickstart: updates to the readme https://review.openstack.org/418133 | 12:37 |
| honza | jtomasek: i think the explanation makes sense but lololol | 12:40 |
| jtomasek | haha, yeah | 12:40 |
| *** milan has joined #tripleo | 12:41 | |
| *** aparna has quit IRC | 12:41 | |
| jtomasek | honza: I am now trying to answer the question whether those should be urls or not | 12:41 |
| *** fzdarsky has joined #tripleo | 12:42 | |
| *** psahoo has quit IRC | 12:42 | |
| honza | jtomasek: i'd say if you're writing a patch to update the shrinkwrap file you do: 1) rm -rf node_modules 2) npm cache clean 3) npm install 4) npm shrinkwrap and then commit the changes | 12:42 |
| honza | and just accept whatever it says :) | 12:43 |
| jtomasek | honza: right | 12:43 |
| *** shardy is now known as shardy_lunch | 12:43 | |
| jtomasek | I'll test it, I need to add another dependency which is currently part of https://review.openstack.org/418798 but I'll split it and include shrinkwrap update | 12:44 |
| *** saneax is now known as saneax-_-|AFK | 12:45 | |
| *** karimb has quit IRC | 12:47 | |
| *** pgadiya has quit IRC | 12:48 | |
| *** lucasagomes is now known as lucas-hungry | 12:50 | |
| *** pblaho has quit IRC | 12:50 | |
| *** rbrady-afk is now known as rbrady | 12:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova Placement API profile https://review.openstack.org/406309 | 12:52 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova Placement API profile https://review.openstack.org/406309 | 12:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Nova Placement API composable service https://review.openstack.org/406397 | 12:52 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: DNM: add --debug in pingtest to find CI issues https://review.openstack.org/417134 | 12:52 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Update docs for HA by default. https://review.openstack.org/418756 | 12:53 |
| *** sudipto has joined #tripleo | 12:56 | |
| *** sudipto_ has joined #tripleo | 12:56 | |
| *** owalsh_ has joined #tripleo | 12:58 | |
| *** owalsh has quit IRC | 12:59 | |
| *** owalsh_ has quit IRC | 12:59 | |
| *** pblaho has joined #tripleo | 12:59 | |
| *** owalsh_ has joined #tripleo | 12:59 | |
| *** thrash|g0ne is now known as thrash | 13:00 | |
| *** morazi has joined #tripleo | 13:00 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs https://review.openstack.org/418562 | 13:02 |
| *** zoli|lunch is now known as zoli|wfh | 13:04 | |
| *** dprince has joined #tripleo | 13:04 | |
| sshnaidm | EmilienM, hi | 13:05 |
| *** liverpooler has quit IRC | 13:05 | |
| sshnaidm | EmilienM, I have containers job working and ready to merge. Do we want it regular job? Right now it's in experimental queue | 13:05 |
| EmilienM | sshnaidm: where can I see it? | 13:05 |
| sshnaidm | EmilienM, https://review.openstack.org/#/c/416259/ fixing commit message now | 13:06 |
| EmilienM | sshnaidm: where is it tested, in gate-tripleo-ci-centos-7-ovb-containers-oooq ? | 13:07 |
| sshnaidm | EmilienM, right | 13:07 |
| *** chlong has joined #tripleo | 13:07 | |
| EmilienM | sshnaidm: where is overcloud logs? http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/ | 13:08 |
| *** morazi has quit IRC | 13:08 | |
| sshnaidm | EmilienM, checking.. | 13:09 |
| jistr | sshnaidm: it's probably not collecting them due to the bug we discussed earlier? | 13:09 |
| sshnaidm | jistr, may be.. but I want to be sure | 13:10 |
| jistr | still i'd be +1 on making it a regular job (non-voting for now) | 13:10 |
| EmilienM | yes, +1 too but without log collections, how to debug things when it's red? | 13:11 |
| *** ooolpbot has joined #tripleo | 13:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 13:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 13:11 |
| *** ooolpbot has quit IRC | 13:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 13:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 13:11 |
| EmilienM | where are pingtest logs on http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/console.html ? | 13:11 |
| EmilienM | how can we see it actually deploys OpenStack and this cloud is working? | 13:11 |
| *** jayg|g0n3 is now known as jayg | 13:12 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Neutron composable upgrade with ansible https://review.openstack.org/418920 | 13:12 |
| *** shardy_lunch has quit IRC | 13:12 | |
| EmilienM | sshnaidm: ^ | 13:14 |
| *** ansmith has joined #tripleo | 13:14 | |
| sshnaidm | EmilienM, http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/undercloud/var/log/oooq/collected_logs/undercloud/home/jenkins/ | 13:14 |
| sshnaidm | EmilienM, deploy log: http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/undercloud/var/log/oooq/collected_logs/undercloud/home/jenkins/overcloud_deploy.log.gz | 13:14 |
| EmilienM | http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/undercloud/var/log/oooq/collected_logs/ | 13:14 |
| sshnaidm | EmilienM, pingtest log: overcloud_validate.log.gz | 13:15 |
| EmilienM | where is overcloud? | 13:15 |
| EmilienM | sshnaidm: where is overcloud_validate.log.gz ? | 13:15 |
| sshnaidm | EmilienM, there is know issue with oooq collecting logs from overcloud, we are working on this: https://review.openstack.org/#/c/417502/ | 13:15 |
| sshnaidm | EmilienM, http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/undercloud/var/log/oooq/collected_logs/undercloud/home/jenkins/overcloud_validate.log.gz | 13:16 |
| EmilienM | sshnaidm: it would be great to be able to browse it without downloading it | 13:16 |
| sshnaidm | EmilienM, and tempest: http://logs.openstack.org/59/416259/14/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/1e72f10/logs/undercloud/var/log/oooq/collected_logs/undercloud/home/jenkins/tempest/tempest.html.gz | 13:16 |
| sshnaidm | EmilienM, that's a problem, yeah, not sure what causes it. | 13:16 |
| sshnaidm | EmilienM, it's on todo queue too | 13:17 |
| panda | sshnaidm: have you tried renaming *.log to *.txt ? | 13:17 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add support for the deployment of Ceph MDS https://review.openstack.org/402389 | 13:17 |
| sshnaidm | panda, I think that's a problem actually, not checked it yet | 13:17 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Make collect_logs less error prone. https://review.openstack.org/418614 | 13:17 |
| *** ansmith_ has joined #tripleo | 13:17 | |
| EmilienM | sshnaidm: ok, fair enough. Sounds like things are in queue, so it's good to me. https://review.openstack.org/#/c/416259/ can be merged imho | 13:17 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient: Add overcloud support report command https://review.openstack.org/405001 | 13:17 |
| sshnaidm | EmilienM, ok, giving it last shoot with new commit msg | 13:18 |
| *** fultonj has joined #tripleo | 13:18 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart https://review.openstack.org/416259 | 13:18 |
| *** shardy_lunch has joined #tripleo | 13:19 | |
| *** bfournie has quit IRC | 13:19 | |
| *** dsariel has quit IRC | 13:19 | |
| *** morazi has joined #tripleo | 13:20 | |
| *** trown|outtypewww is now known as trown | 13:22 | |
| *** amoralej is now known as amoralej|lunch | 13:28 | |
| *** shardy_lunch is now known as shardy | 13:28 | |
| *** shardy has quit IRC | 13:28 | |
| *** shardy has joined #tripleo | 13:29 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 13:31 |
| *** karimb has joined #tripleo | 13:32 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Keep Ceilometer api enabled for Ocata Undercloud https://review.openstack.org/418422 | 13:32 |
| skramaja | EmilienM: i have put my analysis on rabbitmq password issue @https://review.openstack.org/#/c/402061/7/manifests/profile/base/rabbitmq.pp@112, PTAL | 13:33 |
| EmilienM | skramaja: sure thing I'll look asap | 13:34 |
| trown | EmilienM: sshnaidm, the browsability thing with logs is the .log extension instead of .txt ... maybe we could get infra to add .log to the log server config... alternatively we can change all quickstart default logs to be .txt | 13:36 |
| *** colonwq has joined #tripleo | 13:37 | |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo: Set ceph key when using manila ceph backend https://review.openstack.org/405999 | 13:38 |
| EmilienM | trown: it would be useful to pick one of both solutions. | 13:39 |
| *** rlandy has joined #tripleo | 13:39 | |
| *** agurenko_ has quit IRC | 13:39 | |
| sshnaidm | trown, infra would rename it if we didn't gzip them: https://github.com/openstack-infra/devstack-gate/blob/615cae89a3c4b15052528787c34b3743ae6e8845/functions.sh#L946-L946 | 13:39 |
| trown | sshnaidm: ah, well that would be an easier fix than renaming every default log | 13:40 |
| *** gkadam has quit IRC | 13:40 | |
| EmilienM | flaper87: FYI - I plan to abandon https://review.openstack.org/#/q/status:open++topic:g-registry/removal as it's not something we'll merge anytime soon. I think we'll need to keep Glance Registry for a while. I'll restore them, hopefully one dayu | 13:40 |
| trown | adarazs: ^ | 13:40 |
| *** owalsh_ is now known as owalsh-lunch | 13:40 | |
| *** smalleni has quit IRC | 13:40 | |
| *** ccamacho|lunch is now known as ccamacho | 13:41 | |
| *** lucas-hungry has quit IRC | 13:41 | |
| *** rook has quit IRC | 13:41 | |
| adarazs | trown: sshnaidm: I can add an option to not gzip them :) | 13:41 |
| sshnaidm | adarazs, cool! | 13:41 |
| flaper87 | EmilienM: yeah, :/ fwiw, I'll follow up with the heat team | 13:41 |
| adarazs | I'm knee-deep in the log stuff anyway because of the third-party logserver. | 13:41 |
| sshnaidm | adarazs, is artcl_gzip_only for it..? | 13:41 |
| EmilienM | flaper87: ack. Thx. | 13:42 |
| adarazs | sshnaidm: well, currently we have two mode: either create one tar.gz per node or gzip them individually, there's no way (currently) to just pull them over as they are. | 13:42 |
| adarazs | sshnaidm: because the individual gzipping happens on the nodes to save resource on the slave. | 13:43 |
| adarazs | then I tar them all and pull them over and untar them | 13:43 |
| sshnaidm | adarazs, ok | 13:43 |
| adarazs | sshnaidm: but we can use the tar.gz solution and unpack them in the last step. | 13:43 |
| *** colonwq has quit IRC | 13:44 | |
| thrash | EmilienM: interesting... We've now got original test passing, both it and a related test failed, now the original passed, and the other test failed. | 13:44 |
| EmilienM | thrash: yea, it's very inconsistent. | 13:44 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Add packaging documentation https://review.openstack.org/418941 | 13:44 |
| EmilienM | thrash: sounds like races in mistral, most probably | 13:45 |
| thrash | At least the tests that are related are the ones failing and not just random tests. | 13:45 |
| thrash | EmilienM: that's my thought. | 13:45 |
| sshnaidm | adarazs, sounds good, we can omit gzipping for conf, dat, log, it's done by infra: https://github.com/openstack-infra/devstack-gate/blob/615cae89a3c4b15052528787c34b3743ae6e8845/functions.sh#L972-L974 | 13:45 |
| thrash | EmilienM: I'll leave that review there so that I can easily test any possible fixes. | 13:45 |
| thrash | EmilienM: I'll update the lpb | 13:45 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Composable HA https://review.openstack.org/362389 | 13:45 |
| EmilienM | thrash: yeah, and let me know if you need more debug level | 13:45 |
| *** tommylikehu has joined #tripleo | 13:46 | |
| thrash | EmilienM: ack | 13:46 |
| sshnaidm | adarazs, and shell scripts are not compressed anyway.. | 13:46 |
| adarazs | sshnaidm: they are uncompressed after transfer. | 13:47 |
| adarazs | because the doc generation needs them | 13:47 |
| *** sai has joined #tripleo | 13:47 | |
| sshnaidm | adarazs, uh, ok | 13:47 |
| adarazs | sshnaidm: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/collect-logs/tasks/create-docs.yml#L7-L12 | 13:47 |
| *** lucasagomes has joined #tripleo | 13:47 | |
| *** rook has joined #tripleo | 13:49 | |
| *** rook is now known as Guest22365 | 13:49 | |
| *** trown is now known as trown|brb | 13:49 | |
| sshnaidm | adarazs, cool, so you can do the same task, just with ".log" | 13:50 |
| adarazs | sshnaidm: wouldn't it be more simple to just not gzip anything? | 13:50 |
| *** rhallisey has joined #tripleo | 13:50 | |
| sshnaidm | adarazs, oh, you're right :) | 13:52 |
| adarazs | sshnaidm: I'll put up a patch in ~15 minutes. | 13:53 |
| *** hjensas has quit IRC | 13:55 | |
| *** colonwq has joined #tripleo | 13:56 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart https://review.openstack.org/416259 | 13:56 |
| *** owalsh-lunch has quit IRC | 13:56 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add support for a new job testing Heat Convergence https://review.openstack.org/417601 | 13:56 |
| *** david-lyle has quit IRC | 13:56 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: scenario001/pingtest: remove gnocchi_res_alarm https://review.openstack.org/417891 | 13:56 |
| *** lblanchard has joined #tripleo | 13:58 | |
| openstackgerrit | Chris Jones proposed openstack/puppet-tripleo: Add support for fence_ironic fencing agent. https://review.openstack.org/390397 | 13:59 |
| *** david-lyle has joined #tripleo | 13:59 | |
| *** [1]cdearborn has joined #tripleo | 14:01 | |
| *** athomas has quit IRC | 14:01 | |
| openstackgerrit | Chris Jones proposed openstack/puppet-pacemaker: Add support for fence_ironic fencing agent. https://review.openstack.org/390396 | 14:01 |
| *** links has quit IRC | 14:02 | |
| *** Prateek|afk has quit IRC | 14:03 | |
| *** trown|brb is now known as trown | 14:04 | |
| EmilienM | jpich: I moved https://bugs.launchpad.net/tripleo/+bug/1655603 to High and ocata-3, this one seems pretty important | 14:04 |
| openstack | Launchpad bug 1655603 in tripleo "post-deployment validations are triggered at every login" [High,Triaged] | 14:04 |
| trozet | beagles, EmilienM: can you please review https://review.openstack.org/#/c/418495/ and https://review.openstack.org/#/c/417417/ when you get a chance? | 14:05 |
| EmilienM | trozet: ack | 14:05 |
| trozet | EmilienM: ty | 14:05 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Run oooq with undercloud_user https://review.openstack.org/418952 | 14:06 |
| *** jprovazn has quit IRC | 14:06 | |
| jpich | EmilienM: Thanks. I'd have put it in the "really really annoying but doesn't break anything" category but maybe I'm missing some of the side-effects | 14:06 |
| jpich | jtomasek: I think you looked into this, once upon a time ^ | 14:06 |
| EmilienM | jpich: feel free to set Medium then | 14:07 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 14:07 |
| *** hjensas has joined #tripleo | 14:07 | |
| *** hjensas has quit IRC | 14:07 | |
| *** hjensas has joined #tripleo | 14:07 | |
| jpich | EmilienM: Thank you for all the triaging work! | 14:07 |
| *** jprovazn has joined #tripleo | 14:07 | |
| jtomasek | jpich: I've assigned myself | 14:08 |
| *** athomas has joined #tripleo | 14:09 | |
| jpich | jtomasek: Hey, thank you! Do you think it's easy to fix? It's real annoying but I don't think it actually breaks anything (or causes performance issues? Would it?). Well I put my thoughts in a comment anyway :) | 14:09 |
| jtomasek | jpich: it should be simple to fix | 14:10 |
| *** ooolpbot has joined #tripleo | 14:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 14:11 |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 14:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 14:11 |
| *** ooolpbot has quit IRC | 14:11 | |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 14:11 |
| jpich | jtomasek: Don't let me slow you down then, it can be confusing! :) Thanks a lot | 14:11 |
| *** jeckersb_gone is now known as jeckersb | 14:11 | |
| Ng | is anyone else seeing overcloud deployment failing with: Error while evaluating a Resource Statement, Openstacklib::Db::Mysql[nova_api_cell0]: has no parameter named 'create_user' at /etc/puppet/modules/nova/manifests/db/mysql_api.pp:63 ? | 14:12 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the deployment workflows when sending a "FAILED" message https://review.openstack.org/418423 | 14:13 |
| Ng | I'm using t-h-t and puppet-nova from git, so I should have the nova cell patches that went in over the last couple of weeks | 14:13 |
| shardy | Ng: Hmm, I was about to ask do you have the latest puppet-nova ;) | 14:14 |
| shardy | Ng: how are you deploying the modules from git, via upload-puppet-modules? | 14:14 |
| EmilienM | jpich: no prob :) | 14:14 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the deployment workflows when sending a "FAILED" message https://review.openstack.org/418961 | 14:14 |
| EmilienM | jpich: the cat is helping today :P | 14:14 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the baremetal workflows when sending a "FAILED" message https://review.openstack.org/418423 | 14:15 |
| Ng | shardy: no, I'm virt-customize'ing them into the overcloud image's /usr/share/openstack-puppet/modules/ | 14:15 |
| *** liverpooler has joined #tripleo | 14:16 | |
| *** david-lyle has quit IRC | 14:16 | |
| jpich | EmilienM: Cat-driven development is where it's at! She looks super lovely | 14:16 |
| shardy | Ng: ack, well that should work but mkdir puppet-modules && git clone url/to/puppet-nova puppet-modules/nova && upload-puppet-modules -d puppet-modules may be easier | 14:17 |
| Ng | shardy: I blame bandini, I copied this script from him ;D | 14:18 |
| shardy | Ng: I guess you've made sure of the paths etc, e.g I've made mistakes before like cloning puppet-nova as "puppet-nova", then copying that dir | 14:18 |
| Ng | but I can confirm that the overcloud controller node which threw that error, has current puppet-nova in /u/s/o-p/modules/nova/ | 14:18 |
| shardy | but it needs to be "nova" | 14:18 |
| shardy | hrm, OK I'm out of ideas for now then, sorry :) | 14:18 |
| * shardy pulls the latest things and sees if he can reproduce | 14:18 | |
| Ng | https://github.com/openstack/puppet-nova/blob/master/manifests/db/mysql_api.pp#L71 it's that line it's objecting to | 14:19 |
| shardy | Ng: the error is about openstacklib, I assume you updated that too? | 14:19 |
| Ng | well :) | 14:19 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the plan_management workflows when sending a "FAILED" message https://review.openstack.org/418964 | 14:20 |
| *** Goneri has joined #tripleo | 14:20 | |
| *** jcoufal has joined #tripleo | 14:21 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the scale workflows when sending a "FAILED" message https://review.openstack.org/418966 | 14:21 |
| EmilienM | Ng: yeah, we added cell0 support, you need to update tht, puppet-tripleo, puppet-nova and puppet-openstacklib | 14:21 |
| Ng | thanks, I should have noticed the error was actually telling me openstacklib | 14:22 |
| *** udesale has joined #tripleo | 14:22 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Adds ids namespaced artifacts on plans page. https://review.openstack.org/411102 | 14:22 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Add i18n strings to validations components https://review.openstack.org/418967 | 14:24 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fail the validation workflows when sending a "FAILED" message https://review.openstack.org/418968 | 14:24 |
| *** dmarlin_ has quit IRC | 14:25 | |
| *** leanderthal has joined #tripleo | 14:25 | |
| *** dmarlin has joined #tripleo | 14:25 | |
| *** dmarlin is now known as dmarlin_ | 14:26 | |
| *** karthiks has quit IRC | 14:26 | |
| *** saneax-_-|AFK is now known as saneax | 14:27 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras: Use shell instead of command https://review.openstack.org/418581 | 14:28 |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras: Use shell instead of command https://review.openstack.org/418581 | 14:29 |
| *** skramaja has quit IRC | 14:30 | |
| *** florianf has quit IRC | 14:31 | |
| fpan | EmilienM: could you look at https://review.openstack.org/#/c/414730/ again when you get a chance, puppet-etcd is now in rdo | 14:31 |
| larsks | ccamacho, if you're around: you commented on https://review.openstack.org/#/c/411048/16 that I should update the heat_template_version to ocata. Is that just for bookeeping purposes? The tepmlate does not require any ocata-specific features. | 14:36 |
| EmilienM | fpan: done. | 14:36 |
| *** chlong has quit IRC | 14:37 | |
| d0ugal | thrash: so do you think I should +W it? | 14:37 |
| *** florianf has joined #tripleo | 14:37 | |
| thrash | d0ugal: done. :) | 14:38 |
| d0ugal | thrash: thanks! | 14:38 |
| thrash | d0ugal: http://paste.openstack.org/show/594561/ | 14:38 |
| thrash | that's what I'm getting... | 14:38 |
| thrash | d0ugal: trying to run from venv with python mistral/cmd/launch.py --server all --config-file etc/mistral.conf | 14:38 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Use rdo-qemu-ev repo in mitaka jobs https://review.openstack.org/418510 | 14:38 |
| thrash | d0ugal: and all I've set in mistral.conf is transport_url = fake://localhost/ and rpc_backend = fake | 14:39 |
| *** egafford has joined #tripleo | 14:39 | |
| thrash | I've also tried with just transport_url = fake:/// | 14:39 |
| thrash | and just rpc_backend = fake | 14:39 |
| ccamacho | hey larsks yeahp, we support release name aliases, so from now in each branch the header should have the release name as an alias | 14:39 |
| larsks | ccamacho, okay, will do. | 14:40 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova Placement API profile https://review.openstack.org/406309 | 14:40 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Deploy Nova Placement API on the undercloud https://review.openstack.org/417371 | 14:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Nova Placement API composable service https://review.openstack.org/406397 | 14:41 |
| *** Guest22365 is now known as rook | 14:42 | |
| *** rook is now known as Guest43791 | 14:43 | |
| *** owalsh-lunch has joined #tripleo | 14:47 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo: updates to collectd support https://review.openstack.org/417509 | 14:47 |
| *** owalsh-lunch is now known as owalsh | 14:48 | |
| *** amoralej|lunch is now known as amoralej | 14:49 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Refresh node table only once https://review.openstack.org/417396 | 14:49 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Add monitoring and logging agents deployment to CI https://review.openstack.org/410210 | 14:55 |
| EmilienM | bnemec: https://review.openstack.org/#/c/418948/ | 14:57 |
| *** dsariel has joined #tripleo | 14:57 | |
| bnemec | EmilienM: We don't have reno support in all of those projects yet, do we? | 14:58 |
| EmilienM | bnemec: not yet, it's WIP | 14:58 |
| EmilienM | bnemec: I'll add the files when we have the jobs in place so we can actually test it. | 14:59 |
| *** jpena|longlunch is now known as jpena | 15:00 | |
| trozet | shardy: you around? | 15:05 |
| shardy | trozet: Hi! | 15:05 |
| *** prateek has joined #tripleo | 15:06 | |
| trozet | shardy: hey man. Do you mind reviewing these? https://review.openstack.org/#/c/417417/ and https://review.openstack.org/#/c/418495/ | 15:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove Glance Registry service https://review.openstack.org/417109 | 15:07 |
| *** dmarlin has joined #tripleo | 15:07 | |
| shardy | trozet: sure, will do | 15:08 |
| trozet | shardy: ty | 15:08 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: implement a collectd composable service https://review.openstack.org/411048 | 15:08 |
| shardy | if anyone can please review https://review.openstack.org/#/c/418879/ too that would be good | 15:08 |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs https://review.openstack.org/418562 | 15:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove Glance Registry service https://review.openstack.org/417109 | 15:10 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove Glance registry service deployment https://review.openstack.org/417212 | 15:10 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove Glance registry service deployment https://review.openstack.org/417212 | 15:10 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud https://review.openstack.org/417214 | 15:11 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud https://review.openstack.org/417214 | 15:11 |
| *** ooolpbot has joined #tripleo | 15:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 15:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 15:11 |
| *** ooolpbot has quit IRC | 15:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 15:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 15:11 |
| EmilienM | therve: ^ ok, all is under testing now :) | 15:11 |
| EmilienM | bnemec: https://review.openstack.org/#/c/417888/ sounds like we can approve the revert | 15:13 |
| EmilienM | bnemec: I'm doing a last recheck, making sure it's stable | 15:13 |
| *** jaosorior has joined #tripleo | 15:13 | |
| bnemec | EmilienM: Yeah, since it was an intermittent problem it's probably best to make sure it passes more than once with the new fix. | 15:14 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Initial pacemaker remote profile support https://review.openstack.org/400967 | 15:14 |
| jaosorior | bnemec: how did your fix go? regarding killing the job if it's not available in zuul | 15:15 |
| EmilienM | bnemec: ++ | 15:15 |
| *** pradk has joined #tripleo | 15:15 | |
| bnemec | jaosorior: It passed all of the jobs that are currently passing. | 15:16 |
| jaosorior | bnemec: need a +2? | 15:16 |
| jaosorior | and, whta was the url? | 15:17 |
| bnemec | The queue is still long enough that I'm not inclined to try to test the job killing part yet. | 15:17 |
| bnemec | jaosorior: https://review.openstack.org/#/c/418615/ | 15:17 |
| jaosorior | bnemec: great | 15:17 |
| jaosorior | so, would you -W while you get a chance to test that out? | 15:17 |
| bnemec | jaosorior: If you're in a +2'ing mood: https://review.openstack.org/#/c/413246/ | 15:17 |
| bnemec | I already cherry-picked it into the te-broker to test and it's working fine. | 15:18 |
| jaosorior | bnemec: also, do you happen to know at what point does the default key get generated? | 15:18 |
| openstackgerrit | Merged openstack/tripleo-common: Generate a CephX for the new Ceph MDS service https://review.openstack.org/402390 | 15:18 |
| jaosorior | my TLS patch is failing cause I had assumed that the id_rsa.pub was existing, and it isn't | 15:18 |
| bnemec | jaosorior: As long as it's not breaking functional jobs I'm not too concerned about blocking it. If it merges before I have a chance to test the job killing and it turns out it doesn't work then at worst it's having no effect. | 15:19 |
| *** salmankhan has joined #tripleo | 15:19 | |
| jaosorior | ok | 15:19 |
| bnemec | jaosorior: That may be generated as part of the undercloud install as well. | 15:20 |
| jaosorior | bnemec: if there is already an RSA key, do oyu know if the undercloud install will just take that one? | 15:21 |
| bnemec | jaosorior: It should | 15:21 |
| *** prateek has quit IRC | 15:21 | |
| *** yamahata has joined #tripleo | 15:22 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Keep Ceilometer api enabled for Ocata Undercloud https://review.openstack.org/418422 | 15:25 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo: Set ceph key when using manila ceph backend https://review.openstack.org/405999 | 15:25 |
| *** prateek has joined #tripleo | 15:27 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Remove unused roles from OOOQ https://review.openstack.org/418998 | 15:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction https://review.openstack.org/391738 | 15:28 |
| openstackgerrit | Merged openstack/tripleo-common: Move the overcloudrc generation from tripleoclient to a Mistral action https://review.openstack.org/410255 | 15:29 |
| d0ugal | thrash: FYI, I replied on https://review.openstack.org/#/c/418423/ | 15:30 |
| thrash | d0ugal: ack. | 15:31 |
| shardy | trozet: one comment on https://review.openstack.org/#/c/418495 - is there a bug somewhere? | 15:33 |
| trozet | shardy: there is no bug for it. I can create one and add | 15:34 |
| shardy | trozet: yeah please do, I'll fast-approve after you add the bug to the commit message | 15:35 |
| shardy | trozet: in general we ask for a bug reference for all backports, so we can track what's fixed in different branches, and to help ensure only bug fixes vs features get backported | 15:36 |
| *** udesale has quit IRC | 15:36 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements: Add reference to puppet-ipaclient https://review.openstack.org/419000 | 15:36 |
| jaosorior | alee: ^^ | 15:36 |
| trozet | shardy: understood | 15:36 |
| alee | jaosorior, this adds to overcloud image, right? | 15:37 |
| *** salmankhan has quit IRC | 15:37 | |
| jaosorior | alee: yep | 15:37 |
| alee | jaosorior, excellent | 15:37 |
| *** prateek has quit IRC | 15:37 | |
| jaosorior | EmilienM: besides this https://review.openstack.org/#/c/419000/ what else did we have to do to have that puppet module available in the overcloud images and in the undercloud? | 15:38 |
| *** prateek has joined #tripleo | 15:38 | |
| jaosorior | bnemec: if my review is at the end of the experimental-tripleo queue, more or less how long do you think it'll take for it to run? | 15:39 |
| trown | jaosorior: saw jobs sit in that queue for 6 hours yesterday :( | 15:40 |
| bnemec | jaosorior: The way we've been queuing lately I suspect it won't run until tonight. | 15:40 |
| jaosorior | X_X | 15:40 |
| jaosorior | crap | 15:40 |
| bnemec | Yesterday was a bit of an anomaly because there was an infra problem that ate 2/3 of our capacity. | 15:40 |
| EmilienM | jaosorior: https://review.openstack.org/#/c/419000/1 is not needed I think | 15:40 |
| jaosorior | meanwhile, could I get a review for this https://review.openstack.org/#/c/418604/ ? | 15:40 |
| EmilienM | but we can have it | 15:40 |
| adarazs | sshnaidm: the change takes longer than expected, meetings + have to streamline some parts | 15:41 |
| jaosorior | EmilienM: not needed? oh, so how are puppet modules added then? (sorry, a bit confused) | 15:41 |
| sshnaidm | adarazs, sure, no urgent | 15:41 |
| jaosorior | bnemec: oh, right | 15:41 |
| *** salmankhan has joined #tripleo | 15:42 | |
| jaosorior | trown: well, hopefully it was just the anomally that bnemec mentioned | 15:42 |
| jaosorior | bnemec: could you check this one out https://review.openstack.org/#/c/418604/ ? | 15:42 |
| alee | EmilienM, how do we make sure puppet-ipaclient is part of opm? | 15:43 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Remove unused dependency from roles https://review.openstack.org/419007 | 15:43 |
| alee | (and therefore on both undercloid and overcloud) | 15:43 |
| *** shardy has quit IRC | 15:43 | |
| *** sanagikoki has joined #tripleo | 15:43 | |
| chem | gfidente: hi, is there a good way for the user to provide a set of extra ceph pools beside the one that are automatically created ? | 15:44 |
| *** lucasagomes has quit IRC | 15:44 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Remove unused roles from OOOQ https://review.openstack.org/418998 | 15:44 |
| jaosorior | yay, code removal :D | 15:44 |
| chem | gfidente: using extra_config: ceph_pool just override it and prevent creation of the defaut | 15:45 |
| chem | gfidente: so if you have a trick, if not, np. | 15:45 |
| bnemec | jaosorior: Unfortunately I think it's still likely we'll have a queue all day. It just won't be quite as long as yesterday. | 15:45 |
| *** lucasagomes has joined #tripleo | 15:46 | |
| *** Guest43791 is now known as rook | 15:46 | |
| EmilienM | jaosorior: by openstack-puppet-modules package | 15:46 |
| EmilienM | jaosorior, alee: download it from rdo and check what it's in | 15:46 |
| EmilienM | jaosorior: I need to brb | 15:46 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/os-cloud-config: Add support for registering nodes with the libvirt driver https://review.openstack.org/419008 | 15:47 |
| *** prateek has quit IRC | 15:47 | |
| jaosorior | alee: did you get a successful oooq deployment yesterday? | 15:47 |
| *** sanagikoki has quit IRC | 15:48 | |
| alee | jaosorior, well - not exactly - I need to use devmode.sh to get the latest changes -- but then ran into the issue that puppet-ipaclient is not present | 15:49 |
| alee | jaosorior, so we need to get that into opm first | 15:49 |
| alee | jaosorior, that said -- all the other parts appear to be working together correctly | 15:50 |
| alee | jaosorior, ie. the oooq and oooq-extras changes put in the right directives | 15:50 |
| alee | and the instack-undercloud changes call the right puppet modules | 15:51 |
| alee | jaosorior, so all the pieces are there -- we just need puppet-ipaclient to piece it together | 15:51 |
| jaosorior | EmilienM: no biggie; BTW, I commented on your placement API patch | 15:52 |
| jaosorior | alee: great, lets do that | 15:52 |
| *** eglynn has quit IRC | 15:52 | |
| gfidente | chem, it should be possible using CephPools param | 15:53 |
| gfidente | chem, https://bugzilla.redhat.com/show_bug.cgi?id=1283721#c26 | 15:53 |
| openstack | bugzilla.redhat.com bug 1283721 in openstack-tripleo-heat-templates "[RFE] Allow for different values of pg_num, pgp_num and size for each Ceph pool" [High,Closed: errata] - Assigned to gfidente | 15:53 |
| gfidente | you can use that to either override the settings of a specific pool, or to create additional ones | 15:54 |
| *** dhill_ has quit IRC | 15:54 | |
| *** dhill_ has joined #tripleo | 15:54 | |
| chem | gfidente: ack, thanks :) | 15:54 |
| gfidente | chem, note that it is a template param named CephPools not the puppet ceph_pools hiera | 15:55 |
| chem | gfidente: yep | 15:55 |
| jaosorior | alee: found the file | 15:56 |
| jaosorior | alee: https://review.rdoproject.org/r/#/c/4273/ | 15:58 |
| alee | jaosorior, sweet .. EmilienM ^^ | 15:59 |
| jaosorior | bnemec: will this allow us more instances in OVB? https://review.openstack.org/#/c/418622/ | 15:59 |
| bnemec | jaosorior: Potentially | 16:00 |
| bnemec | It remains to be seen how many testenvs the rh1 controller could handle, but it's been better behaved recently. | 16:00 |
| bnemec | I think adding the heat and nova cron jobs has stabilized the performance a bunch. | 16:00 |
| *** sanagikoki has joined #tripleo | 16:00 | |
| bnemec | Even yesterday when we had 40 jobs come in at once it didn't fall over, which actually kind of surprised me. | 16:01 |
| jaosorior | bnemec: I always wondered what that + 1 to the nodecount | 16:01 |
| bnemec | Yeah, there was a scheduling bug that was hitting us hard and that got us around it. | 16:02 |
| jaosorior | trown: could you check this out https://review.openstack.org/#/c/418604/ ? | 16:02 |
| bnemec | Hmm, maybe I should rebase and cherry-pick https://review.openstack.org/#/c/347503/ onto the te-broker. | 16:03 |
| bnemec | That should save some time creating and destroying nonha testenvs. | 16:03 |
| *** zoli|wfh is now known as zoli|brb | 16:04 | |
| jaosorior | bnemec: why only nonha? | 16:05 |
| bnemec | jaosorior: It doesn't use net-iso. That patch is a noop for jobs that do. | 16:05 |
| jaosorior | bnemec: that wouldn't be too bad! | 16:06 |
| jaosorior | trown: thanks dude! | 16:06 |
| bnemec | Ugh, this is kind of a nasty rebase. | 16:06 |
| *** mcornea_ has quit IRC | 16:06 | |
| jaosorior | bnemec: it conflicts with all the stuff I added recently | 16:07 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 16:07 |
| bnemec | jaosorior: Well, I wasn't going to point fingers, but yeah. :-P | 16:07 |
| jaosorior | hahaha | 16:07 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Composable HA https://review.openstack.org/362389 | 16:08 |
| *** ealcaniz has quit IRC | 16:08 | |
| jaosorior | bnemec: commented on the patch | 16:09 |
| *** sai has quit IRC | 16:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs of containers https://review.openstack.org/419018 | 16:10 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Add default `ansible_user` to collect-logs https://review.openstack.org/416741 | 16:10 |
| *** chlong has joined #tripleo | 16:10 | |
| *** ooolpbot has joined #tripleo | 16:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 16:11 |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 16:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 16:11 |
| *** ooolpbot has quit IRC | 16:11 | |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 16:11 |
| *** ealcaniz has joined #tripleo | 16:11 | |
| *** rook has quit IRC | 16:11 | |
| *** sai has joined #tripleo | 16:11 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs of containers https://review.openstack.org/419018 | 16:11 |
| *** ebarrera has quit IRC | 16:12 | |
| *** rook has joined #tripleo | 16:13 | |
| *** rook is now known as Guest93700 | 16:13 | |
| ansiwen | if get_param: [EndpointMap, Ec2ApiInternal, uri] results in ://:, what might be the problem? | 16:14 |
| ansiwen | endpoint_map.yaml is adapted | 16:14 |
| ansiwen | oh, it says "DO NOT MODIFY THIS FILE" *grin* | 16:15 |
| ansiwen | that might be a hint | 16:15 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart-extras: Add /tmp/ara to the collected log directories https://review.openstack.org/418602 | 16:16 |
| *** bkopilov has quit IRC | 16:16 | |
| *** dsariel has quit IRC | 16:17 | |
| ansiwen | do I have to manually run build_endpoint_map.py? or is it run automatically? why is an automatically created file checked in anyways? | 16:17 |
| jaosorior | ansiwen: manually | 16:17 |
| ansiwen | jaosorior: I see, thanks | 16:18 |
| jaosorior | you add the relevant endpoint to endpoint_data.yaml, and then run bild_endpoint_map.py | 16:18 |
| jaosorior | *build | 16:18 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Removes deprecated OpenDaylight L2 only deployments https://review.openstack.org/417417 | 16:19 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add disable_upgrade flag to roles_data.yaml https://review.openstack.org/418344 | 16:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Update net-config-noop to use apply-config https://review.openstack.org/417706 | 16:21 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add disable_upgrade_deployment flag to roles_data.yaml https://review.openstack.org/418344 | 16:22 |
| ansiwen | jaosorior: thanks! and the net_param: value must be existing somewhere? if I set it to Ec2Api, do I have to add that somewhere else as well? | 16:26 |
| jaosorior | ansiwen: the get_param | 16:26 |
| jaosorior | well, build_endpoint_map.py will create the entries | 16:26 |
| jaosorior | so it's just Ec2Api, and it will create whatever endpoints you give it (which will usually be Internal, Admin and such) | 16:27 |
| *** bkopilov has joined #tripleo | 16:28 | |
| *** trown is now known as trown|lunch | 16:28 | |
| *** dsariel has joined #tripleo | 16:29 | |
| *** Guest93700 is now known as rook-LOLLLLL | 16:29 | |
| *** tremble has quit IRC | 16:30 | |
| ansiwen | jaosorior: and the "service name" doesn't matter? because my service is called Ec2Api, and as net_param: I also use Ec2Api. that is not a problem? | 16:30 |
| *** panda is now known as panda|bbl | 16:30 | |
| ansiwen | ouch, running the script also replaces the ZaqarWebSocket entries :-/ | 16:30 |
| jaosorior | what | 16:30 |
| jaosorior | let me check | 16:31 |
| ansiwen | yes, the ZaqarWebSocket entries have protocol: ws, which the script can't create | 16:31 |
| jaosorior | ansiwen: right | 16:31 |
| *** jeckersb is now known as jeckersb_gone | 16:31 | |
| jaosorior | ansiwen: let me fix that first | 16:31 |
| *** jeckersb_gone is now known as jeckersb | 16:31 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Add i18n strings to the navigation bar https://review.openstack.org/418570 | 16:31 |
| ansiwen | it also sets the heat_template_version to 2015-04-30 | 16:32 |
| jaosorior | ansiwen: I'll fix that as wel | 16:33 |
| *** ealcaniz has quit IRC | 16:35 | |
| gfidente | bnemec, to get hci in the ovb/ha job we'd need to att the storagemgmt network to the compute nodes | 16:35 |
| gfidente | bnemec, would you be okay in doing that? if you point me to the net templates maybe I can propose the change? | 16:36 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart: changes to add novajoin to undercloud https://review.openstack.org/398772 | 16:36 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Make build_endpoint_map.py output an ocata versioned template https://review.openstack.org/419029 | 16:37 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Fix protocol for ZaqarWebsockets endpoint https://review.openstack.org/419030 | 16:37 |
| jaosorior | ansiwen: ^^ | 16:37 |
| *** shardy has joined #tripleo | 16:38 | |
| *** aufi has quit IRC | 16:40 | |
| jaosorior | shardy, dprince could you guys check this out https://review.openstack.org/#/q/topic:fix-endpoint-map ? seems that the changes to the zaqar websocket endpoints were done manually and not through the build_endpoint_map.py tool, so running the tool would overwrite those changes. This fixes it | 16:40 |
| gfidente | jaosorior, so that is a rerun of build_endpoint_map ? | 16:40 |
| jaosorior | gfidente: well, those are fixes so what we expect there to be in the endpoint map is there. | 16:41 |
| jaosorior | gfidente: one commit is for the version of the template | 16:41 |
| gfidente | yeah +2 that one already :{P | 16:41 |
| jaosorior | gfidente: and the other commit fixes the protocol in endpoint_data | 16:41 |
| jaosorior | gfidente: endpoint_data is what should have been changed in the first place | 16:41 |
| gfidente | ah so a rerun now would produce the results we needed | 16:41 |
| jaosorior | that's where the endpoint map gets it's data | 16:41 |
| jaosorior | yeah | 16:41 |
| gfidente | and committed already | 16:42 |
| gfidente | ack | 16:42 |
| jaosorior | gfidente: thanks dude | 16:42 |
| gfidente | ty :) | 16:42 |
| shardy | It might be good to reference the commit that changed endpoint map in the https://review.openstack.org/#/c/419030/ patch | 16:42 |
| shardy | but otherwise lgtm | 16:42 |
| jaosorior | shardy: thanks | 16:45 |
| *** cylopez has quit IRC | 16:46 | |
| *** rook-LOLLLLL is now known as rook | 16:46 | |
| *** abehl has quit IRC | 16:46 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add registry and role service list entries for Octavia https://review.openstack.org/418596 | 16:49 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add Octavia API service definitions https://review.openstack.org/411872 | 16:49 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Introduce Octavia implememtation services https://review.openstack.org/411874 | 16:49 |
| ansiwen | jaosorior: now I have to wait until these are merged.... or I cherrypick them locally... | 16:50 |
| jaosorior | ansiwen: you can grab those changes using git-review and then rebase your patches on top of those | 16:51 |
| jaosorior | beagles: the endpoint_map changes for octavia, did you do them manually or through build_endpoint_map.py? | 16:51 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras: collect-logs: unpack tar.gz https://review.openstack.org/419039 | 16:51 |
| * beagles facepalm | 16:51 | |
| beagles | jaosorior: manually .. I'll redo | 16:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Allow freeipa environment file to be in /tmp https://review.openstack.org/418604 | 16:53 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart-extras: WIP: Use openstack deploy to install the undercloud https://review.openstack.org/419040 | 16:53 |
| jaosorior | beagles: | 16:53 |
| jaosorior | don't | 16:53 |
| gfidente | jaosorior, can we have build_endpoint_map as a commit hook or something? | 16:53 |
| beagles | jaosorior: no? | 16:53 |
| jaosorior | gfidente: I had proposed one at some point, and was told not to; I don't remember why | 16:53 |
| jaosorior | gfidente: we could try again haha | 16:53 |
| jaosorior | see if people have changed their minds | 16:53 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart-extras: WIP: Use openstack deploy to install the undercloud https://review.openstack.org/419040 | 16:53 |
| jaosorior | beagles: I cherry picked your commit | 16:53 |
| jaosorior | beagles: ran the script, and it was done right | 16:54 |
| jaosorior | beagles: so you're good | 16:54 |
| beagles | jaosorior: okay cool | 16:54 |
| *** dougbtv is now known as dougbtv|lunch | 16:54 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 16:54 |
| shardy | gfidente: I'm not sure how we'd do a hook, but we definitely could have a validation test that runs the script and ensures the templates match | 16:54 |
| colonwq | bnemec, Ping? I have a question about the launchpad bug 1654611 | 16:55 |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] https://launchpad.net/bugs/1654611 | 16:55 |
| gfidente | shardy, ah validation sounds cool | 16:55 |
| jaosorior | shardy: there is already a -c option that does a check | 16:55 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 16:55 |
| openstackgerrit | Chris Jones proposed openstack/puppet-tripleo: Add support for fence_ironic fencing agent. https://review.openstack.org/390397 | 16:55 |
| gfidente | jaosorior, a -c option for which command? yaml-validate.py? | 16:56 |
| jaosorior | gfidente: build_endpoint_map.py | 16:56 |
| shardy | jaosorior: ah, but evidently we don't run it in the gate ;) | 16:56 |
| jaosorior | shardy: we sure don't | 16:57 |
| jaosorior | was just saying we could use that | 16:57 |
| sshnaidm | do we have an issue with pingtest on master? | 16:57 |
| gfidente | shardy, jaosorior so I think we can move it to yaml-validate.py? | 16:57 |
| Ng | shardy: OOI, did your updating of all the things, lead to a successful overcloud deploy? Mine failed a little later on a glance sync-db | 16:57 |
| jaosorior | gfidente: where is yaml-validate.py? | 16:58 |
| gfidente | jaosorior, tools/ | 16:58 |
| jaosorior | right | 16:58 |
| jaosorior | gfidente: I guess a good change would be to move build_endpoint_map.py to tools | 16:58 |
| jaosorior | shardy: ^^ | 16:59 |
| jaosorior | and then import it via yaml-validate.py, and do the check there | 16:59 |
| jaosorior | sshnaidm: which job? | 17:00 |
| bnemec | And yaml-validate.py grows another feature... :-) | 17:00 |
| sshnaidm | jaosorior, ovb ha and nonha, pingtest fails | 17:00 |
| *** zoli|brb is now known as zoli|wfh | 17:01 | |
| bnemec | gfidente: Give me another minute and I can wire the compute nodes into storage-mgmt. It should be pretty simple. | 17:01 |
| jaosorior | sshnaidm: has that happened in several patches already? | 17:01 |
| gfidente | wow bnemec++ | 17:01 |
| sshnaidm | jaosorior, yes | 17:01 |
| jaosorior | sshnaidm: can you pass the logs? | 17:01 |
| gfidente | bnemec, fyi this is the goal https://review.openstack.org/#/c/338088/ | 17:01 |
| jaosorior | EmilienM: maybe there are no logs for the placement API cause it hasn't been called yet? | 17:01 |
| jaosorior | EmilienM: remember httpd does lazy initialization | 17:02 |
| sshnaidm | jaosorior, http://logs.openstack.org/01/405001/14/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd96eac/logs | 17:02 |
| sshnaidm | jaosorior, http://logs.openstack.org/01/405001/14/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd96eac/logs/overcloud-controller-0/var/log/neutron/server.txt.gz | 17:02 |
| gfidente | bnemec, I have to add a condition for not doing hci before ocata | 17:02 |
| EmilienM | jaosorior: there is | 17:02 |
| gfidente | bnemec, I wonder if we don't need to use different nic templates too? | 17:02 |
| EmilienM | jaosorior: let me show you | 17:02 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Deploy network envs appropriate for the job https://review.openstack.org/347503 | 17:02 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test with bonded public interface https://review.openstack.org/385562 | 17:02 |
| bnemec | gfidente: Yes, that's the only thing we need to change actually. All of the vms already have all the networks in our ovb setup. | 17:03 |
| EmilienM | jaosorior: oh wait | 17:03 |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services https://review.openstack.org/351898 | 17:03 |
| sshnaidm | jaosorior, maybe because of this: http://logs.openstack.org/01/405001/14/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd96eac/logs/overcloud-controller-0/var/log/neutron/openvswitch-agent.txt.gz#_2017-01-11_15_24_22_856 | 17:03 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Add i18n strings to the login page https://review.openstack.org/419045 | 17:03 |
| EmilienM | jaosorior, mwhahaha : same thing for Puppet CI http://logs.openstack.org/58/418758/1/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/ff53584/logs/nova/ | 17:03 |
| jaosorior | sshnaidm: failed to bind port :/ | 17:03 |
| gfidente | bnemec, even the mitaka/liberty jobs? | 17:03 |
| EmilienM | I might have missed something | 17:03 |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Add initial profiles for rest of Octavia services https://review.openstack.org/411422 | 17:04 |
| mwhahaha | EmilienM: bad logging config? | 17:04 |
| jaosorior | sshnaidm: that doesn't look right | 17:04 |
| gfidente | bnemec, I am not sure what would happen with new nic templates expecting a storagemgmt ip in mitaka/liberty | 17:04 |
| jaosorior | beagles: ever seen this http://logs.openstack.org/01/405001/14/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd96eac/logs/overcloud-controller-0/var/log/neutron/openvswitch-agent.txt.gz#_2017-01-11_15_24_22_856 ? | 17:04 |
| * beagles looks | 17:04 | |
| EmilienM | mwhahaha: no, I think the wsgi app is not running | 17:04 |
| jaosorior | EmilienM: what calls placement API? | 17:04 |
| jaosorior | EmilienM: there will be no logs for it in httpd until something tries to call it | 17:05 |
| EmilienM | jaosorior: nova-compute | 17:05 |
| beagles | whoa | 17:05 |
| EmilienM | http://logs.openstack.org/58/418758/1/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/ff53584/logs/nova/nova-compute.txt.gz#_2017-01-11_08_15_32_868 | 17:05 |
| EmilienM | Placement service credentials do not work. Optional use of placement API for reporting is now disabled. | 17:05 |
| jaosorior | EmilienM: can we get the httpd config files in puppet CI http://logs.openstack.org/58/418758/1/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/ff53584/logs/etc/ ? | 17:05 |
| jaosorior | seems to be missing | 17:05 |
| EmilienM | it might be an ordering thing, i've heard placement api needs to start before nova-scheduler | 17:06 |
| *** bana_k has joined #tripleo | 17:06 | |
| sshnaidm | jaosorior, it's bad actually, will fill a bug now because it's in all patches: http://logs.openstack.org/20/418920/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/53f0b69/logs/overcloud-controller-0/var/log/neutron/openvswitch-agent.txt.gz | 17:06 |
| sshnaidm | EmilienM, bnemec ^^ | 17:06 |
| *** aufi has joined #tripleo | 17:06 | |
| *** dsneddon has joined #tripleo | 17:07 | |
| EmilienM | KeyError: 'ofctl_service' | 17:07 |
| *** dougbtv_ has joined #tripleo | 17:07 | |
| EmilienM | I remember we had something similar in the past | 17:07 |
| beagles | jaosorior: short answer no.. fricking weird. | 17:08 |
| jaosorior | sshnaidm: fuuuck | 17:08 |
| *** dmsimard is now known as dmsimard|afk | 17:08 | |
| jaosorior | KeyError: 'unknown OXM field: vlan_tci' O_o | 17:08 |
| * beagles wonders if there was ar recent OVS package update | 17:09 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Re-generate nic-configs https://review.openstack.org/419048 | 17:09 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add storage-mgmt network to compute nodes https://review.openstack.org/419049 | 17:09 |
| beagles | or ryu ftm | 17:09 |
| bnemec | gfidente: https://review.openstack.org/419049 | 17:09 |
| bnemec | I think it should work fine. | 17:09 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo: Set ceph key when using manila ceph backend https://review.openstack.org/405999 | 17:09 |
| fultonj | bnemec: thanks! | 17:10 |
| jaosorior | gfidente, bnemec why would the compute nodes need to be connected to the storage-mgmt network? storage makes sense, but storage-mgmt? | 17:10 |
| bnemec | I guess we'll see though. If necessary we can add newton/ocata-specific nic-configs, but hopefully that won't be necessary. | 17:10 |
| bnemec | jaosorior: Hyperconverged ceph | 17:10 |
| jaosorior | ELI5? | 17:10 |
| bnemec | If you're doing combo compute/ceph nodes they need to have access to the networks for both node types. | 17:10 |
| *** dougbtv|lunch has quit IRC | 17:10 | |
| fultonj | jaosorior: for running OSDs on compute nodes | 17:11 |
| bnemec | gfidente: In any case, ci should tell us whether that breaks the stable jobs. | 17:11 |
| *** ooolpbot has joined #tripleo | 17:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 17:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 17:11 |
| *** ooolpbot has quit IRC | 17:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 17:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 17:11 |
| jaosorior | I see | 17:11 |
| jaosorior | thanks | 17:11 |
| bnemec | Well, it would if ^ weren't a thing | 17:11 |
| gfidente | bnemec, right | 17:11 |
| gfidente | and I was supposed to look into the glance issue too | 17:11 |
| sshnaidm | do we still revert neutron? | 17:11 |
| jaosorior | sshnaidm: I think so, yeah | 17:11 |
| * bnemec prays that https://review.openstack.org/418510 gets at least one of the mitaka jobs passing again | 17:12 | |
| sshnaidm | maybe that breaks us now | 17:12 |
| jaosorior | oh | 17:12 |
| bnemec | sshnaidm: We're waiting for another set of https://review.openstack.org/#/c/417888/ ci results | 17:12 |
| jaosorior | true | 17:12 |
| *** pkovar has quit IRC | 17:12 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove Glance Registry service https://review.openstack.org/417109 | 17:12 |
| *** pcaruana has quit IRC | 17:12 | |
| jaosorior | EmilienM: was something figured out regarding the Heat/Glancev1 issue? | 17:13 |
| sshnaidm | bnemec, ok, maybe it'll solve this too | 17:13 |
| EmilienM | jaosorior: yes, see depends-on | 17:13 |
| EmilienM | jaosorior: https://review.openstack.org/#/c/418987/ | 17:13 |
| jaosorior | EmilienM: yay | 17:13 |
| *** akrzos is now known as akrzos-mtg | 17:14 | |
| colonwq | bnemec, gfidente Can 419049 be accomplished within the composiable role? Where ever ceph-osd goes, storage_mgmt follows. | 17:14 |
| shardy | hrm | 17:14 |
| bnemec | colonwq: I don't think it can right now. | 17:14 |
| shardy | slagle: Hey, thanks for all the help with the upgrades CI | 17:15 |
| colonwq | bnemec, ok thanks. | 17:15 |
| bnemec | colonwq: What did you want to ask about https://launchpad.net/bugs/1654611 ? | 17:15 |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 17:15 |
| shardy | slagle: any idea how the upgrades job passed faster than the normal multinode job?! | 17:15 |
| EmilienM | bnemec, sshnaidm: sounds like https://github.com/openstack/neutron/commit/2cef50bdb087679b9224fdef9638236d40cadcd9 would help | 17:15 |
| shardy | gate-tripleo-ci-centos-7-nonha-multinode SUCCESS in 49m 19s | 17:15 |
| *** yprokule has quit IRC | 17:16 | |
| colonwq | bnemec, can you update with your ceph and rbd packages installed on your osd node? | 17:16 |
| shardy | gate-tripleo-ci-centos-7-multinode-upgrades-nvSUCCESS in 47m 17s ?! | 17:16 |
| EmilienM | https://bugs.launchpad.net/neutron/+bug/1622017 | 17:16 |
| openstack | Launchpad bug 1622017 in neutron "OVS agent is not removing VLAN tags before tunnels when configured with native OF interface" [High,Fix released] - Assigned to IWAMOTO Toshihiro (iwamoto) | 17:16 |
| EmilienM | sshnaidm, bnemec ^ | 17:16 |
| EmilienM | it sounds highly related to bugs | 17:16 |
| EmilienM | we might just need a promotion | 17:16 |
| sshnaidm | EmilienM, right | 17:16 |
| sshnaidm | EmilienM, maybe to trigger it? | 17:17 |
| slagle | shardy: mostly i'd say b/c the only openstack service on the controller is keystone | 17:17 |
| EmilienM | sshnaidm: please do | 17:17 |
| * EmilienM brb lunch | 17:17 | |
| slagle | shardy: but there is also a lot of variance between the different clouds used by infra | 17:17 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 17:17 |
| bnemec | Gah, so many bugs getting promoted. :-( | 17:17 |
| shardy | slagle: Ok, yeah I guess that may be it, but I thought we were taking about an hour to start the upgrade before | 17:17 |
| * shardy was suspcious as a result ;) | 17:17 | |
| shardy | If we can actually test end-to-end upgrades in under an hour, that is awesome news | 17:18 |
| shardy | obviously it'll go up when we add back in all the services and validation, but at least we may have walltime to do that | 17:18 |
| bnemec | colonwq: Update to what? I'm not seeing any pending ceph updates from the hammer repo. | 17:19 |
| gfidente | colonwq, the nic templates are usually customized in production | 17:19 |
| slagle | shardy: 7 minute to initially deploy, and 11 minute upgrade | 17:19 |
| gfidente | based on which nic/vlan the nodes are using | 17:19 |
| shardy | I'll rebase my patches adding the other services, and hopefully we can start landing them to get a more representative test | 17:19 |
| colonwq | bnemec, does the node have the ceph-common package installed? | 17:19 |
| bnemec | slagle: A 7 minute deploy with tripleo? I call shenanigans. :-P | 17:19 |
| gfidente | colonwq, we can't really guess which nic the storagemgmt network would be on | 17:19 |
| shardy | slagle: wow that's faster than my local environment | 17:20 |
| bnemec | colonwq: http://paste.openstack.org/show/594599/ | 17:20 |
| slagle | bnemec: only keystone, rabbit, and db | 17:20 |
| gfidente | colonwq, we can enable the storagemgmt port for the compute nodes though which we do from the hci env file | 17:20 |
| gfidente | https://github.com/openstack/tripleo-heat-templates/blob/master/environments/hyperconverged-ceph.yaml#L4 | 17:20 |
| shardy | the logs all look legit though so great :) | 17:20 |
| *** tesseract has quit IRC | 17:20 | |
| *** karimb has quit IRC | 17:20 | |
| colonwq | bnemec, thanks. that shots my idea out of the water. | 17:21 |
| shardy | bnemec: yeah, it is pretty minimal atm, we just started with testing keystone + dependencies | 17:21 |
| bnemec | Ah, so we're deploying a glorified LDAP server. :-) | 17:21 |
| slagle | i mean, the last 3 puppet steps are basically no-ops :) | 17:21 |
| bnemec | And those are the sloooooow ones. | 17:21 |
| *** colonwq is now known as colonwq_lunch | 17:22 | |
| shardy | yeah | 17:22 |
| shardy | Ok, let me rebase and queue up all the slow stuff and see how we do ;) | 17:22 |
| shardy | excellent to see this working now though, thanks slagle, much appreciated | 17:22 |
| beagles | EmilienM, jaosorior (anybody) regarding the ovs agent thing. A patch was merged recently that remvoed a fix for versions of ryu prior to 4.7. We are still on 4.3 so boom! | 17:23 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Add i18n strings to the navigation bar https://review.openstack.org/418570 | 17:23 |
| beagles | jlibosva requested a rebase for the ryu package on rdo | 17:23 |
| slagle | shardy: np. for once we added CI before landing all the code. imagine that :) | 17:23 |
| *** yamahata has quit IRC | 17:25 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Add i18n strings to the navigation bar https://review.openstack.org/418570 | 17:26 |
| bnemec | Speaking of job performance, it would be nice to re-enable graphite so we can track it: https://review.openstack.org/#/c/411460/ | 17:26 |
| *** amoralej is now known as amoralej|off | 17:28 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-quickstart: Adds support for multiple distributions https://review.openstack.org/419062 | 17:30 |
| *** florianf has quit IRC | 17:30 | |
| shardy | https://review.openstack.org/#/c/418879/ can be approved I think if anyone has a moment | 17:31 |
| *** dougbtv_ is now known as dougbtv | 17:32 | |
| *** aufi has quit IRC | 17:33 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Use shell instead of command https://review.openstack.org/418581 | 17:34 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-quickstart: Adds support for multiple distributions https://review.openstack.org/419062 | 17:37 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Make undercloud install optional and more configurable https://review.openstack.org/417430 | 17:38 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Fix check for overcloud-full in deploy.sh https://review.openstack.org/417407 | 17:40 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Write segfaults and oom-killers to files https://review.openstack.org/419069 | 17:42 |
| sshnaidm | adarazs, ^^ | 17:42 |
| *** hjensas has quit IRC | 17:42 | |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui: Expand %(tenant_id)s macro in service URLs https://review.openstack.org/419070 | 17:42 |
| *** hjensas has joined #tripleo | 17:42 | |
| *** hjensas has quit IRC | 17:42 | |
| *** hjensas has joined #tripleo | 17:42 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-quickstart: Adds support for multiple distributions https://review.openstack.org/419062 | 17:43 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Add docker Glance API service https://review.openstack.org/400870 | 17:44 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Containerize MySQL https://review.openstack.org/414601 | 17:44 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 17:44 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Add docker heat services https://review.openstack.org/417639 | 17:44 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Add docker keystone service https://review.openstack.org/416605 | 17:44 |
| *** rbrady has quit IRC | 17:46 | |
| bnemec | http://logs.openstack.org/10/418510/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-mitaka/a2a7dec/console.html | 17:46 |
| bnemec | Boom, one mitaka job passing | 17:46 |
| *** jpich has quit IRC | 17:46 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Remove unused dependency from roles https://review.openstack.org/419007 | 17:46 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs of containers https://review.openstack.org/419018 | 17:47 |
| *** paramite has quit IRC | 17:47 | |
| *** SlickNik has joined #tripleo | 17:48 | |
| *** sudipto has quit IRC | 17:50 | |
| *** sudipto_ has quit IRC | 17:50 | |
| *** lucasagomes is now known as lucas-afk | 17:50 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add basic pre/post upgrade sanity checks https://review.openstack.org/411846 | 17:51 |
| jaosorior | shardy: could you check this out https://review.openstack.org/#/c/418504/ ? | 17:53 |
| *** dtantsur is now known as dtantsur|afk | 17:53 | |
| *** yamahata has joined #tripleo | 17:54 | |
| *** salmankhan has quit IRC | 18:01 | |
| *** saneax is now known as saneax-_-|AFK | 18:03 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Add a constraint::order class https://review.openstack.org/417843 | 18:04 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Add tries/try_sleep to the constraint classes https://review.openstack.org/418522 | 18:04 |
| *** liverpooler has quit IRC | 18:05 | |
| *** trown|lunch is now known as trown | 18:05 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add glance service support for composable upgrades https://review.openstack.org/405240 | 18:05 |
| *** zoli|wfh is now known as zpli|gone | 18:06 | |
| *** zpli|gone is now known as zoli|gone | 18:06 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add glance to major upgrade CI https://review.openstack.org/412475 | 18:06 |
| EmilienM | beagles: ack, thx | 18:07 |
| *** colonwq_lunch is now known as colonwq | 18:08 | |
| *** athomas has quit IRC | 18:10 | |
| *** derekh has quit IRC | 18:10 | |
| *** ooolpbot has joined #tripleo | 18:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 18:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 18:11 |
| *** ooolpbot has quit IRC | 18:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 18:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 18:11 |
| *** hewbrocca is now known as hewbrocca_afk | 18:11 | |
| *** liverpooler has joined #tripleo | 18:12 | |
| jaosorior | trown: can you check out? https://review.openstack.org/#/c/418504/ | 18:12 |
| EmilienM | jaosorior: done | 18:13 |
| *** sdake_ has joined #tripleo | 18:14 | |
| trown | also done :P | 18:14 |
| sdake_ | hey folks - just noticed i wasn't in this channel - computer change :) | 18:14 |
| jaosorior | EmilienM, trown haha thanks guys | 18:14 |
| sdake_ | dprince we can talk here or in #openstack-kolla | 18:14 |
| dprince | sdake_: cool :) | 18:14 |
| dprince | sdake_: creating the BP now | 18:15 |
| sdake_ | dprince cool | 18:15 |
| sdake_ | dprince sorry for bleedover into rdo - shouldn't have done that - oh well :) | 18:15 |
| sdake_ | #rdo that is | 18:15 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Add a constraint::order class https://review.openstack.org/417843 | 18:15 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Add tries/try_sleep to the constraint classes https://review.openstack.org/418522 | 18:15 |
| *** kfox1111 has joined #tripleo | 18:16 | |
| *** sbezverk has joined #tripleo | 18:16 | |
| *** inc0 has joined #tripleo | 18:16 | |
| inc0 | o/ | 18:16 |
| *** chem has quit IRC | 18:16 | |
| *** david-lyle has joined #tripleo | 18:16 | |
| *** chem has joined #tripleo | 18:16 | |
| *** rasca has quit IRC | 18:17 | |
| dprince | sdake_ inc0 : https://blueprints.launchpad.net/kolla/+spec/apache-packages-for-apis | 18:17 |
| sdake_ | dprince cool - the only thing needed are the work items | 18:19 |
| inc0 | dprince, well, this will require a bit more than just getting packages in | 18:19 |
| sdake_ | dprince however its approved now - so feel free to cut and paste the blueprint parts for the components as work items | 18:19 |
| inc0 | namely, apache confs | 18:19 |
| dprince | inc0: for kolla kubernetes and kolla-ansible yes. | 18:20 |
| sdake_ | inc0 right - but we don't need to use that model with kolla-ansible or kolla-kubernetes | 18:20 |
| dprince | inc0: for TripleO we've got Puppet generating our Apache configs already so as soon as we add the packages we are good to go | 18:20 |
| sdake_ | looks like lag ;) | 18:20 |
| dprince | inc0: I'm not suggesting we force all projects to do this yet. It is opt-in for now | 18:20 |
| sdake_ | dprince deliverables - not projects ;-) | 18:21 |
| dprince | gotcha, deliverables are good | 18:21 |
| *** salmankhan has joined #tripleo | 18:22 | |
| trown | slagle: bkero and I are trying to get deployed server working via quickstart, and we have os-collect-config running on the subnode (configured by get-occ script) ... but we are still hanging during the deploy at the overcloud.Controller create ... any ideas where to look for further troubleshooting? | 18:22 |
| *** jlinkes has quit IRC | 18:24 | |
| larsks | bandini, do you know how https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/memcached.yaml#L37 gets turned into an ip address? When I try exactly the same thing, I get "internal_api" rather than an address. | 18:26 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Failure debugging improvements https://review.openstack.org/419081 | 18:26 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 18:28 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804 https://review.openstack.org/406167 | 18:28 |
| bnemec | dprince: Hey, when you get a chance could you take a look at https://review.openstack.org/#/c/416664/ ? | 18:28 |
| bandini | larsks: ah yes I hit that | 18:28 |
| bandini | sec | 18:28 |
| bnemec | It's costing us at least 5 minutes per ci job right now, and given the gate queue it would be nice to eliminate that. | 18:28 |
| dprince | bnemec: looking | 18:28 |
| slagle | trown: not really. what is hanging | 18:28 |
| trown | slagle: it just sits at overcloud.Controller.0.Controller CREATE_IN_PROGRESS until hitting the deploy timeout http://chunk.io/f/da3854bb3c624676b487a14f60712d04 | 18:30 |
| slagle | trown: probably check the networking and os-collect-config logs on the subnode | 18:31 |
| trown | slagle: we saw the same thing before we got the get-occ script working, but that appears to have run successfully now: http://logs.openstack.org/10/416110/80/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/dffe3c3/logs/var/log/deployed-server-os-collect-config.txt.gz | 18:31 |
| *** mhenkel has quit IRC | 18:32 | |
| trown | slagle: ah right os-collect-config logs are in the journal.. I can see Connection refused in there: http://logs.openstack.org/10/416110/80/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/dffe3c3/logs/var/log/deployed-server-os-collect-config.txt.gz | 18:32 |
| bkero | the networking would seem to be set up correctly: http://logs.openstack.org/10/416110/80/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/dffe3c3/logs/var/log/oooq/collected_logs/undercloud/home/jenkins/toci_vxlan_networking.sh.log.gz | 18:33 |
| dprince | bnemec: +A. Sorry for the delay on this BTW. It was on my radar last week and then I got interrupted | 18:33 |
| dprince | bnemec: I had wanted to test it locally fwiw | 18:33 |
| *** bana_k has quit IRC | 18:34 | |
| bnemec | dprince: Yeah, no problem. I realize it's kind of a tricky patch. | 18:34 |
| bnemec | I _think_ it should be safe since it's just moving a service to run after another service that was already failing. | 18:35 |
| *** salmankhan has quit IRC | 18:35 | |
| *** absubram has quit IRC | 18:36 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates: Setting networking-odl v2 as a mechanism driver https://review.openstack.org/418495 | 18:36 |
| slagle | trown: iptables maybe? | 18:38 |
| bnemec | Ouch. Over 200 jobs in the check-tripleo queue. :-( | 18:38 |
| bkero | The sessions seem to be starting | 18:38 |
| bkero | Jan 11 18:06:52.358381 centos-7-2-node-osic-cloud1-s3500-6602489 systemd[1]: Starting Session 360 of user jenkins. | 18:38 |
| bkero | So I'd believe the SSH is succeeding | 18:39 |
| *** absubram has joined #tripleo | 18:39 | |
| bkero | Huh. os-collect-config[26450]: HTTPConnectionPool(host='192.168.24.3', port=8080): Max retries exceeded with url: /v1/AUTH_8d71c058d019428ba5051a1133f4bdb5/ov-ntroller-dnhj3rnat2tr-deployed-server-k6bvopql52js/5e9af4ca-df77-483b-b76c-902c8e0d0b63?temp_url_sig=8b9060f020f753f45c2132212002a891b36d4b39&temp_url_expires=2147483586 (Caused by | 18:40 |
| bkero | NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x3869850>: Failed to establish a new connection: [Errno 111] Connection refused',)) from http://logs.openstack.org/10/416110/80/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/dffe3c3/logs/subnode-2/syslog.txt.gz | 18:40 |
| bkero | trown: did you see that? ^ | 18:41 |
| EmilienM | therve: your patch worked | 18:41 |
| trown | bkero: ya that is what I saw in the journal too | 18:41 |
| *** abehl has joined #tripleo | 18:41 | |
| EmilienM | therve: tripleo.sh -- Overcloud pingtest SUCCEEDED | 18:42 |
| EmilienM | flaper87: we can remove glance registry in tripleo, thanks to his patch | 18:42 |
| trown | slagle: is https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack_osinfra.sh#L26 maybe relevant? I dont think we are doing that | 18:42 |
| bkero | trown: trown see line 43 https://review.openstack.org/#/c/416110/80/toci_gate_test.sh | 18:43 |
| trown | bkero: hmm, well since we clearly can't merge it like that, lets try removing the comments there and including 18-26 in toci_instack_osinfra.sh in our toci script | 18:45 |
| *** flepied1 has quit IRC | 18:45 | |
| *** sbezverk has left #tripleo | 18:45 | |
| slagle | trown: could be | 18:45 |
| *** chlong has quit IRC | 18:46 | |
| *** owalsh is now known as owalsh-afk | 18:46 | |
| bkero | trown: it should fail fast at least :) | 18:47 |
| EmilienM | beagles: where is the patch from jlibosva? | 18:47 |
| *** shardy has quit IRC | 18:48 | |
| beagles | EmilienM: it wasn't a patch.. he just pinged rdo on it. I'll prod and see what the status is | 18:48 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 18:48 |
| EmilienM | beagles: all CI is broken, we need a patch ASAP | 18:49 |
| beagles | ack | 18:49 |
| EmilienM | I can submit it | 18:49 |
| *** jlinkes has joined #tripleo | 18:49 | |
| EmilienM | beagles: which package is it exactly? | 18:50 |
| *** owalsh-afk has quit IRC | 18:50 | |
| beagles | https://cbs.centos.org/koji/packageinfo?packageID=2330 | 18:50 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 18:51 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix error path for tools/process-templates.py https://review.openstack.org/418879 | 18:51 |
| EmilienM | beagles: trying again on #rdo | 18:52 |
| beagles | EmilienM: failing that we'd be looking at reverting the revert | 18:52 |
| beagles | to neutron that is.. | 18:52 |
| EmilienM | beagles: I'm proposing a temprevert... | 18:54 |
| *** jpena is now known as jpena|off | 18:55 | |
| beagles | EmilienM: ack | 18:55 |
| EmilienM | beagles: which patch exactly? just to make sure | 18:55 |
| EmilienM | do we have a launchpad? | 18:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove unused pacemaker profiles https://review.openstack.org/412214 | 18:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Make build_endpoint_map.py output an ocata versioned template https://review.openstack.org/419029 | 18:56 |
| beagles | EmilienM: patch is https://review.openstack.org/#/c/413475/ | 18:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix protocol for ZaqarWebsockets endpoint https://review.openstack.org/419030 | 18:56 |
| EmilienM | beagles: thx | 18:57 |
| beagles | EmilienM: the lp is https://bugs.launchpad.net/neutron/+bug/1622017 .. but it is really a revert of the fix to that bug | 18:57 |
| openstack | Launchpad bug 1622017 in neutron "OVS agent is not removing VLAN tags before tunnels when configured with native OF interface" [High,Fix released] - Assigned to IWAMOTO Toshihiro (iwamoto) | 18:57 |
| EmilienM | ok | 18:57 |
| *** chlong has joined #tripleo | 18:58 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: neutron: revert https://review.openstack.org/#/c/413475/ https://review.openstack.org/419088 | 18:59 |
| EmilienM | bnemec, beagles: can you give feedback on ^ please? | 18:59 |
| beagles | EmilienM: ack | 19:00 |
| *** tosky has quit IRC | 19:00 | |
| trown | bkero: noticed something else odd | 19:00 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo: Restrict mongodb memory usage https://review.openstack.org/419090 | 19:00 |
| bkero | ? | 19:00 |
| trown | bkero: http://logs.openstack.org/06/418506/1/gate/gate-tripleo-ci-centos-7-nonha-multinode/4d6b91d/logs/var/log/deployed-server-os-collect-config.txt.gz is a successful job, it has 192.168.24.1 in deployed_server_metadata_url (which makes sense since that is the undercloud) | 19:01 |
| bnemec | EmilienM: I'm curious how the multinode jobs are passing. | 19:01 |
| bnemec | Also, how did that patch get promoted if it completely breaks the ovb jobs? | 19:01 |
| trown | bkero: but our unsuccessful job http://logs.openstack.org/10/416110/80/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/dffe3c3/logs/var/log/deployed-server-os-collect-config.txt.gz has 24.3 (which is the subnode itself) | 19:01 |
| trown | bkero: oh wait, no it isnt, but it is a different IP on the undercloud | 19:02 |
| EmilienM | bnemec: good questions | 19:02 |
| *** flepied has joined #tripleo | 19:02 | |
| bnemec | I mean, the current-tripleo repo is older than when that patch merged. | 19:02 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: add default for ZUUL_PROJECT in toci_instack_ovb https://review.openstack.org/418504 | 19:02 |
| trown | bkero: it is getting that from heat though... | 19:04 |
| bkero | right, deployed_server_metadata_url=$(openstack stack resource metadata $server_stack deployed-server | jq -r '.["os-collect-config"].request.metadata_url') | 19:04 |
| bnemec | EmilienM: We're not using the neutron from current-tripleo for some reason: openstack-neutron-10.0.0-0.20170111163815.c08beca.el7.centos.noarch | 19:05 |
| bnemec | current-tripleo is openstack-neutron-10.0.0-0.20170111003620.c08766d.el7.centos.noarch.rpm | 19:05 |
| EmilienM | because we have a temprevert? | 19:05 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Remove unused roles from OOOQ https://review.openstack.org/418998 | 19:06 |
| bkero | I wish I had all these logs from a job that I could grpe through :( | 19:06 |
| bnemec | EmilienM: Oh, that's probably it. We're rebuilding the package from master every time. | 19:06 |
| EmilienM | yeah | 19:06 |
| EmilienM | bnemec: we need to approve https://review.openstack.org/#/c/417888/ then | 19:06 |
| bnemec | So maybe we need to just approve the revert. | 19:06 |
| bnemec | Yeah | 19:06 |
| EmilienM | done | 19:06 |
| EmilienM | I'll be around until late anyway in case something goes wrong with this one | 19:07 |
| bnemec | Well, it can't make things much worse. | 19:07 |
| EmilienM | bnemec: it would be a nice feature though, being able to temprevert from current | 19:07 |
| bnemec | And the cherry-pick without temprevert did pass, so there's a reasonable chance we'll be unbroken after it merges. | 19:07 |
| *** nyechiel_ has quit IRC | 19:08 | |
| bnemec | EmilienM: Yeah. I think we'd have to look up the current-tripleo git hash from the repo. | 19:08 |
| bnemec | But it looks like that's doable. | 19:08 |
| *** gfidente has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 19:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 19:11 |
| *** ooolpbot has quit IRC | 19:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 19:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 19:11 |
| *** jkilpatr has quit IRC | 19:14 | |
| sanagikoki | Could someone review this ? https://review.openstack.org/#/c/404897/ | 19:14 |
| *** abehl has quit IRC | 19:14 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-quickstart: Adds support for multiple distributions https://review.openstack.org/419062 | 19:17 |
| EmilienM | bnemec: so temprevert promotes a package to latest consistent, nice feature :D | 19:19 |
| bnemec | EmilienM: Yes, it's a "feature" ;-) | 19:19 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: implement a collectd composable service https://review.openstack.org/411048 | 19:22 |
| jaosorior | ansiwen: now you can rebase | 19:24 |
| *** jkilpatr has joined #tripleo | 19:29 | |
| *** jlinkes has quit IRC | 19:32 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Remove unused roles from OOOQ https://review.openstack.org/418998 | 19:34 |
| *** paramite has joined #tripleo | 19:34 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Remove unused dependency from roles https://review.openstack.org/419007 | 19:35 |
| *** paramite has quit IRC | 19:43 | |
| *** mburned is now known as mburned_out | 19:44 | |
| *** akuznetsov has joined #tripleo | 19:45 | |
| *** jaosorior has quit IRC | 19:46 | |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart-extras: Add /tmp/ara to the collected log directories https://review.openstack.org/418602 | 19:46 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Improve upgrade process to include upgrade flag https://review.openstack.org/419112 | 19:48 |
| mwhahaha | EmilienM: -^ upgrade flag for undercloud | 19:48 |
| *** akuznetsov has quit IRC | 19:49 | |
| EmilienM | mwhahaha: maybe we can mention https://blueprints.launchpad.net/tripleo/+spec/undercloud-upgrade in the commit message (can be done later) | 19:49 |
| mwhahaha | EmilienM: ok | 19:50 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Improve upgrade process to include upgrade flag https://review.openstack.org/419112 | 19:50 |
| EmilienM | mwhahaha: it looks really good | 19:51 |
| *** rbrady has joined #tripleo | 19:52 | |
| *** rbrady has joined #tripleo | 19:52 | |
| *** jaosorior has joined #tripleo | 19:56 | |
| *** bana_k has joined #tripleo | 20:01 | |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Improve upgrade process to include upgrade flag https://review.openstack.org/419112 | 20:03 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Use zuul-cloner to get tripleo-quickstart/-extras https://review.openstack.org/419117 | 20:03 |
| *** jlinkes has joined #tripleo | 20:05 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient: Switch undercloud upgrade to use upgrade script https://review.openstack.org/419118 | 20:05 |
| *** dsariel has quit IRC | 20:05 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Remove unused dependency from roles https://review.openstack.org/419007 | 20:06 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs of containers https://review.openstack.org/419018 | 20:06 |
| *** akrivoka has quit IRC | 20:06 | |
| *** sdake_ is now known as sdake | 20:07 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Remove unused roles from OOOQ https://review.openstack.org/418998 | 20:08 |
| openstackgerrit | Ade Lee proposed openstack/instack-undercloud: Add code to support novajoin in the undercloud https://review.openstack.org/418478 | 20:10 |
| *** ooolpbot has joined #tripleo | 20:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 20:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 20:11 |
| *** ooolpbot has quit IRC | 20:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 20:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 20:11 |
| *** jlinkes has quit IRC | 20:11 | |
| *** akrzos-mtg is now known as akrzos | 20:13 | |
| flaper87 | EmilienM: what patch is that? LET'S DO THIS! | 20:14 |
| EmilienM | flaper87: https://review.openstack.org/#/c/418987/ | 20:14 |
| *** milan has quit IRC | 20:14 | |
| EmilienM | flaper87: I asked for a review on #heat | 20:15 |
| flaper87 | that's awesome! Thanks therve | 20:16 |
| *** salmankhan has joined #tripleo | 20:20 | |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades https://review.openstack.org/419121 | 20:20 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert "temprevert neutron "Don't create HA resources until needed" patch" https://review.openstack.org/417888 | 20:21 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades https://review.openstack.org/419121 | 20:21 |
| bnemec | Okay, https://review.openstack.org/#/c/417888/ has merged. Let's see what happens. | 20:21 |
| jaosorior | alee: O_O | 20:22 |
| jaosorior | alee: so... what was missing again | 20:22 |
| jaosorior | for testing the oooq patches | 20:22 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/419122 | 20:22 |
| EmilienM | bnemec: let's see ^ | 20:22 |
| alee | jaosorior, sorry - you pointed me to the fact that neutron is now fixed? | 20:23 |
| * bnemec swears at puppet-openstack-integration | 20:23 | |
| bnemec | It keeps breaking my gate jobs. :-( | 20:24 |
| *** salmankhan has quit IRC | 20:24 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add registry and role service list entries for Octavia https://review.openstack.org/418596 | 20:24 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add Octavia API service definitions https://review.openstack.org/411872 | 20:24 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Introduce Octavia implememtation services https://review.openstack.org/411874 | 20:24 |
| * mwhahaha blames your gate jobs | 20:24 | |
| *** jkilpatr has quit IRC | 20:24 | |
| jaosorior | alee: eh, no, I was asking since the RDO package part has merged | 20:25 |
| alee | jaosorior, ah ok | 20:25 |
| alee | jaosorior, lets see .. | 20:25 |
| *** nyechiel_ has joined #tripleo | 20:25 | |
| alee | jaosorior, https://review.openstack.org/#/c/418478/ | 20:26 |
| jaosorior | alee: ah yeah | 20:26 |
| jaosorior | great | 20:26 |
| alee | jaosorior, and the changes in https://review.openstack.org/418483 | 20:27 |
| *** social has quit IRC | 20:27 | |
| alee | and https://review.openstack.org/#/c/398772/ | 20:27 |
| alee | and the puppet change : https://review.openstack.org/418677 | 20:28 |
| jaosorior | right | 20:29 |
| *** jkilpatr has joined #tripleo | 20:29 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: (undercloud|overcloud)-deploy: Add deployed_server script support https://review.openstack.org/417944 | 20:29 |
| *** salmankhan has joined #tripleo | 20:30 | |
| *** mburned_out is now known as mburned | 20:30 | |
| *** sshnaidm is now known as sshnaidm|bbl | 20:30 | |
| *** social has joined #tripleo | 20:33 | |
| *** salmankhan has quit IRC | 20:34 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Remove Glance Registry service https://review.openstack.org/417109 | 20:35 |
| EmilienM | bnemec: which patch? | 20:35 |
| *** bana_k has quit IRC | 20:35 | |
| bnemec | EmilienM: https://review.openstack.org/#/c/411460/ | 20:35 |
| *** sdake has quit IRC | 20:35 | |
| bnemec | Having the integration project in the gate queue breaks the package build because apparently we don't clone that. | 20:36 |
| bnemec | Which makes me wonder why it has tripleo-ci jobs running on it. | 20:36 |
| EmilienM | bnemec: why do you swear on puppet-openstack-integration ? | 20:36 |
| EmilienM | ah | 20:36 |
| EmilienM | ok gotcha | 20:37 |
| EmilienM | bnemec: I don't know, good question | 20:37 |
| *** sdake has joined #tripleo | 20:37 | |
| bnemec | Oh, maybe the problem isn't that we don't clone it. | 20:38 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Add panko service to undercloud https://review.openstack.org/418475 | 20:39 |
| bnemec | It's that no package gets created from it. | 20:39 |
| *** jaosorior has quit IRC | 20:39 | |
| *** gfidente has joined #tripleo | 20:40 | |
| *** nyechiel_ has quit IRC | 20:40 | |
| *** sdake has quit IRC | 20:41 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart: changes to add novajoin to undercloud https://review.openstack.org/398772 | 20:41 |
| bnemec | Weird. We create the repos directory: | 20:42 |
| bnemec | 2017-01-11 20:01:28.276009 | +(./..//tripleo-ci/scripts/common_functions.sh:278): delorean_build_and_serve(): mkdir -p /opt/stack/new/delorean/data/repos/current | 20:42 |
| bnemec | But then it's still missing later | 20:42 |
| bnemec | 2017-01-11 20:01:30.437161 | ./..//tripleo-ci/scripts/common_functions.sh: line 295: pushd: /opt/stack/new/delorean/data/repos: No such file or directory | 20:42 |
| bnemec | Oh, it gets created because tripleo-ci is not a packaged project. | 20:44 |
| bnemec | Then we try to build poi and I bet delorean blows away the dummy repo. | 20:44 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Failure debugging improvements https://review.openstack.org/419081 | 20:47 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add puppet-openstack-integration to delorean exclude list https://review.openstack.org/419128 | 20:47 |
| bnemec | Fixed^ | 20:47 |
| *** mburned is now known as mburned_out | 20:49 | |
| *** sdake has joined #tripleo | 20:49 | |
| *** mburned_out is now known as mburned | 20:49 | |
| EmilienM | bnemec: thanks! nice catch here | 20:51 |
| bnemec | I'm all about fixing problems that block me from getting things done. :-) | 20:52 |
| bnemec | Cripes, it's almost 3:00 and I haven't eaten yet. | 20:53 |
| *** dmsimard|afk is now known as dmsimard | 21:00 | |
| *** gfidente has quit IRC | 21:04 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add retry to RHEL registration https://review.openstack.org/386529 | 21:06 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient: Deploy the undercloud with Heat https://review.openstack.org/351351 | 21:06 |
| *** trown is now known as trown|mtg | 21:09 | |
| *** fzdarsky has quit IRC | 21:09 | |
| *** iranzo has quit IRC | 21:10 | |
| rook | bnemec: hey, i thought i read there is a way to have a hybrid ovb+baremetal setup? | 21:10 |
| *** ooolpbot has joined #tripleo | 21:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 21:11 |
| *** ooolpbot has quit IRC | 21:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 21:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 21:11 |
| rook | bnemec maybe it is all around networking... just use vlans... instead of tenant networking with tunnels. | 21:11 |
| *** jprovazn has quit IRC | 21:11 | |
| rook | bnemec: I am wanting to have N number of baremetal machines for controllers, but virt computes. | 21:11 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Bump required ansible version pin https://review.openstack.org/419135 | 21:16 |
| bnemec | rook: Theoretically you could do that. You would have to create a network on the host cloud that was connected to the provisioning network for the baremetal machines. | 21:16 |
| bnemec | Then you'd have to use that same network for the vms. | 21:16 |
| bnemec | I've done one or the other, but never both at the same time so I'm not entirely sure how it would work. | 21:17 |
| rook | right | 21:17 |
| rook | bnemec: just a vlan tenant network | 21:17 |
| rook | You couldn't use tunnels in this case. | 21:18 |
| rook | without a huge effort. | 21:18 |
| rook | because you would need to somehow get the neutron-ovs-agent on that host. | 21:18 |
| bnemec | Right. If the switch is configured such that you can pxe boot off that vlan then I think it could work. | 21:18 |
| rook | right... so vlan might workout. | 21:18 |
| rook | bnemec or just really big VMs... | 21:19 |
| bnemec | Also an option if I ever get around to documenting it. | 21:19 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart: Add the ARA Ansible callback generate a static playbook reports https://review.openstack.org/418601 | 21:20 |
| *** leanderthal has quit IRC | 21:21 | |
| openstackgerrit | Paul Belanger proposed openstack/tripleo-specs: Add rootfs elements spec for diskimage-builder https://review.openstack.org/419139 | 21:22 |
| mwhahaha | pradk: Are you aware of the package issues that seem to be gnocchi related as a part of the undercloud upgrade http://logs.openstack.org/18/419118/1/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/4dc52e4/logs/var/log/undercloud_upgrade.txt.gz#_2017-01-11_20_31_11_000 | 21:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common: Add ReNo support https://review.openstack.org/419140 | 21:25 |
| pradk | mwhahaha, looking | 21:27 |
| pradk | mwhahaha, huh.. i assume this is related to https://review.rdoproject.org/r/#/c/4187/ we need to merge this i assume | 21:29 |
| pradk | lemme publish a patch | 21:30 |
| mwhahaha | pradk: well the errors seem to point to some sort of repo issue, i'm not entirely sure if we're missing some package or dependency or what. I just saw it in a few different jobs | 21:31 |
| pradk | mwhahaha, so due to this issue (the above patch fixes) gnocchi builds will keep failing as there are files in spec that are not in code any more | 21:33 |
| mwhahaha | pradk: ah, well that's unfortunate | 21:33 |
| pradk | i went ahead and +a'ed it | 21:36 |
| pradk | we might need a new promotion once these builds kick in? | 21:36 |
| mwhahaha | yea probably | 21:36 |
| pradk | hmm so what i merged is for master | 21:41 |
| pradk | looking at the upgrade error you have .. 3.0.3-0.20170110234954.bb687e1 | 21:41 |
| pradk | thats is a newton stable version ..which we merged yesterday https://review.rdoproject.org/r/#/c/4262/ | 21:42 |
| pradk | lets take this to rdo | 21:42 |
| *** dougbtv_ has joined #tripleo | 21:42 | |
| *** trown|mtg is now known as trown|outtypewww | 21:42 | |
| *** dougbtv has quit IRC | 21:43 | |
| *** dougbtv_ is now known as dougbtv | 21:43 | |
| *** jaosorior has joined #tripleo | 21:44 | |
| *** jayg is now known as jayg|g0n3 | 21:45 | |
| *** sshnaidm|bbl is now known as sshnaidm | 21:48 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Deployed server bootstrap via Heat https://review.openstack.org/411445 | 21:55 |
| *** Goneri has quit IRC | 21:56 | |
| *** flepied has quit IRC | 21:56 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release https://review.openstack.org/410831 | 21:58 |
| *** salmankhan has joined #tripleo | 21:58 | |
| *** panda|bbl is now known as panda|Zz | 21:58 | |
| *** ansmith has quit IRC | 21:59 | |
| *** ansmith_ has quit IRC | 21:59 | |
| trozet | can someone set workflow on https://review.openstack.org/#/c/418495/ please? | 22:01 |
| *** fzdarsky has joined #tripleo | 22:02 | |
| *** salmankhan has quit IRC | 22:02 | |
| fpan | EmilienM: would you mind looking at this one more time, https://review.openstack.org/#/c/414730/ | 22:02 |
| *** sdake has quit IRC | 22:03 | |
| *** nyechiel_ has joined #tripleo | 22:04 | |
| *** colonwq has quit IRC | 22:04 | |
| *** rhallisey has quit IRC | 22:05 | |
| *** karimb has joined #tripleo | 22:05 | |
| *** fzdarsky has quit IRC | 22:08 | |
| bnemec | trozet: Done, but do note that tripleo-ci hadn't voted on that patch yet. | 22:09 |
| *** mburned is now known as mburned_out | 22:09 | |
| bnemec | In this case those files aren't covered by it anyway so it doesn't matter, but that would be why it wasn't approved before (I assume). | 22:09 |
| *** ooolpbot has joined #tripleo | 22:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 22:11 |
| *** ooolpbot has quit IRC | 22:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 22:11 |
| *** salmankhan has joined #tripleo | 22:11 | |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 22:11 |
| *** lblanchard has quit IRC | 22:13 | |
| *** flepied has joined #tripleo | 22:14 | |
| *** salmankhan has quit IRC | 22:15 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 22:16 |
| *** colonwq has joined #tripleo | 22:18 | |
| thrash | EmilienM: can we kick up the debug on that job? I can't reproduce locally (of course) and it passed on another recheck. | 22:20 |
| *** fzdarsky has joined #tripleo | 22:21 | |
| *** salmankhan has joined #tripleo | 22:21 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci: Clean all yum info during reposetup https://review.openstack.org/419173 | 22:22 |
| *** sshnaidm is now known as sshnaidm|away | 22:23 | |
| *** salmankhan has quit IRC | 22:25 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Neutron composable upgrade with ansible https://review.openstack.org/418920 | 22:30 |
| *** kberger has joined #tripleo | 22:41 | |
| openstackgerrit | Koki Sanagi proposed openstack/tripleo-heat-templates: Add THT for fossw ML2 plugin in networking-fujitsu https://review.openstack.org/413778 | 22:41 |
| *** jkilpatr has quit IRC | 22:47 | |
| *** jcoufal has quit IRC | 22:48 | |
| *** jcoufal has joined #tripleo | 22:50 | |
| *** dsneddon is now known as dsneddon_afk | 22:51 | |
| *** jmelvin|lunch has quit IRC | 22:52 | |
| *** jcoufal has quit IRC | 22:54 | |
| *** chlong has quit IRC | 22:55 | |
| *** [1]cdearborn has quit IRC | 23:04 | |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart: Add the ARA Ansible callback generate a static playbook reports https://review.openstack.org/418601 | 23:04 |
| *** dsneddon has joined #tripleo | 23:05 | |
| *** fzdarsky is now known as fzdarsky|afk | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654611 | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654615 | 23:11 |
| *** ooolpbot has quit IRC | 23:11 | |
| openstack | Launchpad bug 1654611 in tripleo "Mitaka nonha ping test failing to upload image to glance" [Critical,Triaged] | 23:11 |
| openstack | Launchpad bug 1654615 in tripleo "Mitaka ha ping test failing to ping vm" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 23:11 |
| *** fzdarsky|afk has quit IRC | 23:12 | |
| *** egafford has quit IRC | 23:15 | |
| *** morazi has quit IRC | 23:15 | |
| jaosorior | bnemec: http://logs.openstack.org/03/347503/10/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/fdf6715/console.html#_2017-01-11_20_03_37_938324 :/ | 23:18 |
| *** salmankhan has joined #tripleo | 23:19 | |
| *** saneax-_-|AFK is now known as saneax | 23:20 | |
| bnemec | jaosorior: Yeah, I actually suspect that might have been some funny business I was doing on the controller at that time. | 23:20 |
| bnemec | The newton jobs on that patch passed, so I don't think I completely broke the testenv code. | 23:21 |
| bnemec | Plus most of that patch isn't tested by ci. | 23:21 |
| jaosorior | ah | 23:21 |
| jaosorior | true | 23:21 |
| bnemec | I guess we'll see how the recheck goes tomorrow morning. | 23:21 |
| *** dsneddon has quit IRC | 23:21 | |
| * bnemec is rechecking all the things before leaving for the night | 23:21 | |
| *** dsneddon has joined #tripleo | 23:22 | |
| jaosorior | bnemec: my patch has been on queue for more than 7 hours X_x | 23:22 |
| jaosorior | I guess I'll know if my TLS patch works tomorrow | 23:22 |
| bnemec | That unfortunately sounds about right: http://158.69.68.80/ | 23:22 |
| bnemec | Grr, DNS still hasn't updated so I can stop hitting that via raw IP. | 23:23 |
| *** salmankhan has quit IRC | 23:23 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Setting networking-odl v2 as a mechanism driver https://review.openstack.org/418495 | 23:27 |
| jaosorior | bnemec: did the nodecount fix work? | 23:27 |
| bnemec | jaosorior: That one blew up on the neutron bug. I kicked off a recheck. | 23:27 |
| jaosorior | ok | 23:28 |
| *** nyechiel_ has quit IRC | 23:29 | |
| jaosorior | bnemec: it got to the pingtest though, which means that it was able to schedule the nodes and deploy the overcloud | 23:29 |
| bnemec | jaosorior: True. I want to see it work a few times before we merge it anyway since it was an intermittent problem before. | 23:32 |
| *** salmankhan has joined #tripleo | 23:32 | |
| jaosorior | bnemec: well, you could rebase some change over that one | 23:32 |
| *** colonwq has quit IRC | 23:34 | |
| bnemec | jaosorior: Good idea. 21 test jobs is clearly superior to 7. :-) | 23:34 |
| *** rlandy has quit IRC | 23:35 | |
| jaosorior | bnemec: ?? | 23:35 |
| bnemec | jaosorior: That wasn't sarcasm. If I rebase a couple of other ci patches on that one we'll get 21 jobs running with instead of just 7. | 23:36 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Add panko service to undercloud https://review.openstack.org/418475 | 23:36 |
| bnemec | *running with it | 23:36 |
| *** salmankhan has quit IRC | 23:36 | |
| jaosorior | ah haha | 23:36 |
| jaosorior | thought I had missed something and it was sarcasm | 23:37 |
| jaosorior | but yeah | 23:37 |
| jaosorior | that would be good for testing it out | 23:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Run with actual node count https://review.openstack.org/418622 | 23:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add storage-mgmt network to compute nodes https://review.openstack.org/419049 | 23:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Re-generate nic-configs https://review.openstack.org/419048 | 23:37 |
| *** pradk has quit IRC | 23:38 | |
| *** dmarlin has quit IRC | 23:38 | |
| *** fultonj has quit IRC | 23:40 | |
| *** salmankhan has joined #tripleo | 23:42 | |
| *** salmankhan has quit IRC | 23:46 | |
| *** sanagikoki has quit IRC | 23:48 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Adds NavBar__ namespaced ids for automation https://review.openstack.org/419200 | 23:52 |
| *** jaosorior has quit IRC | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!