| tonyb | spotz: Well if you don't have anythign from mistral or tripleo in 4 hours *and* you don't have a overcloudrc you probably have | 00:01 |
|---|---|---|
| spotz | tonyb hehehe | 00:01 |
| tonyb | spotz: try logging into each node and see if it 'looks' right | 00:01 |
| tonyb | spotz: are the containers you'd expect to see runnign, runnig etc etc | 00:01 |
| spotz | Though to be honest everything has taken longer then I would have though | 00:02 |
| tonyb | spotz: It takes about an 90mins for me to go from blank VM -> installed overcloud but that's with queens. | 00:02 |
| tonyb | spotz: I wouldn't expect it to take much longer on master | 00:03 |
| *** threestrands has joined #tripleo | 00:03 | |
| *** threestrands has quit IRC | 00:03 | |
| *** threestrands has joined #tripleo | 00:03 | |
| spotz | I'm on queens too, I also used the quuen overcloud and ironic files though the instructions I was using had pike | 00:03 |
| tonyb | spotz: Ohhh really? then IIUC os-collect-config should be very noisy and if you get 'STACK COMPLETE' it really shoudl be complete | 00:04 |
| tonyb | spotz: This is the *overcloud* right? the undercloud install went just fine correct? | 00:05 |
| spotz | tonyb yep undercloud is up | 00:06 |
| tonyb | spotz: cool. | 00:06 |
| spotz | tonyb: this is my undercloud screen from the deployment command to where it's been sitting http://paste.openstack.org/show/725313/ | 00:08 |
| spotz | And that suggests all is good | 00:08 |
| *** medberry has quit IRC | 00:09 | |
| spotz | and sudo journalctl -flu os-collect-config on all nodes http://paste.openstack.org/show/725314/ | 00:10 |
| tonyb | spotz: that got truncated as paste only has limited file size, try a gist or just paste the last 100 lines or so | 00:11 |
| spotz | tonyb for the stack? | 00:12 |
| tonyb | spotz: Yeah paste //paste.openstack.org/show/725313/ | 00:12 |
| spotz | https://gist.github.com/spotz/77615f6b722b74d9a73db12ddeed3b31 it's not exciting though:) | 00:12 |
| tonyb | spotz: It's be nice if clicking save told you that "Your paste is big we've truncated it at 4096byes" | 00:12 |
| spotz | hehe | 00:13 |
| tonyb | spotz: Okay well that does look good. | 00:13 |
| tonyb | I wonder why you don't have an overcloudrc | 00:13 |
| spotz | Which is why I keep going back to the infrastructure the VMs are on is the source | 00:14 |
| * tonyb is tryign to think how to manually create one for you | 00:14 | |
| tonyb | spotz: did the command return you to a prompt? | 00:15 |
| tonyb | or does it think the install is still going on? | 00:15 |
| spotz | the deploy? Nope it's just sitting there hung. The last run ended with a 503 HTTP blip | 00:15 |
| tonyb | Oh wait, it *is* still going on. Thats the end of the heat stuff now you're doing the ansilbe stuff | 00:16 |
| spotz | http://paste.openstack.org/show/725315/ | 00:16 |
| tonyb | okay we've come full circle | 00:16 |
| spotz | That's how it ended the last run | 00:16 |
| spotz | hehehe | 00:16 |
| tonyb | :( | 00:16 |
| spotz | I'd hate to kill it if it was slowly trudging along | 00:20 |
| tonyb | spotz: I doubt very much that it is | 00:20 |
| tonyb | spotz: If you can't run openstack overcloud config download in another terminal then I'd say you're toast and shoudl start again tomorrow (it has to be late for you) | 00:22 |
| spotz | tonyb 7:20 so not too bad though I go to bed early. I'll kill it and try to run deploy_steps_playbook.yaml by hand? | 00:23 |
| tonyb | spotz: Oh, okay I must have my internal world clock wrong. 1920 isn't too bad but then again it's Sunday ;P | 00:27 |
| tonyb | spotz: Maybe, that a whole world I'm not familier with | 00:27 |
| spotz | Me neither:) | 00:29 |
| tonyb | ;p | 00:31 |
| *** bandini has quit IRC | 00:41 | |
| *** bandini has joined #tripleo | 00:42 | |
| spotz | tonyb Well I killed the one and started another with the 3 templates you suggested. Guess we'll see in the morning. Thanks as always for you help | 00:58 |
| tonyb | spotz: good luck. At least tomorrow morning you'll have people online that know what they're talkign about ;P | 01:00 |
| spotz | heheh, don't sell yourself short! | 01:00 |
| tonyb | spotz: Thanks | 01:02 |
| *** edmondsw has joined #tripleo | 01:04 | |
| *** edmondsw has quit IRC | 01:08 | |
| *** dmacpher has quit IRC | 01:12 | |
| *** dmacpher has joined #tripleo | 01:13 | |
| *** medberry has joined #tripleo | 01:15 | |
| *** medberry has quit IRC | 01:15 | |
| *** medberry has joined #tripleo | 01:15 | |
| *** threestrands_ has joined #tripleo | 01:18 | |
| *** threestrands_ has quit IRC | 01:19 | |
| *** threestrands_ has joined #tripleo | 01:20 | |
| *** threestrands_ has quit IRC | 01:21 | |
| *** threestrands_ has joined #tripleo | 01:21 | |
| *** threestrands_ has quit IRC | 01:21 | |
| *** threestrands_ has joined #tripleo | 01:21 | |
| *** threestrands has quit IRC | 01:21 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Add --cleanup argument for image uploads https://review.openstack.org/578251 | 01:42 |
| tbarron | bandini: well, thanks for the reviews! | 02:28 |
| openstackgerrit | Merged openstack/tripleo-common master: Remove the unhandled_error task from baremetal.yaml https://review.openstack.org/578763 | 02:31 |
| *** medberry has quit IRC | 02:37 | |
| *** medberry has joined #tripleo | 02:44 | |
| *** medberry has joined #tripleo | 02:44 | |
| *** khyr0n has quit IRC | 02:45 | |
| *** psachin has joined #tripleo | 02:52 | |
| *** edmondsw has joined #tripleo | 02:52 | |
| *** edmondsw has quit IRC | 02:57 | |
| *** ramishra has joined #tripleo | 03:20 | |
| tonyb | spotz: So I just found out anout '--stack-only' and '--config-download-only' which I'm using as the stack part is working great for my but I found a problem with the config side (which I've partially fixed) you might want to try the same if you get a similar problem overnight/tomorrow | 03:30 |
| *** atoth has quit IRC | 03:35 | |
| *** skramaja has joined #tripleo | 03:36 | |
| *** jaganathan has joined #tripleo | 03:53 | |
| *** shreshtha has joined #tripleo | 03:57 | |
| *** moshele has joined #tripleo | 04:02 | |
| *** moshele has quit IRC | 04:05 | |
| *** mdnadeem has joined #tripleo | 04:35 | |
| *** ykarel|away has joined #tripleo | 04:35 | |
| *** ykarel|away is now known as ykarel | 04:39 | |
| *** edmondsw has joined #tripleo | 04:40 | |
| *** bkopilov has quit IRC | 04:44 | |
| *** edmondsw has quit IRC | 04:44 | |
| *** tcw has joined #tripleo | 04:45 | |
| *** cshastri has joined #tripleo | 04:48 | |
| cmyster | i15 | 04:49 |
| *** tcw has quit IRC | 04:55 | |
| *** Noam has joined #tripleo | 04:55 | |
| *** links has joined #tripleo | 05:00 | |
| *** pdeore has joined #tripleo | 05:03 | |
| *** chandankumar has joined #tripleo | 05:08 | |
| *** chandankumar is now known as chkumar|ruck | 05:08 | |
| *** tcw has joined #tripleo | 05:12 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/python-tripleoclient master: Quick'n'dirty way to at least protect and correct rights on files https://review.openstack.org/580354 | 05:13 |
| *** Noam has quit IRC | 05:17 | |
| *** noama has joined #tripleo | 05:17 | |
| *** yprokule has joined #tripleo | 05:17 | |
| *** noama has quit IRC | 05:25 | |
| *** noama has joined #tripleo | 05:25 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/python-tripleoclient master: Quick'n'dirty way to at least protect and correct rights on files https://review.openstack.org/580354 | 05:26 |
| *** holser_ has joined #tripleo | 05:40 | |
| *** hjensas has quit IRC | 05:46 | |
| *** yolanda has joined #tripleo | 05:46 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use the ara-report mechanism from logs.o.o https://review.openstack.org/580090 | 05:47 |
| *** kopecmartin has joined #tripleo | 05:50 | |
| *** medberry has quit IRC | 05:51 | |
| *** avivgt has quit IRC | 05:51 | |
| *** janki has joined #tripleo | 05:53 | |
| *** quiquell|off is now known as quiquell | 05:53 | |
| *** avivgt has joined #tripleo | 05:53 | |
| *** mrsoul has joined #tripleo | 05:54 | |
| *** mrsoul is now known as mschuppert | 05:55 | |
| *** avivgt has quit IRC | 05:58 | |
| *** dparkes has joined #tripleo | 06:03 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/python-tripleoclient master: Quick'n'dirty way to at least protect and correct rights on files https://review.openstack.org/580354 | 06:03 |
| Tengu | damn. Monday morning corrections are hard -.-' | 06:03 |
| *** jfrancoa has joined #tripleo | 06:04 | |
| *** dparkes has quit IRC | 06:08 | |
| *** ksambor has joined #tripleo | 06:09 | |
| *** nyechiel_ has joined #tripleo | 06:09 | |
| *** cylopez has joined #tripleo | 06:09 | |
| *** matbu has joined #tripleo | 06:11 | |
| *** mrsoul has joined #tripleo | 06:11 | |
| *** paramite has joined #tripleo | 06:11 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-docs master: Remove remaining references to docker-cmd in docs https://review.openstack.org/580913 | 06:11 |
| *** cylopez has left #tripleo | 06:13 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use the ara-report mechanism from logs.o.o https://review.openstack.org/580089 | 06:17 |
| *** holser_ has quit IRC | 06:19 | |
| *** quiquell is now known as quiquell|bbl | 06:19 | |
| *** agurenko has joined #tripleo | 06:27 | |
| *** edmondsw has joined #tripleo | 06:28 | |
| *** edmondsw has quit IRC | 06:33 | |
| *** dparkes has joined #tripleo | 06:35 | |
| *** ccamacho has joined #tripleo | 06:39 | |
| *** aufi has joined #tripleo | 06:39 | |
| *** ffiore has joined #tripleo | 06:42 | |
| *** moshele has joined #tripleo | 06:42 | |
| *** bkopilov has joined #tripleo | 06:43 | |
| *** jtomasek has joined #tripleo | 06:53 | |
| *** cshastri has quit IRC | 06:54 | |
| *** cshastri has joined #tripleo | 06:55 | |
| *** radeks has joined #tripleo | 06:55 | |
| *** hjensas has joined #tripleo | 06:57 | |
| *** hjensas has quit IRC | 06:57 | |
| *** hjensas has joined #tripleo | 06:57 | |
| *** jpich has joined #tripleo | 06:58 | |
| *** nyechiel has joined #tripleo | 07:00 | |
| openstackgerrit | Vu Cong Tuan proposed openstack/python-tripleoclient master: Switch to stestr https://review.openstack.org/580933 | 07:00 |
| *** nyechiel_ has quit IRC | 07:01 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Fluentd configures rsyslog to send logs properly https://review.openstack.org/580937 | 07:05 |
| *** peereb has joined #tripleo | 07:05 | |
| *** florianf has joined #tripleo | 07:06 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Fluentd configures rsyslog to send logs properly https://review.openstack.org/580937 | 07:06 |
| *** tesseract has joined #tripleo | 07:06 | |
| mschuppert | hi, could I please get pike backport reviews for https://review.openstack.org/#/c/580068/1 that we get this merged | 07:07 |
| *** rcernin has quit IRC | 07:08 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 07:09 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use the ara-report mechanism from logs.o.o https://review.openstack.org/580090 | 07:09 |
| Tengu | tonyb: heya! could you dig a bit your issue? I was off for the last hour, and am in a meeting in about 15 - after that, I should be able to help you a bit. | 07:12 |
| *** cylopez has joined #tripleo | 07:15 | |
| *** alee has joined #tripleo | 07:17 | |
| *** amoralej|off is now known as amoralej | 07:21 | |
| *** tesseract has quit IRC | 07:25 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Introduce a function to verify for fixed crm_diff https://review.openstack.org/574336 | 07:26 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: WIP First pass at using crm_diff for pcmk resource deep_compare https://review.openstack.org/574388 | 07:26 |
| *** ukalifon has joined #tripleo | 07:26 | |
| mdnadeem | #tripleo do we have below option to update security hardening feature in newton as well : r | 07:27 |
| mdnadeem | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/security_hardening.html#default-security-values-in-horizon | 07:27 |
| *** tesseract has joined #tripleo | 07:27 | |
| mdnadeem | ramishra, ccamacho ^^ | 07:28 |
| *** cylopez has left #tripleo | 07:31 | |
| *** itlinux has joined #tripleo | 07:32 | |
| *** d0ugal_ has quit IRC | 07:33 | |
| *** d0ugal has joined #tripleo | 07:33 | |
| *** d0ugal has quit IRC | 07:33 | |
| *** d0ugal has joined #tripleo | 07:33 | |
| *** avivgt has joined #tripleo | 07:33 | |
| *** tosky has joined #tripleo | 07:35 | |
| mdnadeem | #tripleo do we have below option to update security hardening feature in newton as well : | 07:36 |
| mdnadeem | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/security_hardening.html#default-security-values-in-horizon | 07:36 |
| mdnadeem | d0ugal, ^^ | 07:36 |
| d0ugal | mdnadeem: ? | 07:41 |
| *** nyechiel_ has joined #tripleo | 07:42 | |
| *** nyechiel has quit IRC | 07:42 | |
| *** noama is now known as Noam | 07:43 | |
| mdnadeem | d0ugal, Do you have any info about if we have an option to change the Default Security Values in Horizon via tripleo heat templates in newton, as it has define in the above guide | 07:43 |
| *** quiquell|bbl is now known as quiquell | 07:43 | |
| *** Noam is now known as noama | 07:43 | |
| d0ugal | mdnadeem: No idea, sorry. | 07:43 |
| *** noama has quit IRC | 07:44 | |
| *** noama has joined #tripleo | 07:44 | |
| mdnadeem | d0ugal, No prob , Thanks | 07:45 |
| ramishra | mdnadeem: Looks like those were added to puppet-horizon/tripleo in ocata https://bugs.launchpad.net/tripleo/+bug/1640806 https://bugs.launchpad.net/tripleo/+bug/1640492 | 07:46 |
| openstack | Launchpad bug 1640806 in tripleo "Implement Horizon ENFORCE_PASSWORD_CHECK " [Medium,Fix released] - Assigned to Luke Hinds (lhinds) | 07:46 |
| openstack | Launchpad bug 1640492 in tripleo "Enable disable_password_reveal in horizon" [Medium,Fix released] - Assigned to Alex Schultz (alex-schultz) | 07:46 |
| mdnadeem | ramishra, do we have any scope to backport in Newton ? | 07:48 |
| tonyb | Tengu: Thanks, I'm going to be offline for the next few hours (dinner time), I'll check back when I'm home if you're still online and have time to look at it I'd be greatful | 07:49 |
| ramishra | mdnadeem: I can't answer that definitively, possibly not as these are kind of new features | 07:50 |
| *** bogdando has joined #tripleo | 07:50 | |
| mdnadeem | ramishra++ Thanks for the info | 07:50 |
| *** itlinux has quit IRC | 07:52 | |
| *** cshastri has quit IRC | 07:54 | |
| *** stendulker has joined #tripleo | 07:55 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a lookup plugin to get mistral workflow results https://review.openstack.org/575121 | 07:59 |
| *** itlinux has joined #tripleo | 07:59 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fix bootstrap_host_exec check for manila_share https://review.openstack.org/580879 | 08:06 |
| *** ykarel is now known as ykarel|lunch | 08:08 | |
| jtomasek | florianf: hi, could you please check this one, https://review.openstack.org/#/c/548685/13 it blocks other network config patches from merging | 08:08 |
| florianf | jtomasek: sure! | 08:09 |
| florianf | jtomasek: welcome back! :-) | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 08:10 |
| *** athomas has joined #tripleo | 08:11 | |
| *** threestrands_ has quit IRC | 08:12 | |
| *** dbecker has joined #tripleo | 08:15 | |
| *** athomas has quit IRC | 08:15 | |
| *** rodolof has joined #tripleo | 08:15 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log more details for container images prepare https://review.openstack.org/580959 | 08:15 |
| *** edmondsw has joined #tripleo | 08:16 | |
| jtomasek | florianf: thanks! :) | 08:19 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 08:20 |
| *** athomas has joined #tripleo | 08:20 | |
| *** edmondsw has quit IRC | 08:21 | |
| *** stendulker_ has joined #tripleo | 08:22 | |
| *** stendulker has quit IRC | 08:25 | |
| *** panda|off is now known as panda | 08:26 | |
| Tengu | tonyb: ok - I'm reading a bit more the module in order to understand - unfortunately the error message isn't really helpful. | 08:27 |
| Tengu | well, it's usually the case with puppet anyway -- | 08:27 |
| *** derekh has joined #tripleo | 08:29 | |
| *** akrivoka has joined #tripleo | 08:29 | |
| *** Haresh has joined #tripleo | 08:30 | |
| *** etingof has quit IRC | 08:31 | |
| *** bkopilov has quit IRC | 08:33 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Switch remaining env files to containers defaults https://review.openstack.org/567813 | 08:34 |
| *** suuuper has joined #tripleo | 08:37 | |
| *** ramishra has quit IRC | 08:39 | |
| *** derekh has quit IRC | 08:39 | |
| *** derekh has joined #tripleo | 08:40 | |
| *** etingof has joined #tripleo | 08:43 | |
| *** holser_ has joined #tripleo | 08:43 | |
| *** gvrangan has joined #tripleo | 08:45 | |
| *** ramishra has joined #tripleo | 08:45 | |
| *** bkopilov has joined #tripleo | 08:49 | |
| *** ykarel|lunch is now known as ykarel | 08:49 | |
| Tengu | akrivoka: erf, sorry for the CI -.-'. now it's failing for some reason on your patch :(. | 08:52 |
| Tengu | akrivoka: http://logs.openstack.org/13/569513/5/check/tripleo-ci-centos-7-containers-multinode/f073bd5/logs/undercloud/home/zuul/validations_pre-introspection.log.txt.gz apparently it's related to your work, at least (not 100% sure though) | 08:53 |
| akrivoka | Tengu: not sure... I did change the list validations action. but the previous CI run passed completely. | 08:55 |
| Tengu | akrivoka: hmm. true. damn. Really sorry, I didn't check the status :((. | 08:56 |
| akrivoka | Tengu: no worries :) | 08:56 |
| akrivoka | Tengu: I'll recheck again | 08:57 |
| *** sshnaidm|off is now known as sshnaidm|rover | 09:02 | |
| *** cshastri has joined #tripleo | 09:03 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Removes upgrade bash code from toci https://review.openstack.org/580971 | 09:04 |
| *** alee has quit IRC | 09:06 | |
| *** alee has joined #tripleo | 09:06 | |
| Tengu | bogdando: thank you for your support on my quick'n'dirty patch from Hell ;) | 09:06 |
| *** Goneri has joined #tripleo | 09:08 | |
| *** bkopilov has quit IRC | 09:09 | |
| *** nyechiel_ has quit IRC | 09:09 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 09:10 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 09:12 |
| *** ramishra has quit IRC | 09:15 | |
| *** ramishra has joined #tripleo | 09:17 | |
| *** d0ugal has quit IRC | 09:17 | |
| *** nyechiel_ has joined #tripleo | 09:19 | |
| *** d0ugal has joined #tripleo | 09:23 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Remove TOCI_JOBTYPE from native zuulv3 jobs https://review.openstack.org/580974 | 09:25 |
| *** moguimar has joined #tripleo | 09:25 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Use the ara-report mechanism from logs.o.o https://review.openstack.org/580088 | 09:30 |
| *** bkopilov has joined #tripleo | 09:31 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: HA support for OpenShift https://review.openstack.org/579609 | 09:32 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Replace raw_get with dict access syntax https://review.openstack.org/579843 | 09:32 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 09:35 |
| *** stendulker has joined #tripleo | 09:36 | |
| *** pblaho has joined #tripleo | 09:37 | |
| *** stendulker_ has quit IRC | 09:39 | |
| *** gvrangan has quit IRC | 09:42 | |
| *** itlinux has quit IRC | 09:42 | |
| *** itlinux has joined #tripleo | 09:48 | |
| *** brault has joined #tripleo | 09:52 | |
| *** gvrangan has joined #tripleo | 09:52 | |
| *** aufi has quit IRC | 09:53 | |
| *** gvrangan has quit IRC | 09:53 | |
| *** gvrangan has joined #tripleo | 09:54 | |
| *** gvrangan has quit IRC | 09:55 | |
| *** nyechiel_ has quit IRC | 09:56 | |
| *** gvrangan has joined #tripleo | 09:56 | |
| *** aufi has joined #tripleo | 09:58 | |
| Tengu | tonyb: I'm currently running your code on a local undercloud vm - I should be able to debug a bit more hopefully. | 10:06 |
| *** nyechiel_ has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 10:10 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Bump ARA version to 0.15.0 https://review.openstack.org/580988 | 10:10 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: Configure ARA in ansible action https://review.openstack.org/565077 | 10:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set configure_qemu to true to get qemu port range applied https://review.openstack.org/580068 | 10:12 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect overcloud statistics with ARA https://review.openstack.org/578462 | 10:15 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 10:18 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 10:30 |
| *** stendulker has quit IRC | 10:38 | |
| *** mburned has quit IRC | 10:39 | |
| *** mburned has joined #tripleo | 10:41 | |
| *** paramite has quit IRC | 10:43 | |
| *** sanjay__u has joined #tripleo | 10:44 | |
| *** paramite has joined #tripleo | 10:44 | |
| *** ffiore has quit IRC | 10:48 | |
| *** ffiore has joined #tripleo | 10:49 | |
| *** shreshtha_ has joined #tripleo | 10:54 | |
| *** shreshtha has quit IRC | 10:58 | |
| *** karthiks has quit IRC | 11:04 | |
| Tengu | hmmm. where are the dockerfiles for the containers on hub.docker.com? | 11:08 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 11:10 |
| *** nyechiel_ has quit IRC | 11:13 | |
| *** nyechiel_ has joined #tripleo | 11:13 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 11:15 |
| spotz | tonyb It actually finished! But wouldn't mind the info anyways:) | 11:16 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 11:17 |
| *** karthiks has joined #tripleo | 11:18 | |
| *** nyechiel_ has quit IRC | 11:18 | |
| *** bogdando has quit IRC | 11:19 | |
| spotz | tonyb Well finished and I have the overcloudrc file but the dashoard isn't responding, I'll look at it when I get back fromt he barn | 11:22 |
| hjensas | weshay: Don't we test overcloud upgrades in CI check jobs? (see discussion here: https://review.openstack.org/580776) | 11:23 |
| *** bfournie has quit IRC | 11:23 | |
| *** bfournie has joined #tripleo | 11:24 | |
| *** bfournie has quit IRC | 11:24 | |
| openstackgerrit | Merged openstack/tripleo-common master: Parametrize ansible transport setting https://review.openstack.org/580157 | 11:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add subnet host_routes to output of OS::TripleO::*::Ports::Port https://review.openstack.org/580234 | 11:24 |
| hjensas | ruck, rover ^^ | 11:25 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable octavia-api health check https://review.openstack.org/581008 | 11:26 |
| chkumar|ruck | sshnaidm|rover, ^^ | 11:28 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Delete ovs ports blocking logic https://review.openstack.org/576210 | 11:29 |
| *** nyechiel_ has joined #tripleo | 11:30 | |
| *** morazi has quit IRC | 11:31 | |
| *** ansmith has quit IRC | 11:34 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add --cleanup argument for image uploads https://review.openstack.org/578251 | 11:35 |
| *** bogdando has joined #tripleo | 11:35 | |
| Tengu | akrivoka: hmm. interesting. apparently something changed over the weekend... | 11:36 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add host routes to subnets https://review.openstack.org/580235 | 11:37 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add per-network routes to NIC templates https://review.openstack.org/580236 | 11:37 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: host_routes using get_attr (Composable Networks) https://review.openstack.org/580596 | 11:37 |
| chkumar|ruck | hjensas, http://logs.openstack.org/76/580776/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/5a57fb9/job-output.txt.gz does the containers upgrade i think | 11:38 |
| *** atoth has joined #tripleo | 11:39 | |
| *** itlinux has quit IRC | 11:39 | |
| *** slagle has quit IRC | 11:43 | |
| sshnaidm|rover | chkumar|ruck, hjensas it upgrades keystone only afaik | 11:44 |
| sshnaidm|rover | we have upgrade jobs, but they run in rdo cloud which is under zuulv3 transition right now, need to check configs | 11:44 |
| akrivoka | Tengu: going to test a few things, give me a few minutes | 11:44 |
| *** slagle has joined #tripleo | 11:44 | |
| Tengu | akrivoka: np. working on another patch anyway. Kind of tricky one with some puppet issues :). | 11:45 |
| Tengu | akrivoka: lemme know if I can help (I've corrected my undercloud creation ;)) | 11:45 |
| hjensas | sshnaidm|rover: chkumar|ruck: I have'nt seen tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades pass in some time for any patches ... | 11:46 |
| hjensas | sshnaidm|rover: so, in rdo but not as check|gate jobs? As periodic? | 11:47 |
| hjensas | s/periodic?/periodic|promotion only?/ | 11:47 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: make reproducer bash syntax more portable https://review.openstack.org/581012 | 11:49 |
| *** karthiks has quit IRC | 11:52 | |
| *** rh-jelabarre has joined #tripleo | 11:52 | |
| janki | Hi. Can I please get workflow +1 for https://review.openstack.org/#/c/579494/ | 11:54 |
| akrivoka | Tengu: so I ran the list_validations action on a fresh undercloud with the patch applied and it runs fine... so no idea why it's failing in CI :\ | 11:54 |
| *** bfournie has joined #tripleo | 11:54 | |
| *** raildo has joined #tripleo | 11:54 | |
| Tengu | akrivoka: :/ | 11:54 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: make reproducer bash syntax more portable https://review.openstack.org/581012 | 11:55 |
| *** avivgta has joined #tripleo | 11:55 | |
| *** avivgt has quit IRC | 11:56 | |
| chkumar|ruck | sshnaidm|rover, that upgrade job is broken during build test packages | 11:57 |
| sshnaidm|rover | chkumar|ruck, logs? | 11:57 |
| *** medberry has joined #tripleo | 11:57 | |
| *** medberry has quit IRC | 11:57 | |
| *** medberry has joined #tripleo | 11:57 | |
| chkumar|ruck | sshnaidm|rover, http://logs.openstack.org/76/580776/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/5a57fb9/logs/delorean_logs/ab/aa/abaaf9e687a5609568661fc4175f1aac9687be8f_dev/rpmbuild.log.txt.gz | 11:57 |
| chkumar|ruck | sshnaidm|rover, Error: No Package found for python-d2to1 | 11:58 |
| *** pdeore has quit IRC | 11:58 | |
| *** Haresh has quit IRC | 11:59 | |
| *** mcornea has joined #tripleo | 11:59 | |
| *** abishop has joined #tripleo | 11:59 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 11:59 |
| weshay | hjensas, you referring to the third party rdo jobs? | 12:03 |
| *** amoralej is now known as amoralej|lunch | 12:03 | |
| sshnaidm|rover | chkumar|ruck, I think it's for #rdo | 12:04 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow cinder_volume_init_bundle modify iptables https://review.openstack.org/581015 | 12:04 |
| *** d0ugal has quit IRC | 12:06 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 12:08 | |
| *** d0ugal has joined #tripleo | 12:09 | |
| hjensas | weshay: any job. | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 12:10 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/queens: Make sure remotes are fully up before proceeding https://review.openstack.org/581017 | 12:11 |
| *** alee has quit IRC | 12:11 | |
| tonyb | Tengu: finally done with dinner. Are you around to discuss options for fixing my pxelinux.cfg buglet? | 12:12 |
| *** jistr is now known as jistr|mtg | 12:12 | |
| weshay | hjensas, look at the list again | 12:14 |
| Tengu | tonyb: will be in another meeting in 15 -.-'. | 12:14 |
| tonyb | Tengu: okay Thanks. | 12:14 |
| Tengu | tonyb: weird thing is, apparently an error is not shown in the log. | 12:14 |
| Tengu | I don't really get it. | 12:14 |
| tonyb | Tengu: I'm glad I'm not the only one ;P | 12:14 |
| Tengu | tonyb: might be good to involve some other "ironic" guys, like dtantsur|afk maybe (once he's back - not sure he's the right one, but he will at least point to the right person hopefully) | 12:15 |
| Tengu | tonyb: in the log http://logs.openstack.org/06/580306/10/check/tripleo-puppet-ci-centos-7-undercloud-containers/1396c8e/logs/undercloud/home/zuul/undercloud_install.log.txt.gz you can look up for "has failures" - this will point you to the puppet error. | 12:15 |
| Tengu | The original one seems to be related to apache configuration, precisely the ports.conf having an error - but no error regarding that one is shown -.- | 12:16 |
| tonyb | Tengu: yesh the closest I can come is /etc/httpd/conf doesn't exist | 12:16 |
| Tengu | tonyb: yep, and even more, /etc/httpd doesn't exist. | 12:17 |
| tonyb | Tengu: what I really don't get is I haven't chnage any of that in terms of the catalog but somehow by adding that require we're now instantiaing those resources | 12:17 |
| Tengu | tonyb: as if the "include ::apache" present in the pxe.pp isn't executed (https://github.com/openstack/puppet-ironic/blob/master/manifests/pxe.pp#L167) | 12:17 |
| tonyb | Ahh okay so I think I get it now. | 12:18 |
| Tengu | tonyb: maybe an issue with the order, although puppetlabs-apache is a pretty strong module that should not fail like that. | 12:18 |
| tonyb | when we create the config.pp we only point ar inspector.pp so in that conatain without my chnage we don't ever directly call/load pxe.pp | 12:18 |
| tonyb | now with my chnage we do | 12:19 |
| *** jangutter has joined #tripleo | 12:19 | |
| Tengu | hmm ok. | 12:19 |
| tonyb | so that means we discover in that conatiner we don't have the httpd package | 12:19 |
| Tengu | true. | 12:19 |
| Tengu | that can be seen in the dockerfile in fact. | 12:19 |
| Tengu | BUT... well, puppet should install it anyway. | 12:19 |
| Tengu | unless there are some hiera thingy that prevent the package install of course. | 12:20 |
| tonyb | Tengu: I wonder what we're seting as $ensure_package | 12:20 |
| Tengu | might be the case after all. might be good to check that indeed. | 12:20 |
| *** thrash|g0ne is now known as thrash | 12:20 | |
| jangutter | hi, I was just over in the Neutron channel discussing SIGHUP (and Neutron's inability to safely handle it)... | 12:21 |
| *** yrabl has joined #tripleo | 12:22 | |
| *** karthiks has joined #tripleo | 12:22 | |
| jangutter | This means that https://github.com/openstack/puppet-tripleo/blob/master/templates/logrotate/containers_logrotate.conf.erb#L27 is particularly unsafe in a containerised environment... | 12:22 |
| tonyb | Tengu: it defaults to present https://github.com/openstack/puppet-ironic/blob/master/manifests/pxe.pp#L51 | 12:22 |
| Tengu | tonyb: hmmm nope. that's for the ironic packages not apache. | 12:23 |
| Tengu | 2s, digging. | 12:23 |
| tonyb | Tengu: True | 12:23 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Allow pingloss adjustment. https://review.openstack.org/581021 | 12:24 |
| *** alee has joined #tripleo | 12:24 | |
| *** edmondsw has joined #tripleo | 12:24 | |
| openstackgerrit | Merged openstack/os-net-config master: vlan and linux_bond members for contrail vrouter https://review.openstack.org/577374 | 12:26 |
| Tengu | tonyb: hmm. apparently nothing seems to override the package_ensure of apache module. | 12:26 |
| Tengu | weird. | 12:26 |
| *** trown|outtypewww is now known as trown | 12:26 | |
| tonyb | Tengu: yeah strange. | 12:26 |
| *** leanderthal has joined #tripleo | 12:27 | |
| *** quiquell is now known as quiquell|off | 12:28 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: User delorean-master/build-deps repo for test-package-build https://review.openstack.org/581025 | 12:28 |
| *** edmondsw has quit IRC | 12:29 | |
| Tengu | tonyb: wondwering.... should the ironic::pxe really be included in the ironic::inpector? i.e. do we need the whole content of the pxe class for the inspector? | 12:29 |
| Tengu | tonyb: if not, it might be better to push the pxelinux.cfg directory creation to some "common" file we include then in both classes. | 12:29 |
| Tengu | that way, it's clean, and we shouldn't break anything. | 12:29 |
| *** pradk has quit IRC | 12:30 | |
| tonyb | Tengu: yup I think I need to do that, it's a bigger change but probably the best approach | 12:30 |
| Tengu | not really bigger. | 12:30 |
| Tengu | but just beware the unit tests ;). | 12:30 |
| tonyb | Tengu: in answer to your question about including the whole class, I only did that as without it I got 'could not find File[...] in the catalogue | 12:30 |
| *** edmondsw has joined #tripleo | 12:31 | |
| Tengu | fine | 12:31 |
| Tengu | so yeah, just take that directoriry creation out | 12:31 |
| tonyb | Probably the first clue I was doign something wrong. | 12:31 |
| tonyb | Tengu: Yup I'll stick it in tftproot.pp or similar. | 12:32 |
| Tengu | :) | 12:32 |
| Tengu | :) | 12:32 |
| Tengu | I let you chose - if you have questions regarding the unit-tests, feel free to ping me. | 12:32 |
| Tengu | I'm just in a meeting now, but it shouldn't be long (hopefully), and I can still provide inputs. | 12:33 |
| tonyb | Tengu: Will do and thanks for all your help over the last week. | 12:33 |
| *** suuuper has quit IRC | 12:33 | |
| *** suuuper has joined #tripleo | 12:33 | |
| *** dougbtv has joined #tripleo | 12:33 | |
| tonyb | Tengu: I'll try to help you with the privsep stuff, if you need it :) | 12:33 |
| Tengu | oh great! | 12:33 |
| Tengu | that would be really useful when time comes :). | 12:33 |
| tonyb | :) | 12:34 |
| Tengu | tonyb: care to check the spec I proposed? https://review.openstack.org/580033 that's the first step :) | 12:34 |
| *** rlandy has joined #tripleo | 12:34 | |
| tonyb | Tengu: I didn't vote on it but it looked good to me :) | 12:34 |
| *** leanderthal has quit IRC | 12:34 | |
| tonyb | Tengu: i'll read over it more carefully tomorrow. | 12:35 |
| Tengu | cool :). feel free to request precisions and details if needed. | 12:35 |
| *** edmondsw has quit IRC | 12:35 | |
| *** fultonj has joined #tripleo | 12:35 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: HA support for OpenShift https://review.openstack.org/579609 | 12:35 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Replace raw_get with dict access syntax https://review.openstack.org/579843 | 12:35 |
| EmilienM | weshay, mwhahaha : hey, I did rechecks on https://review.openstack.org/#/c/575330/ several times over the weekend and it's still close to timeout :-/ I guess we can't merge it yet | 12:35 |
| tbarron | bandini: No need for a sync. reply but what led me to look at those | 12:36 |
| tbarron | bandini: bundle restart issues was that I'm trying to get manila-share | 12:36 |
| tbarron | bandini: to see a fresh set of bind mounts (a new Storage Mapping) after | 12:36 |
| tbarron | bandini: an overcloud update. With those two little patches that you | 12:36 |
| tbarron | bandini: reviewed we now have the trigger for 'pcs resource restart' on | 12:36 |
| tbarron | bandini: manila config change working correctly. BUT that doesn't suffice | 12:36 |
| tbarron | bandini: to get a refresh of the Storage Mapping, which I also need. | 12:36 |
| tbarron | bandini: Some details: https://paste.fedoraproject.org/paste/JjCu1uZvFC2ila0gD-mt5Q | 12:36 |
| tbarron | bandini: Is there a way to trigger the Storage Mapping refresh, even if the | 12:36 |
| tbarron | bandini: task needs to be done manually after the overcloud update? | 12:36 |
| tbarron | bandini: That's all, and thanks. | 12:36 |
| tbarron | abishop: ^^^ Note that I am asking our question here. | 12:36 |
| tonyb | Tengu: one of the 'nice' things about privsep is you can have asn many (or few) contexts as you like. I favor more with very specific caps, but in nova I didn't make a string case so we went with just one | 12:37 |
| *** edmondsw has joined #tripleo | 12:37 | |
| weshay | EmilienM, we may be shaving 5-10 min in pre.yaml shortly | 12:37 |
| tonyb | which is probably what we'll do here | 12:37 |
| *** tzumainn has joined #tripleo | 12:37 | |
| weshay | rlandy, figured out why scen07 / 08 was failing w/ the new parents | 12:37 |
| *** dprince has joined #tripleo | 12:37 | |
| tonyb | Tengu: the hard part can be finding the starting place :) | 12:37 |
| bandini | tbarron: finishing something and I'll get back to you | 12:37 |
| weshay | rlandy, do we have a bug on that btw? w/ the old ovs package | 12:37 |
| *** dbecker has quit IRC | 12:37 | |
| tbarron | bandini: ack and tia | 12:37 |
| weshay | panda, ^ | 12:37 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: [DNM] skeleton ci sprint 16 design tripleo.sh bootstrap ansible https://review.openstack.org/581026 | 12:38 |
| weshay | we probably should.. so we can get the packaging guys involved | 12:38 |
| tonyb | Tengu: I suspect you've gone into your meeting and I'm goign to go to bed. Thanks again! | 12:38 |
| Tengu | tonyb: have a good night then | 12:39 |
| panda | weshay: I didn't create any. rlandy would you do the honor ? | 12:39 |
| Tengu | tonyb: we might talk a bit more tomorrow then :). | 12:39 |
| *** dbecker has joined #tripleo | 12:40 | |
| tonyb | Tengu: sure, I'm struggling to work out which TZ you're in as you were very active during my day last week but seem to be in the middle of yours now ;P | 12:40 |
| *** edmondsw has quit IRC | 12:42 | |
| *** assassin has joined #tripleo | 12:42 | |
| Tengu | tonyb: CET :). | 12:44 |
| Tengu | with that wonderfull summer time non-saving thingy -.-' | 12:44 |
| rlandy | weshay: panda: no bug yet | 12:44 |
| Tengu | tonyb: fact is, I'm trying to adjuste my working hours in order to get some more overlap with the US.. | 12:44 |
| rlandy | I left notes in the card we can copy to a bug | 12:45 |
| rlandy | panda: opened yet? | 12:45 |
| weshay | rlandy, most people in tripleo probably had no idea how old that package was | 12:45 |
| *** edmondsw has joined #tripleo | 12:45 | |
| rlandy | weshay: the bugger problem is that it's a released/package ovs to start with | 12:45 |
| rlandy | bigger | 12:45 |
| rlandy | if there is a change to ovs, we will not test it | 12:46 |
| rlandy | unless we somehow build the change prior | 12:46 |
| panda | rlandy: so, updating the package after the vxlan is created would not work ? | 12:47 |
| tonyb | Tengu: ahh cool. I guess I benefit from that overlap too (AEST) | 12:47 |
| rlandy | panda: depends ... | 12:47 |
| rlandy | panda: if it is related to anything involved with creating br-ex, no | 12:48 |
| *** leanderthal has joined #tripleo | 12:49 | |
| *** ansmith has joined #tripleo | 12:49 | |
| Tengu | tonyb: so we might meet again in my evening then I guess. | 12:49 |
| tonyb | Tengu: quiet possibly :) | 12:49 |
| *** edmondsw has quit IRC | 12:49 | |
| Tengu | if you don't get up too late ;) | 12:49 |
| tonyb | Tengu: I have a meeting at 0430, and then another at 0630 | 12:50 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Use delorean-build-deps.repo for test-package-build https://review.openstack.org/581025 | 12:50 |
| tonyb | Tengu: I may not make that fist one | 12:50 |
| Tengu | tonyb: ok :). well, we'll see. | 12:51 |
| *** edmondsw has joined #tripleo | 12:51 | |
| *** toure|gone is now known as toure | 12:52 | |
| *** edmondsw has quit IRC | 12:53 | |
| *** quiquell|off is now known as quiquell | 12:53 | |
| *** edmondsw has joined #tripleo | 12:53 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack https://review.openstack.org/578285 | 12:54 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: HA support for OpenShift https://review.openstack.org/579609 | 12:54 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Replace raw_get with dict access syntax https://review.openstack.org/579843 | 12:54 |
| *** matbu has quit IRC | 12:54 | |
| *** matbu has joined #tripleo | 12:56 | |
| Tengu | PTAL folks :) https://review.openstack.org/580354 Thank you ;) | 12:56 |
| *** chem` has joined #tripleo | 12:59 | |
| *** chem` is now known as chem | 13:00 | |
| *** chkumar|ruck has quit IRC | 13:01 | |
| openstackgerrit | Harald Jensås proposed openstack/os-net-config master: Route object - add support for neutrons Route schema. https://review.openstack.org/579842 | 13:01 |
| bogdando | mwhahaha, EmilienM: ^^ https://review.openstack.org/580354 please | 13:02 |
| *** chandankumar has joined #tripleo | 13:02 | |
| bogdando | I need it for the base of ansible.cfg :) | 13:02 |
| *** chandankumar is now known as chkumar|ruck | 13:02 | |
| *** ykarel is now known as ykarel|away | 13:02 | |
| EmilienM | bogdando, Tengu: I was actually testing it now | 13:03 |
| EmilienM | I'll review my review today for sure | 13:03 |
| *** medberry has quit IRC | 13:03 | |
| bogdando | EmilienM: super, thanks! one more please https://review.openstack.org/#/c/580959/ :) | 13:03 |
| bogdando | And I'm still looking for a better example for docs https://review.openstack.org/#/c/578799/ | 13:04 |
| bogdando | to update something like stack update and not create | 13:04 |
| *** medberry has joined #tripleo | 13:04 | |
| *** medberry has quit IRC | 13:04 | |
| *** medberry has joined #tripleo | 13:04 | |
| EmilienM | bogdando: where are the logs for https://review.openstack.org/#/c/580959/1/puppet/services/docker-registry.j2.yaml ? | 13:05 |
| *** morazi has joined #tripleo | 13:07 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 13:10 |
| bogdando | EmilienM: http://logs.openstack.org/59/580959/1/check/tripleo-ci-centos-7-undercloud-containers/5c40504/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-07-09_08_55_00_624 | 13:10 |
| bogdando | it didn't work | 13:10 |
| * bogdando sigh | 13:10 | |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| *** nenad has joined #tripleo | 13:13 | |
| dprince | bogdando: seems safer to implement what you are after here as an undercloud default instead of changing it globally | 13:13 |
| dprince | bogdando: https://review.openstack.org/#/c/580342/ | 13:13 |
| dprince | bogdando: you could set this in environments/undercloud.yaml right? | 13:14 |
| bogdando | dprince: I posted a comment for why I think it's even better to have it for overclouds as well | 13:14 |
| *** leanderthal has quit IRC | 13:14 | |
| *** jistr|mtg is now known as jistr | 13:14 | |
| bogdando | we run puppet for like 200 times | 13:16 |
| dprince | bogdando: it will help less on initial deploys in the Overcloud as the concurrent counts are lower and those will throttle it anyways. | 13:16 |
| bogdando | by chunks of 3 | 13:16 |
| dprince | bogdando: 6 isn't too bad I think, but my point was we had a ticket downstream about this | 13:16 |
| bogdando | and that's a slow 1 threaded ruby you know | 13:16 |
| bogdando | dprince: I was not aware of it, let's find it out, get QE feedback, and prolly revert | 13:17 |
| *** trozet|off has quit IRC | 13:17 | |
| dprince | bogdando: yes, but it can peg the CPU too. we want to be nice to controllers | 13:17 |
| dprince | bogdando: it was intermittent if I recall. | 13:17 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Leave undercloud images locally after prepare https://review.openstack.org/578257 | 13:18 |
| dprince | bogdando: so long as you are aware that dockerd also throttls concurrent downloads and you are now above that default | 13:18 |
| *** trozet has joined #tripleo | 13:18 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Remove bogus "EXPERIMENTAL" in neutron-sriov.yaml environment file https://review.openstack.org/581031 | 13:18 |
| dprince | bogdando: IMO if we bump one we should probably bump the other | 13:18 |
| *** mdnadeem has quit IRC | 13:18 | |
| bogdando | dprince: I think it's fine to have it trottled | 13:22 |
| bogdando | the mult-process things will just run as they can | 13:22 |
| bogdando | the thing is we'll have a bunches of a 6 running puppets and a 3 downloading layers processes for each of a moment of time | 13:23 |
| bogdando | instead of 3/3 | 13:23 |
| bogdando | so puppets will stop being a cripple | 13:23 |
| bogdando | and we only download it once, while there is 6 steps to interate for all of the 50 containers :) | 13:24 |
| dprince | bogdando: it is fine to have them mismatch. but most people wouldn't realize that you won't always see 6 puppets running as they will block | 13:24 |
| dprince | bogdando: having the Undercloud default to higher than an overcloud probably makes more sense as it can better tolerate downtime. I would rather see us do it there I think | 13:27 |
| dprince | undercloud.yaml | 13:27 |
| bogdando | dprince: could it be a plan B, if more intermittent issues arised downstream CI? | 13:28 |
| bogdando | re-arised | 13:28 |
| openstackgerrit | Merged openstack/tripleo-docs master: Fix dns servers for standalone https://review.openstack.org/579923 | 13:28 |
| *** ykarel|away has quit IRC | 13:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy https://review.openstack.org/569153 | 13:29 |
| *** gvrangan has quit IRC | 13:29 | |
| *** weshay changes topic to "Welcome to Rocky. CI status: GREEN | https://docs.openstack.org/tripleo-docs/latest" | 13:30 | |
| Tengu | jaganathan: hello! could you give a look to the tls thingy with derivated params? | 13:31 |
| *** pchavva has joined #tripleo | 13:31 | |
| jaganathan | Tengu, hi i have gone through and working on draft patch. will place the patch in this week | 13:33 |
| jaganathan | Tengu, will update you once done | 13:33 |
| openstackgerrit | Merged openstack/tripleo-repos master: Add paunch to the includpkgs https://review.openstack.org/579218 | 13:33 |
| Tengu | jaganathan: cool, thanks! | 13:33 |
| jaganathan | Tengu, Welcome, ping you if need any help | 13:33 |
| *** jistr is now known as jistr|mtg | 13:36 | |
| *** agurenko has quit IRC | 13:37 | |
| *** agurenko has joined #tripleo | 13:38 | |
| *** mjturek has joined #tripleo | 13:42 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 13:42 | |
| *** anande has joined #tripleo | 13:45 | |
| *** pradk has joined #tripleo | 13:46 | |
| *** skramaja has quit IRC | 13:46 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds reproducer check+exit+warning dependencies - virtualenv+others https://review.openstack.org/578081 | 13:46 |
| anande | hi guys, in osp-newton any idea why does the deploy fail with the following error : | 13:47 |
| anande | 2018-07-08 08:02:58.708 15404 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [ admin admin] Expected hypervisor stats not met | 13:47 |
| anande | 2018-07-08 08:02:58.708 15404 DEBUG tripleoclient.v1.overcloud_deploy.DeployOvercloud [ admin admin] Checking nodes count | 13:47 |
| anande | 2018-07-08 08:02:58.803 15404 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [ admin admin] Configuration has 1 errors, fix them before proceeding. Ignoring these errors is likely to lead to a failed deploy. | 13:47 |
| anande | this was a scale-out attempt. I noticed that 'nova hypervisor-stats' stopped returning any count of hypervisors that were already successfully scaled out | 13:48 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Generate ansible.cfg for UC/standalone deployments https://review.openstack.org/580171 | 13:49 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-docs master: Document updates to messaging configuration https://review.openstack.org/579258 | 13:51 |
| paramite | Hey guys, can we get the following queens backport merged? All other patches already landed: https://review.openstack.org/#/c/581008/ | 13:52 |
| bogdando | folks, PTAL https://review.openstack.org/#/c/580829 | 13:53 |
| *** cylopez has joined #tripleo | 13:54 | |
| *** artom has joined #tripleo | 13:55 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 13:58 |
| *** anande has quit IRC | 13:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/queens: Support containerized DVR in compute role https://review.openstack.org/573199 | 13:59 |
| EmilienM | bogdando: just a rebased, fyi ^ | 14:00 |
| EmilienM | or it couldn't merge | 14:00 |
| fultonj | would someone be up for an easy review of https://review.openstack.org/#/c/579675 ? | 14:01 |
| bogdando | EmilienM: thanks! | 14:01 |
| dprince | bogdando: see the following old bugs related to changing the DockerPuppetProcessCount | 14:03 |
| dprince | Add DockerPuppetProcessCount defaults to 3 (potentially fixes container did not start before the specified timeout) | 14:03 |
| dprince | https://bugzilla.redhat.com/show_bug.cgi?id=1456986 | 14:03 |
| openstack | bugzilla.redhat.com bug 1456986 in openstack-containers "[OSP12][openstack containers]: Errors while pulling images from remote registry causes overcloud deployment to fail." [High,Closed: errata] - Assigned to jstransk | 14:03 |
| dprince | https://review.openstack.org/#/c/498139/ | 14:03 |
| dprince | bogdando: ^^^ | 14:03 |
| dprince | https://bugs.launchpad.net/tripleo/+bug/1713188 | 14:03 |
| openstack | Launchpad bug 1713188 in tripleo "'container did not start before the specified timeout' ERRORS during docker-puppet config generation" [High,Fix released] - Assigned to Dan Prince (dan-prince) | 14:03 |
| bogdando | dprince: thanks | 14:03 |
| *** jistr|mtg is now known as jistr | 14:05 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 14:10 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| *** rpioso|afk is now known as rpioso | 14:11 | |
| openstackgerrit | Olivier Bourdon proposed openstack/diskimage-builder master: Fix for proper LVM support https://review.openstack.org/576168 | 14:13 |
| openstackgerrit | Olivier Bourdon proposed openstack/diskimage-builder master: Fix for proper LVM support https://review.openstack.org/576168 | 14:15 |
| *** cshastri has quit IRC | 14:15 | |
| *** janki has quit IRC | 14:15 | |
| openstackgerrit | Olivier Bourdon proposed openstack/diskimage-builder master: Fix for proper LVM support https://review.openstack.org/576168 | 14:16 |
| *** janki has joined #tripleo | 14:16 | |
| *** links has quit IRC | 14:18 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 14:21 |
| *** dparkes has quit IRC | 14:21 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: FFU Create cell0 db points to the nova-api bootstrap node. https://review.openstack.org/580393 | 14:22 |
| *** ykarel|away has joined #tripleo | 14:24 | |
| *** ukalifon has quit IRC | 14:28 | |
| *** jcoufal has joined #tripleo | 14:30 | |
| *** ykarel|away is now known as ykarel | 14:31 | |
| *** pabelanger has quit IRC | 14:33 | |
| *** pabelanger has joined #tripleo | 14:33 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/ansible-role-container-registry master: Improve docker/distribution reload handlers https://review.openstack.org/581049 | 14:33 |
| *** janki has quit IRC | 14:34 | |
| *** bkopilov has quit IRC | 14:36 | |
| *** moshele has quit IRC | 14:38 | |
| *** jcoufal has quit IRC | 14:39 | |
| *** cdearborn has joined #tripleo | 14:45 | |
| owalsh | bogdando: WDYT about https://review.openstack.org/577855? I think it would be cleaner to revert to PS7 and update the dist-git to include the top level docker_config_scripts dir | 14:46 |
| karthiks | dsneddon, Can you please review https://review.openstack.org/#/c/580290/ . The requirements-check job for os-net-config is failing otherwise | 14:47 |
| *** nyechiel_ has quit IRC | 14:47 | |
| *** cylopez has left #tripleo | 14:47 | |
| bogdando | owalsh: makes sense | 14:47 |
| *** stendulker has joined #tripleo | 14:52 | |
| openstackgerrit | Andy Smith proposed openstack/tripleo-docs master: Document updates to messaging configuration https://review.openstack.org/579258 | 14:54 |
| *** radeks has quit IRC | 14:55 | |
| *** quiquell is now known as quiquell|off | 14:58 | |
| *** safchain has joined #tripleo | 14:59 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: tripleo-validations, group-validations fails with notify_running task exception https://review.openstack.org/581054 | 15:00 |
| EmilienM | bogdando: thanks ^ | 15:00 |
| *** beekneemech is now known as bnemec | 15:00 | |
| EmilienM | bogdando, ykarel : do you want to add Depends-on in https://review.openstack.org/#/c/580037/ ? | 15:01 |
| *** janki has joined #tripleo | 15:02 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: tripleo-validations, group-validations fails with notify_running task exception https://review.openstack.org/581054 | 15:02 |
| *** bogdando has quit IRC | 15:02 | |
| ykarel | EmilienM, which one? | 15:02 |
| *** peereb has quit IRC | 15:03 | |
| *** ksambor has quit IRC | 15:03 | |
| EmilienM | ykarel: https://review.openstack.org/581049 | 15:04 |
| ykarel | EmilienM, but i can't get if ^^ will help | 15:04 |
| ykarel | EmilienM, see https://review.openstack.org/#/c/580631/1 | 15:05 |
| ykarel | anyway if we want to test, that can be tested | 15:05 |
| *** artom has quit IRC | 15:06 | |
| *** ykarel is now known as ykarel|away | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 15:10 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Refactor service client getters https://review.openstack.org/578127 | 15:11 |
| *** agurenko has quit IRC | 15:13 | |
| safchain | Hello, can someone have another look at this https://review.openstack.org/#/c/561274/ , slagle already +2 :) thanks | 15:15 |
| EmilienM | safchain: will look today, thanks for the reminder | 15:15 |
| EmilienM | safchain: since we don't have a CI job, have you been able to test it? | 15:16 |
| safchain | EmilienM, yes it is tested by our CI | 15:16 |
| safchain | EmilienM, and I submitted WIP patches for upstream CI too | 15:17 |
| safchain | EmilienM, thanks | 15:17 |
| safchain | EmilienM, https://review.openstack.org/#/c/578748/ , the scenario | 15:18 |
| EmilienM | mwhahaha, weshay, ykarel|away: so interesting numbers (finally) | 15:18 |
| EmilienM | with https://review.openstack.org/#/c/580631/ : "Run openstack tripleo container image prepare" task takes 8 min, http://logs.openstack.org/31/580631/1/check/tripleo-ci-centos-7-undercloud-containers/464f363/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-07-07_04_29_11 | 15:18 |
| EmilienM | usually it takes 15 min http://logs.openstack.org/10/576210/3/check/tripleo-ci-centos-7-undercloud-containers/aeaa00c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-07-09_11_58_49 | 15:18 |
| EmilienM | though running on different cloud providers | 15:19 |
| EmilienM | safchain: ack, thx | 15:19 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common stable/queens: Fixes ordering of environment files in a deployment plan https://review.openstack.org/581060 | 15:20 |
| *** rodolof has quit IRC | 15:21 | |
| *** mjturek_ has joined #tripleo | 15:23 | |
| *** rfolco is now known as rfolcOUT | 15:23 | |
| *** mjturek has quit IRC | 15:24 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: [DNM] Flush handlers https://review.openstack.org/580631 | 15:27 |
| *** yprokule has quit IRC | 15:30 | |
| *** avivgta has quit IRC | 15:31 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/python-tripleoclient master: Quick'n'dirty way to at least protect and correct rights on files https://review.openstack.org/580354 | 15:37 |
| ykarel|away | EmilienM, ack. let's see if it's consistent | 15:38 |
| EmilienM | ykarel|away: I think your patch helped | 15:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud"" https://review.openstack.org/575330 | 15:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Test scen 001 / 002 with cont uc again https://review.openstack.org/580766 | 15:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Test scen 001 / 002 with cont uc again BIS https://review.openstack.org/580767 | 15:39 |
| ykarel|away | EmilienM, yes it fixes https issue, as docker needs to be restarted after changing insecure-registry param | 15:39 |
| EmilienM | ykarel|away: testing with 3 other patches, so 6 more results (testing scenario001 and 002), let's see | 15:40 |
| EmilienM | ykarel|away: gotcha | 15:40 |
| ykarel|away | EmilienM, ack | 15:40 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Remove bogus "EXPERIMENTAL" in neutron-sriov.yaml environment file https://review.openstack.org/581031 | 15:46 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Parameterize dns server during ironic CI setup https://review.openstack.org/580590 | 15:47 |
| *** rodolof has joined #tripleo | 15:52 | |
| *** medberry has quit IRC | 15:54 | |
| *** nenad is now known as nenad|gone | 15:57 | |
| *** anande has joined #tripleo | 15:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 16:00 |
| *** akhilaki has joined #tripleo | 16:03 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: tripleo-validations, group-validations fails with notify_running task exception https://review.openstack.org/581054 | 16:04 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 16:04 |
| *** pradk- has joined #tripleo | 16:05 | |
| *** stendulker has quit IRC | 16:05 | |
| *** aufi has quit IRC | 16:06 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic https://review.openstack.org/577855 | 16:06 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic https://review.openstack.org/577855 | 16:07 |
| weshay | mwhahaha, EmilienM fyi http://logs.openstack.org/23/578023/4/gate/tripleo-ci-centos-7-containers-multinode/71a6dff/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-09_15_25_10 | 16:08 |
| *** pradk has quit IRC | 16:08 | |
| ccamacho | mwhahaha EmilienM akrikova around? mind to check this simple fix? https://review.openstack.org/#/c/581054/ | 16:10 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 16:10 |
| *** ramishra has quit IRC | 16:15 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add AllNodesExtraMapData parameter https://review.openstack.org/581080 | 16:19 |
| *** trown is now known as trown|lunch | 16:20 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add AllNodesExtraMapData parameter https://review.openstack.org/581080 | 16:22 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add network prefix configuration https://review.openstack.org/581083 | 16:22 |
| *** nyechiel_ has joined #tripleo | 16:24 | |
| *** florianf has quit IRC | 16:24 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Update standalone role for a cloud https://review.openstack.org/575862 | 16:25 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: standalone run a post config to generate a clouds.yaml https://review.openstack.org/575597 | 16:25 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Add FS055 job as experimental to run refstack tests https://review.openstack.org/570892 | 16:26 |
| *** derekh has quit IRC | 16:28 | |
| *** plix has joined #tripleo | 16:30 | |
| *** plix has left #tripleo | 16:30 | |
| *** kopecmartin has quit IRC | 16:32 | |
| jangutter | Hi, I was tracking random Neutron failures on Queens stack, and I found out that https://github.com/openstack/puppet-tripleo/blob/master/templates/logrotate/containers_logrotate.conf.erb#L27 sends SIGHUP to the Neutron server process periodically. | 16:32 |
| jangutter | According to the Neutron folks, it's not safe to send SIGHUP to Neutron and it's definitely not trivial to make it safe. | 16:33 |
| jangutter | I'm wondering if anyone else has seen or tested this in practice? | 16:33 |
| *** medberry has joined #tripleo | 16:40 | |
| *** medberry has quit IRC | 16:40 | |
| *** medberry has joined #tripleo | 16:40 | |
| *** florianf has joined #tripleo | 16:40 | |
| mwhahaha | beagles: -^ | 16:43 |
| *** artom has joined #tripleo | 16:44 | |
| beagles | jangutter: mwhahaha: I was tried this out a couple of times after seeing jangutter's bug report and can confirm that the container ends up restarting | 16:47 |
| beagles | jangutter: is there a conversation in #openstack-neutron or a thread where this is being discussed? | 16:48 |
| * beagles checks | 16:48 | |
| mwhahaha | how did log rotation work with neutron-service previously? | 16:48 |
| jangutter | beagles: nope, I just spoke briefly with mpeterson there, so I don't think it's under active discussion. | 16:48 |
| jangutter | mwhahaha: in the non-containerized version it used the good old copytruncate method. | 16:49 |
| mwhahaha | of course it does | 16:51 |
| * mwhahaha wishes all the services acted the same way | 16:51 | |
| *** dciabrin has quit IRC | 16:51 | |
| *** jpich has quit IRC | 16:52 | |
| *** dciabrin has joined #tripleo | 16:52 | |
| jangutter | mwhahaha: Neutron's plugin and agent-heavy design makes it especially vulnerable to something like this :-( | 16:52 |
| jangutter | mwhahaha: since signals must be handled cooperatively... | 16:52 |
| beagles | looks like maybe sighup isn't being handled when neutron isn't running in daemon mode | 16:52 |
| mwhahaha | so the container log rotate needs to be updated to exclude neutron | 16:52 |
| mwhahaha | and we need a different method for neutron i guess | 16:53 |
| mwhahaha | don't know if copytruncate works | 16:53 |
| * beagles doesn't really know just looking at lp bugs indidcated in neutron irc chat history | 16:53 | |
| *** holser_ has quit IRC | 16:53 | |
| mwhahaha | it's alreadya bundle of joy https://github.com/openstack/puppet-tripleo/blob/master/templates/logrotate/containers_logrotate.conf.erb#L21-L27 | 16:55 |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: Add log enable to control module generation https://review.openstack.org/581089 | 16:56 |
| *** alee has quit IRC | 16:57 | |
| *** holser_ has joined #tripleo | 16:57 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-docs master: Added information regarding system's clock - must be set to UTC https://review.openstack.org/581090 | 16:59 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck/memcached: add brackets if ipv6 https://review.openstack.org/581092 | 17:02 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy https://review.openstack.org/569153 | 17:02 |
| EmilienM | mwhahaha: ^ | 17:03 |
| mwhahaha | EmilienM: your patch is bad | 17:03 |
| * mwhahaha commented | 17:03 | |
| *** shreshtha_ has quit IRC | 17:04 | |
| EmilienM | mwhahaha: copy/pasta | 17:05 |
| *** florianf has quit IRC | 17:05 | |
| mwhahaha | mmm pasta | 17:05 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck/memcached: add brackets if ipv6 https://review.openstack.org/581092 | 17:05 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780726 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 17:10 |
| *** assassin has quit IRC | 17:12 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-docs master: Added information regarding system's clock - must be set to UTC https://review.openstack.org/581090 | 17:14 |
| *** Goneri has quit IRC | 17:14 | |
| *** noama has quit IRC | 17:14 | |
| *** tesseract has quit IRC | 17:15 | |
| *** suuuper has quit IRC | 17:19 | |
| *** anande has quit IRC | 17:20 | |
| Tengu | hey folks, PTAL? :) https://review.openstack.org/581090 thank you! | 17:21 |
| *** suuuper has joined #tripleo | 17:22 | |
| *** trown|lunch is now known as trown | 17:23 | |
| *** ffiore has quit IRC | 17:26 | |
| *** holser_ has quit IRC | 17:33 | |
| *** holser_ has joined #tripleo | 17:33 | |
| *** cylopez has joined #tripleo | 17:35 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 17:35 |
| *** cylopez has left #tripleo | 17:36 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Implement fetching of networks https://review.openstack.org/548685 | 17:36 |
| *** slagle has quit IRC | 17:37 | |
| *** slagle has joined #tripleo | 17:38 | |
| *** yamahata has joined #tripleo | 17:40 | |
| *** morazi has quit IRC | 17:42 | |
| *** brault has quit IRC | 17:44 | |
| *** jfrancoa has quit IRC | 17:44 | |
| *** amoralej is now known as amoralej|off | 17:49 | |
| *** moshele has joined #tripleo | 17:51 | |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-ha-utils master: Fix custom STONITH compute names in IHA playbook https://review.openstack.org/580725 | 17:57 |
| *** janki has quit IRC | 17:58 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Unify the Manila HA and non-HA docker configurations https://review.openstack.org/545061 | 18:00 |
| openstackgerrit | Merged openstack/tripleo-ui master: Initial Network configuration views https://review.openstack.org/569124 | 18:03 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix broken README refs in getting started guide https://review.openstack.org/577391 | 18:03 |
| *** rodolof has quit IRC | 18:07 | |
| *** anande has joined #tripleo | 18:12 | |
| slagle | dprince: do you know how what env vars I need to set to be able to use openstackclient/heatclient against the standalone ephemeral heat? | 18:19 |
| dprince | slagle: I have an old etherpad with this in it. sec | 18:21 |
| dprince | slagle: https://etherpad.openstack.org/p/tripleo-composable-undercloud | 18:22 |
| dprince | slagle: like 110 there | 18:22 |
| dprince | slagle: is that what you were after? | 18:22 |
| slagle | thanks. looking | 18:22 |
| slagle | dprince: yes, but that no longer works. as i think that was for the fake keystone stuff | 18:23 |
| slagle | we now have nothing on port 35358 | 18:23 |
| slagle | only 8006 | 18:23 |
| slagle | but i can't figure out how to tell openstackclient what to do | 18:24 |
| dprince | slagle: right, we got rid of fake keystone | 18:24 |
| *** ykarel|away has quit IRC | 18:24 | |
| slagle | OS_AUTH_TYPE=none OS_ENDPOINT=http://127.0.0.1:8006/v1/admin openstack stack list | 18:26 |
| slagle | works :) | 18:26 |
| *** pradk- has quit IRC | 18:27 | |
| jtomasek | slagle: in failures list workflow I get structure such as http://paste.openstack.org/show/725361/ I am trying to identify which parts of it are important? Is listing just a node name and msg enough? | 18:28 |
| jtomasek | slagle: I am trying to figure out how to display the failures in GUI | 18:28 |
| slagle | jtomasek: well the key is the hostname, which points to a list of tuples of "task name","task dict" | 18:30 |
| slagle | jtomasek: where task dict is the key/value pairs from the ansible task | 18:30 |
| *** suuuper has quit IRC | 18:31 | |
| slagle | which could be different for each task. not sure if there will always be "msg" present. i'd have to check | 18:31 |
| *** medberry has quit IRC | 18:31 | |
| jtomasek | slagle: I see, so I'll make sure I show all data: hostname -> tasks -> key-value pairs | 18:33 |
| slagle | jtomasek: i think that makes sense | 18:34 |
| jtomasek | slagle: ok, thanks | 18:34 |
| *** pradk- has joined #tripleo | 18:41 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: [WIP] Add a standalone role for creating the zuul-hosts file https://review.openstack.org/579154 | 18:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud"" https://review.openstack.org/575330 | 18:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Test scen 001 / 002 with cont uc again https://review.openstack.org/580766 | 18:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Test scen 001 / 002 with cont uc again BIS https://review.openstack.org/580767 | 18:46 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates stable/queens: FFU: missing ironic tasks https://review.openstack.org/581103 | 18:48 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Default --local-domain to localdomain https://review.openstack.org/581104 | 18:48 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration https://review.openstack.org/578456 | 18:50 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run https://review.openstack.org/580037 | 18:53 |
| *** atoth has quit IRC | 18:53 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add (back) --keep-running https://review.openstack.org/581110 | 18:54 |
| spotz | Hey all - so I'm receiving this after Stack overcloud CREATE_COMPLETE Host 192.168.126.110 not found in /home/stack/.ssh/known_hosts and when I try to go the dashboard link I'm given I get the page isn't responding. Any hints? | 18:54 |
| *** bkopilov has joined #tripleo | 18:56 | |
| *** mburned is now known as mburned_out | 18:56 | |
| *** mburned_out is now known as mburned | 18:57 | |
| *** medberry has joined #tripleo | 19:03 | |
| *** medberry has quit IRC | 19:03 | |
| *** medberry has joined #tripleo | 19:03 | |
| *** anande has quit IRC | 19:04 | |
| *** dprince has quit IRC | 19:08 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Reparent scenario007 and 008 to tripleo-ci-base https://review.openstack.org/581116 | 19:09 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add memory and swap info into collect-logs collect task https://review.openstack.org/578023 | 19:10 |
| *** marrusl has joined #tripleo | 19:12 | |
| *** brault has joined #tripleo | 19:15 | |
| *** jaganathan has quit IRC | 19:19 | |
| *** psachin has quit IRC | 19:23 | |
| *** tosky has quit IRC | 19:23 | |
| EmilienM | weshay: http://logs.openstack.org/30/575330/25/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/8279028/logs/ara_oooq/file/dff4f21d-fdec-4403-a049-688e8e12ee75/#line-9 | 19:27 |
| EmilienM | weshay: this one takes almost 6 min | 19:27 |
| EmilienM | I'm wondering why, and how to save these 6 min | 19:27 |
| EmilienM | http://logs.openstack.org/30/575330/25/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/8279028/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 19:28 |
| EmilienM | it's openstack-selinux that takes 4 min | 19:28 |
| EmilienM | to be installed | 19:29 |
| EmilienM | we could save it if we deployed this one in the image | 19:29 |
| weshay | EmilienM, that is normal | 19:29 |
| weshay | sure.. we could preinstall selinux | 19:30 |
| *** jaganathan has joined #tripleo | 19:30 | |
| EmilienM | yes IMHO we would save a good 4 min | 19:31 |
| EmilienM | let me finish something first and I'll propose it to infra somewhere | 19:32 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes https://review.openstack.org/572312 | 19:33 |
| *** dprince has joined #tripleo | 19:33 | |
| *** alee has joined #tripleo | 19:36 | |
| EmilienM | pabelanger: if I wanted "openstack-selinux" rpm deployed prior to a "run" playbook in TripleO CI, would you recommend to include this RPM in the nodepool image or just use bindep? | 19:38 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable collectd to connect to metrics QDR https://review.openstack.org/576057 | 19:39 |
| pabelanger | EmilienM: likely bindep.txt, I don't believe we'd add the dependency to the images | 19:39 |
| EmilienM | ok | 19:39 |
| EmilienM | pabelanger: the problem is openstack-selinux comes from RDO I think | 19:39 |
| EmilienM | let me see | 19:40 |
| pabelanger | right, you'd need to enable that repo first then | 19:40 |
| EmilienM | yeah from delorean | 19:40 |
| EmilienM | ok | 19:40 |
| pabelanger | what is the issue your trying to solve? | 19:40 |
| EmilienM | pabelanger: I also could use a zuul v3 playbook | 19:40 |
| pabelanger | yes, that too | 19:40 |
| EmilienM | k | 19:41 |
| EmilienM | I'll hack something up and it might be dirty, I'll add you as reviewer and weshay as well | 19:41 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-heat-templates master: [DNM] test new jobs configuration https://review.openstack.org/579653 | 19:41 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-heat-templates master: [DNM] test new jobs configuration https://review.openstack.org/579653 | 19:41 |
| pabelanger | EmilienM: is it failing to install? | 19:41 |
| EmilienM | pabelanger: no | 19:41 |
| EmilienM | pabelanger: it's just long to install | 19:42 |
| EmilienM | pabelanger: and I think it's one these things we could do in pre | 19:42 |
| EmilienM | in order to avoid timeouts in run | 19:42 |
| pabelanger | how long does it take to install? | 19:43 |
| *** alee has quit IRC | 19:43 | |
| *** alee has joined #tripleo | 19:43 | |
| EmilienM | pabelanger: nearly 5 min | 19:43 |
| EmilienM | 4 min on average I think | 19:43 |
| pabelanger | you could maybe try using eatmydata to disable fsync on jobs, however there is a downside to that | 19:44 |
| EmilienM | http://logs.openstack.org/30/575330/25/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/8279028/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz#_2018-07-09_09_20_30 | 19:44 |
| EmilienM | eatmydata is a bit unsafe, isn't? | 19:44 |
| EmilienM | (by a bit I mean a lot) | 19:45 |
| pabelanger | yah, it is meant for data-to-disk synchronization calls have no affect | 19:45 |
| pabelanger | depending on cloud, IO might be bad | 19:45 |
| pabelanger | as long as node doesn't reboot or die, data should be safe | 19:46 |
| pabelanger | and since data is just ephemeral, might be you a boost in job run times | 19:46 |
| pabelanger | but, be sure to properly test | 19:47 |
| EmilienM | I'll try to setup the package in pre first, and maybe make it so it's easy to add more packages in the future | 19:47 |
| weshay | EmilienM, I think we should focus on running the container sync in pre.yaml | 19:57 |
| weshay | EmilienM, you are spinnin wheels bro | 19:57 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add doc for the libvirt reproducer https://review.openstack.org/566155 | 19:57 |
| EmilienM | weshay: I was thinking about it and yes imho we should find another way | 19:57 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add host routes to subnets https://review.openstack.org/580235 | 19:58 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add per-network routes to NIC templates https://review.openstack.org/580236 | 19:58 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: host_routes using get_attr (Composable Networks) https://review.openstack.org/580596 | 19:58 |
| EmilienM | weshay: but it's still 4 min we can save, if we had the package in the image for example | 19:58 |
| EmilienM | weshay: see the last link that I posted | 19:58 |
| *** yrabl has quit IRC | 20:00 | |
| weshay | EmilienM, that package take a long time because it's running relabel right? | 20:01 |
| EmilienM | weshay: yep | 20:01 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: tripleo-validations, group-validations fails with notify_running task exception https://review.openstack.org/581054 | 20:02 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 20:02 |
| Tengu | adding packages in the image has also a downside: might take longer to download them because of extra size. but it certainly won't take as long as a relabel :] | 20:04 |
| EmilienM | one crazy idea though is to have our own nodepool images | 20:04 |
| EmilienM | we would save so much time by adding all the rpms we want | 20:05 |
| EmilienM | things would get cached etc | 20:05 |
| Tengu | EmilienM: "Nodepool images" ? like docker repository on premisses? | 20:05 |
| EmilienM | Tengu: the extra size of this rpm is really irrelevant imho | 20:05 |
| *** pchavva has quit IRC | 20:05 | |
| EmilienM | https://trunk.rdoproject.org/centos7-master/current/ | 20:06 |
| EmilienM | the rpm makes 145KB | 20:06 |
| Tengu | EmilienM: depending on which package of course :). as long as you yum clean all && rm -f /var/lib/yum/<...> :) | 20:06 |
| pabelanger | EmilienM: https://review.openstack.org/577889/ will give you a speed boost for jobs | 20:06 |
| pabelanger | if somebody wants to compare run times | 20:06 |
| Tengu | *-rf | 20:06 |
| Tengu | anyway. | 20:06 |
| EmilienM | pabelanger: can I recheck it? | 20:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP: Enable pipelining for ansible https://review.openstack.org/577889 | 20:07 |
| EmilienM | let's see how it goes now | 20:07 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: run container prep in pre, like upstream https://review.openstack.org/580731 | 20:07 |
| EmilienM | weshay: I'm exploring other things than container image things, I think Yatin found the solution with his patches | 20:08 |
| trozet | mwhahaha: do you mind setting workflow on https://review.openstack.org/#/c/579005/1 please? | 20:08 |
| EmilienM | weshay: a combination of https://review.openstack.org/#/c/580631/ and https://review.openstack.org/#/c/580037/ should work | 20:08 |
| *** brandor5 has joined #tripleo | 20:08 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Expose dnsmasq_local_resolv option https://review.openstack.org/577936 | 20:08 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Disable recursion in Designate-managed BIND https://review.openstack.org/577937 | 20:08 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Enable configuration of Designate's pools.yaml https://review.openstack.org/580526 | 20:08 |
| * weshay llooks | 20:08 | |
| weshay | EmilienM, ya.. I'm trying to get that going locally | 20:09 |
| pabelanger | heading out for food, but can check back later. I do think smaller containers will help job times, but also interested in IO times jobs are seeing | 20:09 |
| brandor5 | hello everyone: I'm curious what would happen if I have a production rhosp10 and uploaded new deploy images, ran openstack baremetal configure boot, and then re-ran a deploy? | 20:09 |
| EmilienM | pabelanger: I agree for smaller containers however it won't happen overnight | 20:09 |
| EmilienM | it should be a goal for Stein maybe or something, something as a wide effort, it's a lot of work I think | 20:10 |
| Tengu | can't the CI vm use only tmpfs? :) | 20:11 |
| *** pradk- has quit IRC | 20:11 | |
| *** thrash is now known as thrash|g0ne | 20:12 | |
| mwhahaha | eck`: what's the relationship between NODE_IP_ADDRESS and RABBITMQ_NODENAME in the rabbitmq-env.conf? | 20:13 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: tripleo-validations, group-validations fails with notify_running task exception https://review.openstack.org/581054 | 20:15 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Improve validations output for troubleshooting. https://review.openstack.org/581007 | 20:15 |
| eck` | mwhahaha: NODE_IP_ADDRESS is basically the interface it will bind to | 20:16 |
| mwhahaha | eck`: is there a reason we don't set it? | 20:16 |
| * mwhahaha is running into issues with the defaults | 20:16 | |
| eck` | mwhahaha: i believe we do set it | 20:16 |
| *** dparkes has joined #tripleo | 20:17 | |
| * eck` looks at an env | 20:17 | |
| mwhahaha | eck`: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/rabbitmq.yaml#L104 | 20:17 |
| brandor5 | anyone? | 20:17 |
| eck` | hrm. | 20:18 |
| EmilienM | weshay, mwhahaha : I'm actually wondering why we bother to deploy openstack-selinux if we don't enable enforcing in CI. | 20:18 |
| mwhahaha | EmilienM: it's a dep in a bunch of packages | 20:18 |
| mwhahaha | eck`: i would have thought we would have wanted to bind to a specific interface | 20:18 |
| mwhahaha | eck`: we do have teh ELR_EPMD_ADDRESS configured, http://logs.openstack.org/62/575862/6/check/tripleo-ci-centos-7-undercloud-containers/524adeb/logs/undercloud/var/log/config-data/rabbitmq/etc/rabbitmq/rabbitmq-env.conf.txt.gz | 20:19 |
| weshay | there is that, and we still could flag issues theoretically | 20:19 |
| weshay | if there was bandwidth for that | 20:19 |
| eck` | mwhahaha: yeah we used to set that at some point, i wasn't aware it changed along the way | 20:19 |
| EmilienM | weshay: right | 20:19 |
| * eck` digs in git | 20:19 | |
| eck` | mwhahaha: https://review.openstack.org/#/c/410722/ | 20:21 |
| eck` | that's why | 20:21 |
| mwhahaha | hmm ok let me look | 20:21 |
| eck` | it sets tcp_listeners in rabbitmq.config instead | 20:21 |
| mwhahaha | eck`: so it doesn't seem to be working because... | 20:22 |
| mwhahaha | eck`: http://logs.openstack.org/62/575862/6/check/tripleo-ci-centos-7-standalone/ec2c0fe/logs/undercloud/var/log/extra/docker/containers/rabbitmq/stdout.log.txt.gz | 20:22 |
| mwhahaha | eck`: despite listeners being configured to 192.168.24.1 | 20:23 |
| mwhahaha | eck`: see http://logs.openstack.org/62/575862/6/check/tripleo-ci-centos-7-standalone/ec2c0fe/logs/undercloud/var/log/config-data/rabbitmq/etc/rabbitmq/rabbitmq.config.gz | 20:23 |
| mwhahaha | or something else is failing when it's trying to do the lookup on startup | 20:24 |
| eck` | mwhahaha: in that case i'm guessing the short hostname doesn't resolve properly | 20:24 |
| mwhahaha | yea that's kinda the problem :/ | 20:24 |
| eck` | it's going to resolve centos-7-rax-iad-0000615650 and then connect to epmd there | 20:24 |
| * mwhahaha goes back to hating on /etc/hosts | 20:24 | |
| eck` | so if that gives you something other than ERL_EPMD_ADDRESS it will fail | 20:25 |
| eck` | and if ipv6 is involved it can get even more fun | 20:25 |
| mwhahaha | k that's what i figured and i was afraid of. What happens if you configure RABBITMQ_NODE_IP_ADDRES, would it use that instead of the hostname? | 20:25 |
| mwhahaha | i guess i just need to purge the /etc/hosts of bad resolvers for that that hostname -> ip | 20:26 |
| eck` | no it needs to use the hostname | 20:26 |
| eck` | that is a core erlang thing | 20:26 |
| mwhahaha | boooo | 20:27 |
| mwhahaha | eck`: thanks for the info | 20:27 |
| eck` | np! | 20:27 |
| spotz | mwhahaha eck` EmilienM - Any hints how to debug the overcloud dashboard? | 20:28 |
| mwhahaha | spotz: you mean the tripleo UI? | 20:29 |
| spotz | Yeah I'm finally completing the install get the link for the dashboard but can't open the page | 20:29 |
| mwhahaha | spotz: oh that's horizon | 20:30 |
| spotz | yeah | 20:30 |
| mwhahaha | depends on your network config | 20:30 |
| mwhahaha | if you can't reach it, it sounds like your net config is bad or something | 20:30 |
| spotz | running on an haproxy from the looks of it. | 20:30 |
| mwhahaha | spotz: so it should be runnin on the same hosts as everything else, if you course overcloudrc are the openstack commands working? | 20:31 |
| spotz | mwhahaha: Yep | 20:32 |
| mwhahaha | spotz: can you curl it from the undercloud then? | 20:33 |
| spotz | mwhahaha: Yep, oh duh I think I know the issue:) | 20:36 |
| spotz | mwhahaha: It works if I do it from the desktop it's installed on:) | 20:38 |
| mwhahaha | spotz: yea routing stuff | 20:38 |
| spotz | I forgot I'd been sshing to it through the host machine | 20:39 |
| *** dparkes has quit IRC | 20:41 | |
| *** ansmith has quit IRC | 20:41 | |
| weshay | mwhahaha, os-net-config has no real gate jobs? | 20:43 |
| spotz | All the Workflow links have errors but much progress has been made:) | 20:43 |
| mwhahaha | weshay: ? | 20:44 |
| weshay | bah just requirements https://review.openstack.org/#/c/580290/ | 20:45 |
| weshay | in the gate | 20:45 |
| weshay | hrm.. also have to jobs failing on workflows | 20:46 |
| * weshay writes it up | 20:46 | |
| *** brault has quit IRC | 20:48 | |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1780855 | 20:48 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 20:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP: run repo-setup in pre (and then being able to deploy pkgs in pre) https://review.openstack.org/581131 | 20:49 |
| EmilienM | weshay: re-using oooq ^ look | 20:49 |
| *** tzumainn has quit IRC | 20:49 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP: run repo-setup in pre (and then being able to deploy pkgs in pre) https://review.openstack.org/581131 | 20:50 |
| EmilienM | mwhahaha: we can merge https://review.openstack.org/#/c/569153/ I think, the patch worked (I saw it in zuul) | 20:52 |
| *** pradk has joined #tripleo | 20:52 | |
| EmilienM | mwhahaha: fs035 will pass | 20:52 |
| mwhahaha | k | 20:52 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Install openstack-selinux in pre-phase https://review.openstack.org/581133 | 20:55 |
| pradk | can someone merge this please https://review.openstack.org/#/c/576220/1 .. has been sitting for a while | 20:59 |
| *** mjturek_ has quit IRC | 20:59 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Revert "Add host prep step for ntp time sync" https://review.openstack.org/581135 | 21:02 |
| trozet | mwhahaha: ^ | 21:02 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Cleanup hosts name on initial install https://review.openstack.org/581136 | 21:03 |
| mwhahaha | trozet: wat | 21:03 |
| mwhahaha | EmilienM, slagle -^ /etc/hosts cleanup proposal | 21:03 |
| EmilienM | ok will review tha ttonight | 21:03 |
| mwhahaha | trozet: we shouldn't be running host prep steps during os-net-config | 21:04 |
| mwhahaha | os-net-config should be done | 21:04 |
| mwhahaha | that's an issue outside of that patch | 21:04 |
| trozet | mwhahaha: just calling it how i see it | 21:04 |
| trozet | mwhahaha: i mean your patch broke it :) | 21:04 |
| mwhahaha | trozet: well you should report bugs with details and not reverts for unrealated patches | 21:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing adding properties to flavors https://review.openstack.org/579406 | 21:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: [DNM] Add local network-environment file for fs001 https://review.openstack.org/577230 | 21:05 |
| trozet | mwhahaha: it is related it caues the failures | 21:05 |
| trozet | causes | 21:05 |
| mwhahaha | i look forward to logs and details | 21:06 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Update standalone role for a cloud https://review.openstack.org/575862 | 21:06 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: standalone run a post config to generate a clouds.yaml https://review.openstack.org/575597 | 21:06 |
| trozet | mwhahaha: the nice thing is with a commit open i can pull it into apex, then respin apex baremetal deployment and see if it fixes it | 21:06 |
| *** brandor5 has left #tripleo | 21:07 | |
| mwhahaha | trozet: so it's likely covering up another issue. so i get that but that's not really solving the udnerlying issue | 21:07 |
| trozet | mwhahaha: the issue that host prep tasks shouldn't run until after os-net-config is complete? | 21:08 |
| mwhahaha | trozet: if that's the problem sure, but w/o logs or reproducer information it's all conjecture | 21:08 |
| mwhahaha | if at host_prep_tasks you don't have connectivity, that's a problem | 21:08 |
| trozet | mwhahaha: https://build.opnfv.org/ci/job/apex-deploy-baremetal-master/2560/console | 21:08 |
| trozet | FAILED! => {\\\"changed\\\": true, \\\"cmd\\\": [\\\"ntpdate\\\", \\\"-u\\\", \\\"0.se.pool.ntp.org\\\"], \\\"delta\\\": \\\"0:00:40.056215\\\", \\\"end\\\": \\\"2018-07-09 20:47:47.234276\\\", \\\"msg\\\": \\\"non-zero return code\\\", \\\"rc\\\": 1, \\\"start\\\": \\\"2018-07-09 20:47:07.178061\\\", \\\"stderr\\\": \\\"Error resolving 0.se.pool.ntp.org: Name or service not known (-2)\\\ | 21:09 |
| mwhahaha | trozet: yea did you setup dns? | 21:09 |
| trozet | [root@overcloud-controller-0 ~]# ntpdate -u 0.se.pool.ntp.org | 21:09 |
| trozet | 9 Jul 20:57:04 ntpdate[17403]: adjust time server 192.36.143.130 offset 0.002542 sec | 21:09 |
| * mwhahaha shrugs on your environment | 21:09 | |
| trozet | mwhahaha: i was logged into the CI node while it was running | 21:09 |
| trozet | mwhahaha: after i saw os-net-config finish i typed ^^^ and it worked fine | 21:09 |
| mwhahaha | trozet: right so some logs to that effect would be nice | 21:10 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780855 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 21:10 |
| trozet | mwhahaha: i just gave you the log | 21:10 |
| mwhahaha | trozet: you gave me a deployment log, not a system log showing anything | 21:10 |
| trozet | mwhahaha: the resistance is real | 21:12 |
| mwhahaha | trozet: so i don't know if it's just an interface takes too long to up or if it's a deployment issue | 21:12 |
| mwhahaha | trozet: so if you want me to help, provide details/sosreport/etc | 21:12 |
| mwhahaha | this log doesn't help me understand what your ci/systems look like | 21:12 |
| trozet | mwhahaha: forget it | 21:14 |
| mwhahaha | trozet: so i bet your compute hosts don't have internet do they | 21:14 |
| mwhahaha | trozet: so you need to provide a local ntp time source | 21:14 |
| trozet | mwhahaha: they all have internet, this is the same deployment weve been running on the same hardware, it worked until this patch | 21:15 |
| mwhahaha | trozet: since it's working on the other hosts, i'm not sure what's different about your compute nodes | 21:17 |
| mwhahaha | trozet: so it's not a global break which is why i'm trying to figure out whats different with your environment than say our ovb environments | 21:18 |
| *** pradk has quit IRC | 21:19 | |
| mwhahaha | slagle: how is the NetworkDeployment and host_prep_tasks ordered now inc onfig download? Is there anyway os-net-config could still be running when we kick off the host_prep_tasks? | 21:22 |
| *** rmascena has joined #tripleo | 21:23 | |
| mwhahaha | trozet: so it looks like the network deployment should have been finished prior to host prep from that log output. can you provide a sosreport from one of those compute hosts that might show when the network was finally ready? | 21:25 |
| *** raildo has quit IRC | 21:26 | |
| slagle | mwhahaha: host_prep_tasks starts after, it's in a separate play so I don't see how it could still be running | 21:26 |
| mwhahaha | hostprep ran at Monday 09 July 2018 20:55:11 +0000 but the networkdeployment finished at Monday 09 July 2018 20:54:49 +0000 (0:00:00.174) | 21:27 |
| mwhahaha | so yea | 21:27 |
| mwhahaha | i'm wondering if the interfaces took too long to actually come up and we don't wait for them to be up | 21:28 |
| mwhahaha | and os-net-config just fires & forgets | 21:28 |
| mwhahaha | which seems weirdf | 21:28 |
| *** abishop has quit IRC | 21:29 | |
| slagle | i believe os-net-config waits for the return of ifup | 21:30 |
| mwhahaha | but does ifup actually wait for dhcp and stuff | 21:30 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift. https://review.openstack.org/581141 | 21:33 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift. https://review.openstack.org/581141 | 21:34 |
| trozet | mwhahaha: why did you mention compute nodes, do you only see it fail there and not on control? | 21:36 |
| mwhahaha | trozet: it was successful on the control nodes | 21:36 |
| *** jtomasek has quit IRC | 21:37 | |
| *** akhilaki_ has joined #tripleo | 21:38 | |
| trozet | mwhahaha: we dont put IP on external interfaces on compute nodes, and their default route is to route to undercloud, so if it is only compute nodes that is probably it | 21:38 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: WIP First pass at using crm_diff for pcmk resource deep_compare https://review.openstack.org/574388 | 21:40 |
| *** akhilaki has quit IRC | 21:40 | |
| mwhahaha | trozet: right so that probably means it's never worked on your compute nodes and it's been silently failing to ntp sync time forever | 21:43 |
| trozet | mwhahaha: so this patch implies now that the node has an IP on the external network interface | 21:46 |
| *** moshele has quit IRC | 21:46 | |
| mwhahaha | trozet: no it implies that you need to properly configure your ntp for teh deployment | 21:46 |
| mwhahaha | trozet: so what was happening previously is we were not validing that ntp actually synced | 21:47 |
| mwhahaha | trozet: so you could use a bogus ntp server but your computes would slowly shift away from the contorllers | 21:47 |
| *** rmascena has quit IRC | 21:49 | |
| mwhahaha | trozet: if you have a locally available ntp server (ie, undercloud) that would work as well. the external connectivity is only because you're using an external ntp server w/o ensuring the computes can reach it | 21:49 |
| mwhahaha | trozet: are you not enabling masq on the undercloud? | 21:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: skydive external_deploy_task migration https://review.openstack.org/561274 | 21:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Use delorean-build-deps.repo for test-package-build https://review.openstack.org/581025 | 21:50 |
| openstackgerrit | Merged openstack/instack-undercloud master: Call validations upload workflow instead of action https://review.openstack.org/576145 | 21:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: FFU: missing ironic tasks https://review.openstack.org/580200 | 21:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: yaml-validator - network_data validate show all errors https://review.openstack.org/580230 | 21:50 |
| openstackgerrit | Merged openstack/os-net-config master: Syncing the requirements https://review.openstack.org/580290 | 21:50 |
| trozet | mwhahaha: an user could specify the ntp server when he/she deploys so want to make it work for external | 21:51 |
| trozet | mwhahaha: trying to remember the reason we do not put IP on compute nodes | 21:51 |
| mwhahaha | trozet: cause you shouldnt' need them | 21:51 |
| mwhahaha | trozet: and yes, the ntpservers are configurable (and should be configured like dns servers) | 21:52 |
| mwhahaha | trozet: you are actually configuring them because we default to pool.ntp.org | 21:52 |
| mwhahaha | but it wasn't actually working for your compute nodes | 21:52 |
| mwhahaha | because who validates systems in CI anyway :D | 21:53 |
| mwhahaha | you're getting nailed by us actually checking that it works now :D | 21:53 |
| trozet | mwhahaha: should it fail a deployment if it fails on compute? i can see why it matters for pacemaker timing on control nodes, but it worked fien on computes before | 21:55 |
| mwhahaha | trozet: it's a UX issue. Sure we could make it optional, but if they start shifting too far for an actual deployment it can be detrimental | 21:55 |
| trozet | mwhahaha: i guess ceph may matter for clock skew detection on hyperconverged setups | 21:55 |
| mwhahaha | yea | 21:56 |
| mwhahaha | it's safer to fail fast (and clearly) | 21:56 |
| mwhahaha | where as before it could fail later w/o obvious reasons | 21:56 |
| trozet | mwhahaha: i'll add a patch to apex to eanble IP on compute nodes and see if the problem goes away | 21:56 |
| mwhahaha | we'd seen it in docker where ntp would suddenly sync the time during deployment and it fail during configuration | 21:56 |
| *** yrabl has joined #tripleo | 21:57 | |
| *** holser_ has quit IRC | 21:58 | |
| *** tzumainn has joined #tripleo | 22:03 | |
| *** paramite has quit IRC | 22:04 | |
| *** cdearborn_ has joined #tripleo | 22:06 | |
| *** bfournie has quit IRC | 22:08 | |
| *** bfournie has joined #tripleo | 22:08 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1780855 | 22:10 |
| openstack | Launchpad bug 1780855 in tripleo "undercloud install fails on workflow not found workflow_identifier=tripleo.validations.v1.upload_validations " [Critical,Triaged] | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| *** cdearborn has quit IRC | 22:10 | |
| *** cdearborn_ has quit IRC | 22:12 | |
| *** tzumainn has quit IRC | 22:12 | |
| mwhahaha | weshay: didn't we have that bug already | 22:12 |
| weshay | mwhahaha, I can double check | 22:12 |
| mwhahaha | i swear i've seen that error message before | 22:12 |
| *** bfournie has quit IRC | 22:13 | |
| weshay | it just f.. the gate | 22:13 |
| *** khyr0n has joined #tripleo | 22:13 | |
| mwhahaha | https://review.openstack.org/#/c/576145 | 22:13 |
| mwhahaha | it just landed | 22:13 |
| *** numans has quit IRC | 22:14 | |
| mwhahaha | weshay: do we have an out dated tripleo-common somewhere | 22:14 |
| mwhahaha | cause it should have been available 12 days ago https://review.openstack.org/#/c/576126/ | 22:14 |
| weshay | mwhahaha, ah.. it just failed on the same patch 5 times | 22:15 |
| weshay | https://review.openstack.org/#/c/572260/ | 22:15 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: Update yaml files for Dell EMC VNX, Unity drivers https://review.openstack.org/572260 | 22:15 |
| *** jaganathan has quit IRC | 22:15 | |
| mwhahaha | odd | 22:15 |
| *** numans has joined #tripleo | 22:19 | |
| *** rcernin has joined #tripleo | 22:20 | |
| *** threestrands_ has joined #tripleo | 22:20 | |
| mwhahaha | weshay & company: https://review.openstack.org/#/c/581083/ | 22:22 |
| weshay | wha wha.. woooooot | 22:23 |
| * weshay looks more closely | 22:23 | |
| *** yrabl has quit IRC | 22:23 | |
| weshay | thanks for some good news | 22:23 |
| *** karthiks has quit IRC | 22:23 | |
| *** jappleii__ has joined #tripleo | 22:23 | |
| *** jappleii__ has quit IRC | 22:24 | |
| *** jappleii__ has joined #tripleo | 22:25 | |
| weshay | meh.. thought that was a different patch | 22:25 |
| weshay | :) | 22:25 |
| mwhahaha | not yet (soon) | 22:25 |
| mwhahaha | weshay: https://review.openstack.org/#/c/581136 might be needed first (testing) | 22:25 |
| weshay | EmilienM, I may need to update this https://review.openstack.org/#/c/580037/45/playbooks/containers/pre-prep-docker.yaml | 22:26 |
| *** threestrands_ has quit IRC | 22:26 | |
| *** mcornea has quit IRC | 22:26 | |
| mwhahaha | weshay: somehow i'm not sure how the udnercloud bits get past that, we appear to be adding in 127.0.1.1 somewhere for the containerized udnercloud install | 22:26 |
| weshay | 127.0.1.1? | 22:26 |
| weshay | k k.. will look.. I want to close out this container mess | 22:27 |
| *** jaganathan has joined #tripleo | 22:27 | |
| mwhahaha | weshay: yea i couldn't find it in oooq or oooq-extras | 22:31 |
| mwhahaha | weshay: oh sorry it was 127.0.0.1 http://logs.openstack.org/62/575862/6/check/tripleo-ci-centos-7-undercloud-containers/524adeb/logs/undercloud/etc/hosts.txt.gz | 22:32 |
| mwhahaha | 127.0.0.1 undercloud.localdomain undercloud localhost | 22:32 |
| mwhahaha | in standalone we don't do any hostname set stuff | 22:32 |
| weshay | in undercloud-setup we do | 22:32 |
| mwhahaha | maybe i read the conditionals backwards | 22:32 |
| *** dprince has quit IRC | 22:33 | |
| mwhahaha | weshay: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-setup/tasks/hostname.yml | 22:33 |
| mwhahaha | weshay: it doesn't run under containerized undercloud | 22:33 |
| mwhahaha | i couldn't spot any /etc/hosts writing | 22:34 |
| weshay | standalone vs. containerized undercloud | 22:34 |
| weshay | oh | 22:35 |
| weshay | that was a cont undercloud run | 22:35 |
| weshay | need a few | 22:35 |
| *** karthiks has joined #tripleo | 22:36 | |
| mwhahaha | hey my patch didn't take 3 hours to fail in ci for standalone | 22:46 |
| mwhahaha | too bad it still failed | 22:46 |
| * mwhahaha goes digging | 22:46 | |
| mwhahaha | stderr: /usr/bin/docker-current: Error response from daemon: linux runtime spec devices: open /dev/cinder-volumes: no such file or directory. | 22:46 |
| mwhahaha | that's a new one | 22:46 |
| mwhahaha | also neutron_metadata_agent didn't work :/ | 22:47 |
| *** mjturek has joined #tripleo | 22:48 | |
| *** brault has joined #tripleo | 22:48 | |
| *** yamahata has quit IRC | 22:50 | |
| mwhahaha | beagles: thoughts on why the neutron-metadata-agent might return 127 on startup? http://logs.openstack.org/62/575862/7/check/tripleo-ci-centos-7-standalone/846e5e3/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-07-09_22_28_38 | 22:51 |
| *** mjturek has quit IRC | 22:51 | |
| *** brault has quit IRC | 22:53 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-common master: WIP: Use process-templates.py and cache templates to speed up plan ops. https://review.openstack.org/581153 | 22:53 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Prepare Docker Registry + Containers in pre-run https://review.openstack.org/580037 | 22:54 |
| *** mjturek has joined #tripleo | 22:54 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: run container prep in pre, like upstream https://review.openstack.org/580731 | 22:55 |
| *** pmannidi has joined #tripleo | 23:00 | |
| *** mjturek has quit IRC | 23:02 | |
| *** yamahata has joined #tripleo | 23:03 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove the OVS-DPDK deprecated parameters https://review.openstack.org/566239 | 23:03 |
| mwhahaha | oh neat it worked in the child patch, maybe it was a temporary thing with that /dev/cinders-volumes error | 23:04 |
| mwhahaha | weshay: http://logs.openstack.org/97/575597/18/check/tripleo-ci-centos-7-standalone/bd96468/job-output.txt.gz#_2018-07-09_21_46_20_892750 | 23:05 |
| mwhahaha | ~35 mins on the install | 23:05 |
| mwhahaha | (not including all the prep bits) | 23:05 |
| * mwhahaha thinks that is the appropriate thing to give up on for the day | 23:05 | |
| * mwhahaha bails | 23:05 | |
| *** mjturek has joined #tripleo | 23:06 | |
| weshay | mwhahaha, seems like a good idea | 23:06 |
| *** yolanda_ has joined #tripleo | 23:06 | |
| *** mjturek has quit IRC | 23:07 | |
| *** yolanda has quit IRC | 23:09 | |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Allow pingloss adjustment. https://review.openstack.org/581021 | 23:10 |
| *** khyr0n_ has joined #tripleo | 23:22 | |
| *** dmacpher_ has joined #tripleo | 23:22 | |
| *** dmacpher has quit IRC | 23:22 | |
| *** diablo_rojo_phon has quit IRC | 23:22 | |
| *** rook has quit IRC | 23:22 | |
| *** khyr0n has quit IRC | 23:23 | |
| *** diablo_rojo_phon has joined #tripleo | 23:24 | |
| *** rook has joined #tripleo | 23:25 | |
| *** rook is now known as Guest67898 | 23:25 | |
| *** edmondsw has quit IRC | 23:26 | |
| *** bandini has quit IRC | 23:27 | |
| *** safchain has quit IRC | 23:27 | |
| *** safchain has joined #tripleo | 23:27 | |
| *** zshi has quit IRC | 23:28 | |
| *** bfournie has joined #tripleo | 23:28 | |
| *** bandini has joined #tripleo | 23:28 | |
| *** mjturek has joined #tripleo | 23:29 | |
| *** mjturek has quit IRC | 23:34 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Adds scenario008 ODL to zuul check https://review.openstack.org/579005 | 23:40 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Allow pingloss adjustment. https://review.openstack.org/581161 | 23:42 |
| *** rpioso is now known as rpioso|afk | 23:42 | |
| *** zshi has joined #tripleo | 23:43 | |
| *** akhilaki_ has quit IRC | 23:48 | |
| tonyb | Tengu: I added some review comments to your spec | 23:49 |
| tonyb | Tengu: would you be upset if I did a, really, bad PoC patch? python-tripleoclient is quite different from the intended usecase/architecture for privsep and I'm really curious now ;P | 23:50 |
| *** dmacpher_ has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!