| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 00:00 |
|---|---|---|
| *** gbarros has joined #tripleo | 00:00 | |
| *** jcoufal has joined #tripleo | 00:01 | |
| *** saneax-_-|AFK has joined #tripleo | 00:04 | |
| *** gbarros has quit IRC | 00:04 | |
| *** Goneri has quit IRC | 00:13 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: TEST: Don't override worker counts https://review.openstack.org/433992 | 00:14 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Make quotes consistent to match the sample config https://review.openstack.org/432406 | 00:15 |
| *** fragatin_ has quit IRC | 00:15 | |
| *** fragatina has joined #tripleo | 00:15 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 00:17 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Revert "Revert "toci_gate_test: allow to run upgrade jobs for scenarios"" https://review.openstack.org/433715 | 00:19 |
| *** hjensas has quit IRC | 00:19 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Turn off propagation for undercloud logger https://review.openstack.org/431185 | 00:19 |
| openstackgerrit | Merged openstack/instack-undercloud master: Add py35 to tox envlist https://review.openstack.org/431666 | 00:19 |
| openstackgerrit | Merged openstack/instack-undercloud master: Stop using deprecated mockpatch module https://review.openstack.org/431667 | 00:19 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Remove link to modindex https://review.openstack.org/426050 | 00:19 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Drop ceph workaround for mitaka https://review.openstack.org/425754 | 00:20 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Remove rdo-qemu-ev workaround https://review.openstack.org/425753 | 00:20 |
| *** jcoufal has quit IRC | 00:24 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: Extend devmode to run with OVB https://review.openstack.org/425447 | 00:32 |
| *** limao has joined #tripleo | 00:39 | |
| owalsh_sick | Err.. "ERROR: At least 4 GB of memory is required for undercloud installation. A minimum of 6 GB is recommended. Only detected 7726 MB" | 00:39 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-deployment https://review.openstack.org/421009 | 00:41 |
| owalsh_sick | Error is wrong, 7750 MB is required | 00:41 |
| *** limao has quit IRC | 00:42 | |
| *** limao has joined #tripleo | 00:42 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Ansible role for built packages install https://review.openstack.org/426869 | 00:42 |
| openstackgerrit | Oliver Walsh proposed openstack/instack-undercloud master: Fix insufficient memory error message https://review.openstack.org/434002 | 00:47 |
| *** tbonds has quit IRC | 00:52 | |
| *** gatuus has quit IRC | 01:07 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add option to build delorean changes and include the repo https://review.openstack.org/434004 | 01:11 |
| EmilienM | slagle, beekneemech: https://review.openstack.org/#/c/433954/1 seems to pass but doesn't show extrem improvements | 01:19 |
| EmilienM | ovb-nonha is 1h50 and ovb-ha is 2h | 01:20 |
| EmilienM | it's still okay | 01:20 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: Extend devmode to run with OVB https://review.openstack.org/425447 | 01:21 |
| *** jjung has quit IRC | 01:22 | |
| owalsh_sick | beekneemech, EmilienM: FYI http://logs.openstack.org/41/405241/42/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/aa7b21b/console.html#_2017-02-14_23_58_43_309559 | 01:23 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 01:24 |
| EmilienM | owalsh_sick: looking | 01:24 |
| EmilienM | openstackgerrit: yes I +2 your patch | 01:24 |
| EmilienM | owalsh_sick: wait, why did it fail? | 01:26 |
| owalsh_sick | EmilienM: new memory check | 01:27 |
| owalsh_sick | EmilienM: ignore the error message, 7750 MB required now | 01:27 |
| EmilienM | owalsh_sick: what you fixed is the message right? not the actual test? | 01:27 |
| EmilienM | mwhahaha: the actual test is here: https://github.com/openstack/instack-undercloud/commit/6b38be4b00eb5634dbc4e14d8706c0661cc11929 | 01:27 |
| EmilienM | mwhahaha: sorry wrong ping | 01:28 |
| owalsh_sick | EmilienM: yes, https://review.openstack.org/434002 just fixes the error | 01:28 |
| EmilienM | owalsh_sick: but why are we erroring in the logs you pasted | 01:29 |
| EmilienM | owalsh_sick: don't we have enough memory in CI? | 01:29 |
| owalsh_sick | EmilienM: yea | 01:29 |
| EmilienM | if total_mb < REQUIRED_MB | 01:30 |
| EmilienM | you just fixed the error message | 01:30 |
| owalsh_sick | 7726 MB is an odd number though | 01:30 |
| EmilienM | owalsh_sick: mhh I'm still confused why we have http://logs.openstack.org/41/405241/42/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/aa7b21b/console.html#_2017-02-14_23_58_43_309559 | 01:31 |
| EmilienM | because to me it means we don' thave enough memory in CI | 01:31 |
| owalsh_sick | EmilienM: maybe it's a bad host? | 01:31 |
| owalsh_sick | rechecking at the moment | 01:32 |
| mwhahaha | Do we need to revert that change? | 01:32 |
| EmilienM | mwhahaha: if it's consistent yes | 01:33 |
| EmilienM | AFIK nodepool nodes should have 8gb | 01:34 |
| EmilienM | but thanks to owalsh's fix, we should know why it fails really | 01:34 |
| EmilienM | we'll have the real memory | 01:34 |
| owalsh_sick | error reports the real memory, just the minimum required that's wrong in the message | 01:34 |
| EmilienM | ok so 7726 was detected | 01:35 |
| owalsh_sick | yea | 01:35 |
| EmilienM | owalsh_sick: sounds like we could change the value to 7726 instead of 7750 | 01:36 |
| EmilienM | mwhahaha: regarding https://review.openstack.org/#/c/433954/ - do you see any thing else we could lock to a specific step to save time? | 01:36 |
| EmilienM | mwhahaha: maybe the ports.conf by moving wsgi services to step3? | 01:37 |
| mwhahaha | Yea we need to have all the wsgi stuff as their own profile and do them all in the same step | 01:37 |
| owalsh_sick | EmilienM: recheck looks promising... might just be one node that's < 8GB | 01:38 |
| EmilienM | owalsh_sick: I bet we'll hit it again soon | 01:38 |
| EmilienM | owalsh_sick: we were lucky this time | 01:38 |
| EmilienM | owalsh_sick: to avoid useless rechecks, I would just decrease the number | 01:38 |
| owalsh_sick | EmilienM: ok, maybe 7680 MB (7.5GB) | 01:40 |
| EmilienM | owalsh_sick: wfm | 01:40 |
| owalsh_sick | EmilienM: ok, I'll push a review | 01:40 |
| EmilienM | thx | 01:41 |
| openstackgerrit | Oliver Walsh proposed openstack/instack-undercloud master: Reduce required memory check to 7.5GB https://review.openstack.org/434014 | 01:46 |
| *** rlandy has quit IRC | 01:47 | |
| EmilienM | wow I think my patch was useful | 01:48 |
| EmilienM | mwhahaha: https://bugs.launchpad.net/tripleo/+bug/1664418/comments/6 | 01:50 |
| openstack | Launchpad bug 1664418 in tripleo "HA deployments taking close to the CI timeout" [High,Triaged] | 01:50 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 01:52 |
| mwhahaha | Interesting | 01:52 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 01:53 |
| EmilienM | mwhahaha: another attempt to reduce time of deployment ^ | 01:53 |
| EmilienM | mwhahaha: 2h00 for ovb-ha is not too bad, isn't? | 01:53 |
| mwhahaha | We should improve logging so we can capture this stuff and analyze it better. I bet there is a bunch of these types of things we could tweak to improve | 01:57 |
| *** jjung has joined #tripleo | 01:57 | |
| EmilienM | mwhahaha: we have to admit we have a bunch of _config resources in puppet catalog, and it keeps increased more and more after releases, ie: puppet-oslo, etc | 01:58 |
| mwhahaha | But config resources are cheap in comparison to some things like the openstack service interacting providers | 01:59 |
| EmilienM | mwhahaha: should we noop service providers after they are managed in a step? | 02:00 |
| mwhahaha | Keystone_*, neutron_* etc | 02:00 |
| EmilienM | I find it dangerous tbh | 02:00 |
| mwhahaha | I would not noop them | 02:01 |
| mwhahaha | But we should work on defining when things should run in what step | 02:01 |
| mwhahaha | Or be able to define ordering in THT for some stuff | 02:02 |
| EmilienM | mwhahaha: I agree though we should do that in Pike, maybe i can create a blueprint or something | 02:02 |
| EmilienM | mwhahaha: what I'm doing now is taking the risk to inject a regression just before a release with the hope to save time during the deployment | 02:02 |
| *** dsariel has quit IRC | 02:09 | |
| *** jjung has quit IRC | 02:14 | |
| *** fzdarsky_ has joined #tripleo | 02:15 | |
| *** fzdarsky has quit IRC | 02:18 | |
| EmilienM | owalsh_sick: http://logs.openstack.org/16/434016/2/check/gate-tripleo-ci-centos-7-nonha-multinode/c9f5ada/console.html#_2017-02-15_02_20_20_102459 | 02:22 |
| EmilienM | owalsh_sick: I think we hit it a lot now | 02:22 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 02:26 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/tripleo-ci master: Fix to use correct config options for ssh user https://review.openstack.org/434026 | 02:26 |
| *** mhenkel_ has quit IRC | 02:45 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-quickstart master: WIP: Added DPDK config to create networks to host tenant as DPDK https://review.openstack.org/432997 | 02:47 |
| *** mhenkel_ has joined #tripleo | 02:47 | |
| *** mhenkel_ has quit IRC | 02:51 | |
| *** ramishra has joined #tripleo | 02:53 | |
| *** bkopilov has quit IRC | 02:56 | |
| *** bkopilov_ has quit IRC | 02:57 | |
| *** yamahata has quit IRC | 03:00 | |
| *** mhenkel_ has joined #tripleo | 03:01 | |
| *** artom_ has joined #tripleo | 03:01 | |
| *** CaptTofu_ has joined #tripleo | 03:04 | |
| *** ansiwen_ has joined #tripleo | 03:05 | |
| *** slagle_ has joined #tripleo | 03:06 | |
| *** axisys_ has joined #tripleo | 03:06 | |
| *** remix_auei has joined #tripleo | 03:06 | |
| *** zb has joined #tripleo | 03:06 | |
| *** cinerama` has joined #tripleo | 03:07 | |
| *** ramishra_ has joined #tripleo | 03:07 | |
| *** CaptTofu has quit IRC | 03:07 | |
| *** slagle has quit IRC | 03:07 | |
| *** ramishra has quit IRC | 03:07 | |
| *** leanderthal|afk has quit IRC | 03:07 | |
| *** apetrich has quit IRC | 03:07 | |
| *** zaneb has quit IRC | 03:07 | |
| *** ansiwen has quit IRC | 03:07 | |
| *** bswartz has quit IRC | 03:07 | |
| *** cinerama has quit IRC | 03:07 | |
| *** axisys has quit IRC | 03:07 | |
| *** artom has quit IRC | 03:07 | |
| *** remix_tj has quit IRC | 03:07 | |
| *** shadower has quit IRC | 03:07 | |
| *** leanderthal|afk has joined #tripleo | 03:07 | |
| *** apetrich has joined #tripleo | 03:08 | |
| *** isq has quit IRC | 03:15 | |
| *** jaosorior has joined #tripleo | 03:19 | |
| *** saneax-_-|AFK is now known as saneax | 03:20 | |
| *** saneax is now known as saneax-_-|AFK | 03:22 | |
| jaosorior | beekneemech: stilla round? | 03:23 |
| *** isq has joined #tripleo | 03:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Deploy WSGI apps at the same step (3) https://review.openstack.org/434016 | 03:36 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add Ceph RGW to capabilities map https://review.openstack.org/433590 | 03:36 |
| jaosorior | EmilienM: shouldn't the starting of the services have a dependency now on the syncdb? | 03:36 |
| openstackgerrit | Merged openstack/instack-undercloud master: Fix insufficient memory error message https://review.openstack.org/434002 | 03:39 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job https://review.openstack.org/427481 | 03:45 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin) https://review.openstack.org/427482 | 03:45 |
| openstackgerrit | Merged openstack/tripleo-docs master: Update overcloud node specs https://review.openstack.org/433933 | 03:52 |
| EmilienM | jaosorior: not sure why | 03:58 |
| *** tzumainn has quit IRC | 04:01 | |
| *** nmathew has joined #tripleo | 04:02 | |
| *** psahoo has joined #tripleo | 04:07 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Reduce required memory check to 7.5GB https://review.openstack.org/434014 | 04:13 |
| *** bkopilov_ has joined #tripleo | 04:17 | |
| *** bkopilov has joined #tripleo | 04:19 | |
| jaosorior | EmilienM: cause the db must be ran before the services are started. | 04:19 |
| jaosorior | well, at least it should be ran before httpd | 04:19 |
| *** dsneddon_ has quit IRC | 04:23 | |
| *** sasha2 has quit IRC | 04:26 | |
| *** yamahata has joined #tripleo | 04:31 | |
| *** links has joined #tripleo | 04:34 | |
| *** udesale has joined #tripleo | 04:51 | |
| *** sudipto has joined #tripleo | 05:13 | |
| *** sudipto_ has joined #tripleo | 05:13 | |
| *** prateek has joined #tripleo | 05:20 | |
| *** fragatina has quit IRC | 05:37 | |
| *** skramaja has joined #tripleo | 05:38 | |
| jaosorior | stevebaker: around? | 05:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Declare variables for freeipa_setup.sh script https://review.openstack.org/434080 | 05:52 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/426863 | 05:53 |
| *** ramishra_ has quit IRC | 05:58 | |
| *** ramishra has joined #tripleo | 06:00 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for RabbitMQ https://review.openstack.org/327482 | 06:00 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Pass hieradata for internal TLS for RabbitMQ https://review.openstack.org/409143 | 06:00 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ https://review.openstack.org/426307 | 06:00 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Handle service upgrades correctly when enable_telemetry=false https://review.openstack.org/433824 | 06:02 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ https://review.openstack.org/426307 | 06:04 |
| *** fragatina has joined #tripleo | 06:09 | |
| *** pgadiya has joined #tripleo | 06:13 | |
| *** pcaruana has joined #tripleo | 06:20 | |
| *** dsariel has joined #tripleo | 06:27 | |
| *** jaganathan has joined #tripleo | 06:36 | |
| *** hjensas has joined #tripleo | 06:38 | |
| *** hjensas has joined #tripleo | 06:38 | |
| *** saneax-_-|AFK is now known as saneax | 06:39 | |
| *** iranzo has joined #tripleo | 06:44 | |
| *** rcernin has joined #tripleo | 07:07 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Don't output the PublicVip separately to /etc/hosts https://review.openstack.org/434105 | 07:16 |
| *** abehl has joined #tripleo | 07:21 | |
| *** cmyster has quit IRC | 07:22 | |
| *** jprovazn has joined #tripleo | 07:25 | |
| *** cmyster has joined #tripleo | 07:26 | |
| *** cmyster has quit IRC | 07:26 | |
| *** cmyster has joined #tripleo | 07:26 | |
| *** jtomasek has joined #tripleo | 07:27 | |
| *** jtomasek_ has joined #tripleo | 07:27 | |
| *** tesseract has joined #tripleo | 07:31 | |
| *** jtomasek has quit IRC | 07:32 | |
| therve | http://logs.openstack.org/91/433091/6/gate/gate-tripleo-ci-centos-7-nonha-multinode/8a5f4a8/console.html#_2017-02-14_23_50_29_690217 is the strangest error... | 07:39 |
| *** saibarspeis has joined #tripleo | 07:39 | |
| therve | Is REQUIRED_MB tweaked somewhere? | 07:39 |
| therve | Oh it changed last night, sorry | 07:42 |
| *** tremble has joined #tripleo | 07:43 | |
| *** jtomasek_ is now known as jtomasek | 07:45 | |
| jaosorior | it did | 07:48 |
| jaosorior | therve: fuck, is that failing in CI? | 07:48 |
| therve | jaosorior, A last night build | 07:49 |
| therve | Hopefully it's working now :) | 07:49 |
| jaosorior | therve: ok, let me know if you run into that again | 07:49 |
| therve | Sure, thanks | 07:49 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update DeploymentPlan page node counts https://review.openstack.org/433449 | 07:50 |
| *** mhenkel_ has quit IRC | 07:52 | |
| *** karimb has joined #tripleo | 07:53 | |
| *** rasca has joined #tripleo | 07:56 | |
| *** saneax is now known as saneax-_-|AFK | 07:58 | |
| *** stendulker has joined #tripleo | 08:00 | |
| *** jlinkes has joined #tripleo | 08:02 | |
| *** nmathew has quit IRC | 08:10 | |
| *** amoralej|off is now known as amoralej | 08:12 | |
| *** ealcaniz has joined #tripleo | 08:12 | |
| *** athomas has joined #tripleo | 08:14 | |
| *** fragatina has quit IRC | 08:21 | |
| *** ccamacho|Zzz is now known as ccamacho | 08:21 | |
| *** aufi has joined #tripleo | 08:22 | |
| *** leanderthal|afk is now known as leanderthal | 08:23 | |
| leanderthal | o/ | 08:23 |
| jaosorior | o/ | 08:23 |
| *** paramite has joined #tripleo | 08:24 | |
| *** shardy has joined #tripleo | 08:24 | |
| jaosorior | ccamacho: hey dude, could you check this out https://review.openstack.org/#/c/434080/ ? | 08:27 |
| *** ipsecguy has joined #tripleo | 08:28 | |
| ccamacho | hey jaosorior morning man! | 08:28 |
| ccamacho | sure | 08:28 |
| jaosorior | ccamacho: how are you feeling dude? | 08:28 |
| jaosorior | I remember you were feeling quite sick in the beginning of the week | 08:28 |
| jtomasek | d0ugal: hi, I am getting "Error rendering template puppet/post-upgrade.yaml : puppet-steps.j2" when creating plan from latest THT | 08:29 |
| d0ugal | nice :) | 08:29 |
| jtomasek | d0ugal: have you seen that? | 08:29 |
| d0ugal | jtomasek: latest THT = master or packages? | 08:29 |
| jtomasek | haha | 08:29 |
| jtomasek | master | 08:29 |
| d0ugal | jtomasek: I have not seen it, but I've not deployed for ~10 days | 08:30 |
| jtomasek | d0ugal: it does not happen from packages (default plan in undercloud I've installed yesterday) | 08:30 |
| d0ugal | jtomasek: do you have the full traceback? executor log file. | 08:30 |
| jtomasek | d0ugal: I'll check, mistral, right? | 08:30 |
| d0ugal | jtomasek: yeah | 08:30 |
| d0ugal | /var/log/mistral/executor.log or something | 08:30 |
| jtomasek | d0ugal: http://paste.openstack.org/show/598959/ | 08:32 |
| bandini | morning | 08:32 |
| *** nmathew has joined #tripleo | 08:32 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix quickstart issues https://review.openstack.org/425459 | 08:32 |
| *** sshnaidm|off is now known as sshnaidm | 08:32 | |
| jtomasek | d0ugal: hrm, give me a sec, this is the error when fetching parameters, I'll search for one happening when creating the plan as it probably affects this one | 08:33 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix quickstart issues https://review.openstack.org/425459 | 08:34 |
| d0ugal | jtomasek: that error logging is terrible. | 08:34 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras master: Implement overcloud sanity checks role https://review.openstack.org/429716 | 08:35 |
| d0ugal | it doesn't log the original exception :( | 08:35 |
| ccamacho | jaosorior much better thanks :) | 08:35 |
| d0ugal | jtomasek: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/templates.py#L122 | 08:35 |
| d0ugal | jtomasek: if that is changed to LOG.exception(error_msg) we would have more info. | 08:36 |
| shardy | d0ugal: I was meaning to mention this a couple of weeks back - there are common errors such as j2 rendering problems which get obfuscated by mistral atm | 08:36 |
| *** links has quit IRC | 08:36 | |
| shardy | the root cause is always in the executor log but the CLI error tells you not much | 08:37 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Ansible role for built packages install https://review.openstack.org/426869 | 08:37 |
| shardy | perhaps we can raise a bug with some reproducers of similar issues and work on improving that in the actions | 08:37 |
| d0ugal | shardy: yeah, it is because the action raises a plain exception with the message "Error rendering template puppet/post-upgrade.yaml : puppet-steps.j2" :) | 08:37 |
| ccamacho | jaosorior shouldnt be export Hostname=${Hostname:-""} instead of export Hostname=${Hostname-""} from the exports? Notice the ':' | 08:38 |
| shardy | d0ugal: ah, hopefully an easy fix then :) | 08:38 |
| d0ugal | jtomasek, shardy - so that particular error is probably here? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/post-upgrade.j2.yaml#L27 | 08:38 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs https://review.openstack.org/413224 | 08:39 |
| d0ugal | no idea actually, maybe that means it is in the included file. | 08:39 |
| d0ugal | I'll try and improve the error. | 08:39 |
| shardy | d0ugal: yeah probably - there was an update to the process templates action which supports j2 includes | 08:39 |
| d0ugal | ah | 08:39 |
| shardy | my guess is jtomasek doesn't have the latest action | 08:39 |
| jtomasek | d0ugal: I think the error I've pasted is caused by non existence of that file in the swift | 08:39 |
| shardy | then the include will break] | 08:39 |
| jaosorior | ccamacho: you're right | 08:40 |
| d0ugal | jtomasek: it sounds like it is because your tht is newer than your tripleo-common :) | 08:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Declare variables for freeipa_setup.sh script https://review.openstack.org/434080 | 08:40 |
| ccamacho | jaosorior cool :) | 08:40 |
| *** b00tcat has joined #tripleo | 08:40 | |
| *** b00tcat has quit IRC | 08:40 | |
| *** b00tcat has joined #tripleo | 08:40 | |
| jtomasek | d0ugal: which is a bug caused by UI most probably. I've just tried to create plan using other method (tar) and it worked | 08:40 |
| shardy | jtomasek: do you have https://review.openstack.org/#/c/425220/ ? | 08:40 |
| shardy | jtomasek: but yeah if the referenced file isn't in swift, that new logic won't work either :) | 08:41 |
| *** jlinkes has quit IRC | 08:42 | |
| jtomasek | d0ugal, shardy: I'll dig furhter and let you know if I find out anything else, but it is most probably GUI bug | 08:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/426863 | 08:42 |
| shardy | jtomasek: ack, sounds good, thanks! | 08:42 |
| *** saneax-_-|AFK is now known as saneax | 08:43 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Compress logs to tar.gz archive https://review.openstack.org/434143 | 08:43 |
| jtomasek | d0ugal: btw. I've hit this several times yesterday http://paste.openstack.org/show/598961/ | 08:43 |
| jtomasek | d0ugal: it seems like some actions don't support this entirely. I think it was nodes assignment workflow I hit that. I'll let you know when I isolate it better | 08:44 |
| d0ugal | jtomasek: that error is expected | 08:44 |
| d0ugal | jtomasek: I know it is weird :) | 08:44 |
| d0ugal | jtomasek: If a workflow sends a Zaqar message with the status "ERROR" it marks itself as failed. | 08:45 |
| d0ugal | which makes it clearer in mistral what did and didn't work | 08:45 |
| d0ugal | but the actual error that Mistral outputs is confusing | 08:46 |
| jtomasek | d0ugal: aha, I thought that error is happening because FailAction action did not receive a proper input (an exception) | 08:46 |
| *** jpena|away is now known as jpena | 08:46 | |
| d0ugal | jtomasek: lol, I can see why you would think that | 08:47 |
| jtomasek | :) | 08:47 |
| d0ugal | what it means is "Action failed. This exception is expected) | 08:47 |
| d0ugal | " | 08:47 |
| shardy | jtomasek: Hey, unrelated question - do we use any js libraries which support canvas operations (in particular path intersection for drag-and-drop topology designer type things)? | 08:47 |
| d0ugal | Maybe I will try and change it to that. | 08:47 |
| *** jpich has joined #tripleo | 08:48 | |
| d0ugal | that sounds fancy :) | 08:48 |
| jtomasek | shardy: not yet | 08:48 |
| shardy | jtomasek: I've got a non-tripleo use-case that needs it, but I was wondering about poking at the UI code a little and wanted to try to use same/similar libraries if possible | 08:48 |
| jtomasek | shardy: why? | 08:48 |
| shardy | jtomasek: I've got a side project that needs it, which is kinda similar to a template/network designer UI | 08:48 |
| *** karimb has quit IRC | 08:48 | |
| jtomasek | shardy: it usually depends on the framework used | 08:49 |
| jtomasek | we're using Reactjs | 08:49 |
| shardy | jtomasek: thanks, I'll try to find some time to look into it :) | 08:50 |
| jtomasek | shardy: this is a good source of existing solutions (for ReactJS) https://github.com/enaqx/awesome-react | 08:51 |
| shardy | jtomasek: nice, thanks! | 08:52 |
| *** links has joined #tripleo | 08:52 | |
| *** b00tcat has quit IRC | 08:53 | |
| *** b00tcat has joined #tripleo | 08:53 | |
| *** b00tcat has quit IRC | 08:53 | |
| *** b00tcat has joined #tripleo | 08:53 | |
| *** cylopez has joined #tripleo | 08:55 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-docs master: WIP: Containerized TripleO architecture https://review.openstack.org/430200 | 08:58 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-docs master: WIP: Containerized TripleO Development tips/tricks https://review.openstack.org/430201 | 08:58 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-docs master: WIP: Containerized Undercloud https://review.openstack.org/430199 | 08:58 |
| *** zzzeek has quit IRC | 09:00 | |
| *** jpena is now known as jpena|away | 09:00 | |
| *** zzzeek has joined #tripleo | 09:00 | |
| *** jeckersb_gone has quit IRC | 09:00 | |
| *** jayg|g0n3 has quit IRC | 09:00 | |
| *** jlinkes has joined #tripleo | 09:01 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Setup FreeIPA to serve DNS in the setup script https://review.openstack.org/434151 | 09:01 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job https://review.openstack.org/427481 | 09:02 |
| *** radez has quit IRC | 09:05 | |
| d0ugal | is docs.openstack.org having issues? | 09:06 |
| *** jpena|away is now known as jpena | 09:07 | |
| jtomasek | shardy, d0ugal: ok, so the bug happens because puppet/puppet-steps.j2 is only file without '.yaml' suffix. It probably should be named puppet-steps.j2.yaml? when creating plan, GUI is excluding any non .yaml, .pp, .json, .sh files | 09:07 |
| jtomasek | I am going to file a GUI bug to include j2 files which will fix it | 09:07 |
| d0ugal | aha | 09:08 |
| shardy | jtomasek: No it can't be j2.yaml as we try to render all files with that extension | 09:09 |
| shardy | jtomasek: the .j2 files are fragments intended to be used only via includes | 09:09 |
| jtomasek | shardy: I see, is this the only case so far? | 09:09 |
| shardy | jtomasek: yes it was added only recently as part of the composable upgrades work, to reduce some template duplication | 09:10 |
| shardy | I expect we'll use the same approach again in future | 09:10 |
| jtomasek | shardy: thanks for clarification! pretty cool. I'll fix it in GUI | 09:10 |
| *** agurenko has joined #tripleo | 09:10 | |
| *** lucas-afk is now known as lucasagomes | 09:10 | |
| shardy | jtomasek: ack, thanks! | 09:10 |
| *** panda|zZ is now known as panda | 09:11 | |
| *** tobias-fiberdata has joined #tripleo | 09:13 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin) https://review.openstack.org/427482 | 09:13 |
| *** gfidente has joined #tripleo | 09:13 | |
| *** gfidente has quit IRC | 09:13 | |
| *** gfidente has joined #tripleo | 09:13 | |
| *** nyechiel has joined #tripleo | 09:14 | |
| *** karimb has joined #tripleo | 09:15 | |
| *** tobias_fiberdata has quit IRC | 09:17 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Include j2 files in plan creation https://review.openstack.org/434161 | 09:19 |
| *** links has quit IRC | 09:26 | |
| *** chem has quit IRC | 09:29 | |
| *** chem has joined #tripleo | 09:29 | |
| *** dtantsur|afk is now known as dtantsur | 09:33 | |
| *** ipsecguy has quit IRC | 09:34 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 09:35 |
| snecklifter | shardy: on a scale of never to definitely, chances of getting https://bugs.launchpad.net/tripleo/+bug/1651541 backported? | 09:36 |
| openstack | Launchpad bug 1651541 in tripleo "Custom network names prevent deployment" [High,In progress] - Assigned to Steven Hardy (shardy) | 09:36 |
| snecklifter | to newton | 09:37 |
| *** nmathew has quit IRC | 09:39 | |
| *** nmathew has joined #tripleo | 09:39 | |
| *** links has joined #tripleo | 09:42 | |
| *** dsariel has quit IRC | 09:43 | |
| *** suuuper has joined #tripleo | 09:46 | |
| shardy | snecklifter: it's possible, but the patches were a little large/risky | 09:50 |
| shardy | snecklifter: I've been waiting on reviews for https://review.openstack.org/#/c/413626/ for a while, will chase that | 09:51 |
| shardy | then we can figure out if a backport if reasonable | 09:51 |
| shardy | snecklifter: have you confirmed the patches I posted fix your problem? | 09:51 |
| *** ckyriaki has joined #tripleo | 09:52 | |
| shardy | snecklifter: as a starting point I've cherry-picked https://review.openstack.org/#/c/434185/ which is a related heat fix | 09:53 |
| *** dsariel has joined #tripleo | 09:54 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the builtin Mistral engine command 'fail' when failing workflows https://review.openstack.org/425047 | 09:55 |
| snecklifter | shardy: ok thanks, no not tested, its not a hard requirement but we are putting in production soon so thought I'd ask | 09:55 |
| shardy | snecklifter: Ok, if you have a test env where you could apply the patches and provide review feedback that would be helpful | 09:56 |
| *** akrivoka has joined #tripleo | 09:56 | |
| shardy | snecklifter: I did local testing but couldn't be 100% sure I'd solved your issue | 09:56 |
| shardy | snecklifter: I'll chase up landing the remaining patch to master then we can look at a backport | 09:57 |
| snecklifter | shardy: sure, I'll see if I can test and get back to you later today, thanks for response | 09:57 |
| *** ckyriaki is now known as ckyriakidou | 09:57 | |
| *** ckyriakidou has quit IRC | 09:58 | |
| *** ckyriakidou has joined #tripleo | 09:58 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the builtin Mistral engine command 'fail' when failing workflows https://review.openstack.org/425047 | 10:00 |
| *** salmankhan has joined #tripleo | 10:01 | |
| *** mcornea has joined #tripleo | 10:01 | |
| *** chem has quit IRC | 10:01 | |
| *** chem has joined #tripleo | 10:02 | |
| *** hewbrocca_afk is now known as hewbrocca | 10:03 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the builtin Mistral engine command 'fail' when failing workflows https://review.openstack.org/425047 | 10:04 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the builtin Mistral engine command 'fail' when failing workflows https://review.openstack.org/425047 | 10:06 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart-extras master: Add disk root device hints https://review.openstack.org/433691 | 10:08 |
| *** dtantsur is now known as dtantsur|bbl | 10:10 | |
| *** udesale has quit IRC | 10:15 | |
| *** remix_auei is now known as remix_tj | 10:20 | |
| *** yamahata has quit IRC | 10:20 | |
| *** Lokesh_Jain_ has quit IRC | 10:23 | |
| *** owalsh_sick has quit IRC | 10:23 | |
| *** owalsh_sick has joined #tripleo | 10:34 | |
| openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo master: Enable languages in UI config https://review.openstack.org/432328 | 10:35 |
| *** salmankhan has quit IRC | 10:39 | |
| *** limao has quit IRC | 10:42 | |
| *** tosky has joined #tripleo | 10:43 | |
| *** limao has joined #tripleo | 10:43 | |
| *** owalsh_sick is now known as owalsh_afk | 10:43 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Remove hardcoded instances of `stack` from roles https://review.openstack.org/421463 | 10:44 |
| *** limao has quit IRC | 10:47 | |
| *** zoli is now known as zoli|lunch | 10:52 | |
| *** nmathew has quit IRC | 10:56 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 10:56 |
| snecklifter | shardy: http://paste.openstack.org/show/598988/ | 10:58 |
| snecklifter | shardy: might just be me not applying patches correctly | 10:58 |
| snecklifter | had to manually apply one hunk as its OSP 10 | 10:58 |
| shardy | snecklifter: looks like you're missing the heat patch I linked earlier@ | 10:58 |
| snecklifter | shardy: ah ok, didnt realise I needed that too | 10:58 |
| shardy | http://paste.openstack.org/show/598988 | 10:58 |
| snecklifter | will retest | 10:58 |
| shardy | snecklifter: Yeah you'll need ^^ | 10:58 |
| shardy | hopefully we can get that reviewed then it'll be in packages soon | 10:59 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 11:00 |
| *** athomas has quit IRC | 11:00 | |
| *** sudipto_ has quit IRC | 11:01 | |
| *** sudipto has quit IRC | 11:01 | |
| *** chem has quit IRC | 11:04 | |
| *** dtantsur|bbl is now known as dtantsur | 11:05 | |
| *** salmankhan has joined #tripleo | 11:05 | |
| *** chem has joined #tripleo | 11:05 | |
| *** stendulker has quit IRC | 11:06 | |
| lhinds | anyone with an undercloud built from a recent master check this for me: | 11:08 |
| lhinds | [stack@undercloud tmp]$ ls -lart|grep profiledir | grep wc -l | 11:08 |
| *** athomas has joined #tripleo | 11:08 | |
| lhinds | I have 202555 profiledirs created by DIB `PROFILE_DIR=$(mktemp -d --tmpdir profiledir.XXXXXX)` | 11:09 |
| lhinds | or better still: ls|grep profiledir | wc -l | 11:09 |
| lhinds | you don't need -lart | 11:09 |
| *** jjung has joined #tripleo | 11:11 | |
| *** nyechiel has quit IRC | 11:14 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Make the DB URIs host-independent for all services https://review.openstack.org/431425 | 11:16 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Deploy the undercloud with Heat https://review.openstack.org/351351 | 11:17 |
| shardy | lhinds: that's weird, I only see one profiledir.xxx file in /home/stack/tmp | 11:20 |
| shardy | You've not built 202555 images have you?! ;) | 11:20 |
| *** jayg|g0n3 has joined #tripleo | 11:20 | |
| *** jayg|g0n3 has quit IRC | 11:24 | |
| *** jayg|g0n3 has joined #tripleo | 11:24 | |
| *** suuuper has quit IRC | 11:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Install requirements with pip update https://review.openstack.org/434226 | 11:26 |
| *** jkilpatr has quit IRC | 11:35 | |
| *** agurenko_ has joined #tripleo | 11:38 | |
| *** agurenko has quit IRC | 11:39 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: teardown: wait longer for processes to exit https://review.openstack.org/426205 | 11:41 |
| ccamacho | hey shardy, do you mind if I add the step0 validation for the mistral services in https://review.openstack.org/#/c/428711 ?? | 11:41 |
| ccamacho | shardy, this one sorry https://review.openstack.org/#/c/405246/ | 11:42 |
| shardy | ccamacho: sure, but note we probably won't land that until after pike opens | 11:42 |
| ccamacho | shardy yeahp but for at least have it finished | 11:43 |
| shardy | ccamacho: ack, sounds good, thanks! | 11:43 |
| snecklifter | shardy: same error http://paste.openstack.org/show/598988 | 11:43 |
| snecklifter | after applying heat patch | 11:44 |
| shardy | snecklifter: hmm, and heat-engine was definitely restarted? | 11:44 |
| snecklifter | haha, no | 11:44 |
| snecklifter | ok, trying again | 11:44 |
| shardy | :) | 11:44 |
| *** paramite has quit IRC | 11:45 | |
| *** paramite has joined #tripleo | 11:45 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Setup FreeIPA to serve DNS in the setup script https://review.openstack.org/434151 | 11:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job https://review.openstack.org/427481 | 11:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin) https://review.openstack.org/427482 | 11:50 |
| *** suuuper has joined #tripleo | 11:51 | |
| *** jkilpatr has joined #tripleo | 11:53 | |
| jaosorior | bandini: hey dude, can you check this https://review.openstack.org/#/c/434080/ ? | 11:54 |
| *** adarazs is now known as adarazs_lunch | 11:55 | |
| bandini | jaosorior: yessir. isn't it woefully late for you? or are you back in .fi? | 11:56 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add removed wait_for script to validate role https://review.openstack.org/434239 | 11:56 |
| jaosorior | bandini: back in Finland | 11:57 |
| jaosorior | bandini: but if I was in Mexico it would be woefully early :P | 11:58 |
| bandini | ahaha right | 11:58 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix quickstart issues https://review.openstack.org/425459 | 12:00 |
| jaosorior | bandini: anyway, yeah, back to Finland. time to get on a diet after all the rampant eating I did | 12:01 |
| bandini | jaosorior: ahahaha. I booked my flight to .mx for this summer \o/ | 12:01 |
| jaosorior | niiiice | 12:01 |
| jaosorior | bandini: I suggest you preemptively loose weight before that trip :P | 12:02 |
| bandini | rotfl | 12:02 |
| *** lucasagomes is now known as lucas-hungry | 12:04 | |
| *** ansmith has joined #tripleo | 12:05 | |
| EmilienM | hello | 12:06 |
| bandini | lo EmilienM | 12:06 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Add mistral service support for composable upgrades https://review.openstack.org/405246 | 12:06 |
| jaosorior | EmilienM: sup dude | 12:06 |
| EmilienM | bandini: hey, look https://review.openstack.org/#/c/433954/1 and https://review.openstack.org/#/c/434016/4 | 12:06 |
| EmilienM | bandini: just experimenting now | 12:07 |
| *** bogdando has joined #tripleo | 12:09 | |
| bandini | EmilienM: ack I will try the second one and see if it solves the restarting httpd stuff | 12:09 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add removed wait_for script to validate role https://review.openstack.org/434239 | 12:09 |
| bandini | EmilienM: somehow I'd still wish we find a way to have puppet-apache be a bit smarter. I'll need to think about that a bit | 12:10 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add removed wait_for script to validate role https://review.openstack.org/434239 | 12:11 |
| EmilienM | bandini: the first one is I think good to go, the second one with wsgi needs more work imho, jaosorior did a review already | 12:12 |
| *** bkopilov_ has quit IRC | 12:13 | |
| *** bkopilov has quit IRC | 12:13 | |
| *** ansmith has quit IRC | 12:16 | |
| *** ebarrera has joined #tripleo | 12:25 | |
| *** karimb has quit IRC | 12:27 | |
| EmilienM | flaper87: can you look at the issues on the container job please? | 12:27 |
| EmilienM | https://review.openstack.org/#/c/433954/ | 12:28 |
| *** liverpooler has quit IRC | 12:29 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: Add converge update to major upgrade test https://review.openstack.org/434250 | 12:29 |
| *** pkovar has joined #tripleo | 12:31 | |
| *** bogdando has quit IRC | 12:33 | |
| *** dbecker has joined #tripleo | 12:36 | |
| *** psahoo has quit IRC | 12:37 | |
| openstackgerrit | Karthik S proposed openstack/os-net-config master: WIP: Restart Openvswitch after adding DPDK ports https://review.openstack.org/434255 | 12:39 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 12:40 |
| *** zoli|lunch is now known as zoli | 12:41 | |
| *** bfournie has quit IRC | 12:41 | |
| *** panda is now known as panda|lunch | 12:44 | |
| *** dbecker has quit IRC | 12:45 | |
| jaosorior | anybody seen this before? | 12:47 |
| jaosorior | ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Cannot attach VIF 3631a576-3d6e-4a34-ad62-cf23a7d9c521 to the | 12:47 |
| jaosorior | node feed2670-4abe-4e85-8b46-7c23d20f25e1 | 12:47 |
| *** limao has joined #tripleo | 12:48 | |
| jaosorior | dtantsur: ^^ | 12:48 |
| dtantsur | I haven't; it may be an outcome of recent refactorings - drop by #openstack-ironic | 12:48 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix quickstart issues https://review.openstack.org/425459 | 12:52 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Add i18n to Register Nodes form https://review.openstack.org/434259 | 12:54 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Add i18n to Nodes table https://review.openstack.org/433179 | 12:56 |
| *** morazi has joined #tripleo | 12:58 | |
| *** dbecker has joined #tripleo | 12:58 | |
| *** adarazs_lunch is now known as adarazs | 12:59 | |
| *** salmankhan has quit IRC | 13:00 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Handle service upgrades correctly when enable_telemetry=false https://review.openstack.org/433824 | 13:02 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Declare variables for freeipa_setup.sh script https://review.openstack.org/434080 | 13:02 |
| *** morazi has quit IRC | 13:03 | |
| jaosorior | jistr: sooo, should I merge it? | 13:03 |
| openstackgerrit | Merged openstack/tripleo-ui master: Add i18n to Notifications https://review.openstack.org/419469 | 13:03 |
| jistr | jaosorior: yea if you could, that'd be great | 13:03 |
| *** trown|outtypewww is now known as trown | 13:04 | |
| jistr | jaosorior: thanks! | 13:05 |
| *** hewbrocca is now known as hewbrocca_afk | 13:05 | |
| slagle_ | EmilienM: has there ever been any work done to make puppet reuse keystone tokens? | 13:05 |
| slagle_ | on my deployment, it's run "openstack token issue" 39 times | 13:06 |
| *** slagle_ is now known as slagle | 13:06 | |
| slagle | that's a 2-3 second operation | 13:06 |
| EmilienM | slagle: not afik | 13:06 |
| EmilienM | slagle: which resource ask for token? | 13:07 |
| EmilienM | Keystone_* ? | 13:07 |
| slagle | EmilienM: it doesnt say in the log | 13:08 |
| slagle | i guess you would have to look at all the context around that command to tell what puppet is actually doing | 13:08 |
| *** lucas-hungry is now known as lucasagomes | 13:09 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-quickstart-extras master: WIP: Added a new role to DPDK customization of the deployment https://review.openstack.org/434261 | 13:11 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-quickstart master: WIP: Added DPDK config to create networks to host tenant as DPDK https://review.openstack.org/432997 | 13:13 |
| *** pgadiya has quit IRC | 13:14 | |
| *** mdnadeem has joined #tripleo | 13:15 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: OVN plugin configuration fixes https://review.openstack.org/397674 | 13:15 |
| EmilienM | slagle: afik we use the admin_token because we don't manage /root/openrc in tripleo (that contains admin creds, etc) | 13:15 |
| *** morazi has joined #tripleo | 13:16 | |
| EmilienM | shardy: I reviewed https://review.openstack.org/#/c/405241/ and it seems ok to me for a first iteration | 13:18 |
| slagle | it seems we use the admin token to issue another token, which is then used just a couple times | 13:18 |
| mdnadeem | :q! | 13:18 |
| *** jcoufal has joined #tripleo | 13:18 | |
| *** bfournie has joined #tripleo | 13:20 | |
| *** fultonj has joined #tripleo | 13:21 | |
| lhinds | shardy: seems they are viewable by root | 13:21 |
| lhinds | ls -la profiledir.Brt7og | 13:21 |
| lhinds | total 8664 | 13:21 |
| lhinds | drwx------. 2 root root 6 Feb 15 17:05 . | 13:21 |
| EmilienM | shardy, marios, matbu : if you can review https://review.openstack.org/#/c/405241 when you have time | 13:22 |
| slagle | i guess the db syncs trigger service restarts? | 13:23 |
| *** sudipto_ has joined #tripleo | 13:23 | |
| *** sudipto has joined #tripleo | 13:23 | |
| EmilienM | slagle: they do but not on the node where db sync ran | 13:24 |
| marios | EmilienM: ack i will do after i finish thing i'm doing | 13:24 |
| EmilienM | slagle: it won't trigger nova-api on another node if dbsync ran in master | 13:24 |
| EmilienM | slagle: that's why we run dbsync at step3 on master and start services on other nodes at step4 | 13:24 |
| slagle | yes, but on update your services are already started | 13:25 |
| slagle | so on update, we db sync and restart the same services 3 times | 13:25 |
| slagle | i dunno, i should probably stop looking at puppet logs | 13:26 |
| EmilienM | slagle: on update, service restart only on master node I think | 13:26 |
| mdnadeem | EmilienM, can you please confirm, if deploying overclod using --templates option without any argument, then is it uses /usr/share/openstack-tripleo-heat-templates/environments/network-environment.yaml file for network setup? | 13:26 |
| EmilienM | slagle: I don't see anything that trigger an restart unless you update config | 13:26 |
| *** fpan_ is now known as fpan | 13:26 | |
| jaosorior | mdnadeem: nope, you have to specify that manually | 13:27 |
| *** panda|lunch is now known as panda | 13:27 | |
| slagle | EmilienM: ok | 13:28 |
| *** spredzy has quit IRC | 13:28 | |
| slagle | EmilienM: couldn't we do the db syncs at single step? | 13:28 |
| mdnadeem | jaosorior, if we dnt specify manually any template file, then which it is bydefault uses for network setup on overcloud node? | 13:28 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-quickstart master: WIP: Added DPDK config to create networks to host tenant as DPDK https://review.openstack.org/432997 | 13:28 |
| EmilienM | slagle: yes, and we should | 13:28 |
| pradk | shardy, fixed the comment https://review.openstack.org/#/c/433824/ | 13:28 |
| mdnadeem | jaosorior, as per this document https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/template_deploy.html, it should uses default template location /usr/share/openstack-tripleo-heat-templates. | 13:29 |
| jaosorior | mdnadeem: well, it will use the default values for those parameters. | 13:30 |
| beagles | mcornea: regarding the postun on openvswitch being related, I'm sure it is in someway just not sure how :) The general idea behind that particular issue was to workaround problems with by the openvswitch upgrades. I clearly needed a break when I wrote that comment | 13:30 |
| jaosorior | mdnadeem: that file you pointed out overwrites the default values | 13:30 |
| beagles | mcornea: because, from what I can remember, because of systemd dependencies if we stop ovs the neutron agent goes with | 13:31 |
| jaosorior | mdnadeem: but yeah, it's correct, that it will use this /usr/share/openstack-tripleo-heat-templates as a default location for the templates | 13:31 |
| mdnadeem | jaosorior, is default value is hard-coded or it is mentioned in some file in default location ? | 13:31 |
| EmilienM | slagle: i'm currently in a mtg but I'll look today all those things | 13:32 |
| beagles | mcornea: I need to double check the packages this morning to see what's on the go | 13:32 |
| mdnadeem | jaosorior, i have used this command: openstack overcloud deploy --templates --control-scale 1 --compute-scale 3 --neutron-tunnel-types vxlan --neutron-network-type vxlan --neutron-public-interface em2 | 13:32 |
| *** jayg|g0n3 is now known as jayg | 13:32 | |
| beagles | mcornea: btw, thanks for letting me on to your test environment! this would have been a nightmare to pinpoint otherwise | 13:32 |
| mdnadeem | jaosorior, but i am not sure, from where it took default value to setup my overcloud network environment. could you please confirm me? i am newbie to overcloud | 13:33 |
| mcornea | beagles: sure, the faster we can get it sorted out the better | 13:33 |
| snecklifter | shardy: http://paste.openstack.org/show/599025/ | 13:33 |
| snecklifter | shardy: looks like its outputting null values or something, the deploy stalls | 13:33 |
| mcornea | beagles: so I see I've got openvswitch-2.6.1-4.1.git20161206.el7.x86_64 installed on the compute node, is this expected version? | 13:34 |
| *** spredzy has joined #tripleo | 13:34 | |
| flaper87 | EmilienM: yes, looking (also on a plane) | 13:34 |
| *** zoli is now known as zoli|brb | 13:34 | |
| beagles | mcornea: yeah, i think so... the versions of everything I checked seemed correct (neutron, ryu, ovs, etc etc) | 13:34 |
| flaper87 | EmilienM: I believe we already have a patch for that issue, though | 13:34 |
| EmilienM | flaper87: you driving the plane? | 13:34 |
| jaosorior | mdnadeem: I'm afraid that's not such a simple question. But basically it will use this https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml for the nested stack definitions. And there you can see the files that are used, so there are the defaults\ | 13:34 |
| EmilienM | flaper87: DON'T STALE, never stale dude: rule #1 | 13:35 |
| jaosorior | mdnadeem: there is no single place where these are defined. | 13:35 |
| EmilienM | flaper87: ok so the patch is not breaking the CI job, right? | 13:35 |
| jaosorior | mdnadeem: why not deploy using tripleo-quickstart? It will make things easier instead of having to figure out all this. If you're doing a small POC | 13:35 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Setup FreeIPA to serve DNS in the setup script https://review.openstack.org/434151 | 13:35 |
| flaper87 | EmilienM: I'll leave the driving to you... someone has to actually code and fix the gate | 13:36 |
| flaper87 | EmilienM: checking again to make sure | 13:36 |
| mdnadeem | jaosorior, Thanks, i need to check it | 13:37 |
| mcornea | beagles: if it helps I can redo the deployment and ping you before starting the compute upgrade. I'm not sure how to reproduce it in other way | 13:37 |
| jaosorior | mdnadeem: sorry that the answer wasn't so simple. But I think quickstart will be useful if you wanna start checking this out. | 13:38 |
| flaper87 | EmilienM: so yeah, that patch is not breaking the containers job | 13:38 |
| flaper87 | some other patch did | 13:38 |
| EmilienM | flaper87: ack, thx. Safe travel man | 13:38 |
| mdnadeem | jaosorior, yah, i will try quickstart. | 13:38 |
| *** bswartz has joined #tripleo | 13:39 | |
| mdnadeem | jaosorior++ | 13:39 |
| flaper87 | EmilienM: won't stale | 13:39 |
| beagles | mcornea: we might want to get some nova eyes on this since it is hanging in the systemctl try-restart in it's postun as the internal_api is down. I'm not sure that we want our services to be that sensitive (even if there isn't much nova can do withot an internal-api network) | 13:39 |
| *** jpena is now known as jpena|lunch | 13:39 | |
| *** rlandy has joined #tripleo | 13:40 | |
| beagles | mcornea: I added another comment to that bug. It would be cool if we can hold onto that system for a little while longer in case someone else needs to look at it, but don't let keeping it hold you up. Maybe if you need to recycle it, could you capture the nova, openvswitch and neutron logs as well as /var/log/messages? | 13:44 |
| *** bkopilov_ has joined #tripleo | 13:45 | |
| *** ebarrera has quit IRC | 13:45 | |
| mcornea | beagles: ok, I'll add the logs and have another environment preapred for debugging this specific issue. | 13:46 |
| *** rhallisey has joined #tripleo | 13:46 | |
| beagles | mcornea: thanks man! | 13:46 |
| mcornea | beagles: thank you for the support :) | 13:46 |
| *** bkopilov has joined #tripleo | 13:47 | |
| beagles | mcornea: thanks for the report and info!!!! | 13:47 |
| *** rhallisey has quit IRC | 13:52 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add HorizontalNumberInput https://review.openstack.org/434282 | 13:55 |
| *** amoralej is now known as amoralej|lunch | 13:56 | |
| *** fultonj has quit IRC | 13:56 | |
| *** fultonj has joined #tripleo | 13:57 | |
| *** limao_ has joined #tripleo | 13:57 | |
| *** limao has quit IRC | 13:57 | |
| *** morazi has quit IRC | 13:58 | |
| *** sasha2 has joined #tripleo | 13:59 | |
| paramite | EmilienM, Hey Emilien, what HW resources are used for OVB scenarios? | 14:00 |
| *** zoli|brb is now known as zoli | 14:01 | |
| EmilienM | paramite: rh1 | 14:01 |
| arxcruz | EmilienM: hey, I found the reason that all metadefinition tests in http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq/7a5f97a/logs/oooq/collected_logs/stackviz/#/stdin is failing | 14:02 |
| arxcruz | EmilienM: it's because it's missing to call glance-manage db_load_metadefs command | 14:02 |
| arxcruz | I wondering where should I open the bug, puppet-tripleo ? | 14:03 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/tripleo-docs master: Add some documentation about VirtualBMC and pxe_ipmitool https://review.openstack.org/434286 | 14:03 |
| *** karimb has joined #tripleo | 14:04 | |
| *** morazi has joined #tripleo | 14:06 | |
| *** Goneri has joined #tripleo | 14:08 | |
| *** rhallisey has joined #tripleo | 14:08 | |
| *** ealcaniz has quit IRC | 14:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Containers: Add required EndpointMap parameter https://review.openstack.org/433655 | 14:08 |
| *** trown is now known as trown|brb | 14:08 | |
| *** jcoufal_ has joined #tripleo | 14:10 | |
| *** jcoufal has quit IRC | 14:11 | |
| *** morazi has quit IRC | 14:11 | |
| b00tcat | hi, I accidentally deleted my overcloudrc file from my home folder, is there any way to rebuild it? | 14:12 |
| *** jcoufal has joined #tripleo | 14:12 | |
| *** ansmith has joined #tripleo | 14:14 | |
| adarazs | arxcruz: open it on tripleo launchpad and somebody will let you know if that's not the right place. :) | 14:14 |
| arxcruz | adarazs: okay :) | 14:14 |
| *** jcoufal_ has quit IRC | 14:14 | |
| sshnaidm | jaosorior, hi, do you use your baremetal_ozz on dev env? | 14:14 |
| jaosorior | sshnaidm: rh1? | 14:15 |
| sshnaidm | jaosorior, yep | 14:15 |
| b00tcat | disregard my doubt, I just found there was `/usr/bin/instack-create-overcloudrc` | 14:15 |
| jaosorior | sshnaidm: I've been trying to use it to set up a containers based environment there | 14:16 |
| jaosorior | but... every time I try it it fails | 14:16 |
| sshnaidm | jaosorior, ok, I won't touch it then | 14:16 |
| jaosorior | sshnaidm: if you have experience setting up a containers environment, I would use some help | 14:18 |
| sshnaidm | jaosorior, do you mean containers based compute? | 14:18 |
| sshnaidm | jaosorior, like we have in containers job? | 14:19 |
| *** ealcaniz has joined #tripleo | 14:20 | |
| jaosorior | sshnaidm: Ah, I was trying the containers based undercloud | 14:20 |
| *** tzumainn has joined #tripleo | 14:20 | |
| sshnaidm | jaosorior, oh, I thought dprince worked with weshay on this, I'm not so familiar with this | 14:20 |
| jaosorior | fails for me, every time :/ | 14:21 |
| sshnaidm | jaosorior, where the logs? | 14:21 |
| jaosorior | so I'm probably missing something | 14:21 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add explicit swift check to tripleo_upgrade_node.sh https://review.openstack.org/434305 | 14:21 |
| *** trown|brb is now known as trown | 14:24 | |
| jaosorior | sshnaidm: gotta bring up the environment again, wait up | 14:24 |
| *** morazi has joined #tripleo | 14:25 | |
| *** milan has joined #tripleo | 14:26 | |
| *** amoralej|lunch is now known as amoralej | 14:27 | |
| *** dprince has joined #tripleo | 14:27 | |
| *** links has quit IRC | 14:31 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/tripleo-docs master: Add some documentation about VirtualBMC and pxe_ipmitool https://review.openstack.org/434286 | 14:32 |
| *** pmannidi has quit IRC | 14:33 | |
| *** chlong has quit IRC | 14:37 | |
| *** liverpooler has joined #tripleo | 14:40 | |
| *** liverpooler has quit IRC | 14:40 | |
| *** agurenko_ has quit IRC | 14:40 | |
| *** liverpooler has joined #tripleo | 14:40 | |
| *** eck`gone has joined #tripleo | 14:44 | |
| *** eck`gone is now known as eck` | 14:44 | |
| *** cdearborn has joined #tripleo | 14:45 | |
| EmilienM | arxcruz: in tripleo | 14:47 |
| arxcruz | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1664995 done | 14:48 |
| openstack | Launchpad bug 1664995 in tripleo "glance is not calling glance-manage db_load_metadefs" [Medium,New] | 14:48 |
| *** ealcaniz__ has joined #tripleo | 14:48 | |
| *** salmankhan has joined #tripleo | 14:48 | |
| *** jpena|lunch is now known as jpena | 14:49 | |
| *** ealcaniz has quit IRC | 14:50 | |
| *** jcoufal_ has joined #tripleo | 14:51 | |
| *** jcoufal has quit IRC | 14:54 | |
| *** lblanchard has joined #tripleo | 14:58 | |
| *** fultonj has quit IRC | 14:59 | |
| b00tcat | hi shardy, I remember once that you told me how to debug my tripleo-heat-templates since heat was not giving out enough info, how was that done? I can't find the note where I copied what you said :( | 15:00 |
| *** zb is now known as zaneb | 15:00 | |
| *** fultonj has joined #tripleo | 15:01 | |
| *** liverpooler has quit IRC | 15:04 | |
| *** ealcaniz__ has quit IRC | 15:06 | |
| *** liverpooler has joined #tripleo | 15:06 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Update author field in package.json https://review.openstack.org/434335 | 15:07 |
| *** jaosorior has quit IRC | 15:09 | |
| EmilienM | ccamacho, sshnaidm : could you please review https://review.openstack.org/#/c/426375 - I think we really need it asap | 15:09 |
| *** limao_ has quit IRC | 15:09 | |
| ccamacho | hey EmilienM checking | 15:09 |
| *** jaosorior has joined #tripleo | 15:10 | |
| shardy | matbu: Hey, are you OK with https://review.openstack.org/#/c/405241/ landing, and we can work on any subsequent fixes as a followup? | 15:10 |
| *** limao has joined #tripleo | 15:10 | |
| shardy | owalsh_afk & ansiwen_ ^^ | 15:10 |
| ansiwen_ | shardy: looking | 15:10 |
| matbu | shardy: yep, i was tessting it today it sounds good, im hitting another issue, but not related to this | 15:11 |
| shardy | matbu: likewise, I started testing it earlier today but hit some ceph issues which I'm pretty sure aren't related to the patch | 15:11 |
| *** udesale has joined #tripleo | 15:11 | |
| shardy | matbu: please leave your vote on the patch then I'll approve it, thanks! | 15:11 |
| matbu | shardy: ack | 15:12 |
| *** dmarlin has joined #tripleo | 15:12 | |
| matbu | marios: ^ | 15:13 |
| *** liverpooler has quit IRC | 15:14 | |
| *** liverpooler has joined #tripleo | 15:16 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Update author field in package.json https://review.openstack.org/434335 | 15:16 |
| honza | jpich: leave it to me to mess up such a simple patch :( :( :( | 15:16 |
| jpich | honza: Everyone's a critic anyway ;) | 15:17 |
| honza | :) | 15:17 |
| *** ealcaniz__ has joined #tripleo | 15:19 | |
| *** radez has joined #tripleo | 15:22 | |
| *** saibarspeis has quit IRC | 15:22 | |
| *** saibarspeis has joined #tripleo | 15:24 | |
| *** ealcaniz__ has quit IRC | 15:26 | |
| *** saneax is now known as saneax-_-|AFK | 15:28 | |
| *** gatuus has joined #tripleo | 15:30 | |
| marios | matbu: thanks, shardy yeah afaics it completes for me today too just voted | 15:30 |
| dtrainor | honza, jpich, fwiw i'm far better at messing up simple patches than both of you combined | 15:31 |
| * jpich hearing a challenge here | 15:31 | |
| * honza same | 15:31 | |
| *** eck` is now known as eck`gone | 15:33 | |
| *** yolanda has quit IRC | 15:34 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add removed wait_for script to validate role https://review.openstack.org/434239 | 15:35 |
| *** yolanda has joined #tripleo | 15:35 | |
| *** agurenko has joined #tripleo | 15:37 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 15:38 |
| *** ealcaniz__ has joined #tripleo | 15:38 | |
| matbu | marios: i have made the ugly ovs thing in the ansible step | 15:38 |
| *** trozet has quit IRC | 15:38 | |
| matbu | marios: just a dummy pushed of the script | 15:38 |
| *** trozet has joined #tripleo | 15:38 | |
| matbu | im testing it in a few | 15:39 |
| matbu | marios: https://review.openstack.org/434346 | 15:39 |
| marios | matbu: thanks looking | 15:39 |
| EmilienM | marios: is there something that refrains you to approve https://review.openstack.org/#/c/405241/ ? | 15:39 |
| marios | chem: matbu and so it lives on https://review.openstack.org/#/c/434346/1/puppet/services/tripleo-packages.yaml | 15:39 |
| marios | EmilienM: i thought shardy was going to vote too | 15:40 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart-extras master: Add disk root device hints https://review.openstack.org/433691 | 15:40 |
| marios | EmilienM: oh its his review :/ | 15:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: multinode/upgrade: add nova services to environment https://review.openstack.org/434348 | 15:40 |
| matbu | marios: i guess, i put there then it should be executed on each nodes (controller) | 15:40 |
| *** salmankhan has quit IRC | 15:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: multinode/upgrade: add nova services to environment https://review.openstack.org/434348 | 15:40 |
| marios | EmilienM: done | 15:40 |
| EmilienM | marios: cool | 15:40 |
| matbu | marios: for the other nodes, we may have to make it into the bash script | 15:40 |
| matbu | marios: i'll add it | 15:40 |
| *** mdnadeem has quit IRC | 15:40 | |
| marios | matbu: well its still there | 15:41 |
| marios | matbu: i mean it is already there... see http://paste.openstack.org/raw/598999/ | 15:41 |
| jaosorior | sshnaidm: is adding ZUUL_CHANGES supposed to work? | 15:41 |
| jaosorior | just tried it out like it said here https://etherpad.openstack.org/p/tripleo-ci-devenvs | 15:41 |
| marios | matbu: i didn't remove it as i knew we may still have to have a workaround for ovs jus wasn't sure if it was going to be the same one | 15:41 |
| jaosorior | and it didn't grab the t-h-t changes I needed :/ | 15:41 |
| sshnaidm | jaosorior, yes, export ZUUL_CHANGES | 15:41 |
| sshnaidm | jaosorior, how do you run? | 15:42 |
| matbu | marios: ack, im testing the controller part now | 15:42 |
| jaosorior | sshnaidm: basically copied the command in line 48 and changed the reference | 15:42 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Switch central and compute templates to use polling agent https://review.openstack.org/430444 | 15:42 |
| sshnaidm | jaosorior, should work, do you have logs? | 15:43 |
| *** spredzy has quit IRC | 15:43 | |
| jaosorior | wait up | 15:43 |
| jaosorior | wtf | 15:43 |
| jaosorior | it grabbed an unrelated change | 15:43 |
| jaosorior | let me check | 15:43 |
| *** prateek has quit IRC | 15:45 | |
| jaosorior | EmilienM, marios could you check this https://review.openstack.org/#/c/434151/ ? | 15:45 |
| *** salmankhan has joined #tripleo | 15:46 | |
| EmilienM | matbu: thanks for the +A. From now, we can close the blueprint and work with bugs in launchpad. OK? cc matbu chem | 15:47 |
| EmilienM | jaosorior: done | 15:47 |
| marios | jaosorior: ack | 15:47 |
| jaosorior | EmilienM, marios thanks | 15:47 |
| *** spredzy has joined #tripleo | 15:48 | |
| matbu | EmilienM: yep cool, happy to see this BP closing :) | 15:49 |
| EmilienM | I'm working on the last bits to release RC1 now | 15:50 |
| *** eck`gone is now known as eck` | 15:50 | |
| *** jmelvin has joined #tripleo | 15:50 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Apply puppet in non-controller script in step. https://review.openstack.org/433641 | 15:51 |
| openstackgerrit | Bob Fournier proposed openstack/instack-undercloud master: This change installs two Ironic inspector plugins. The ``lldp_basic`` plugin was added to Ironic inspector in Ocata to process LLDP packets stored in swift (https://review.openstack.org/#/c/406496/). The ``local_link_connection`` plugin was added in New https://review.openstack.org/434356 | 15:54 |
| *** ekuris has joined #tripleo | 15:55 | |
| openstackgerrit | Bob Fournier proposed openstack/instack-undercloud master: Install Ironic inspector plugins https://review.openstack.org/434356 | 15:55 |
| *** abregman has joined #tripleo | 15:56 | |
| *** abregman has quit IRC | 15:56 | |
| openstackgerrit | Bob Fournier proposed openstack/instack-undercloud master: Install Ironic inspector plugins https://review.openstack.org/434356 | 15:57 |
| *** abregman has joined #tripleo | 15:58 | |
| *** bogdando has joined #tripleo | 15:59 | |
| *** jaganathan has quit IRC | 15:59 | |
| *** chlong has joined #tripleo | 16:03 | |
| *** twi99y has quit IRC | 16:04 | |
| *** twi99y has joined #tripleo | 16:04 | |
| *** ccamacho has quit IRC | 16:04 | |
| slagle | EmilienM: i'm still seeing the same behavior in my deployment with it restarting services. it looks like it's triggered by the db sync to me | 16:05 |
| slagle | i can upload the full log somewhere | 16:05 |
| *** bogdando has quit IRC | 16:05 | |
| *** tremble has quit IRC | 16:06 | |
| *** flepied has quit IRC | 16:06 | |
| EmilienM | slagle: with which patch applied? | 16:06 |
| *** yamahata has joined #tripleo | 16:07 | |
| slagle | i dont have any patches applied | 16:07 |
| EmilienM | slagle: right, it must something in puppet-nova. Can you tell which services are restarted? only nova? | 16:09 |
| slagle | EmilienM: quite a bit more than that: https://clbin.com/x3PKW | 16:09 |
| slagle | i guess it's similar to what bandini was seeing | 16:09 |
| EmilienM | slagle: gimme a few min, so I can finish to write reno for puppet-tripleo | 16:09 |
| EmilienM | yes very similar if not equal actually | 16:10 |
| EmilienM | I think we found why for nova, but I'm still confused about neutron | 16:10 |
| EmilienM | we'll also have to look at swift | 16:10 |
| bandini | any takers for a short release notes addition? https://review.openstack.org/#/c/433765/ | 16:10 |
| jtomasek | jrist, honza: when I run 'tox' in tripleo-ui it outputs: [reno.config] did not load config file /home/jtomasek/tripleo-ui/releasenotes/config.yaml: [Errno 2] No such file or directory: '/home/jtomasek/tripleo-ui/releasenotes/config.yaml' | 16:12 |
| EmilienM | bandini: +2 | 16:12 |
| jtomasek | is that expected? I think it should use config.yaml in releasenotes/source/config.yaml IIUC | 16:13 |
| jrist | hmm | 16:13 |
| bandini | EmilienM: thanks. okay if I merge it now? | 16:13 |
| jaosorior | sshnaidm: right, so this is the command i'm using | 16:13 |
| jaosorior | TE_DATAFILE=/tmp/env.json OVERRIDE_ZUUL_BRANCH= ZUUL_BRANCH=master WORKSPACE=/tmp DEVSTACK_GATE_TIMEOUT=200 TOCI_JOBTYPE=ovb-fakeha-^CUUL_CHANGES="openstack/tripleo-heat-templates:master:refs/changes/34/307734/4" ZUUL_PROJECT="openstack/tripleo-heat-templates" ZUUL_BRANCH="master" ./toci_gate_test.sh | 16:13 |
| jrist | jtomasek: let me try it in a fresh env | 16:13 |
| jaosorior | sshnaidm: and it's disregarding the change reference I give. And just uses master from tripleo-heat-templates | 16:13 |
| jaosorior | :/ | 16:13 |
| *** suuuper has quit IRC | 16:14 | |
| sshnaidm | TOCI_JOBTYPE=ovb-fakeha-^CUUL_CHANGES ? | 16:14 |
| EmilienM | bandini: go ahead | 16:14 |
| jaosorior | wrong paste | 16:15 |
| jaosorior | sshnaidm: TE_DATAFILE=/tmp/env.json OVERRIDE_ZUUL_BRANCH= ZUUL_BRANCH=master WORKSPACE=/tmp DEVSTACK_GATE_TIMEOUT=200 TOCI_JOBTYPE=ovb-fakeha-caserver ZUUL_CHANGES="openstack/tripleo-heat-templates:master:refs/changes/51/434151/3" ZUUL_PROJECT="openstack/tripleo-heat-templates" ZUUL_BRANCH="master" ./toci_gate_test.sh | 16:15 |
| jtomasek | jrist: this is the complete output: http://paste.openstack.org/show/599066/ | 16:15 |
| *** gatuus has quit IRC | 16:15 | |
| jrist | looked like it worked fine | 16:16 |
| jpich | jtomasek: Does it work and generates the notes anyway though? It's all like "heh build succeeded" at the end | 16:16 |
| *** artom_ is now known as artom | 16:16 | |
| jrist | it does | 16:16 |
| sshnaidm | jaosorior, can I see the log of run? | 16:16 |
| jrist | mine does the same exact output jtomasek | 16:16 |
| jrist | but it still gens the notes | 16:17 |
| dtrainor | jtomasek, mine as well | 16:17 |
| jaosorior | sshnaidm: sure, you can log into ozz-undercloud | 16:17 |
| jtomasek | hmm | 16:17 |
| jaosorior | in rh1 | 16:17 |
| dtrainor | jtomasek, https://docs.openstack.org/developer/reno/usage.html#configuring-reno "Reno looks for an optional config.yml file in the release notes directory" | 16:18 |
| dtrainor | maybe that helps | 16:18 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras master: Implement overcloud sanity checks role https://review.openstack.org/429716 | 16:18 |
| *** suuuper has joined #tripleo | 16:20 | |
| jtomasek | dtrainor, jpich, jrist: ah, ok, it is differenc conf then... conf.yaml vs source/conf.py... sorry:) | 16:20 |
| jrist | no prob, bob | 16:20 |
| *** ealcaniz__ has quit IRC | 16:20 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue https://review.openstack.org/434346 | 16:22 |
| *** flepied has joined #tripleo | 16:22 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add explicit swift check to tripleo_upgrade_node.sh https://review.openstack.org/434305 | 16:23 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: [WIP ]Add manual ceph-osd upgrade https://review.openstack.org/434367 | 16:23 |
| *** gatuus has joined #tripleo | 16:23 | |
| *** cinerama` is now known as cinerama | 16:23 | |
| sshnaidm | jaosorior, and where is the log? | 16:24 |
| *** saibarspeis has quit IRC | 16:24 | |
| sshnaidm | jaosorior, I'll run it again, ok? | 16:25 |
| *** aufi has quit IRC | 16:27 | |
| *** jcoufal has joined #tripleo | 16:28 | |
| jtomasek | jrist: is calling 'reno new 3.0.0 --edit' the same as editing the 3.0.0-<hash>.yaml file? | 16:28 |
| social | Can anyone have look at https://review.openstack.org/#/c/432357 ? We need this in Ocata | 16:28 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Add missing release notes for Ocata RC1 https://review.openstack.org/434369 | 16:28 |
| EmilienM | bandini: ^ if you can also review | 16:28 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add sanity checks to the baremetal overcloud and upgrades playbooks https://review.openstack.org/433914 | 16:28 |
| jrist | jtomasek: good question, but you can just add a new note | 16:29 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Add missing release notes for Ocata RC1 https://review.openstack.org/434369 | 16:29 |
| * bandini looks | 16:29 | |
| jrist | jtomasek: my impression is that the answer is no | 16:29 |
| jrist | I think that will attempt to create another new 3.0.0 | 16:29 |
| jrist | EmilienM: do you know^ ? | 16:29 |
| jtomasek | jrist: ah, yeah, I think I understand now... how to decide if new releasenotes file is needed or to put it into existing one | 16:30 |
| jtomasek | ? | 16:30 |
| EmilienM | jrist: I don't | 16:30 |
| *** udesale has quit IRC | 16:30 | |
| jrist | jtomasek: I'd say just a small note with the info about that specific patch is fine | 16:31 |
| *** jcoufal_ has quit IRC | 16:31 | |
| jrist | EmilienM: do you agree ^? | 16:31 |
| *** jcoufal__ has joined #tripleo | 16:31 | |
| *** leanderthal is now known as leanderthal|afk | 16:32 | |
| jtomasek | jrist: IIUC a new note is required when a version is supposed to be bumped | 16:32 |
| EmilienM | slagle: can you pleae show me your catalog at step 5? I want to see what trigger swift restarts | 16:32 |
| jpich | jtomasek: They all get merged in the end | 16:32 |
| jrist | jtomasek: yeah | 16:32 |
| *** jcoufal has quit IRC | 16:32 | |
| ansiwen_ | shardy: I got distracted and reviewd 405241 just now, and had a question, otherwise lgtm | 16:32 |
| jrist | jtomasek: what jpich said | 16:32 |
| *** jcoufal_ has joined #tripleo | 16:33 | |
| jrist | jtomasek: they get merged into one at the end of the release | 16:33 |
| jrist | jtomasek: the one that I did initially was just to catch up | 16:33 |
| EmilienM | slagle: same for neutron | 16:33 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: collect logs: use wildcard instead of specific user name for home collection https://review.openstack.org/434375 | 16:34 |
| *** jlinkes has quit IRC | 16:34 | |
| jtomasek | jrist, jpich: ok, I think I understand now:) thanks again | 16:34 |
| dtrainor | fwiw that's how i understand they are compiled as well jtomasek | 16:35 |
| EmilienM | matbu, marios: what version of THT is deployed when running gate-tripleo-ci-centos-7-multinode-upgrades-nv and deploying the env? stable/newton or master? | 16:35 |
| dtrainor | specific to the branch as the product of the commits | 16:35 |
| jrist | jtomasek: no, thank you | 16:35 |
| shardy | ansiwen_: if the command fails, it will interrupt the upgrade, same with any task that doesn't say to ignore errors | 16:36 |
| *** jcoufal__ has quit IRC | 16:36 | |
| jaosorior | sshnaidm: sure | 16:36 |
| jaosorior | beekneemech: you around? | 16:36 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 16:36 |
| jpich | jtomasek: No problems! The only thing that caught me when testing the release notes locally is that only the *committed* notes are taken into account, so my stuff wasn't showing up till I git commit --amended it | 16:36 |
| slagle | EmilienM: how do I get the catalog? | 16:37 |
| *** Lokesh_Jain_ has joined #tripleo | 16:37 | |
| *** ekuris has quit IRC | 16:37 | |
| jtomasek | jpich: only thing which bothers me is that since almost every patch needs a release note, it puts a requirement to setup python environment for each potential contributor | 16:38 |
| jtomasek | just to be able to generate a simple text file | 16:38 |
| EmilienM | slagle: I use var/log/messages | 16:39 |
| jpich | jtomasek: :/ Maybe we should have a note in the docs on how to quickly to do so with virtualenv, and a link to the reno docs to explain why we're doing all this? | 16:39 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: Add converge update to major upgrade test https://review.openstack.org/434250 | 16:39 |
| tosky | jtomasek: is it a real problem to have a python environment ready? | 16:39 |
| slagle | EmilienM: oh...catalog=log? | 16:39 |
| EmilienM | slagle: yes | 16:40 |
| jtomasek | tosky: for a javascript project yes, because you don't need python to develop on tripleo-ui | 16:40 |
| jrist | jtomasek: yeah, :( | 16:40 |
| ansiwen_ | shardy: is there an option to give a warning instead of interrupting? because it's not a fatal problem, just means, there is some homework to do | 16:40 |
| tosky | jtomasek: ok, but it's a dnf install away | 16:40 |
| slagle | EmilienM: ok, sorry, one sec....http://i2.kym-cdn.com/photos/images/original/000/234/765/b7e.jpg | 16:40 |
| shardy | ansiwen_: well we could add ignore_errors to the task in that case | 16:40 |
| sshnaidm | jaosorior, I see it builds b06e49302d510d0e5f28c585c41c52ef5bc8ad13 | 16:41 |
| EmilienM | shardy: see my question about THT and gate-tripleo-ci-centos-7-multinode-upgrades-nv - I'm worried that we need to add services in tht / newton first :/ | 16:41 |
| shardy | ansiwen_: there's no good way to surface an error to the operator at this point though | 16:41 |
| jpich | jtomasek: I think we should be careful about what is actually relevant to the end user, if there's too many release notes it becomes unusable. E.g. if a new bug is created during a dev cycle and fixed before the release, it had no user-visible impact and doesn't warrant a release note, imo | 16:41 |
| shardy | EmilienM: yeah that's why I only put it in the check queue for tripleo-ci | 16:41 |
| tosky | jpich: that's totally correct | 16:41 |
| jaosorior | sshnaidm: it should build 701b5448847cbd131344cb2dac70465a8ef5f9a6 | 16:41 |
| shardy | EmilienM: we do have some work to do before we can make it voting on t-h-t I agree | 16:42 |
| jaosorior | sshnaidm: this is the ref I'm trying to reference https://review.openstack.org/#/c/434151/ | 16:42 |
| *** jcoufal has joined #tripleo | 16:42 | |
| ansiwen_ | shardy: ok, ectually I don't know if the tool returns something !=0 if it cannot finish the migration... but if so, it would be maybe the lesser evil to ignore the error | 16:42 |
| slagle | EmilienM: https://slagle.fedorapeople.org/heat-debug.log | 16:42 |
| jtomasek | tosky: it is not that huge deal, but just to compare, it is the same as if for tripleoclient you'd have a requirement to run ruby to generate release notes, it is a distraction | 16:42 |
| shardy | ansiwen_: Ok, perhaps you can look into that and post a follow-up patch? | 16:42 |
| slagle | EmilienM: 25MB file btw, it's the debug log from all 5 steps | 16:42 |
| ansiwen_ | shardy: yup | 16:43 |
| jtomasek | jpich: good point | 16:43 |
| shardy | ansiwen_: thanks! | 16:43 |
| slagle | EmilienM: afaict, it's something to do with how the nova anchors are defined in deps.pp | 16:43 |
| *** rcernin has quit IRC | 16:43 | |
| EmilienM | slagle: I crashed my laptop when I openned the file | 16:44 |
| EmilienM | thanks :D | 16:44 |
| slagle | np | 16:44 |
| tosky | jtomasek: and sometime if you need some extra python modules from source you may need gcc to compile it | 16:44 |
| tosky | I understand, but still | 16:44 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient master: Pass empty stack_fields to update manager https://review.openstack.org/432422 | 16:44 |
| slagle | EmilienM: i guess in a true HA environment, since the db-sync only happens on the master node, the services on the other nodes don't get restarted | 16:44 |
| tosky | jtomasek: automatic release note management with reno saves time later when you need to write them | 16:45 |
| slagle | EmilienM: i'm not sure if that is intentional or not | 16:45 |
| *** thrash is now known as thrash|biab | 16:45 | |
| *** jcoufal_ has quit IRC | 16:45 | |
| tosky | jtomasek: of course you could implement a reno-compatible engine in javascript :P | 16:45 |
| *** owalsh_afk has quit IRC | 16:45 | |
| jtomasek | tosky: hehe, right, I get the point and agree | 16:45 |
| slagle | EmilienM: it just seems the service restart is unnecessary in either case | 16:45 |
| *** eggmaster has joined #tripleo | 16:46 | |
| jtomasek | jpich: so regarding this one, since it is a relatively simple cleanup, it IMHO does not need a releasenote https://review.openstack.org/#/c/431515/ | 16:46 |
| EmilienM | if someone can review https://review.openstack.org/#/c/434369/ please, so I can propose TripleO RC1 | 16:46 |
| *** tosky has quit IRC | 16:46 | |
| EmilienM | slagle: I'm readin the catalog | 16:46 |
| EmilienM | slagle: step5 starts at 15:34:58 iiuc | 16:47 |
| jtomasek | jpich: hm, maybe the bug is worth a release note since it has been tracked from previous release | 16:48 |
| EmilienM | slagle: at 15:16:14 I mean | 16:49 |
| *** tosky has joined #tripleo | 16:49 | |
| *** abregman has quit IRC | 16:49 | |
| slagle | EmilienM: ummm | 16:49 |
| EmilienM | slagle: /Stage[main]/Swift::Client/Package[swiftclient]/ensure (notice): created | 16:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job https://review.openstack.org/427481 | 16:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin) https://review.openstack.org/427482 | 16:49 |
| slagle | EmilienM: 15:34:27 from what i can tell is the start of step 5 | 16:49 |
| EmilienM | slagle: can you check in logs and confirm swiftclient is added at step5? | 16:49 |
| slagle | EmilienM: search for "Runtime environment", that is the start of each step | 16:50 |
| slagle | EmilienM: how would I confirm that? | 16:50 |
| *** owalsh_afk has joined #tripleo | 16:51 | |
| EmilienM | slagle: different ways, first, can you check if you see the resource in the other steps? | 16:51 |
| *** owalsh_afk is now known as owalsh | 16:51 | |
| EmilienM | slagle: also in syslog, can you check when the package is installed? | 16:51 |
| slagle | EmilienM: how do I tell if a resource is in a step? | 16:53 |
| EmilienM | slagle: in the catalog | 16:53 |
| EmilienM | slagle: can you check the catalog at step4 | 16:53 |
| slagle | EmilienM: all the packages are already installed | 16:53 |
| EmilienM | and see if you see swiftclient | 16:53 |
| *** gbarros has joined #tripleo | 16:54 | |
| EmilienM | mwhahaha: can you confirm that when we see: Swift::Client/Package[swiftclient]/ensure (notice): created it means the package was freshly installed ? | 16:54 |
| mwhahaha | or it's the virtual package thing again | 16:54 |
| EmilienM | ah that also | 16:54 |
| mwhahaha | where it's not properly detecting that it's installed | 16:55 |
| EmilienM | mwhahaha: was it a packaging name with python3? | 16:55 |
| * mwhahaha has no idea | 16:55 | |
| slagle | EmilienM: i see swiftclient, but there is no mention of "resource" | 16:55 |
| EmilienM | python2-swiftclient-3.3.0-0.20170131151542.307d4c0.el7.centos.noarch | 16:55 |
| EmilienM | it could be the virtual resource again | 16:56 |
| *** fragatina has joined #tripleo | 16:56 | |
| slagle | EmilienM: no packages were installed during the stack-update, they are already installed | 16:56 |
| EmilienM | jpena, amoralej ^ do you remember this thing? | 16:56 |
| mwhahaha | is it not tagged with openstack? | 16:56 |
| *** abehl has quit IRC | 16:56 | |
| EmilienM | jpena, amoralej : do you remember what was the problem with virtual package again? and the thing with puppet that thinks the package was not installed | 16:56 |
| slagle | EmilienM: this is also when running with EnablePackageInstall:False (i'm following up from what I said I would try from the meeting) | 16:56 |
| EmilienM | mwhahaha: it is | 16:56 |
| amoralej | yes EmilienM, problem was that package name was python2-XXXX but it was installed as python-XXX using virtual package | 16:57 |
| jpena | EmilienM: if you're using Puppet 4, the yum provider should already support virtual packages | 16:57 |
| jpich | jtomasek: Looking at the bug, it looks like there's a small user visible impact so, no need to describe all that was refactored but maybe a short sentence on what the user will see differently | 16:57 |
| amoralej | but that was fixed with puppet4 | 16:57 |
| EmilienM | ok so we shouldn't hit that | 16:57 |
| EmilienM | it must be something else then | 16:57 |
| mwhahaha | EmilienM: oh it was a puppet >3.6 <4 thing, https://github.com/openstack/puppet-openstacklib/blob/master/manifests/defaults.pp | 16:57 |
| EmilienM | mwhahaha: indeed | 16:58 |
| *** tesseract has quit IRC | 16:58 | |
| mwhahaha | it might not mean that it was installed | 16:58 |
| EmilienM | slagle: just to make sure, what version of puppet do you run? | 16:58 |
| mwhahaha | it might just mean it was added to the catalog | 16:58 |
| *** nyechiel has joined #tripleo | 16:59 | |
| jpich | jtomasek, jrist: It's not uncommon to also give people the option to submit the release note as a dependent patch, so they don't lose the current review votes/+2 for the patch | 16:59 |
| slagle | EmilienM: puppet-4.6.2-2.el7.noarch | 16:59 |
| shardy | marios: Hey looking at https://review.openstack.org/#/c/424715 and I think the CI failures are real | 16:59 |
| shardy | it seems we're running the UpgradeInit always | 17:00 |
| jrist | jpich: oh, cool I didn't know that | 17:00 |
| EmilienM | slagle: I'm in a mtg now, I'll continue later | 17:00 |
| slagle | EmilienM: sure, np | 17:01 |
| *** ramishra has quit IRC | 17:01 | |
| ansiwen_ | shardy: if I read the code correctly, it always returns with 0 in the unlimited mode, so no change needed | 17:03 |
| shardy | ansiwen_: Ok, how does an operator know when it's done then? | 17:03 |
| *** fragatina has quit IRC | 17:03 | |
| shardy | is there some other command that checks the actual status? | 17:03 |
| ansiwen_ | only over the output on standard out... I know... | 17:03 |
| *** trown is now known as trown|lunch | 17:04 | |
| ansiwen_ | shardy: https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L789-L795 | 17:05 |
| *** dtantsur is now known as dtantsur|afk | 17:06 | |
| ansiwen_ | shardy: the sum over all info[0]-info[1] would need to be 0, then no work is left. | 17:09 |
| ansiwen_ | shardy: these tools are not made for automation, obviously | 17:10 |
| *** gbarros has quit IRC | 17:10 | |
| shardy | ansiwen_: clearly | 17:10 |
| *** hewbrocca_afk is now known as hewbrocca | 17:11 | |
| *** jprovazn has quit IRC | 17:12 | |
| *** d0ugal has quit IRC | 17:16 | |
| beekneemech | jaosorior: Had an appointment this morning. What's up? | 17:16 |
| *** beekneemech is now known as bnemec | 17:16 | |
| bnemec | Silly IRC client, it's not Friday. | 17:16 |
| jaosorior | bnemec: hey dude, why is this being done? https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/common_functions.sh#L103 | 17:18 |
| openstackgerrit | Merged openstack/tripleo-docs master: Don't limit creation of undercloud.conf to baremetal https://review.openstack.org/433904 | 17:21 |
| bnemec | jaosorior: I believe that's a local dns server. We had trouble at one point with too many DNS requests overloading the bastion, and this way they never leave the local network. | 17:21 |
| panda | gfidente: arxcruz is the tempest man for upstream. if he was a black girl with white hair I'd call him "storm" | 17:21 |
| bnemec | Although that was added before we had the problem, I think. | 17:21 |
| arxcruz | lol | 17:21 |
| gfidente | arxcruz hey I was wondering if we use the deployer-input file created by tripleoclient when setting up tempest against the overcloud? | 17:22 |
| arxcruz | gfidente: I'm looking the bug you're asking, basically we do use the deployer-input-conf in our tests | 17:22 |
| gfidente | so is there a workaround for that bz already? | 17:23 |
| arxcruz | gfidente: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L79 is the code that creates the tempest-deployer-input.conf | 17:24 |
| shardy | EmilienM: I've been thinking about multinode_major_upgrade.yaml in tht | 17:24 |
| gfidente | arxcruz yeah but we don't set that value today | 17:24 |
| arxcruz | gfidente: I'm not aware of workarounds, let me check if the test is being executed upstream | 17:24 |
| *** zoli is now known as zoli|gone | 17:24 | |
| *** chlong has quit IRC | 17:24 | |
| shardy | right now we only run the upgrade job on patches to master, but we depend on multinode_major_upgrade.yaml from stable/newton | 17:25 |
| shardy | I think that means it's impossible to validate adding services to the upgrade CI job now we moved the list of enabled services | 17:25 |
| gfidente | arxcruz so if that flag is not set I think tempest is skipping the resize tests | 17:25 |
| arxcruz | gfidente: yes | 17:25 |
| gfidente | yes as in we're skipping them? | 17:25 |
| arxcruz | gfidente: yes, we are skipping | 17:26 |
| gfidente | which is fine, I'm just weighting how much urgent that is | 17:26 |
| gfidente | thanks! | 17:26 |
| shardy | EmilienM: I'll look into it, I think we may have to just use the environment from master for now | 17:26 |
| gfidente | arxcruz so can you please add a comment in the BZ pointing at what is consuming the deployer-input file? | 17:26 |
| EmilienM | shardy: well the problem is how to deploy newton with new services added in a scenario in master | 17:26 |
| *** cylopez has quit IRC | 17:27 | |
| arxcruz | gfidente: in order to make it work dinamically, in tripleoclient it's gonna need a lot of code btw | 17:27 |
| shardy | EmilienM: yeah, actually looking at tripleo-ci, we are only using master | 17:27 |
| gfidente | yeah that is why I am worried as well | 17:27 |
| arxcruz | gfidente: the scripts upstream use this but I'm not sure about the OSPD | 17:27 |
| shardy | UPGRADE_ENV=/usr/share/openstack-tripleo-heat-templates/ci/environments/multinode_major_upgrade.yaml | 17:27 |
| shardy | EmilienM: I think that's OK, as for upgrades you can only have services which exist on both the stable and master branch | 17:28 |
| arxcruz | gfidente: it will depend how tempest is being executed, if you're using the config tool | 17:28 |
| shardy | EmilienM: Ok, sorry for the noise, I'll try adding some services and see what CI does | 17:28 |
| shardy | EmilienM: I agree it's a problem for scenarios | 17:28 |
| gfidente | arxcruz we could easily enable that flag if any cephstorage node exists, but then we'd miss when osds are colocated on computes ... and to figure that out, we'd need to introspect the templates and the registry | 17:28 |
| shardy | we may need to separate the environment files | 17:28 |
| gfidente | which is crazy :) | 17:29 |
| *** milan has quit IRC | 17:29 | |
| EmilienM | shardy: i'm fine with it | 17:29 |
| EmilienM | shardy: I'll deal with scenarios | 17:29 |
| *** dsariel has quit IRC | 17:29 | |
| arxcruz | gfidente: https://review.openstack.org/#/c/338853/ would enable these not default options | 17:29 |
| EmilienM | shardy: i'll think about it. I think now we are in a period of time where things need to be boostraped first | 17:29 |
| shardy | EmilienM: Ok, thanks, I'll work on getting coverage added for the services we're missing until scenarios is ready | 17:29 |
| shardy | (until we run out of ram, which I think we aren't yet) | 17:29 |
| EmilienM | ok | 17:30 |
| EmilienM | shardy: please focus on core services only | 17:30 |
| *** d0ugal has joined #tripleo | 17:30 | |
| *** d0ugal has quit IRC | 17:30 | |
| *** d0ugal has joined #tripleo | 17:30 | |
| EmilienM | shardy: ie: what we have in regular multinode scenario | 17:30 |
| shardy | EmilienM: yeah, well nova and ceph are missing, so they're my main focus | 17:30 |
| EmilienM | shardy: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml#L6 | 17:30 |
| shardy | even if we have to remove some of the currently added services until scenarios is ready | 17:30 |
| gfidente | arxcruz yeah but that's not enough | 17:30 |
| EmilienM | other services should be covered by scenarios | 17:30 |
| gfidente | arxcruz it's based on the assumption that ceph exists only if there are cephstorage nodes | 17:31 |
| EmilienM | shardy: ack, wfm | 17:31 |
| gfidente | arxcruz which isn't the case for HCI | 17:31 |
| shardy | EmilienM: Ok that sounds reasonable, I'll copy the multinode service list | 17:31 |
| arxcruz | gfidente: sure, it's an start | 17:31 |
| arxcruz | gfidente: just showing half of the way you have to do to make it work in python-tripleoclient :) | 17:31 |
| gfidente | arxcruz have you seen https://bugzilla.redhat.com/show_bug.cgi?id=1318745#c4 ? | 17:32 |
| openstack | bugzilla.redhat.com bug 1318745 in python-tripleoclient "[tempest] OSPD Director should enable compute_feature_enabled.resize to deployer-input file when using ceph" [High,New] - Assigned to gfidente | 17:32 |
| arxcruz | gfidente: yes, I see | 17:33 |
| arxcruz | gfidente: I think we had this discussion before about this same problem a long time ago | 17:33 |
| jaosorior | bnemec: that makes sense. thanks | 17:34 |
| *** jaosorior has quit IRC | 17:35 | |
| EmilienM | if someone has time for this release note patch, please https://review.openstack.org/#/c/434369/ | 17:36 |
| *** lucasagomes is now known as lucas-afk | 17:38 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Align multinode and multinode_upgrade CI services https://review.openstack.org/434421 | 17:38 |
| *** sudipto_ has quit IRC | 17:38 | |
| *** sudipto has quit IRC | 17:38 | |
| *** jpich has quit IRC | 17:40 | |
| honza | jtomasek: sorry, just got back from shoveling the driveway | 17:41 |
| *** thrash|biab is now known as thrash | 17:41 | |
| honza | jtomasek: i was gonna suggest implementing reno in js but tosky kind of beat me to it :) | 17:41 |
| *** athomas has quit IRC | 17:42 | |
| *** d0ugal has quit IRC | 17:42 | |
| *** owalsh has quit IRC | 17:42 | |
| *** owalsh has joined #tripleo | 17:42 | |
| tosky | :D | 17:43 |
| *** dougbtv_ has joined #tripleo | 17:44 | |
| honza | dtrainor: hey, thanks for introducing me to the wonders of the zuul dashboard, it has done amazing things to my patience with CI | 17:45 |
| honza | dtrainor: i feel like such a calm person now | 17:45 |
| dtrainor | good, it helped me out quite a bit as well. i wouldn't say it keeps me completely sane, but... | 17:46 |
| honza | dtrainor: honeymoon period :) | 17:47 |
| dtrainor | haha something like that | 17:49 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: break out general_config into config and topology https://review.openstack.org/425451 | 17:51 |
| *** karimb has quit IRC | 17:51 | |
| *** yamahata has quit IRC | 17:51 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 17:54 |
| *** jmelvin has quit IRC | 17:55 | |
| shardy | slagle: hey, is https://github.com/openstack-infra/tripleo-ci/blob/master/test-environments/multinode-core.yaml still needed? | 17:56 |
| shardy | slagle: it appears we removed OS::TripleO::Services::Core since I48cd2b6a4593d673d5883b45feae088392e7e713 | 17:56 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 17:56 |
| *** akrivoka has quit IRC | 17:57 | |
| *** saneax-_-|AFK is now known as saneax | 17:57 | |
| shardy | slagle: but that template does something different from the original pcmk core template | 17:57 |
| *** jcoufal has quit IRC | 17:59 | |
| shardy | bandini: related question, what happens on upgrade if OS::TripleO::Services::Core is still defined, won't we still apply the core pacemaker manifest unless it's set to OS::Heat::None? | 17:59 |
| *** agurenko has quit IRC | 17:59 | |
| slagle | shardy: yes, it's needed for the 3 node job at least | 17:59 |
| * shardy is trying to get pacemaker and nova tested in upgrade CI | 18:00 | |
| slagle | shardy: when you deploy a role without the neutron ovs agent service, then we need a different service to open the 4789 port for vxlan tunnelling between nodes | 18:00 |
| shardy | slagle: ack, thanks, but just to add the firewall rules, not to apply ::tripleo::profile::pacemaker::core (even on newton?) | 18:00 |
| shardy | slagle: Ok, so we probably don't need it for the single-node upgrade job then | 18:01 |
| slagle | shardy: right, so to add a firewall rule, you have to use a service profile | 18:01 |
| slagle | shardy: i saw this thing called "Core" mapped to None, so i thought it was something we could use | 18:01 |
| shardy | but we might need it to include the core pcmk manifest when we deploy the newton overcloud | 18:01 |
| slagle | shardy: i had no idea what it was actually for | 18:01 |
| shardy | https://github.com/openstack/tripleo-heat-templates/commit/d9986387f592059de0203a93dcbebd4df92b088a#diff-d6bc8ce83328ae5c18dae3b4fa3684a0 | 18:01 |
| shardy | slagle: it was used pre-ocata to include a pacemaker specific manifest | 18:02 |
| *** twi99y has quit IRC | 18:02 | |
| *** twi99y has joined #tripleo | 18:02 | |
| bandini | shardy: well we removed the manifests (both in puppet-tripleo and tht) for the core service. So if it is still defined either heat will barf or it will ignore it? | 18:02 |
| slagle | shardy: when i looked, it wasn't being used for anything | 18:03 |
| slagle | i actually thought it was a "define your own service" thing | 18:03 |
| shardy | slagle: ack, thanks, I'll leave 3-nodes alone and remove it from the upgrades env | 18:04 |
| shardy | thanks | 18:04 |
| *** panda is now known as panda|bbl | 18:04 | |
| shardy | bandini: yeah, I think it'll break because inside heat the service is still defined | 18:04 |
| shardy | but I'm about to find out for sure ;) | 18:04 |
| bandini | shardy: do we have a way to set it to none in the upgrade process? | 18:04 |
| bandini | shardy: yeah it sounds like it will break, you are right | 18:04 |
| *** nyechiel has quit IRC | 18:05 | |
| shardy | bandini: yeah we just need to add back the mapping to OS::Heat::None in overcloud-resource-registry-puppet.j2.yaml | 18:05 |
| shardy | bandini: or, we can add it explicitly to environments/major-upgrade-composable-steps.yaml | 18:05 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker keystone service https://review.openstack.org/416605 | 18:06 |
| shardy | bandini: I'll do some testing, thanks for confirming | 18:06 |
| bandini | shardy: ah right! | 18:06 |
| bandini | np | 18:06 |
| *** jpena is now known as jpena|away | 18:06 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: CI fix broken references to multinode-core.yaml https://review.openstack.org/434443 | 18:09 |
| shardy | slagle: ^^ the file was missing in t-h-t, which I guess means 3-nodes is still using the env from tripleo-ci | 18:09 |
| *** Goneri has quit IRC | 18:09 | |
| *** gfidente is now known as gfidente|afk | 18:10 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker_puppet_tasks initialization on primary node https://review.openstack.org/426565 | 18:10 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: Remove test-environments/multinode_major_upgrade.yaml https://review.openstack.org/426375 | 18:12 |
| slagle | shardy: it's b/c toci_gate_test is still using multinode-3nodes.yaml from tripleo-ci, which references multinode-core.yaml in the same directory | 18:12 |
| slagle | i didn't really follow moving all the environments from tripleo-ci to tht | 18:12 |
| shardy | slagle: yeah me neither tbh but https://review.openstack.org/#/c/426375/ looks like it won't work due to the missing reference (moves refernce for the upgrade env to t-h-t) | 18:13 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker ironic services https://review.openstack.org/421517 | 18:13 |
| shardy | I added a Depends-On, so lets see if that works | 18:13 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Add yum clean all when updating undercloud https://review.openstack.org/434447 | 18:14 |
| *** Goneri has joined #tripleo | 18:14 | |
| EmilienM | shardy: can you review https://review.openstack.org/#/c/434348/2 please, | 18:14 |
| EmilienM | ? | 18:14 |
| EmilienM | shardy: and maybe rebase https://review.openstack.org/#/c/434443/1 on top | 18:15 |
| *** flepied has quit IRC | 18:18 | |
| shardy | EmilienM: I think it needs to be the other direction of dependency | 18:18 |
| shardy | or we won't actually test the t-h-t version | 18:18 |
| shardy | added a comment | 18:19 |
| EmilienM | shardy: can you rebase it please? i'm in a call atm | 18:19 |
| shardy | EmilienM: ack will do | 18:19 |
| EmilienM | otherwise I'll do it after | 18:19 |
| EmilienM | thanks | 18:19 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: multinode/upgrade: add nova services to environment https://review.openstack.org/434348 | 18:20 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Generate Pre/Post Puppet Tasks for all roles https://review.openstack.org/434451 | 18:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add environment for deployed-server with pacemaker https://review.openstack.org/434452 | 18:21 |
| *** jkilpatr has quit IRC | 18:22 | |
| *** ckyriakidou has quit IRC | 18:24 | |
| *** rasca has quit IRC | 18:25 | |
| bandini | shardy: do you by chance have a tip on how to find out which template is at fault when I get: ERROR: Failed to validate: : resources.ControllerServiceChain: : Failed to validate nested template: The template is not a JSON object or YAML mapping. | 18:26 |
| bandini | could not spot anything in the heat logs that would tell me which file is broken | 18:27 |
| *** prateek has joined #tripleo | 18:27 | |
| shardy | bandini: Hmm, yeah heat should give a better error, but have you tried "./tools/yaml-validate.py ." in t-h-t ? | 18:29 |
| *** jkilpatr has joined #tripleo | 18:29 | |
| shardy | assuming it's actually malformed yaml vs some other issue that should find it | 18:29 |
| bandini | shardy: that gives green (which boggles my mind :) | 18:29 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Virtual environments are not deprecated https://review.openstack.org/434458 | 18:30 |
| *** nyechiel has joined #tripleo | 18:30 | |
| *** yamahata has joined #tripleo | 18:31 | |
| shardy | bandini: Hmm, Ok you can validate each template individually via | 18:31 |
| shardy | openstack orchestration template validate -t puppet/services/keystone.yaml | 18:31 |
| bandini | shardy: aaah nice, thanks! | 18:32 |
| slagle | bnemec: hmm, i dont think i like that | 18:32 |
| slagle | we need to keep the instructions deprecated, and the script is also deprecated | 18:32 |
| bnemec | slagle: We can't deprecate something without a replacement. | 18:33 |
| slagle | there is a replacement, oooq | 18:33 |
| bnemec | Is it documented? | 18:33 |
| slagle | yes | 18:34 |
| shardy | bandini: when you find the problem, perhaps save the broken template so we can use it to create a minimal reproducer for a heat bug about the uninformative error | 18:34 |
| *** fragatina has joined #tripleo | 18:34 | |
| *** flepied has joined #tripleo | 18:34 | |
| slagle | bnemec: not in tripleo-docs, it has it's own i guess | 18:34 |
| bandini | shardy: ack, sounds great! | 18:34 |
| *** ipsecguy has joined #tripleo | 18:35 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Cleanup Nodes selectors https://review.openstack.org/431515 | 18:35 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update DeploymentPlan page node counts https://review.openstack.org/433449 | 18:35 |
| *** suuuper has quit IRC | 18:36 | |
| *** suuuper has joined #tripleo | 18:36 | |
| slagle | bnemec: i think that in reality it has already been deprecated for a while, given it's reliance on tripleo-incubator | 18:36 |
| slagle | so adding the warning really just matches current reality | 18:36 |
| slagle | that's why i added it anyway | 18:36 |
| slagle | no one is updating instack-virt-setup to not use devtest_testenv afaik | 18:37 |
| *** hewbrocca is now known as hewbrocca_afk | 18:38 | |
| bnemec | slagle: Then the deprecation warning should point at the quickstart docs. | 18:38 |
| bnemec | Although I'm not a fan of some of the docs living out of tree. | 18:39 |
| slagle | that's mostly why i didn't link to them | 18:39 |
| bnemec | I mean, right now the warning says those docs are going to be removed, full stop. | 18:40 |
| bnemec | Which is not true, the virtual docs are just going to transition to a different method. | 18:40 |
| slagle | well...it does not say that *exactly* | 18:41 |
| slagle | it says those instructions | 18:41 |
| slagle | which, they are. it's replaced by oooq | 18:42 |
| slagle | or we can bring devtest_testenv over into instack-undercloud and maintain it there | 18:42 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Include j2 files in plan creation https://review.openstack.org/434161 | 18:42 |
| *** trown|lunch is now known as trown | 18:44 | |
| *** Goneri has quit IRC | 18:45 | |
| *** saneax is now known as saneax-_-|AFK | 18:48 | |
| *** ekuris has joined #tripleo | 18:49 | |
| *** saibarspeis has joined #tripleo | 18:49 | |
| *** jmelvin has joined #tripleo | 18:49 | |
| *** prateek has quit IRC | 18:50 | |
| EmilienM | mwhahaha: when you have time, please look https://review.openstack.org/#/c/434369/ | 18:54 |
| *** mcornea has quit IRC | 18:54 | |
| *** pkovar has quit IRC | 18:57 | |
| *** tosky has quit IRC | 18:57 | |
| *** abehl has joined #tripleo | 18:57 | |
| beagles | marios, got a second to take a peek at https://bugs.launchpad.net/tripleo/+bug/1664670 . I'm considering dropping the severity to high and addressing through documentation. Where you are familiar with some of the OVS related issues, I'd like to get your opinion. | 18:58 |
| openstack | Launchpad bug 1664670 in tripleo "During Newton->Ocata upgrade compute nodes lose network connectivity" [Critical,Confirmed] - Assigned to Brent Eagles (beagles) | 18:58 |
| shardy | beagles: Without dvr is this because we upgrade all the l3 agents on the controllers at the same time? | 19:00 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-l3.yaml#L82 | 19:00 |
| beagles | shardy: actually this is isolated to the compute node | 19:01 |
| shardy | beagles: Ah, Ok | 19:01 |
| shardy | was just recalling a conversation with mcornea where he rightly pointed out that we might be able to do a rolling upgrade of the l3 agents instead of all at once | 19:01 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add HorizontalNumberInput https://review.openstack.org/434282 | 19:02 |
| beagles | shardy: and I *think* it is specific to the internal_api network being on an OVS bridge that is also in the neutron openvswitch agent's bridge_mappings (it explains some of it in any case) | 19:02 |
| shardy | beagles: ack, sounds like you're on it then, thanks! :) | 19:03 |
| *** pcaruana has quit IRC | 19:03 | |
| beagles | shardy: thanks for the heads up on the L3 agent thing though :) | 19:04 |
| mwhahaha | owalsh: by the way we need add a way to update the cell v2 stuff for controller scaling | 19:04 |
| *** nyechiel has quit IRC | 19:04 | |
| mwhahaha | owalsh: cause right now it doesn't get updated when we add new rabbit hosts | 19:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: Exclude /var/log/journal from devstack-logs https://review.openstack.org/434467 | 19:08 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add major-upgrade-converge environment. https://review.openstack.org/434468 | 19:08 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: Add converge update to major upgrade test https://review.openstack.org/434250 | 19:09 |
| *** shardy has quit IRC | 19:10 | |
| owalsh | mwhahaha: snap, that occurred to me this afternoon too | 19:10 |
| owalsh | mwhahaha: at least we have an update command now | 19:11 |
| mwhahaha | owalsh: easiest thing to do is write the cell provider | 19:12 |
| owalsh | mwhahaha: yea, I figured that too | 19:13 |
| *** owalsh is now known as owalsh-afk | 19:15 | |
| EmilienM | owalsh: you like ruby? :) | 19:15 |
| *** owalsh-afk has quit IRC | 19:15 | |
| *** paramite has quit IRC | 19:19 | |
| *** owalsh-afk has joined #tripleo | 19:20 | |
| owalsh-afk | EmilienM: I'm more of a python dev, but I dabble in ruby from time to time... | 19:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: Exclude /var/log/journal from devstack-logs https://review.openstack.org/434467 | 19:21 |
| EmilienM | owalsh-afk: I was kidding, we'll help in this thing | 19:21 |
| *** salmankhan has quit IRC | 19:21 | |
| owalsh-afk | EmilienM: ack, I know :-) I don't think the ruby would be particularly difficult though | 19:22 |
| *** sdake_ has joined #tripleo | 19:22 | |
| EmilienM | owalsh-afk: not at all, we already have a bunch of providers like this | 19:22 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Create /etc/my.cnf.d/tripleo.cnf with proper bind-address https://review.openstack.org/431424 | 19:23 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Make the DB URIs host-independent for all services https://review.openstack.org/431425 | 19:23 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add nova service support for composable upgrades https://review.openstack.org/405241 | 19:23 |
| owalsh-afk | EmilienM: yea, I'm pretty sure I've created a provider before, many moons ago... | 19:24 |
| * owalsh-afk must get my boy to bed and eat, bbl | 19:25 | |
| *** sdake has quit IRC | 19:26 | |
| *** sdake has joined #tripleo | 19:27 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement verify profiles as a custom action https://review.openstack.org/429684 | 19:28 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check ironic boot configuration as a custom action https://review.openstack.org/428225 | 19:28 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action https://review.openstack.org/428178 | 19:28 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check hypervisor stats as a custom action https://review.openstack.org/429757 | 19:28 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check boot images as a custom action https://review.openstack.org/428177 | 19:28 |
| *** twi99y_ has joined #tripleo | 19:29 | |
| openstackgerrit | Brent Eagles proposed openstack/os-net-config stable/newton: Add support for enabling hotplug on interfaces https://review.openstack.org/434472 | 19:30 |
| *** sdake_ has quit IRC | 19:30 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check hypervisor stats as a custom action https://review.openstack.org/429757 | 19:31 |
| *** twi99y has quit IRC | 19:33 | |
| *** chlong has joined #tripleo | 19:36 | |
| *** fragatina has quit IRC | 19:37 | |
| *** fragatina has joined #tripleo | 19:37 | |
| *** suuuper has quit IRC | 19:42 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Setup FreeIPA to serve DNS in the setup script https://review.openstack.org/434151 | 19:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Release notes ha composable https://review.openstack.org/433765 | 19:49 |
| *** chlong has quit IRC | 19:51 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add release config for RDO stable ocata release https://review.openstack.org/434484 | 19:51 |
| mwhahaha | blah i'm getting image building failures it looks like | 19:53 |
| EmilienM | mwhahaha: where? | 19:55 |
| *** amoralej is now known as amoralej|off | 19:57 | |
| mwhahaha | EmilienM: my dev env which has traditionally meant someone changed how image building works | 19:57 |
| *** iranzo has quit IRC | 19:58 | |
| jrist | honza: remember how you said jenkins isn't making you rage anymore? | 19:58 |
| honza | jrist: oui | 19:59 |
| jrist | what's with this run lint failure for an author name change? heh | 19:59 |
| EmilienM | jrist: there is no jenkins in OpenStack for a while, fyi | 19:59 |
| EmilienM | it's zuul now :P | 19:59 |
| *** prateek has joined #tripleo | 20:00 | |
| honza | jrist: lol what | 20:00 |
| honza | jrist: and missing log file? | 20:00 |
| mwhahaha | 'ascii' codec can't encode character u'\u2018' in position 0: ordinal not in range(128) | 20:03 |
| mwhahaha | that's what i get when i try and build images | 20:03 |
| mwhahaha | anyone seen that one before? | 20:03 |
| mwhahaha | EmilienM, bnemec -^ | 20:03 |
| EmilienM | no | 20:04 |
| mwhahaha | specifically it's building the ./ironic-python-agent.d/dib-manifests | 20:04 |
| jrist | EmilienM: haha I see | 20:06 |
| jrist | honza: *breathes into bag* | 20:06 |
| bnemec | mwhahaha: Hmm, sounds like it could be related to https://review.openstack.org/#/c/431075/ | 20:07 |
| *** abehl has quit IRC | 20:07 | |
| bnemec | We had a similar issue in instack-undercloud, but I thought it was fixed in this version of the code. | 20:07 |
| mwhahaha | bnemec: is possible, revert? | 20:08 |
| bnemec | mwhahaha: Did you get a stack trace, or just the error message? | 20:09 |
| * EmilienM hurry to release :P | 20:09 | |
| mwhahaha | bnemec: no trace, just a failure and sadness | 20:09 |
| *** jkilpatr_ has joined #tripleo | 20:09 | |
| *** pabelanger has joined #tripleo | 20:09 | |
| pabelanger | o/ | 20:10 |
| pabelanger | can we get somebody to approve: https://review.openstack.org/#/c/434467/ | 20:10 |
| pabelanger | it is to help reduce the amount of logs tripleo is generating | 20:10 |
| *** prateek has quit IRC | 20:10 | |
| mwhahaha | bnemec: https://bugs.launchpad.net/tripleo/+bug/1665114 | 20:11 |
| openstack | Launchpad bug 1665114 in tripleo "building images fails with 'ascii' codec can't encode character u'\u2018' in position 0: ordinal not in range(128)" [High,Confirmed] | 20:11 |
| *** Goneri has joined #tripleo | 20:11 | |
| mwhahaha | bnemec: i'll try reverting that change in my local env and see if it works (running now) | 20:13 |
| EmilienM | mwhahaha: you want me to block release on that? | 20:13 |
| *** jkilpatr has quit IRC | 20:13 | |
| bnemec | mwhahaha: Okay. When we had this problem in instack-undercloud, https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/image_builder.py#L123 fixed it. | 20:13 |
| mwhahaha | EmilienM: yea probably | 20:14 |
| mwhahaha | not sure why we don't see this elsewhere | 20:14 |
| EmilienM | mwhahaha: is it ok if we release rc1 on 80859a9349d5d58c69d1f499ed1cad29263b96b2 ? | 20:14 |
| EmilienM | mwhahaha: which is the commit right before bnemec's one | 20:14 |
| mwhahaha | i mean we can always fix it after rc1 | 20:15 |
| mwhahaha | if no one else is hitting it | 20:15 |
| EmilienM | yeah | 20:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry https://review.openstack.org/421567 | 20:15 |
| mwhahaha | let me play with it this afternoon | 20:15 |
| * bnemec will try too | 20:16 | |
| EmilienM | mwhahaha: i'll release rc1 like this and in case of failure we'll revert it OR fix it + backport. Sounds good? | 20:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: Switch logs for TARCMD to include only specific logs https://review.openstack.org/434496 | 20:17 |
| mwhahaha | bnemec: yea that's it, i reverted that logging bit and it is now on to the overcloud-full.log | 20:17 |
| mwhahaha | bnemec: i have that utf8 line so that didn't fix it | 20:19 |
| pabelanger | EmilienM: ^ I'm going to need your help landing that change sooner then later. Can you poll your team to see what log files you actually need at the end of jobs? We found an issue with tripleo is uploading /etc/alternative from undercloud, which is adding pressure to logs.o.o | 20:20 |
| bnemec | pabelanger: The problem is we don't know what logs we need until we need them. | 20:20 |
| bnemec | Random stuff breaks all the time, unfortunately. | 20:20 |
| pabelanger | bnemec: then I would suggest adding them to the whilelist as it is grows | 20:20 |
| *** kbyrne has quit IRC | 20:22 | |
| EmilienM | pabelanger: can we include directories that might not exist? | 20:22 |
| EmilienM | pabelanger: we have some scenarios jobs that can run some services or not | 20:22 |
| pabelanger | EmilienM: I would update the tar command to check if the direct exists first, then try to tar it | 20:23 |
| bnemec | That means we're looking at a ~2 hour turnaround just to get logs when something starts failing. | 20:23 |
| bnemec | Longer than that if we need to actually merge the ci patch so it applies to other repos. | 20:23 |
| pabelanger | yes, but we currently have 12TB of data | 20:23 |
| pabelanger | and trying to reduce it | 20:23 |
| pabelanger | for some reason, tripleo is now uploading /etc/alternative from the undercloud to logs.o.o | 20:24 |
| pabelanger | which is ~1GB per patch | 20:24 |
| bnemec | And I'm totally fine with stopping that. | 20:24 |
| pabelanger | and since devstack-gate uses a whitelist approach, we should be doing the same for tripleo | 20:24 |
| EmilienM | for the short term, yes let's not upload /etc/alternative | 20:25 |
| EmilienM | for the long term, I agree with pabelanger, we need more consistency with other upstream projects, and re-use the bits when possible | 20:25 |
| openstackgerrit | Merged openstack/instack-undercloud master: Disallow IP changes on undercloud update https://review.openstack.org/432388 | 20:26 |
| bnemec | devstack != tripleo | 20:26 |
| bnemec | But whatever. | 20:27 |
| mwhahaha | well we still need to get our act together and figure out a list of stuff that we actually need | 20:27 |
| EmilienM | bnemec: what do you propose? | 20:27 |
| pabelanger | yes, because from what I see, tripleo is the highest user of log files right now | 20:27 |
| mwhahaha | realistically we should not be having to debug in CI | 20:27 |
| pabelanger | and we need to decrease it | 20:27 |
| EmilienM | mwhahaha: I disagree | 20:27 |
| EmilienM | mwhahaha: I found very useful to have debug | 20:28 |
| EmilienM | mwhahaha: moreover, devstack jobs have it | 20:28 |
| mwhahaha | thats not what i mean | 20:28 |
| pabelanger | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=717&rra_id=all for context of log.o.o usage | 20:28 |
| mwhahaha | i mean we should not be using CI to debug as we should have better ways to reproduce CI locally for debug purposes | 20:28 |
| EmilienM | mwhahaha: ah ok, I agree | 20:28 |
| pabelanger | mwhahaha: ++ | 20:28 |
| EmilienM | pabelanger: indeed :/ | 20:29 |
| EmilienM | shorterm, can we stop uploading /etc/alternative ? | 20:29 |
| pabelanger | I am working on it | 20:29 |
| bnemec | I disagree that I should have to set up a local environment to debug a gate failure. | 20:29 |
| bnemec | But like I said, whatever. Do what you want. | 20:30 |
| EmilienM | bnemec: not all of our failures are because of the gate | 20:30 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 20:30 |
| mwhahaha | i know tripleo is complex but if we don't know what we need to debug then i don't think we understand our project very well | 20:31 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add missing release notes for Ocata RC1 https://review.openstack.org/434369 | 20:32 |
| mwhahaha | i think we use the gate because it's easier than actually using our project which is a larger issue | 20:32 |
| mwhahaha | anyway | 20:34 |
| mwhahaha | bnemec: so i pinpointed the failure to https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/image_builder.py#L129-L130 | 20:34 |
| pabelanger | EmilienM: bnemec: http://logs.openstack.org/29/431029/24/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-ocata/c6090c9/ is a job in question, currently using 4GB of data. You can see, undercloud is the issue here | 20:34 |
| *** zb has joined #tripleo | 20:35 | |
| EmilienM | that: http://logs.openstack.org/29/431029/24/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-ocata/c6090c9/logs/undercloud/etc/ | 20:35 |
| EmilienM | I wonder if http://logs.openstack.org/29/431029/24/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-ocata/c6090c9/logs/etc/ would be enough | 20:35 |
| pabelanger | across all jobs for that patch, it is 18GB | 20:36 |
| EmilienM | imho, yes | 20:36 |
| EmilienM | pabelanger: that's terrible, I know | 20:36 |
| slagle | EmilienM: the reason we added all of /etc was b/c that ^^ wasn't enough | 20:36 |
| *** jerrygb has joined #tripleo | 20:36 | |
| slagle | i agree we shouldn't have to debug in CI | 20:36 |
| slagle | but you shouldn't have to reproduce locally just b/c the ci job is missing logs | 20:37 |
| slagle | so it's kind of dont know what you need until it fails thing | 20:37 |
| mwhahaha | well then you repro locally, add logs to list to be captured | 20:37 |
| slagle | sure, if that's the approach you want to take, it will certainly work | 20:38 |
| mwhahaha | given shared finite resources, it's not a want but rather more of a need | 20:38 |
| pabelanger | slagle: do you mind pointing out the patch that would be collecting everything in /etc for undercloud? | 20:39 |
| slagle | pabelanger: i don't know the patch, but i think it's actually in postci in common_functions | 20:39 |
| *** sdake has quit IRC | 20:41 | |
| *** ekuris has quit IRC | 20:43 | |
| *** sdake has joined #tripleo | 20:47 | |
| *** sdake has quit IRC | 20:47 | |
| *** sdake has joined #tripleo | 20:50 | |
| *** sdake has quit IRC | 20:56 | |
| *** saibarspeis has quit IRC | 20:57 | |
| -openstackstatus- NOTICE: We're currently battling an increase in log volume which isn't leaving sufficient space for new jobs to upload logs and results in POST_FAILURE in those cases; recheck if necessary but keep spurious rebasing and rechecking to a minimum until we're in the clear. | 20:58 | |
| *** milan has joined #tripleo | 21:00 | |
| *** ansmith has quit IRC | 21:04 | |
| EmilienM | bnemec: can you please help to look at this log issue, they are about to disable RH1 | 21:05 |
| *** ekuris has joined #tripleo | 21:06 | |
| bnemec | EmilienM: So is the problem our enabling of debug? | 21:07 |
| EmilienM | bnemec: I think /etc/alternatives is taking too much space | 21:08 |
| EmilienM | bnemec: probably on longterm we need to cleanup /etc a bit more but /etc/alternatives is really the problem today | 21:08 |
| bnemec | EmilienM: So we just need to add /etc/alternatives to the exclude lists? | 21:08 |
| bnemec | EmilienM: I'm also fine with merging https://review.openstack.org/#/c/434467 now if the alternative is shutting off rh1. | 21:09 |
| bnemec | When I left that comment I wasn't aware that this was still an immediate problem. | 21:09 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Encode log line to prevent UnicodeEncodeError https://review.openstack.org/434520 | 21:11 |
| EmilienM | bnemec: we can avoid a shutdown by exclusing /etc/alternatives and the journal | 21:12 |
| bnemec | EmilienM: Okay, I'm confused. Why are we even extracting etc? extract_logs was intentionally limited to var: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n170 | 21:13 |
| EmilienM | bnemec: I don't know yet | 21:13 |
| bnemec | EmilienM: Oh, it's slagle's fault. :-P https://github.com/openstack-infra/tripleo-ci/commit/97e770e54fe5eb9e63b1ea872cf1c8a1ad251a7b | 21:15 |
| slagle | bnemec: the logs we are being told about are for ovb | 21:15 |
| bnemec | Except that's only for infra jobs. It shouldn't affect ovb. :-/ | 21:15 |
| slagle | but yea, we can add to the blacklist | 21:15 |
| slagle | but folks seemed to be scoffing at that | 21:16 |
| EmilienM | can you submit a patch? you know better than me on that | 21:16 |
| EmilienM | just exclude /etc/alternatives for now | 21:16 |
| *** fultonj has quit IRC | 21:16 | |
| slagle | sure, it's not going to affect the type of job that was pointed out as the issue | 21:17 |
| *** fultonj has joined #tripleo | 21:17 | |
| bnemec | Yeah, I'm not sure what patch we need yet. For that matter, why is usr there? | 21:17 |
| bnemec | Oh, file not found. It's not. :-) | 21:17 |
| EmilienM | they purged | 21:18 |
| bnemec | Oh, this is the one they started deleting. | 21:18 |
| EmilienM | to release space | 21:18 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Exclude etc/alternatives https://review.openstack.org/434523 | 21:19 |
| bnemec | Hold on, was it all just that job? Our regular jobs are not uploading etc from ovb: http://logs.openstack.org/31/426231/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/5c3c958/logs/undercloud/ | 21:19 |
| slagle | EmilienM: there you go ^ | 21:19 |
| slagle | EmilienM: i really dont see how that will affect ovb jobs | 21:21 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Add ceilometer polling agent profile https://review.openstack.org/430441 | 21:21 |
| EmilienM | slagle: right, at least it will save space for multinode jobs now | 21:22 |
| bnemec | EmilienM: There's no patch I can push to fix https://review.openstack.org/#/c/431029 It's not what we're running in tripleo-ci. | 21:22 |
| bnemec | And there's no /etc/alternatives in our regular ovb jobs. | 21:22 |
| bnemec | Unless it's in the tar.xz, which I doubt since those are not 1 GB files. | 21:22 |
| sshnaidm | bnemec, EmilienM I have a patch that should reduce logs size for oooq jobs: https://review.openstack.org/#/c/425459/ | 21:22 |
| EmilienM | sshnaidm, panda|bbl, weshay: you around? | 21:23 |
| sshnaidm | EmilienM, I am, weshay is in pto | 21:23 |
| EmilienM | sshnaidm: you're only fixing oooq jobs, right? | 21:24 |
| EmilienM | sshnaidm: because it seems there is an issue on regular ovb jobs now | 21:24 |
| sshnaidm | EmilienM, in this patch - yes | 21:24 |
| EmilienM | sshnaidm: where /etc/alternatives is included | 21:24 |
| sshnaidm | EmilienM, it's in tar.xz | 21:25 |
| slagle | bnemec: i already don't see etc/alterantives in multinode jobs either | 21:25 |
| EmilienM | I don't remember having logs/undercloud/etc/ folder some time ago | 21:28 |
| sshnaidm | EmilienM, and its size 300K.. | 21:28 |
| EmilienM | sshnaidm: logs/undercloud/etc/ ? | 21:28 |
| EmilienM | sshnaidm: also why did we have logs/undercloud/usr ? | 21:28 |
| EmilienM | where does it come from | 21:28 |
| sshnaidm | EmilienM, no, in undercloud.xz file | 21:28 |
| sshnaidm | EmilienM, can you show? we should have only /var in logs/undercloud | 21:29 |
| EmilienM | they purged the directories | 21:29 |
| bnemec | EmilienM: That only happened in https://review.openstack.org/#/c/431029 AFAICT. | 21:29 |
| EmilienM | bnemec: ah | 21:30 |
| bnemec | This is why I said there's no tripleo-ci patch I can push to fix it. It isn't actually in tripleo-ci. | 21:30 |
| sshnaidm | bnemec, the problem that we collected too much logs there, is it? | 21:31 |
| *** liverpooler has quit IRC | 21:32 | |
| slagle | etc/alternatives is just symlinks anyway isn't it? | 21:32 |
| bnemec | sshnaidm: Apparently. | 21:32 |
| slagle | it's 0 KB in the logs i'm looking at | 21:33 |
| sshnaidm | bnemec, I suspect I know why.. lemme try to fix it | 21:33 |
| slagle | just a bunch of broken symlinks | 21:33 |
| bnemec | Maybe something is resolving symlinks and basically duplicating /usr/bin in /etc. | 21:33 |
| *** eck` is now known as eck`gone | 21:33 | |
| slagle | not in the jobs i'm looking at | 21:33 |
| *** jkilpatr_ has quit IRC | 21:35 | |
| *** jayg is now known as jayg|g0n3 | 21:35 | |
| slagle | in the multinode jobs, a fully exploded /etc is 7-8 MB | 21:37 |
| slagle | go figure | 21:37 |
| slagle | that doesn't really warrant "only explicitly collect what you need" for me | 21:38 |
| *** b00tcat` has joined #tripleo | 21:38 | |
| slagle | or we could just not explode it, which is purely convenience | 21:39 |
| sshnaidm | pabelanger, do you have "du" from this patch? how much each folder took | 21:40 |
| *** lblanchard has quit IRC | 21:41 | |
| *** sdake has joined #tripleo | 21:46 | |
| pabelanger | sshnaidm: http://paste.openstack.org/show/599114/ | 21:48 |
| sshnaidm | pabelanger, and logs directory? | 21:49 |
| *** ipsecguy_ has joined #tripleo | 21:51 | |
| pabelanger | sshnaidm: http://paste.openstack.org/show/599115/ | 21:52 |
| *** ipsecguy has quit IRC | 21:52 | |
| sshnaidm | pabelanger, and files (not directories) are not of big size there? | 21:54 |
| pabelanger | sshnaidm: last pastebin show undercloud as the issue | 21:54 |
| pabelanger | but, I can't get more data, files are now gone | 21:55 |
| sshnaidm | pabelanger, ok, thanks | 21:55 |
| EmilienM | pabelanger, sshnaidm, slagle, bnemec: thanks for your help. I need to be afk a while, I'll catch up later. Thanks again | 21:55 |
| *** dprince has quit IRC | 21:57 | |
| *** panda|bbl is now known as panda | 21:58 | |
| panda | mmhh | 21:58 |
| panda | I changed log collect artifacts to use the default values | 21:58 |
| *** rwsu has quit IRC | 22:04 | |
| *** panda_ has joined #tripleo | 22:05 | |
| *** panda is now known as Guest45303 | 22:05 | |
| *** Guest45303 has quit IRC | 22:05 | |
| *** Goneri has quit IRC | 22:05 | |
| *** panda_ is now known as panda | 22:05 | |
| *** trown is now known as trown|outtypewww | 22:06 | |
| panda | pabelanger: you can wipe out all the logs from those patches | 22:07 |
| panda | pabelanger: I don't know why they are taking so much space, but I'm testing the logs collection too | 22:08 |
| *** Goneri has joined #tripleo | 22:09 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 22:09 |
| sshnaidm | panda, we changed today defaults in logs role | 22:09 |
| sshnaidm | panda, pabelanger my try to fix it ^^ | 22:10 |
| sshnaidm | panda, I think it's mostly because we have collect_dir now in {{ local_working_dir }} in defaults, and this folder is archived in our oooq jobs | 22:11 |
| sshnaidm | panda, just my guess | 22:11 |
| *** jkilpatr_ has joined #tripleo | 22:12 | |
| panda | sshnaidm: I'm not testing multinode yet, those jobs fail fast | 22:12 |
| *** dsavineau has quit IRC | 22:13 | |
| *** dougbtv_ has quit IRC | 22:13 | |
| panda | 26G of data, it must be the images ... | 22:14 |
| *** b00tcat` has quit IRC | 22:14 | |
| panda | thos machines are not up that long to collect 26G of logs | 22:14 |
| panda | sshnaidm: and I'm not using the collect logs function | 22:15 |
| sshnaidm | panda, maybe it's better to noop all jobs you don't test atm | 22:16 |
| panda | only ovb-ha are involved, but that include all the stable branches toor | 22:16 |
| panda | I'll put a filter on the branch too | 22:17 |
| panda | too* | 22:17 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 22:22 |
| panda | this should block stable releases too, focusing on master | 22:23 |
| sshnaidm | panda, ok, I see multinode jobs didn't take too much space now | 22:23 |
| panda | sshnaidm: multinode jobs are not the issue, I fail fast on them, don't even start the script, immediately exit 1 | 22:23 |
| sshnaidm | panda, I think it's better to use collect-logs definitions, not to rely on defaults | 22:25 |
| panda | yeah, there must be something we collected with the default collect_list that it's not taken into consideration from upstream | 22:25 |
| panda | I didn't want to override collect list ... we have to maintain that too now :/ | 22:26 |
| sshnaidm | panda, maybe we'll have one common list with time | 22:27 |
| panda | time will heal all wounds, even scars on logs.o.o disk array. | 22:28 |
| *** rhallisey has quit IRC | 22:32 | |
| gregwork | um, when configuring the overcloud in OSP10, what is HypervisorNeutronPublicInterface and NeutronPublicInterface from a heat template pov ? | 22:32 |
| gregwork | when i deployed osp9 we had the control plane interface in the compute nic template | 22:33 |
| *** sshnaidm is now known as sshnaidm|off | 22:34 | |
| gregwork | more importantly is the web deployment UI capable of performing an install using the 'multiple-nics' network template? | 22:37 |
| *** gfidente|afk has quit IRC | 22:45 | |
| *** morazi has quit IRC | 22:45 | |
| *** dbecker has quit IRC | 22:45 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras master: Implement overcloud sanity checks role https://review.openstack.org/429716 | 22:46 |
| *** karimb has joined #tripleo | 22:48 | |
| *** milan has quit IRC | 22:48 | |
| *** dougbtv has quit IRC | 22:53 | |
| *** ansmith has joined #tripleo | 22:56 | |
| *** cdearborn has quit IRC | 22:58 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Open log in utf-8 to prevent UnicodeEncodeError https://review.openstack.org/434520 | 23:14 |
| *** limao has quit IRC | 23:18 | |
| *** limao has joined #tripleo | 23:19 | |
| *** limao has quit IRC | 23:19 | |
| *** limao has joined #tripleo | 23:20 | |
| *** jmelvin has quit IRC | 23:23 | |
| *** bfournie has quit IRC | 23:23 | |
| *** limao has quit IRC | 23:24 | |
| *** panda is now known as panda|zZ | 23:29 | |
| *** pmannidi has joined #tripleo | 23:37 | |
| *** sdake has quit IRC | 23:45 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Ansible role for built packages install https://review.openstack.org/426869 | 23:47 |
| *** dcritch has quit IRC | 23:52 | |
| *** jerrygb_ has joined #tripleo | 23:52 | |
| *** jerrygb has quit IRC | 23:53 | |
| *** dmarlin has quit IRC | 23:55 | |
| *** jerrygb_ has quit IRC | 23:59 | |
| *** jerrygb has joined #tripleo | 23:59 | |
| *** bfournie has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
