*** jbadiapa has quit IRC | 00:04 | |
*** holser has joined #tripleo | 00:50 | |
*** holser has quit IRC | 00:57 | |
*** tkajinam has quit IRC | 01:25 | |
*** lbragstad has quit IRC | 01:26 | |
*** tkajinam has joined #tripleo | 01:26 | |
*** lbragstad has joined #tripleo | 01:26 | |
*** mschuppert has quit IRC | 01:30 | |
*** d0ugal has quit IRC | 01:38 | |
*** xarlos has quit IRC | 01:39 | |
*** rlandy has quit IRC | 01:50 | |
*** d0ugal has joined #tripleo | 01:53 | |
*** cdearborn has quit IRC | 01:57 | |
*** slaweq has joined #tripleo | 02:11 | |
*** slaweq has quit IRC | 02:15 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Run multinode and undercloud jobs nova-less https://review.opendev.org/680573 | 02:27 |
---|---|---|
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Run multinode and undercloud jobs nova-less https://review.opendev.org/680573 | 02:29 |
*** holser has joined #tripleo | 03:06 | |
*** ykarel|away has joined #tripleo | 03:08 | |
*** holser has quit IRC | 03:10 | |
*** ccamacho has quit IRC | 03:11 | |
*** rh-jelabarre has quit IRC | 03:31 | |
*** rfolco has quit IRC | 03:32 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Handle non-config-download deployment types https://review.opendev.org/680957 | 03:41 |
*** rpioso has quit IRC | 03:42 | |
*** ildikov has quit IRC | 03:42 | |
*** csatari has quit IRC | 03:42 | |
*** rpioso has joined #tripleo | 03:44 | |
*** ildikov has joined #tripleo | 03:45 | |
*** csatari has joined #tripleo | 03:45 | |
*** dsneddon has quit IRC | 03:46 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Use memcached for token caching in barbican authtoken https://review.opendev.org/681371 | 03:50 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Use memcached for token caching in barbican authtoken https://review.opendev.org/681371 | 03:51 |
*** udesale has joined #tripleo | 04:00 | |
*** ykarel|away has quit IRC | 04:08 | |
*** surpatil has joined #tripleo | 04:09 | |
*** dsneddon has joined #tripleo | 04:16 | |
rakhmerov | hi, we still see this issue in our TripleO gate: https://zuul.opendev.org/t/openstack/build/3077307c007849969d54fbc709d8271c/log/job-output.txt#3620 | 04:22 |
rakhmerov | do you think something else needs to be done or it's just not enough time passed to spread out new DNS entries across the servers? | 04:22 |
*** ykarel|away has joined #tripleo | 04:25 | |
*** ykarel|away is now known as ykarel | 04:25 | |
ramishra | rakhmerov: Is this an one-off failure or happens consistently? | 04:28 |
rakhmerov | ramishra: consistently | 04:29 |
rakhmerov | for ~ 2 weeks | 04:29 |
ramishra | ykarel: do you've any idea? ^^ | 04:29 |
rakhmerov | ramishra: there was a new version of mistral-lib that is required for this patch | 04:29 |
ykarel | ramishra, which failure, an link? | 04:29 |
*** soniya29 has joined #tripleo | 04:29 | |
* ykarel checks irc logs | 04:30 | |
ramishra | ykarel: https://zuul.opendev.org/t/openstack/build/3077307c007849969d54fbc709d8271c/log/job-output.txt#3620 | 04:30 |
rakhmerov | so it should be somehow related to that but what I see in the log is something different | 04:30 |
rakhmerov | ykarel: https://zuul.opendev.org/t/openstack/build/3077307c007849969d54fbc709d8271c/log/job-output.txt#3620 | 04:30 |
ykarel | rakhmerov, same error always? i have seen this but happens randomly | 04:30 |
*** dsneddon has quit IRC | 04:30 | |
ykarel | due to network | 04:31 |
rakhmerov | I can recheck | 04:31 |
rakhmerov | but I've looked into that 2-3 times and it was always this | 04:31 |
ykarel | rakhmerov, so if i see history, it looks mostly green https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-scenario003-standalone&project=openstack%2Fmistral | 04:32 |
rakhmerov | the thing is that for other patches it's OK. This patch requires a new mistral-lib and I would expect to something related to that | 04:32 |
rakhmerov | but it seems to be unrelated | 04:33 |
rakhmerov | .. to see .. | 04:33 |
ykarel | rakhmerov, okk /me looks for 676373 all past failures, and see if i can find something | 04:33 |
rakhmerov | ok, thanks | 04:34 |
rakhmerov | appreciate your help | 04:34 |
ykarel | rakhmerov, second last failure is related to old mistral-lib | 04:36 |
ykarel | https://950a9b226a088be0e083-ada58f3685ee9000e4bc8f323c3bc042.ssl.cf2.rackcdn.com/676373/10/check/tripleo-ci-centos-7-scenario003-standalone/b223ec2/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 04:36 |
rakhmerov | 1 sec | 04:37 |
ykarel | rakhmerov, master promoted yesterday, so it has new mistra-lib 1.2.0 so it should be good now | 04:37 |
rakhmerov | aah, good | 04:37 |
ykarel | wrt mistral-lib | 04:37 |
rakhmerov | yep | 04:37 |
rakhmerov | it is now rechecked, so let's see if it's ok now | 04:37 |
rakhmerov | so most likely the network issue is sporadic? | 04:38 |
ykarel | rakhmerov, yes | 04:38 |
rakhmerov | ok | 04:38 |
*** pcaruana has joined #tripleo | 04:42 | |
rakhmerov | ykarel: https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ef9/676373/12/check/tripleo-ci-centos-7-containers-multinode/ef9175c/job-output.txt | 04:43 |
rakhmerov | this is after recheck | 04:43 |
ykarel | rakhmerov, looking | 04:44 |
rakhmerov | ok | 04:44 |
ykarel | this seems different job | 04:45 |
ykarel | multinode | 04:45 |
ykarel | this is also green, except 676373, https://zuul.opendev.org/t/openstack/builds?project=openstack%2Fmistral&job_name=tripleo-ci-centos-7-containers-multinode | 04:46 |
ykarel | the current failure is infra related for this job, let's see if 003-standalone passes | 04:47 |
*** skramaja has joined #tripleo | 04:47 | |
*** marios has joined #tripleo | 04:49 | |
*** brault has joined #tripleo | 05:00 | |
*** dsneddon has joined #tripleo | 05:03 | |
*** saneax has joined #tripleo | 05:03 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Handle non-config-download deployment types https://review.opendev.org/680957 | 05:04 |
*** brault has quit IRC | 05:05 | |
*** ratailor has joined #tripleo | 05:06 | |
*** dsneddon has quit IRC | 05:08 | |
*** slaweq has joined #tripleo | 05:11 | |
*** pcaruana has quit IRC | 05:12 | |
*** jtomasek has joined #tripleo | 05:13 | |
*** slaweq has quit IRC | 05:16 | |
*** lmiccini has joined #tripleo | 05:21 | |
*** rcernin has quit IRC | 05:22 | |
*** redrobot has quit IRC | 05:25 | |
*** marios has quit IRC | 05:33 | |
*** rcernin has joined #tripleo | 05:38 | |
*** yprokule has joined #tripleo | 05:41 | |
*** dsneddon has joined #tripleo | 05:41 | |
*** kopecmartin|off is now known as kopecmartin | 05:46 | |
*** dsneddon has quit IRC | 05:47 | |
*** rcernin has quit IRC | 05:51 | |
*** avivgt has joined #tripleo | 06:00 | |
*** rpittau|afk is now known as rpittau | 06:01 | |
*** rcernin has joined #tripleo | 06:09 | |
openstackgerrit | Luca Miccini proposed openstack/puppet-pacemaker master: Extend deep_compare to stonith resources https://review.opendev.org/679407 | 06:10 |
*** slaweq has joined #tripleo | 06:11 | |
*** slaweq has quit IRC | 06:15 | |
*** jfrancoa has joined #tripleo | 06:17 | |
*** dsneddon has joined #tripleo | 06:21 | |
*** pcaruana has joined #tripleo | 06:21 | |
*** slaweq has joined #tripleo | 06:22 | |
*** holser has joined #tripleo | 06:22 | |
*** dsneddon has quit IRC | 06:26 | |
*** radeks has joined #tripleo | 06:35 | |
*** ricolin has joined #tripleo | 06:38 | |
*** ricolin has quit IRC | 06:39 | |
openstackgerrit | Radoslaw Smigielski proposed openstack/puppet-tripleo master: Add missing response to Redis tcp-check in HAproxy https://review.opendev.org/681385 | 06:45 |
*** dsneddon has joined #tripleo | 06:55 | |
*** ykarel is now known as ykarel|lunch | 06:57 | |
*** brault has joined #tripleo | 06:57 | |
openstackgerrit | Radoslaw Smigielski proposed openstack/puppet-tripleo master: Add missing response to Redis tcp-check in HAproxy https://review.opendev.org/681385 | 06:59 |
*** dsneddon has quit IRC | 07:00 | |
*** tesseract has joined #tripleo | 07:11 | |
*** pkopec has joined #tripleo | 07:15 | |
*** hberaud|gone is now known as hberaud | 07:17 | |
*** gfidente has joined #tripleo | 07:17 | |
*** devep has joined #tripleo | 07:17 | |
devep | Morning! I have a question, I have a client who would like to not specify the tenant network during the installation. Just need a confirmation - it will require few changes in heat templates and it should be possible? | 07:20 |
*** dsneddon has joined #tripleo | 07:26 | |
*** cylopez has joined #tripleo | 07:29 | |
*** dsneddon has quit IRC | 07:30 | |
*** radeks has quit IRC | 07:34 | |
openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Support connecting OVN DB over SSL https://review.opendev.org/680345 | 07:36 |
*** jpena|off is now known as jpena | 07:37 | |
rakhmerov | ykarel|lunch: yes, it was a different job | 07:37 |
rakhmerov | standalone failed again with the same issue (still old mistral-lib) | 07:38 |
*** ccamacho has joined #tripleo | 07:38 | |
*** rcernin has quit IRC | 07:38 | |
ykarel|lunch | rakhmerov, /me looks | 07:45 |
*** ykarel|lunch is now known as ykarel | 07:45 | |
rakhmerov | ok | 07:46 |
*** dsneddon has joined #tripleo | 07:48 | |
openstackgerrit | Piotr Kopec proposed openstack/tripleo-heat-templates master: Remove libvirt packaged dependencies https://review.opendev.org/681092 | 07:49 |
*** jpich has joined #tripleo | 07:51 | |
*** dsneddon has quit IRC | 07:53 | |
*** florianf has joined #tripleo | 07:54 | |
ykarel | rakhmerov, somehow it's using old repository | 07:55 |
rakhmerov | yeah | 07:55 |
ykarel | i see mirror is also updated for current-tripleo | 07:55 |
rakhmerov | I just wonder what we can do with that | 07:55 |
ykarel | http://mirror.bhs1.ovh.openstack.org:8080/rdo/centos7/current-tripleo/ | 07:55 |
ykarel | rakhmerov, i will post one more recheck in meanwhile, | 07:58 |
rakhmerov | ok | 07:58 |
ykarel | as mistral-lib 1.2.0 is in current-tripleo, but job used old repo | 07:58 |
ykarel | seems mirror were not synched | 07:58 |
*** jbadiapa has joined #tripleo | 08:01 | |
*** marios_ has joined #tripleo | 08:05 | |
*** sshnaidm|afk is now known as sshnaidm|ruck | 08:09 | |
*** ykarel is now known as ykarel|meeting | 08:12 | |
*** ykarel_ has joined #tripleo | 08:14 | |
*** ratailor_ has joined #tripleo | 08:14 | |
*** ratailor has quit IRC | 08:16 | |
*** ykarel|meeting has quit IRC | 08:16 | |
*** ykarel_ is now known as ykarel|meeting | 08:18 | |
*** derekh has joined #tripleo | 08:20 | |
*** dsneddon has joined #tripleo | 08:22 | |
*** radeks has joined #tripleo | 08:24 | |
*** phyrox has joined #tripleo | 08:26 | |
*** tkajinam has quit IRC | 08:27 | |
*** dsneddon has quit IRC | 08:28 | |
*** lmiccini has quit IRC | 08:29 | |
*** alexmcleod has joined #tripleo | 08:31 | |
*** marios_ has quit IRC | 08:38 | |
*** marios_ has joined #tripleo | 08:45 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: ensure nova-api is running before starting nova-compute https://review.opendev.org/681042 | 08:47 |
*** phyrox has quit IRC | 08:53 | |
*** dsneddon has joined #tripleo | 08:55 | |
*** dsneddon has quit IRC | 08:59 | |
sshnaidm|ruck | EmilienM, not sure if related to podman update, but anyway: https://bugs.launchpad.net/tripleo/+bug/1843555 | 09:00 |
openstack | Launchpad bug 1843555 in tripleo "Nova conductor container fails on healthcheck" [Critical,Triaged] | 09:00 |
openstackgerrit | Michael Chapman proposed openstack/tripleo-heat-templates master: Add redis password for ml2 ansible coordination https://review.opendev.org/681298 | 09:07 |
*** gfidente has quit IRC | 09:10 | |
*** rcernin has joined #tripleo | 09:11 | |
*** marios_ is now known as marios | 09:14 | |
*** soniya29 has quit IRC | 09:18 | |
openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: Exit running validations with a proper return code https://review.opendev.org/681417 | 09:20 |
*** surpatil has quit IRC | 09:22 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Collect tempest.html in logs https://review.opendev.org/681421 | 09:24 |
owalsh | sshnaidm|ruck, EmilienM: I suspect the validations are racy. Hit this earlier and added a retry in https://review.opendev.org/#/c/681042/6/deployment/nova/nova-conductor-container-puppet.yaml@205 | 09:25 |
*** dtantsur|afk is now known as dtantsur | 09:30 | |
owalsh | I'm intentionally delaying the nova-api start to test a different race though, so figure it was due to this | 09:31 |
*** dsneddon has joined #tripleo | 09:31 | |
*** ykarel_ has joined #tripleo | 09:32 | |
*** ratailor_ has quit IRC | 09:32 | |
*** ratailor_ has joined #tripleo | 09:32 | |
*** ykarel|meeting has quit IRC | 09:34 | |
*** dsneddon has quit IRC | 09:36 | |
*** ykarel_ is now known as ykarel | 09:39 | |
*** gfidente has joined #tripleo | 09:40 | |
*** rcernin has quit IRC | 09:41 | |
*** surpatil has joined #tripleo | 09:42 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add a lookup plugin to get mistral workflow results https://review.opendev.org/575121 | 09:58 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Port the network env validation to use parameters https://review.opendev.org/547518 | 09:58 |
*** hberaud is now known as hberaud|school-r | 09:59 | |
*** hberaud|school-r is now known as hberaud | 10:02 | |
*** dsneddon has joined #tripleo | 10:07 | |
ykarel | rakhmerov, 003-standalone passed this time | 10:10 |
ykarel | multinode still running | 10:10 |
rakhmerov | ooh, good! | 10:10 |
rakhmerov | what did you do to make this happen? | 10:10 |
ykarel | rakhmerov, just recheck :) | 10:10 |
rakhmerov | :) | 10:10 |
rakhmerov | ok, you're lucky ) | 10:10 |
ykarel | mirror should have lagged behind for some reason | 10:11 |
*** saneax has quit IRC | 10:11 | |
rakhmerov | multinode usually fail very quickly | 10:11 |
rakhmerov | so I guess it will pass now | 10:11 |
ykarel | hmm let's see if it pass this time | 10:11 |
ykarel | if it fails we need to check with infra then | 10:11 |
*** dsneddon has quit IRC | 10:12 | |
*** saneax has joined #tripleo | 10:12 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Fix passing tags through infrared to the tripleo-upgrade role. https://review.opendev.org/681268 | 10:13 |
*** dsneddon has joined #tripleo | 10:15 | |
*** d0ugal has quit IRC | 10:16 | |
*** bfournie has quit IRC | 10:18 | |
*** florianf has quit IRC | 10:19 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Handle non-config-download deployment types https://review.opendev.org/680957 | 10:22 |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: ensure nova-api is running before starting nova-compute https://review.opendev.org/681042 | 10:22 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Remove deploment resource mappings for config-download https://review.opendev.org/680958 | 10:23 |
*** pkopec has quit IRC | 10:24 | |
*** pkopec has joined #tripleo | 10:26 | |
*** d0ugal has joined #tripleo | 10:30 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Imporve unit test coverage for cinder manifects https://review.opendev.org/681435 | 10:33 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Added back tempest.html and remove .stestr in logs https://review.opendev.org/681421 | 10:41 |
*** bfournie has joined #tripleo | 10:45 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Retry healthcheck validations https://review.opendev.org/681442 | 10:53 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Imporve unit test coverage for cinder manifects https://review.opendev.org/681435 | 10:54 |
*** ansmith_ has quit IRC | 11:05 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Check if docker enabled before stopping all containers. https://review.opendev.org/681215 | 11:07 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Enhance docker check verifying its socket existence. https://review.opendev.org/681444 | 11:07 |
*** cfontain has quit IRC | 11:10 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Retry healthcheck validations https://review.opendev.org/681442 | 11:12 |
*** rh-jelabarre has joined #tripleo | 11:16 | |
*** mcornea has joined #tripleo | 11:18 | |
*** dsneddon has quit IRC | 11:18 | |
*** florianf has joined #tripleo | 11:18 | |
*** sshnaidm|ruck is now known as sshnaidm|bbl | 11:20 | |
*** ykarel is now known as ykarel|afk | 11:20 | |
openstackgerrit | Radoslaw Smigielski proposed openstack/puppet-tripleo master: Add missing response to Redis tcp-check in HAProxy https://review.opendev.org/681385 | 11:26 |
*** udesale has quit IRC | 11:31 | |
EmilienM | owalsh, sshnaidm|bbl, damn ... | 11:32 |
EmilienM | sshnaidm|bbl, owalsh : we can't revert my patch since we have a new podman | 11:32 |
EmilienM | owalsh: thanks for the retry patch | 11:32 |
openstackgerrit | Michal Skalski proposed openstack/os-net-config master: Fix usage of oneOf keyword in schema https://review.opendev.org/681447 | 11:33 |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 11:39 |
*** jpena is now known as jpena|lunch | 11:40 | |
*** raildo has joined #tripleo | 11:44 | |
*** dsneddon has joined #tripleo | 11:46 | |
*** hamdyk has joined #tripleo | 11:50 | |
*** dsneddon has quit IRC | 11:51 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 11:51 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Add release note link in README https://review.opendev.org/578687 | 11:51 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 11:52 |
*** brault has quit IRC | 11:54 | |
*** brault has joined #tripleo | 11:55 | |
*** brault has quit IRC | 11:55 | |
*** brault has joined #tripleo | 11:56 | |
*** spsurya has joined #tripleo | 11:58 | |
bandini | is 'fatal: [standalone]: FAILED! => {"changed": false, "msg": "nova-conductor isn't working (healthcheck failed)"}' a known one (https://90ec13382cc0efa2ba74-f4b3e55908e5a0013f1707a18c05bdb0.ssl.cf2.rackcdn.com/679244/5/check/tripleo-ci-centos-7-scenario010-standalone/8643219/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz) ? | 12:01 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Imporve unit test coverage for cinder manifects https://review.opendev.org/681435 | 12:01 |
bandini | marios, sshnaidm|bbl: ^ ? | 12:01 |
bandini | my quick scan of tripleo bugs did not turn up anything, wondering if I am alone there | 12:01 |
owalsh | bandini: https://bugs.launchpad.net/tripleo/+bug/1843555 | 12:02 |
openstack | Launchpad bug 1843555 in tripleo "Nova conductor container fails on healthcheck" [Critical,In progress] - Assigned to Oliver Walsh (owalsh) | 12:02 |
bandini | owalsh++ thank you sir. now how on earth did my search for that not find it | 12:03 |
*** rfolco has joined #tripleo | 12:06 | |
marios | bandini: o/ looks like you have answer ( i am not ruck|rover so really not following bugs atm) | 12:06 |
marios | bandini: and not your fault looks like ruck rovers have forgotten to change their nick ;) | 12:07 |
bandini | lol | 12:08 |
* bandini lunch | 12:08 | |
*** ansmith has joined #tripleo | 12:08 | |
*** derekh has quit IRC | 12:16 | |
*** avivgt has quit IRC | 12:20 | |
owalsh | EmilienM: something I don't get about https://bugs.launchpad.net/tripleo/+bug/1842948 ... | 12:23 |
openstack | Launchpad bug 1842948 in tripleo "nova_wait_for_compute_service can be run before nova_api is up on controllers" [High,In progress] - Assigned to Oliver Walsh (owalsh) | 12:23 |
*** rlandy has joined #tripleo | 12:23 | |
owalsh | EmilienM: I was assuming pulling the image meant nova_api took longer to come up with a remote registry but we should have pulled it in step 3 for the db sync | 12:23 |
owalsh | or is podman not caching images? | 12:24 |
*** dsneddon has joined #tripleo | 12:24 | |
EmilienM | it should cache them | 12:24 |
EmilienM | are we pulling it on all controllers? I think yes, let me confirm | 12:24 |
*** lyarwood has joined #tripleo | 12:24 | |
owalsh | EmilienM: yea, pull on all but the command only runs on one | 12:24 |
owalsh | as it's wrapped in bootstrap_host_exec | 12:25 |
EmilienM | right | 12:25 |
*** ade_lee has quit IRC | 12:25 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 12:26 |
* owalsh scratches head | 12:26 | |
EmilienM | owalsh: do you see the pull at step4 ? how much time does it take? | 12:26 |
owalsh | EmilienM: not seen it yet... setting up an env now | 12:28 |
owalsh | either way it's racy but I don't understand why a remote registry would change anything | 12:28 |
*** dsneddon has quit IRC | 12:28 | |
EmilienM | owalsh: me neither (cc mcornea) - maybe some slowness which increase the race risk? | 12:29 |
mcornea | owalsh: I guess when a remote registry is used it takes longer to pull the images | 12:30 |
EmilienM | I guess it's on the compute side then? | 12:30 |
EmilienM | the compute takes time to pull the image because it wasn't pulled at step3 | 12:30 |
*** fultonj has quit IRC | 12:31 | |
*** fultonj has joined #tripleo | 12:32 | |
*** jpena|lunch is now known as jpena | 12:32 | |
owalsh | EmilienM: could be... /me starts digging into logs | 12:32 |
openstackgerrit | Merged openstack/tripleo-upgrade master: Fix container validation after overcloud update. https://review.opendev.org/681263 | 12:33 |
openstackgerrit | Merged openstack/tripleo-upgrade master: [DOC] Add note about roles_upgrade_order variable. https://review.opendev.org/631465 | 12:33 |
*** avivgts has joined #tripleo | 12:34 | |
mcornea | EmilienM: owalsh from what I've seen it takes longer for the api to come up on the controller(due to the time it takes to pull the images) and by the time when the api is up the wait condition fails on the compute side | 12:34 |
owalsh | mcornea: yea, that shouldn't happen though. We should already have the image from step 3... | 12:36 |
*** morazi has joined #tripleo | 12:36 | |
*** ykarel|afk is now known as ykarel | 12:38 | |
*** noama has joined #tripleo | 12:41 | |
*** avivgts has quit IRC | 12:42 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Enhance docker check verifying its socket existence. https://review.opendev.org/681444 | 12:43 |
*** ade_lee has joined #tripleo | 12:53 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 12:53 |
*** avivgts has joined #tripleo | 12:55 | |
*** dsneddon has joined #tripleo | 13:00 | |
*** derekh has joined #tripleo | 13:01 | |
*** ratailor_ has quit IRC | 13:02 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 13:03 |
*** dsneddon has quit IRC | 13:05 | |
*** Goneri has joined #tripleo | 13:08 | |
cloudnull | if folks have a moment to review https://review.opendev.org/#/c/677237/ it'd be greatly appreciated. | 13:10 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-heat-templates master: Configure sshd using tripleo-ansible https://review.opendev.org/675708 | 13:13 |
*** avivgts has quit IRC | 13:20 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 13:21 |
*** cylopez has quit IRC | 13:22 | |
*** jaosorior has quit IRC | 13:26 | |
*** dsneddon has joined #tripleo | 13:30 | |
*** skramaja has quit IRC | 13:32 | |
*** gbarros has joined #tripleo | 13:33 | |
*** avivgts has joined #tripleo | 13:33 | |
*** aakarsh|2 has quit IRC | 13:39 | |
*** panda is now known as panda|ruck | 13:40 | |
openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates master: Remove panko https://review.opendev.org/681478 | 13:41 |
openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates master: Disable legacy telemetry by default https://review.opendev.org/681479 | 13:41 |
*** sshnaidm|bbl is now known as sshnaidm|ruck | 13:44 | |
*** hamdykhader has joined #tripleo | 13:44 | |
*** panda|ruck is now known as panda|rover | 13:45 | |
*** hamdyk has quit IRC | 13:46 | |
*** redrobot has joined #tripleo | 13:50 | |
*** cylopez has joined #tripleo | 13:53 | |
openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates master: [WIP] Disable legacy telemetry by default https://review.opendev.org/681485 | 13:54 |
*** rpittau is now known as rpittau|afk | 13:54 | |
owalsh | EmilienM: re https://bugs.launchpad.net/tripleo/+bug/1843555 - healthchecks are failing for me on the undercloud deploy. Has something changed in podman exec? | 13:56 |
openstack | Launchpad bug 1843555 in tripleo "Nova conductor container fails on healthcheck" [Critical,In progress] - Assigned to Oliver Walsh (owalsh) | 13:56 |
openstackgerrit | Hamdy Khader proposed openstack/tripleo-heat-templates master: Add heat templates to deploy mellanox neutron agent https://review.opendev.org/674486 | 13:56 |
cloudnull | #startmeeting tripleo | 14:00 |
openstack | Meeting started Wed Sep 11 14:00:32 2019 UTC and is due to finish in 60 minutes. The chair is cloudnull. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
openstack | The meeting name has been set to 'tripleo' | 14:00 |
cloudnull | hello all, welcome to another tripleo-transformation squad meeting | 14:00 |
cloudnull | #topic rollcall | 14:01 |
*** openstack changes topic to "rollcall (Meeting topic: tripleo)" | 14:01 | |
mwhahaha | hi2u | 14:01 |
cloudnull | o/ | 14:01 |
cloudnull | I think we might be a little light, I have a feeling there's a lot of PTO going around :) | 14:01 |
openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo master: Support networking-ansible-ml2 coordination https://review.opendev.org/681293 | 14:02 |
-cloudnull- - tripleo-transformation squad meeting starting now | 14:02 | |
EmilienM | owalsh: yes, I'm still in mtg but tl;dr: new podman landed yesterday which now returns the actual return code from exec (was broken before); so healthchecks were broken before and we didn't see it | 14:03 |
cloudnull | #topic recap | 14:05 |
cloudnull | Etherpad | 14:05 |
*** openstack changes topic to "recap (Meeting topic: tripleo)" | 14:05 | |
cloudnull | #link https://etherpad.openstack.org/p/tripleo-ansible-agenda | 14:05 |
cloudnull | Work-board | 14:05 |
cloudnull | #link https://storyboard.openstack.org/#!/board/174 | 14:05 |
cloudnull | Project | 14:05 |
cloudnull | #link https://storyboard.openstack.org/#!/project/openstack/tripleo-ansible | 14:05 |
cloudnull | Open Reviews in need | 14:05 |
cloudnull | #link https://review.opendev.org/#/q/project:%255Eopenstack/tripleo-ansible+status:open+label:verified%253D%252B1%252Cuser%253Dzuul | 14:05 |
cloudnull | THT2TA work in need of reviews | 14:05 |
cloudnull | https://review.opendev.org/#/q/topic:THT2TA+(status:open) | 14:05 |
cloudnull | It would be great to get eyes on the THT2TA reviews. | 14:06 |
*** surpatil has quit IRC | 14:06 | |
cloudnull | with the cycle coming to a close I think it'd be wonderful if we could wrap those up | 14:06 |
cloudnull | #link https://review.opendev.org/#/q/topic:THT2TA+(status:open) | 14:06 |
cloudnull | #topic open-discussion | 14:06 |
*** openstack changes topic to "open-discussion (Meeting topic: tripleo)" | 14:06 | |
cloudnull | Because this is essentially mwhahaha and I, I think we can wrap this up. However, is there anything anyone wants to talk about? | 14:07 |
mwhahaha | i don't have anything | 14:07 |
cloudnull | Then I think we're done here :) | 14:07 |
cloudnull | maybe we should move this meeting to bi-weekly? | 14:08 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Imporve unit test coverage for cinder manifects https://review.opendev.org/681435 | 14:08 |
cloudnull | I'll take that question offline , anyway, take care all. | 14:10 |
cloudnull | #endmeeting | 14:10 |
*** openstack changes topic to "CI Status: GREENish RDOCloud Status: MEHish | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/" | 14:10 | |
*** Vorrtex has joined #tripleo | 14:10 | |
openstack | Meeting ended Wed Sep 11 14:10:06 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:10 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-09-11-14.00.html | 14:10 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-09-11-14.00.txt | 14:10 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-09-11-14.00.log.html | 14:10 |
*** gbarros has quit IRC | 14:15 | |
*** aakarsh|2 has joined #tripleo | 14:16 | |
*** devep has quit IRC | 14:16 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 14:17 |
*** ricolin has joined #tripleo | 14:18 | |
*** florianf has quit IRC | 14:21 | |
*** hamdykhader has quit IRC | 14:24 | |
openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Add collectd-sensubility configuration https://review.opendev.org/678863 | 14:27 |
sshnaidm|ruck | owalsh, I see it still happens in the patch: https://review.opendev.org/#/c/681442 logs - https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_df7/681442/2/check/tripleo-ci-centos-7-standalone/df7325b/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:28 |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 14:33 |
*** dsneddon has quit IRC | 14:33 | |
*** pierreprinetti has joined #tripleo | 14:33 | |
EmilienM | owalsh, sshnaidm|ruck : the issue is with https://github.com/openstack/tripleo-common/blob/master/healthcheck/common.sh#L23 | 14:37 |
*** ykarel is now known as ykarel|away | 14:37 | |
EmilienM | we bumped podman from 1.4 to 1.5 last night | 14:38 |
EmilienM | and 1.4 had broken returncode (not returning an error properly) | 14:38 |
EmilienM | so 1.5 is now returning the actual state (bad) | 14:38 |
*** nhicher has quit IRC | 14:39 | |
EmilienM | the problem is that if you run "podman exec" to manually try an healcheck, you NEED the "-u" option, as root, the process can't be found with "ss" | 14:39 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Imporve unit test coverage for cinder manifects https://review.opendev.org/681435 | 14:39 |
EmilienM | in other words, running ss -ntp | grep -qE ":($ports).*,pid=($pids)," with root doesn't produce the same output as with the e.g. nova user | 14:39 |
sshnaidm|ruck | EmilienM, and where is command that runs podman exec? | 14:40 |
*** sshnaidm|ruck is now known as sshnaidm|rover | 14:40 | |
EmilienM | owalsh: what systemd command do you run? | 14:41 |
owalsh | EmilienM: systemctl status tripleo_nova_conductor_healthcheck | 14:41 |
EmilienM | it's red for me indeed | 14:41 |
EmilienM | "There is no nova-conductor process with opened RabbitMQ ports (5671,5672) running in the container" | 14:41 |
EmilienM | I think we need to fix the root cause: https://github.com/openstack/tripleo-common/blob/master/healthcheck/common.sh#L23 | 14:41 |
EmilienM | this test is bad | 14:42 |
EmilienM | as ss doesn't print out the right thing when run with root | 14:42 |
owalsh | EmilienM: but shouldn't CI be all read? | 14:43 |
owalsh | red? | 14:43 |
*** gbarros has joined #tripleo | 14:43 | |
EmilienM | except if the healthcheck fails after the deployment, which makes no sense | 14:43 |
EmilienM | let me see | 14:43 |
owalsh | EmilienM: most of the jobs are green on https://review.opendev.org/#/c/681442, but standalone failed on the healthcheck | 14:45 |
EmilienM | http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-containers&branch=master | 14:45 |
EmilienM | if you look at a successful job: | 14:46 |
EmilienM | https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_7d1/680957/6/check/tripleo-ci-centos-7-undercloud-containers/7d1cd54/logs/undercloud/var/log/extra/services.txt.gz | 14:46 |
*** ykarel|away has quit IRC | 14:46 | |
EmilienM | â— tripleo_nova_conductor_healthcheck.service loaded failed failed nova_conductor healthcheck | 14:46 |
EmilienM | it seems it doesn't make CI failing | 14:47 |
EmilienM | Sep 11 12:13:41 undercloud.localdomain podman[237436]: There is no nova-conductor process with opened RabbitMQ ports (5671,5672) running in the container | 14:47 |
EmilienM | Sep 11 12:13:41 undercloud.localdomain podman[237436]: Error: non zero exit code: 1: OCI runtime error | 14:47 |
EmilienM | Sep 11 12:13:41 undercloud.localdomain systemd[1]: tripleo_nova_conductor_healthcheck.service: main process exited, code=exited, status=1/FAILURE | 14:47 |
EmilienM | Sep 11 12:13:41 undercloud.localdomain systemd[1]: Failed to start nova_conductor healthcheck. | 14:47 |
EmilienM | Sep 11 12:13:41 undercloud.localdomain systemd[1]: Unit tripleo_nova_conductor_healthcheck.service entered failed state. | 14:47 |
EmilienM | can be confirmed in the journal | 14:47 |
EmilienM | owalsh: to me, we should not do a retry with https://review.opendev.org/#/c/681442/ | 14:48 |
EmilienM | and fix the root cause, which is a broken healthcheck | 14:48 |
owalsh | EmilienM: retrying definitely isn't going to fix it :-) I wonder if the check passes before the first healthcheck runs | 14:49 |
owalsh | so we are racing with the 120s delay but not in the way I expected | 14:50 |
owalsh | EmilienM: may still need a retry loop to wait for a healthcheck status though | 14:51 |
EmilienM | it doesn't address the issue with https://github.com/openstack/tripleo-common/blob/master/healthcheck/common.sh#L22-L23 | 14:51 |
owalsh | EmilienM: indeed it doesn't - it's to address the fact that any jobs are green when they should all be red | 14:52 |
*** panda|rover is now known as panda|ruck | 14:52 | |
*** cylopez has quit IRC | 14:53 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 14:53 |
*** jbadiapa has quit IRC | 14:54 | |
*** florianf has joined #tripleo | 14:56 | |
*** nhicher has joined #tripleo | 14:56 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/stein: Fix container validation after overcloud update. https://review.opendev.org/681511 | 14:56 |
*** ykarel has joined #tripleo | 15:03 | |
*** dsneddon has joined #tripleo | 15:04 | |
*** ayoung has quit IRC | 15:07 | |
*** dsneddon has quit IRC | 15:08 | |
*** ayoung has joined #tripleo | 15:10 | |
*** chandankumar has quit IRC | 15:11 | |
*** chandankumar has joined #tripleo | 15:12 | |
*** bdodd has joined #tripleo | 15:24 | |
*** yprokule has quit IRC | 15:26 | |
*** gbarros has quit IRC | 15:30 | |
*** alexmcleod is now known as alexmcleod|bbl | 15:30 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Add a tasks to download amphora image for octavia deployments https://review.opendev.org/669344 | 15:30 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Preserve Octavia networks when running tempest https://review.opendev.org/670135 | 15:30 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Add a tasks to download amphora image for octavia deployments https://review.opendev.org/669344 | 15:31 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Preserve Octavia networks when running tempest https://review.opendev.org/670135 | 15:31 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 15:35 |
openstackgerrit | Merged openstack/tripleo-common stable/stein: Use blockinfile for tripleo-ssh-known-hosts https://review.opendev.org/681080 | 15:36 |
*** dsneddon has joined #tripleo | 15:36 | |
*** dsneddon has quit IRC | 15:42 | |
*** ayoung has quit IRC | 15:43 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: Add support for running tempest against Octavia featuresets https://review.opendev.org/669666 | 15:43 |
*** jaosorior has joined #tripleo | 15:44 | |
*** d0ugal has quit IRC | 15:44 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: Set the amphora image to stein branch https://review.opendev.org/678899 | 15:44 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-ci master: Change featurset for octavia standalone to support full tempest https://review.opendev.org/669740 | 15:44 |
*** xarlos has joined #tripleo | 15:44 | |
xarlos | Hi there. I just want to put it out there, that the instructions for isolated networking are inconclusive. | 15:45 |
xarlos | There's no mention of usng the generated templates. The methods described breaks the file paths. | 15:45 |
*** ayoung has joined #tripleo | 15:45 | |
xarlos | The network override.yaml doesn't even get referenced. | 15:46 |
xarlos | Does anyone disagree with me? | 15:46 |
* mwhahaha shrugs | 15:49 | |
mwhahaha | thought we had some docs referencing using the tool scripts to process them | 15:49 |
mwhahaha | hjensas|afk, bfournie might have more info | 15:49 |
hjensas|afk | xarlos: links? | 15:50 |
*** ykarel is now known as ykarel|away | 15:51 | |
*** Garyx has quit IRC | 15:53 | |
*** Garyx has joined #tripleo | 15:54 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck_port: run ss -ntp with sudo https://review.opendev.org/681525 | 15:54 |
EmilienM | owalsh: ^ | 15:54 |
EmilienM | owalsh: feel free to comment on my ps foo :D | 15:55 |
owalsh | EmilienM: cool | 15:55 |
EmilienM | owalsh: let me test now | 15:55 |
chandankumar | beagles: Hello | 15:57 |
chandankumar | beagles: can we port this fs062 to os_tempest https://review.opendev.org/#/c/678899/ as it is similar to standalone | 15:57 |
chandankumar | ? | 15:57 |
ykarel|away | EmilienM, so healthcheck_listen also faced issue? | 15:59 |
*** d0ugal has joined #tripleo | 15:59 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-ci master: Change featurset for octavia standalone to support full tempest https://review.opendev.org/669740 | 15:59 |
ykarel|away | EmilienM, in addition to healthcheck_port? | 15:59 |
EmilienM | no | 15:59 |
EmilienM | I was wrong | 15:59 |
EmilienM | I fixed it ^ | 15:59 |
EmilienM | sorry slow gerrit on my side | 16:00 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck_port: run ss -ntp with sudo https://review.opendev.org/681525 | 16:00 |
ykarel|away | okk no correct | 16:00 |
ykarel|away | s/no/now | 16:01 |
EmilienM | owalsh: healthcheck passed now | 16:01 |
EmilienM | Process: 525837 ExecStart=/usr/bin/podman exec nova_conductor /openstack/healthcheck (code=exited, status=0/SUCCESS) | 16:01 |
EmilienM | Main PID: 525837 (code=exited, status=0/SUCCESS) | 16:01 |
ykarel|away | EmilienM, so ^^ works with non root users as well? | 16:07 |
ykarel|away | i doubt non root user have sudo enabled | 16:07 |
openstackgerrit | Kamil Sambor proposed openstack/puppet-tripleo master: Support connecting OVN DB over SSL https://review.opendev.org/674849 | 16:08 |
EmilienM | ykarel|away: the healthchecks are running in systemd, with root. So they'll be able to run sudo I think | 16:09 |
ykarel|away | EmilienM, ack if they run with root, sudo should work | 16:09 |
*** dtantsur is now known as dtantsur|afk | 16:10 | |
EmilienM | we'll see how CI works | 16:10 |
ykarel|away | ack | 16:10 |
*** jfrancoa has quit IRC | 16:12 | |
*** dsneddon has joined #tripleo | 16:15 | |
sshnaidm|rover | is sudo installed there? | 16:16 |
*** hjensas|afk is now known as hjensas | 16:19 | |
hjensas | I'm seeing this issue downstream - I think after rebooting the UC. DHCP agent fail to start the dnsmasq sidecar if I get it right: container create failed: container_linux.go:345: starting container process caused "process_linux.go:430: container init caused \"write /proc/self/attr/keycreate: permission denied\"" | 16:20 |
hjensas | : internal libpod error | 16:20 |
*** dsneddon has quit IRC | 16:20 | |
hjensas | If anyone seen it before and know a quick fix, it would be appreciated. :) | 16:21 |
*** ricolin has quit IRC | 16:22 | |
openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Support connecting OVN DB over SSL https://review.opendev.org/680345 | 16:23 |
*** jpich has quit IRC | 16:24 | |
EmilienM | sshnaidm|rover: yes | 16:26 |
EmilienM | hjensas: can you run "podman --version" on the host which failed? | 16:27 |
EmilienM | it has to be 1.0.5 | 16:27 |
hjensas | EmilienM: podman version 1.0.5 | 16:27 |
openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: WIP: Support connecting OVN DB over SSL https://review.opendev.org/680345 | 16:28 |
*** chandankumar is now known as raukadah | 16:31 | |
EmilienM | hjensas: please file bz | 16:31 |
hjensas | EmilienM: ok, will do. | 16:31 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: Add support for running tempest against Octavia featuresets https://review.opendev.org/669666 | 16:32 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: Set the amphora image to stein branch https://review.opendev.org/678899 | 16:32 |
*** marios is now known as marios|out | 16:33 | |
openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: Run Sova patterns parsing in CI jobs https://review.opendev.org/678630 | 16:37 |
*** marios|out has quit IRC | 16:37 | |
hjensas | EmilienM: bz1751300 filed ... | 16:39 |
*** jpena is now known as jpena|off | 16:44 | |
*** jaosorior has quit IRC | 16:46 | |
*** jaganathan has joined #tripleo | 16:47 | |
*** dsneddon has joined #tripleo | 16:51 | |
*** ayoung has quit IRC | 16:51 | |
*** ykarel|away has quit IRC | 16:52 | |
*** holser has quit IRC | 16:53 | |
*** ayoung has joined #tripleo | 16:53 | |
openstackgerrit | Merged openstack/tripleo-ansible master: Check if docker enabled before stopping all containers. https://review.opendev.org/681215 | 16:55 |
*** dsneddon has quit IRC | 16:56 | |
*** cylopez has joined #tripleo | 16:57 | |
*** tesseract has quit IRC | 16:57 | |
xarlos | hjensas: The general link itself: https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/network_isolation.html | 16:59 |
*** derekh has quit IRC | 17:00 | |
xarlos | Following it, it seems that non-relative paths are not working in the overrites (-e ~/templates/network-environment-overrides.yaml) | 17:01 |
*** cylopez has quit IRC | 17:01 | |
openstackgerrit | Emilien Macchi proposed openstack/paunch master: Add --cpuset-cpus support for both Docker and Podman https://review.opendev.org/681257 | 17:01 |
xarlos | The reference for ```openstack overcloud deploy --templates \``` perhaps should be elaborated. (I for example use the templates in ~/generated-openstack-tripleo-heat-templates ) | 17:02 |
xarlos | Perhaps i'm not doing it correctly, but it's been a cause of many a headache :-) | 17:02 |
*** d0ugal has quit IRC | 17:04 | |
hjensas | xarlos: you should'nt use the ones in "~/generated-openstack-tripleo-heat-templates". Generating the templates is a means to generate nic config samples that you then copy out of there. | 17:05 |
hjensas | xarlos: the first example here : https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/network_isolation.html#create-network-environment-overrides-file | 17:06 |
xarlos | sure, but then ```get_file: ../../scripts/run-os-net-config.sh``` breaks. | 17:07 |
xarlos | And specifying the environment overrides as you mentioned gets ignored. | 17:07 |
*** ykarel|away has joined #tripleo | 17:08 | |
*** d0ugal has joined #tripleo | 17:09 | |
hjensas | xarlos: it does. And the doc seem to mention that the get_file need to be updated to point to /usr/share/openstack-tripleo-heat-templates/.... | 17:09 |
xarlos | (And for completeness, the docs suggest to use there in that link ```In order to configure the resource registry section of the network environment of the cluster, copy the generated net-single-nic-with-vlans.yaml file to apply the required cluster specific changes, which overrides the defaults``` | 17:10 |
xarlos | ```And the doc seem to mention that the get_file need to be updated``` I don't see this. I See about the citation of relevant or explicit, but not where to actually point in this tutorial. | 17:11 |
hjensas | xarlos: sorry, typo - "doc seem not to mention". | 17:13 |
*** gfidente has quit IRC | 17:13 | |
xarlos | I'm happy to do a bit of a writeup of my issues if it helps correct the docs for others. And future me. | 17:13 |
hjensas | xarlos: I think the doc should have something similar to the note in downstream docs. | 17:14 |
hjensas | xarlos: If creating custom NIC templates, you must set the run-os-net-config.sh script location to an absolute location for each NIC template. The script is located at /usr/share/openstack-tripleo-heat-templates/network/scripts/run-os-net-config.sh on the undercloud. | 17:14 |
xarlos | But the override file doesn't seem to ork, and expect it being the --templates argument on the deploy that's the problem too. | 17:14 |
hjensas | xarlos: https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/14/html/advanced_overcloud_customization/custom-network-interface-templates#network-interface-architecture | 17:14 |
*** ayoung has quit IRC | 17:14 | |
xarlos | yeah. I have done this too to make it work, but then I realised that the network overrides were not working, so I assume there was more to it. | 17:15 |
xarlos | I noticed a bug with the --templates directive not looking OUTSIDE of the template folders correctly too, though that was ~queens release. Perhaps it still exists? | 17:16 |
hjensas | xarlos: which network overrides are not working? | 17:16 |
*** ayoung has joined #tripleo | 17:17 | |
xarlos | hjensas: e /home/stack/templates/custom-network-configuration.yaml | 17:17 |
xarlos | This one did get read: -e /usr/share/openstack-tripleo-heat-templates/environments/network-environment.yaml <--- but then any overrides did not seem to occur. | 17:17 |
hjensas | xarlos: was | 17:18 |
hjensas | '-e /home/stack/templates/custom-network-configuration.yaml' added after '-e /usr/share/openstack-tripleo-heat-templates/environments/network-environment.yaml' in the deploy command? | 17:18 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Rename 'undercloud-' to '<stack_name>-' https://review.opendev.org/681294 | 17:22 |
hjensas | xarlos: a write up, or even better proposing a patch to the docs would be welcome! | 17:22 |
*** hberaud is now known as hberaud|afk | 17:25 | |
*** dsneddon has joined #tripleo | 17:25 | |
*** alexmcleod|bbl has quit IRC | 17:26 | |
*** sshnaidm|rover is now known as sshnaidm|off | 17:28 | |
*** hberaud|afk is now known as hberaud | 17:30 | |
xarlos | hjensas: I'd be happy to make a writeup, and if (you?) feel it's more accurate i'm happy to suggest a patch for them. | 17:31 |
*** spsurya has quit IRC | 17:32 | |
*** brault has quit IRC | 17:33 | |
hjensas | xarlos: I would'nt mind updating the doc to clarify things. And I think an operator actually trying to use it is a good fit to propose changes. As dev's we are sometimes a bit too involved and miss the important details. I'd be happy to review a patch if you propose it. :) | 17:34 |
cloudnull | anyone around to review https://review.opendev.org/#/c/680131/ and https://review.opendev.org/#/c/680132/ - the kolla patches just merged, and I'd like to get started on some downstream backports for those changes | 17:34 |
*** brault has joined #tripleo | 17:35 | |
*** brault has quit IRC | 17:35 | |
openstackgerrit | Emilien Macchi proposed openstack/paunch master: Add --cpuset-cpus support for both Docker and Podman https://review.opendev.org/681257 | 17:35 |
*** brault has joined #tripleo | 17:35 | |
EmilienM | cloudnull: done | 17:35 |
*** kopecmartin is now known as kopecmartin|off | 17:38 | |
cloudnull | tyvm ! | 17:38 |
*** ayoung has quit IRC | 17:39 | |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Rename 'undercloud-' to '<stack_name>-' https://review.opendev.org/681294 | 17:41 |
*** ayoung has joined #tripleo | 17:42 | |
*** ramishra has quit IRC | 18:00 | |
*** ykarel|away has quit IRC | 18:00 | |
openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo master: Support networking-ansible-ml2 coordination https://review.opendev.org/681293 | 18:00 |
*** ykarel|away has joined #tripleo | 18:00 | |
xarlos | hjensas: I'll whip something up | 18:05 |
*** hberaud is now known as hberaud|gone | 18:11 | |
*** Garyx has quit IRC | 18:12 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Wait for first healthcheck before running validation tasks https://review.opendev.org/681442 | 18:16 |
*** Garyx has joined #tripleo | 18:16 | |
*** panda|ruck is now known as panda|ruck|off | 18:21 | |
*** jbadiapa has joined #tripleo | 18:27 | |
*** ykarel|away has quit IRC | 18:28 | |
*** abishop_ is now known as abishop | 18:33 | |
*** radeks has quit IRC | 18:40 | |
*** d0ugal has quit IRC | 18:47 | |
*** pkopec has quit IRC | 18:51 | |
*** d0ugal has joined #tripleo | 18:52 | |
*** brault has quit IRC | 19:02 | |
*** devep has joined #tripleo | 19:08 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Wait for first healthcheck before running validation tasks https://review.opendev.org/681442 | 19:09 |
*** morazi has quit IRC | 19:16 | |
*** ade_lee has quit IRC | 19:22 | |
*** bdodd has quit IRC | 19:27 | |
*** artom has quit IRC | 19:28 | |
*** artom has joined #tripleo | 19:37 | |
*** morazi has joined #tripleo | 19:37 | |
*** ade_lee has joined #tripleo | 19:40 | |
xarlos | hjensas: Also in the docs, it's seggesting to use to-be deprecated neutron commands for the networks, should this be updated for openstack commands nowadays? https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/network_isolation.html#creating-floating-ip-networks | 19:40 |
hjensas | xarlos: yes, I'd suggest doing that in a separate patch. | 19:41 |
*** rh-jelabarre has quit IRC | 19:44 | |
*** rh-jelabarre has joined #tripleo | 19:48 | |
*** panda|ruck|off has quit IRC | 19:55 | |
*** panda has joined #tripleo | 19:57 | |
*** cdearborn has joined #tripleo | 20:04 | |
*** ayoung has quit IRC | 20:24 | |
*** ayoung has joined #tripleo | 20:24 | |
*** ansmith has quit IRC | 20:28 | |
*** ayoung has quit IRC | 20:35 | |
*** ayoung has joined #tripleo | 20:38 | |
*** rh-jelabarre has quit IRC | 20:43 | |
*** rh-jelabarre has joined #tripleo | 20:52 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: DNM: test healthcheck fix with retry https://review.opendev.org/681605 | 20:53 |
*** slaweq has quit IRC | 21:10 | |
*** morazi has quit IRC | 21:10 | |
*** slaweq has joined #tripleo | 21:11 | |
*** ade_lee has quit IRC | 21:11 | |
*** Vorrtex has quit IRC | 21:12 | |
*** rcernin has joined #tripleo | 21:15 | |
EmilienM | weshay: did we post m3 patch? | 21:15 |
weshay | EmilienM not that I know of | 21:16 |
weshay | EmilienM https://review.opendev.org/#/c/680715/ | 21:17 |
weshay | https://review.opendev.org/#/q/topic:tripleo-m3+(status:open+OR+status:merged) | 21:17 |
EmilienM | weshay: we need a patch in openstack/releases | 21:17 |
weshay | ok.. | 21:17 |
weshay | EmilienM /me gets my doc | 21:18 |
*** slaweq has quit IRC | 21:18 | |
weshay | EmilienM ok.. looks like instead of bugfix.. we use milestone – For a date-based milestone tag. | 21:20 |
weshay | EmilienM I'll go put up a patch | 21:20 |
*** mcornea has quit IRC | 21:22 | |
weshay | tox -e venv -- new-release master $i milestone ? | 21:23 |
weshay | didn't work | 21:23 |
EmilienM | master? | 21:23 |
EmilienM | train | 21:23 |
weshay | train? or designate which milestone | 21:23 |
weshay | k | 21:23 |
weshay | k.. failed on instack-undercloud ; working on the other repos | 21:24 |
* weshay looks at instack undercloud | 21:24 | |
*** noama has quit IRC | 21:26 | |
*** ade_lee has joined #tripleo | 21:27 | |
weshay | EmilienM can I go create instack-undercloud? | 21:27 |
weshay | No such file or directory: 'deliverables/train/instack-undercloud.yaml | 21:27 |
*** slaweq has joined #tripleo | 21:27 | |
weshay | meh.. I think we deprecated that repo | 21:28 |
* weshay looks | 21:28 | |
weshay | aye | 21:28 |
EmilienM | we removed instack undercloud in rocky | 21:29 |
*** slaweq has quit IRC | 21:32 | |
weshay | aye.. | 21:32 |
weshay | 1 more sec | 21:32 |
*** mcornea has joined #tripleo | 21:36 | |
weshay | EmilienM https://review.opendev.org/#/c/681617/ | 21:37 |
*** saneax has quit IRC | 21:57 | |
*** panda has quit IRC | 22:00 | |
openstackgerrit | wes hayutin proposed openstack/puppet-tripleo master: tag meta for tripleo train ml3 https://review.opendev.org/681619 | 22:02 |
weshay | might need to do ^ | 22:02 |
*** panda has joined #tripleo | 22:03 | |
*** matbu has quit IRC | 22:06 | |
*** slaweq has joined #tripleo | 22:11 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: DNM: test healthcheck fix with retry https://review.opendev.org/681605 | 22:12 |
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Run multinode and undercloud jobs nova-less https://review.opendev.org/680573 | 22:13 |
*** slaweq has quit IRC | 22:16 | |
EmilienM | weshay: no | 22:19 |
EmilienM | weshay: puppet modules can't have strings in tags | 22:19 |
EmilienM | it's a limitation in "puppet module build" command | 22:19 |
EmilienM | you only want numbers | 22:19 |
EmilienM | remove b1 and bump it | 22:19 |
EmilienM | 11.3.0 ? | 22:19 |
EmilienM | also why b1? | 22:20 |
EmilienM | just do 11.3.0 and it's good | 22:20 |
EmilienM | actually no, do nothing alex did it with https://review.opendev.org/#/c/680715/ | 22:21 |
EmilienM | we have the metadata.json ready | 22:21 |
EmilienM | just use 11.2.0 | 22:21 |
EmilienM | I updated the release patch for you, I need to go | 22:21 |
*** rlandy is now known as rlandy|bbl | 22:24 | |
EmilienM | weshay: also -1 on https://review.opendev.org/#/c/681617/, you missed components | 22:26 |
cloudnull | any change someone wants to take a look at https://review.opendev.org/#/c/677237, it'd be great to get this in to help wrap up this cycle's THT2TA work. | 22:29 |
EmilienM | core: we need reviews on https://review.opendev.org/#/c/681525/ which is fixing a critical bug in our gate | 22:34 |
EmilienM | weshay: ^ fyi | 22:35 |
EmilienM | fultonj: hey just for fun I did https://review.opendev.org/#/c/681294/ | 22:36 |
EmilienM | fultonj: i was tired to see undercloud being used when deploying standalone etc | 22:37 |
EmilienM | i would use some reviews | 22:37 |
*** threestrands has joined #tripleo | 22:37 | |
fultonj | EmilienM: oh | 22:38 |
*** jcoufal has joined #tripleo | 22:38 | |
* fultonj adds it to my list of things to review and begins process to feed daughter | 22:39 | |
EmilienM | I'm leaving now | 22:40 |
*** aakarsh|2 has quit IRC | 22:42 | |
EmilienM | weshay: another FYI | 22:48 |
EmilienM | weshay: when we produce releases, the RDO bot updates the distgits | 22:49 |
EmilienM | https://review.rdoproject.org/r/#/q/branch:stein-rdo+owner:%22rdo-trunk+%253Cjavier.pena%2540redhat.com%253E%22 | 22:49 |
EmilienM | I usually approve the patches a few hours after the tags are pushed | 22:49 |
*** raildo has quit IRC | 22:49 | |
EmilienM | weshay: you can also do it if you have +2 on these things | 22:49 |
*** paramite|clone has joined #tripleo | 22:54 | |
*** numans has quit IRC | 22:55 | |
*** paramite has quit IRC | 22:56 | |
*** tkajinam has joined #tripleo | 23:04 | |
*** mcornea has quit IRC | 23:10 | |
*** slaweq has joined #tripleo | 23:11 | |
*** saneax has joined #tripleo | 23:12 | |
*** slaweq has quit IRC | 23:15 | |
*** sanjayu_ has joined #tripleo | 23:18 | |
*** hjensas has quit IRC | 23:19 | |
*** saneax has quit IRC | 23:20 | |
*** d0ugal has quit IRC | 23:23 | |
*** d0ugal has joined #tripleo | 23:25 | |
*** hjensas has joined #tripleo | 23:28 | |
*** devep has quit IRC | 23:40 | |
*** klemorali has quit IRC | 23:54 | |
*** cdearborn has quit IRC | 23:56 | |
*** sanjayu_ has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!