| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 00:00 |
|---|---|---|
| *** lblanchard has quit IRC | 00:00 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/602248 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 00:00 |
| openstackgerrit | Merged openstack/tripleo-common master: Rename tripleo-ci-centos-7-scenario009-multinode-oooq https://review.openstack.org/619828 | 00:01 |
| *** wolverineav has quit IRC | 00:09 | |
| *** wolverineav has joined #tripleo | 00:09 | |
| *** slaweq has joined #tripleo | 00:11 | |
| *** wolverineav has quit IRC | 00:14 | |
| *** slaweq has quit IRC | 00:16 | |
| *** PagliaccisCloud has quit IRC | 00:21 | |
| *** cfontain has joined #tripleo | 00:22 | |
| *** vpickard is now known as vpickard_ | 00:25 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid random POST-RUN END RESULT_TIMED_OUT https://review.openstack.org/624381 | 00:28 |
| *** ssbarnea|rover has quit IRC | 00:34 | |
| *** wolverineav has joined #tripleo | 00:34 | |
| *** hjensas has quit IRC | 00:35 | |
| *** wolverineav has quit IRC | 00:36 | |
| *** wolverineav has joined #tripleo | 00:38 | |
| *** wolverineav has quit IRC | 00:38 | |
| *** wolverineav has joined #tripleo | 00:38 | |
| *** cfontain has quit IRC | 00:55 | |
| *** akrivoka has quit IRC | 01:06 | |
| *** akrivoka has joined #tripleo | 01:06 | |
| *** slaweq has joined #tripleo | 01:10 | |
| *** slaweq has quit IRC | 01:15 | |
| *** pbandark has quit IRC | 01:19 | |
| *** cfontain has joined #tripleo | 01:23 | |
| *** pbandark has joined #tripleo | 01:27 | |
| *** psachin has joined #tripleo | 01:31 | |
| *** pbandark has quit IRC | 01:33 | |
| *** rodolof has quit IRC | 01:40 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/557459 | 01:44 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/557465 | 01:44 |
| *** pbandark has joined #tripleo | 01:48 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Do not pass insecure and mirrors as arguments https://review.openstack.org/622627 | 01:54 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP make python uploader the default https://review.openstack.org/616019 | 01:54 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP Export images to be served by httpd https://review.openstack.org/622628 | 01:54 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Role to install apache to serve container images https://review.openstack.org/624829 | 01:54 |
| *** cfontain has quit IRC | 01:56 | |
| *** d0ugal has quit IRC | 01:56 | |
| *** mschuppert has quit IRC | 02:06 | |
| *** mrsoul has quit IRC | 02:07 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Sharing hypervisor /var/lib/ironic with ironic-conductor container https://review.openstack.org/615215 | 02:08 |
| *** d0ugal has joined #tripleo | 02:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Sharing hypervisor /var/lib/ironic with ironic-conductor container https://review.openstack.org/615219 | 02:16 |
| openstackgerrit | Merged openstack/tripleo-validations master: Drop baremetal job template https://review.openstack.org/625108 | 02:16 |
| *** cfontain has joined #tripleo | 02:24 | |
| *** rfolco has quit IRC | 02:30 | |
| *** lblanchard has joined #tripleo | 02:31 | |
| *** itlinux has joined #tripleo | 02:39 | |
| *** cfontain has quit IRC | 02:57 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP Export images to be served by httpd https://review.openstack.org/622628 | 03:02 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Role to install apache to serve container images https://review.openstack.org/624829 | 03:02 |
| *** wolverineav has quit IRC | 03:03 | |
| *** wolverineav has joined #tripleo | 03:04 | |
| *** wolverineav has quit IRC | 03:08 | |
| *** slaweq has joined #tripleo | 03:11 | |
| *** apetrich has quit IRC | 03:15 | |
| *** slaweq has quit IRC | 03:15 | |
| *** boazel has joined #tripleo | 03:24 | |
| *** boazel_ has quit IRC | 03:26 | |
| *** lblanchard has quit IRC | 03:29 | |
| *** cfontain has joined #tripleo | 03:33 | |
| *** Hazelesque has quit IRC | 03:43 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Allow for service_bootstrap_ips empty list in IpListMap https://review.openstack.org/624999 | 03:49 |
| *** ramishra has joined #tripleo | 03:49 | |
| *** Hazelesque has joined #tripleo | 03:51 | |
| *** cfontain has quit IRC | 04:05 | |
| *** udesale has joined #tripleo | 04:10 | |
| *** psachin has quit IRC | 04:10 | |
| *** slaweq has joined #tripleo | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| *** ykarel|away has joined #tripleo | 04:24 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Update tuned profile variable configuration file if it exists https://review.openstack.org/622840 | 04:27 |
| *** psachin has joined #tripleo | 04:29 | |
| *** snecklifter has joined #tripleo | 04:38 | |
| itlinux | hello all.. | 04:41 |
| itlinux | does anyone know if there is an option to have two OS::Keystone::GroupRoleAssignment | 04:41 |
| *** PagliaccisCloud has joined #tripleo | 04:44 | |
| *** pdeore has joined #tripleo | 04:50 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Switch debug to use logging classes https://review.openstack.org/620373 | 05:06 |
| *** pbandark has quit IRC | 05:07 | |
| *** wolverineav has joined #tripleo | 05:08 | |
| *** slaweq has joined #tripleo | 05:11 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Update tuned profile variable configuration file if it exists https://review.openstack.org/622840 | 05:14 |
| *** slaweq has quit IRC | 05:16 | |
| *** agopi has quit IRC | 05:17 | |
| *** krypto has quit IRC | 05:20 | |
| *** agopi has joined #tripleo | 05:25 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Update tuned profile variable configuration file if it exists https://review.openstack.org/622840 | 05:32 |
| *** cfontain has joined #tripleo | 05:33 | |
| *** tzumainn has quit IRC | 05:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: mistral-executor: bind-mount undercloud.conf when validations are enabled https://review.openstack.org/624623 | 05:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Ensure we get dedicated logging file for HAProxy https://review.openstack.org/620601 | 05:40 |
| *** ratailor has joined #tripleo | 05:51 | |
| *** wolverineav has quit IRC | 05:51 | |
| *** zaneb has quit IRC | 05:52 | |
| *** hjensas has joined #tripleo | 05:58 | |
| *** snecklifter has quit IRC | 06:06 | |
| *** cfontain has quit IRC | 06:07 | |
| *** ykarel|away is now known as ykarel | 06:11 | |
| *** agopi has quit IRC | 06:13 | |
| *** agopi has joined #tripleo | 06:18 | |
| *** saneax has joined #tripleo | 06:23 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Flatten Glance service configuration https://review.openstack.org/624719 | 06:24 |
| *** agopi has quit IRC | 06:25 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Flatten Ironic services configuration https://review.openstack.org/625025 | 06:25 |
| *** hakhande_ has joined #tripleo | 06:33 | |
| *** aufi has joined #tripleo | 06:34 | |
| *** cfontain has joined #tripleo | 06:36 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Ensure we actually pass parameters to parent template https://review.openstack.org/621105 | 06:44 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Flatten Zaqar service configuration https://review.openstack.org/624952 | 06:45 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/rocky: Imported Translations from Zanata https://review.openstack.org/625158 | 06:48 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/625159 | 06:49 |
| *** jtomasek has quit IRC | 06:52 | |
| *** rcernin has quit IRC | 07:03 | |
| *** jtomasek has joined #tripleo | 07:06 | |
| *** cfontain has quit IRC | 07:10 | |
| *** quiquell|off is now known as quiquell | 07:11 | |
| quiquell | Good morning | 07:11 |
| quiquell | marios_|ruck: o/ | 07:11 |
| *** slaweq has joined #tripleo | 07:11 | |
| *** PagliaccisCloud has quit IRC | 07:12 | |
| marios_|ruck | o/ quiquell | 07:12 |
| *** pcaruana has joined #tripleo | 07:12 | |
| quiquell | marios_|ruck: Let's try to merge the container prep https://review.openstack.org/#/c/621517/ | 07:14 |
| quiquell | chem: ^ are you ok with it ? | 07:14 |
| quiquell | marios_|ruck: Well first we need this https://review.openstack.org/#/c/624656/, so we don't break f28 | 07:14 |
| quiquell | Fuck... ovb break there | 07:15 |
| quiquell | Well, let's merge the updat e prep then we fix f28 stuff | 07:15 |
| quiquell | So we can merge the sceanrios | 07:15 |
| quiquell | what do you tink ? | 07:15 |
| *** slaweq has quit IRC | 07:16 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/rocky: Call etcd scaleup playbook when adding master nodes https://review.openstack.org/625163 | 07:17 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/rocky: Configure registry to use gluster https://review.openstack.org/625164 | 07:17 |
| *** mschuppert has joined #tripleo | 07:18 | |
| marios_|ruck | quiquell: ack will check them | 07:20 |
| quiquell | marios_|ruck: Do we need something to review ? | 07:20 |
| marios_|ruck | quiquell: not really, scen1/4 are just waiting for the /#/c/621517/ (want to vote here https://review.openstack.org/#/c/619508/ ? you already voted on 4) | 07:21 |
| quiquell | marios_|ruck: ready to vote all of them if they have the Depends-On in the other | 07:21 |
| quiquell | marios_|ruck: even put the +w so they get merge after the other get merge | 07:21 |
| quiquell | Let's close stuff | 07:22 |
| quiquell | marios_|ruck: scenairo004 miss rocky in the job | 07:23 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Flatten Glance service configuration https://review.openstack.org/624719 | 07:23 |
| * Tengu has a bad feeling with the flatening tasks regarding merge conflict | 07:24 | |
| Tengu | -.-' | 07:24 |
| Tengu | pretty sure it will be a wack-a-mole game. | 07:24 |
| quiquell | Tengu: prepare the hammer | 07:24 |
| Tengu | it's ready. heavy, dripping with blood of former moles. | 07:25 |
| Tengu | >:| | 07:25 |
| *** ksambor has joined #tripleo | 07:26 | |
| quiquell | marios_|ruck: so rocky will run multinode and standalone scenarios ? | 07:26 |
| marios_|ruck | quiquell: just saw your comment. well i think the plan is to get it to rocky at least. perhaps we should remove from rocky though until master merges | 07:28 |
| quiquell | marios_|ruck: ack, then we replace at rocky too, since we ned to merge the THT change at rocky for the prep containers | 07:28 |
| marios_|ruck | quiquell: i can update those. but https://github.com/openstack-infra/tripleo-ci/blob/40b50f763c943ececc3bd37c9e8c92e3c431497e/zuul.d/standalone-jobs.yaml#L89 scen3 merged like that so we need to change that too | 07:29 |
| quiquell | marios_|ruck: Going to change the sceanrio002 so only master runs standalone scenario0042 | 07:29 |
| quiquell | marios_|ruck: let's change scenario003 too | 07:29 |
| quiquell | YOu take care of 1/4 I take care of 2/3 ack ? | 07:29 |
| marios_|ruck | quiquell: k | 07:29 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario001-standalone job https://review.openstack.org/619508 | 07:31 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Add tripleo-ci-centos-7-scenario004-standalone job https://review.openstack.org/619520 | 07:31 |
| marios_|ruck | quiquell: ^ | 07:31 |
| quiquell | marios_|ruck: ack | 07:34 |
| quiquell | Preparing the others | 07:34 |
| quiquell | marios_|ruck: btw, going to remove tripleo-ci-centos-7-scenario002-multinode-oooq-container-refstack | 07:35 |
| quiquell | No one is using it | 07:35 |
| quiquell | Argg no | 07:36 |
| quiquell | It's suppose to run at experimental, but I don't see it in the experimental project layout | 07:37 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add standalone scenario002 job https://review.openstack.org/618709 | 07:39 |
| quiquell | marios_|ruck: going to change 003 in the same review | 07:39 |
| quiquell | ok ? | 07:39 |
| marios_|ruck | quiquell: sounds good (re refstack job i don't know about that do you want me to dig?) | 07:40 |
| quiquell | marios_|ruck: na let's leave it, it's not run at experimental either | 07:40 |
| *** ssbarnea|rover has joined #tripleo | 07:40 | |
| quiquell | marios_|ruck: we have to talk with chandan_kumar , let's merge the scenarios | 07:40 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add standalone scenario002 job https://review.openstack.org/618709 | 07:41 |
| quiquell | marios_|ruck: ^ done | 07:41 |
| hjensas | can we merge this please - https://review.openstack.org/625129 | 07:41 |
| *** slaweq has joined #tripleo | 07:42 | |
| quiquell | hjensas: Holy sh... people already using it | 07:42 |
| quiquell | hjensas: merging | 07:42 |
| quiquell | hjensas: I don't see it in the zuul check jobs | 07:43 |
| hjensas | quiquell: yeah, maby I did'nt do it right? | 07:43 |
| hjensas | quiquell: but we need to get it back, we did disable the job that covered it in multinode - https://github.com/openstack-infra/tripleo-ci/commit/b8a3dd2ef679adcb34b0eaecd616f26a1efaf285#diff-cfdb98a345b32c677b1068d84f8f838f | 07:44 |
| quiquell | hjensas: If you want standalone scenarios | 07:44 |
| quiquell | hjensas: You can use the new template | 07:44 |
| quiquell | hjensas: tripleo-standalone-scenarios-full | 07:45 |
| *** skramaja has joined #tripleo | 07:45 | |
| marios_|ruck | quiquell: hjensas: i think its cos of files here ? https://review.openstack.org/#/c/625129/1/zuul.d/layout.yaml | 07:45 |
| marios_|ruck | i mean why it didn't run | 07:45 |
| quiquell | marios_|ruck: yep, layout.yaml is not included there | 07:45 |
| *** snecklifter has joined #tripleo | 07:46 | |
| hjensas | yeah, I can push a depends on patch that change designate files to verify? | 07:46 |
| quiquell | hjensas: or add layout, you can being changed job | 07:46 |
| marios_|ruck | hjensas: yeah sounds good but its non voting anyway (still would be nice to see it) | 07:46 |
| quiquell | marios_|ruck: layout.yaml have to be at files | 07:46 |
| quiquell | marios_|ruck: you can break the job changing stuff there like overriding vars and the like | 07:47 |
| marios_|ruck | hjensas: (seems like you know this but since i went looking for it anyway .. .;) https://zuul-ci.org/docs/zuul/user/config.html#attr-job.files ) | 07:47 |
| quiquell | marios_|ruck: should he use the new template tripleo-standalone-scenarios-full ? | 07:47 |
| *** slaweq has quit IRC | 07:47 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid random POST-RUN END RESULT_TIMED_OUT https://review.openstack.org/624381 | 07:47 |
| quiquell | hjensas: btw, This is going to be only for master rocky is not going to run it for the moment, in case you want to backport stuff | 07:48 |
| *** psachin has quit IRC | 07:48 | |
| marios_|ruck | quiquell: where do you mean (for the template) ? maybe better to comment on the rview? | 07:49 |
| *** jfrancoa has joined #tripleo | 07:50 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: DNM - Validating scenario003 standalone job in check https://review.openstack.org/625168 | 07:50 |
| quiquell | marios_|ruck, hjensas: Commented https://review.openstack.org/#/c/625129 | 07:51 |
| *** slaweq has joined #tripleo | 07:51 | |
| quiquell | Let's address that before +2 +w | 07:51 |
| *** saneax has quit IRC | 07:51 | |
| quiquell | marios_|ruck: the standalone sceanrios take less time now, so maybe we can exercise full scenarios now at projects | 07:51 |
| hjensas | quiquell: https://review.openstack.org/625168 - in zuul status runs: tripleo-ci-centos-7-scenario003-standalone (non-voting) | 07:51 |
| quiquell | hjensas: yep, but maybe is not bad that zuul.d/ stuff appears on files, so you ensure that the CI part of tht is good if you change it | 07:52 |
| *** saneax has joined #tripleo | 07:52 | |
| quiquell | hjensas: You are not going to change it so much, so it's not a big deal | 07:53 |
| quiquell | hjensas: Imaging you break the other jobs after changing layout.yaml you will don't know if you don't add zuul.d to them | 07:53 |
| *** yprokule has joined #tripleo | 07:54 | |
| hjensas | quiquell: I get it, but non of the other jobs do that. Would it not be better to do a separate change and adding it to all jobs? | 07:54 |
| quiquell | marios_|ruck: Do you know something about this https://review.openstack.org/#/c/624683/ ? | 07:54 |
| skramaja | ramishra: thanks for updating the patch, i thought i would do it today. i have +2ed. thanks. | 07:54 |
| quiquell | hjensas: Well, maybe we can do a little of boyscout there and add in the same review | 07:55 |
| marios_|ruck | quiquell: no didn't see it happened after i left last night? | 07:55 |
| quiquell | hjensas: At the end is a CI change review | 07:55 |
| marios_|ruck | quiquell: (oh no since 12th?) | 07:55 |
| quiquell | hjensas: we can fix tht CI in the same review | 07:55 |
| quiquell | marios_|ruck: Don't know... it's really needed ? | 07:55 |
| marios_|ruck | quiquell: well if they pass then lets keep them ? (lets see on the scenarios, maybe merge those first before this) | 07:57 |
| quiquell | marios_|ruck: They are adding new tests there | 07:58 |
| quiquell | marios_|ruck: A no it's skip | 07:58 |
| quiquell | marios_|ruck: It only affects scenario002 ? | 07:58 |
| ramishra | skramaja: np:) thanks! | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/602248 | 08:00 |
| quiquell | marios_|ruck: scnario001 uses telemetry too | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 08:00 |
| marios_|ruck | quiquell: (don't know man, but thats what the commit says, Barbican and telemetry is being executed on scenario002" | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 08:00 |
| marios_|ruck | quiquell: yup looks like https://github.com/openstack/tripleo-heat-templates/blob/c4b816e8c5e9eff2de73cf7006d3e47bfa295b90/ci/environments/scenario002-standalone.yaml#L2 | 08:01 |
| quiquell | marios_|ruck: So let's merge skip list/and container prep first | 08:01 |
| quiquell | marios_|ruck: then the sceanrios ack ? | 08:01 |
| *** amoralej|off is now known as amoralej | 08:02 | |
| *** snecklifter has quit IRC | 08:02 | |
| marios_|ruck | quiquell: (sure but it only affects 2 so doesn't have to matter to 1/3/4) | 08:02 |
| quiquell | marios_|ruck: It affects 1 too | 08:02 |
| marios_|ruck | checking | 08:02 |
| quiquell | marios_|ruck: so let's merge container prep first | 08:02 |
| quiquell | marios_|ruck: since it affects all of them | 08:03 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add tripleo-ci-centos-7-scenario003-standalone job https://review.openstack.org/625129 | 08:03 |
| marios_|ruck | quiquell: ah telemetry for 1 yes | 08:03 |
| quiquell | chem: are you around ? | 08:04 |
| quiquell | chem: Is the container prep ok ? https://review.openstack.org/#/c/621517/ | 08:04 |
| quiquell | marios_|ruck: ... I don't ge t the last comment from rfolco | 08:07 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Don't wait on ERROR VM state https://review.openstack.org/624750 | 08:08 |
| quiquell | marios_|ruck: he says that tests are passing https://review.openstack.org/#/c/624683 | 08:08 |
| quiquell | we can have skiplist + whitelist ? | 08:08 |
| quiquell | why do we need this if they are passing ? | 08:08 |
| *** apetrich has joined #tripleo | 08:09 | |
| quiquell | Ahh they are being "removed" from skip list | 08:10 |
| quiquell | So looks like we can merge this thing | 08:10 |
| quiquell | marios_|ruck: so let's merge the skip list change https://review.openstack.org/#/c/624683 since we can merge this right now | 08:11 |
| *** nkinder has quit IRC | 08:19 | |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Transitioning to HAProxy 1.8 https://review.openstack.org/607856 | 08:26 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Cleanup irrelevant scripts from previous releases. https://review.openstack.org/615370 | 08:29 |
| *** hberaud|gone is now known as hberaud | 08:31 | |
| *** florianf_ has joined #tripleo | 08:34 | |
| *** paramite has joined #tripleo | 08:37 | |
| chem | quiquell: hey, I can't see where the backup file goes I've got the feeling it's not saved in the log | 08:37 |
| chem | quiquell: not blocking, but really it would help (me?) to understand this mangling better :) | 08:37 |
| chem | quiquell: or i'm missing something http://logs.openstack.org/17/621517/26/check/tripleo-ci-centos-7-standalone/3cd1ce5/logs/undercloud/home/zuul/ | 08:38 |
| quiquell | chem: collect-logs is not recollecting them | 08:43 |
| quiquell | I think | 08:43 |
| chem | quiquell: yeah, I think so too. I'm trying to get why it take 30min more, and then I'll +2/+a if you're ok with the patch in its current state | 08:45 |
| *** kopecmartin|off is now known as kopecmartin | 08:45 | |
| * chem looking comparing standalone-deploy logs | 08:45 | |
| quiquell | chem: 30m is normal you can compare with undercloud containers | 08:45 |
| quiquell | chem: lok at ARA | 08:46 |
| chem | quiquell: yeah it's all in the standalone deploy that the +30min happens | 08:46 |
| chem | quiquell: used to take 35min now it's 1h | 08:46 |
| quiquell | chem: so we have "/home/zuul/*.yml", | 08:48 |
| quiquell | "/home/zuul/*.yaml", | 08:48 |
| quiquell | chem: I suppose ansible is adding a suffix to it, that's why it's not saving it | 08:48 |
| chem | quiquell: I think it's adding the date like 201812... | 08:48 |
| *** jpena|off is now known as jpena | 08:48 | |
| quiquell | chem: from ansible doc it generated something like "/path/to/file.txt.2015-02-12@22:09~" | 08:49 |
| quiquell | add suffix | 08:49 |
| quiquell | We have to chagne collectlogs | 08:49 |
| quiquell | Do you want it for +2 ? or we can do it later on ? | 08:49 |
| quiquell | Let me put the fix in place in a new review | 08:50 |
| *** tosky has joined #tripleo | 08:53 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add yaml* to collect-logs https://review.openstack.org/625182 | 08:54 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add yaml* to collect-logs https://review.openstack.org/625182 | 08:54 |
| quiquell | chem: ^ | 08:54 |
| chem | quiquell: cool, thanks will look | 08:55 |
| quiquell | chem: Can we have a +2 without it in the container prep stuff? we need it to start to merge standalone + scenarios, so we replace multinode vrsion of it at master | 08:55 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Run Update/Upgrade ansible playbook outside of mistral https://review.openstack.org/625126 | 08:58 |
| chem | quiquell: oki, I've got it, so we're updating the repo inside the container and rebuilding it running yum upgrade, and all that happen in http://logs.openstack.org/17/621517/26/check/tripleo-ci-centos-7-standalone/3cd1ce5/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 08:59 |
| chem | quiquell: and it takes ~25min | 08:59 |
| chem | quiquell: and we do that for *all* containers \o/ | 09:00 |
| quiquell | chem: At least is done in parallel depending on the number of threads | 09:01 |
| quiquell | chem: Same same as undercloud containers | 09:01 |
| quiquell | chem: There are plans to do this offline at a job so our containers are ready | 09:01 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Remove unused params in jinja renderec network config templates https://review.openstack.org/625187 | 09:01 |
| *** shardy has joined #tripleo | 09:01 | |
| quiquell | chem: But if you have a change for example at some of the RPMs at containers you need them to update it | 09:01 |
| quiquell | chem: to really test the review | 09:02 |
| chem | quiquell: yeah, that make totally sense | 09:02 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Remove unused params in jinja rendered network config templates https://review.openstack.org/625187 | 09:02 |
| chem | quiquell: just it's sad we can't update a *base* container once where the update takes place and then rebuild all container on top of this | 09:03 |
| quiquell | chem: more complex stuff would be to use a base image and rebuild kolla from them, so we do the upgrade only ones | 09:03 |
| quiquell | :-/ | 09:03 |
| quiquell | But that's coooomplex | 09:03 |
| quiquell | chem: you have read my mind, all is possible | 09:03 |
| *** cylopez has joined #tripleo | 09:04 | |
| chem | quiquell: :), yeah rigth, surprisigly obvious thing can became super complex in the container world in no time :) | 09:04 |
| chem | quiquell: but it's friday and all is good with your patch, so let's merge it ? | 09:05 |
| quiquell | chem: I am starting to thing that for developers containers are very convenient, but not the case for deployments | 09:05 |
| quiquell | chem: Let's drink in the weekend and forget for next week | 09:05 |
| chem | quiquell: right, let's just do that :) | 09:07 |
| openstackgerrit | Thomas Herve proposed openstack/python-tripleoclient master: Remove unused services in tripleo deploy https://review.openstack.org/624086 | 09:07 |
| quiquell | chem: ^ this reduces time there | 09:07 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Fix the ironic_inspector config file in the switch-vlans validation https://review.openstack.org/624744 | 09:09 |
| chem | quiquell: yeah, but that's the heat stage and currently for the one node deployment it takes ~15min for heat to calculate that one node resource | 09:09 |
| chem | quiquell: I don't see much to gain here (but I just glanced at the review and may missed something) | 09:10 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Remove unused params in jinja rendered network config templates https://review.openstack.org/625187 | 09:10 |
| *** gfidente|afk is now known as gfidente | 09:14 | |
| chem | quiquell: merged and did a lp for standalone-upgrade assigned to me https://bugs.launchpad.net/tripleo/+bug/1808509 | 09:15 |
| openstack | Launchpad bug 1808509 in tripleo "Standalone upgrade doesn't upgrade the packages inside the master container." [High,New] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 09:15 |
| *** ccamacho has joined #tripleo | 09:20 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Sharing hypervisor /var/lib/ironic with ironic-conductor container https://review.openstack.org/615216 | 09:21 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Allow mysql options to be set for the HA bundle https://review.openstack.org/625192 | 09:29 |
| *** cfontain has joined #tripleo | 09:35 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/rocky: Add additional tuning options for mariadb/galera https://review.openstack.org/625196 | 09:37 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/queens: Add additional tuning options for mariadb/galera https://review.openstack.org/625197 | 09:38 |
| *** rodolof has joined #tripleo | 09:48 | |
| *** rodolof has quit IRC | 09:56 | |
| *** rodolof has joined #tripleo | 09:56 | |
| *** ksambor has quit IRC | 09:57 | |
| *** ykarel is now known as ykarel|lunch | 10:00 | |
| *** jfrancoa has quit IRC | 10:04 | |
| *** suuuper has joined #tripleo | 10:05 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Run Update/Upgrade ansible playbook outside of mistral https://review.openstack.org/625126 | 10:07 |
| *** jfrancoa has joined #tripleo | 10:18 | |
| *** moguimar has joined #tripleo | 10:28 | |
| *** agopi has joined #tripleo | 10:31 | |
| *** ykarel|lunch is now known as ykarel | 10:32 | |
| *** salmankhan has joined #tripleo | 10:34 | |
| *** agopi has quit IRC | 10:36 | |
| *** cfontain has quit IRC | 10:38 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-common stable/queens: Generating fencing for capitalized MACs https://review.openstack.org/625203 | 10:39 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Removing barbican and telemetry from skiplist https://review.openstack.org/624683 | 10:41 |
| ykarel | marios_|ruck, i see tests failing in scenario002 ^^ | 10:46 |
| openstackgerrit | Javier Peña proposed openstack/tripleo-quickstart-extras master: Build packages using DLRN in reverse order https://review.openstack.org/600792 | 10:46 |
| ykarel | quiquell, ^^ can't get why those removed | 10:46 |
| marios | ykarel: looking quiquell scen 2^ | 10:46 |
| marios | damn | 10:47 |
| marios | ykarel: wait you mean on the check non voting? | 10:48 |
| marios | ykarel: or where | 10:48 |
| ykarel | scenario002 non voting | 10:48 |
| marios | ykarel: cos we are removing those scenarios they shouldn't be voting anywhere. | 10:48 |
| marios | ykarel: yeah so the idea is we will see if those tests pas for standalone 2 | 10:48 |
| ykarel | but this will affect promotion jobs | 10:48 |
| marios | ykarel: we are gating/promoting on scen2? | 10:48 |
| ykarel | yes fs017 | 10:48 |
| marios | ykarel: quiquell then we must revert that https://review.openstack.org/#/c/624683/ immediately quiquell | 10:49 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Revert "Removing barbican and telemetry from skiplist" https://review.openstack.org/625206 | 10:49 |
| ykarel | good to check barbican part, if it's fine add telemetry again else revert | 10:49 |
| marios | quiquell: ^^ ykarel | 10:49 |
| quiquell | They were working | 10:50 |
| ykarel | quiquell, where? | 10:50 |
| marios | ykarel: yeah the telemetry was meant to be fixed apparently but barbican was the unkown one | 10:50 |
| marios | (from alex commit message) | 10:50 |
| quiquell | http://logs.openstack.org/09/618709/32/check/tripleo-ci-centos-7-scenario002-standalone/96700ba/logs/tempest.html.gz | 10:50 |
| quiquell | ykarel: rfolco comment on the review | 10:50 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Revert "Removing barbican and telemetry from skiplist" https://review.openstack.org/625206 | 10:51 |
| shardy | Anyone feel like a yaql challenge? :) | 10:51 |
| quiquell | ykarel: it's tested agains this review, that's why we are merging it | 10:51 |
| marios | quiquell: but lets merge the jobs first, then this | 10:51 |
| ykarel | quiquell, if u see there telemetry test were skipped | 10:51 |
| marios | quiquell: is what we should have done. its like we are intentionally delaying ourselves. especially if it breaks promotions | 10:51 |
| quiquell | ykarel: shit you are right it's spkipped | 10:52 |
| marios | quiquell: i know i +A it so i have to take responsibility. | 10:52 |
| marios | quiquell: but lets revert please vote | 10:52 |
| quiquell | marios: I pushed you sorry | 10:52 |
| marios | quiquell: heh no i have to take responsibility and then not do it so easily next time | 10:52 |
| quiquell | marios: +2, I think you can +2 it so I +w | 10:52 |
| quiquell | marios: we need this | 10:53 |
| shardy | http://paste.openstack.org/show/737290/ if anyone wants to take a look, I need to repeat adding the service_name for each key | 10:53 |
| ykarel | yup should not ignore results from non-voting job | 10:53 |
| quiquell | ykarel: thanks! | 10:53 |
| marios | ykarel:++ | 10:53 |
| * shardy tries repeat for .keys | 10:53 | |
| marios | sorry my yaql is weak at best. i like to stare at it for a while though trying to understand it. trouble is how/where do you test it | 10:54 |
| marios | shardy: ^ | 10:54 |
| shardy | marios: heh yeah mine was OK but now a little rusty - I'm testing with a small heat stack | 10:54 |
| shardy | I'll get it eventually, probably just need another coffee :) | 10:54 |
| *** hberaud is now known as hberaud|lunch | 10:55 | |
| marios | shardy: ack yeah i was hoping you'd point me to some online service/parser for it. | 10:55 |
| marios | shardy: well good luck :) | 10:55 |
| shardy | marios: there is an online one IIRC, and a CLI parser | 10:56 |
| shardy | I'm just more familiar with doing it in a minimal template | 10:56 |
| marios | shardy: ack no need to distract you i'll search for it. ack thanks | 10:56 |
| *** PagliaccisCloud has joined #tripleo | 10:59 | |
| *** iurygregory is now known as iury|lunch | 11:03 | |
| *** ksambor has joined #tripleo | 11:05 | |
| *** trozet has quit IRC | 11:07 | |
| *** rfolco has joined #tripleo | 11:16 | |
| *** derekh has joined #tripleo | 11:17 | |
| quiquell | marios: this looks good now https://review.openstack.org/#/c/625129, scenario003 at tht | 11:25 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid random POST-RUN END RESULT_TIMED_OUT due to du execution https://review.openstack.org/624381 | 11:28 |
| *** iury|lunch is now known as iurygregory | 11:29 | |
| openstackgerrit | melissaml proposed openstack/tripleo-specs master: fix a typo in specs/policy/expedited-approvals.rst https://review.openstack.org/625220 | 11:34 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Remove package exclusion from yum and dnf https://review.openstack.org/624656 | 11:46 |
| *** pdeore has quit IRC | 11:47 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Add standalone scenario002 job https://review.openstack.org/618709 | 11:48 |
| *** hberaud|lunch is now known as hberaud | 11:48 | |
| Tengu | hey folks, PTAL before the weekend? :) https://review.openstack.org/#/c/624719/ | 11:49 |
| Tengu | I would love avoiding a 3rd conflict... | 11:49 |
| *** raildo has joined #tripleo | 11:50 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Dump toci_gate_test.sh execution to toci.sh https://review.openstack.org/625227 | 11:58 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Dump toci_gate_test.sh execution to toci.sh https://review.openstack.org/625227 | 11:59 |
| quiquell | chem: now we have the backupo http://logs.openstack.org/82/625182/2/check/tripleo-ci-centos-7-standalone/d54108a/logs/undercloud/home/zuul/ | 12:00 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Enable tempest for fedora28 standalone https://review.openstack.org/618056 | 12:03 |
| *** vinaykns has joined #tripleo | 12:03 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add updates to standalone containers prep https://review.openstack.org/621517 | 12:04 |
| quiquell | marios: ^ let's merge !!! | 12:04 |
| *** dciabrin has quit IRC | 12:04 | |
| *** salmankhan has quit IRC | 12:06 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Improve speed of collect_logs.sh https://review.openstack.org/625229 | 12:07 |
| *** salmankhan has joined #tripleo | 12:09 | |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart master: Remove tripleo newton and ocata jobs https://review.openstack.org/619900 | 12:10 |
| *** udesale has quit IRC | 12:11 | |
| quiquell | rfolco: Is my comment right ? https://review.openstack.org/#/c/625129 | 12:14 |
| rfolco | quiquell, replying there | 12:14 |
| quiquell | rfolco: ack, maybe it does not make sense to add template, since they have to add "files" section there | 12:16 |
| quiquell | gfidente, chem: Can you help us with +2 at the standalone scenario 1 https://review.openstack.org/#/c/619508/ ? | 12:17 |
| *** bfournie has joined #tripleo | 12:17 | |
| chem | quiquell: hey, thanks for the logging, looking at the review in a few | 12:18 |
| quiquell | chem: Can you help with the scenario review ? we can merge them now but mnissing a +2 | 12:18 |
| chem | quiquell: well zuul -1 it ... | 12:19 |
| quiquell | chem: https://review.openstack.org/#/c/619508/ | 12:19 |
| chem | quiquell: yeap, that one :) | 12:19 |
| chem | quiquell: several timeouts | 12:19 |
| *** vinaykns has quit IRC | 12:19 | |
| quiquell | chem: fuck... totally unrelated, but yes :-( | 12:19 |
| quiquell | ssbarnea|rover, marios_|ruck: Are we having timeouts around ? | 12:20 |
| *** pcaruana has quit IRC | 12:21 | |
| ssbarnea|rover | yes, but random on post, random likely to du but fix is in progress, in few hours I should know for sure if it works. | 12:21 |
| *** hberaud is now known as hberaud|afk | 12:21 | |
| quiquell | ssbarnea|rover: I saw the reviews, ack thanks, so it's underterministic ? | 12:21 |
| ssbarnea|rover | quiquell: please have a look at https://review.openstack.org/#/c/624381/12 | 12:21 |
| *** pcaruana has joined #tripleo | 12:22 | |
| ssbarnea|rover | yes, with 1:25 chance of happening *per* job with due to number of jobs caused far more downvotes | 12:22 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common master: Add new Ansible role tripleo-container-backend. https://review.openstack.org/621553 | 12:22 |
| *** rh-jelabarre has joined #tripleo | 12:23 | |
| quiquell | ssbarnea|rover: we don't want to decrease post-timeout at jobs ? | 12:23 |
| chem | quiquell: quick question, why not rocky ? | 12:23 |
| ssbarnea|rover | let me know how it looks at first inspection. i changed direction several times while working on it. | 12:23 |
| quiquell | chem: I think we want to do that when we are able to remove multinode from rocky, it need some reviews to do so | 12:24 |
| quiquell | chem: so we will do reviews to remove multinode + review to activate standalone | 12:24 |
| marios | quiquell: containers multinode? or where? | 12:24 |
| ssbarnea|rover | currently timeout is set to 60m, which is unresonably high, but this failures are permanent failure due to deadlock, are not due to just being slow. | 12:24 |
| chem | quiquell: rigth, understood | 12:24 |
| *** vkapalav has joined #tripleo | 12:24 | |
| marios | quiquell: ah scen 1 (looking | 12:24 |
| quiquell | yep | 12:24 |
| *** pcaruana is now known as pcaruana|intw| | 12:25 | |
| marios | ssbarnea|rover: containers multinode timeouts :) ^ | 12:25 |
| *** cylopez has quit IRC | 12:25 | |
| quiquell | ssbarnea|rover: 60m post ? It was like 30m last time I saw that holy... | 12:25 |
| ssbarnea|rover | quiquell: true, that's the value I remember too, but I can assure you that now is 60, is very easy to spot in logs. probably was increased by someone. | 12:25 |
| ssbarnea|rover | with 30 we could timeout naturally on bigger logs, but 60 seems far too much, and what is worse is that we have to wait another hour to get the failure in this case. | 12:26 |
| quiquell | ssbarnea|rover: big issue | 12:26 |
| quiquell | ssbarnea|rover: Commented https://review.openstack.org/#/c/624381 | 12:27 |
| ssbarnea|rover | the fact that it occurs in only ~1:25 it makes it non-critical, but big, that's why I am working to address it. | 12:27 |
| quiquell | ssbarnea|rover: we cannot make job pass with timeouts... | 12:27 |
| quiquell | ssbarnea|rover: We can have like a legit collect logs bad stuff in the review that does not have to merge | 12:28 |
| quiquell | This will introduce false positives man | 12:28 |
| hjensas | shardy: did you get you yaql working? | 12:29 |
| marios_|ruck | quiquell: rfolco oof scenario 3 standalone @ 2hr 48 @ https://review.openstack.org/#/c/619508/17 | 12:29 |
| ssbarnea|rover | quiquell: i disagree here, remember that the entire collect_logs.sh content is some kind of "|| true" | 12:29 |
| quiquell | ssbarnea|rover: it depends on the review | 12:30 |
| marios_|ruck | rfolco: quiquell its too close. and its standalone. we need to look at that and if its tempest trim it down | 12:30 |
| quiquell | ssbarnea|rover: the review can be replacing sleep 1000000 | 12:30 |
| quiquell | ssbarnea|rover: we have to look at timeouts if they happend | 12:31 |
| quiquell | ssbarnea|rover: it's a fucking pain in the ass I know but sometimes they are legit at post | 12:31 |
| *** jpena is now known as jpena|lunch | 12:31 | |
| quiquell | marios_|ruck: :-((((( | 12:31 |
| ssbarnea|rover | quiquell: look at http://logs.openstack.org/81/624381/10/check/tripleo-ci-centos-7-containers-multinode-queens/2a4a4ce/ | 12:31 |
| ssbarnea|rover | ~1h for zuul to kill the POST, this is what happens, only due to the f** du. | 12:33 |
| ssbarnea|rover | we should alias du to fu. | 12:33 |
| Tengu | hmm. why is "du" used in fact? | 12:33 |
| ssbarnea|rover | Tengu: to generate a report of the biggest log folders. | 12:34 |
| quiquell | marios_|ruck: tempest took 5 minutes | 12:34 |
| rfolco | quiquell, marios_|ruck standalone job is like ios code update on older iphones, sleep() everywhere to run slower and force users to buy new hardware | 12:34 |
| Tengu | ssbarnea|rover: hmm ok. guess it's usefuly for some reason? | 12:34 |
| quiquell | ssbarnea|rover: so we discover it because timeouts does not pass, so they cannot mark as pass | 12:34 |
| *** ratailor has quit IRC | 12:34 | |
| *** cfontain has joined #tripleo | 12:34 | |
| marios_|ruck | quiquell: ack then its bad cos tempest would be the easy problem to solve | 12:34 |
| ssbarnea|rover | we do this before running rsync. yes it is very useful as rsync can timeout alter if we try to upload the world. | 12:34 |
| quiquell | marios_|ruck: standalone took 2 hours | 12:34 |
| Tengu | right, ok | 12:35 |
| quiquell | marios_|ruck: but 2 hours take the whole standalone job | 12:35 |
| quiquell | marios_|ruck: one of the services there makes standalone take longer :-( | 12:35 |
| ssbarnea|rover | Tengu: but I decided to take a different approach, runnig it with nohup & | 12:35 |
| ssbarnea|rover | it it gets stuck, bad luck, but at least it will not fail the POST for this reason alone. | 12:36 |
| Tengu | ssbarnea|rover: yeah, saw your patch, liked it - at least it should not lock up the tasks while it's calculating | 12:36 |
| ssbarnea|rover | Tengu: Ideally I should try to rsync the file again after the normal rsync but I am waiting for results to see if this is needed. | 12:36 |
| ssbarnea|rover | because rsync will likely start before du finishes the report. | 12:36 |
| openstackgerrit | Merged openstack/tripleo-docs master: undercloud: add a note about --use-heat option. https://review.openstack.org/625074 | 12:37 |
| Tengu | ssbarnea|rover: guess using "find -size" has no value... ? at least it might help filtering out the du? | 12:37 |
| Tengu | ssbarnea|rover: rsync has a nice -P option for stats, speed and size output. didn't check if it was used. | 12:37 |
| ssbarnea|rover | we cannot use find, i tried. that's is because we still need to report total sizes. | 12:38 |
| ssbarnea|rover | Tengu: i tried rsync stats too, incompatible with ansible syncronize module, generates spam. we could bypass it using bash and rsync directly probably. | 12:38 |
| *** skramaja has quit IRC | 12:39 | |
| quiquell | marios_|ruck, rfolco: normal standalone with container prep http://logs.openstack.org/17/621517/26/check/tripleo-ci-centos-7-standalone/3cd1ce5/job-output.txt.gz#_2018-12-13_12_12_51_563871 | 12:39 |
| quiquell | 3649.34s | 12:39 |
| ssbarnea|rover | mainly the rsync being stupid: "rsync --quiet --stats" generates no stats. | 12:39 |
| quiquell | scenario003 http://logs.openstack.org/08/619508/17/check/tripleo-ci-centos-7-scenario003-standalone/503f121/job-output.txt.gz#_2018-12-14_09_59_27_330446 | 12:39 |
| Tengu | ssbarnea|rover: ah, yeah, synchronize... a bit lame imho. | 12:39 |
| quiquell | 7223.28s | 12:39 |
| ssbarnea|rover | i had to use sed to filter rsync stats output to extract one line that I am interested about. | 12:39 |
| Tengu | erf. so sometimes broken pipe right? | 12:40 |
| *** rodolof has quit IRC | 12:40 | |
| ssbarnea|rover | is that coincidence that is almost exactly 2h ? | 12:40 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 12:40 |
| *** rodolof has joined #tripleo | 12:41 | |
| ssbarnea|rover | Tengu: not sometimes, always. I have lots of attempts to fix it LOTS (in the last 3-4 months). | 12:41 |
| Tengu | guess so, seeing the amount of timed_out and post_failures :/ | 12:42 |
| rfolco | hjensas, please see my comment at https://review.openstack.org/#/c/625129/... I hope I did not confuse you more :) | 12:42 |
| Tengu | fact is, `du' is nasty and doesn't like when we have lot's of file, or recursion. | 12:42 |
| Tengu | maybe there are other tools at FS level? | 12:42 |
| Tengu | ssbarnea|rover: what's the FS on the CI nodes? xfs maybe? | 12:43 |
| ssbarnea|rover | i suspect someone is messing with the stdin/stdout causing this, likely zuul streamer, and this being a side effect. apparently affects only du|sort|head usage. | 12:43 |
| Tengu | buffering? | 12:43 |
| Tengu | du can take long. | 12:43 |
| ssbarnea|rover | no idea, I asked the same question two hours ago. i know for sure that NFS can hang. | 12:43 |
| Tengu | redrobot: deep tree, many files | 12:43 |
| quiquell | marios_|ruck, rfolco: 1 hour of container prep :-( http://logs.openstack.org/08/619508/17/check/tripleo-ci-centos-7-scenario003-standalone/503f121/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-12-14_08_10_32 | 12:43 |
| Tengu | erf... redrobot sorry -.-' | 12:44 |
| quiquell | marios_|ruck, rfolco: 22 minutes normal standalone http://logs.openstack.org/17/621517/26/check/tripleo-ci-centos-7-standalone/3cd1ce5/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-12-13_11_00_43 | 12:44 |
| ssbarnea|rover | in fact I suspect that my trick with treshold would be enough because "sort" could also be the cause, give it 1M files and see how well it behaves, especially if you do not have too much RAM. | 12:44 |
| Tengu | oh. ssbarnea|rover if there is xfs on the CI: xfs_estimate | 12:44 |
| Tengu | it's... wow. | 12:44 |
| ssbarnea|rover | by using treshold on du, we limit what we sent to sort. | 12:45 |
| Tengu | pretty fucking fast as hell | 12:45 |
| sri_ | shardy, Hi quick question, I am using compute-dvr (OS::TripleO::ComputeDVR) role in my overcloud, but in ips-from-pool-all.yaml the compute ports look like this OS::TripleO::Compute::Ports::ExternalPort. I suppose to change that to OS::TripleO::ComputeDVR::Ports::ExternalPort right ? | 12:45 |
| Tengu | ssbarnea|rover: time xfs_estimate / xfs_estimate / 0.08s user 0.46s system 96% cpu 0.560 total | 12:45 |
| rfolco | quiquell, do we have a bug for it ? | 12:45 |
| Tengu | that's nothing to compare with du :D | 12:45 |
| quiquell | rfolco: for what ? | 12:45 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add tripleo-ci-centos-7-scenario003-standalone job https://review.openstack.org/625129 | 12:45 |
| ssbarnea|rover | Tengu: this is not only to get the big total, we want to see whom takes the most. also i would not like to take a FS specific approach. | 12:46 |
| Tengu | ssbarnea|rover: something like "find <path> -type d -maxdepth X -exec xfs_estimate '{}' \;" should do | 12:46 |
| ssbarnea|rover | on my system adding the treshhold made du run from 15s to 1s. | 12:47 |
| Tengu | ssbarnea|rover: well, sometimes, it's a path to follow if we want better perfs. | 12:47 |
| rfolco | quiquell, nm this is the new container prep for standalone, right? | 12:47 |
| Tengu | ssbarnea|rover: also, there's a max-depth on du... ? | 12:47 |
| quiquell | rfolco: same thing as undercloud | 12:47 |
| rfolco | k k | 12:47 |
| ssbarnea|rover | Tengu: it makes it useless, no longer usable total. | 12:47 |
| Tengu | ah, yeah, because it won't count content, of course. | 12:48 |
| * Tengu loves the xfs_estimate thing | 12:48 | |
| ssbarnea|rover | ... *if* your FS is xfs. | 12:48 |
| Tengu | but of course, it will work only on xfs :D | 12:48 |
| Tengu | yeah. | 12:48 |
| quiquell | rfolco: what's the differende between scenario001 and scenario004 ? later takes 1:51 minute to run | 12:48 |
| Tengu | well, rhel/centos/fedora are using xfs by default... ? | 12:48 |
| Tengu | so for those at least it might be a thing. ubuntu probably stick with ext4 -.-. | 12:49 |
| *** cfontain has quit IRC | 12:49 | |
| ssbarnea|rover | Tengu: it seems that my patch is blazing fast: see http://logs.openstack.org/81/624381/12/check/tripleo-ci-fedora-28-standalone/09f4ff4/logs/log-size.txt | 12:50 |
| Tengu | 0s ?? | 12:51 |
| ssbarnea|rover | yep! not a mistake. | 12:51 |
| Tengu | wow. | 12:51 |
| Tengu | that's pretty nice. | 12:51 |
| Tengu | wondering how `du' does that with the threshold. | 12:51 |
| quiquell | ssbarnea|rover: you are using hard linking at the end ? | 12:51 |
| Tengu | in order to ignore <size> it should know that size... | 12:51 |
| ssbarnea|rover | but this was the first job, lets see on others. probably I will have to run 2-3 rechecks just to see if results are consistent. | 12:52 |
| Tengu | yup | 12:52 |
| ssbarnea|rover | quiquell: that's some extra optimizations I added on a sperate patch, https://review.openstack.org/#/c/625229/ -- hardlinking and parallel compression. didn't want to pile too much in du one. | 12:53 |
| ssbarnea|rover | they are not the same issue, is the same area but different aspects. | 12:53 |
| *** iurygregory is now known as iurygregory|mtg | 12:53 | |
| quiquell | ssbarnea|rover: cool this is geting interesting | 12:53 |
| ssbarnea|rover | usually collect logs total duration was under 10m. | 12:53 |
| ssbarnea|rover | if everything works we may see cutting like 10m from average build duration. | 12:54 |
| ssbarnea|rover | should be visible in graphs is true | 12:54 |
| *** fultonj has quit IRC | 12:54 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Ensure we do not remove logs with very, very few traffic https://review.openstack.org/616945 | 12:54 |
| *** fultonj has joined #tripleo | 12:55 | |
| quiquell | rfolco, marios_|ruck: I think scenario003 near 3 hours is transitory http://dashboard-ci.tripleo.org/d/FEdraO0ik/jobs-exploration?orgId=1&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-7-scenario003-standalone | 12:58 |
| *** dprince has joined #tripleo | 12:59 | |
| quiquell | limestone provider is always problematic for that job | 12:59 |
| marios_|ruck | quiquell: ack good to know so it might happen for the others too | 12:59 |
| shardy | sri_: Yes the resource names are auto-generated based on the roles_data.yaml role names | 13:00 |
| *** ykarel has quit IRC | 13:00 | |
| shardy | the docs only show examples for the default role names | 13:00 |
| *** ansmith has joined #tripleo | 13:00 | |
| quiquell | marios_|ruck: yep we have to monitor this, but we have to improve the container prep, taking it offline or something like that | 13:00 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Improve speed of collect_logs.sh https://review.openstack.org/625229 | 13:01 |
| *** ykarel has joined #tripleo | 13:01 | |
| sri_ | shardy, understood, thanks :) | 13:01 |
| quiquell | ykarel: container prep merged, we can start to merge scenarios :-) | 13:01 |
| ykarel | quiquell, looks like scenarios have some miss | 13:02 |
| *** morazi has joined #tripleo | 13:02 | |
| quiquell | ykarel: what miss ? | 13:02 |
| ykarel | quiquell, services miss, wrt to revert done recently(skip list one) standalone scenario002(telemetry test skipped) and multinode scenario002(telemetry test failed) | 13:04 |
| *** abishop has joined #tripleo | 13:04 | |
| ykarel | so i think it's good to check those standalone are scenarios are identical wrt to what's being tested | 13:04 |
| ssbarnea|rover | marios_|ruck: quiquell ykarel : take a look at https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/oooq_common_functions.sh.j2#L115 -- do we suppose to override that file or this was a copy/paste bug? | 13:05 |
| ssbarnea|rover | you see last file is the same on all 3 lines.... looks like a bug to me. | 13:06 |
| quiquell | ykarel: so we remove the +w from them ? | 13:06 |
| *** ksambor has quit IRC | 13:06 | |
| ykarel | ssbarnea|rover, i don't know about those left sides, but considering the fact there is if elif it looks correct | 13:07 |
| *** weshay_pto is now known as weshay | 13:07 | |
| ykarel | as only one will be true | 13:07 |
| lyarwood | egonzalez: finally looking at the placement kolla changes btw, just pushed a revised version that doesn't remove the nova-placement service until after the kolla-ansible changes land, otherwise all of the kolla-ansible jobs fail. | 13:07 |
| weshay | ssbarnea|rover, marios_|ruck morning.. need anything? | 13:07 |
| ykarel | quiquell, which patches are those with +W, adding standalone scenarios or replacing multinode with standalone | 13:08 |
| ssbarnea|rover | weshay: a good stake and glass of red, please! | 13:08 |
| egonzalez | lyarwood sure, now in k-ansible nova is failing due other reasons, placement works | 13:08 |
| quiquell | ykarel: They add scenario and skip multinode from master | 13:08 |
| weshay | ssbarnea|rover, I'll have one shipped immediately | 13:09 |
| quiquell | ykarel: https://review.openstack.org/#/c/619508/17/zuul.d/multinode-jobs.yaml | 13:09 |
| *** moguimar has quit IRC | 13:10 | |
| ykarel | quiquell, i think if those are not complete yet with respect to services being tested those should not be replaced | 13:11 |
| *** trown|outtypewww is now known as trown | 13:11 | |
| ykarel | i haven't looked at those jobs so can't say | 13:11 |
| quiquell | ykarel: at least 1 and 2 | 13:11 |
| quiquell | ykarel: they use telemetry | 13:11 |
| quiquell | ykarel: 4 can be ok ? | 13:11 |
| marios_|ruck | weshay: o/ this one is a promotion blocker https://bugs.launchpad.net/tripleo/+bug/1808349 been digging and pinging folks today | 13:11 |
| openstack | Launchpad bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 13:11 |
| ykarel | quiquell, /em have not checked | 13:11 |
| marios_|ruck | weshay: its in the etherpad anyway | 13:11 |
| quiquell | ykarel: https://review.openstack.org/#/c/619520/ | 13:12 |
| weshay | marios_|ruck, ya.. was just reading through that | 13:12 |
| weshay | marios_|ruck, david simard used to be the guy who was responsible for the rdo registry | 13:13 |
| ykarel | marios_|ruck, that is due to kolla patch adding zaqar-server, zaqar-base containers instead of zaqar | 13:13 |
| ykarel | weshay, no it's nothing to do with registry | 13:13 |
| weshay | oh /me looks again | 13:13 |
| weshay | ykarel, what's up | 13:13 |
| marios_|ruck | weshay: especially annoying since we were waiting for the containers-build to unblock promotions | 13:13 |
| marios_|ruck | ykarel: ++ | 13:13 |
| *** quiquell is now known as quiquell|lunch | 13:13 | |
| marios_|ruck | weshay: can we please have ykarel on our team | 13:13 |
| marios_|ruck | or like clone him | 13:14 |
| quiquell|lunch | marios_|ruck: going to remove +w from scenario004 ykarel has some doubts about it | 13:14 |
| ykarel | marios_|ruck, weshay https://review.openstack.org/#/c/610929/ cause the https://bugs.launchpad.net/tripleo/+bug/1808349 | 13:14 |
| openstack | Launchpad bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 13:14 |
| quiquell|lunch | marios_|ruck: ack ? | 13:14 |
| weshay | I've already asked to clone him, but he's one of a kind :) | 13:14 |
| *** hberaud|afk is now known as hberaud | 13:14 | |
| ykarel | quiquell|lunch, /me didn't looked those scenarios, so it's up to u guys, the issue i seen in scenario002 | 13:15 |
| quiquell|lunch | ykarel: let's us verify it before ẠẠ+w, thanks again mate | 13:15 |
| weshay | ykarel, so.. just making sure I understand... | 13:15 |
| quiquell|lunch | lunch time !!! | 13:15 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 13:15 |
| weshay | https://review.openstack.org/#/c/610929/ causes the container to not be found? | 13:15 |
| *** moguimar has joined #tripleo | 13:15 | |
| weshay | Update a single zaqar image to zaqar-server and zaqar-wsgi | 13:16 |
| weshay | images. | 13:16 |
| weshay | oh ya | 13:16 |
| weshay | I see | 13:16 |
| weshay | ykarel++ | 13:16 |
| lyarwood | egonzalez: I don't anything failing just yet, mind if I keep working on the change this afternoon? | 13:16 |
| weshay | marios_|ruck, so ya.. now we have two containers | 13:16 |
| ykarel | weshay, yup | 13:16 |
| weshay | ykarel, nice catch | 13:16 |
| egonzalez | lyarwood sure, from ansible part only upgrade tasks are missing | 13:16 |
| weshay | ya.. good practice to check for any changes to kolla when the build fails | 13:17 |
| egonzalez | images are working atm | 13:17 |
| weshay | marios_|ruck, ssbarnea|rover /me wonders if we could launch a 3rd party job on openstack/kolla on any change that builds but doesn't push containers | 13:17 |
| weshay | that may help | 13:18 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Enable tempest for fedora28 standalone https://review.openstack.org/618056 | 13:18 |
| ykarel | weshay, both required, building containers , and then deploying those | 13:18 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Install correct python version packages at tempest https://review.openstack.org/618721 | 13:18 |
| ykarel | just building containers will not help | 13:18 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Remove package exclusion from yum and dnf https://review.openstack.org/624656 | 13:18 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Enable tempest for fedora28 standalone https://review.openstack.org/618056 | 13:18 |
| ykarel | in this case atleast | 13:18 |
| ssbarnea|rover | there is something i do not understand: how can a job finish succesfully without doing all its job (pushing being a part of it, right). | 13:19 |
| ssbarnea|rover | doing a build without publishing the result is a failure AFAIK. | 13:19 |
| *** EmilienM is now known as EvilienM | 13:20 | |
| weshay | ssbarnea|rover, f28 is phun no? | 13:20 |
| ykarel | ssbarnea|rover, the container-build job pushes containers to rdo registry, then other jobs consumes those container images | 13:20 |
| *** moguimar has quit IRC | 13:20 | |
| ssbarnea|rover | weshay: not as fun as rovering | 13:20 |
| weshay | ykarel, I'll run the idea of a check job on kolla | 13:20 |
| ykarel | container build job is passing, the once consuming fails as it can't find the required container | 13:20 |
| weshay | by the team | 13:20 |
| weshay | ssbarnea|rover, lolz | 13:20 |
| ykarel | weshay, ack | 13:20 |
| weshay | ykarel, wdyt.. master only? | 13:21 |
| marios_|ruck | ykarel: right and the containers build job was green all of yesterday | 13:21 |
| marios_|ruck | ykarel: (but i didn't know about the 'new' zaqar container) | 13:21 |
| ykarel | weshay, master would be good start, i don't think we get failures in others | 13:21 |
| weshay | we'll have to weigh the job cost.. vs.. having it just kick in periodic | 13:22 |
| weshay | that's a fairly active repo | 13:22 |
| ssbarnea|rover | BRB in 1h, doctor appt. | 13:22 |
| weshay | k | 13:22 |
| marios_|ruck | weshay: either way yes absolutely should do but as with all the other things, until we can make them vote it won't stop us from breaking us | 13:23 |
| ykarel | marios_|ruck, so what happens after the kolla patch, zaqar-base, zaqar-server, zaqar-wsgi container images are build, but failing jobs are looking for image named "zaqar" | 13:23 |
| ykarel | makes sense now? | 13:23 |
| weshay | marios_|ruck, ykarel so we need to patch tripleo-common | 13:23 |
| marios_|ruck | ykarel: ack thanks | 13:23 |
| ykarel | weshay, yup but i doubt the job will pass in gate if we change the name of image as it will look for that image in docker.io | 13:23 |
| marios_|ruck | https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml.j2#L886 this weshay ? | 13:24 |
| weshay | ya | 13:24 |
| weshay | marios_|ruck, ya.. and the static file that sits next to it.. I think | 13:24 |
| marios_|ruck | weshay: k doing | 13:24 |
| weshay | ykarel++ | 13:24 |
| weshay | marios++ | 13:24 |
| *** moguimar has joined #tripleo | 13:24 | |
| ykarel | weshay, fs010 running in check/gate i think, right | 13:26 |
| marios_|ruck | but hold on do we also need parameters in tht weshay probably | 13:26 |
| marios_|ruck | for each image | 13:26 |
| weshay | ya ur right | 13:26 |
| marios_|ruck | weshay: not ++ for me its all ykarel | 13:26 |
| weshay | marios_|ruck, that's a tripleo mtg thing? | 13:26 |
| marios_|ruck | ykarel:++ | 13:26 |
| weshay | marios_|ruck, who is responsible for zaqar | 13:26 |
| marios_|ruck | weshay: dono i'd say flapper cos he invented it :) but he's out i think | 13:27 |
| weshay | marios_|ruck, should we consider removing zaqar from the deployment? | 13:27 |
| weshay | until it's fixed? | 13:27 |
| marios_|ruck | weshay: shouldn't be too hard to post 2 patches lets try that for now. but yeah maybe also post that patch to remove. since it is blocking master promote, which is already >10 days old now | 13:28 |
| weshay | marios_|ruck, cloud/App | 13:29 |
| weshay | marios_|ruck, need a big sev1 escalation on that DFG for this | 13:29 |
| *** ykarel is now known as ykarel|afk | 13:29 | |
| *** moguimar has quit IRC | 13:29 | |
| marios_|ruck | weshay: i filed the escalation card for it yesterday fyi | 13:29 |
| marios_|ruck | weshay: (prod chain trello) | 13:30 |
| weshay | marios_|ruck, I see it | 13:30 |
| weshay | can summarize this recent info to the bug | 13:30 |
| * weshay marking it alert as well | 13:30 | |
| weshay | so we can get some folks on it | 13:31 |
| weshay | marios_|ruck, k.. updated the card | 13:33 |
| *** moguimar has joined #tripleo | 13:34 | |
| *** weshay is now known as weshay1-1 | 13:34 | |
| *** jpena|lunch is now known as jpena | 13:35 | |
| *** rlandy has joined #tripleo | 13:37 | |
| *** iurygregory|mtg is now known as iurygregory | 13:38 | |
| *** moguimar has quit IRC | 13:38 | |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Infrastructure for the nodes page https://review.openstack.org/625255 | 13:39 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Split zaqar to zaqar-server and zaqar-wsgi https://review.openstack.org/625256 | 13:39 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Update tuned profile variable configuration file if it exists https://review.openstack.org/622840 | 13:40 |
| *** dciabrin_ has joined #tripleo | 13:40 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 13:41 |
| *** vpickard_ is now known as vpickard | 13:42 | |
| *** toure|gone is now known as toure | 13:43 | |
| *** moguimar has joined #tripleo | 13:43 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Move [neutron] auth_url to KeystoneV3Internal https://review.openstack.org/625257 | 13:44 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix horizon's iptables rules for haproxy when split off a separate role https://review.openstack.org/625258 | 13:45 |
| *** derekh has quit IRC | 13:47 | |
| *** moguimar has quit IRC | 13:48 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Split zaqar to zaqar-server and zaqar-wsgi https://review.openstack.org/625259 | 13:48 |
| *** lblanchard has joined #tripleo | 13:48 | |
| marios | weshay1-1: mandre totally incomplete ^^^ only realy added the zaqar-server will likely need "zaqar folks" to dig more | 13:49 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Split zaqar to zaqar-server and zaqar-wsgi https://review.openstack.org/625256 | 13:49 |
| Tengu | marios: erf... care to rebase on https://review.openstack.org/624952 ? | 13:50 |
| Tengu | oh, sorry, tripleo-common | 13:50 |
| marios | Tengu: well theres two one in tht too. looking at your review | 13:50 |
| Tengu | wait... t-h-t is also affected. so yeah | 13:50 |
| Tengu | marios: thanks :) | 13:50 |
| Tengu | that would be really nice of you | 13:50 |
| marios | Tengu: ugh :/ | 13:51 |
| Tengu | yeah, I know | 13:51 |
| Tengu | that's why I'm a bit crying ;). | 13:51 |
| marios | Tengu: yeah staring :) i mean sure its doable but this is promotion blocker :/ anyway the patch isn't right yet. lets worry about it disrupting you once it is. i only posted as initial reaction to us now unerstanding what broke it and needing to get somethign started there cos blocker | 13:52 |
| mandre | thanks marios, I don't have enough zaqar knowledge to evaluate the tht change, but the tripleo-common one looks good | 13:52 |
| *** moguimar has joined #tripleo | 13:52 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Put user data in the main stack https://review.openstack.org/625260 | 13:53 |
| Tengu | marios: ok. If yours merge before mine, I'll ask some help from you for the rebase I guess. That's doable I think? :) | 13:53 |
| Tengu | and if mine merges before yours, well, feel free to ping me. | 13:53 |
| *** amoralej is now known as amoralej|lunch | 13:54 | |
| marios | Tengu: seriously the rebase shouldn't be a problem i understand https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=0de7bc09f3d2c8ad4403046703ce91f9ead980fc more now you're moving things around | 13:54 |
| marios | Tengu: i'll rebase before we merge it | 13:55 |
| marios | Tengu: if /when | 13:55 |
| Tengu | marios: yeah, moving and flattening | 13:55 |
| EvilienM | Tengu: our work in flattening is less important than marios's work with CI and blockers | 13:55 |
| EvilienM | so we'll rebase | 13:55 |
| marios | EvilienM: seriously don't spend time on that yet thanks. the tht patch is wrong/incomplete i know nothing about zaqar-server vs zaqar-wsgi and what they need to configure there | 13:55 |
| marios | EvilienM: i just posted https://review.openstack.org/#/c/624952/ as placeholder | 13:56 |
| EvilienM | k | 13:56 |
| marios | EvilienM: so it needs to be fixed first | 13:56 |
| Tengu | jsut added myself to your change in order to follow it, marios | 13:56 |
| marios | https://review.openstack.org/#/c/625259/ this EvilienM sorry | 13:56 |
| *** moguimar has quit IRC | 13:57 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: docker: wire SELinuxMode with Ansible vars https://review.openstack.org/625262 | 13:58 |
| *** moguimar has joined #tripleo | 13:59 | |
| *** ykarel|afk is now known as ykarel | 14:00 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Undercloud Validations - Deprecated (replaced/removed) opts https://review.openstack.org/604923 | 14:03 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow for service_bootstrap_ips empty list in IpListMap https://review.openstack.org/624999 | 14:03 |
| *** moguimar has quit IRC | 14:04 | |
| *** thrash is now known as thrash|biab | 14:04 | |
| *** pcaruana|intw| has quit IRC | 14:05 | |
| *** weshay1-1 is now known as weshay | 14:05 | |
| weshay | thanks marios | 14:05 |
| openstackgerrit | Natal Ngétal proposed openstack/tripleo-quickstart master: [Documentation] Fix malformed table. https://review.openstack.org/625264 | 14:07 |
| *** moguimar has joined #tripleo | 14:08 | |
| *** tzumainn has joined #tripleo | 14:11 | |
| ykarel | marios_|ruck, i mentioned yesterday about periodic fs035, so now there are two same failures, so it's some real issue:- https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, see 3rd and 4th from top both related to mysql, so i doubt recent bump to mariadb | 14:11 |
| ykarel | dciabrin_, ^^ in case u can confirm the issue | 14:12 |
| *** moguimar has quit IRC | 14:13 | |
| marios | ykarel: thanks checking | 14:16 |
| *** moguimar has joined #tripleo | 14:17 | |
| marios_|ruck | ykarel: hm timeout ? 2018-12-14 08:44:15 | ab8-4c3e-9bcc-c4ed44fc86c3] Timed out) | 14:18 |
| marios_|ruck | http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/83e13cd/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:18 |
| marios_|ruck | on the heat stack create | 14:18 |
| marios_|ruck | ykarel: sec (I was looking at cistatus, checking from your link now) | 14:20 |
| ykarel | they may be old | 14:20 |
| ykarel | or new don't konw | 14:20 |
| marios_|ruck | ykarel: same http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/83e13cd/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:20 |
| marios_|ruck | top one https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master | 14:21 |
| marios_|ruck | ykarel: but the next one different digging | 14:21 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add promotion release file for master Fedora 28 pipeline https://review.openstack.org/625034 | 14:21 |
| ykarel | marios_|ruck, 3rd and 4th from top | 14:21 |
| *** moguimar has quit IRC | 14:22 | |
| *** derekh has joined #tripleo | 14:24 | |
| marios_|ruck | ykarel: where did you see mariadb issue. i see Error: No such image: 192.168.24.1:8787/tripleomaster/centos-binary-neutron-dhcp-agent:tripleo | 14:25 |
| marios_|ruck | in http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/be49104/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/8ec6b07/logs/undercloud/home/zuul/overcloud_depl | 14:25 |
| ykarel | marios_|ruck, search: can't connect | 14:25 |
| ykarel | in overcloud_deploy.log | 14:26 |
| *** moguimar has joined #tripleo | 14:26 | |
| *** udesale has joined #tripleo | 14:27 | |
| *** saneax has quit IRC | 14:29 | |
| *** moguimar has quit IRC | 14:31 | |
| *** pcaruana has joined #tripleo | 14:31 | |
| *** moguimar has joined #tripleo | 14:35 | |
| *** ksambor has joined #tripleo | 14:36 | |
| *** moguimar has quit IRC | 14:40 | |
| *** mcornea has joined #tripleo | 14:43 | |
| marios_|ruck | ykarel: https://bugs.launchpad.net/tripleo/+bug/1808536 | 14:43 |
| openstack | Launchpad bug 1808536 in tripleo "periodic-tripleo-featureset035-master fails overcloud deploy for "error: Could not connect to cluster (is it running" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 14:43 |
| marios_|ruck | thanks | 14:43 |
| marios_|ruck | ssbarnea|rover: fyi ^ | 14:43 |
| *** moguimar has joined #tripleo | 14:44 | |
| ykarel | marios_|ruck, ack | 14:47 |
| marios_|ruck | ykarel.fork() | 14:47 |
| marios_|ruck | .clone() | 14:47 |
| marios_|ruck | thanks ykarel for the help ! | 14:48 |
| ykarel | np | 14:48 |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten sahara service configuration https://review.openstack.org/625270 | 14:48 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Temp change periodic switch to rely on zuul.job https://review.openstack.org/625271 | 14:48 |
| *** moguimar has quit IRC | 14:49 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Fix the ironic_inspector config file in the switch-vlans validation https://review.openstack.org/624744 | 14:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add featureset058 file for standalone-update https://review.openstack.org/623039 | 14:50 |
| *** panda|off is now known as panda | 14:50 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Fix the ironic_inspector config file in the switch-vlans validation https://review.openstack.org/625272 | 14:51 |
| *** psachin has joined #tripleo | 14:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/paunch master: systemd/healthcheck: fix service names for requires/requisite https://review.openstack.org/625274 | 14:52 |
| *** amoralej|lunch is now known as amoralej | 14:53 | |
| *** moguimar has joined #tripleo | 14:53 | |
| *** mfedosin has joined #tripleo | 14:53 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Fix DeploymentStatusAction KeyError https://review.openstack.org/625275 | 14:54 |
| Tengu | marios: hmm mysql is served via haproxy btw - and now we should get haproxy logs and stats. | 14:57 |
| Tengu | well. *might be served by haproxy would be more correct. | 14:58 |
| *** moguimar has quit IRC | 14:58 | |
| mwhahaha | it is served via haproxy | 15:01 |
| Tengu | mwhahaha: apparently sometime there isn't any haproxy container :/. | 15:01 |
| marios_|ruck | Tengu: for what https://bugs.launchpad.net/tripleo/+bug/1808536 you mean? | 15:02 |
| openstack | Launchpad bug 1808536 in tripleo "periodic-tripleo-featureset035-master fails overcloud deploy for "error: Could not connect to cluster (is it running" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 15:02 |
| marios_|ruck | i missed the context | 15:02 |
| marios_|ruck | so you mean haproxy is the root? | 15:02 |
| mwhahaha | that error isn't via haproxy tho | 15:02 |
| mwhahaha | that's trying to talk to the socket | 15:02 |
| *** moguimar has joined #tripleo | 15:03 | |
| Tengu | didn't get the LP before - so yep, no haproxy. as it's via the socket. | 15:03 |
| *** zul has joined #tripleo | 15:04 | |
| marios_|ruck | ack thanks for looking Tengu mwhahaha | 15:04 |
| Tengu | http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/8ec6b07/logs/undercloud/var/log/containers/mysql/mariadb.log.txt.gz there are some nice things at the bottom | 15:05 |
| Tengu | but it doesn't match the time of the "cannot connect" thing. | 15:05 |
| mwhahaha | didn't we bump mariadb to a newer version (ping dciabrin_) | 15:05 |
| Tengu | mwhahaha: that's what ykarel said a couple of minutes agot | 15:06 |
| Tengu | -t | 15:06 |
| *** moguimar has quit IRC | 15:07 | |
| *** rbrady has joined #tripleo | 15:08 | |
| *** moguimar has joined #tripleo | 15:12 | |
| *** quiquell|lunch is now known as quiquell | 15:12 | |
| *** moguimar has quit IRC | 15:16 | |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: metrics_qdr: Use plain auth by default https://review.openstack.org/602678 | 15:17 |
| quiquell | marios_|ruck: What do we do with scenarios, do we workflow them or not ? | 15:17 |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-heat-templates stable/rocky: Fix access to /var/lib/haproxy when SELinux is enabled https://review.openstack.org/625281 | 15:17 |
| *** rbrady has quit IRC | 15:18 | |
| marios_|ruck | quiquell: i don't see why not. rfolco ? scenarios what say you. mwhahaha ? | 15:18 |
| marios_|ruck | lets merge? | 15:18 |
| quiquell | marios_|ruck: Didn't we have to check ykarel concerns ' | 15:19 |
| quiquell | ? | 15:19 |
| marios_|ruck | https://review.openstack.org/#/c/619508 https://review.openstack.org/#/c/619520 https://review.openstack.org/618709 https://review.openstack.org/625129 | 15:19 |
| mwhahaha | which reviews? | 15:19 |
| rfolco | scen2 is good https://review.openstack.org/#/c/618709/ | 15:19 |
| marios_|ruck | quiquell: which concerns? about the tempest? the revert is almost merging | 15:19 |
| *** thrash|biab is now known as thrash | 15:20 | |
| *** rbrady has joined #tripleo | 15:20 | |
| marios_|ruck | mwhahaha: just above your previous post sorry ^ | 15:20 |
| mwhahaha | as long as we're dropping the multinode at the same time it should be fine | 15:20 |
| marios_|ruck | quiquell: did i miss something more | 15:20 |
| mwhahaha | but we do need to line up the coverages in THT/etc | 15:20 |
| mwhahaha | cause that was missing for some stuff | 15:20 |
| mwhahaha | where multinode goes away and single node is not there to replace it | 15:21 |
| *** psachin has quit IRC | 15:21 | |
| *** moguimar has joined #tripleo | 15:21 | |
| marios_|ruck | mwhahaha: like https://review.openstack.org/#/c/619508/17/zuul.d/multinode-jobs.yaml@174 you mean? | 15:21 |
| quiquell | marios_|ruck: a right, so if we workflow now they will be after revert | 15:21 |
| marios_|ruck | mwhahaha: yeah hjensas posted something for tht this morning https://review.openstack.org/#/c/625129 | 15:21 |
| mwhahaha | https://review.openstack.org/#/c/625129/ | 15:21 |
| mwhahaha | like that | 15:21 |
| mwhahaha | yea that one | 15:21 |
| marios_|ruck | mwhahaha: yeah we've been focused on getting them in first | 15:22 |
| mwhahaha | if we could get 1-4 updated ASAP that would be good | 15:22 |
| quiquell | marios_|ruck, mwhahaha: maybe now we can run -full and not -minimal | 15:23 |
| mwhahaha | those are the important ones | 15:23 |
| marios_|ruck | mwhahaha: i have a related series here fyi too https://review.openstack.org/#/q/topic:replace-scen1 you already saw some of those and i abandoned the branch ones | 15:23 |
| *** Vorrtex has joined #tripleo | 15:25 | |
| *** moguimar has quit IRC | 15:25 | |
| *** hberaud is now known as hberaud|afk | 15:29 | |
| *** psachin has joined #tripleo | 15:29 | |
| *** hjensas has quit IRC | 15:30 | |
| *** moguimar has joined #tripleo | 15:30 | |
| *** kopecmartin is now known as kopecmartin|off | 15:32 | |
| *** yprokule has quit IRC | 15:33 | |
| rlandy | mwhahaha: we are trying to add a fedora-28 job (with centos7 containers) temporarily to the master promotion pipeline. Looking at https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml#L135 ... any reason we do not have an upstream-fedora-28 that does not diverge? | 15:33 |
| rlandy | I am running a test job with single-fedora-28-node and getting a failure | 15:34 |
| rlandy | Failed to find required executable iptables in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/ | 15:34 |
| rlandy | which should be available | 15:34 |
| mwhahaha | oh that comment is because the label is different | 15:34 |
| mwhahaha | that's all | 15:34 |
| rlandy | hmmm ... | 15:34 |
| *** moguimar has quit IRC | 15:34 | |
| rlandy | well something is different | 15:35 |
| mwhahaha | i think the images are different | 15:35 |
| rlandy | beyond the label | 15:35 |
| rlandy | yeah - must be | 15:35 |
| mwhahaha | it's likely that it doesn't have the same stuff | 15:35 |
| rlandy | the check job works | 15:35 |
| quiquell | rlandy, mwhahaha: Could be that they are not even building the fedora-28 upstream image yet | 15:35 |
| mwhahaha | i think that rdo-fedora-28 is what the rdo packaging uses | 15:35 |
| mwhahaha | so it might be very minimal package | 15:36 |
| rlandy | I gather nobody from our team uses it - otherwise we would have found this by now | 15:36 |
| quiquell | ok found he nodeset they have https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml | 15:36 |
| mwhahaha | yea it's not used by us for anything | 15:36 |
| mwhahaha | i just had to define it so rdo zuul didn't complain when i added it upstream | 15:36 |
| rlandy | I see, ok | 15:36 |
| rlandy | well, if we want to run f-28 jobs in periodic, we need an equivalent nodeset | 15:37 |
| quiquell | rlandy: they have upstream-centos-7 and rdo-centos-7 | 15:37 |
| quiquell | rlandy: but rdo-centos-7 only, look like they are missing upstream- at nodpool diskimage | 15:37 |
| rlandy | yeah - there are a lot of centos things fedora is lacking | 15:37 |
| evrardjp | ola | 15:37 |
| rlandy | ack - I am just not sure who owns adding that - maybe it's our team | 15:38 |
| quiquell | rlandy: let me find the nodepool config they use | 15:38 |
| rlandy | or if there is any reason we don;t have an upstream equivalent nodeset | 15:38 |
| rlandy | who is 'they'? the cloud admins? sf? | 15:39 |
| quiquell | rlandy: No one need it until now | 15:39 |
| rlandy | we need to close the loop here | 15:39 |
| *** moguimar has joined #tripleo | 15:39 | |
| quiquell | rlandy: this is where RDO zuul generates images https://softwarefactory-project.io/r/gitweb?p=config.git;a=blob;f=nodepool/rdo-cloud.yaml | 15:40 |
| evrardjp | EvilienM: hello -- we just spoke about https://review.openstack.org/#/c/616632/ in #openstack-meeting (and about issues of releasing some tripleO ansible roles) | 15:41 |
| rlandy | dib-fedora-28-minimal - not good enough | 15:41 |
| quiquell | rlandy: they have to replace upstream-centos-28 for fedora-28 | 15:41 |
| EvilienM | evrardjp: how can I help? | 15:41 |
| rlandy | rdo-fedora-28 or that | 15:41 |
| evrardjp | dhellmann has proposed a few solutions, but is there anyone I should ping for following that up? | 15:41 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Improve speed of collect_logs.sh https://review.openstack.org/625229 | 15:42 |
| rlandy | not replace - but add | 15:42 |
| rlandy | oh | 15:42 |
| *** trozet has joined #tripleo | 15:42 | |
| evrardjp | EvilienM: I think pointing the right people to the conversation log would be helpful | 15:42 |
| quiquell | Yep add it I mean | 15:42 |
| evrardjp | they could then propose changes of release jobs | 15:42 |
| trozet | mschuppert: ping? | 15:42 |
| weshay | sec.. reading in a minute | 15:42 |
| mschuppert | trozet: hi | 15:43 |
| EvilienM | evrardjp: looking | 15:43 |
| evrardjp | EvilienM: http://eavesdrop.openstack.org/meetings/releaseteam/2018/releaseteam.2018-12-14-15.00.log.html#l-130 | 15:43 |
| *** moguimar has quit IRC | 15:43 | |
| trozet | mschuppert: hey, I saw you investigate an issue with /var/lib/nova/instances getting failure to write OSERROR 13 or whatever, using NFS with OOO | 15:43 |
| trozet | mschuppert: https://bugs.launchpad.net/tripleo/+bug/1799903 | 15:44 |
| openstack | Launchpad bug 1799903 in tripleo "Instance creation fails with Permission denied: '/var/lib/nova/instances/<instance-id>" [High,Fix released] - Assigned to Jose Luis Franco (jfrancoa) | 15:44 |
| evrardjp | I am curious on what's really needed in your release jobs -- do you actively push roles into ansible galaxy maybe? | 15:44 |
| evrardjp | (haven't checked your release jobs, my bad) | 15:44 |
| mwhahaha | evrardjp: we just need the publish-to-pypi w/o the actual publish | 15:44 |
| mwhahaha | evrardjp: we dont' publish to galaxy at the moment but if that was a thing it wouldn't hurt | 15:44 |
| evrardjp | that's what OSA was doing in the past. It should be alright with the default release jobs in project config | 15:44 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid random POST-RUN END RESULT_TIMED_OUT due to du execution https://review.openstack.org/624381 | 15:45 |
| trozet | mschuppert: i have tripleo NFS deployment, and it gets a similar error, but a little different | 15:45 |
| trozet | mschuppert: wondering if you could help me | 15:45 |
| mwhahaha | evrardjp: from our standpoint we're really just interested in the resulting tarball because we shove all these things in packages anyway | 15:45 |
| evrardjp | so there might be something extra that's set there that shouldn't be | 15:45 |
| evrardjp | mwhahaha: yeah that's why I was surprised :) | 15:45 |
| mwhahaha | there used to be a publish job that did all the things w/o the pypi things but they removed it | 15:46 |
| mwhahaha | so this is what we're running into now | 15:46 |
| mschuppert | trozet: yeah I can try. what do you see? | 15:46 |
| mschuppert | trozet: btw we have one issue which might be related which ratailor works on in https://bugzilla.redhat.com/show_bug.cgi?id=1656617 | 15:47 |
| openstack | bugzilla.redhat.com bug 1656617 in openstack-nova "Updating openstack-nova-common on the compute will break nova permissions in the containers" [High,On_dev] - Assigned to ratailor | 15:47 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Improve speed of collect_logs.sh https://review.openstack.org/625229 | 15:47 |
| trozet | mschuppert: i get OS13 error when nova tries to do os.utime on the _base directory i think...trying to find which tab i had open with the code | 15:48 |
| *** moguimar has joined #tripleo | 15:48 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Adopt use of pre-commit linting https://review.openstack.org/623202 | 15:48 |
| *** ksambor has quit IRC | 15:49 | |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: WIP: Add overcloud upgrade validate command https://review.openstack.org/625293 | 15:50 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Adopt use of pre-commit linting https://review.openstack.org/623202 | 15:50 |
| *** gfidente has quit IRC | 15:52 | |
| *** moguimar has quit IRC | 15:52 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Fix new mariadb ipv6 issue https://review.openstack.org/625294 | 15:52 |
| *** moguimar has joined #tripleo | 15:57 | |
| evrardjp | mwhahaha: I think that's what OSA is doing, as we don't care about PyPI publication | 15:58 |
| evrardjp | we don't release our roles anymore though | 15:58 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
| mwhahaha | evrardjp: ok sure if you need some help with reviews or what not I can help. I think jfrancoa was looking at it as well | 16:00 |
| evrardjp | Well I guess it was more me wanting to help, but thanks for the offer mwhahaha :) | 16:01 |
| *** moguimar has quit IRC | 16:01 | |
| mwhahaha | i looked at it previously and we need to dupe the pypi job stuff and remove the publish | 16:02 |
| mwhahaha | let me see if i can pull up the details | 16:02 |
| *** hberaud|afk is now known as hberaud | 16:03 | |
| mwhahaha | it used to be release-openstack-server | 16:03 |
| jfrancoa | mwhahaha: evrardjp: the last update on that is that we need to have the projects defined in project-config (I removed ansible-role-redhat-subscription from it, to define the job template locally in the repo's zuul.d) but the validation now fails because the job is not present in project-config (https://review.openstack.org/#/c/616632/) | 16:03 |
| evrardjp | oh | 16:04 |
| mwhahaha | there was also https://review.openstack.org/#/c/531829/ | 16:04 |
| jfrancoa | mwhahaha: evrardjp: so we need to identify some job template that will cover this type of ansible roles... as they're not published in pypi..they don't have docs to build.. and the thing of defining our own job template (https://review.openstack.org/#/c/620353/) won't work | 16:05 |
| *** moguimar has joined #tripleo | 16:06 | |
| *** jobewan has joined #tripleo | 16:08 | |
| evrardjp | I am checking what we have in OSA, and it seems we only have announce-release ? | 16:08 |
| evrardjp | I need to check if that covers the use case | 16:09 |
| evrardjp | oh god I am curious now :) | 16:09 |
| *** moguimar has quit IRC | 16:11 | |
| mwhahaha | it probably just tags and that's it | 16:14 |
| * mwhahaha guesses | 16:14 | |
| *** PagliaccisCloud has quit IRC | 16:15 | |
| evrardjp | mwhahaha: well I see it on releases.openstack.org | 16:15 |
| evrardjp | so I suppose it's not only tagging | 16:15 |
| evrardjp | me guessing too | 16:15 |
| *** moguimar has joined #tripleo | 16:15 | |
| evrardjp | but you're right | 16:15 |
| evrardjp | we are not publishing on tarballs.o.o | 16:15 |
| evrardjp | which is the difference | 16:16 |
| mwhahaha | yea that's the bit we'd like | 16:16 |
| quiquell | tarballs.o.o ? didn't know about that one | 16:16 |
| mwhahaha | yea that's where we publish all the artifacts from releases | 16:16 |
| mwhahaha | so signed tarballs | 16:17 |
| quiquell | mwhahaha: ack | 16:17 |
| mwhahaha | http://tarballs.openstack.org/ansible-role-container-registry/ | 16:17 |
| mwhahaha | example | 16:17 |
| mwhahaha | we don't really need to publish any wheels either | 16:17 |
| evrardjp | I think it's a fair point to bring to the release team: It kinda makes sense to tarball and push when releasing | 16:19 |
| evrardjp | so maybe the base jobs should be used for that | 16:19 |
| evrardjp | I think it's fair to discuss that in #openstack-release | 16:19 |
| *** moguimar has quit IRC | 16:20 | |
| *** pcaruana has quit IRC | 16:20 | |
| *** cylopez has joined #tripleo | 16:20 | |
| *** jfrancoa has quit IRC | 16:21 | |
| *** quiquell is now known as quiquell|off | 16:23 | |
| *** moguimar has joined #tripleo | 16:24 | |
| *** moguimar has quit IRC | 16:29 | |
| *** moguimar has joined #tripleo | 16:33 | |
| *** moguimar has quit IRC | 16:38 | |
| *** rodolof has quit IRC | 16:38 | |
| *** hjensas has joined #tripleo | 16:39 | |
| *** rodolof has joined #tripleo | 16:39 | |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-quickstart-extras master: Allow to specify a non-default interpreter for the reproducer script https://review.openstack.org/625305 | 16:39 |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-quickstart-extras master: Allow to specify a non-default interpreter for the reproducer script https://review.openstack.org/625305 | 16:40 |
| *** holser_ has joined #tripleo | 16:41 | |
| evrardjp | I guess alternatively, publishing to pypi like these roles would do: http://git.openstack.org/cgit/openstack/ansible-role-tripleo-ui/tree/zuul.d/layout.yaml#n3 ? | 16:41 |
| evrardjp | anyway -- I was just the messenger :) | 16:42 |
| *** moguimar has joined #tripleo | 16:42 | |
| *** wolverineav has joined #tripleo | 16:44 | |
| bandini | marios: /go 28 | 16:44 |
| bandini | meh | 16:44 |
| bandini | sorry | 16:44 |
| marios_|ruck | bandini: thanks for https://bugs.launchpad.net/tripleo/+bug/1808536 | 16:45 |
| openstack | Launchpad bug 1808536 in tripleo "periodic-tripleo-featureset035-master fails overcloud deploy for "error: Could not connect to cluster (is it running" " [Undecided,In progress] - Assigned to Michele Baldessari (michele) | 16:45 |
| *** rodolof has quit IRC | 16:45 | |
| *** rodolof has joined #tripleo | 16:45 | |
| bandini | marios_|ruck: is there a way I can trigger the periodic failure with my review applied? | 16:46 |
| marios_|ruck | bandini: hm not sure about that. well it should run the same job just not the periodic one | 16:46 |
| marios_|ruck | weshay: ssbarnea|rover ^^^ | 16:46 |
| marios_|ruck | bandini: like you'll have some ovb fs jobs run sec where is ur review looking | 16:47 |
| weshay | bandini, ya.. there should be reproduce script in the periodic failure | 16:47 |
| weshay | and you can add the zuul_changes to the script | 16:47 |
| weshay | it should pick it up | 16:47 |
| *** moguimar has quit IRC | 16:47 | |
| weshay | bandini, just double check that dlrn actually built your patch :) | 16:47 |
| bandini | oh i see | 16:48 |
| *** iurygregory has quit IRC | 16:48 | |
| marios_|ruck | bandini: ah so is puppet-tripleo i don't think we run third party there weshay ? (so i lied about the ovb jobs running there) | 16:49 |
| weshay | marios_|ruck, puppet tripleo jobs are multinode/singlenode upstream jobs only | 16:49 |
| *** cylopez has quit IRC | 16:49 | |
| weshay | however marios_|ruck bandini one could still patch an ovb jobs w/ a puppet-tripleo zuul change | 16:50 |
| weshay | and test it in rdo-cloud | 16:50 |
| marios_|ruck | oh no so i see fs 35 running here https://review.openstack.org/#/c/557459/ for example bandini | 16:50 |
| marios_|ruck | i wasn't lying | 16:50 |
| marios_|ruck | ! | 16:50 |
| weshay | oh ya. .but I think that is the only one | 16:50 |
| marios_|ruck | weshay: yeah thats the one on the bug though | 16:51 |
| weshay | the other puppet modules are just upstream | 16:51 |
| marios_|ruck | luckily :) | 16:51 |
| weshay | :) | 16:51 |
| bandini | alright then I'll wait for ci and cross fingers in the meantime | 16:51 |
| marios_|ruck | what will you do to fill the extra time bandini ? | 16:51 |
| * marios_|ruck goes for weekend quits while ahead | 16:51 | |
| *** moguimar has joined #tripleo | 16:52 | |
| bandini | ahahaha I will booze up to cope with the inevitable upcoming failure | 16:52 |
| marios_|ruck | bandini: haha its all gonna come crashing down at one point right? | 16:53 |
| * marios_|ruck cries | 16:53 | |
| *** ykarel is now known as ykarel|away | 16:55 | |
| weshay | therve, howdy.. sir | 16:55 |
| *** tosky has quit IRC | 16:56 | |
| weshay | therve, when you have a second can you please read through https://bugs.launchpad.net/tripleo/+bug/1808349 and catch up w/ marios_|ruck if we think we can fix that | 16:56 |
| openstack | Launchpad bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 16:56 |
| *** moguimar has quit IRC | 16:56 | |
| *** salmankhan has quit IRC | 16:56 | |
| marios_|ruck | weshay: therve /me on my way out ssbarnea|rover is around for a little while possibly but is late in EU | 16:57 |
| *** salmankhan has joined #tripleo | 16:57 | |
| *** shardy is now known as shardy_mtg | 16:58 | |
| marios_|ruck | therve: the outstanding is the tht patch it is incomplete https://review.openstack.org/625259 | 16:58 |
| marios_|ruck | therve: especially what goes where for the zaqar-server vs wsgi | 16:58 |
| ssbarnea|rover | ping me if there is something i can help with, even during the weekend i should be online | 16:58 |
| *** moguimar has joined #tripleo | 17:01 | |
| *** amoralej is now known as amoralej|off | 17:01 | |
| *** moguimar has quit IRC | 17:05 | |
| *** udesale has quit IRC | 17:07 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten memcached service configuration https://review.openstack.org/624712 | 17:07 |
| *** wolverineav has quit IRC | 17:07 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Use templating for nova cell database_connection https://review.openstack.org/611404 | 17:08 |
| *** hberaud is now known as hberaud|gone | 17:08 | |
| ssbarnea|rover | marios_|ruck: i got an unexpected early failure on the updates job: http://logs.openstack.org/81/624381/13/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/72a55d2/job-output.txt.gz | 17:09 |
| ssbarnea|rover | SSH Error: data could not be sent to remote host "10.4.70.80". Make sure this host can be reached over ssh on subnode-2 | 17:09 |
| *** sshnaidm|off has quit IRC | 17:10 | |
| *** moguimar has joined #tripleo | 17:10 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten sahara service configuration https://review.openstack.org/625270 | 17:12 |
| openstackgerrit | Harald Jensås proposed openstack/puppet-tripleo stable/rocky: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/625314 | 17:14 |
| dpeacock | hjensas: I have https://review.openstack.org/#/c/624712/ which is conflicting with a couple of your patches; we should coordinate. Can you take a look and let me know what you think? | 17:14 |
| *** moguimar has quit IRC | 17:15 | |
| *** PagliaccisCloud has joined #tripleo | 17:15 | |
| *** moguimar has joined #tripleo | 17:19 | |
| hjensas | dpeacock: thanks for the heads up. I think yours will land first, and rebasing my patches once it does won't be too much work. My patches which is in conflict is based on top of 4 other patches that need to land first. | 17:21 |
| *** aufi has quit IRC | 17:22 | |
| dpeacock | hjensas: ok - sounds good - please let me know if you need to thrash it out any deeper nearer the time :-) | 17:22 |
| *** moguimar has quit IRC | 17:24 | |
| *** sshnaidm|off has joined #tripleo | 17:25 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates stable/rocky: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/625315 | 17:26 |
| *** moguimar has joined #tripleo | 17:28 | |
| *** agopi has joined #tripleo | 17:32 | |
| *** moguimar has quit IRC | 17:32 | |
| *** bnemec is now known as beekneemech | 17:37 | |
| *** moguimar has joined #tripleo | 17:37 | |
| *** psachin has quit IRC | 17:39 | |
| itlinux | hello | 17:40 |
| mwhahaha | weshay, marios_|ruck: Bug 1808349 is going to be a problem because we'll need a promotion to land the fix in THT | 17:40 |
| openstack | bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] https://launchpad.net/bugs/1808349 - Assigned to Marios Andreou (marios-b) | 17:40 |
| *** moguimar has quit IRC | 17:42 | |
| *** PagliaccisCloud has quit IRC | 17:43 | |
| mwhahaha | weshay, marios_|ruck: we might need to see about manually copying zaqar to zaqar-wsgi (or vice versa) for a bit in the promotion process to work around it | 17:43 |
| therve | weshay: Looking | 17:46 |
| ykarel|away | bandini, so if u want to test ur puppet-tripleo patch with periodic job u can do like https://review.rdoproject.org/r/#/c/17730 with job name: periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master and Depends-On on puppet-tripleo patch | 17:46 |
| *** moguimar has joined #tripleo | 17:46 | |
| mwhahaha | weshay: i think if we can manually create a zaqar-wsgi upstream, we can land the rename patch and unblock things | 17:46 |
| therve | The kolla change looks ridiculous though | 17:47 |
| *** derekh has quit IRC | 17:47 | |
| mwhahaha | i bet the ubuntu package is not wsgi based | 17:48 |
| mwhahaha | so they created a non-wsgi container | 17:48 |
| mwhahaha | which is ubuntu/debian only | 17:48 |
| therve | I don't even understand what it's trying to do to be honest | 17:50 |
| mwhahaha | I think it refactored the zaqar build into like the other ones with a base container that the others use. In this case the zaqar-server container only works for deb stuff. and zaqar-wsgi is basically what the old zaqar container was | 17:51 |
| *** moguimar has quit IRC | 17:51 | |
| mwhahaha | so zaqar-wsgi = rhel, zaqar-server = deb | 17:51 |
| mwhahaha | (silly) | 17:51 |
| mwhahaha | actually the left the deb version of the wsgi stuff in | 17:52 |
| *** wolverineav has joined #tripleo | 17:52 | |
| *** wolverineav has quit IRC | 17:52 | |
| mwhahaha | so yea they just added a new container and broke anyone consuming the old one | 17:52 |
| *** wolverineav has joined #tripleo | 17:52 | |
| mwhahaha | i thought everything was supposed to be run under wsgi going forward anyway | 17:52 |
| * mwhahaha shrugs | 17:52 | |
| *** suuuper has quit IRC | 17:53 | |
| therve | I don't get why they have to do the app.py stuff now | 17:54 |
| mwhahaha | they don't | 17:55 |
| mwhahaha | it's out of date | 17:55 |
| mwhahaha | i noticed that as well when i was doing fedora stuff | 17:55 |
| *** moguimar has joined #tripleo | 17:55 | |
| therve | mwhahaha: How did it work before? | 17:56 |
| mwhahaha | which reminds me i need to propose fixes for the app.py things | 17:56 |
| mwhahaha | *magic* | 17:56 |
| mwhahaha | hrm | 17:58 |
| mwhahaha | https://review.openstack.org/#/c/610929/10/docker/zaqar/Dockerfile.j2 was the old container so it's likely they broke the wsgi container now | 17:58 |
| * ykarel|away out | 17:58 | |
| therve | Yeah I think we should just ask for a revert | 17:58 |
| *** moguimar has quit IRC | 18:00 | |
| therve | With the 2 containers we could remove the hack in the zaqar RPM for websocket though | 18:02 |
| *** ykarel|away has quit IRC | 18:02 | |
| mwhahaha | i think we should roll with the two containers but fix it | 18:03 |
| *** trown is now known as trown|lunch | 18:03 | |
| mwhahaha | shouldn't it be /usr/bin/zaqar-server rather than app.py? | 18:03 |
| *** moguimar has joined #tripleo | 18:04 | |
| mwhahaha | i'll look at it later i guess | 18:04 |
| therve | Hum no I guess it is app.py | 18:06 |
| *** jpena is now known as jpena|off | 18:06 | |
| therve | Presumably we don't use wsgi in the current deployment | 18:06 |
| *** holser_ has quit IRC | 18:06 | |
| *** shardy_mtg has quit IRC | 18:08 | |
| *** moguimar has quit IRC | 18:09 | |
| EvilienM | if someone can review https://review.openstack.org/#/c/625274/ please | 18:10 |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten snmp service configuration https://review.openstack.org/625322 | 18:10 |
| *** itlinux has quit IRC | 18:13 | |
| *** itlinux has joined #tripleo | 18:13 | |
| *** moguimar has joined #tripleo | 18:13 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten tuned service configuration https://review.openstack.org/625323 | 18:14 |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten tripleo-firewall service configuration https://review.openstack.org/625324 | 18:17 |
| *** moguimar has quit IRC | 18:18 | |
| *** vkapalav has quit IRC | 18:18 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: flatten tripleo-packages service configuration https://review.openstack.org/625326 | 18:19 |
| *** moguimar has joined #tripleo | 18:22 | |
| *** wolverineav has quit IRC | 18:23 | |
| *** wolverineav has joined #tripleo | 18:26 | |
| *** moguimar has quit IRC | 18:27 | |
| *** rodolof has quit IRC | 18:27 | |
| *** wolverineav has quit IRC | 18:28 | |
| *** wolverineav has joined #tripleo | 18:28 | |
| *** moguimar has joined #tripleo | 18:32 | |
| *** akrivoka has quit IRC | 18:35 | |
| *** moguimar has quit IRC | 18:36 | |
| *** dsneddon has quit IRC | 18:39 | |
| *** moguimar has joined #tripleo | 18:41 | |
| *** chandan_kumar has quit IRC | 18:46 | |
| *** moguimar has quit IRC | 18:46 | |
| *** moguimar has joined #tripleo | 18:50 | |
| openstackgerrit | Jill Rouleau proposed openstack/paunch master: Make systemd.service_delete handle healthchecks https://review.openstack.org/625328 | 18:52 |
| *** morazi has quit IRC | 18:52 | |
| *** moguimar has quit IRC | 18:55 | |
| *** salmankhan has quit IRC | 18:57 | |
| *** moguimar has joined #tripleo | 18:59 | |
| *** moguimar has quit IRC | 19:04 | |
| *** dsneddon has joined #tripleo | 19:05 | |
| *** hjensas has quit IRC | 19:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Add option to run OVB jobs without te-broker https://review.openstack.org/618653 | 19:08 |
| *** moguimar has joined #tripleo | 19:08 | |
| *** rbrady has quit IRC | 19:09 | |
| *** dsneddon has quit IRC | 19:09 | |
| *** moguimar has quit IRC | 19:12 | |
| *** moguimar has joined #tripleo | 19:17 | |
| *** nkinder has joined #tripleo | 19:17 | |
| *** fultonj has quit IRC | 19:21 | |
| *** moguimar has quit IRC | 19:22 | |
| *** wolverineav has quit IRC | 19:25 | |
| *** wolverineav has joined #tripleo | 19:25 | |
| *** moguimar has joined #tripleo | 19:26 | |
| *** fultonj has joined #tripleo | 19:28 | |
| *** trown|lunch is now known as trown | 19:29 | |
| *** wolverineav has quit IRC | 19:30 | |
| *** moguimar has quit IRC | 19:30 | |
| *** dsneddon has joined #tripleo | 19:33 | |
| *** moguimar has joined #tripleo | 19:35 | |
| *** HardCase has joined #tripleo | 19:38 | |
| *** wolverineav has joined #tripleo | 19:38 | |
| *** moguimar has quit IRC | 19:40 | |
| *** florianf_ has quit IRC | 19:42 | |
| *** moguimar has joined #tripleo | 19:44 | |
| *** moguimar has quit IRC | 19:49 | |
| *** moguimar has joined #tripleo | 19:53 | |
| openstackgerrit | Douglas Mendizábal proposed openstack/tripleo-heat-templates master: Add template code to configure hsm backends for barbican https://review.openstack.org/610634 | 19:56 |
| *** mfedosin has quit IRC | 19:57 | |
| *** moguimar has quit IRC | 19:58 | |
| *** moguimar has joined #tripleo | 20:02 | |
| *** moguimar has quit IRC | 20:07 | |
| *** betherly has joined #tripleo | 20:09 | |
| *** jschluet has joined #tripleo | 20:10 | |
| *** moguimar has joined #tripleo | 20:11 | |
| *** betherly has quit IRC | 20:13 | |
| *** moguimar has quit IRC | 20:16 | |
| *** morazi has joined #tripleo | 20:17 | |
| *** moguimar has joined #tripleo | 20:21 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: Correct file modes for rpmlint failures https://review.openstack.org/625340 | 20:22 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: WIP: prevent upgrading to incompatible mechanism driver https://review.openstack.org/625341 | 20:24 |
| *** moguimar has quit IRC | 20:25 | |
| openstackgerrit | Brent Eagles proposed openstack/python-tripleoclient master: WIP: prevent upgrading to incompatible mechanism driver https://review.openstack.org/625049 | 20:26 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 20:27 |
| *** moguimar has joined #tripleo | 20:30 | |
| *** dpeacock has quit IRC | 20:30 | |
| openstackgerrit | Douglas Mendizábal proposed openstack/tripleo-common master: Added roles to configure ATOS and Thales HSMs https://review.openstack.org/610629 | 20:30 |
| openstackgerrit | Douglas Mendizábal proposed openstack/tripleo-heat-templates master: Add template code to configure hsm backends for barbican https://review.openstack.org/610634 | 20:31 |
| *** dpeacock has joined #tripleo | 20:34 | |
| *** moguimar has quit IRC | 20:34 | |
| *** moguimar has joined #tripleo | 20:39 | |
| *** pbandark has joined #tripleo | 20:40 | |
| *** moguimar has quit IRC | 20:43 | |
| *** wolverineav has quit IRC | 20:43 | |
| *** wolverineav has joined #tripleo | 20:44 | |
| *** dtrainor has quit IRC | 20:45 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-puppet-elements master: Remove additional containered software https://review.openstack.org/625345 | 20:47 |
| *** moguimar has joined #tripleo | 20:48 | |
| *** wolverineav has quit IRC | 20:49 | |
| *** betherly has joined #tripleo | 20:50 | |
| * mwhahaha flips tables | 20:51 | |
| *** Vorrtex has quit IRC | 20:52 | |
| *** moguimar has quit IRC | 20:52 | |
| openstackgerrit | Jon Schlueter proposed openstack/tripleo-common master: Remove redundant ntp package from image-yaml files https://review.openstack.org/625346 | 20:53 |
| *** betherly has quit IRC | 20:55 | |
| *** moguimar has joined #tripleo | 20:57 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Lift the limit on ntp servers https://review.openstack.org/625347 | 20:57 |
| *** wolverineav has joined #tripleo | 20:58 | |
| *** moguimar has quit IRC | 21:02 | |
| *** moguimar has joined #tripleo | 21:06 | |
| *** moguimar has quit IRC | 21:11 | |
| *** rlandy has quit IRC | 21:12 | |
| *** chandan_kumar has joined #tripleo | 21:13 | |
| *** moguimar has joined #tripleo | 21:15 | |
| *** jobewan has quit IRC | 21:16 | |
| *** moguimar has quit IRC | 21:20 | |
| *** moguimar has joined #tripleo | 21:24 | |
| *** dprince has quit IRC | 21:27 | |
| *** moguimar has quit IRC | 21:29 | |
| *** abishop has quit IRC | 21:30 | |
| *** raildo has quit IRC | 21:33 | |
| mwhahaha | EvilienM: have you see this failure before? http://logs.openstack.org/04/624304/2/gate/tripleo-ci-centos-7-standalone/09c0a0c/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-12-14_21_09_16 | 21:33 |
| *** moguimar has joined #tripleo | 21:33 | |
| EvilienM | looking | 21:34 |
| mwhahaha | i wonder if it's related to the container updates in the standalone | 21:34 |
| mwhahaha | if we broke stable/rocky | 21:34 |
| mwhahaha | yes we did | 21:35 |
| mwhahaha | we need https://review.openstack.org/#/c/624869/ | 21:35 |
| mwhahaha | but https://review.openstack.org/#/c/621517/ was merged | 21:35 |
| mwhahaha | meh | 21:35 |
| * mwhahaha files bug | 21:36 | |
| *** moguimar has quit IRC | 21:38 | |
| mwhahaha | rfolco, quiquell|off: fyi https://bugs.launchpad.net/tripleo/+bug/1808591 | 21:38 |
| openstack | Launchpad bug 1808591 in tripleo "stable/rocky standalone failing to pull containers from local registry" [Critical,Triaged] | 21:38 |
| EvilienM | meh | 21:39 |
| mwhahaha | not sure which is faster | 21:39 |
| mwhahaha | reverting, fixing stable/rocky or updating the config | 21:39 |
| *** hjensas has joined #tripleo | 21:39 | |
| EvilienM | let's update the config | 21:39 |
| EvilienM | I can approve it before I leave | 21:39 |
| mwhahaha | i think fixing the patch soit can land in stable/rocky is fastest | 21:40 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/rocky: Run local registry and prep cont at standalone https://review.openstack.org/624869 | 21:42 |
| EvilienM | mwhahaha: ok go ahead I'll approve | 21:42 |
| mwhahaha | there | 21:42 |
| *** hakhande_ has quit IRC | 21:42 | |
| mwhahaha | let me go punt all the stable/rocky patches out of the gate | 21:42 |
| *** moguimar has joined #tripleo | 21:43 | |
| EvilienM | +2 +A | 21:43 |
| *** EvilienM is now known as EmilienM | 21:44 | |
| *** weshay is now known as weshay_pto | 21:44 | |
| mwhahaha | oh just one, ok | 21:44 |
| *** moguimar has quit IRC | 21:47 | |
| *** bfournie has quit IRC | 21:48 | |
| *** jtomasek has quit IRC | 21:49 | |
| *** moguimar has joined #tripleo | 21:52 | |
| *** rodolof has joined #tripleo | 21:54 | |
| *** holser_ has joined #tripleo | 21:55 | |
| *** moguimar has quit IRC | 21:56 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Flatten Keepalived service configuration https://review.openstack.org/624182 | 21:59 |
| *** moguimar has joined #tripleo | 22:01 | |
| *** moguimar has quit IRC | 22:05 | |
| *** thrash is now known as thrash|g0ne | 22:06 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix access to /var/lib/haproxy when SELinux is enabled https://review.openstack.org/624373 | 22:08 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1808591 | 22:10 |
| openstack | Launchpad bug 1808591 in tripleo "stable/rocky standalone failing to pull containers from local registry" [Critical,Triaged] | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| *** moguimar has joined #tripleo | 22:10 | |
| *** dtrainor has joined #tripleo | 22:12 | |
| *** betherly has joined #tripleo | 22:14 | |
| *** moguimar has quit IRC | 22:15 | |
| *** trown is now known as trown|outtypewww | 22:16 | |
| HardCase | Hey all another question for you. Triple/Queens trying to deploy Ceph cluster and always failing on at least one node with "Error ENOENT: unrecognized pool ". 3 Ceph nodes, with 1 OS disk, 1 dedicated Journal disk and 3 OSD disks. Hardware configuration is the same on all 3. Thoughts? | 22:17 |
| *** dciabrin_ has quit IRC | 22:18 | |
| *** rodolof has quit IRC | 22:18 | |
| *** betherly has quit IRC | 22:18 | |
| *** moguimar has joined #tripleo | 22:19 | |
| HardCase | Here are my current Ceph configs if it helps https://hastebin.com/ijafetuwop.js | 22:21 |
| *** rfolco has quit IRC | 22:22 | |
| *** moguimar has quit IRC | 22:24 | |
| *** betherly has joined #tripleo | 22:24 | |
| *** holser_ has quit IRC | 22:28 | |
| *** moguimar has joined #tripleo | 22:28 | |
| *** betherly has quit IRC | 22:29 | |
| *** slaweq has quit IRC | 22:33 | |
| *** moguimar has quit IRC | 22:33 | |
| *** moguimar has joined #tripleo | 22:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove deploy steps on empty roles https://review.openstack.org/624145 | 22:38 |
| *** moguimar has quit IRC | 22:41 | |
| *** lblanchard has quit IRC | 22:44 | |
| *** moguimar has joined #tripleo | 22:46 | |
| *** moguimar has quit IRC | 22:51 | |
| *** wolverineav has quit IRC | 22:51 | |
| *** moguimar has joined #tripleo | 22:55 | |
| *** wolverineav has joined #tripleo | 22:59 | |
| *** moguimar has quit IRC | 23:00 | |
| *** wolverineav has quit IRC | 23:03 | |
| *** moguimar has joined #tripleo | 23:04 | |
| *** wolverineav has joined #tripleo | 23:06 | |
| *** srini_ has joined #tripleo | 23:07 | |
| *** sri_ has quit IRC | 23:08 | |
| *** moguimar has quit IRC | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1808591 | 23:10 |
| openstack | Launchpad bug 1808591 in tripleo "stable/rocky standalone failing to pull containers from local registry" [Critical,Triaged] | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| *** holser_ has joined #tripleo | 23:11 | |
| *** moguimar has joined #tripleo | 23:13 | |
| *** holser_ has quit IRC | 23:16 | |
| *** moguimar has quit IRC | 23:18 | |
| *** moguimar has joined #tripleo | 23:23 | |
| *** PagliaccisCloud has joined #tripleo | 23:29 | |
| *** moguimar has quit IRC | 23:29 | |
| *** moguimar has joined #tripleo | 23:35 | |
| *** moguimar has quit IRC | 23:39 | |
| *** moguimar has joined #tripleo | 23:44 | |
| *** moguimar has quit IRC | 23:48 | |
| *** moguimar has joined #tripleo | 23:53 | |
| *** moguimar has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!