EmilienM | http://status.openstack.org/openstack-health/#/g/build_name/tripleo-ci-centos-7-scenario003-multinode-oooq-container-mistral | 00:03 |
---|---|---|
EmilienM | there are some failures: ^ | 00:03 |
EmilienM | mwhahaha, weshay ^ | 00:03 |
EmilienM | http://logs.openstack.org/69/511169/4/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/475633f/logs/tempest.html.gz | 00:03 |
EmilienM | the jobname is weird though | 00:03 |
mwhahaha | thats on mistral itself | 00:03 |
*** ebarrera has quit IRC | 00:04 | |
mwhahaha | hence the -mistral | 00:04 |
EmilienM | openstack-health adds the project name at the end of the job | 00:04 |
EmilienM | I asked on infra channel | 00:04 |
EmilienM | yeah | 00:05 |
EmilienM | also, we need to keep in mind this isn't check pipeline | 00:05 |
EmilienM | but gate / periodic | 00:06 |
EmilienM | and we don't have periodic jobs anymore | 00:06 |
EmilienM | so these are failures in gate | 00:06 |
EmilienM | which should be lower than check | 00:06 |
mwhahaha | right | 00:06 |
mwhahaha | we want them to be 100% | 00:06 |
mwhahaha | or as close to as possible | 00:06 |
EmilienM | also maybe we're missing some data | 00:08 |
EmilienM | also-bis I'm wondering if a fake subunit is created before the deployment, because the deployment can fail before running tempest | 00:08 |
EmilienM | which is usually the case | 00:09 |
EmilienM | I know Sagi has a patch for that | 00:09 |
EmilienM | https://review.openstack.org/#/c/522955/ | 00:09 |
*** rakhmerov has quit IRC | 00:16 | |
*** etingof has quit IRC | 00:18 | |
*** dhill__ has joined #tripleo | 00:18 | |
*** dhill_ has quit IRC | 00:18 | |
*** rakhmerov has joined #tripleo | 00:19 | |
*** etingof has joined #tripleo | 00:19 | |
*** dmacpher has quit IRC | 00:22 | |
*** athomas has quit IRC | 00:27 | |
*** hjensas has joined #tripleo | 00:28 | |
*** hjensas has joined #tripleo | 00:28 | |
*** tosky has quit IRC | 00:32 | |
weshay | EmilienM, I see them, thanks | 00:36 |
*** hjensas has quit IRC | 00:44 | |
*** bfournie has joined #tripleo | 00:52 | |
*** bfournie has quit IRC | 00:53 | |
*** tvignaud has quit IRC | 00:55 | |
*** sai_ has quit IRC | 00:59 | |
*** bfournie has joined #tripleo | 00:59 | |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 01:00 |
*** matbu has quit IRC | 01:09 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 01:10 |
*** psachin has joined #tripleo | 01:11 | |
*** dmacpher has joined #tripleo | 01:12 | |
*** tvignaud has joined #tripleo | 01:13 | |
*** fragatina has quit IRC | 01:14 | |
*** fragatina has joined #tripleo | 01:15 | |
*** fragatina has quit IRC | 01:16 | |
*** matbu has joined #tripleo | 01:16 | |
Slower | anyone know which part of the CI configures the undercloud insecure docker registry? | 01:19 |
Slower | it's not happening in my job.. (a CI testing job) | 01:19 |
*** cshastri has joined #tripleo | 01:26 | |
*** matbu has quit IRC | 01:27 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Implement post-upload cleanup of docker images https://review.openstack.org/519201 | 01:37 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP Concurrent upload container images https://review.openstack.org/522055 | 01:37 |
*** fragatina has joined #tripleo | 01:42 | |
*** fragatina has quit IRC | 01:44 | |
*** mrunge has quit IRC | 01:56 | |
*** matbu has joined #tripleo | 01:57 | |
*** mrunge has joined #tripleo | 01:59 | |
*** matbu has quit IRC | 02:08 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 02:10 |
*** matbu has joined #tripleo | 02:15 | |
*** thrash is now known as thrash|g0ne | 02:20 | |
*** dparkes has quit IRC | 02:39 | |
EmilienM | Slower: in quickstart probably? | 02:49 |
*** moshele has joined #tripleo | 02:53 | |
openstackgerrit | Merged openstack/tripleo-common master: Memory channels parameter is not derivable https://review.openstack.org/523315 | 03:03 |
*** ramishra has joined #tripleo | 03:05 | |
*** links has joined #tripleo | 03:07 | |
mwhahaha | Oh noes is the ovsdbapp issue back? I thought that was the same problem we had with scenario001/3 | 03:07 |
mwhahaha | Slower: puppet-tripleo I think as part of the docker setup | 03:07 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 03:09 |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 03:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstackgerrit | Merged openstack/tripleo-common master: Add DesignatePassword https://review.openstack.org/518993 | 03:14 |
*** noslzzp has joined #tripleo | 03:16 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add noop's for docker pacemaker for rabbitmq https://review.openstack.org/524751 | 03:20 |
weshay | hey Slower | 03:22 |
*** threestrands has joined #tripleo | 03:27 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Default $NODEPOOL_PROVIDER https://review.openstack.org/490037 | 03:31 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/525413 | 03:39 |
Slower | weshay: heya! | 03:41 |
weshay | Slower, hey o | 03:41 |
Slower | weshay: so if you look at the setup in the undercloud, the docker registry isn't configured properly | 03:42 |
weshay | hrm.. ok let's take a look | 03:42 |
Slower | docker-distribution still has port 5000 | 03:42 |
weshay | hrm | 03:42 |
weshay | k | 03:42 |
weshay | need a sec to get the check outs | 03:42 |
Slower | and there's no setting for insecure registry | 03:42 |
Slower | sure | 03:42 |
Slower | weshay: http://logs.openstack.org/11/523511/10/check/tripleo-ci-centos-7-containers-multinode/e2f12e4/logs/undercloud/etc/sysconfig/docker.gz | 03:43 |
Slower | http://logs.openstack.org/11/523511/10/check/tripleo-ci-centos-7-containers-multinode/e2f12e4/logs/undercloud/etc/docker-distribution/registry/config.yml.txt.gz | 03:43 |
Slower | vs ours | 03:43 |
Slower | which has port 5000 and no insecure registry setting | 03:43 |
weshay | so we need | 03:45 |
Slower | is it because we're installing docker rpm later? | 03:45 |
Slower | maybe it's updating.. shouldn't overwrite that stuff tho eh? | 03:45 |
weshay | ya.. so wait a sec.. | 03:46 |
weshay | you are referring to errors in the overcloud deployment at this point | 03:46 |
Slower | correct | 03:46 |
weshay | so nothing has changed there | 03:46 |
Slower | correct | 03:46 |
weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L15-L22 | 03:47 |
Slower | well I added something but we can puill it | 03:47 |
weshay | pull it where though.. move it from overcloud deployment to undercloud? | 03:47 |
Slower | weshay: right, so I set that | 03:47 |
Slower | to try it | 03:47 |
weshay | ya.. but it already should be done.. | 03:48 |
Slower | but no where else is that set | 03:48 |
weshay | hrm.. /me looks at our review again | 03:48 |
Slower | also | 03:48 |
Slower | it's still set to port 5000 | 03:48 |
weshay | Slower, can you chat? | 03:48 |
weshay | Slower, the overcloud-prep-containers should still be run as is.. w/ the same variables | 03:49 |
weshay | we've only touched the undercloud | 03:50 |
weshay | so I'm confused | 03:50 |
openstackgerrit | Ian Main proposed openstack/instack-undercloud master: DNM, undercloud containers TESTING ONLY https://review.openstack.org/518118 | 03:50 |
Slower | yeah sure | 03:51 |
weshay | in your channel | 03:52 |
Slower | be there in a sec :) | 03:52 |
*** psahoo has joined #tripleo | 03:55 | |
*** fragatina has joined #tripleo | 03:56 | |
*** psahoo is now known as psahoo|BF | 04:01 | |
*** fragatina has quit IRC | 04:01 | |
*** psahoo|BF is now known as psahoo | 04:06 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 04:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
*** pdeore has joined #tripleo | 04:10 | |
*** shreshtha has joined #tripleo | 04:11 | |
*** ykarel|away has joined #tripleo | 04:13 | |
*** psachin has quit IRC | 04:15 | |
*** fragatina has joined #tripleo | 04:17 | |
*** skramaja has joined #tripleo | 04:18 | |
*** pgadiya has joined #tripleo | 04:24 | |
*** psachin has joined #tripleo | 04:30 | |
*** psachin has quit IRC | 04:32 | |
*** fpan has quit IRC | 04:33 | |
*** moshele has quit IRC | 04:37 | |
*** dpawar has joined #tripleo | 04:43 | |
*** jaganathan has joined #tripleo | 04:44 | |
*** udesale has joined #tripleo | 04:53 | |
*** jaosorior has joined #tripleo | 04:55 | |
*** anilvenkata has joined #tripleo | 04:55 | |
*** ratailor has joined #tripleo | 04:56 | |
jaosorior | stevebaker: around? | 04:58 |
jaosorior | EmilienM: around? | 04:59 |
*** pdeore_ has joined #tripleo | 05:01 | |
*** pdeore has quit IRC | 05:03 | |
*** gfidente has quit IRC | 05:07 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 05:10 |
*** psachin has joined #tripleo | 05:10 | |
*** tzumainn has quit IRC | 05:11 | |
*** moshele has joined #tripleo | 05:18 | |
*** threestrands has quit IRC | 05:25 | |
openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Fix for timeouts on scale down https://review.openstack.org/523532 | 05:26 |
*** gfidente has joined #tripleo | 05:34 | |
EmilienM | jaosorior: yes | 05:38 |
jaosorior | EmilienM: Hey, do you know the status the issue of not being able to add new images? | 05:38 |
jaosorior | EmilienM: For several weeks we haven't been able to add new images (e.g. rsyslog, barbican) cause they fail when trying to add them to tripleo-common, cause they're not in RDO. and we can't add them to RDO cause there's work on-going to add the ability to make that liste of autogenerated images flexible | 05:39 |
jaosorior | EmilienM: but this is effectively blocking adding any new containterized services :/ | 05:40 |
EmilienM | jaosorior: I'm not aware about that tbh | 05:40 |
jaosorior | EmilienM: it's blocking https://review.openstack.org/#/c/521529/ and it would block barbican if we didn't have some REALLY old testing images in the tripleomaster dockerhub repo (which we're still testing if they work) | 05:42 |
EmilienM | jaosorior: I think you need to get in touch with amoralej|off / mandre on your morning | 05:44 |
*** fragatina has quit IRC | 05:44 | |
jaosorior | EmilienM: will do | 05:45 |
jaosorior | EmilienM: this has been blocking adding any new images for new services :/ I don't get why other folks aren't having ths issue. | 05:45 |
EmilienM | jaosorior: I understand how bad is it | 05:46 |
EmilienM | jaosorior: I just don't know how to help | 05:46 |
jaosorior | EmilienM: it's alright, I'll keep poking people. thanks | 05:46 |
EmilienM | jaosorior: ping panda as well | 05:47 |
EmilienM | all these people have been working on that part | 05:47 |
EmilienM | jaosorior: let me know if things don't move | 05:49 |
EmilienM | I'm out now | 05:49 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 05:50 |
EmilienM | dmsimard: it passed CI ^ | 05:50 |
jaosorior | EmilienM: oh, it's blocking barbican now as well :( | 05:53 |
jaosorior | http://logs.openstack.org/39/523539/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c4fd7c/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 05:53 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DNM - test dependencies https://review.openstack.org/525469 | 05:53 |
EmilienM | dmsimard: I'm testing it https://review.openstack.org/#/q/topic:zuul/required-projects/cleanup | 05:53 |
EmilienM | jaosorior: dude like I said I can't do anything | 05:53 |
EmilienM | jaosorior: if it's blocking barbican's gate, disable voting | 05:54 |
jaosorior | EmilienM: not saying that you do; just keeping (someone) updated. | 05:54 |
jaosorior | apparently I'm the only one that's hitting stuff with it, so at least somebody else knows | 05:54 |
EmilienM | sorry for that | 05:54 |
* EmilienM out | 05:54 | |
EmilienM | ttyl | 05:54 |
jaosorior | ~have a good one | 05:54 |
*** rlandy has quit IRC | 05:57 | |
*** janki has joined #tripleo | 05:58 | |
*** pdeore has joined #tripleo | 05:59 | |
*** pdeore_ has quit IRC | 06:01 | |
*** masco has joined #tripleo | 06:03 | |
*** gfidente has quit IRC | 06:03 | |
*** masco has quit IRC | 06:05 | |
Tengu | hello there | 06:05 |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 06:10 |
jaosorior | Tengu: sup dude | 06:15 |
Tengu | jaosorior: fine and you? a bit frozen with the home->work travel with the motorbike… it was about -1°C this morning :] | 06:17 |
*** pdeore has quit IRC | 06:18 | |
jaosorior | Tengu: haha shiiit motorbike at -1? | 06:19 |
Tengu | yup | 06:19 |
*** oanson has quit IRC | 06:20 | |
Tengu | not a big deal. Especially since I got heated handles :D | 06:20 |
*** oanson has joined #tripleo | 06:20 | |
bandini | morning | 06:21 |
Tengu | hello bandini | 06:21 |
bandini | yo Tengu | 06:22 |
*** pgadiya has quit IRC | 06:25 | |
*** nyechiel has joined #tripleo | 06:26 | |
*** dmacpher has quit IRC | 06:30 | |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common stable/pike: Memory channels parameter is not derivable https://review.openstack.org/525476 | 06:34 |
*** masco has joined #tripleo | 06:35 | |
*** pdeore has joined #tripleo | 06:38 | |
*** skramaja is now known as skramaja|afk | 06:38 | |
*** karthiks has joined #tripleo | 06:39 | |
*** pgadiya has joined #tripleo | 06:42 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add deploy_steps_tasks interface https://review.openstack.org/522344 | 06:51 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 06:51 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml https://review.openstack.org/525260 | 06:52 |
*** marios has joined #tripleo | 06:53 | |
Tengu | jaosorior: IPSEC like in "you're able to direct-connect your office network to the openstack over IPSEC tunnels"? | 06:54 |
jaosorior | Tengu: nah, IPSEC like, set up tunnels for each network and make all nodes communicate with encryption. | 06:55 |
jaosorior | Tengu: an alternative to TLS everywhere | 06:55 |
openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci master: WIP, test CI with experimental undercloud upgrade https://review.openstack.org/515361 | 06:56 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Set simple crypto plugin as global default for Barbican https://review.openstack.org/525480 | 06:56 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Fix step_config output which is str not list https://review.openstack.org/510131 | 06:57 |
*** udesale__ has joined #tripleo | 06:58 | |
*** udesale has quit IRC | 06:58 | |
jaosorior | Tengu: although, at some point we could make it configurable for such a thing :D | 06:59 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 07:00 |
*** udesale has joined #tripleo | 07:00 | |
*** shreshtha has quit IRC | 07:01 | |
*** udesale__ has quit IRC | 07:02 | |
*** abregman|afk has quit IRC | 07:03 | |
*** bogdando has joined #tripleo | 07:07 | |
*** dparkes has joined #tripleo | 07:08 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 07:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
*** pgadiya has quit IRC | 07:10 | |
*** jfrancoa has joined #tripleo | 07:11 | |
Tengu | jaosorior: ok :) | 07:17 |
Tengu | jaosorior: there was a VPNaaS, but it was dropped in either ocata or pike, because no real interest, and no maintainer :/ | 07:18 |
Tengu | so. haproxy basic auth support. let's go :D | 07:18 |
*** agurenko has joined #tripleo | 07:20 | |
*** pgadiya has joined #tripleo | 07:23 | |
Tengu | \o/ haproxy::userlist does already exists, so it should be really easy to play. | 07:24 |
Tengu | although… duh… it's an ugly implementation :/. | 07:25 |
*** iranzo has joined #tripleo | 07:25 | |
*** oidgar has joined #tripleo | 07:26 | |
stevebaker | jaosorior: hey, I'll take a look tomorrow, if mandre doesn't figure it out first | 07:27 |
jaosorior | stevebaker: that would be great :D | 07:27 |
openstackgerrit | Ade Lee proposed openstack/puppet-tripleo master: Add multiple backends for barbican https://review.openstack.org/523538 | 07:28 |
*** pmannidi has quit IRC | 07:31 | |
*** pcaruana has joined #tripleo | 07:32 | |
stevebaker | jaosorior: so the issue is that tripleomaster hasn't had images promoted for 4 days, so its missing new ones like centos-binary-barbican-keystone-listener? | 07:33 |
jaosorior | stevebaker: the issue is that there is currently no way to get new images | 07:36 |
jaosorior | stevebaker: which is something you were working on, IIRC | 07:36 |
jaosorior | but your work was blocked for some reason? | 07:36 |
jaosorior | or -1ed | 07:36 |
jaosorior | I don't recall | 07:36 |
jaosorior | stevebaker: yeah, this https://review.rdoproject.org/r/#/c/9328/ | 07:37 |
jaosorior | stevebaker: so, for instance, this adds the rsyslog image to tripleo-common https://review.openstack.org/#/c/521529/ but it fails CI cause we don't have the rsyslog image in RDO. So... I can't add a new image to tripleo cause we don't have that image (which I have no way of adding yet) | 07:37 |
*** aditya_r has joined #tripleo | 07:38 | |
jaosorior | stevebaker: currently there is a txt file that maintains that list of containers, which we can't modify because it's the same list as pike containers | 07:39 |
jaosorior | stevebaker: so, that effectively blocks barbican and rsyslog now | 07:39 |
stevebaker | jaosorior: centos-binary-barbican-keystone-listener is being built, it just hasn't been promoted to docker.io yet https://console.registry.rdoproject.org/registry#/images/master/centos-binary-barbican-keystone-listener | 07:41 |
*** hjensas has joined #tripleo | 07:41 | |
jaosorior | stevebaker: is it? | 07:42 |
jaosorior | stevebaker: as far as I had understood, stuff is being tracked here https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/container-push/parsed_containers.txt which is where we can't add images right now | 07:42 |
stevebaker | jaosorior: this one was built 3 hours ago https://console.registry.rdoproject.org/registry#/images/master/centos-binary-barbican-keystone-listener:tripleo-ci-testing | 07:42 |
jaosorior | stevebaker: how do we add extra images? we also need centos-binary-barbican-worker | 07:43 |
jaosorior | stevebaker: and rsyslog | 07:43 |
*** pmannidi has joined #tripleo | 07:44 | |
pmannidi | 'll own it as it's australian military case | 07:45 |
*** pmannidi has quit IRC | 07:45 | |
jaosorior | lol dafuq | 07:45 |
stevebaker | https://console.registry.rdoproject.org/registry#/images/master/centos-binary-barbican-worker and https://console.registry.rdoproject.org/registry#/images/master/centos-binary-rsyslog-base are both being built and pushed to the RDO registry. Maybe there is a backlog due to the weekend zuul outage | 07:45 |
*** pmannidi has joined #tripleo | 07:45 | |
jaosorior | stevebaker: how do we add centos-binary-rsyslog ? (need it besides the -base image) | 07:46 |
stevebaker | jaosorior: but you could ping weshay or dmsimard about when a promotion to docker.io/tripleomaster might happen | 07:46 |
jaosorior | stevebaker: ok ok, so apparently the issue I had has been fixed. How does the adding of images work? if I need a new one for instance | 07:47 |
*** pmannidi has quit IRC | 07:48 | |
jaosorior | stevebaker: soo... this should be fixed once we get a docker.io/tripleomaster promotion, right? http://logs.openstack.org/29/521529/2/check/tripleo-ci-centos-7-containers-multinode/5bb3c76/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2017-12-04_18_51_53 | 07:48 |
stevebaker | All you need to do is get the change landed to container-images/overcloud_containers.yaml.j2, then wait for the eventual promotion to docker.io/tripleoupstream | 07:48 |
*** rcernin has quit IRC | 07:48 | |
jaosorior | stevebaker: ok! well, then it's all sorted out then :D I'll poke weshay and dmismard when they're around. | 07:49 |
jaosorior | stevebaker: thanks! | 07:49 |
stevebaker | jaosorior: yeah, I believe so. I mean that is my expectation. No promotions for 4 days looks like the root cause of your issue | 07:50 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 07:52 |
stevebaker | jaosorior: did you see my comment about deleting container-images/overcloud_containers.yaml ? | 07:52 |
jaosorior | stevebaker: eh... no | 07:52 |
*** dbecker has joined #tripleo | 07:52 | |
jaosorior | stevebaker: where? | 07:52 |
stevebaker | jaosorior: https://review.openstack.org/#/c/515613/ | 07:53 |
*** oidgar has quit IRC | 07:53 | |
jaosorior | aaah alright | 07:53 |
jaosorior | yeah | 07:53 |
jaosorior | stevebaker: I'll abandon that change then | 07:53 |
*** athomas has joined #tripleo | 07:54 | |
stevebaker | ok, thanks | 07:54 |
jaosorior | stevebaker: thanks for the help and the reviews | 07:54 |
*** dsariel has joined #tripleo | 07:54 | |
stevebaker | jaosorior: no problem, good evening! | 07:54 |
jaosorior | have a good one! | 07:54 |
*** morazi has joined #tripleo | 07:56 | |
*** radeks has joined #tripleo | 07:58 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support https://review.openstack.org/525492 | 07:58 |
Tengu | jaosorior: -^ started. | 07:58 |
jaosorior | nice nice | 07:58 |
Tengu | will now integrate that new thing in the current endpoints. | 07:58 |
*** tvignaud has quit IRC | 07:58 | |
Tengu | well, endpoint definition and so on. | 07:59 |
*** tvignaud has joined #tripleo | 07:59 | |
*** skramaja|afk is now known as skramaja | 08:00 | |
*** paramite has joined #tripleo | 08:01 | |
*** shreshtha has joined #tripleo | 08:03 | |
*** artom_ has joined #tripleo | 08:04 | |
*** aufi has joined #tripleo | 08:04 | |
*** ykarel_ has joined #tripleo | 08:06 | |
*** artom has quit IRC | 08:07 | |
*** ykarel|away has quit IRC | 08:08 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 08:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
*** jaosorior_ has joined #tripleo | 08:10 | |
*** yprokule has joined #tripleo | 08:11 | |
*** ffiore has joined #tripleo | 08:11 | |
*** jaosorior has quit IRC | 08:13 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Reintroduce TripleoPackages in the default Controller service. https://review.openstack.org/524259 | 08:14 |
*** pdeore has quit IRC | 08:15 | |
*** pdeore has joined #tripleo | 08:16 | |
*** jtomasek has joined #tripleo | 08:16 | |
*** abregman has joined #tripleo | 08:16 | |
*** brault has quit IRC | 08:17 | |
*** dpawar has quit IRC | 08:21 | |
*** masco has quit IRC | 08:22 | |
*** florianf has joined #tripleo | 08:22 | |
*** masco has joined #tripleo | 08:23 | |
*** shardy has joined #tripleo | 08:24 | |
*** tesseract has joined #tripleo | 08:24 | |
*** mdnadeem has joined #tripleo | 08:27 | |
*** mcornea has joined #tripleo | 08:28 | |
*** dpawar has joined #tripleo | 08:31 | |
*** ccamacho has joined #tripleo | 08:32 | |
jtomasek | florianf: hi, could you please check these again, I had to rebase due to merge conflict https://review.openstack.org/#/q/project:openstack/tripleo-ui+branch:master+topic:4modalPanel | 08:32 |
*** rcernin has joined #tripleo | 08:33 | |
*** cylopez has joined #tripleo | 08:33 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 08:35 |
*** brault has joined #tripleo | 08:37 | |
*** gkadam has joined #tripleo | 08:38 | |
openstackgerrit | Merged openstack/tripleo-ui master: Layout components updates https://review.openstack.org/516361 | 08:38 |
*** ykarel_ is now known as ykarel | 08:38 | |
*** ffiore has quit IRC | 08:39 | |
*** dsariel has quit IRC | 08:40 | |
*** pcaruana has quit IRC | 08:40 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Custom overcloud user/key for deployed server prepare https://review.openstack.org/522776 | 08:41 |
*** mrch has joined #tripleo | 08:43 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support https://review.openstack.org/525492 | 08:45 |
Tengu | pfiou. | 08:46 |
Tengu | jaosorior_: -^^ some more stuff. not yet finished. | 08:46 |
jaosorior_ | ack | 08:47 |
*** jaosorior_ is now known as jaosorior | 08:47 | |
florianf | jtomasek: sure, just a sec | 08:50 |
Tengu | jaosorior: it's a bit painful, but I think I'm pretty close to a nice resolution :). unit tests are passing on my laptop, sooo… should be ok shortly. | 08:50 |
*** ffiore has joined #tripleo | 08:53 | |
*** jpena|off is now known as jpena | 08:55 | |
*** skramaja is now known as skramaja|lunch | 08:55 | |
Tengu | jaosorior: I take the opportunity to add unit tests for your new tripleo::haproxy::service_endpoints definition :). I'll need them in order to ensure nothing is broken. | 08:56 |
*** jpich has joined #tripleo | 08:56 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 08:58 |
jaosorior | Tengu: hey! great! | 08:58 |
jaosorior | appreciated | 08:58 |
*** sshnaidm|off is now known as sshnaidm|rover | 08:58 | |
Tengu | :) | 08:58 |
Tengu | playing a bit with hiera in the fixture. | 08:58 |
* Tengu puts some starwars stuff in the tests | 08:59 | |
*** oidgar has joined #tripleo | 09:00 | |
jaosorior | shardy: when running config-download, have you ran into this issue? | 09:01 |
jaosorior | failed: [192.168.24.6] (item=/etc/libvirt/secrets) => {"changed": false, "failed": true, "item": "/etc/libvirt/secrets", "msg": "There was an issue creating /etc/libvirt/secrets as requested: [Errno 13] Permission denied: '/etc/libvirt/secrets'", "path": "/etc/libvirt/secrets", "state": "absent"} | 09:01 |
jaosorior | failed: [192.168.24.6] (item=/etc/libvirt/qemu) => {"changed": false, "failed": true, "item": "/etc/libvirt/qemu", "msg": "There was an issue creating /etc/libvirt/qemu as requested: [Errno 13] Permission denied: '/etc/libvirt/qemu'", "path": "/etc/libvirt/qemu", "state": "absent"} | 09:01 |
shardy | jaosorior: No, perhaps you're missing become: true somewhere? | 09:02 |
jaosorior | shardy: I didn't modify that section at all | 09:02 |
jaosorior | shardy: only thing I did was pull the deploy_steps_tasks patch and add the ipsec composable service | 09:03 |
jaosorior | shardy: actually, checking this out https://review.openstack.org/#/c/522344/3/common/deploy-steps.j2 there is no become: true in the host prep steps | 09:04 |
shardy | jaosorior: yeah I think we expect the service templates to set it when needed | 09:05 |
shardy | jaosorior: I wasn't testing containerized libvirt yesterday so maybe this is an issue specific to that | 09:06 |
jaosorior | yeah | 09:06 |
shardy | not sure why we wouldn't see it in CI tho | 09:06 |
jaosorior | it does seem like an issue there though | 09:06 |
jaosorior | shardy: I run the playbook like this: | 09:06 |
jaosorior | ansible-playbook \ | 09:06 |
jaosorior | -v \ | 09:06 |
jaosorior | -i /usr/bin/tripleo-ansible-inventory \ | 09:06 |
jaosorior | ~/config-download/tripleo-*/deploy_steps_playbook.yaml | 09:06 |
jaosorior | shardy: I'm trying now by specifically adding the "become" as part of the command line. But I didn't expect it was needed there. | 09:06 |
shardy | jaosorior: yeah at one point it was, but then we added become: true in various places | 09:07 |
shardy | I suspect this way of deploying w/containers isn't yet covered in CI | 09:07 |
radeks | I have sort of generic question, I am looking for the largest overcloud installation with TripleO Ocata/Pike? I have 150 phy computes with Newton (classic architecture, 3 controllers) and I wonder how far I can go with Pike and containers? | 09:08 |
*** etingof has quit IRC | 09:09 | |
shardy | radeks: I think rook tested to ~300 nodes but some tuning of the undercloud was needed | 09:09 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 09:10 |
shardy | radeks: not sure if that was ocata or pike tho tbh | 09:10 |
radeks | <shardy> do you know by any chance if that was with containers or classic architecture ? | 09:10 |
shardy | radeks: Not sure on the status of scale testing w/containers, IIRC that was with the classic architecture | 09:11 |
shardy | rook should be able to confirm later when he is around | 09:11 |
radeks | shardy: thanks ! | 09:11 |
radeks | I will ask him | 09:11 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 09:15 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 09:15 |
radeks | shardy: I also tweaked few bits and pieces on UC, mostly MariaDB, heat and keystone (httpd). | 09:15 |
shardy | radeks: ack - FYI from Queens onwards it's possible to decouple deploying the nodes/networks from the configuration (via ansible) | 09:16 |
shardy | I suspect that will help with very large deployments, but there's discussion ongoing about further improvements | 09:17 |
radeks | shardy: I just wonder how this new architecture will influence these large scale deployments, I didn't have chance to check it myself yet :) | 09:19 |
radeks | shardy: it's hard to find spare 100+ servers to play with :) | 09:20 |
shardy | radeks: I think the changes to enable ansible for the configuration workflow will help, but probably the switch to containers won't have a large impact provided there is a local image registry to cache the images | 09:24 |
Tengu | jaosorior: small question for your dynamic endpoints definition: I should add a "tripleo.<service_name>.haproxy_endpoints:" hash entry in hiera, right? | 09:24 |
shardy | Tengu: you're working on making the LB configuration pluggable in puppet-tripleo? | 09:25 |
shardy | that has been on the TODO list for some time now :) | 09:25 |
Tengu | shardy: nope, well, partly, I'm working on top of jaosorior patches in order to add support for basic authentication for selected haproxy endpoint (user managed) | 09:26 |
Tengu | shardy: if you want the details: https://bugs.launchpad.net/tripleo/+bug/1736132 | 09:26 |
openstack | Launchpad bug 1736132 in tripleo "Allow to add Basic Authentication on HAProxy endpoint" [Wishlist,In progress] - Assigned to Cédric Jeanneret (cjeanneret-c2c) | 09:26 |
shardy | Tengu: Ah, I see | 09:27 |
*** abregman has quit IRC | 09:27 | |
shardy | Tengu: the reason I asked is we've got a historical non-pluggable interface with conditionals, e.g: | 09:27 |
shardy | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L1671 | 09:27 |
shardy | that would be nicer if it was pluggable like firewall rules, but it's not been done yet | 09:28 |
Tengu | shardy: yep, jaosorior has already done part of the jobs, creating a pluggable interface. | 09:28 |
shardy | Tengu: Aha, nice, will check out the patches :) | 09:30 |
*** dtantsur|afk has quit IRC | 09:30 | |
jaosorior | shardy: it's pluggable | 09:30 |
Tengu | shardy: it's already merged, at least the tripleo::haproxy::service_endpoints definition :). | 09:30 |
Tengu | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp now it has to be called ;) | 09:30 |
jaosorior | shardy: https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L883 | 09:30 |
Tengu | :D | 09:31 |
shardy | jaosorior: nice! So we just have to port the services in tht over to use that then | 09:31 |
jaosorior | shardy: it's VERY manual right now though, so there's a lot of manual stuff you need to add about your endpoint; but yeah, it's there. | 09:31 |
*** lucas-afk is now known as lucasagomes | 09:31 | |
shardy | jaosorior: cool, well it's a first step at least, thanks for doing it | 09:32 |
jaosorior | shardy: I was starting to do that https://review.openstack.org/#/c/474107/ https://review.openstack.org/#/c/474110/ but never actually got it working. Then again, I barely dedicated any time to it. | 09:32 |
*** aditya_r has quit IRC | 09:32 | |
Tengu | jaosorior: on my side, I'm unable to actually use that, at lest unable to make unit tests working -.- | 09:33 |
*** dtantsur has joined #tripleo | 09:33 | |
*** dtantsur has joined #tripleo | 09:33 | |
jaosorior | Tengu: what's up with the unit tests? | 09:34 |
*** skramaja|lunch is now known as skramaja | 09:34 | |
Tengu | jaosorior: apparently, adding in the "default.yaml" hiera file in fixtures/hieradata an entry isn't working. | 09:34 |
Tengu | jaosorior: wait, gisting the current state. | 09:34 |
* jaosorior sucks at puppet unit testing | 09:35 | |
* jaosorior dislikes the interface as well | 09:35 | |
*** etingof has joined #tripleo | 09:35 | |
Tengu | jaosorior: https://gist.github.com/cjeanneret/b5f8cc093261eeb620f941f38dc96e01 | 09:36 |
Tengu | :D | 09:36 |
Tengu | of course it's nasty and unfriendly. | 09:36 |
Tengu | but, at least, it exists, and should be used ;). | 09:36 |
jaosorior | I don't disagree | 09:36 |
Tengu | will check if I have to point to hiera in some way. | 09:36 |
Tengu | muahahahahahahaaaaa classes/tripleo_profile_base_cinder_volume_spec.rb: # hiera. (╯°□°)╯︵ ┻━┻ | 09:37 |
Tengu | ok, made my day XD | 09:37 |
*** gfidente has joined #tripleo | 09:37 | |
*** gfidente has quit IRC | 09:37 | |
*** gfidente has joined #tripleo | 09:37 | |
*** dtantsur has joined #tripleo | 09:38 | |
*** derekh has joined #tripleo | 09:39 | |
*** aufi has quit IRC | 09:39 | |
*** etingof has quit IRC | 09:42 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 09:47 |
Tengu | jaosorior: apparently, the syntaxe with "dots" in the index isn't correctly understood. | 09:48 |
*** stendulker has joined #tripleo | 09:48 | |
Tengu | jaosorior: in order to test, I entered "tripleo::foo::haproxy_endpoints" in the hiera file, updated your code, and tadaaaa, working. | 09:48 |
Tengu | at least it finds the entry. | 09:48 |
jaosorior | nice! | 09:49 |
Tengu | sooo... may I correct your code in my own patch, or should I first update it ? | 09:50 |
jaosorior | Tengu: what do you need to correct? | 09:50 |
Tengu | jaosorior: I think I'll first need a patch in order to add unit tests to your code (and correct it), then only shall I push my basic auth… | 09:50 |
jaosorior | oh | 09:50 |
jaosorior | the . syntax | 09:50 |
Tengu | jaosorior: hiera index, replacing dots by semi-colons | 09:50 |
Tengu | yep | 09:50 |
Tengu | nasty one to spot. | 09:50 |
*** cylopez has left #tripleo | 09:51 | |
jaosorior | uhm... sure, although I don't understand why. That's exactly the same syntax we use to set the firewall rules | 09:51 |
Tengu | funny thing: I'm pretty sure I already saw that one. | 09:51 |
Tengu | hmmmm. | 09:51 |
Tengu | maybe something fishy with my ruby libs version? | 09:51 |
Tengu | wait, rolling back to your syntaxe, and will push the code to my review in order to check what Zuul thinks of it. | 09:51 |
jaosorior | ok | 09:52 |
*** owalsh_ is now known as owalsh | 09:52 | |
Tengu | jaosorior: I think zuul doesn't run tests when we prefix the commit message with a "WIP" right? | 09:52 |
*** salmankhan has joined #tripleo | 09:53 | |
Tengu | oh. it actually does. ook. | 09:53 |
*** dbellant has joined #tripleo | 09:53 | |
Tengu | jaosorior: small remark: in order to check what was going on, I added a check that makes your definition fail when there isn't any endpoint defined for the service. I'm not sure if I can let it (i.e. will it break anything?) | 09:54 |
Tengu | hmm. it will break. because no service uses hiera for now. | 09:54 |
*** etingof has joined #tripleo | 09:55 | |
*** iranzo has quit IRC | 09:55 | |
*** aufi has joined #tripleo | 09:55 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support https://review.openstack.org/525492 | 09:58 |
*** dsariel has joined #tripleo | 09:58 | |
Tengu | jaosorior: -^ I'll let that one run the tests until the end of zuul in order to ensure nothing breaks. | 09:58 |
*** gfidente has quit IRC | 10:00 | |
shardy | dtantsur: Hey quick question, what's the osc plugin equivalent of ironic node-set-provision-state control-0 deleted ? | 10:00 |
shardy | probably obvious but I can't see what it is atm | 10:01 |
shardy | https://bugs.launchpad.net/tripleo/+bug/1734831 means I still need that a few times a day :( | 10:01 |
openstack | Launchpad bug 1734831 in tripleo "virtualbmc processes silently die over time" [Medium,Triaged] | 10:01 |
shardy | not been able to find the root cause yet, may try running the vbmc processes in a terminal to figure it out | 10:02 |
*** dbellant has quit IRC | 10:02 | |
*** dbellant has joined #tripleo | 10:03 | |
dtantsur | shardy: openstack baremetal node unprovision IIRC | 10:04 |
dtantsur | shardy: etingof is working on making vbmc a proper daemon, that may help | 10:04 |
shardy | dtantsur: ack, thanks - if you've got any other ideas how to debug I'm happy to try | 10:04 |
*** SlickNik- has joined #tripleo | 10:04 | |
shardy | the processes just die and AFAICS there's nothing in the logs | 10:04 |
*** SlickNik has quit IRC | 10:05 | |
*** SlickNik- is now known as SlickNik | 10:05 | |
Tengu | nice one. | 10:05 |
jistr | flaper87: are any of these errors the ones that stopped your OpenShift deployment? Inability to start origin-node.service because of: | 10:05 |
jistr | Dec 05 10:03:27 overcloud-controller-2 origin-node[849132]: W1205 10:03:27.530436 849176 cni.go:157] Unable to update cni config: No networks found in /etc/cni/net.d | 10:05 |
jistr | Dec 05 10:03:27 overcloud-controller-2 origin-node[849132]: F1205 10:03:27.538985 849176 start_node.go:140] could not start DNS, unable to read config file: open /etc/origin/node/resolv.conf: no... or directory | 10:05 |
* jistr may try redoing the OC from scratch to see if the error is reproducible\ | 10:06 | |
flaper87 | jistr: that's exactly the error I'm hitting | 10:09 |
flaper87 | it's basically because the 99-something dispatch for network-manager is not running | 10:09 |
flaper87 | or it is running but not for the right IFACE | 10:09 |
*** gfidente has joined #tripleo | 10:09 | |
*** gfidente has quit IRC | 10:09 | |
*** gfidente has joined #tripleo | 10:09 | |
jistr | ack, thanks | 10:10 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 10:10 |
flaper87 | if you run the sript manually, it'll generate the resolv.conf and you can start object-node | 10:10 |
flaper87 | jistr: ^ | 10:10 |
*** tosky has joined #tripleo | 10:11 | |
jistr | thanks. I'm redoing the OC to clean it up, i finished the install after a few unsuccessful attempts so i want to make sure i have a "clean expected broken state" :)) | 10:11 |
jistr | err i mean i didn't finish it, but in previous attempts it failed on different issues even earlier, hence the cleanup | 10:12 |
*** dbellant has quit IRC | 10:13 | |
*** dbellant has joined #tripleo | 10:15 | |
*** SlickNik- has joined #tripleo | 10:17 | |
*** SlickNik has quit IRC | 10:18 | |
*** SlickNik- is now known as SlickNik | 10:18 | |
*** sshnaidm|rover is now known as sshnaidm|rover|a | 10:18 | |
*** sshnaidm|rover|a is now known as sshnaidm|afk | 10:18 | |
*** hewbrocca_afk is now known as hewbrocca | 10:19 | |
Tengu | jaosorior: hmmm. weird. apparently, it's not only in my run of the tests that it fails. I'll try to check this afternoon or tomorrow. | 10:21 |
flaper87 | jistr: mmh, what did it fail on? | 10:23 |
jaganathan | please review tripleo-heat-templates patch https://review.openstack.org/#/c/523358/ | 10:24 |
jistr | flaper87: pebkac and environment setup issues, not really fault of the installer. Btw i use the 3.6 branch of openshift-ansible from github, do you use the same? | 10:24 |
flaper87 | jistr: I use the RPM | 10:25 |
jistr | flaper87: and where do you get it from? (not CentOS i guess?) | 10:25 |
flaper87 | jistr: sudo yum install -y centos-release-openshift-origin | 10:25 |
flaper87 | jistr: openshift-ansible | 10:25 |
flaper87 | jistr: it's 3.6, IIRC | 10:25 |
jistr | huh i tried that and i got some old openshift-ansible without the byo playbook directory | 10:26 |
*** jwb has quit IRC | 10:26 | |
flaper87 | jistr: there are multiple packages. Make sure openshift-ansible-playbooks is installed | 10:26 |
flaper87 | jistr: yum search openshift-ansible should give you several packages | 10:26 |
jistr | i installed just openshift-ansible IIRC, so if it doesn't pull all the necessary stuff then i was probably missing some RPM. Will try that again, thanks :) | 10:27 |
openstackgerrit | Merged openstack/tripleo-ui master: Prevent filter duplicates https://review.openstack.org/508536 | 10:28 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Make CephPools override properties of other pools https://review.openstack.org/525520 | 10:28 |
*** rcernin has quit IRC | 10:30 | |
*** dsariel has quit IRC | 10:32 | |
*** abregman has joined #tripleo | 10:33 | |
*** aufi has quit IRC | 10:37 | |
*** sshnaidm|afk is now known as sshnaidm|rover | 10:43 | |
*** ffiore has quit IRC | 10:45 | |
*** ffiore has joined #tripleo | 10:45 | |
shardy | jistr: Hey re https://review.openstack.org/#/c/523436/ I am missing something as that variable is undefined, where does it come from? | 10:46 |
dtantsur | folks, is tripleo-ci-centos-7-scenario002-multinode-oooq-container down? | 10:46 |
* shardy reads inventory docs | 10:47 | |
jistr | shardy: ah ha! And it works fine for you without the --private-key param altogether? I guess the variable may be only defined if --private-key is explicitly passed on the command line to the outer playbook... That's what happens when executing via tripleoclient --config-download, but i guess i broke the manual run by doing this. I'll post a patch to make the --private-key optional. | 10:49 |
shardy | jistr: ah yeah, perhaps we can make it optional | 10:49 |
shardy | jistr: I'm running via config download && ansible-playbook manually | 10:49 |
*** aufi has joined #tripleo | 10:50 | |
*** daidv has quit IRC | 10:50 | |
*** dbellant has quit IRC | 10:51 | |
*** dbellant has joined #tripleo | 10:52 | |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 10:52 |
*** salmankhan has quit IRC | 10:52 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Make Kubespray install work without --private-key too https://review.openstack.org/525524 | 10:53 |
jistr | shardy: ^^ | 10:54 |
jistr | i'll mark it wip for now as i didn't test yet | 10:54 |
shardy | jistr: thanks, testing now | 10:55 |
openstackgerrit | Lee Yarwood proposed openstack/tripleo-quickstart master: Allow the confgiuration of virtualbmc on Newton https://review.openstack.org/509219 | 10:55 |
*** salmankhan has joined #tripleo | 10:57 | |
*** dsariel has joined #tripleo | 11:02 | |
*** daidv has joined #tripleo | 11:05 | |
*** cshastri has quit IRC | 11:05 | |
sshnaidm|rover | myoung|ruck, weshay fyi https://bugs.launchpad.net/tripleo/+bug/1736383 | 11:05 |
openstack | Launchpad bug 1736383 in tripleo "RDO project registry: container push fails for a few containers" [Critical,Triaged] | 11:05 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 11:10 |
*** chem has quit IRC | 11:11 | |
*** etingof has quit IRC | 11:12 | |
*** stendulker_ has joined #tripleo | 11:14 | |
*** marios has quit IRC | 11:16 | |
*** stendulker has quit IRC | 11:18 | |
*** chem has joined #tripleo | 11:21 | |
*** stendulker_ has quit IRC | 11:21 | |
shardy | jistr: now that we don't set kubectl_localhost, what's the preferred method to get kubectl on the undercloud, do we have packages already or is it a manual install? | 11:24 |
*** etingof has joined #tripleo | 11:26 | |
*** udesale has quit IRC | 11:29 | |
*** adarazs is now known as adarazs_lunch | 11:35 | |
*** jkilpatr has quit IRC | 11:36 | |
*** janki has quit IRC | 11:39 | |
*** shreshtha has quit IRC | 11:40 | |
*** cshastri has joined #tripleo | 11:47 | |
*** ramishra has quit IRC | 11:50 | |
shardy | Ouch, actually turning it back on fails due to https://github.com/ansible/ansible/issues/11702 | 11:50 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove workaround for periodic jobs https://review.openstack.org/525541 | 11:52 |
sshnaidm|rover | panda, adarazs_lunch ^^ | 11:53 |
*** akrivoka has joined #tripleo | 11:55 | |
Tengu | hmmm, is it an known issue that doesn't break the CI checks? http://logs.openstack.org/92/525492/3/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6e8c26c/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2017-12-05_11_31_21 | 11:55 |
*** jkilpatr has joined #tripleo | 11:55 | |
openstackgerrit | Or Idgar proposed openstack/puppet-tripleo stable/pike: Remove erroneous octavia code related to sync_db https://review.openstack.org/513376 | 11:57 |
*** oidgar is now known as oidgar__ | 11:58 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli https://review.openstack.org/463728 | 11:58 |
jistr | shardy: centos ships kubernetes-client RPM | 11:58 |
*** oidgar__ has quit IRC | 12:02 | |
*** ramishra has joined #tripleo | 12:02 | |
jaosorior | Tengu: yeah, we need promotion in docker.io to happen before that gets fixed. | 12:02 |
*** oidgar__ has joined #tripleo | 12:02 | |
*** oidgar__ has quit IRC | 12:03 | |
*** oidgar has joined #tripleo | 12:03 | |
*** cshastri has quit IRC | 12:03 | |
*** raildo has joined #tripleo | 12:05 | |
*** anilvenkata has quit IRC | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 12:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
*** fzdarsky has joined #tripleo | 12:10 | |
openstackgerrit | Merged openstack/tripleo-common stable/pike: Memory channels parameter is not derivable https://review.openstack.org/525476 | 12:11 |
adarazs_lunch | sshnaidm|rover: +2 | 12:12 |
*** adarazs_lunch is now known as adarazs | 12:13 | |
*** lucasagomes is now known as lucas-hungry | 12:13 | |
*** pkovar has joined #tripleo | 12:14 | |
*** marios has joined #tripleo | 12:17 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 12:17 |
jistr | flaper87: so i got successfully further by deploying without br-ex, but not much further :) The origin-node.service started fine but it got to | 12:17 |
jistr | RUNNING HANDLER [openshift_node : restart openvswitch] | 12:18 |
jistr | where it got stuck | 12:18 |
jistr | and i can't ssh to the overcloud node... | 12:18 |
jistr | probably the ovs restart broke something w/ networking | 12:18 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Instance HA support https://review.openstack.org/506922 | 12:19 |
*** pgadiya has quit IRC | 12:23 | |
*** bfournie has quit IRC | 12:24 | |
*** bfournie has joined #tripleo | 12:24 | |
openstackgerrit | Numan Siddique proposed openstack/tripleo-quickstart master: Enable OVN HA profile in fset30 https://review.openstack.org/523804 | 12:24 |
*** pkovar has quit IRC | 12:28 | |
*** bfournie has quit IRC | 12:28 | |
*** pkovar has joined #tripleo | 12:28 | |
*** iranzo has joined #tripleo | 12:32 | |
*** ykarel_ has joined #tripleo | 12:34 | |
*** masco has quit IRC | 12:35 | |
*** skramaja has quit IRC | 12:36 | |
*** ykarel has quit IRC | 12:37 | |
*** psahoo has quit IRC | 12:37 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 12:37 |
*** fpan has joined #tripleo | 12:40 | |
jaosorior | shardy: just tested your patch out https://review.openstack.org/#/c/522344/3 worked awesomely :D | 12:42 |
jaosorior | tested it with my IPSEC patch https://review.openstack.org/#/c/521863/ | 12:42 |
*** ratailor has quit IRC | 12:43 | |
jaosorior | AND... the IPSEC stuff works! (I knew it worked, but it now works as a composable service) | 12:45 |
*** abregman is now known as abregman|mtg | 12:45 | |
*** Goneri has quit IRC | 12:45 | |
jaosorior | jistr: could you check this out? https://review.openstack.org/#/c/521863 could it be an acceptable iteration? The next step would be to stop cloning the IPSEC repo and have that available already. But other than that, it looks quite solid. | 12:46 |
jaosorior | shardy: ^^ | 12:46 |
openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 12:48 |
*** jpena is now known as jpena|lunch | 12:48 | |
*** mrch has quit IRC | 12:48 | |
*** fzdarsky has quit IRC | 12:49 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 12:50 |
*** abishop has joined #tripleo | 12:51 | |
*** gfidente has quit IRC | 12:54 | |
*** BryanS68 has joined #tripleo | 12:55 | |
openstackgerrit | Merged openstack/tripleo-ui master: Modals with react-bootstrap https://review.openstack.org/516362 | 12:55 |
openstackgerrit | Merged openstack/tripleo-ui master: Rework ModalPanel to be based on react-overlays https://review.openstack.org/516364 | 12:55 |
openstackgerrit | Merged openstack/tripleo-ui master: ModalPanel vs Validations sidebar positioning https://review.openstack.org/516365 | 12:55 |
*** gfidente has joined #tripleo | 12:56 | |
*** gfidente has quit IRC | 12:56 | |
*** gfidente has joined #tripleo | 12:56 | |
*** paramite has quit IRC | 12:58 | |
*** dprince has joined #tripleo | 12:58 | |
jistr | jaosorior: yea lgtm. Gave just +1 for now but i can circle back later, will also look at the parent patch. | 12:59 |
*** mrch has joined #tripleo | 12:59 | |
openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 13:01 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 13:01 |
jaosorior | jistr: fixed. Thanks! | 13:01 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add modal closing components https://review.openstack.org/520366 | 13:01 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add release notes for Modals and Validations sidebar changes https://review.openstack.org/524101 | 13:01 |
jistr | jaosorior: i didn't notice this at first -- i think the paths are out of sync there https://review.openstack.org/#/c/521863/12/extraconfig/services/ipsec.yaml | 13:05 |
*** jcoufal has joined #tripleo | 13:05 | |
*** cshastri has joined #tripleo | 13:06 | |
*** ramishra has quit IRC | 13:08 | |
jaosorior | jistr: oh wait, in the playbook directory there's supposed to be a "roles" directory that contains any custom roles that you add | 13:08 |
openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 13:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
*** bfournie has joined #tripleo | 13:10 | |
*** paramite has joined #tripleo | 13:10 | |
*** rhallisey has joined #tripleo | 13:10 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 13:10 |
*** lucas-hungry is now known as lucasagomes | 13:14 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/525603 | 13:14 |
jaosorior | jistr: changed it and trying it out again. | 13:15 |
openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Add disruption detector for Overcloud endpoint monitoring https://review.openstack.org/520126 | 13:17 |
jaosorior | jkilpatr: seems that folks are uploading roles to tripleo-common now. that would make it easier to integrate the rsyslog role: https://review.openstack.org/#/c/487450/ | 13:18 |
jkilpatr | jaosorior, nice! I was just working on updating my spec | 13:19 |
jaosorior | jkilpatr: that way, you won't need to worry about packaging n stuff :D | 13:20 |
dtantsur | attempt #2: should I recheck Could not pull image docker.io/tripleomaster/centos-binary-barbican-keystone-listener in sc002? | 13:20 |
dtantsur | is there a bug number for it? | 13:21 |
jaosorior | dtantsur: no bug yet | 13:21 |
jaosorior | dtantsur: promotion is needed for docker images on docker.io | 13:21 |
jaosorior | sshnaidm|rover: ^^ | 13:21 |
dtantsur | jaosorior: fine, but why do we try getting a non-existing image? shouldn't we use an older one? | 13:21 |
jaosorior | no idea | 13:22 |
*** links has quit IRC | 13:22 | |
dtantsur | sigh.. is everything affected or is it just my bad luck (i.e. is it worth retrying)? | 13:22 |
jaosorior | dtantsur: it will fail scenario002 every time. | 13:22 |
sshnaidm|rover | dtantsur, I'm working on this right now.. | 13:23 |
dtantsur | ack, thanks sshnaidm|rover | 13:23 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update roles listing https://review.openstack.org/509415 | 13:23 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor ImportPlanCard into ActionCard https://review.openstack.org/512265 | 13:23 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Select Roles feature https://review.openstack.org/512266 | 13:23 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] Submit select roles https://review.openstack.org/521510 | 13:23 |
*** s_b_34343 has joined #tripleo | 13:25 | |
weshay | myoung|ruck, ping | 13:25 |
dpawar | Is there a know issue for Zuul gate is timed_out for legacy-puppet-unit-4.8-centos-7 ? | 13:25 |
dpawar | http://logs.openstack.org/05/525105/2/gate/legacy-puppet-unit-4.8-centos-7/79bb988/job-output.txt.gz#_2017-12-05_07_01_00_938361 | 13:26 |
*** liverpooler has joined #tripleo | 13:26 | |
*** thrash|g0ne is now known as thrash | 13:26 | |
*** jwb_ has joined #tripleo | 13:26 | |
dpawar | abishop: ^^ | 13:26 |
*** jwb_ is now known as jwb | 13:27 | |
weshay | sshnaidm|rover, myoung|ruck looks like the promoter is currently promoting testing to current-tripleo | 13:27 |
weshay | afaict | 13:27 |
*** cshastri has quit IRC | 13:27 | |
dpawar | dprince: ^^ | 13:27 |
sshnaidm|rover | weshay, yes, it is | 13:27 |
weshay | sshnaidm|rover, rock on | 13:27 |
*** ffiore has quit IRC | 13:28 | |
*** pchavva has joined #tripleo | 13:28 | |
*** tzumainn has joined #tripleo | 13:28 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 13:29 |
weshay | arxcruz, is this associated w/ a bug? https://review.openstack.org/#/c/525603/ | 13:30 |
arxcruz | weshay: yes, I haven't add the bug because i'm still testing | 13:30 |
*** trown|outtypewww is now known as trown | 13:30 | |
weshay | arxcruz, k | 13:30 |
*** udesale has joined #tripleo | 13:32 | |
abishop | dpawar: sorry, I'm not familiar with that test | 13:32 |
sshnaidm|rover | jaosorior, dtantsur https://bugs.launchpad.net/tripleo/+bug/1736411 | 13:32 |
openstack | Launchpad bug 1736411 in tripleo "CI: scenario002 job fails when not finding centos-binary-barbican-keystone-listener container" [Critical,Triaged] | 13:32 |
dtantsur | thanks! | 13:32 |
sshnaidm|rover | I'll try to upload it manually right now | 13:32 |
*** ffiore has joined #tripleo | 13:32 | |
*** rlandy has joined #tripleo | 13:33 | |
jistr | jaosorior: will the generated_psk work fine w/ stack updates too? | 13:33 |
*** psachin has quit IRC | 13:33 | |
*** oidgar has quit IRC | 13:34 | |
jaosorior | jistr: it should, it should only rekey (which is nice for security). I'll try it right now :D | 13:36 |
*** moshele has quit IRC | 13:37 | |
jaosorior | jistr: a stack update would be a matter of running ansible again, right? | 13:37 |
*** moshele has joined #tripleo | 13:39 | |
*** janki has joined #tripleo | 13:40 | |
*** jaganathan has quit IRC | 13:42 | |
openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-specs master: rsyslog remote logging https://review.openstack.org/523493 | 13:43 |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS https://review.openstack.org/525608 | 13:45 |
*** jkilpatr has quit IRC | 13:47 | |
*** jkilpatr has joined #tripleo | 13:48 | |
*** liverpooler has quit IRC | 13:49 | |
*** liverpooler has joined #tripleo | 13:49 | |
*** fpan has quit IRC | 13:50 | |
*** artom_ has quit IRC | 13:52 | |
*** jangutter has joined #tripleo | 13:52 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files. https://review.openstack.org/520639 | 13:53 |
jistr | jaosorior: yea for the purpose of the generated_psk thing, yes | 13:53 |
*** jpena|lunch is now known as jpena | 13:57 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 13:59 |
EmilienM | hi | 13:59 |
mwhahaha | hi2u | 13:59 |
EmilienM | hi2u2 | 13:59 |
jistr | hi4all | 14:00 |
mwhahaha | #startmeeting tripleo | 14:00 |
mwhahaha | #topic agenda | 14:00 |
mwhahaha | * Review past action items | 14:00 |
mwhahaha | * One off agenda items | 14:00 |
mwhahaha | * Squad status | 14:00 |
mwhahaha | * Bugs & Blueprints | 14:00 |
openstack | Meeting started Tue Dec 5 14:00:05 2017 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
mwhahaha | * Projects releases or stable backports | 14:00 |
mwhahaha | * Specs | 14:00 |
mwhahaha | * open discussion | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
mwhahaha | Hi everyone! who is around today? | 14:00 |
*** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
openstack | The meeting name has been set to 'tripleo' | 14:00 |
weshay | 0/ | 14:00 |
*** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
EmilienM | o/ | 14:00 |
jtomasek | o/ | 14:00 |
fultonj | o/ | 14:00 |
abishop | o/ | 14:00 |
gfidente | o/ | 14:00 |
marios | o/ | 14:00 |
akrivoka | o/ | 14:00 |
beagles | o/ | 14:00 |
jaosorior | o/ | 14:00 |
florianf | gchamoul: Hi! akrivoka and I have created an etherpad with patches we'd like to give priority among the many which haven't been reviewed yet. feel free to add some of your patches you consider most important: http://etherpad.corp.redhat.com/validations-reviews | 14:00 |
jfrancoa | o/ | 14:01 |
florianf | o/ | 14:01 |
slagle | hi | 14:01 |
*** vpickard_ is now known as vpickard | 14:01 | |
*** pkovar has quit IRC | 14:01 | |
panda | o/ | 14:01 |
sshnaidm|rover | o/ | 14:01 |
akrivoka | florianf: gchamoul: let's use this one instead :) https://etherpad.openstack.org/p/validations-reviews | 14:01 |
d0ugal | o/ | 14:01 |
ccamacho | o/ | 14:02 |
shardy | o/ | 14:02 |
mwhahaha | #topic review past action items | 14:02 |
mwhahaha | none | 14:02 |
*** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
mwhahaha | moving on | 14:02 |
mwhahaha | #topic one off agenda items | 14:02 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:02 |
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:02 | |
*** mmethot|away is now known as mmethot | 14:02 | |
dpeacock | o/ | 14:02 |
mwhahaha | (mwhahaha) Queens-m2 is here and gone. Queens-m3 is next (Jan 22 - Jan 26). | 14:02 |
mwhahaha | Milestone 2 is this week. We've already cut the release so at this point it's now more book keeping to understand what was released and where we're are for the final milestone. It should be noted that we were going to stop allowing the starting of new features at milestone 2 this release so if you're feature isn't started then now is the time to considering moving it to Rocky. I believe we can still make some | 14:02 |
mwhahaha | progress on some of the work if we can ensure that the feature is off by default and does not impact the existing features. | 14:02 |
mwhahaha | If you have an open feature, please review the outstanding work and be able to explain why we should allow your feature to continue forward for Queens. There are some features which we will most likely still need allow new work. For example the upgrades workflows and things related to fast forward upgrades. Beyond that, we should be focusing on bugs as we have nearly 540 open bugs. | 14:03 |
mwhahaha | I'm going to also send an ML note about this as well. | 14:03 |
*** aputtur_ has joined #tripleo | 14:03 | |
*** oidgar has joined #tripleo | 14:03 | |
mwhahaha | It's time to start stablizing | 14:03 |
EmilienM | tl;dr no new things from now | 14:03 |
oidgar | o/ | 14:03 |
*** artom has joined #tripleo | 14:04 | |
florianf | akrivoka: :-) | 14:04 |
mwhahaha | any questions? | 14:04 |
gchamoul | florianf, akrivoka: ack | 14:04 |
EmilienM | I agree with Alex, we should stabilize what we started in queens, stop starting, start stopping, with exceptions for FFU and upgrades | 14:04 |
gfidente | I think integration squad has a couple of things in progress, which landed only partially | 14:04 |
gfidente | that ceph rbd mirror and nfs-ganesha | 14:04 |
EmilienM | gfidente: I think that's fine, since it's a feature in progress I guess | 14:05 |
*** ramishra has joined #tripleo | 14:05 | |
EmilienM | it can be finished in m3 | 14:05 |
mwhahaha | gfidente: which is fine but we'll need to raise those and explain the impact and make sure we're not adding regressions | 14:05 |
matbu | o/ | 14:05 |
EmilienM | iiuc the message is: from now, don't expect patches to land if they do something really new | 14:05 |
shardy | I was wondering if we planed to swith to the --config-download workflow for default or if we'll have to wait for rocky | 14:05 |
mwhahaha | gfidente: it would also be beneficial to land those sooner than later, so let us know if you need reviews | 14:05 |
gfidente | mwhahaha EmilienM ok thanks guys | 14:06 |
EmilienM | shardy: really good question | 14:06 |
gfidente | rbdmirror should be good, just needs an update | 14:06 |
shardy | IMO it'd be good to align on one deploy workflow, as it's a bit of a headache trying to keep the two approaches in sync | 14:06 |
gfidente | nfs-ganesha news some more iterations | 14:06 |
* social o/ | 14:06 | |
EmilienM | shardy: AFIK it doesn't work yet with OVB (we tried yesterday) - maybe a simple thing, but we haven't tested it in CI | 14:06 |
shardy | unless there are blocker issues, I'd like to switch to it by default, with a flag to re-enable the "classic" heat based workflow for Queens | 14:07 |
EmilienM | shardy: I agree | 14:07 |
shardy | then remove the heat software deployment bits potentially in Rocky | 14:07 |
dprince | ++ for config-download | 14:07 |
mwhahaha | if we can, let's do it like ASAP | 14:07 |
mwhahaha | It's not something we should do in january | 14:07 |
shardy | EmilienM: Ok, maybe we could have a WIP patch switching the default to flush out any remaining issues? | 14:07 |
mwhahaha | i'd rather we have time to flush out all the issues | 14:07 |
EmilienM | slagle: thoughts? | 14:08 |
shardy | mwhahaha: yup agreed, if we're doing it we need to land it asap | 14:08 |
arxcruz | o/ | 14:08 |
jpich | Will we be tagging releases early on milestone week now, in general? They used to be done on Thursdays during milestones, from what I recall | 14:08 |
gfidente | shardy is config-download currently interpolating with the ExternalResource ? | 14:09 |
shardy | gfidente: yes it works with the external_deploy_tasks, but not the mistral workflow resources | 14:09 |
gfidente | sorry not interpolating, interleaving | 14:09 |
shardy | gfidente: what's the status of reworking the ceph integration to external_deploy_tasks? | 14:09 |
gfidente | shardy auch, like zero | 14:09 |
mwhahaha | jpich: the release team got really approve happy, but we shouldn't expect the end of the week. that being said we'll allow a few things to land this week while we do the updates to BPs and such | 14:09 |
shardy | gfidente: :( | 14:09 |
shardy | I thought it was discussed a while ago | 14:10 |
gfidente | discussed yes, at ptg | 14:10 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736411 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1736411 in tripleo "CI: scenario002 job fails when not finding centos-binary-barbican-keystone-listener container" [Critical,Triaged] | 14:10 |
jpich | mwhahaha: Noted | 14:10 |
jpich | Thanks | 14:10 |
shardy | in theory it should be fairly easy as it's just moving the ansible playbook run from mistral to t-h-t | 14:10 |
gfidente | shardy did not do the actual work though | 14:10 |
shardy | gfidente: that's true, I did not ;) | 14:10 |
gfidente | I think jistr did some investigation? | 14:10 |
gfidente | shardy yeah I did not even, just bringing up needs to be done | 14:10 |
shardy | gfidente: maybe we can take a look and figure out how much work it will be | 14:10 |
gfidente | shardy yeah sounds like we should | 14:11 |
EmilienM | we probably need to take some actions | 14:11 |
mwhahaha | #action EmilienM and slagle look at switching config-download as default | 14:11 |
EmilienM | #action EmilienM to talk with slagle about switching default deployments to use config-download | 14:12 |
EmilienM | argggg | 14:12 |
beagles | gfidente, shardy, if you guys were going to do this soon (like today) we could kill two birds with one stone if I could look-on | 14:12 |
EmilienM | #undo | 14:12 |
* mwhahaha is faster | 14:12 | |
EmilienM | mwhahaha: mine was longer | 14:12 |
EmilienM | undo didn't work? | 14:12 |
shardy | beagles: ah yeah we need the same for octavia | 14:12 |
weshay | lol | 14:12 |
s_b_34343 | HI all , i'm new to triplo controller HA. | 14:12 |
mwhahaha | #action gfidente and shardy look at ceph-ansible and config-download | 14:12 |
beagles | I think I've got the gist of it and am in the process of trying it out but I think the general ideas are the same | 14:12 |
EmilienM | s_b_34343: in a meeting right now, we'll answer all your questions shortly | 14:12 |
slagle | EmilienM: sorry got distracted with something else | 14:13 |
slagle | we can discuss post-meeting | 14:13 |
shardy | beagles: yeah I think it's logically the same as the mistral approach, but generating the inventory may differ a bit | 14:13 |
s_b_34343 | how shoul i start will be needing doc | 14:13 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/kubernetes-master.yaml | 14:13 |
beagles | shardy, ack | 14:13 |
EmilienM | slagle: perfect | 14:13 |
shardy | that is a working example for kubespray | 14:13 |
s_b_34343 | to understand controller ha working for triplo | 14:13 |
mwhahaha | also | 14:13 |
mwhahaha | #link https://releases.openstack.org/queens/schedule.html | 14:13 |
gfidente | shardy ack | 14:13 |
mwhahaha | ok moving on | 14:13 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/pike: Remove yum warning in ceph-ansible validation https://review.openstack.org/525618 | 14:13 |
mwhahaha | (akrivoka) Validations patches in need of reviews | 14:13 |
mwhahaha | #link https://etherpad.openstack.org/p/validations-reviews | 14:13 |
akrivoka | hi | 14:13 |
akrivoka | it's been a bit of a challange lately getting validations patches merged, as we have very few cores reviewing regularly | 14:13 |
akrivoka | we have some patches that have been up for a long time, so just wanted to ask people to review them so we can get them merged | 14:14 |
akrivoka | (see link above) | 14:14 |
EmilienM | akrivoka: nice work on validations, I'm doing some reviews sometimes, it's really good | 14:14 |
akrivoka | that's pretty much it | 14:14 |
mwhahaha | akrivoka: thanks | 14:14 |
s_b_34343 | <EmilienM>: ok will wait | 14:14 |
akrivoka | EmilienM: thanks, much appreciated! | 14:14 |
mwhahaha | #action team to review open validation patches | 14:14 |
gchamoul | +1 for EmilienM | 14:14 |
mwhahaha | (gcerami) getting a list of containers built by kolla | 14:14 |
EmilienM | quick question | 14:14 |
*** aputtur_ has quit IRC | 14:14 | |
EmilienM | before we switch to containers | 14:14 |
*** ykarel_ is now known as ykarel|afk | 14:14 | |
EmilienM | akrivoka: where these validations are tested? | 14:15 |
EmilienM | I know tripleo-ci-centos-7-containers-multinode is supposed to run them? | 14:15 |
akrivoka | EmilienM: not sure tbh | 14:15 |
EmilienM | akrivoka: can you show me logs on where validations are run? | 14:15 |
EmilienM | http://logs.openstack.org/79/525179/1/check/tripleo-ci-centos-7-containers-multinode/a72e345/logs/ | 14:15 |
akrivoka | maybe florianf knows? | 14:16 |
EmilienM | akrivoka: your team needs to figure out how your code is tested, imho | 14:16 |
EmilienM | akrivoka: and if you need help from CI team, please ask | 14:16 |
gchamoul | EmilienM: validations runs are enabled only on a few list of scenarios | 14:16 |
akrivoka | ok, I will look into it | 14:16 |
EmilienM | gchamoul: which ones? can I see logs? | 14:17 |
EmilienM | we can take it offline though | 14:17 |
gchamoul | EmilienM: let me check the list for you | 14:17 |
EmilienM | #action EmilienM, akrivoka, gchamoul to check where validations are tested in tripleo ci | 14:17 |
EmilienM | gchamoul: ok, post-meeting | 14:17 |
EmilienM | mwhahaha: go ahead | 14:17 |
florianf | EmilienM: only manually afaik | 14:17 |
mwhahaha | well gcerami is not here | 14:17 |
EmilienM | panda: ^ | 14:17 |
sshnaidm|rover | mwhahaha, he's panda | 14:17 |
gchamoul | EmilienM: I planned to add the right set of jobs into tripleo-validations | 14:18 |
panda | hi, right now we are using a single static file as a list of containers to upload after promotion. WE were planning to make it pe release and get the list from kolla/parsed_containers.txt on each build, but thre are some reviews that make that list obsolete, What is now the best way to get a list of built containers so we know what to upload after a promotion ? | 14:18 |
mwhahaha | ah brain not working yet | 14:18 |
mwhahaha | I guess that's a question for dprince or mandre -^ | 14:18 |
*** anilvenkata has joined #tripleo | 14:19 | |
sshnaidm|rover | it's root cause of current https://bugs.launchpad.net/tripleo/+bug/1736411 | 14:19 |
openstack | Launchpad bug 1736411 in tripleo "CI: scenario002 job fails when not finding centos-binary-barbican-keystone-listener container" [Critical,Triaged] | 14:19 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use ListView from patternfly-react for NodesListView https://review.openstack.org/505611 | 14:20 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use ListView from patternfly-react for NodeDrives list https://review.openstack.org/505612 | 14:20 |
dprince | panda: I think you can use the new 'container image prepare' commands to generate an upload yaml file dynamically | 14:20 |
dprince | panda: in python-tripleoclient. Would this help solve your case? | 14:20 |
panda | dprince: do we need to install undercloud first ? | 14:20 |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating https://review.openstack.org/511249 | 14:20 |
dprince | panda: no, the command just requires python-tripleoclient | 14:21 |
apetrich | jtomasek, I've updated ^^ now it returns the flattened params | 14:21 |
dprince | panda: you could even install it in a .venv | 14:21 |
sshnaidm|rover | dprince, does it generate per release? | 14:21 |
mandre | panda: the overcloud_containers.yaml.j2 file in tripleo-common has the list of all the images used in tripleo deployments | 14:21 |
jtomasek | apetrich: sweet | 14:21 |
apetrich | :) | 14:21 |
dprince | sshnaidm|rover: it an. It has parameters for the container names (prefix/suffix). Also the tag, and namespace can be fully controlled | 14:22 |
jaosorior | jistr: the PSK change worked with updates. | 14:22 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Do not merge - Check job multinode-upgrades-master https://review.openstack.org/525625 | 14:22 |
panda | mandre: taht would require tripleo-common to be fetched too ? | 14:22 |
jistr | jaosorior: ack great :) (mtg here...) | 14:22 |
jaosorior | sorry | 14:23 |
dprince | panda,sshnaidm|rover: openstack overcloud container image prepare --namespace=trunk.registry.rdoproject.org/master --images-file=rdo-images.yaml --push-destination=172.19.0.2:8787 --tag tripleo-ci-testing | 14:23 |
sshnaidm|rover | dprince, I mean in pike set of containers could be different then in queens, isn't it? | 14:23 |
dprince | sshnaidm|rover: then you'd use the Pike version of tripleoclient. It has the same command and could manage the differences via the template in python-tripleoclient | 14:23 |
mandre | panda: right, or a curl since it's just a single file | 14:24 |
jistr | ( gfidente, shardy: sorry i missed the mention earlier, let's sync after the meeting. We have Kubespray running in CI and green so that's at least somewhat of a "proof" that porting ceph-ansible to external_deploy_tasks should be achievable.) | 14:24 |
jaosorior | sshnaidm|rover: they already are different. | 14:24 |
sshnaidm|rover | dprince, great | 14:24 |
panda | yeah i think we can try the command solution | 14:24 |
panda | thanks all! | 14:25 |
weshay | thanks panda | 14:25 |
mwhahaha | cool thanks | 14:25 |
mwhahaha | moving on | 14:26 |
mwhahaha | #topic Squad status | 14:26 |
mwhahaha | ci | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:26 |
mwhahaha | upgrade | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:26 |
mwhahaha | containers | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:26 |
*** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:26 | |
mwhahaha | integration | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:26 |
mwhahaha | ui/cli | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:26 |
mwhahaha | validations | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:26 |
mwhahaha | networking | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:26 |
mwhahaha | workflows | 14:26 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:26 |
*** jmelvin has joined #tripleo | 14:26 | |
mwhahaha | workflows missing updates | 14:26 |
mwhahaha | I want to thank beagles for starting the networking squad meeting yesterday. very informative | 14:27 |
mwhahaha | everyone updated their status, thanks! | 14:27 |
mwhahaha | any other status related items folks would like to raise | 14:27 |
EmilienM | I was wondering if a weekly small summary on the ML would help | 14:28 |
EmilienM | some other teams like Keystone, Nova, do it | 14:28 |
*** Goneri has joined #tripleo | 14:28 | |
EmilienM | but it would take someone willing to write-up something | 14:28 |
d0ugal | One for tripleo or per squad? | 14:28 |
EmilienM | for tripleo maybe? I'm not sure, it's a proposal | 14:29 |
EmilienM | like "a week in tripleo", that you can read in less than 5 min | 14:29 |
d0ugal | I had considered doing this for the workflow squad, but there hasn't been much to share. (We have only had two meetings so far) | 14:29 |
mwhahaha | EmilienM: are you volunteering to put it together? :D | 14:29 |
mwhahaha | i mean it's a good idea but it's yet more work | 14:29 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Use cachable facts to allow multiple runs https://review.openstack.org/525237 | 14:29 |
EmilienM | ok... got it... I'll start something then :D | 14:29 |
d0ugal | lol | 14:29 |
EmilienM | but in french | 14:29 |
*** jcoufal has quit IRC | 14:29 | |
mwhahaha | sure no one reads the ML anyway | 14:30 |
trown | there is also chicken egg of... will people read it | 14:30 |
EmilienM | trown: I'll give it a first try and ask who read it | 14:30 |
mwhahaha | I guess it's more for folks not already knee deep in tripleo | 14:30 |
mwhahaha | to get the highlights | 14:30 |
trown | or lowlights :p | 14:30 |
mwhahaha | let's try it and it could just be a basic summary out of the status etherpads | 14:30 |
EmilienM | #action EmilienM starts to send a weekly newsletter about tripleo | 14:30 |
mwhahaha | cool, moving on then | 14:31 |
EmilienM | or a summary of weshay's bad jokes | 14:31 |
mwhahaha | #topic bugs & blueprints | 14:31 |
mwhahaha | #link https://launchpad.net/tripleo/+milestone/queens-3 | 14:31 |
mwhahaha | For Queens we currently have 71 (+1) blueprints and about 540 (-1) open bugs. 540 queens-3. | 14:31 |
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:31 | |
trown | haha | 14:31 |
EmilienM | but we need more than 5 min reading | 14:31 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Do not merge - Check job multinode-upgrades-master https://review.openstack.org/525625 | 14:31 |
weshay | EmilienM, you had a good one today.. I see forward progress | 14:31 |
mwhahaha | i'm probably going to move the <= medium bugs out to a rocky-1 milestone just so we can see what high/critical bugs we have for milestone 3 | 14:32 |
mwhahaha | please take a look at the high/critical bugs as we've previously mentioned now is a time for stablization | 14:32 |
EmilienM | mwhahaha: do you need help in creating milestones and moving things around? | 14:32 |
mwhahaha | also i see some alert bugs poping up, let's make sure to take a look at them | 14:32 |
mwhahaha | EmilienM: no i'll get it today. i moved all the m2 bugs to m3 last night | 14:32 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Do not merge - Check job multinode-upgrades-master https://review.openstack.org/525625 | 14:32 |
EmilienM | ok | 14:32 |
EmilienM | the 2 alerts are unassigned | 14:33 |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1736284 | 14:33 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 14:33 |
EmilienM | who is working on this one? | 14:33 |
mwhahaha | that one looks like the one we just fixed | 14:33 |
mwhahaha | i hadn't looked at the logs yet | 14:33 |
*** dpawar has quit IRC | 14:33 | |
mwhahaha | but we'd see the same stuff with the ovsdbapp thing | 14:33 |
EmilienM | I pinged Ihar | 14:33 |
mwhahaha | k | 14:33 |
EmilienM | same for https://bugs.launchpad.net/tripleo/+bug/1736411 | 14:33 |
openstack | Launchpad bug 1736411 in tripleo "CI: scenario002 job fails when not finding centos-binary-barbican-keystone-listener container" [Critical,Triaged] | 14:33 |
mwhahaha | that one i assume is a missing container from promotion? | 14:34 |
EmilienM | jaosorior: can you take this one? or find someone actively working on it? | 14:34 |
mwhahaha | related to panda's request previously? | 14:34 |
EmilienM | most probably - but we need an owner | 14:34 |
sshnaidm|rover | EmilienM, I'm actually working on it | 14:34 |
jaosorior | EmilienM: it's the image issue I was complaining about. | 14:34 |
jaosorior | EmilienM: sshnaidm|rover is working on it AFAIK. | 14:34 |
EmilienM | sshnaidm|rover: so if you're working on it, please assign it to you | 14:35 |
EmilienM | folks, please keep launchpad updated | 14:35 |
sshnaidm|rover | EmilienM, assigned | 14:35 |
EmilienM | good. | 14:35 |
mwhahaha | cool thanks, any other bug related items? | 14:35 |
mwhahaha | #topic projects releases or stable backports | 14:37 |
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:37 | |
mwhahaha | so m2 went out yesterday | 14:37 |
mwhahaha | EmilienM: when is the next round of stable releases? next week? | 14:37 |
EmilienM | yeah I think so | 14:38 |
EmilienM | or I can do it end of this week | 14:38 |
*** pdeore has quit IRC | 14:39 | |
mwhahaha | the release team would probably prefer next week | 14:39 |
EmilienM | sounds good for me | 14:39 |
mwhahaha | ok | 14:39 |
mwhahaha | any other backports people need reviews on? | 14:39 |
EmilienM | we said we keep stable/newton until January and then we see | 14:40 |
EmilienM | (just a heads-up) | 14:40 |
*** udesale has quit IRC | 14:40 | |
mwhahaha | k | 14:40 |
EmilienM | the # of backports into that branch is decreasing a lot | 14:41 |
*** BryanS68 has quit IRC | 14:41 | |
EmilienM | (good sign) | 14:41 |
EmilienM | I think we can move on | 14:41 |
mwhahaha | #topic specs | 14:41 |
mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:41 |
*** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:41 | |
mwhahaha | since it's m2, we should be moving any open specs to rocky | 14:42 |
EmilienM | maybe we can give an extra-very-last week | 14:42 |
mwhahaha | that's fine | 14:42 |
EmilienM | and warn people by IRC, email, etc | 14:42 |
mwhahaha | i'll include that in my email note about m2/m3 | 14:43 |
EmilienM | I see 5 potential specs that has +2 already | 14:43 |
EmilienM | good | 14:43 |
mwhahaha | Also i'll be going through the blueprints and pinging folks and moving to future releases | 14:44 |
mwhahaha | anyway on to bonus time | 14:44 |
mwhahaha | #topic open discussion | 14:44 |
*** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:44 | |
mwhahaha | any random topics that people want to chat about? | 14:44 |
*** moshele has quit IRC | 14:44 | |
EmilienM | did we update the list of cores? | 14:45 |
EmilienM | I've seen nominations lately | 14:45 |
EmilienM | rlandy was the latest iirc | 14:45 |
EmilienM | trown: ^ | 14:45 |
mwhahaha | i believe the rest have been included, rlandy should be added if not already | 14:45 |
*** jaosorior has quit IRC | 14:46 | |
EmilienM | I went ahead and added her to https://review.openstack.org/#/admin/groups/190,members | 14:46 |
mwhahaha | k | 14:47 |
EmilienM | sounds like we're done | 14:47 |
mwhahaha | ok thanks everyone | 14:47 |
mwhahaha | #endmeeting | 14:47 |
*** openstack changes topic to "CI status: GREEEEEEEEN! see alerts and read ML. | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:47 | |
openstack | Meeting ended Tue Dec 5 14:47:33 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:47 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-12-05-14.00.html | 14:47 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-12-05-14.00.txt | 14:47 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-12-05-14.00.log.html | 14:47 |
EmilienM | s_b_34343: don't hesitate to ask your question here, please add details of what you're doing, and which doc you're following. | 14:47 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add version and git sha to debug modal https://review.openstack.org/519835 | 14:48 |
EmilienM | gchamoul: I propose to enable validations on tripleo-ci-centos-7-containers-multinode which already runs in tripleo-validations | 14:48 |
gchamoul | EmilienM, akrivoka, florianf: well, one example and the only one I found https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-tripleo-ci-delorean-full-minimal-76/undercloud/home/stack/ | 14:48 |
EmilienM | gchamoul: this is not the gate | 14:49 |
gchamoul | EmilienM: yes that was tested before zuulv3 | 14:49 |
gchamoul | I think | 14:49 |
EmilienM | gchamoul: no, I checked the featuresets, and it was tested on multinode-scenarios jobs (non containerized) | 14:49 |
*** udesale has joined #tripleo | 14:50 | |
EmilienM | but since we stopped to run these jobs in master (and we only run them in stable/pike and before), we don't run validations anymore | 14:50 |
gchamoul | EmilienM: yes | 14:50 |
EmilienM | so I propose to use tripleo-ci-centos-7-containers-multinode | 14:50 |
EmilienM | which is featureset010.yml | 14:50 |
EmilienM | so if that's fine for you, you can send a patch to featureset010.yml to activate the validations and we'll see how that works | 14:50 |
gchamoul | EmilienM: that's fine to me | 14:51 |
EmilienM | gchamoul: cool, let me know when you have a patch, i'll review it | 14:51 |
gchamoul | EmilienM: so nothing to change in the tripleo-validations zuul.d/project.yaml? | 14:51 |
EmilienM | gchamoul: nope | 14:52 |
EmilienM | gchamoul: for now | 14:52 |
gchamoul | EmilienM: ack got it! thanks, I am doing the patch right now | 14:52 |
*** pkovar has joined #tripleo | 14:52 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Refactor lodash imports https://review.openstack.org/509778 | 14:52 |
EmilienM | gchamoul: if there are some validations specific to some services (e.g. ceilometer), we'll have to run scenario001 (and patch the featureset) | 14:52 |
EmilienM | gchamoul: but let's start small | 14:52 |
EmilienM | gchamoul: thanks for the help | 14:52 |
slagle | shardy: what is it that you have to do in 2 places with regards to config-download? | 14:53 |
florianf | gchamoul: thanks for creating a patch! | 14:53 |
EmilienM | slagle: during the meeting we discussed about whether or not we want to enable config-download by default in queens - and we said "yes, why not, but we need to make sure it works everywhere first (in all CI jobs I guess) and fix all found issues as soon as possible - we also said we would allow to disable it via the client | 14:54 |
EmilienM | what are your thoughts? | 14:54 |
*** lblanchard has joined #tripleo | 14:54 | |
*** BryanS68 has joined #tripleo | 14:54 | |
gchamoul | EmilienM: ok let's start small, but yes in the future we should test validations against ceilomter, ceph and maybe others services we (florianf & akrivoka) would like to see running | 14:54 |
slagle | EmilienM: 1) given that we have insufficient api abstraction behind our workflows, it requires client changes, thus there are UI implications. We'd need to make sure they can take on that work | 14:55 |
slagle | EmilienM: 2) it does not exactly fit with the themes of "stabilization" | 14:56 |
EmilienM | gchamoul: sure, I can even help there | 14:56 |
slagle | 3) there is still some work to do to make it work for the SSHKnownHosts deployments for nova live migration since those deployments rely on Heat deployment outputs | 14:56 |
gchamoul | EmilienM: perfect! | 14:56 |
slagle | EmilienM: those are the 3 big items why I've not been pushing to make it default in queens | 14:57 |
EmilienM | slagle: that's good feedback, indeed. | 14:57 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Enable tripleo-validations runs in featureset010 https://review.openstack.org/525637 | 14:57 |
florianf | gchamoul, EmilienM: For now it would be a big step forward if we would test the inventory (beyond unit tests) and *some* of the undercloud validations. But I agree, in the long run we might want to have as many validations as possible covered by ci. | 14:57 |
mandre | panda: something like this should get you all the required images for a given release of tripleo, http://paste.openstack.org/show/628173/ | 14:57 |
shardy | slagle: https://review.openstack.org/#/c/522344/3/common/deploy-steps.j2 is an example, e.g if we're not switching the default I probably have to update that to add the per-service deploy_steps_tasks into the heat driven playbook | 14:58 |
gchamoul | EmilienM, akrivoka, florianf: https://review.openstack.org/#/c/525637/ | 14:58 |
*** lblanchard has quit IRC | 14:58 | |
shardy | it's not a huge issue but at some point it'd be really great to switch to one workflow | 14:58 |
EmilienM | gchamoul: commented | 14:58 |
shardy | maybe it's too soon tho given the issues mentioned above | 14:58 |
shardy | thanks for the update | 14:58 |
panda | mandre: thanks, adding among the possible solutions | 14:59 |
*** udesale has quit IRC | 14:59 | |
slagle | shardy: i thought that was the heat driven playbook? that's the same playbook that config-download uses | 14:59 |
d0ugal | Anyone got a moment for a small quickstart change? https://review.openstack.org/523393 | 14:59 |
slagle | EmilienM: shardy : i'm certainly not opposed to making it the default. just given where we are, i'm not sure it's feasibly at this point | 15:00 |
EmilienM | slagle, shardy : I guess a good compromise is to expose the feature without enabling it by default | 15:00 |
shardy | slagle: yes that's my point, it's what config download uses, but the heat driven one is in the RoleConfig resource at line 81-103 | 15:00 |
shardy | slagle: and we can't support stuff like external_deploy_tasks via the heat driven workflow | 15:00 |
EmilienM | slagle: no I understand totally, no need to justify - it makes sense. I personally didn't realize about 1) and 3) | 15:00 |
sshnaidm|rover | EmilienM, wrt https://review.openstack.org/#/c/523903/ - should we change tripleo-ci-centos-7-ovb-containers-oooq to run on branches only? If so, I'll update the patch | 15:01 |
gchamoul | EmilienM: answered | 15:02 |
shardy | EmilienM: yes we can leave it disabled by default, that just means we'll have to delay moving any commonly used features like ceph to external_deploy_tasks I think | 15:02 |
slagle | shardy: ok, i think i follow now. | 15:03 |
gchamoul | florianf: running those tests could be done quickly through the openstack-tox-* IMHO | 15:03 |
shardy | beagles: ^^ FYI | 15:04 |
beagles | shardy, what are your thoughts with respect to octavia? use the external_post_deploy_taks or ... | 15:04 |
beagles | shardy: :) | 15:04 |
beagles | IRC collision ;) | 15:04 |
shardy | slagle: we'd been looking at moving the recent octavia bits to external_deploy_tasks, but it sounds like we may have to stick with the mistral based approach for Queens, or document use of --config-download in the case of octavia being enabled | 15:04 |
slagle | shardy: well as I said, it sounds like it depends on what other folks can take on honestly. UI, ceph, octavia | 15:05 |
slagle | i'm not saying it shouldnt be the default :) | 15:05 |
shardy | beagles: IMHO the external_deploy_tasks interface is much cleaner but if we have to stick with the mistral approach for Queens then so be it | 15:05 |
beagles | shardy, I think we still want that asap so we can transition nicely | 15:05 |
beagles | shardy, ack | 15:05 |
shardy | slagle: ack sure, I wasn't aware of some of the issues you mentioned, I'd wrongly assumed we could just hide the default in the existing deploy workflow | 15:06 |
shardy | e.g make it pretty transparent | 15:06 |
EmilienM | panda, weshay: how do I know on which hash containers have been built in a job? for example http://logs.openstack.org/01/511701/7/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/86a2e14/logs | 15:06 |
EmilienM | panda, weshay: delorean hash | 15:06 |
*** dsariel has quit IRC | 15:06 | |
EmilienM | panda, weshay: I see the tag: 3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d but how do I know the hash? | 15:06 |
slagle | shardy: yes, i had assumed (hoped) as well when I first started. but it's not possible afaict given the existing deploy workflow has an immediate exit after Heat has accepted the stack create request | 15:06 |
slagle | that's an insufficient abstraction to make any change to our deployment, other than just call heat stack create | 15:07 |
weshay | panda, can you help EmilienM please.. I'm in a mtg | 15:07 |
panda | EmilienM: that's the hash ? | 15:07 |
shardy | slagle: Ok, so I guess we need a v2 deploy workflow so that clients know to listen for a different kind of output from zaqar | 15:07 |
EmilienM | panda: yeah? | 15:08 |
EmilienM | panda: I fail to find the URL | 15:08 |
EmilienM | panda: I want to check packages version | 15:08 |
shardy | slagle: thanks for the update, I guess we can iterate on that early next cycle to align with the various things in progress expecting to use external_deploy_tasks | 15:08 |
shardy | brb | 15:08 |
*** shardy is now known as shardy_afk | 15:08 | |
slagle | shardy: that is along the lines of what I've done with config_download_deploy workflow. you call the workflow -> client polls zaqar queue until workflow completes -> deployment complete | 15:08 |
panda | EmilienM: it may have been purged , let me check | 15:09 |
EmilienM | panda: https://trunk.rdoproject.org/centos7-master/3b/85/3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d/ | 15:09 |
EmilienM | panda: this one? | 15:09 |
*** agurenko has quit IRC | 15:09 | |
panda | EmilienM: yes | 15:09 |
EmilienM | panda: ok... | 15:09 |
EmilienM | panda: it's a bit complex to find, but ok | 15:09 |
EmilienM | dalvarez: python-ovsdbapp-0.6.0-0.20171024151214.0b86d12.el7.centos.src.rpm | 15:09 |
EmilienM | https://trunk.rdoproject.org/centos7-master/3b/85/3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d/ | 15:09 |
EmilienM | dalvarez: http://logs.openstack.org/01/511701/7/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/86a2e14/logs/undercloud/home/zuul/overcloud_containers.yaml.txt.gz | 15:09 |
EmilienM | that's how I found it | 15:09 |
dalvarez | EmilienM, thanks a lot! yeah we may need 0.9.0 | 15:10 |
EmilienM | dalvarez: I have to switch context now, but I need your help on this bug (and your team) | 15:10 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736284 | 15:10 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Triaged] | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736411 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1736411 in tripleo "CI: scenario002 job fails when not finding centos-binary-barbican-keystone-listener container" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 15:10 |
EmilienM | dalvarez: yeah I'm not sure why latest promotion gives us old repo - it's a question for panda maybe. | 15:10 |
jistr | gfidente: re the ceph-ansible port to external_deploy_tasks, inspiration can be drawn from https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/kubernetes-master.yaml | 15:10 |
gfidente | jistr ack, sec | 15:10 |
gfidente | I think I'll get back to you soon | 15:10 |
jistr | gfidente: AFAIK only thing that we're missing to add is https://review.openstack.org/#/c/525524/ | 15:10 |
gfidente | with questions :D | 15:10 |
*** ykarel_ has joined #tripleo | 15:11 | |
panda | if the promotion ran close to the job time, then the job may have picked the old hash still | 15:11 |
*** aditya_r has joined #tripleo | 15:11 | |
jistr | otherwise it all works in CI (we've seen it green twice and not red since then) and AFAIK also locally for folks, so it's no sand castle :P | 15:12 |
jistr | ack re questions :) | 15:12 |
florianf | gchamoul: How about we pick a bunch of specific validations for fs10 we know will succeed in the limited ci environment and only run those? | 15:12 |
akrivoka | gchamoul: thanks for the patch! | 15:13 |
akrivoka | florianf: good idea, that sounds good to me | 15:13 |
*** janki has quit IRC | 15:13 | |
*** janki has joined #tripleo | 15:14 | |
EmilienM | I see we had a promotion on https://dashboards.rdoproject.org/rdo-dev | 15:14 |
gchamoul | florianf: well by default, the run-tripleo-validations will run all the validations for one group, and we know that undercloud-ram/cpu are always due to some default values from oooq | 15:14 |
*** ykarel|afk has quit IRC | 15:14 | |
*** mrch has quit IRC | 15:14 | |
EmilienM | so the latest hash should be good, let me verify | 15:14 |
*** janki has quit IRC | 15:14 | |
gchamoul | florianf: always failing... | 15:15 |
EmilienM | dalvarez: ^ rechecking for you | 15:15 |
*** janki has joined #tripleo | 15:15 | |
EmilienM | latest hash is ac82ea9271a4ae3860528eaf8a813da7209e62a6_28eeb6c7, let's see the version | 15:15 |
dalvarez | EmilienM, thanks, that should do it | 15:15 |
florianf | gchamoul: and that default would be hard to change? | 15:16 |
dalvarez | EmilienM, just one more question, if i have the image (from the link you sent) whats the quickest way to check which packages are installed? | 15:16 |
gchamoul | florianf: we need to find an agreement with the CI team | 15:16 |
EmilienM | dalvarez: I just showed you ^ | 15:17 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow https://review.openstack.org/510902 | 15:17 |
gchamoul | florianf: when I added the tripleo-validations patches in OOOQ, we've had some issues with the resources | 15:17 |
EmilienM | dalvarez: you look at logs/undercloud/home/zuul/overcloud_containers.yaml.txt.gz | 15:17 |
EmilienM | dalvarez: that gives you the delorean hash | 15:17 |
florianf | gchamoul: would it be easier with the negative tests? | 15:17 |
florianf | gchamoul: "it" = only run specific validations | 15:18 |
dalvarez | EmilienM, ack got it! thanks | 15:18 |
dalvarez | EmilienM, didn't know that it was the dlrn hash | 15:18 |
EmilienM | dalvarez: https://trunk.rdoproject.org/centos7-master/ac/82/ac82ea9271a4ae3860528eaf8a813da7209e62a6_28eeb6c7/ | 15:18 |
EmilienM | python-ovsdbapp-0.9.0-0.20171130203756.7d4b4b6.el7.centos.src.rpm | 15:18 |
gchamoul | florianf: it's easier with the negative tests because I run a small list of validations and tricking the validations default | 15:18 |
EmilienM | so this time we're good! | 15:18 |
EmilienM | dalvarez: so it seems like the bug is invalid then | 15:19 |
EmilienM | dalvarez: i'll comment and close | 15:19 |
dalvarez | EmilienM, cool :) thanks | 15:19 |
gchamoul | florianf: for example, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/tripleo-validations/templates/run-preintro-validations-negative-tests.sh.j2 | 15:19 |
EmilienM | weshay, dalvarez: FYI https://bugs.launchpad.net/tripleo/+bug/1736284/comments/2 | 15:20 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Invalid] | 15:20 |
*** dsariel has joined #tripleo | 15:21 | |
dalvarez | EmilienM, ack this one was easy :) | 15:21 |
EmilienM | dalvarez: thanks for being responsive, as usual | 15:21 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Make Kubespray install work without --private-key too https://review.openstack.org/525524 | 15:23 |
dalvarez | EmilienM, happy to help :) | 15:23 |
dalvarez | thx | 15:23 |
EmilienM | dalvarez: i'm going to document how to find the URL | 15:23 |
EmilienM | if I found it hard, I guess it's not easy for newcomers | 15:23 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 15:23 |
gchamoul | florianf, akrivoka: the negative tests for pre-deployment and post-deployment (in oooq-extras) are still in review though https://review.openstack.org/#/q/status:open+project:openstack/tripleo-quickstart-extras+branch:master+topic:tripleo-validations | 15:23 |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Do not create roles unless keystone was deployed https://review.openstack.org/525648 | 15:24 |
dalvarez | EmilienM++ that one is useful for us not very familiar with it... also i added to my todo list to write a tiny guide about how to modify code within a container (rebuild the image and so) which is also useful for debugging | 15:24 |
dalvarez | EmilienM, maybe there's already something in place? | 15:25 |
gchamoul | florianf, akrivoka: do you think it would be better to have those negative tests in tripleo-validations instead of oooq-extras? | 15:25 |
EmilienM | dalvarez: not afik | 15:25 |
dalvarez | ack | 15:26 |
sshnaidm|rover | dtantsur, containers should work now | 15:26 |
sshnaidm|rover | dtantsur, tell me please if you see any problem again | 15:27 |
dtantsur | neat! will recheck | 15:27 |
florianf | gchamoul: If we had them in tripleo-validations it would be easier to ad tests for new validations within the same patch that actually adds the validation | 15:27 |
florianf | gchamoul: So, yes, I think it would have some advantages | 15:27 |
EmilienM | mwhahaha: promotion OK - one alert: assigned & WIP | 15:27 |
gchamoul | florianf: ok I need to think about how we can integrate them into the current way of the validations are working | 15:32 |
s_b_34343 | <EmilienM> : cuurently i'm not refereing anything doc . i have deployed controler ha for 3 controller . currently we are deploying our services on physical machine . now i wanted to deploy them on container like other services | 15:33 |
s_b_34343 | i'm very new to docker and container | 15:33 |
gchamoul | florianf: because that something we don't want to see through the tripleo-ui, I guess | 15:33 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add nova and neutron tempest plugins to default config https://review.openstack.org/525657 | 15:33 |
*** anilvenkata has quit IRC | 15:34 | |
*** anilvenkata has joined #tripleo | 15:34 | |
s_b_34343 | <EmilienM>: even i wanted to know that how controller failover happens and the architecture also | 15:34 |
*** oidgar has quit IRC | 15:34 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image https://review.openstack.org/525659 | 15:34 |
gchamoul | florianf, akrivoka: do you have time this week to talk a little bit about this? | 15:34 |
*** paramite has quit IRC | 15:36 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add nova and neutron tempest plugins to default config https://review.openstack.org/525657 | 15:36 |
*** udesale has joined #tripleo | 15:36 | |
*** dsariel has quit IRC | 15:40 | |
*** ramishra has quit IRC | 15:40 | |
s_b_34343 | <EmilienM> : can you point out to any document which i can refere | 15:41 |
*** udesale has quit IRC | 15:41 | |
*** shardy_afk is now known as shardy | 15:42 | |
*** udesale has joined #tripleo | 15:42 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-docs master: Document containet tags / delorean https://review.openstack.org/525667 | 15:45 |
EmilienM | dalvarez: ^ draft | 15:45 |
dalvarez | EmilienM, wow that was quick, thansks a lot (s/containet/container) :) | 15:45 |
*** ihrachys has joined #tripleo | 15:45 | |
ihrachys | EmilienM, I saw you pinged me | 15:45 |
EmilienM | yeah | 15:45 |
EmilienM | ihrachys: too late, we' closed the bug | 15:46 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-docs master: Document container tags / delorean https://review.openstack.org/525667 | 15:46 |
ihrachys | :) | 15:46 |
ihrachys | I am so sad about it /s | 15:46 |
ihrachys | good job :) | 15:46 |
EmilienM | ihrachys: don't worry I know where to find you :P | 15:47 |
sshnaidm|rover | cores, please review/merge dns issues patch: https://review.openstack.org/#/c/525228/ | 15:47 |
*** wojdec1 has joined #tripleo | 15:47 | |
ihrachys | I added the channel to auto-join now, so you can ping me here | 15:47 |
*** openstackgerrit has quit IRC | 15:48 | |
*** morazi has quit IRC | 15:48 | |
wojdec1 | Hey Folks… I'm trying to deploy tripleo using quickstart (master), in a proxied lab environment. Am consistently running into the following error: | 15:49 |
*** openstackgerrit has joined #tripleo | 15:49 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/525603 | 15:49 |
wojdec1 | from the ansible log: FAILED! => {"changed": true, "cmd": "virt-customize --run /home/stack/repo_setup.sh -a /home/stack/overcloud-full.qcow2 > /home/stack/_home_stack_repo_setup.sh.log 2>&1" | 15:50 |
florianf | gchamoul: sure! | 15:51 |
wojdec1 | running that command from the shell on the machine, works ok. so it would appear to be something in the way the env is setup, and likely the http_proxy isn't used… Any hints? Is there perhaps some other channel for quickstart issues like these? | 15:52 |
*** ffiore has quit IRC | 15:53 | |
*** dsariel has joined #tripleo | 15:53 | |
*** nyechiel has quit IRC | 15:53 | |
*** thrash is now known as thrash|biab | 15:54 | |
mwhahaha | wojdec1: this is the right channel, i don't know if http_proxy support is fully developed for quickstart | 15:55 |
*** bogdando has quit IRC | 15:57 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Use cachable facts to allow multiple runs https://review.openstack.org/525671 | 15:58 |
mwhahaha | wojdec1: you can file a bug against tripleo https://bugs.launchpad.net/tripleo/+filebug | 15:58 |
wojdec1 | mwhahaha: Ok. will do. tx | 15:58 |
*** ffiore has joined #tripleo | 15:58 | |
EmilienM | ihrachys: thanks | 15:58 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update parameters updating https://review.openstack.org/525672 | 16:02 |
*** hamzy has quit IRC | 16:02 | |
EmilienM | mandre: please look https://review.openstack.org/#/c/525667/ when you can | 16:02 |
*** salmankhan has quit IRC | 16:03 | |
*** gvrangan has joined #tripleo | 16:05 | |
*** aufi has quit IRC | 16:05 | |
*** ccamacho has quit IRC | 16:06 | |
*** salmankhan has joined #tripleo | 16:06 | |
s_b_34343 | <EmilienM> : can you help me? | 16:08 |
*** yprokule has quit IRC | 16:09 | |
*** dbecker has quit IRC | 16:09 | |
*** ffiore has quit IRC | 16:12 | |
*** athomas has quit IRC | 16:12 | |
EmilienM | s_b_34343: sure, sorry I was afk a little | 16:12 |
EmilienM | s_b_34343: https://docs.openstack.org/tripleo-docs/latest/ is an excellent start | 16:12 |
*** gbarros has quit IRC | 16:13 | |
*** gbarros has joined #tripleo | 16:13 | |
s_b_34343 | <EmilienM> : thanks EmilienM but i didnt find anything related controller ha | 16:15 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Enable and document tags for all tasks https://review.openstack.org/476114 | 16:15 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add NovaMigrationTarget service to SR-IOV Compute role https://review.openstack.org/520342 | 16:15 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 16:15 |
openstackgerrit | Merged openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/525413 | 16:15 |
openstackgerrit | Merged openstack/tripleo-validations master: Change HAProxy validation queue timeout to match the default https://review.openstack.org/525173 | 16:15 |
openstackgerrit | Merged openstack/tripleo-validations master: Change controller ulimit to match the default https://review.openstack.org/525179 | 16:15 |
EmilienM | s_b_34343: controllers are deployed with HA by default, if you follow the recommended architecture | 16:16 |
EmilienM | dmsimard: FYI https://review.openstack.org/#/c/525265 worked fine | 16:16 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 16:16 |
dmsimard | EmilienM: you tested in different cases ? | 16:17 |
EmilienM | dmsimard: yes | 16:17 |
EmilienM | dmsimard: where in ara can I see the runtime for gitclones? | 16:18 |
EmilienM | couldn't find it http://logs.openstack.org/65/525265/5/check/tripleo-ci-centos-7-undercloud-oooq/448749e/logs/ara/ | 16:18 |
mwhahaha | EmilienM: isn't it this part http://logs.openstack.org/65/525265/5/check/tripleo-ci-centos-7-undercloud-oooq/448749e/job-output.txt.gz#_2017-12-05_05_57_01_141809 | 16:19 |
s_b_34343 | <EmilienM> : what if opensatck is deployed with 3 controller ha but currenly we are deploying are services on physcical machine . but now we are having requiremnt that our services should be containerize ? | 16:19 |
s_b_34343 | how shoild i proceed for this ? | 16:19 |
EmilienM | s_b_34343: yes, in queens we expect our users to deploy with containers | 16:19 |
EmilienM | s_b_34343: I think the procedure is documented, isn't? | 16:19 |
*** hewbrocca is now known as hewbrocca_afk | 16:20 | |
EmilienM | mwhahaha: nice, it takes less than 1 min now | 16:20 |
EmilienM | s_b_34343: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html | 16:20 |
s_b_34343 | <EmilienM> : really sorry for asking stuppid question but i really dont know havent read yet | 16:20 |
sri_ | s_b_34343, http://tripleo.org/install/containers_deployment/overcloud.html | 16:21 |
dmsimard | EmilienM: that's the ara from devstack-gate | 16:22 |
dmsimard | EmilienM: not the one from zuul | 16:22 |
EmilienM | sshnaidm|rover: https://review.openstack.org/#/c/523903/17/zuul.d/ovb-jobs.yaml - does my comment make sense? | 16:22 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 16:23 |
EmilienM | sshnaidm|rover: I re-ran CI jobs since we got promotion, let's see how it works now | 16:23 |
dmsimard | EmilienM: the one from zuul is at the top level | 16:23 |
EmilienM | dmsimard: link? | 16:23 |
*** udesale has quit IRC | 16:23 | |
dmsimard | EmilienM: oh, but we don't generate ara reports for successful jobs right now http://logs.openstack.org/65/525265/5/check/tripleo-ci-centos-7-undercloud-oooq/448749e/ | 16:23 |
s_b_34343 | thanks EmilienM , and sri_ . just wanted to know that in ha envirnment if any controller goes down then failover happens . but what about failback is triplo handing ? | 16:23 |
EmilienM | dmsimard: why? | 16:23 |
dmsimard | EmilienM: ara static reports are not big in size but they're a lot of small files and it's not very healthy for the log server (inodes) so we're transitioning to another way of providing reports that is much more lightweight https://ara.readthedocs.io/en/latest/advanced.html | 16:24 |
dmsimard | we'll be able to test it on logs-dev.o.o soon: https://review.openstack.org/#/q/topic:ara-sqlite-middleware | 16:25 |
EmilienM | ok | 16:25 |
EmilienM | cool | 16:25 |
dmsimard | so we will be able to provide reports all the time | 16:25 |
s_b_34343 | hi EmilienM , and sri_ going offline | 16:25 |
*** ffiore has joined #tripleo | 16:25 | |
sri_ | s_b_34343, using pacemaker and haprxoy , this hasn't change in container environment, the only thing changes we put servers in containers | 16:25 |
*** suuuper has joined #tripleo | 16:26 | |
s_b_34343 | <sri_> are we using both pacemaker and haprxoy . i thought only pacemaker | 16:26 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update parameters updating https://review.openstack.org/525672 | 16:27 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the name from task() functions that refer to themselves https://review.openstack.org/524250 | 16:27 |
beagles | mwhahaha, re: comment on https://review.openstack.org/#/c/487450 with respect to gnocchi integration - I wasn't aware that it did that. Can you point me in the general direction of what you are referring to? | 16:27 |
s_b_34343 | <sri_>: wiil connect aftr 1 hr will ask this Q again | 16:27 |
weshay | mwhahaha, removed alert on https://bugs.launchpad.net/tripleo/+bug/1736284 | 16:27 |
openstack | Launchpad bug 1736284 in tripleo "Cannot commit transaction AddPortCommand exceptions cause tempest network_basic_ops to incur ssh timeouts" [Critical,Invalid] | 16:27 |
mwhahaha | beagles: it doesn't pull existing ids but ceilometer does require that the services be up before it can complete. | 16:28 |
mwhahaha | beagles: the point being is that durring the regular deployment there should be a point at which info can be pulled from other openstack services | 16:28 |
beagles | mwhahaha, ahhh | 16:29 |
sshnaidm|rover | EmilienM, we got promotion right now | 16:29 |
beagles | mwhahaha, so like - we create the ports and then ask neutron for those ports? | 16:29 |
sri_ | s_b_34343, you have to use haproxy and pacemaker to do ha | 16:30 |
EmilienM | sshnaidm|rover: I know, that's why I rebased it to re-kick jobs | 16:30 |
EmilienM | sshnaidm|rover: but your -1, see my comment please. | 16:30 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: [WIP] Early release for fast forward upgrade testing. https://review.openstack.org/525680 | 16:31 |
mwhahaha | beagles: we should be able to do that in step5 | 16:31 |
mwhahaha | beagles: i think the issue was the ovs being up which we moved to step4 in containerized world | 16:31 |
beagles | mwhahaha, right with the ovs agent in step 4 that should do | 16:31 |
*** s_b_34343 has quit IRC | 16:31 | |
*** ykarel__ has joined #tripleo | 16:32 | |
beagles | mwhahaha, yup, I think the problem initially was that we had trouble running calls against the cloud from within puppet early on. The last I attempted was July I think and by then Or was off and running doing most of this in ansible | 16:32 |
*** marios has quit IRC | 16:33 | |
beagles | mwhahaha, if the problem of running openstack calls against the cloud from within puppet during deployment is solid then this should be less of an issue | 16:33 |
sshnaidm|rover | EmilienM, removed it | 16:34 |
flaper87 | shardy: jistr I hate my ISP! I'm sorry | 16:34 |
EmilienM | sshnaidm|rover: thx, let's see how CI pass now | 16:34 |
mwhahaha | beagles: it should be and if isn't then that's a bug we need to fix and not try and workaround it | 16:34 |
*** ykarel_ has quit IRC | 16:34 | |
beagles | mwhahaha, k I'll give it a go | 16:35 |
shardy | flaper87: np! :) | 16:36 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image https://review.openstack.org/525659 | 16:37 |
*** aditya_r has quit IRC | 16:37 | |
*** hamzy_ has joined #tripleo | 16:37 | |
*** oidgar has joined #tripleo | 16:38 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class https://review.openstack.org/506186 | 16:40 |
*** thrash|biab is now known as thrash | 16:40 | |
openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Extending contribution docs with more detail https://review.openstack.org/525683 | 16:41 |
*** hamzy has joined #tripleo | 16:42 | |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart-extras master: Only create config-download.yaml for multinode https://review.openstack.org/525684 | 16:44 |
*** iranzo has quit IRC | 16:44 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: [WIP] Early release for fast forward upgrade testing. https://review.openstack.org/525680 | 16:44 |
slagle | EmilienM: ^^ | 16:45 |
*** dparkes has quit IRC | 16:45 | |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 16:45 |
*** hamzy_ has quit IRC | 16:46 | |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 16:46 |
sshnaidm|rover | pabelanger, is it forbidden for you too? http://mirror.ord.rax.openstack.org:8080/rdo/centos7/3b/85/3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d/python2-oslo-service-1.26.0-0.20170921123949.1a973c4.el7.centos.noarch.rpm | 16:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 16:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart-extras master: Only create config-download.yaml for multinode https://review.openstack.org/525684 | 16:49 |
flaper87 | slagle: got 5 mins? | 16:50 |
flaper87 | slagle: wanted to chat real quick about the OOO patch | 16:50 |
EmilienM | slagle: any reason to hold https://review.openstack.org/#/c/522344/ or should we move forward? | 16:52 |
flaper87 | slagle: fwiw, I fully agree with you that NM is a big red flag. As far as installing and configuring it goes, the steps that I currently have in my patch exist in the openshift-ansible master branch | 16:52 |
*** abregman|mtg has quit IRC | 16:52 | |
flaper87 | slagle: we have two options to move this patch forward: 1) I remove the code and use openshift-ansible master or 2) We land it and wait for the release of openshift-ansible before changing that code | 16:53 |
flaper87 | slagle: ultimately, I'm also working on removing NM from the picture entirely | 16:53 |
flaper87 | it's currently a requirement for openshift but I think we might be able to do away with it | 16:53 |
flaper87 | thing is, it's currently not possible to disable NM in openshift-ansible and that's something that I'll bring up to the upstream community | 16:54 |
flaper87 | slagle: pls, let me know if any of the above makes sense :) | 16:54 |
*** hamzy has quit IRC | 16:54 | |
slagle | flaper87: it makes sense. what is the urgency to land it given where we are with NM? | 16:55 |
*** aputtur_ has joined #tripleo | 16:55 | |
flaper87 | slagle: allow for working in parallel on other things like multi-node deployment | 16:55 |
flaper87 | slagle: more than an urgency it's a convenience | 16:55 |
flaper87 | jistr: is also helping with this and it's easier to iterate if we have it in-tree | 16:56 |
pabelanger | sshnaidm|rover: 404, does it exist on trunk.rdoproject.org? | 16:56 |
slagle | flaper87: did you see my comments on the patch? | 16:56 |
flaper87 | slagle: mmh, I saw one from yday. Lemme check again | 16:56 |
flaper87 | :D | 16:56 |
slagle | flaper87: it's teh same comment i left previously fwiw | 16:56 |
pabelanger | sshnaidm|rover: it is a reverse proxy cache, so any issues you see, are most likely from trunk.rdoproject.org. Unless we run out of HDDs | 16:57 |
slagle | flaper87: a path forward could be a ci only template | 16:57 |
*** yprokule has joined #tripleo | 16:57 | |
slagle | flaper87: i'm 100% on board with workarounds / first steps in CI. and those templates are in tree | 16:57 |
slagle | flaper87: the problem i have with this is living under extraconfig/services | 16:57 |
flaper87 | slagle: this can totally wait until after q-2 | 16:58 |
flaper87 | makes sense to me, I don't think there's any urgency other than convenience to work on the feature. | 16:58 |
EmilienM | gchamoul: I replied on https://review.openstack.org/#/c/525637/ - maybe we can find a technical solution here. | 16:58 |
flaper87 | slagle: We can hold-off until after Q-2 and work on the NM in the meantime | 16:58 |
slagle | flaper87: if we could somehow isolate the NM bits to a test or ci template, i'd be fine to have that land | 16:58 |
EmilienM | gchamoul: how can we ignore the RAM test but validate others | 16:58 |
flaper87 | slagle: ++ | 16:59 |
EmilienM | gchamoul: I don't want to run tests if we ignore results, what's the point? | 16:59 |
flaper87 | slagle: I can do that, yes | 16:59 |
*** eck`gone is now known as eck` | 16:59 | |
flaper87 | those bits should go away anyways so, I might as well take them out now and move them into a ci template | 16:59 |
slagle | flaper87: i do wonder some about how what you're doing with installing openshift fits with the shiftonstack work | 17:00 |
slagle | i thought they were also looking at openshift on undercloud managed nodes | 17:00 |
slagle | as well as on overcloud managed nodes | 17:00 |
flaper87 | slagle: it integrates with that. The bits that I'm would like to use are the ones from shiftonstack which landed in the master branch recently | 17:01 |
flaper87 | the difference is that we're creating the nodes ourselves | 17:01 |
EmilienM | shardy, slagle: any concensus was reached on next step for https://review.openstack.org/#/c/525637/1 ? | 17:01 |
slagle | right | 17:01 |
EmilienM | sorry https://review.openstack.org/#/c/522344/ | 17:01 |
*** fragatina has joined #tripleo | 17:01 | |
*** janki has quit IRC | 17:02 | |
*** dbellant has quit IRC | 17:02 | |
*** fragatin_ has joined #tripleo | 17:02 | |
shardy | EmilienM: I think if we're not moving to --config-download by default I'll need to rework it | 17:02 |
*** aditya_r has joined #tripleo | 17:02 | |
shardy | I'll mark it WIP and take a look tomorrow | 17:02 |
slagle | shardy: your latest comment is fine with me | 17:03 |
*** derekh has quit IRC | 17:03 | |
shardy | Or we can land that and I'll do a follow-up | 17:03 |
slagle | shardy: whichever you want :) | 17:03 |
slagle | i added +2. you can land it if you want to | 17:03 |
shardy | CI looks pretty green and I think jaosorior was waiting on this so perhaps we land it and I'll make the non-config-download path work as a follow up | 17:04 |
EmilienM | shardy: ok, thx | 17:04 |
EmilienM | shardy: let's go ahead then and land it | 17:04 |
shardy | EmilienM: Ok sounds good, I'll work on a follow-up patch tomorrow | 17:05 |
shardy | thanks! | 17:05 |
EmilienM | cool, good night! | 17:05 |
*** fragatina has quit IRC | 17:06 | |
*** jpich has quit IRC | 17:06 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image https://review.openstack.org/525659 | 17:09 |
beagles | EmilienM, can you point me at the types of stuff mwhahaha is referencing above with respect to gnocchi/ceilometer? | 17:10 |
beagles | EmilienM, I'm guessing there isn't a case where puppet making REST calls on other openstack components? | 17:10 |
mwhahaha | beagles: talk to pradk. | 17:10 |
EmilienM | beagles: sure, give me a min | 17:10 |
beagles | pradk ^ | 17:10 |
mwhahaha | beagles: ceilometer upgrade talks to gnocchi which talks to keystone over rest | 17:11 |
*** moshele has joined #tripleo | 17:11 | |
*** gvrangan has quit IRC | 17:11 | |
mwhahaha | beagles: a better solution for Octavia would be to have a python app/script that does all the setup | 17:12 |
* beagles ponders that for a sec | 17:13 | |
mwhahaha | Like ceilometer-upgrade | 17:13 |
beagles | mwhahaha, that's packaged with ceilometer? | 17:14 |
mwhahaha | Yea | 17:14 |
openstackgerrit | Ian Main proposed openstack/tripleo-heat-templates master: Add a new UndercloudHomeDir parameter https://review.openstack.org/524408 | 17:15 |
mwhahaha | The install/setup would be more user-friendly that way | 17:15 |
mwhahaha | Too many manual steps | 17:15 |
*** jfrancoa has quit IRC | 17:16 | |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 17:16 |
beagles | mwhahaha, no argument there - the octavia crowd are a little ... funny with some of this stuff I think | 17:16 |
*** moshele has quit IRC | 17:16 | |
beagles | mwhahaha, like the whole port creation thing should really be handled by some kind of in-app layer the same way dhcp and l3 agent do in neutroy | 17:17 |
beagles | neutron | 17:17 |
mwhahaha | Yes | 17:17 |
beagles | mwhahaha, but I think nmagnezi's been fighting an uphill battle even on that | 17:17 |
beagles | (cuz frankly that part is particularly insane) | 17:17 |
*** nyechiel has joined #tripleo | 17:18 | |
*** mdnadeem has quit IRC | 17:20 | |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 17:21 |
* beagles wonders if there is some kind of secret prize for services that are "most awkward or difficult" to configure/integrate that he doesn't know about | 17:21 | |
*** pcaruana has joined #tripleo | 17:22 | |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 17:22 |
*** radeks has quit IRC | 17:23 | |
*** BryanS68 has quit IRC | 17:23 | |
weshay | Slower, morning | 17:24 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry https://review.openstack.org/524644 | 17:25 |
*** pcaruana has quit IRC | 17:26 | |
*** lucasagomes is now known as lucas-afk | 17:27 | |
*** pcaruana has joined #tripleo | 17:27 | |
*** dtantsur is now known as dtantsur|afk | 17:27 | |
*** ffiore has quit IRC | 17:30 | |
*** gkadam has quit IRC | 17:30 | |
EmilienM | Slower, weshay : what's the progress on idempotency failures? | 17:34 |
EmilienM | on undercloud-container | 17:34 |
Slower | EmilienM: nothing at the moment | 17:35 |
EmilienM | gchamoul: let me know what you think on https://review.openstack.org/#/c/525637/ | 17:35 |
Slower | EmilienM: I'm working on other issues | 17:35 |
Slower | EmilienM: love it if youc ould look at this. I did check that teh passwords were being saved/restored properly | 17:35 |
EmilienM | Slower: ok, it sounds like it fails to access to mysql | 17:35 |
Slower | EmilienM: and that seems to work, so I'm not sure why we get a perm failed on mysql | 17:35 |
EmilienM | Slower: could you reproduce locally? | 17:36 |
Slower | EmilienM: yep | 17:36 |
Slower | EmilienM: even doit will reproduce | 17:36 |
weshay | ahoy | 17:36 |
*** florianf is now known as florianf|afk | 17:37 | |
Slower | weshay: !! | 17:38 |
weshay | Slower, need anything from me buddy? | 17:38 |
Slower | weshay: good for now | 17:38 |
EmilienM | Slower, weshay: do you have logs of the failure again? please | 17:40 |
EmilienM | the mysql thing | 17:40 |
*** yprokule_ has joined #tripleo | 17:40 | |
*** yprokule has quit IRC | 17:40 | |
*** yprokule_ is now known as yprokule | 17:40 | |
weshay | EmilienM, http://logs.openstack.org/18/518118/7/check/tripleo-ci-centos-7-undercloud-oooq/97451ab/logs/undercloud/home/zuul/undercloud_reinstall.log.txt.gz#_2017-12-04_22_40_46 | 17:41 |
EmilienM | thx | 17:42 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 17:44 |
*** fragatin_ has quit IRC | 17:44 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Update capabilities-map.yaml to include latest storage environments https://review.openstack.org/523927 | 17:45 |
*** BryanS68 has joined #tripleo | 17:45 | |
*** sshnaidm|rover is now known as sshnaidm|off | 17:47 | |
Slower | does anyone know where the docker registry is configured on the undercloud, for the overcloud? | 17:48 |
Slower | it looks like puppet tripleo is doing it, but I can' | 17:48 |
EmilienM | yeah | 17:48 |
Slower | can't figure out where it's being called from | 17:48 |
EmilienM | in quickstart I think | 17:48 |
EmilienM | a sec | 17:48 |
weshay | EmilienM, naw.. don't think so | 17:48 |
Slower | EmilienM: ya, where? :) | 17:48 |
weshay | maybe I'm wrong.. EmilienM is usually right | 17:49 |
weshay | I had to tweet about it | 17:49 |
EmilienM | https://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/config/release/tripleo-ci/consistent-master.yml#n4 | 17:49 |
EmilienM | here? | 17:49 |
EmilienM | or https://review.openstack.org/#/c/520639/8/config/release/tripleo-ci/master.yml | 17:50 |
*** wojdec1 has left #tripleo | 17:50 | |
EmilienM | rlandy: just did that ^ | 17:50 |
*** s_b_34343 has joined #tripleo | 17:50 | |
EmilienM | Slower: when you test idempotency, can you very that you have /root/.my.cnf in the mysql container? if yes, can you paste it please? or make sure creds are good? | 17:51 |
Slower | EmilienM: we need the one that sets up the local registry, eg configures /etc/docker-distribution/config.yml | 17:52 |
*** s_b_34343 has quit IRC | 17:55 | |
*** gbarros has quit IRC | 17:56 | |
shardy | Slower: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/docker_registry.pp is the manifest which does it | 17:57 |
*** pcaruana has quit IRC | 17:58 | |
*** itlinux has joined #tripleo | 17:58 | |
itlinux | hello all.. I wonder if we have any docs or direction on how to turn all the sercurity group off.. I have a case where I need to do some testing. Thanks | 17:59 |
shardy | Slower: AFAICS we don't yet have a composable service template for it | 17:59 |
*** radeks has joined #tripleo | 17:59 | |
Slower | shardy: where is that called from when instack is the undercloud? | 18:00 |
shardy | https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.pp#L554 | 18:01 |
shardy | Slower: | 18:01 |
shardy | ^^ | 18:01 |
*** trown is now known as trown|lunch | 18:02 | |
dprince | shardy: yes, we've established that the profile is included by default. More perplexes is what is setting the Hiera variables for CI | 18:03 |
dprince | for the remote_registry, and the insecure_registries options | 18:04 |
dprince | you can set those via hiera overrides | 18:04 |
dprince | in the Overcloud we have proper parameters we can use for them in puppet/services/docker.yaml | 18:04 |
shardy | https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L7 | 18:05 |
*** gfidente is now known as gfidente|afk | 18:06 | |
shardy | dprince: I think we just default to hiera('controller_host') in the manifest | 18:06 |
shardy | https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/docker_registry.pp#L39 | 18:06 |
shardy | s/manifest/class | 18:06 |
dprince | shardy: right. that is for controller host. But I don't see any references to the hiera settings for 'insecure_registries' or 'remote_mirror' | 18:07 |
*** mcornea has quit IRC | 18:07 | |
shardy | dprince: do we need those with the prepare/upload workflow? | 18:07 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add name property where missing https://review.openstack.org/521992 | 18:07 |
shardy | e.g it's not being configured as a pull through cache, we upload to it directly? | 18:07 |
*** dsariel has quit IRC | 18:08 | |
*** morazi has joined #tripleo | 18:08 | |
dprince | shardy: I see the defaults now. | 18:08 |
dprince | shardy: so I think we'll need a mix of these manifests on the Undercloud now. And the issue is probably that these manifests have duplicate resources | 18:08 |
dprince | shardy: so we need to resolve this | 18:09 |
dprince | for ecample both or configuring /etc/sysconfig/docker. That isn't good I think | 18:09 |
shardy | dprince: yea we'll need to fix that to allow a composable service template for sure | 18:09 |
Slower | shardy: thanks! | 18:10 |
*** oidgar has quit IRC | 18:10 | |
dprince | shardy: I'll work with Slower to try and decouple these things | 18:10 |
dprince | Slower: we need to use docker_registry.pp in addition to docker.pp | 18:10 |
shardy | dprince: ack sounds good, happy to help test/review etc | 18:11 |
*** s_b_34343 has joined #tripleo | 18:11 | |
dprince | Slower: *but* before we can do this I think we have to untangle a few thanks | 18:11 |
Slower | dprince: ok | 18:11 |
dprince | few things | 18:11 |
*** ykarel__ has quit IRC | 18:11 | |
Slower | I'll get back on bj | 18:11 |
dprince | Slower: so, I think we need to change instack. This will probably be at least 3 patches in a series | 18:11 |
*** paramite has joined #tripleo | 18:12 | |
*** yprokule has quit IRC | 18:14 | |
*** moshele has joined #tripleo | 18:14 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add multiple secret store backends for barbican https://review.openstack.org/523539 | 18:15 |
openstackgerrit | Matt Young proposed openstack/tripleo-quickstart master: Create an artifact for convert-image log https://review.openstack.org/525725 | 18:17 |
*** tesseract has quit IRC | 18:21 | |
*** paramite has quit IRC | 18:22 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 18:23 |
trozet | EmilienM, mwhahaha: can one of you take a look at this blueprint please? https://blueprints.launchpad.net/tripleo/+spec/opendaylight-ssl-support | 18:23 |
*** salmankhan has quit IRC | 18:24 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 18:24 |
EmilienM | slagle, sdoran: first step, https://review.openstack.org/525285 (see setup.cfg) | 18:25 |
EmilienM | slagle, sdoran: second step: https://review.rdoproject.org/r/10809 | 18:26 |
EmilienM | at this stage, is won't be for Queens but for Rocky, ok? | 18:26 |
EmilienM | trozet: we don't create blueprints in second milestone for current cycle, at this stage it's for the next cycle. | 18:27 |
trozet | EmilienM: need it for queens | 18:28 |
EmilienM | trozet: why didn't you create the blueprint on time? | 18:28 |
EmilienM | trozet: we sent so much emails about milestones and blueprints | 18:29 |
EmilienM | trozet: right now, we're in milestone 3, which means we're stabilizing what we started in milestone 1 and 2 and work on releasing Queens | 18:29 |
EmilienM | trozet: opendaylight-ssl-support is a new feature, that didn't start in milestone 1 and 2, so it will move to Rocky milestone 1. | 18:29 |
*** vpickard is now known as vpickard_ | 18:30 | |
EmilienM | trozet: unless we make an exception, but mwhahaha needs to give thought on that | 18:30 |
trozet | EmilienM: ok, what is the MS3 deadline? january something? | 18:30 |
EmilienM | releases.openstack.org/queens/schedule.html | 18:30 |
EmilienM | Jan 22 - Jan 26 | 18:31 |
trozet | EmilienM: yeah so let me see if i can have all the patches posted soon | 18:31 |
EmilienM | trozet: we're trying to get better at planning | 18:31 |
trozet | EmilienM: then might make an exception easier | 18:31 |
EmilienM | trozet: and posting blueprints in the middle of a cycle doesn't help in this effort | 18:31 |
EmilienM | if we let everyone pushing blueprints in middle or end of cycles, it does nowhere | 18:32 |
*** tosky has quit IRC | 18:32 | |
EmilienM | goes* | 18:32 |
EmilienM | and we end up wtih broken CI at end of cycles like we had before | 18:32 |
rook | shardy: hey | 18:32 |
trozet | EmilienM: understood | 18:32 |
shardy | rook: Hi! | 18:32 |
rook | shardy: did you ping me earlier? | 18:32 |
EmilienM | trozet: next time, please schedule the blueprint before... | 18:32 |
rook | I don't have enough scroll back | 18:32 |
shardy | rook: I mentioned you as someone was asking about scale testing, sec | 18:33 |
shardy | rook: it was radeks, asking about scale testing and if we've yet got results for pike based builds w/containers | 18:33 |
openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Extending contribution docs with more detail https://review.openstack.org/525683 | 18:35 |
dmsimard | mwhahaha: can we merge https://review.openstack.org/#/c/525228/ ? | 18:35 |
dmsimard | it'll likely fix a bunch of dns errors. | 18:35 |
*** jpena is now known as jpena|off | 18:35 | |
rook | shardy: yeah we do! but obviously neutron isn't containreized. | 18:36 |
rook | containerized. | 18:36 |
rook | The scale is nothing impressive | 18:37 |
rook | all ~100 nodes | 18:37 |
*** tongl has joined #tripleo | 18:37 | |
rook | shardy i shared results to rhos-dev like ~2 months ago | 18:37 |
shardy | rook: Ok thanks for confirming! | 18:38 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update parameters updating https://review.openstack.org/525672 | 18:38 |
EmilienM | can someone approve https://review.openstack.org/#/c/525228/ please | 18:40 |
*** BryanS68 has quit IRC | 18:41 | |
openstackgerrit | Merged openstack/tripleo-common master: Add the RootStackName parameter to the plan https://review.openstack.org/522252 | 18:41 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Make Kubespray install work without --private-key too https://review.openstack.org/525524 | 18:41 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 18:41 |
*** dhill__ has quit IRC | 18:43 | |
*** akrivoka has quit IRC | 18:43 | |
*** dhill_ has joined #tripleo | 18:43 | |
*** BryanS68 has joined #tripleo | 18:48 | |
*** gvrangan has joined #tripleo | 18:49 | |
*** eck` is now known as eck`gone | 18:49 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-common master: Added ability to generate kek for barbican simple crypto backend https://review.openstack.org/525337 | 18:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 18:49 |
*** pkovar has quit IRC | 18:52 | |
*** suuuper has quit IRC | 18:57 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 18:57 |
*** gvrangan has quit IRC | 18:57 | |
*** shardy has quit IRC | 18:58 | |
mwhahaha | EmilienM, dmsimard approved | 19:00 |
dmsimard | thanks | 19:01 |
openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Remove erroneous octavia code related to sync_db https://review.openstack.org/513376 | 19:02 |
openstackgerrit | Merged openstack/tripleo-common master: Fix step_config output which is str not list https://review.openstack.org/510131 | 19:02 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Make CephPools override properties of other pools https://review.openstack.org/525520 | 19:02 |
*** iranzo has joined #tripleo | 19:03 | |
*** strattao__ has joined #tripleo | 19:06 | |
*** fragatina has joined #tripleo | 19:06 | |
*** gbarros has joined #tripleo | 19:07 | |
strattao__ | anyone in there that can help with a question about trying tripleo quickstart with a satellite server? | 19:09 |
*** Goneri has quit IRC | 19:10 | |
*** hamzy has joined #tripleo | 19:10 | |
*** abregman has joined #tripleo | 19:12 | |
openstackgerrit | Merged openstack/tripleo-docs master: Document container tags / delorean https://review.openstack.org/525667 | 19:12 |
*** aditya_r has quit IRC | 19:14 | |
*** trown|lunch is now known as trown | 19:14 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Reintroduce TripleoPackages in the default Controller service. https://review.openstack.org/524259 | 19:14 |
weshay | mwhahaha, toure picked up https://bugs.launchpad.net/tripleo/+bug/1730712 | 19:14 |
openstack | Launchpad bug 1730712 in tripleo "tripleo should not query overcloud if never deployed to prevent extraneous error messages in swift/mistral" [Medium,Triaged] - Assigned to Toure Dunnon (toure) | 19:14 |
mwhahaha | k | 19:14 |
*** moshele has quit IRC | 19:15 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files. https://review.openstack.org/520639 | 19:15 |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 19:16 |
openstackgerrit | Ian Main proposed openstack-infra/tripleo-ci master: DNM, update logging for undercloud containers https://review.openstack.org/518972 | 19:16 |
*** eck`gone is now known as eck` | 19:16 | |
openstackgerrit | Ian Main proposed openstack/instack-undercloud master: DNM, undercloud containers TESTING ONLY https://review.openstack.org/518118 | 19:20 |
*** moshele has joined #tripleo | 19:22 | |
*** tosky has joined #tripleo | 19:28 | |
*** gbarros has quit IRC | 19:28 | |
*** iranzo has quit IRC | 19:38 | |
*** mcornea has joined #tripleo | 19:53 | |
*** salmankhan has joined #tripleo | 19:54 | |
*** Vijayendra has quit IRC | 19:56 | |
*** salmankhan has quit IRC | 19:58 | |
*** florianf|afk has quit IRC | 20:04 | |
*** gkadam has joined #tripleo | 20:05 | |
*** jrist has quit IRC | 20:05 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican keystone listener https://review.openstack.org/525741 | 20:06 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican worker image https://review.openstack.org/525742 | 20:06 |
*** florianf|afk has joined #tripleo | 20:08 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 20:10 |
openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 20:10 |
*** vpickard_ is now known as vpickard | 20:10 | |
*** BryanS68 has quit IRC | 20:11 | |
*** moshele has quit IRC | 20:11 | |
*** BryanS68 has joined #tripleo | 20:15 | |
*** strattao__ has quit IRC | 20:16 | |
openstackgerrit | Merged openstack/tripleo-ui master: Extending contribution docs with more detail https://review.openstack.org/525683 | 20:26 |
*** rwsu has quit IRC | 20:31 | |
*** rwsu has joined #tripleo | 20:31 | |
EmilienM | mwhahaha: ovb-ipv6 is ready https://review.openstack.org/#/c/523903/ | 20:40 |
*** nyechiel has quit IRC | 20:40 | |
*** Vijayendra has joined #tripleo | 20:41 | |
*** gbarros has joined #tripleo | 20:42 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: zuul: update OVB jobs https://review.openstack.org/525746 | 20:42 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: zuul: update OVB jobs https://review.openstack.org/525747 | 20:44 |
openstackgerrit | Emilien Macchi proposed openstack/paunch master: zuul: add OVB ipv6 job https://review.openstack.org/525749 | 20:45 |
openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services. https://review.openstack.org/519531 | 20:45 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-pacemaker master: zuul: add OVB ipv6 job https://review.openstack.org/525750 | 20:46 |
openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates master: Add ceph-rbdmirror ansible container service https://review.openstack.org/520244 | 20:48 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: cistatus.html: update OVB jobs https://review.openstack.org/525751 | 20:50 |
*** mcornea has quit IRC | 20:50 | |
*** dparkes has joined #tripleo | 20:51 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add -c for clean_templates https://review.openstack.org/525753 | 20:57 |
*** Goneri has joined #tripleo | 20:59 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 21:01 |
mwhahaha | EmilienM: so tripleo-upgrade has the docs job running on it but no docs/ folder. should we create some docs or disable the job | 21:05 |
EmilienM | mwhahaha: it's exactly what I told them last week | 21:05 |
EmilienM | but nothing changed I guess | 21:05 |
mwhahaha | no i'm trying to fix it | 21:05 |
mwhahaha | so which should we do? | 21:05 |
EmilienM | disable job | 21:06 |
EmilienM | they don't have doc | 21:06 |
mwhahaha | k | 21:07 |
mwhahaha | what about release notes | 21:07 |
mwhahaha | same deal? | 21:07 |
openstackgerrit | Dan Prince proposed openstack/instack-undercloud master: Use the docker profile to set INSECURE_REGISTRY https://review.openstack.org/525755 | 21:07 |
mwhahaha | i assume we might want to drop in the reno support | 21:07 |
EmilienM | mwhahaha: for this repo? | 21:08 |
mwhahaha | yea | 21:08 |
EmilienM | well no | 21:08 |
EmilienM | if we start something new, let's have something clean | 21:08 |
mwhahaha | ok so disable that job too | 21:08 |
EmilienM | if we don't do it now | 21:08 |
EmilienM | we'll never do it. | 21:08 |
mwhahaha | so add in reno support | 21:09 |
EmilienM | catching up release notes isn't fun, I did it for tripleo | 21:09 |
EmilienM | yes | 21:09 |
mwhahaha | k | 21:09 |
*** hamzy has quit IRC | 21:12 | |
openstackgerrit | Dan Prince proposed openstack/puppet-tripleo master: Remove INSECURE_REGISTRY from docker_registry.pp https://review.openstack.org/525761 | 21:17 |
*** jtomasek has quit IRC | 21:18 | |
openstackgerrit | Dan Prince proposed openstack/instack-undercloud master: Use the docker profile to set INSECURE_REGISTRY https://review.openstack.org/525755 | 21:24 |
openstackgerrit | Dan Prince proposed openstack/instack-undercloud master: Use the docker profile to set INSECURE_REGISTRY https://review.openstack.org/525755 | 21:25 |
openstackgerrit | Dan Prince proposed openstack/puppet-tripleo master: Remove INSECURE_REGISTRY from docker_registry.pp https://review.openstack.org/525761 | 21:26 |
*** noslzzp has quit IRC | 21:28 | |
*** gfidente|afk has quit IRC | 21:29 | |
*** jkilpatr has quit IRC | 21:35 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 21:36 |
*** gkadam has quit IRC | 21:38 | |
weshay | Slower, dprince should I run through and rebase all the deps for the container undercloud work? | 21:38 |
*** itlinux has quit IRC | 21:39 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Concurrent upload container images https://review.openstack.org/522055 | 21:39 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add DockerRegistryMirror parameter https://review.openstack.org/525764 | 21:39 |
dprince | weshay: sure | 21:39 |
dprince | weshay: I've got 2 more patches to subit | 21:40 |
dprince | submit | 21:40 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 21:42 |
weshay | dprince, Slower k.. it's all up2date | 21:43 |
*** itlinux has joined #tripleo | 21:44 | |
*** jrist has joined #tripleo | 21:46 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 21:46 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Allow for multiple playbooks to be run https://review.openstack.org/525765 | 21:46 |
*** ihrachys has quit IRC | 21:49 | |
*** ihrachys has joined #tripleo | 21:49 | |
openstackgerrit | Merged openstack/tripleo-validations stable/pike: Remove yum warning in ceph-ansible validation https://review.openstack.org/525618 | 21:49 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add deploy_steps_tasks interface https://review.openstack.org/522344 | 21:49 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 21:49 |
*** radeks has quit IRC | 21:50 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Document manual config-download https://review.openstack.org/524437 | 21:50 |
*** trown is now known as trown|outtypewww | 21:50 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 21:50 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add noop's for docker pacemaker for rabbitmq https://review.openstack.org/524751 | 21:51 |
*** pchavva has quit IRC | 21:51 | |
*** ihrachys has quit IRC | 21:54 | |
*** abregman has quit IRC | 21:54 | |
*** ihrachys has joined #tripleo | 21:54 | |
openstackgerrit | Dan Prince proposed openstack/puppet-tripleo master: Remove INSECURE_REGISTRY from docker_registry.pp https://review.openstack.org/525761 | 21:55 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class https://review.openstack.org/506186 | 21:58 |
*** rhallisey has quit IRC | 21:59 | |
*** BryanS68 has quit IRC | 22:01 | |
*** rbowen has quit IRC | 22:03 | |
*** zshi has quit IRC | 22:03 | |
*** threestrands has joined #tripleo | 22:05 | |
*** threestrands has quit IRC | 22:05 | |
*** threestrands has joined #tripleo | 22:05 | |
*** rcernin has joined #tripleo | 22:05 | |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add step config to OPTIONAL_DOCKER_SECTIONS https://review.openstack.org/525776 | 22:08 |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add step config to OPTIONAL_DOCKER_SECTIONS https://review.openstack.org/525776 | 22:10 |
*** iranzo|AFK is now known as iranzo | 22:11 | |
*** iranzo is now known as iranzo|AFK | 22:12 | |
*** fragatina has quit IRC | 22:13 | |
*** fragatina has joined #tripleo | 22:17 | |
*** fragatin_ has joined #tripleo | 22:17 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 22:18 |
*** dprince has quit IRC | 22:18 | |
*** yamahata has joined #tripleo | 22:19 | |
*** fragatina has quit IRC | 22:21 | |
*** raildo has quit IRC | 22:21 | |
*** nyechiel has joined #tripleo | 22:22 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 22:23 |
*** eck` is now known as eck`gone | 22:24 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 22:29 |
*** jmelvin has quit IRC | 22:41 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 22:43 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Remove default for --overcloud-ssh-key https://review.openstack.org/525779 | 22:46 |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 22:46 |
*** yamahata has quit IRC | 22:49 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Include tripleo-bootstrap role https://review.openstack.org/525780 | 22:57 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Remove jq package install https://review.openstack.org/525781 | 22:58 |
slagle | EmilienM: ^^ those are the next steps to consuming the role. | 22:59 |
openstackgerrit | K Jonathan Harker proposed openstack/diskimage-builder master: zypper: fix package removal https://review.openstack.org/517658 | 22:59 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Include tripleo-bootstrap role https://review.openstack.org/525780 | 23:00 |
*** yamahata has joined #tripleo | 23:03 | |
*** bfournie has quit IRC | 23:12 | |
*** yamahata has quit IRC | 23:13 | |
*** abishop has quit IRC | 23:17 | |
*** aputtur_ has quit IRC | 23:27 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 23:31 |
*** tongl has quit IRC | 23:41 | |
weshay | myoung|ruck, fyi.. it worked the second time.. and it promoted | 23:41 |
*** yamahata has joined #tripleo | 23:43 | |
*** tongl has joined #tripleo | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!