*** jbadiapa has joined #openstack-kolla | 00:33 | |
*** iclon_ has quit IRC | 01:00 | |
*** iclon has joined #openstack-kolla | 01:19 | |
*** signed8b_ has joined #openstack-kolla | 01:27 | |
*** negronjl has quit IRC | 01:29 | |
*** Guest33999 has quit IRC | 01:30 | |
*** signed8bit has quit IRC | 01:30 | |
*** hrww has joined #openstack-kolla | 01:31 | |
*** negronjl has joined #openstack-kolla | 01:34 | |
*** iclon_ has joined #openstack-kolla | 03:26 | |
*** iclon has quit IRC | 03:28 | |
*** gouthamr has quit IRC | 04:15 | |
*** gouthamr has joined #openstack-kolla | 04:16 | |
*** jbadiapa has quit IRC | 04:52 | |
*** iclon_ has quit IRC | 04:56 | |
*** Luzi has joined #openstack-kolla | 04:58 | |
*** goldyfruit_ has joined #openstack-kolla | 05:26 | |
*** iclon has joined #openstack-kolla | 05:31 | |
*** cah_link has joined #openstack-kolla | 05:32 | |
*** iclon_ has joined #openstack-kolla | 05:37 | |
*** iclon has quit IRC | 05:40 | |
*** iclon_ has quit IRC | 05:44 | |
*** mixor has joined #openstack-kolla | 06:09 | |
yoctozepto | morning | 06:10 |
---|---|---|
*** iclon has joined #openstack-kolla | 06:29 | |
*** spsurya has joined #openstack-kolla | 06:33 | |
*** skramaja has joined #openstack-kolla | 06:37 | |
*** mixor has quit IRC | 06:52 | |
*** rpittau|afk is now known as rpittau | 07:10 | |
*** pcaruana has joined #openstack-kolla | 07:15 | |
*** hrww has quit IRC | 07:21 | |
*** luksky has joined #openstack-kolla | 07:21 | |
hrw | elo | 07:22 |
hrw | yoctozepto: for a good start of a day: https://review.opendev.org/#/c/686134/ https://review.opendev.org/#/c/686133/ | 07:22 |
yoctozepto | hrw: elo, unfortunately already started ;p | 07:23 |
*** mixor has joined #openstack-kolla | 07:27 | |
hrw | :D | 07:30 |
mnasiadka | morning | 07:32 |
*** ivve has joined #openstack-kolla | 07:41 | |
*** gdwornicki has quit IRC | 07:44 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Support matrix for Kolla https://review.opendev.org/677500 | 07:46 |
*** gdwornicki has joined #openstack-kolla | 07:47 | |
*** mixor has quit IRC | 07:48 | |
*** mixor has joined #openstack-kolla | 07:55 | |
hrw | yoctozepto: speaking of bug #1706549 - I do wonder how it affected anything on CI earlier as code was only run on Debian and we did not run on Debian in CI | 07:56 |
openstack | bug 1706549 in kolla train "apt_sources_list option does not work" [Medium,Triaged] https://launchpad.net/bugs/1706549 | 07:56 |
hrw | https://hub.docker.com/r/kolla/debian-source-base/tags | 07:57 |
hrw | By kolla • Updated 3 years ago | 07:57 |
hrw | ;D | 07:57 |
hrw | kolla-publish-debian-source | 07:58 |
hrw | (non-voting) | 07:59 |
hrw | in progress | 07:59 |
yoctozepto | hrw: that's another quirk, already explained to mgoddard once that it's os family there | 08:01 |
yoctozepto | so Ubuntu -> Debian | 08:01 |
yoctozepto | it was run but was effectively no-op | 08:01 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Add Debian/source CI job https://review.opendev.org/686133 | 08:04 |
hrw | this version has image building removed | 08:04 |
*** rgogunskiy has joined #openstack-kolla | 08:09 | |
mgoddard | morning | 08:13 |
*** gfidente has joined #openstack-kolla | 08:16 | |
hrw | yoctozepto: this bug shows thing broken since 2016... | 08:17 |
hrw | added comment to the bug | 08:18 |
hrw | no one complained since 2016 so I would rather remove that functionality and tell people to use overrides | 08:19 |
*** zbr is now known as zbr|ruck | 08:23 | |
yoctozepto | hrw: yup, me too | 08:24 |
yoctozepto | just ensure we can override that | 08:24 |
hrw | [hrw@lumpek ~]$ df -h|wc -l | 08:26 |
hrw | 66 | 08:26 |
hrw | my NAS system went wild... | 08:26 |
yoctozepto | hrw: but see | 08:27 |
yoctozepto | this is meant to be | 08:27 |
yoctozepto | adding debian broke that | 08:27 |
yoctozepto | and readding debian will remove it | 08:27 |
yoctozepto | <hrw> my NAS system went wild... | 08:28 |
yoctozepto | lumpeks do go wild | 08:28 |
hrw | 10:27 < yoctozepto> and readding debian will remove it | 08:30 |
hrw | ? | 08:30 |
hrw | I do not follow | 08:30 |
*** gdwornicki has quit IRC | 08:30 | |
yoctozepto | hrw: you suggested to remove the option | 08:31 |
yoctozepto | the apt_sources_list | 08:31 |
hrw | it does not work anyway | 08:31 |
yoctozepto | and it happens when you are readding debian support | 08:31 |
yoctozepto | and it got broken | 08:31 |
yoctozepto | when it was added for the first time | 08:31 |
yoctozepto | did you read that commit message? | 08:31 |
hrw | it was broken before I joined | 08:31 |
yoctozepto | Partially-implements: blueprint build-debian | 08:32 |
yoctozepto | yeah, I know, nobody is blaming you ;p | 08:32 |
hrw | yoctozepto: when I joined kolla Debian was there for a while. on a way to go out. | 08:32 |
yoctozepto | as can be seen | 08:32 |
yoctozepto | I just say it's a nice coincidence that breakage and removal happen due to debian support | 08:34 |
yoctozepto | ;D | 08:34 |
hrw | ;D | 08:34 |
hrw | yoctozepto: it also shows how not used this option is | 08:35 |
hrw | no one noticed | 08:35 |
yoctozepto | indeed, except that one guy in 2017 | 08:36 |
*** rgogunskiy has quit IRC | 08:38 | |
*** rgogunskiy_ has joined #openstack-kolla | 08:38 | |
*** rgogunskiy_ has quit IRC | 08:38 | |
*** rgogunskiy has joined #openstack-kolla | 08:39 | |
*** rgogunskiy has quit IRC | 08:39 | |
yoctozepto | hrw: argh, POST_FAILURE on debian job | 08:42 |
yoctozepto | :< | 08:42 |
*** rgogunskiy_ has joined #openstack-kolla | 08:42 | |
*** mixor has quit IRC | 08:42 | |
hrw | where? | 08:43 |
yoctozepto | https://cb91710b8557a2f6220d-98f49207ca8d4e649788d064c2e22814.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/kolla/master/kolla-publish-debian-source/747d878/ | 08:43 |
yoctozepto | publishing | 08:43 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Support matrix for Kolla https://review.opendev.org/677500 | 08:44 |
hrw | 2019-10-04 08:30:09.457645 | POST-RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/kolla/tests/playbooks/publish.yml@master] | 08:44 |
hrw | after 2.5h | 08:44 |
yoctozepto | 2019-10-04 08:30:09.457645 | POST-RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/kolla/tests/playbooks/publish.yml@master] | 08:45 |
yoctozepto | yeah | 08:45 |
yoctozepto | 2019-10-04 06:30:21.660175 | TASK [shell: for img in $(docker images --format '{% raw %}{{ .Repository }}:{{ .Tag }}{% endraw %}' | grep kolla ); do docker push $img; done] | 08:45 |
yoctozepto | 2 hours of PUSHING | 08:46 |
yoctozepto | built images | 08:46 |
yoctozepto | more reasons to split build/publish jobs into smaller chunks | 08:46 |
yoctozepto | we can declare jobs to run after another | 08:46 |
yoctozepto | so we could reuse the bases | 08:46 |
yoctozepto | hrw: imho restore building in k-a jobs for debian | 08:47 |
yoctozepto | the subset is quite small and stable in there | 08:48 |
yoctozepto | and we could have a hard time publishing... | 08:48 |
hrw | the problem is that we need to have publishing. | 08:48 |
yoctozepto | we do | 08:49 |
yoctozepto | what do you propose | 08:49 |
hrw | for start: bump timeout to max 3h | 08:50 |
yoctozepto | hrw: unfortunately need to wait till tomorrow to see if it helped | 08:51 |
yoctozepto | (and tomorrow one image fails to build and we are screwed) | 08:52 |
hrw | GEGI*#Y$T#*$T&@(#P$T@$GEHGOWEHNGW~! | 08:52 |
yoctozepto | indeed hrw | 08:52 |
yoctozepto | centos jobs like to timeout | 08:53 |
yoctozepto | so they are often not up to date | 08:53 |
yoctozepto | :< | 08:53 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Add Debian/source CI job https://review.opendev.org/686133 | 08:53 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Debian: increase periodic publish job to 3h https://review.opendev.org/686552 | 08:55 |
hrw | hope it is proper way | 08:55 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Add Debian/source CI job https://review.opendev.org/686133 | 08:59 |
yoctozepto | hrw: I removed more cruft there | 08:59 |
hrw | ok | 08:59 |
yoctozepto | no idea what that push is doing there too | 09:00 |
yoctozepto | ah no | 09:00 |
yoctozepto | I know | 09:00 |
yoctozepto | eh | 09:00 |
yoctozepto | so uncrufted | 09:01 |
yoctozepto | much better | 09:01 |
hrw | <here goes picture of pieseł> | 09:01 |
yoctozepto | hrw: that timeout seems wrong | 09:04 |
yoctozepto | would be adding only 10 minutes | 09:04 |
yoctozepto | wonder where the rest of the time went | 09:05 |
hrw | heh. | 09:06 |
yoctozepto | centos publish job failed too | 09:09 |
yoctozepto | seems we are unlucky on publishing transfer today | 09:10 |
yoctozepto | most likely because all those jobs run at the same time | 09:10 |
yoctozepto | also 2 hours of pushing there | 09:11 |
yoctozepto | 2h 40 minutes total time | 09:11 |
hrw | in september it took 1:51 to push all kolla images at linaro ci | 09:11 |
hrw | 1:49 - 1:51 in general | 09:12 |
yoctozepto | hrw: make that 3:30 maybe | 09:13 |
hrw | yoctozepto: iirc 3h is zuul limit anyway | 09:14 |
yoctozepto | I doubt 10 minutes will save us | 09:14 |
yoctozepto | but 40 could | 09:14 |
yoctozepto | ah maybe | 09:14 |
yoctozepto | let's ask infra | 09:14 |
hrw | abandoned | 09:14 |
yoctozepto | will you be asking? | 09:15 |
hrw | will | 09:16 |
hrw | but there is an other option... | 09:16 |
hrw | we do build and then push | 09:16 |
hrw | we should consider build-and-push-while-building | 09:16 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Implement IPv6 support in the control plane https://review.opendev.org/681573 | 09:17 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Revert "Adding python*-pyngus package to openstack base" https://review.opendev.org/685952 | 09:17 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Implement IPv6 support in the control plane https://review.opendev.org/681573 | 09:18 |
*** tonythomas has joined #openstack-kolla | 09:19 | |
yoctozepto | hmm, sounds plausible | 09:20 |
yoctozepto | could decrease time | 09:20 |
hrw | something like: http://paste.debian.net/1104309/ would work? mnasiadka? yoctozepto? | 09:30 |
hrw | as: login to docker hub if publisher and then if publisher then push during build | 09:30 |
mnasiadka | well, if something fails - we push some containers, but some not - is it a problem then? | 09:32 |
yoctozepto | eureka | 09:32 |
mnasiadka | maybe we could define multiple profiles, like Openstack-core, external, other crap, and build profile by profile? | 09:32 |
yoctozepto | publish.yml was in post | 09:32 |
mnasiadka | and once a profile is built, push it? | 09:32 |
yoctozepto | so it was affected by the post limit | 09:32 |
yoctozepto | not run | 09:33 |
mnasiadka | publish.yml in post? uhh | 09:33 |
yoctozepto | post-timeout: 7200 | 09:33 |
yoctozepto | bingo | 09:33 |
yoctozepto | makes sense now that it failed after 2h | 09:33 |
hrw | yoctozepto: so s/7200/10800/? | 09:33 |
yoctozepto | not sure, I think we would be better off with posting inside the run I believe anyway | 09:34 |
yoctozepto | and then reset the post limit to something low | 09:34 |
mnasiadka | well, we don't really have influence over faulty internet connection of a nodepool vendor | 09:34 |
yoctozepto | in case it hangs | 09:34 |
mnasiadka | it can hang in run for hours as well :) | 09:34 |
yoctozepto | hrw: I think your approach is fine, please propose | 09:36 |
yoctozepto | just add |bool to the template too | 09:36 |
yoctozepto | (never sure how bools are translated between stuff) | 09:36 |
hrw | yoctozepto: on the other side mnasiadka is right. when we build and then push then we do not push when build fails | 09:37 |
hrw | so this way stays | 09:37 |
hrw | it reminded me why I split push from build in Linaro CI D | 09:37 |
hrw | : | 09:37 |
yoctozepto | hmm, yeah | 09:39 |
yoctozepto | but no | 09:39 |
yoctozepto | then let it stay wrt orderding | 09:39 |
yoctozepto | first build | 09:39 |
yoctozepto | then publish | 09:39 |
hrw | in theory our CI jobs are expected to just work. except when they do not | 09:39 |
yoctozepto | as always | 09:39 |
yoctozepto | ok, then it's easiest to just raise the post-timeout there | 09:40 |
yoctozepto | to 3h | 09:40 |
yoctozepto | because we hit that | 09:40 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: increase both limits to 3h https://review.opendev.org/686561 | 09:41 |
mnasiadka | yoctozepto: well, post-timeout can be even 8h, it's periodical | 09:42 |
*** jbadiapa has joined #openstack-kolla | 09:42 | |
mnasiadka | and we really need to push those images somehow | 09:42 |
mnasiadka | unless Openstack-infra delivers a local docker hub proxy, that we can use for pushing - or something like that | 09:42 |
yoctozepto | hrw: would be nicer with reasoning in the message though | 09:44 |
hrw | will add | 09:44 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: increase both limits to 3h https://review.opendev.org/686561 | 09:45 |
hrw | feel free to expand | 09:45 |
*** mixor has joined #openstack-kolla | 09:46 | |
openstackgerrit | Merged openstack/kolla-ansible master: CI: Remove multinode non-ceph glance exception https://review.opendev.org/685903 | 09:55 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Support matrix for Kolla https://review.opendev.org/677500 | 10:05 |
*** gdwornicki has joined #openstack-kolla | 10:06 | |
*** rgogunskiy has joined #openstack-kolla | 10:18 | |
hrw | one day we will reconsider keeping all those distros as base etc | 10:18 |
*** rgogunskiy_ has quit IRC | 10:22 | |
*** factor has joined #openstack-kolla | 10:26 | |
* hrw out | 10:31 | |
*** mixor has quit IRC | 10:34 | |
*** mixor has joined #openstack-kolla | 10:36 | |
*** mixor has quit IRC | 10:44 | |
openstackgerrit | Isaac Prior proposed openstack/kolla-ansible master: Parse MariaDB log messages in different formats into Fluentd https://review.opendev.org/686428 | 10:46 |
*** rgogunskiy has quit IRC | 10:57 | |
openstackgerrit | Merged openstack/kolla-ansible master: Horizon: fix for Debian https://review.opendev.org/685966 | 11:02 |
*** rgogunskiy has joined #openstack-kolla | 11:02 | |
*** rgogunskiy has quit IRC | 11:07 | |
*** jbadiapa has quit IRC | 11:09 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla master: CI: Use semaphore to limit strain on DockerHub https://review.opendev.org/686569 | 11:10 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla master: CI: Use semaphore to limit strain on Docker Hub https://review.opendev.org/686569 | 11:10 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla master: CI: Use semaphore to limit strain on Docker Hub https://review.opendev.org/686569 | 11:14 |
*** zbr|ruck is now known as zbr|lunch | 11:15 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 11:16 |
yoctozepto | hrw: remember to add debian binary to periodics once it is fine (or it won't get updated) | 11:16 |
hrw | ok | 11:17 |
*** kplant has joined #openstack-kolla | 11:31 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 11:39 |
*** EmilienM has quit IRC | 11:53 | |
*** EmilienM has joined #openstack-kolla | 11:54 | |
*** gdwornicki has quit IRC | 12:00 | |
*** kukacz has joined #openstack-kolla | 12:09 | |
*** spsurya has quit IRC | 12:10 | |
*** goldyfruit_ has quit IRC | 12:22 | |
*** signed8b_ has quit IRC | 12:24 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: build: prioritize images by amount of children https://review.opendev.org/686587 | 12:29 |
hrw | checking how it improves | 12:29 |
yoctozepto | hrw: ok | 12:32 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 12:34 |
*** ivve has quit IRC | 12:41 | |
*** kukacz has quit IRC | 12:44 | |
*** kukacz has joined #openstack-kolla | 12:45 | |
*** vesper11 has quit IRC | 12:53 | |
*** vesper11 has joined #openstack-kolla | 12:54 | |
*** Luzi has quit IRC | 12:55 | |
*** vesper11 has quit IRC | 12:59 | |
*** BjoernT has joined #openstack-kolla | 13:11 | |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Deprecate Almanach images https://review.opendev.org/686616 | 13:14 |
*** rgogunskiy has joined #openstack-kolla | 13:16 | |
*** BjoernT has quit IRC | 13:19 | |
*** BjoernT has joined #openstack-kolla | 13:22 | |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Deprecate Dragonflow images https://review.opendev.org/686641 | 13:25 |
*** dpawlik has quit IRC | 13:25 | |
*** zbr|lunch is now known as zbr|ruck | 13:25 | |
*** vesper11 has joined #openstack-kolla | 13:27 | |
hrw | mgoddard: https://review.opendev.org/#/c/675568/ | 13:28 |
mgoddard | hrw: ah | 13:28 |
mgoddard | we already deprecated k8s stuff: https://docs.openstack.org/releasenotes/kolla/unreleased.html | 13:29 |
hrw | ok | 13:29 |
hrw | that's why 'free to edit' in comment | 13:29 |
*** vesper11 has quit IRC | 13:31 | |
*** vesper11 has joined #openstack-kolla | 13:32 | |
jovial[m] | `/etc/hosts` in the `nova_libvirt` container of my exisiting hosts doesn't update when I add a new hypervisor. If I restart the container, do the VMs, continue to run or are they killed when the libvirt process dies? | 13:32 |
jovial[m] | I asumming using `network: host` only populates this file once at container start up i.e its not a bind mount | 13:34 |
mgoddard | jovial[m]: try it :) | 13:34 |
*** rgogunskiy_ has joined #openstack-kolla | 13:34 | |
*** pescobar has quit IRC | 13:35 | |
*** pescobar has joined #openstack-kolla | 13:36 | |
mgoddard | jovial[m]: VMs continue running (just tried) | 13:37 |
mgoddard | I think it uses pid=host, so the qemu processes don't get killed | 13:37 |
jovial[m] | thank you :) | 13:37 |
*** rgogunskiy has quit IRC | 13:37 | |
mgoddard | as for /etc/hosts, it's a common complaint | 13:38 |
mgoddard | again, I'd say try it :) | 13:38 |
mgoddard | but I know we don't have an easy way to update /etc/hosts when a new host is added | 13:38 |
mgoddard | we should | 13:38 |
jovial[m] | would it be better to bind mount `/etc/hosts`? because at the moment, I can't live-migrate to my new hypervisor. | 13:38 |
jovial[m] | without restarting nova_libvirt on the other hosts that is. | 13:39 |
mgoddard | just added something to https://etherpad.openstack.org/p/kolla-ussuri-ptg | 13:40 |
mgoddard | right, that's the problem | 13:40 |
*** goldyfruit_ has joined #openstack-kolla | 13:40 | |
mgoddard | it would be best to solve the problem via DNS | 13:40 |
mgoddard | but failing that, I think you need to restart the libvirt container | 13:41 |
jovial[m] | OK, thanks for your help :) | 13:41 |
openstackgerrit | Merged openstack/kolla master: CI: increase both limits to 3h https://review.opendev.org/686561 | 13:41 |
pescobar | thanks mgoddard | 13:41 |
mgoddard | pescobar: np | 13:42 |
*** gmann_afk is now known as gmann | 13:58 | |
*** JamesBenson has joined #openstack-kolla | 14:00 | |
openstackgerrit | Merged openstack/kolla master: Revert "Adding python*-pyngus package to openstack base" https://review.opendev.org/685952 | 14:01 |
mgoddard | yoctozepto, mnasiadka, hrw: Added a topic to next week's meeting about image building & publishing. I've put some ideas down on this etherpad, please read through in advance: https://etherpad.openstack.org/p/kolla-train-image-evaluation | 14:04 |
hrw | ok | 14:04 |
mgoddard | one thing we could do is be bold and remove images rather than deprecate | 14:04 |
*** JamesBenson has quit IRC | 14:05 | |
hrw | if someone complain then we can say 'patches to get them back are welcome' | 14:07 |
mgoddard | easier to ask for forgiveness... | 14:08 |
hrw | if conf is None or not conf.logs_dir or not image_name: | 14:09 |
hrw | argh | 14:09 |
hrw | have to live with lack of kolla-build.log ;( | 14:10 |
*** goldyfruit___ has joined #openstack-kolla | 14:16 | |
*** Blinkiz has quit IRC | 14:18 | |
*** goldyfruit_ has quit IRC | 14:19 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Deprecate Almanach images https://review.opendev.org/686616 | 14:24 |
yoctozepto | <mgoddard> one thing we could do is be bold and remove images rather than deprecate | 14:26 |
yoctozepto | +3 | 14:26 |
yoctozepto | <hrw> have to live with lack of kolla-build.log ;( | 14:26 |
yoctozepto | hmm? | 14:26 |
*** skramaja has quit IRC | 14:30 | |
*** JamesBenson has joined #openstack-kolla | 14:34 | |
yoctozepto | mgoddard: https://etherpad.openstack.org/p/kolla-train-image-evaluation commented | 14:34 |
*** gdwornicki has joined #openstack-kolla | 14:35 | |
*** jbadiapa has joined #openstack-kolla | 14:35 | |
*** goldyfruit_ has joined #openstack-kolla | 14:36 | |
*** goldyfruit___ has quit IRC | 14:39 | |
yoctozepto | mgoddard: https://2134a29bae866f641ab6-701f34b1f5c8464754ca2157d0b700e8.ssl.cf5.rackcdn.com/686133/11/gate/kolla-ansible-ubuntu-source-upgrade/a0aa7cf/primary/logs/kolla/all-CRITICAL.txt.gz <- turns out CRITICAL can fail otherwise fine upgrades | 14:39 |
yoctozepto | due to mariadb downtime | 14:39 |
*** skramaja has joined #openstack-kolla | 14:45 | |
mgoddard | yoctozepto: ouch. that's a bug in placement though, surely | 14:46 |
mgoddard | wonder how many retries it used | 14:47 |
hrw | yoctozepto: --logs-dir allows to have per-image log files. But 'added next task' like messages from kolla-build are handled by separate logger | 14:47 |
yoctozepto | hrw: ah, this | 14:52 |
hrw | would help with priority checks. but have good grep for it | 14:53 |
hrw | https://paste.debian.net/1104438/ shows how it went | 14:53 |
yoctozepto | makes sense | 14:54 |
hrw | https://paste.debian.net/1104439/ is without patch | 14:55 |
hrw | now waiting for centos/source with patch | 14:55 |
hrw | https://paste.debian.net/1104440/ is centos/source without patch. 35.34 minutes | 14:56 |
yoctozepto | could depend on other factors too | 14:56 |
hrw | sure | 14:56 |
*** primeministerp has joined #openstack-kolla | 14:56 | |
hrw | build done in tmpfs to remove i/o limit | 14:57 |
*** skramaja has quit IRC | 14:57 | |
hrw | we could link /var/cache/{apt,yum} and do not clean it between images | 14:57 |
hrw | etc | 14:57 |
hrw | too bad that docker do not care about squashing | 14:59 |
hrw | but shared cache does not give much as we use local mirror in infra | 15:01 |
primeministerp | Hey guys has anyone tried kolla on aarch64? | 15:02 |
primeministerp | it deploys and I get a functional controller, however it appears it complians that KVM isn't present. | 15:03 |
primeministerp | That of course happens when you try to deploy a vm. | 15:04 |
*** BjoernT has quit IRC | 15:04 | |
hrw | primeministerp: which hw? | 15:05 |
hrw | primeministerp: I am local aarch64 person | 15:05 |
*** BjoernT has joined #openstack-kolla | 15:06 | |
hrw | Tasks: 204, 827 thr, 506 kthr; 28 running | 15:11 |
hrw | such building I like ;d | 15:12 |
hrw | and primeministerp went silent | 15:15 |
yoctozepto | and which distro obviously | 15:20 |
hrw | yoctozepto: should work on any. | 15:22 |
Wasaac | Not sure if anyone's noticed but the fluentd config for mariadb hasn't been parsing everything correctly. I submitted a bug report last week (https://bugs.launchpad.net/kolla-ansible/+bug/1845629) and a PR this week (https://review.opendev.org/#/c/686428/). Reviews and criticism would be most appreciated. | 15:25 |
openstack | Launchpad bug 1845629 in kolla-ansible "Fluentd config incorrectly parses MariaDB logs" [Undecided,In progress] - Assigned to Isaac Prior (wasaac) | 15:25 |
primeministerp | ubuntu 18.04 | 15:26 |
*** gdwornicki has quit IRC | 15:26 | |
yoctozepto | hrw: you checked all three for kvm? | 15:26 |
hrw | Wasaac: thanks | 15:26 |
primeministerp | yoctozepto: ubuntu 18.04 arm64 | 15:26 |
hrw | primeministerp: what hardware? | 15:26 |
primeministerp | ampere emag | 15:26 |
hrw | ok | 15:27 |
primeministerp | it's a lenovo server w/ an Ampere eMAG | 15:27 |
hrw | primeministerp: can you pastebin log with exact message? | 15:27 |
primeministerp | I'm rebuilding now | 15:27 |
hrw | ok | 15:27 |
primeministerp | I"ll post again once it's finished | 15:28 |
hrw | primeministerp: thanks | 15:28 |
*** cah_link has quit IRC | 15:28 | |
*** BjoernT_ has joined #openstack-kolla | 15:33 | |
hrw | primeministerp: I will build ubuntu/binary set from master and deploy on my testing farm (m400 with xgene1) | 15:34 |
*** BjoernT has quit IRC | 15:35 | |
* hrw off | 15:35 | |
hrw | have a nice weekend | 15:35 |
*** rpittau is now known as rpittau|afk | 15:45 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fix baremetal serial console autoenable https://review.opendev.org/686755 | 15:52 |
*** kplant has quit IRC | 15:53 | |
*** rgogunskiy_ has quit IRC | 16:16 | |
*** rgogunskiy has joined #openstack-kolla | 16:17 | |
*** jbadiapa has quit IRC | 16:21 | |
*** rgogunskiy has quit IRC | 16:22 | |
*** gdwornicki has joined #openstack-kolla | 16:26 | |
*** goldyfruit_ has quit IRC | 16:32 | |
*** BaptisteGer has joined #openstack-kolla | 16:39 | |
*** goldyfruit_ has joined #openstack-kolla | 16:39 | |
*** zbr|ruck has quit IRC | 16:39 | |
*** dpawlik has joined #openstack-kolla | 16:44 | |
*** goldyfruit_ has quit IRC | 16:46 | |
*** gfidente has quit IRC | 16:49 | |
*** zbr has joined #openstack-kolla | 16:51 | |
*** gdwornicki has quit IRC | 16:59 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for self-signed SSL certificates and TLS CI scenario https://review.opendev.org/664517 | 17:13 |
primeministerp | hrw: I found a couple problems w/ my underlying host. Could be apparmor. | 17:13 |
*** rgogunskiy has joined #openstack-kolla | 17:46 | |
*** rgogunskiy has quit IRC | 17:51 | |
*** gdwornicki has joined #openstack-kolla | 17:58 | |
*** rgogunskiy has joined #openstack-kolla | 18:05 | |
*** rgogunskiy has quit IRC | 18:10 | |
*** gdwornicki has quit IRC | 18:11 | |
*** gdwornicki has joined #openstack-kolla | 18:27 | |
*** pcaruana has quit IRC | 18:51 | |
*** BjoernT_ has quit IRC | 19:02 | |
primeministerp | hrw: http://paste.openstack.org/show/781097/ | 19:28 |
primeministerp | hrw: 853: error : virCPUGetHost:454 : this function is not supported by the connection driver: cannot detect host CPU model for aarch64 architecture | 19:29 |
primeministerp | hrw: 853: info : libvirt version: 5.0.0, package: 1ubuntu2~cloud0 (Openstack Ubuntu Testing Bot <openstack-testing-bot@ubuntu.com> Wed, 06 Mar 2019 11:26:13 +0000) | 19:30 |
primeministerp | hrw: http://paste.openstack.org/show/781098/ | 19:35 |
primeministerp | hrw: that's the nova-compute.log of the failed vm start | 19:36 |
*** BjoernT has joined #openstack-kolla | 19:40 | |
primeministerp | anyone from linaro in the channel? | 19:44 |
*** zbr has quit IRC | 19:46 | |
*** BjoernT has quit IRC | 19:49 | |
*** BjoernT has joined #openstack-kolla | 19:51 | |
*** bverschueren_ is now known as bverschueren | 19:54 | |
primeministerp | hrw: starting to think it's because I didn't explicitly add architecture=aarch64 to the vm image | 20:18 |
*** EmilienM is now known as EvilienM | 20:18 | |
*** EvilienM is now known as containerizes_hi | 20:19 | |
*** containerizes_hi is now known as containerized | 20:19 | |
*** containerized is now known as EvilienM | 20:19 | |
*** dswebb has quit IRC | 20:45 | |
*** dswebb has joined #openstack-kolla | 20:45 | |
*** dpawlik has quit IRC | 20:54 | |
*** JamesBenson has quit IRC | 21:32 | |
*** goldyfruit_ has joined #openstack-kolla | 21:38 | |
*** jbadiapa has joined #openstack-kolla | 21:50 | |
*** EvilienM is now known as EmilienM | 21:52 | |
*** goldyfruit_ has quit IRC | 22:04 | |
*** goldyfruit_ has joined #openstack-kolla | 22:07 | |
*** BjoernT has quit IRC | 22:44 | |
*** BjoernT has joined #openstack-kolla | 22:45 | |
*** luksky has quit IRC | 23:00 | |
*** JamesBenson has joined #openstack-kolla | 23:46 | |
*** JamesBenson has quit IRC | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!