| *** weifan has quit IRC | 00:03 | |
| *** tobiash has quit IRC | 00:08 | |
| *** tobiash has joined #openstack-infra | 00:11 | |
| mordred | corvus, clarkb: https://review.opendev.org/#/c/630406 and its children is green and ready for review | 00:12 |
|---|---|---|
| mordred | well, except for the last patch, which is not | 00:12 |
| *** diablo_rojo has joined #openstack-infra | 00:15 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Add replication config to gerrit ansible https://review.opendev.org/691173 | 00:17 |
| *** yamamoto has joined #openstack-infra | 00:18 | |
| *** yamamoto has quit IRC | 00:23 | |
| *** zer0c00l has joined #openstack-infra | 00:34 | |
| *** aspiers has quit IRC | 00:35 | |
| *** weifan has joined #openstack-infra | 00:39 | |
| *** aedc has quit IRC | 00:40 | |
| *** rlandy has quit IRC | 00:43 | |
| *** weifan has quit IRC | 00:45 | |
| *** jamesmcarthur has joined #openstack-infra | 00:46 | |
| *** ccamacho has quit IRC | 00:51 | |
| mordred | infra-root: review-dev is running on the top of that stack ^^ - I ran the ansible by hand | 00:54 |
| *** jamesmcarthur has quit IRC | 01:01 | |
| *** jamesmcarthur has joined #openstack-infra | 01:09 | |
| *** todun_ has joined #openstack-infra | 01:12 | |
| *** todun has quit IRC | 01:12 | |
| *** todun_ is now known as todun | 01:12 | |
| *** yamamoto has joined #openstack-infra | 01:16 | |
| *** goldyfruit___ has quit IRC | 01:17 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through storyboard hiera data https://review.opendev.org/691777 | 01:27 |
| *** weifan has joined #openstack-infra | 01:32 | |
| paladox | clarkb fungi mordred i guess https://bugs.chromium.org/p/gerrit/issues/detail?id=11573 was your issue? | 01:34 |
| *** weifan has quit IRC | 01:36 | |
| *** dpawlik has joined #openstack-infra | 01:40 | |
| *** igordc has quit IRC | 01:42 | |
| *** dpawlik has quit IRC | 01:45 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Deprecates the existing "ironic-agent" element in DIB https://review.opendev.org/675608 | 01:49 |
| *** todun has quit IRC | 02:02 | |
| *** todun has joined #openstack-infra | 02:03 | |
| *** larainema has joined #openstack-infra | 02:04 | |
| *** lxkong has joined #openstack-infra | 02:09 | |
| *** markvoelker has joined #openstack-infra | 02:36 | |
| *** markvoelker has quit IRC | 02:41 | |
| *** igordc has joined #openstack-infra | 02:45 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Add launchpadlib credentials to gerrit ansible https://review.opendev.org/691172 | 03:03 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Add replication config to gerrit ansible https://review.opendev.org/691173 | 03:03 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through storyboard hiera data https://review.opendev.org/691777 | 03:03 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through secure.config contents https://review.opendev.org/691800 | 03:03 |
| *** yamamoto has quit IRC | 03:07 | |
| *** yamamoto has joined #openstack-infra | 03:07 | |
| *** yamamoto has quit IRC | 03:07 | |
| *** yamamoto has joined #openstack-infra | 03:07 | |
| *** jerryz has quit IRC | 03:20 | |
| *** anteaya has quit IRC | 03:49 | |
| *** Guest14611 has quit IRC | 03:50 | |
| *** benj has joined #openstack-infra | 03:51 | |
| *** benj is now known as Guest85345 | 03:51 | |
| *** ricolin has joined #openstack-infra | 03:57 | |
| *** yamamoto has quit IRC | 04:12 | |
| *** yamamoto has joined #openstack-infra | 04:12 | |
| *** yamamoto has quit IRC | 04:13 | |
| *** yamamoto has joined #openstack-infra | 04:13 | |
| *** todun has quit IRC | 04:14 | |
| *** yamamoto has quit IRC | 04:17 | |
| *** yamamoto has joined #openstack-infra | 04:26 | |
| *** markvoelker has joined #openstack-infra | 04:58 | |
| *** markvoelker has quit IRC | 05:03 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through storyboard hiera data https://review.opendev.org/691777 | 05:20 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through secure.config contents https://review.opendev.org/691800 | 05:20 |
| *** igordc has quit IRC | 05:31 | |
| *** igordc has joined #openstack-infra | 05:38 | |
| *** dpawlik has joined #openstack-infra | 05:42 | |
| *** markvoelker has joined #openstack-infra | 05:46 | |
| *** dpawlik has quit IRC | 05:46 | |
| *** markvoelker has quit IRC | 05:56 | |
| *** markvoelker has joined #openstack-infra | 05:56 | |
| *** markvoelker has quit IRC | 06:00 | |
| *** diablo_rojo has quit IRC | 06:11 | |
| *** diablo_rojo has joined #openstack-infra | 06:26 | |
| *** dpawlik has joined #openstack-infra | 06:30 | |
| *** gfidente has joined #openstack-infra | 06:33 | |
| *** lmiccini has joined #openstack-infra | 06:45 | |
| *** tkajinam has quit IRC | 06:50 | |
| *** tkajinam has joined #openstack-infra | 06:51 | |
| *** igordc has quit IRC | 06:52 | |
| *** kjackal has joined #openstack-infra | 06:55 | |
| *** diablo_rojo has quit IRC | 07:03 | |
| *** rcernin has quit IRC | 07:28 | |
| *** ccamacho has joined #openstack-infra | 07:33 | |
| *** pcaruana has joined #openstack-infra | 07:37 | |
| *** jtomasek has joined #openstack-infra | 07:37 | |
| *** slaweq has joined #openstack-infra | 07:42 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Revert "Pause Fedora jobs" https://review.opendev.org/691540 | 07:48 |
| *** tesseract has joined #openstack-infra | 07:49 | |
| *** pgaxatte has joined #openstack-infra | 07:52 | |
| *** tkajinam has quit IRC | 07:54 | |
| *** trident has quit IRC | 07:55 | |
| *** trident has joined #openstack-infra | 08:01 | |
| *** kopecmartin|off is now known as kopecmartin | 08:05 | |
| *** dciabrin has joined #openstack-infra | 08:09 | |
| *** yamamoto has quit IRC | 08:13 | |
| *** yamamoto has joined #openstack-infra | 08:15 | |
| *** dchen has quit IRC | 08:17 | |
| *** pkopec has joined #openstack-infra | 08:22 | |
| *** dayou has quit IRC | 08:26 | |
| *** dayou has joined #openstack-infra | 08:32 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: AFS: Allow for remote vos release with localauth https://review.opendev.org/691824 | 08:41 |
| *** ralonsoh has joined #openstack-infra | 08:44 | |
| *** priteau has joined #openstack-infra | 08:46 | |
| *** amoralej|off is now known as amoralej | 08:50 | |
| *** jpena|off is now known as jpena | 08:51 | |
| *** lucasagomes has joined #openstack-infra | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 08:55 | |
| *** rpittau|afk is now known as rpittau | 09:08 | |
| openstackgerrit | Felix Schmidt proposed zuul/zuul master: Change colors of various "negative" results in UI https://review.opendev.org/691828 | 09:13 |
| *** tkajinam has joined #openstack-infra | 09:15 | |
| *** tkajinam has quit IRC | 09:16 | |
| *** soniya29 has joined #openstack-infra | 09:18 | |
| *** yamamoto has quit IRC | 09:23 | |
| *** yamamoto has joined #openstack-infra | 09:30 | |
| *** aedc has joined #openstack-infra | 09:35 | |
| *** yamamoto has quit IRC | 09:35 | |
| *** ociuhandu has joined #openstack-infra | 09:47 | |
| *** xinranwang has joined #openstack-infra | 09:49 | |
| *** ociuhandu has quit IRC | 09:50 | |
| *** iurygregory has quit IRC | 10:01 | |
| *** pcaruana has quit IRC | 10:03 | |
| *** lpetrut has joined #openstack-infra | 10:07 | |
| *** priteau has quit IRC | 10:20 | |
| *** pcaruana has joined #openstack-infra | 10:24 | |
| *** jamesmcarthur has quit IRC | 10:27 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: AFS: Allow for remote vos release with localauth https://review.opendev.org/691824 | 10:28 |
| ianw | ok, ubuntu mirror released; dropping the lock | 10:29 |
| ianw | fedora just started | 10:30 |
| *** aedc has quit IRC | 10:38 | |
| *** prometheanfire has quit IRC | 10:52 | |
| *** prometheanfire has joined #openstack-infra | 10:52 | |
| slaweq | hi infra-root | 11:01 |
| slaweq | was there any issue with grafana in last days maybe? We have gaps on all graphs at http://grafana.openstack.org/d/Hj5IHcSmz/neutron-failure-rate?orgId=1 | 11:02 |
| slaweq | it seems that it started displaying something again today | 11:02 |
| *** rfolco|ruck has quit IRC | 11:04 | |
| *** rfolco|ruck has joined #openstack-infra | 11:04 | |
| *** soniya29 has quit IRC | 11:12 | |
| frickler | slaweq: yes, we ran out of disk space, should be fixed since yesterday evening UTC | 11:14 |
| *** ianychoi__ is now known as ianychoi | 11:24 | |
| slaweq | frickler: thx, not it is fine, I just wanted to know if there is any known root cause of it :) | 11:27 |
| slaweq | frickler: if You would have few minutes, can You maybe take a look at https://review.opendev.org/#/c/681201/ ? | 11:28 |
| *** soniya29 has joined #openstack-infra | 11:30 | |
| *** soniya29 is now known as soniya29|afk | 11:30 | |
| *** soniya29|afk has quit IRC | 11:35 | |
| *** arxcruz is now known as arxcruz|lunch | 11:37 | |
| *** pgaxatte has quit IRC | 11:38 | |
| *** yamamoto has joined #openstack-infra | 11:38 | |
| *** Lucas_Gray has joined #openstack-infra | 11:50 | |
| *** ociuhandu has joined #openstack-infra | 11:51 | |
| *** yamamoto has quit IRC | 11:52 | |
| *** kjackal has quit IRC | 11:53 | |
| *** Goneri has quit IRC | 11:54 | |
| *** ociuhandu has quit IRC | 11:55 | |
| *** jaosorior has joined #openstack-infra | 11:56 | |
| *** rh-jelabarre has joined #openstack-infra | 11:58 | |
| *** markvoelker has joined #openstack-infra | 11:59 | |
| *** kjackal has joined #openstack-infra | 12:00 | |
| *** markvoelker has quit IRC | 12:03 | |
| *** markvoelker has joined #openstack-infra | 12:05 | |
| *** amoralej is now known as amoralej|lunch | 12:13 | |
| *** goldyfruit___ has joined #openstack-infra | 12:15 | |
| *** rfolco|ruck is now known as rfolco|rover | 12:17 | |
| *** goldyfruit___ has quit IRC | 12:20 | |
| *** rlandy has joined #openstack-infra | 12:20 | |
| *** larainema has quit IRC | 12:22 | |
| *** Goneri has joined #openstack-infra | 12:23 | |
| *** dpawlik has quit IRC | 12:27 | |
| *** Goneri has quit IRC | 12:28 | |
| *** Goneri has joined #openstack-infra | 12:29 | |
| *** jpena is now known as jpena|lunch | 12:29 | |
| *** yamamoto has joined #openstack-infra | 12:32 | |
| *** gbutnaru has joined #openstack-infra | 12:33 | |
| *** Goneri has quit IRC | 12:35 | |
| *** jaosorior has quit IRC | 12:39 | |
| *** pcaruana has quit IRC | 12:45 | |
| *** Wryhder has joined #openstack-infra | 12:51 | |
| *** Lucas_Gray has quit IRC | 12:52 | |
| *** Wryhder is now known as Lucas_Gray | 12:52 | |
| *** yamamoto has quit IRC | 12:55 | |
| *** Goneri has joined #openstack-infra | 12:56 | |
| *** arxcruz|lunch is now known as arxcruz | 12:56 | |
| *** dklyle has quit IRC | 12:57 | |
| *** david-lyle has joined #openstack-infra | 12:57 | |
| *** pcaruana has joined #openstack-infra | 12:58 | |
| *** dpawlik has joined #openstack-infra | 13:04 | |
| *** Goneri has quit IRC | 13:04 | |
| *** dave-mccowan has joined #openstack-infra | 13:06 | |
| *** liuyulong has joined #openstack-infra | 13:11 | |
| *** Lucas_Gray has quit IRC | 13:13 | |
| *** Goneri has joined #openstack-infra | 13:15 | |
| *** jpena|lunch is now known as jpena | 13:19 | |
| *** snapiri has quit IRC | 13:19 | |
| *** goldyfruit___ has joined #openstack-infra | 13:26 | |
| *** ramishra has quit IRC | 13:27 | |
| *** ramishra has joined #openstack-infra | 13:28 | |
| *** david-lyle is now known as dklyle | 13:28 | |
| *** mriedem has joined #openstack-infra | 13:29 | |
| *** michael-beaver has joined #openstack-infra | 13:35 | |
| *** yamamoto has joined #openstack-infra | 13:37 | |
| *** amoralej|lunch is now known as amoralej | 13:44 | |
| *** pgaxatte has joined #openstack-infra | 13:47 | |
| *** jaosorior has joined #openstack-infra | 13:47 | |
| *** pcaruana has quit IRC | 13:52 | |
| *** goldyfruit_ has joined #openstack-infra | 13:53 | |
| *** pcaruana has joined #openstack-infra | 13:55 | |
| *** goldyfruit___ has quit IRC | 13:55 | |
| *** jaosorior has quit IRC | 13:59 | |
| *** diablo_rojo has joined #openstack-infra | 14:02 | |
| *** jaosorior has joined #openstack-infra | 14:03 | |
| *** dklyle has quit IRC | 14:05 | |
| *** dklyle has joined #openstack-infra | 14:07 | |
| *** weshay|rover is now known as weshay | 14:09 | |
| *** dklyle has quit IRC | 14:12 | |
| *** eharney has quit IRC | 14:14 | |
| *** sreejithp has joined #openstack-infra | 14:15 | |
| *** hashar has joined #openstack-infra | 14:37 | |
| *** jamesmcarthur has joined #openstack-infra | 14:38 | |
| clarkb | slaweq: ya sorry about that. I believe we have sorted it out though. Please let us know if you don't see the data updating as expected since yesterday evening | 14:50 |
| *** yamamoto has quit IRC | 14:51 | |
| *** jamesmcarthur has quit IRC | 14:53 | |
| *** slaweq has quit IRC | 14:54 | |
| *** slaweq has joined #openstack-infra | 14:56 | |
| *** gyee has joined #openstack-infra | 14:57 | |
| *** eharney has joined #openstack-infra | 14:59 | |
| *** ociuhandu has joined #openstack-infra | 15:00 | |
| *** jamesmcarthur has joined #openstack-infra | 15:01 | |
| *** dklyle has joined #openstack-infra | 15:01 | |
| *** ociuhandu has quit IRC | 15:07 | |
| *** ociuhandu has joined #openstack-infra | 15:12 | |
| *** liuyulong has quit IRC | 15:17 | |
| *** dpawlik has quit IRC | 15:18 | |
| *** pgaxatte has quit IRC | 15:19 | |
| *** ociuhandu has quit IRC | 15:20 | |
| jrosser | should the cherry pick button in gerrit add all the "cherry-picked from..." to the commit message? | 15:22 |
| clarkb | jrosser: that is a non default flag to the cherry pick command | 15:22 |
| clarkb | (I'm guessing that is what gerrit doesn't add it) | 15:22 |
| *** ociuhandu has joined #openstack-infra | 15:22 | |
| jrosser | i'm sure it used to - perhaps i'm mistaken | 15:22 |
| fungi | yeah, you only get that from git if you use -x | 15:23 |
| cmurphy | gerrit only adds it if the change has landed | 15:23 |
| jrosser | aaaaahhhhhh | 15:23 |
| fungi | ooh, i can understand why it would do that | 15:23 |
| jrosser | oh of course because the actual SHA isnt known yet | 15:23 |
| fungi | well, the sha you cherry-picked is known, but that sha may never appear in the branch due to updates | 15:24 |
| jrosser | yes | 15:24 |
| *** mattw4 has joined #openstack-infra | 15:25 | |
| *** ociuhandu has quit IRC | 15:26 | |
| *** yamamoto has joined #openstack-infra | 15:27 | |
| *** pgaxatte has joined #openstack-infra | 15:40 | |
| *** yamamoto has quit IRC | 15:44 | |
| *** slaweq has quit IRC | 15:49 | |
| *** slaweq has joined #openstack-infra | 15:54 | |
| *** Goneri has quit IRC | 15:56 | |
| *** goldyfruit___ has joined #openstack-infra | 15:59 | |
| *** goldyfruit_ has quit IRC | 16:01 | |
| *** igordc has joined #openstack-infra | 16:01 | |
| *** hashar has quit IRC | 16:03 | |
| *** kjackal has quit IRC | 16:08 | |
| *** lucasagomes has quit IRC | 16:12 | |
| *** hashar has joined #openstack-infra | 16:15 | |
| *** igordc has quit IRC | 16:18 | |
| *** aedc has joined #openstack-infra | 16:19 | |
| *** aedc has quit IRC | 16:20 | |
| *** aedc has joined #openstack-infra | 16:21 | |
| *** jaosorior has quit IRC | 16:24 | |
| *** jamesmcarthur_ has joined #openstack-infra | 16:35 | |
| *** tesseract has quit IRC | 16:38 | |
| *** xinranwang has quit IRC | 16:38 | |
| *** jamesmcarthur has quit IRC | 16:39 | |
| *** aedc has quit IRC | 16:44 | |
| *** jpena is now known as jpena|brb | 16:45 | |
| *** aedc has joined #openstack-infra | 16:45 | |
| *** amoralej is now known as amoralej|off | 16:48 | |
| *** lpetrut has quit IRC | 16:49 | |
| clarkb | jrosser: when do you think would be a good time to get https://review.opendev.org/#/c/690433/ and friends in? | 16:56 |
| *** kopecmartin is now known as kopecmartin|off | 16:59 | |
| AJaeger | clarkb: I just asked about https://review.opendev.org/689472 which should be the same. Let me push my open ones in and then rename the topic so that we work from the same list... | 16:59 |
| AJaeger | clarkb: oh, it's not the same - let me look closer at mine | 17:00 |
| clarkb | sounds good (also I'm happy to abandon any of mine that need abandoning) | 17:00 |
| *** jamesmcarthur_ has quit IRC | 17:00 | |
| *** sreejithp has quit IRC | 17:01 | |
| AJaeger | clarkb: I'm happy to abandon as well ;) | 17:01 |
| AJaeger | let me double check the set... | 17:02 |
| *** aedc has quit IRC | 17:02 | |
| *** yamamoto has joined #openstack-infra | 17:02 | |
| *** jamesmcarthur has joined #openstack-infra | 17:03 | |
| *** jamesmcarthur has quit IRC | 17:03 | |
| *** jamesmcarthur has joined #openstack-infra | 17:03 | |
| AJaeger | clarkb: just got a few +2As, I'll take inventory in a bit... | 17:04 |
| clarkb | ok thanks | 17:04 |
| AJaeger | clarkb: https://review.opendev.org/#/c/690433 can be abandoned, 689472 just got approved. Let's push for your backports nevertheless ;) | 17:07 |
| *** aedc has joined #openstack-infra | 17:08 | |
| clarkb | AJaeger: done | 17:08 |
| AJaeger | thanks. I'll handled lxc differently than you, just removed it. | 17:11 |
| AJaeger | dirk, I thought lxc was not working on openSUSE (saw your comment for that) - but just noticed it's in the distro. | 17:12 |
| *** aedc has quit IRC | 17:12 | |
| AJaeger | evrardjp: ^ | 17:12 |
| *** aedc has joined #openstack-infra | 17:12 | |
| dirk | Ajaeger: yes, i said the version of lxc we have is not supported | 17:14 |
| AJaeger | dirk: ah, ok. | 17:14 |
| dirk | Also lxc is not the problem, the lack of working wickedd with lxc is | 17:15 |
| dirk | Or the alternative (networkd) which does not exist | 17:15 |
| *** pgaxatte has quit IRC | 17:16 | |
| *** igordc has joined #openstack-infra | 17:16 | |
| AJaeger | so, removing lxc testing for openSUSE in openstack-ansible is correct - like in https://review.opendev.org/689012? | 17:16 |
| dirk | Imho yes | 17:17 |
| *** lmiccini has quit IRC | 17:17 | |
| AJaeger | ok, thanks | 17:17 |
| dirk | The old plan was to work on the aio targets | 17:17 |
| *** Goneri has joined #openstack-infra | 17:17 | |
| dirk | Which is d difficult enough to keep working because basically none cares about them | 17:18 |
| AJaeger | ;/ | 17:18 |
| AJaeger | clarkb: so, for openstack-ansible-lxc_hosts, I'll backport https://review.opendev.org/689012 to remove the jobs - could you abandon yours, please? | 17:20 |
| *** aedc has quit IRC | 17:22 | |
| clarkb | AJaeger: to confirm I should abandon https://review.opendev.org/690446 and https://review.opendev.org/690447 ? | 17:22 |
| AJaeger | no - https://review.opendev.org/690443 and friends | 17:23 |
| AJaeger | https://review.opendev.org/#/c/689012/ is merging to remove the jobs on that repo, let's backport that one | 17:23 |
| AJaeger | clarkb: let's keep 446 and 447 | 17:23 |
| clarkb | oh I see lxc_hosts | 17:24 |
| *** jpena|brb is now known as jpena | 17:24 | |
| AJaeger | yes | 17:24 |
| clarkb | done | 17:25 |
| *** rpittau is now known as rpittau|afk | 17:25 | |
| AJaeger | clarkb: https://review.opendev.org/690434 as well, please | 17:29 |
| *** gmann is now known as gmann_afk | 17:29 | |
| AJaeger | (abandon I mean) | 17:31 |
| *** sshnaidm is now known as sshnaidm|afk | 17:31 | |
| *** yamamoto has quit IRC | 17:32 | |
| *** gmann_afk is now known as gmann | 17:35 | |
| *** ociuhandu has joined #openstack-infra | 17:40 | |
| *** weifan has joined #openstack-infra | 17:41 | |
| *** dtantsur is now known as dtantsur|afk | 17:41 | |
| *** ociuhandu has quit IRC | 17:45 | |
| *** weifan has quit IRC | 17:46 | |
| *** jamesmcarthur has quit IRC | 17:47 | |
| *** jamesmcarthur_ has joined #openstack-infra | 17:47 | |
| *** hashar has quit IRC | 17:48 | |
| *** weifan has joined #openstack-infra | 17:51 | |
| *** gfidente is now known as gfidente|afk | 17:58 | |
| *** jerryz has joined #openstack-infra | 17:58 | |
| openstackgerrit | Matt Riedemann proposed opendev/elastic-recheck master: Add query for test_vcpu_to_pcpu_reshape fail bug 1850514 https://review.opendev.org/691933 | 18:07 |
| openstack | bug 1850514 in OpenStack Compute (nova) "ReshapeForPCPUsTest.test_vcpu_to_pcpu_reshape intermittently fails with "Cannot 'migrate' instance while it is in vm_state building"" [Medium,Confirmed] https://launchpad.net/bugs/1850514 | 18:07 |
| *** ociuhandu has joined #openstack-infra | 18:12 | |
| *** weifan has quit IRC | 18:16 | |
| *** ociuhandu has quit IRC | 18:18 | |
| *** jaosorior has joined #openstack-infra | 18:24 | |
| *** jaosorior has quit IRC | 18:26 | |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Replace old Train cycle signing key with Ussuri https://review.opendev.org/691939 | 18:28 |
| *** weifan has joined #openstack-infra | 18:28 | |
| *** jpena is now known as jpena|off | 18:30 | |
| *** elod has quit IRC | 18:33 | |
| *** elod has joined #openstack-infra | 18:33 | |
| *** weifan has quit IRC | 18:52 | |
| clarkb | we'll haev our weekly meeting in ~5 minutes over in #openstack-meeting | 18:56 |
| *** Guest85345 is now known as benj_ | 19:08 | |
| *** ralonsoh has quit IRC | 19:08 | |
| *** aedc has joined #openstack-infra | 19:09 | |
| *** pkopec has quit IRC | 19:10 | |
| *** aedc has quit IRC | 19:11 | |
| *** aedc has joined #openstack-infra | 19:11 | |
| *** pkopec has joined #openstack-infra | 19:15 | |
| *** pkopec has quit IRC | 19:15 | |
| *** eharney has quit IRC | 19:29 | |
| *** yamamoto has joined #openstack-infra | 19:31 | |
| *** kjackal has joined #openstack-infra | 19:43 | |
| *** weifan has joined #openstack-infra | 19:47 | |
| *** rlandy has quit IRC | 19:49 | |
| *** rlandy has joined #openstack-infra | 19:50 | |
| *** jamesmcarthur_ has quit IRC | 19:50 | |
| *** panda|pto has quit IRC | 19:55 | |
| *** panda has joined #openstack-infra | 19:58 | |
| openstackgerrit | Merged openstack/project-config master: Replace old Train cycle signing key with Ussuri https://review.opendev.org/691939 | 19:58 |
| fungi | thanks! | 19:59 |
| ianw | corvus: yeah, not quite COW afaik ... it *should* do incremental updates for sure | 19:59 |
| fungi | not quite a spherical cow at any rate. more wind resistance | 19:59 |
| fungi | gonna go find some late lunch/early dinner and then return to hack on more things | 20:00 |
| *** elod has quit IRC | 20:02 | |
| *** elod has joined #openstack-infra | 20:02 | |
| *** weifan has quit IRC | 20:02 | |
| *** weifan has joined #openstack-infra | 20:03 | |
| *** jamesmcarthur has joined #openstack-infra | 20:09 | |
| *** weifan has quit IRC | 20:12 | |
| *** dpawlik has joined #openstack-infra | 20:14 | |
| *** weifan has joined #openstack-infra | 20:18 | |
| *** dpawlik has quit IRC | 20:19 | |
| openstackgerrit | Merged opendev/elastic-recheck master: Add query for test_vcpu_to_pcpu_reshape fail bug 1850514 https://review.opendev.org/691933 | 20:21 |
| openstack | bug 1850514 in OpenStack Compute (nova) "ReshapeForPCPUsTest.test_vcpu_to_pcpu_reshape intermittently fails with "Cannot 'migrate' instance while it is in vm_state building"" [Medium,In progress] https://launchpad.net/bugs/1850514 - Assigned to Matt Riedemann (mriedem) | 20:21 |
| *** weifan has quit IRC | 20:27 | |
| *** eharney has joined #openstack-infra | 20:27 | |
| openstackgerrit | Merged opendev/puppet-mediawiki master: Move cache directory out of mediawiki Git worktree https://review.opendev.org/688762 | 20:29 |
| *** weifan has joined #openstack-infra | 20:30 | |
| openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Remove opensuse-150 nodeset https://review.opendev.org/691966 | 20:30 |
| *** markvoelker has quit IRC | 20:35 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Use zuul-registry as buildset registry https://review.opendev.org/689238 | 20:37 |
| *** weifan has quit IRC | 20:37 | |
| *** weifan has joined #openstack-infra | 20:38 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Make the buildset registry port configurable https://review.opendev.org/689240 | 20:38 |
| *** weifan has quit IRC | 20:40 | |
| openstackgerrit | Slawek Kaplonski proposed openstack/project-config master: Remove python27 jobs from neutron dashboard https://review.opendev.org/691973 | 20:44 |
| *** weifan has joined #openstack-infra | 20:44 | |
| *** markvoelker has joined #openstack-infra | 20:45 | |
| AJaeger | clarkb: I'm slowly going through ansible repos - stable/stein has many openstack-150 jobs, hope to catch them all... | 20:47 |
| openstackgerrit | Merged opendev/puppet-mediawiki master: Make sure the images tree is owned by www-data https://review.opendev.org/688763 | 20:47 |
| openstackgerrit | Merged opendev/puppet-mediawiki master: Fetch external dependencies https://review.opendev.org/688764 | 20:47 |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** kjackal has quit IRC | 21:03 | |
| *** gfidente|afk has quit IRC | 21:10 | |
| *** rfolco|rover is now known as rfolco|off | 21:12 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove openstack-tox-py27-with-oslo-master https://review.opendev.org/691986 | 21:15 |
| *** pcaruana has quit IRC | 21:15 | |
| AJaeger | gmann: I think we can remove that one as well, correct? ^ | 21:15 |
| mordred | morning clarkb - anything exciting? | 21:16 |
| clarkb | ianw: did the vhd changes to dib get released yet? I'm noticing there are a lot of build errors in rax and wonder if that may be contributing (I haven't looked up tracebacks yet) | 21:16 |
| gmann | AJaeger: yes but in phase-2 when oslo drop the support. | 21:16 |
| openstackgerrit | Merged opendev/infra-specs master: Spec to retire static.openstack.org https://review.opendev.org/683852 | 21:16 |
| clarkb | mordred: uh ianw has https://review.opendev.org/#/c/691824/2 and you hae review-dev changes to review | 21:16 |
| ianw | clarkb: ummm, yes | 21:16 |
| mordred | clarkb: yes, yes I do - they | 21:16 |
| mordred | they're very exciting | 21:17 |
| AJaeger | gmann: but repos - lie neutron - don't build with py27 anymore. See 691973 | 21:17 |
| mordred | I anticipate you will be overcome with joy and excitement while reading them | 21:17 |
| fungi | and i'm back, full of burritos | 21:17 |
| fungi | (well, really just the one) | 21:17 |
| clarkb | I'm in the "do reviews" portion of my day post lunch and bike ride. I just need to get feeling back in my face and fingers after the bike ride | 21:17 |
| AJaeger | gmann: I mean https://review.opendev.org/#/c/686833/ removed from neutron py27 support, so running neutron with oslo master will now fail every single day... | 21:17 |
| *** smarcet has joined #openstack-infra | 21:17 | |
| ianw | https://nb02.openstack.org/ubuntu-bionic-0000046608.log | 21:18 |
| ianw | used qemu-img | 21:18 |
| AJaeger | clarkb: I'm done with pushing changes for now - will backport glance, nova etc once those are merged tomorrow. | 21:18 |
| clarkb | AJaeger: thank you! | 21:18 |
| mordred | fungi: I was sort of picturing a stream of burritos oozing from | 21:18 |
| fungi | AJaeger: gmann: i assume that just means it's time to drop those integration tests from running against oslo changes | 21:19 |
| mordred | fungi: so i'm disappointed to hear it's only the one | 21:19 |
| clarkb | ianw: maybwe we should test a manual boot of that image in rax? | 21:19 |
| fungi | mordred: one was plenty | 21:19 |
| ianw | Detailed error for node 8e24f43b-713d-4b22-85b0-f9e3ca4abab7: Exceeded maximum number of retries. Exceeded max scheduling attempts 3 for instance 8e24f43b-713d-4b22-85b0-f9e3ca4abab7. Last exception: ['SR_BACKEND_FAILURE_110', '', "VDI resize failed [opterr=Command ['/usr/bin/vhd-util', 'revert', '--debug', '-n', '/ | 21:19 |
| gmann | AJaeger: ohk, if that failing then we can remove i think. oslo has its own job of py2.7 till they drop it. so should be fine to drop these integration jobs | 21:19 |
| bnemec | Yeah, I think it's safe to remove those jobs. They only run on consumers of Oslo, not on Oslo itself. | 21:19 |
| AJaeger | fungi: exactly, that's what 691986 does. | 21:19 |
| gmann | fungi: yeah, agree | 21:19 |
| ianw | clarkb: hrm, i mean i did build and upload and boot an image manually, i wonder what is different in the automated pipeline :/ | 21:20 |
| AJaeger | fungi, gmann , then please review 691986 ;) Thanks! | 21:20 |
| fungi | already did after you mentioned it! | 21:20 |
| clarkb | ianw: possible it is just a timing thing? maybe the images boot more slowly then we hit our timeouts? I should load my ssh key and check for tracebacks to see | 21:20 |
| fungi | thanks for putting that together | 21:20 |
| AJaeger | thanks, fungi! | 21:20 |
| AJaeger | corvus: https://review.opendev.org/691966 (opendev/base-jobs) has two Zuul reports on one change. Is that correct? | 21:21 |
| ianw | clarkb: hrm, no i suspect it's the "vdi resize failed" thing :/ | 21:21 |
| ianw | https://discussions.citrix.com/topic/261769-resize-vdi-fails/ ... same error, nothing helpful | 21:22 |
| corvus | AJaeger: one might be from another tenant | 21:23 |
| AJaeger | corvus: yeah, that's what I expected - is that intented? | 21:24 |
| ianw | https://bugs.launchpad.net/nova/+bug/862653 ... this looks like it maybe | 21:24 |
| openstack | Launchpad bug 862653 in XCP "'VDI resize failed' errors on nova-compute (XenServer)" [Undecided,New] | 21:24 |
| clarkb | ianw: I seem to recall some vdi images are resizeable and others are not? mordred you may remember from your vhd util hacking? | 21:24 |
| ianw | "This is a vhd-util issue -- it checks the VHD image header for a specific creator code ... which may or may not be there depending on how you created the image." | 21:24 |
| AJaeger | config-core, a few small changes for review: https://review.opendev.org/691973 https://review.opendev.org/691140 and clarkb's https://review.opendev.org/690718 , please | 21:24 |
| corvus | AJaeger: honestly, i'm not sure we've entirely set out what we want to happen in that case | 21:25 |
| corvus | AJaeger: my guess is that whan did happen is that the first report says that the openstack tenant will break, and the second report says that the opendev tenant is fine with it | 21:25 |
| mordred | clarkb, ianw: it's possible *this* is why we weren't using qemu-img | 21:25 |
| AJaeger | corvus: yes, agree. If that is fine for now, all is good ;) Just wanted to be sure... | 21:26 |
| AJaeger | thanks, corvus | 21:26 |
| mordred | tbh - I find the vhd stuff super confusing because it wants to base a lot of thing on metadata written into the image | 21:26 |
| * AJaeger waves good night | 21:26 | |
| clarkb | as confirmation I've just double checked the whisper data for any new resource specific files and there are none under compute/ | 21:27 |
| clarkb | looking good that the bug was indeed fixed and we just needed to update | 21:27 |
| *** Goneri has quit IRC | 21:27 | |
| ianw | https://git.qemu.org/?p=qemu.git;a=blob;f=block/vpc.c;h=318e6d66fbf6d417bd018817d2f76ae84560e5f4;hb=fb9245c2610932d33ce14#l294 | 21:27 |
| ianw | i wonder if we can see the creator app change ... | 21:28 |
| mordred | clarkb: woot! | 21:29 |
| *** rfolco|off has quit IRC | 21:31 | |
| ianw | image header differences -> http://paste.openstack.org/show/785642/ | 21:33 |
| *** yamamoto has quit IRC | 21:33 | |
| ianw | https://github.com/xapi-project/blktap/blob/master/vhd/lib/vhd-util-resize.c#L1055 | 21:36 |
| ianw | if (!vhd_creator_tapdisk(&vhd)) ... error | 21:36 |
| ianw | note the old header has "tap" in there | 21:36 |
| clarkb | https://github.com/libyal/libvhdi/blob/master/documentation/Virtual%20Hard%20Disk%20(VHD)%20image%20format.asciidoc#2-footer is the format | 21:37 |
| clarkb | ianw: wow | 21:37 |
| ianw | maybe, somehow, the image i uploaded was not subject to resizing when i tried it? | 21:38 |
| mordred | oh - yeah - this is totally right | 21:39 |
| mordred | this is the weird thing - they care what tool made an image and base decisions on that | 21:40 |
| ianw | return !strncmp(ctx->footer.crtr_app, "tap", 3); | 21:41 |
| ianw | i wonder if we binary-edit s/qemu/tap/ | 21:41 |
| clarkb | who needs interoperable tools | 21:41 |
| clarkb | ianw: it would be really interesting to see if that owrks (like are their other binary level differences that actually matter?) | 21:41 |
| ianw | so the thing is, it seems to me that the entire blktap layers have been removed from xen? | 21:42 |
| ianw | https://xenbits.xen.org/gitweb/?p=xen.git;a=commit;h=5c883cf036cf5ab8b1b79390549e2475f7a568dd | 21:43 |
| clarkb | but vhd-util is still checking for it? | 21:44 |
| mordred | I think we should totally try the binary edit | 21:44 |
| ianw | well, rackspace's backend resizing whatever version "vhd-util" is checking the header of the image before resizing it, it would seem | 21:44 |
| *** prometheanfire has quit IRC | 21:44 | |
| mordred | rackspace uses forked tools | 21:45 |
| *** elod has quit IRC | 21:45 | |
| *** prometheanfire has joined #openstack-infra | 21:45 | |
| mordred | (which is saying - that even if it's removed from xen, that doesn't mean it's removed from rax) | 21:45 |
| ianw | is there any way to report this to anyone at rackspace who would have a vague chance of being able to do something about it? | 21:45 |
| ianw | (submitting a support request via the website seems like a highway to circular conversations about it ...) | 21:46 |
| ianw | let me make copies of the vhd's for a bit of testing | 21:46 |
| clarkb | cloudnull gave me a contact at rax I just have to figure out where that was written down | 21:46 |
| openstackgerrit | Merged zuul/zuul-jobs master: Adjust buildset registry container name https://review.opendev.org/690992 | 21:46 |
| openstackgerrit | Merged zuul/zuul-jobs master: Don't sudo when saving container logs in registry test https://review.opendev.org/690993 | 21:47 |
| openstackgerrit | Merged zuul/zuul-jobs master: Test buildset registry with k8s and docker https://review.opendev.org/689280 | 21:47 |
| *** elod has joined #openstack-infra | 21:47 | |
| *** slaweq has quit IRC | 21:52 | |
| *** elod has quit IRC | 21:54 | |
| *** elod has joined #openstack-infra | 21:56 | |
| *** weifan has quit IRC | 21:59 | |
| *** weifan has joined #openstack-infra | 22:01 | |
| *** rcernin has joined #openstack-infra | 22:02 | |
| *** goldyfruit___ has quit IRC | 22:04 | |
| *** mriedem has quit IRC | 22:06 | |
| ianw | i'm uploading an image now that i've hand-edited to have "tap" as the creator | 22:17 |
| ianw | ( /opt/rax-vhd/ on nb02) | 22:17 |
| ianw | the original vhd i tested with was nb01:/home/ianw/test.vhd ... which has qemu headers ... i've cleared that out, maybe i did something wrong in testing :/ | 22:18 |
| mordred | ianw: I'll be fascinated by the outcome | 22:21 |
| *** gyee has quit IRC | 22:27 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Revert "Drop vhdutil dependency, use qemu-img" https://review.opendev.org/691998 | 22:29 |
| *** weifan has quit IRC | 22:30 | |
| *** aedc has quit IRC | 22:30 | |
| *** weifan has joined #openstack-infra | 22:31 | |
| *** aedc has joined #openstack-infra | 22:33 | |
| clarkb | mordred: left some thoughts on https://review.opendev.org/#/c/630406/69 I don't know that any are worth a -1 at this point | 22:34 |
| clarkb | but I think at least a few of them should be addressed (like the zuul.yaml files listing and the docker compose image version) | 22:34 |
| *** goldyfruit___ has joined #openstack-infra | 22:35 | |
| *** weifan has quit IRC | 22:35 | |
| mordred | clarkb: yeah - those are all great. I'll push up a followup | 22:41 |
| corvus | i agree with your comments, though i think that the image version can be a followup when we're serious about prod. the files listing is maybe a -1 but also could be a followup since the job is running on that change. | 22:41 |
| clarkb | ya I think followup works | 22:42 |
| clarkb | wanted to make sure they were seen though | 22:42 |
| mordred | I replied about the init thing ... | 22:42 |
| clarkb | I guess we can't preinit and ship that with the image because of all the mounted external state | 22:44 |
| corvus | what i like about the current thing is that it's a clear step in the playbook which means it's easy to tie into ops. what i don't like is that it splits the "container config" between the playbook and the compose file. | 22:44 |
| clarkb | mordred: if we did your todo of pushing some of that into the image would we be able to init at build time? | 22:44 |
| *** smarcet has quit IRC | 22:47 | |
| *** weifan has joined #openstack-infra | 22:47 | |
| mordred | clarkb: no, I don't think so - because I think init also does schema migrations | 22:47 |
| clarkb | oh right | 22:47 |
| mordred | corvus: yeah | 22:47 |
| *** weifan has quit IRC | 22:49 | |
| mordred | corvus: it would be nicer, I think, if compose had the init-container concept | 22:49 |
| *** slaweq has joined #openstack-infra | 22:50 | |
| clarkb | you can do non persistent containers that have to run prior to other containers | 22:51 |
| clarkb | I think zuul quickstart may do this? | 22:51 |
| corvus | but they don't have to complete | 22:51 |
| corvus | that's the missing piece | 22:51 |
| clarkb | oh | 22:51 |
| corvus | we do express those deps in quickstart, but it's mostly just a scheduling hint really. the real dependencies are all handled by waiting for services to come up. | 22:52 |
| *** weifan has joined #openstack-infra | 22:52 | |
| *** weifan has quit IRC | 22:52 | |
| *** gyee has joined #openstack-infra | 22:52 | |
| *** weifan has joined #openstack-infra | 22:53 | |
| *** weifan has quit IRC | 22:53 | |
| *** weifan has joined #openstack-infra | 22:53 | |
| clarkb | https://github.com/docker/compose/issues/5007#issuecomment-316530890 | 22:54 |
| *** slaweq has quit IRC | 22:54 | |
| mordred | "rewrite your app" | 22:55 |
| clarkb | in go | 22:55 |
| ianw | "message": "Image cannot be imported. Error code: '396'" | 22:55 |
| clarkb | ianw: that is after changing the header bits? | 22:56 |
| clarkb | there must be some checksum or other binary verification | 22:56 |
| ianw | good point, it probably changes the overall checksum | 22:56 |
| ianw | i think we need to revert, but at least we have the smoking gun to see if we can get any traction with rackspace | 22:57 |
| corvus | mordred, clarkb: is that "docker-compose run service" idea workable for this case? | 22:57 |
| clarkb | corvus: we need ti to run with a different cmd which is what I think the existing code does? | 22:58 |
| clarkb | corvus: the only difference would be encoding that into a compose file (which may need to be a separate file?) | 22:58 |
| mordred | ooh - but yeah | 22:58 |
| mordred | podman-compose uses the file | 22:58 |
| clarkb | I guess that would be worthwhile to split the config | 22:58 |
| clarkb | from ansible and compose | 22:58 |
| mordred | so we don't have to have the image and volume list duplicated | 22:58 |
| mordred | well | 23:01 |
| mordred | except podman-compose run is broken | 23:01 |
| *** tkajinam has joined #openstack-infra | 23:08 | |
| *** diablo_rojo has quit IRC | 23:10 | |
| *** diablo_rojo has joined #openstack-infra | 23:11 | |
| *** mattw4 has quit IRC | 23:20 | |
| *** mattw4 has joined #openstack-infra | 23:20 | |
| *** mattw4 has quit IRC | 23:27 | |
| *** Goneri has joined #openstack-infra | 23:29 | |
| *** yamamoto has joined #openstack-infra | 23:31 | |
| ianw | mordred: do you think the "fixed" subformat might stop rax trying to resize the image? | 23:37 |
| clarkb | if we do that are we stuck producing 80GB images? | 23:37 |
| clarkb | (or whatever the root disk size in rax is) | 23:37 |
| ianw | but if it's also compressed, the blank bits should be minimal? | 23:38 |
| clarkb | I don't think it is compressed | 23:38 |
| *** Goneri has quit IRC | 23:38 | |
| *** jamesmcarthur has joined #openstack-infra | 23:38 | |
| clarkb | our vhd images are roughly the same size as raw images | 23:38 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through secure.config contents https://review.opendev.org/691800 | 23:41 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Clean up review comments https://review.opendev.org/692003 | 23:41 |
| mordred | clarkb: ^^ there's the review comments patch - I stuck it at the end of the stack | 23:41 |
| clarkb | mordred: zuul is unhappy with it (I left a note about why | 23:45 |
| *** weifan has quit IRC | 23:45 | |
| mordred | clarkb: whoops | 23:45 |
| *** goldyfruit___ has quit IRC | 23:45 | |
| *** jamesmcarthur has quit IRC | 23:46 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Clean up review comments https://review.opendev.org/692003 | 23:46 |
| *** goldyfruit___ has joined #openstack-infra | 23:48 | |
| *** tkajinam has quit IRC | 23:48 | |
| *** weifan has joined #openstack-infra | 23:53 | |
| *** weifan has quit IRC | 23:53 | |
| *** gyee has quit IRC | 23:54 | |
| *** yamamoto has quit IRC | 23:57 | |
| *** jamesmcarthur has joined #openstack-infra | 23:58 | |
| *** dchen has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!