| *** danpawlik has joined #openstack-infra | 00:00 | |
| tonyb | clarkb: Oh and the test in shade can Depend-On the ansible/ansible PR cool. | 00:01 |
|---|---|---|
| clarkb | yup | 00:01 |
| *** dhill_ has joined #openstack-infra | 00:01 | |
| tonyb | okay so step 1 add the feature to shade | 00:01 |
| *** wolverineav has quit IRC | 00:02 | |
| *** slaweq has quit IRC | 00:02 | |
| * tonyb wonders if it's too late for 2.5 ... I guess we'll see | 00:03 | |
| *** wolverineav has joined #openstack-infra | 00:04 | |
| *** ihrachys_ has quit IRC | 00:04 | |
| *** ihrachys has joined #openstack-infra | 00:04 | |
| *** danpawlik has quit IRC | 00:05 | |
| *** mriedem has quit IRC | 00:05 | |
| *** bobh has quit IRC | 00:05 | |
| *** slaweq has joined #openstack-infra | 00:08 | |
| *** slaweq has quit IRC | 00:12 | |
| *** wolverineav has quit IRC | 00:17 | |
| *** dhill_ has quit IRC | 00:17 | |
| mordred | tonyb: I think it's too late for 2.5 - but depending on the size of the pr maybe we can sell someone on squeezing it in | 00:17 |
| *** slaweq has joined #openstack-infra | 00:18 | |
| *** wolverineav has joined #openstack-infra | 00:18 | |
| mordred | tonyb: but we can get you taken care of in shade-land real quick like | 00:18 |
| tonyb | mordred: Okay I figured 2.5 would be a strectch once the PR exists I'll let you know so I can advocate for it if appropriate | 00:19 |
| mordred | tonyb: yah - ping me in any case - I'm core on those modules too, but I lose track of them | 00:19 |
| mordred | clarkb: https://review.openstack.org/#/c/549608/9/manifests/web.pp@142 <-- the file requires - I thought puppet auto-required nested directories with magic? | 00:19 |
| tonyb | mordred: Thanks will do. Once the shade review passes CI I'll let you knwo but I really am askign for a friend :) | 00:20 |
| clarkb | mordred: I want to say it doesn't but that it may work as is because newer puppet ordres resources implicitly in the order they are defined in the file | 00:20 |
| tonyb | well he'll do the shade part I'll do the ansible PR | 00:20 |
| *** dingyichen has joined #openstack-infra | 00:21 | |
| *** dingyichen has joined #openstack-infra | 00:22 | |
| *** slaweq has quit IRC | 00:22 | |
| *** wolverineav has quit IRC | 00:22 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack https://review.openstack.org/549608 | 00:23 |
| *** wolverineav has joined #openstack-infra | 00:23 | |
| mordred | clarkb: kk. updated ^^ | 00:23 |
| *** gyee has quit IRC | 00:23 | |
| mordred | clarkb: I also replied on the archive thing - the copied that pattern from puppet-storyboard, so I think i'd rather keep it as is and then if we wanna change, make sure we do it in both | 00:23 |
| mordred | ianw: if'n you're around still - updated ^^ patch from clarkb review | 00:24 |
| *** tosky has quit IRC | 00:25 | |
| mordred | tonyb: your friend's patch looks great | 00:26 |
| tonyb | mordred: :) | 00:26 |
| *** slaweq has joined #openstack-infra | 00:28 | |
| *** slaweq has quit IRC | 00:33 | |
| *** danpawlik has joined #openstack-infra | 00:36 | |
| *** dingyichen has quit IRC | 00:37 | |
| *** dingyichen has joined #openstack-infra | 00:38 | |
| *** fifilip has quit IRC | 00:38 | |
| *** slaweq has joined #openstack-infra | 00:38 | |
| *** lbragstad has quit IRC | 00:39 | |
| *** wolverineav has quit IRC | 00:41 | |
| *** danpawlik has quit IRC | 00:41 | |
| *** wolverineav has joined #openstack-infra | 00:41 | |
| *** slaweq has quit IRC | 00:42 | |
| *** dingyichen has quit IRC | 00:43 | |
| *** gongysh has joined #openstack-infra | 00:44 | |
| *** e0ne has quit IRC | 00:44 | |
| *** zhurong has joined #openstack-infra | 00:45 | |
| *** wolverineav has quit IRC | 00:46 | |
| *** dingyichen has joined #openstack-infra | 00:47 | |
| *** dingyichen has quit IRC | 00:48 | |
| *** gongysh has quit IRC | 00:48 | |
| *** slaweq has joined #openstack-infra | 00:48 | |
| clarkb | pabelanger: looking at pypi I don't think the glean release you wanted to do happened? | 00:49 |
| clarkb | pabelanger: looks like we need a 1.10.3 as its only a bug fix on top of 1.10.2? | 00:49 |
| clarkb | I can help with that. Probably bad idea to do one at this point in th day but tomorrow morning | 00:50 |
| *** dingyichen has joined #openstack-infra | 00:52 | |
| *** slaweq has quit IRC | 00:53 | |
| *** david-lyle has quit IRC | 00:53 | |
| *** zerick has quit IRC | 00:56 | |
| *** zerick_ has joined #openstack-infra | 00:56 | |
| ianw | arggh, ubuntu-ports mirror failed at last steps with afs issues i think | 00:56 |
| *** david-lyle has joined #openstack-infra | 00:56 | |
| *** VW has joined #openstack-infra | 00:58 | |
| *** slaweq has joined #openstack-infra | 00:59 | |
| *** jamesmcarthur has joined #openstack-infra | 01:01 | |
| *** camunoz has quit IRC | 01:01 | |
| *** dingyichen has joined #openstack-infra | 01:02 | |
| *** notmyname has quit IRC | 01:02 | |
| *** dingyichen has quit IRC | 01:02 | |
| *** slaweq has quit IRC | 01:03 | |
| *** spiffxp has joined #openstack-infra | 01:03 | |
| *** notmyname has joined #openstack-infra | 01:03 | |
| *** vipul has joined #openstack-infra | 01:04 | |
| *** aviau has quit IRC | 01:05 | |
| *** aviau has joined #openstack-infra | 01:06 | |
| *** jamesmcarthur has quit IRC | 01:06 | |
| *** dingyichen has joined #openstack-infra | 01:07 | |
| *** gongysh has joined #openstack-infra | 01:08 | |
| *** dingyichen has quit IRC | 01:08 | |
| *** slaweq has joined #openstack-infra | 01:09 | |
| *** VW has quit IRC | 01:10 | |
| *** VW has joined #openstack-infra | 01:11 | |
| *** zhurong has quit IRC | 01:11 | |
| *** slaweq has quit IRC | 01:13 | |
| *** danpawlik has joined #openstack-infra | 01:15 | |
| *** VW has quit IRC | 01:15 | |
| *** dingyichen has joined #openstack-infra | 01:18 | |
| *** dingyichen has quit IRC | 01:18 | |
| *** slaweq has joined #openstack-infra | 01:19 | |
| *** danpawlik has quit IRC | 01:19 | |
| *** eernst has quit IRC | 01:20 | |
| *** dingyichen has joined #openstack-infra | 01:20 | |
| *** dingyichen has quit IRC | 01:21 | |
| *** wolverineav has joined #openstack-infra | 01:22 | |
| *** slaweq has quit IRC | 01:23 | |
| *** wolverin_ has joined #openstack-infra | 01:26 | |
| *** wolverineav has quit IRC | 01:26 | |
| *** s-shiono has joined #openstack-infra | 01:27 | |
| *** slaweq has joined #openstack-infra | 01:29 | |
| *** dingyichen has joined #openstack-infra | 01:34 | |
| *** slaweq has quit IRC | 01:34 | |
| *** dingyichen has quit IRC | 01:35 | |
| *** dingyichen has joined #openstack-infra | 01:35 | |
| *** dingyichen has quit IRC | 01:37 | |
| *** wolverin_ has quit IRC | 01:38 | |
| *** slaweq has joined #openstack-infra | 01:39 | |
| *** dingyichen has joined #openstack-infra | 01:41 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Make the build reproducible https://review.openstack.org/549646 | 01:44 |
| *** slaweq has quit IRC | 01:44 | |
| *** zhurong has joined #openstack-infra | 01:46 | |
| *** wolverineav has joined #openstack-infra | 01:47 | |
| gmann_ | corvus: AJaeger: andreaf: gibi: I sent the summary of 'job template vs irellevant_files' PTG discussion on ML - http://lists.openstack.org/pipermail/openstack-dev/2018-March/128029.html | 01:47 |
| clarkb | gmann_: thank you! | 01:48 |
| gmann_ | corvus: AJaeger: andreaf: gibi: we need to select the workaround till we get the best approach/solution | 01:48 |
| gmann_ | clarkb: 3 options are there as workaround as of now. | 01:49 |
| *** slaweq has joined #openstack-infra | 01:49 | |
| *** danpawlik has joined #openstack-infra | 01:50 | |
| *** jamesmcarthur has joined #openstack-infra | 01:51 | |
| *** annp has joined #openstack-infra | 01:51 | |
| *** gongysh has quit IRC | 01:52 | |
| *** daidv_ has joined #openstack-infra | 01:53 | |
| *** slaweq has quit IRC | 01:54 | |
| *** namnh has joined #openstack-infra | 01:54 | |
| *** danpawlik has quit IRC | 01:55 | |
| *** udesale has joined #openstack-infra | 01:56 | |
| *** david-lyle has quit IRC | 01:57 | |
| *** jamesmcarthur has quit IRC | 01:57 | |
| *** udesale_ has joined #openstack-infra | 02:00 | |
| *** slaweq has joined #openstack-infra | 02:00 | |
| pabelanger | clarkb: yah, never tagged it at PTG but we can now if people want | 02:01 |
| pabelanger | yah, 1.10.3 is fine | 02:01 |
| clarkb | pabelanger: I'm just following up on my notes from last week and that was on there | 02:01 |
| clarkb | pabelanger: happy to help but won't do it tonight because if tonight is like last night I will be asleep sortly | 02:01 |
| pabelanger | ++ | 02:01 |
| *** udesale has quit IRC | 02:02 | |
| *** imacdonn has quit IRC | 02:03 | |
| *** wolverineav has quit IRC | 02:03 | |
| *** imacdonn has joined #openstack-infra | 02:03 | |
| *** wolverineav has joined #openstack-infra | 02:04 | |
| *** slaweq has quit IRC | 02:04 | |
| *** rloo has quit IRC | 02:06 | |
| *** wolverineav has quit IRC | 02:08 | |
| *** slaweq has joined #openstack-infra | 02:10 | |
| *** slaweq has quit IRC | 02:15 | |
| *** daidv_ has quit IRC | 02:18 | |
| *** wolverineav has joined #openstack-infra | 02:22 | |
| *** dingyichen has quit IRC | 02:24 | |
| *** dingyichen has joined #openstack-infra | 02:25 | |
| *** liuyulong has joined #openstack-infra | 02:27 | |
| *** danpawlik has joined #openstack-infra | 02:27 | |
| *** wolverineav has quit IRC | 02:27 | |
| *** olaph1 has joined #openstack-infra | 02:29 | |
| *** slaweq has joined #openstack-infra | 02:31 | |
| *** olaph has quit IRC | 02:31 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/549529 | 02:32 |
| *** danpawlik has quit IRC | 02:32 | |
| *** salv-orl_ has joined #openstack-infra | 02:34 | |
| *** slaweq has quit IRC | 02:35 | |
| *** salv-orlando has quit IRC | 02:37 | |
| *** slaweq has joined #openstack-infra | 02:38 | |
| *** slaweq_ has joined #openstack-infra | 02:41 | |
| *** jamesdenton has joined #openstack-infra | 02:42 | |
| *** slaweq has quit IRC | 02:42 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Rename get_schema to getSchema https://review.openstack.org/550670 | 02:44 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Extend config API with getSupportedLabels() https://review.openstack.org/550671 | 02:44 |
| *** slaweq_ has quit IRC | 02:46 | |
| *** harlowja has quit IRC | 02:49 | |
| smcginnis | dhellmann: The switch of the deliverable stuff to objects appears to have broken reading and writing deliverable files in some cases. | 02:49 |
| smcginnis | dhellmann: It blows up trying to convert the objects to yaml. | 02:50 |
| *** slaweq has joined #openstack-infra | 02:51 | |
| *** slaweq has quit IRC | 02:55 | |
| *** nicolasbock has quit IRC | 02:57 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Store label info with launcher registration https://review.openstack.org/548376 | 03:01 |
| *** slaweq has joined #openstack-infra | 03:02 | |
| *** agopi has joined #openstack-infra | 03:03 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings master: Replaces yaml.load() with yaml.safe_load() https://review.openstack.org/543839 | 03:04 |
| *** tojuvone has joined #openstack-infra | 03:05 | |
| *** tojuvone has left #openstack-infra | 03:05 | |
| *** slaweq has quit IRC | 03:06 | |
| *** danpawlik has joined #openstack-infra | 03:06 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Remove Craton team meeting https://review.openstack.org/550067 | 03:07 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Remove Interop Challenge meeting https://review.openstack.org/550066 | 03:07 |
| *** hongbin has joined #openstack-infra | 03:09 | |
| *** danpawlik has quit IRC | 03:10 | |
| *** slaweq has joined #openstack-infra | 03:12 | |
| *** slaweq has quit IRC | 03:16 | |
| *** andreas_s has joined #openstack-infra | 03:19 | |
| *** andreas_s has quit IRC | 03:23 | |
| *** auristor has quit IRC | 03:30 | |
| *** udesale_ has quit IRC | 03:31 | |
| *** olaph has joined #openstack-infra | 03:31 | |
| *** slaweq has joined #openstack-infra | 03:32 | |
| *** olaph1 has quit IRC | 03:32 | |
| *** germs has quit IRC | 03:32 | |
| *** germs has joined #openstack-infra | 03:33 | |
| *** germs has quit IRC | 03:33 | |
| *** germs has joined #openstack-infra | 03:33 | |
| *** slaweq has quit IRC | 03:36 | |
| *** danpawlik has joined #openstack-infra | 03:41 | |
| *** slaweq has joined #openstack-infra | 03:42 | |
| *** auristor has joined #openstack-infra | 03:43 | |
| *** danpawlik has quit IRC | 03:47 | |
| *** slaweq has quit IRC | 03:47 | |
| *** slaweq has joined #openstack-infra | 03:52 | |
| *** slaweq has quit IRC | 03:57 | |
| *** eernst has joined #openstack-infra | 03:58 | |
| *** slaweq has joined #openstack-infra | 04:03 | |
| *** rlandy|bbl is now known as rlandy | 04:03 | |
| *** eernst has quit IRC | 04:05 | |
| *** slaweq has quit IRC | 04:07 | |
| *** psachin has joined #openstack-infra | 04:12 | |
| *** slaweq has joined #openstack-infra | 04:13 | |
| *** danpawlik has joined #openstack-infra | 04:14 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add NO_TIMEOUT flag for reprepro https://review.openstack.org/550683 | 04:17 |
| *** slaweq has quit IRC | 04:17 | |
| auristor | ianw: what logging do you have from these afs failures/ | 04:18 |
| *** danpawlik has quit IRC | 04:19 | |
| *** bobh has joined #openstack-infra | 04:19 | |
| *** slaweq has joined #openstack-infra | 04:23 | |
| *** bobh has quit IRC | 04:25 | |
| *** dave-mccowan has quit IRC | 04:26 | |
| *** slaweq has quit IRC | 04:27 | |
| ianw | auristor: sorry not enough to be helpful. just client failures. possibly in US time pabelanger might be able to dig into server logs to see if anything helpful | 04:28 |
| auristor | is the timeout a fileserver timeout or a volserver timeout? | 04:29 |
| ianw | auristor: it's stuff like | 04:30 |
| ianw | Mar 8 00:32:03 mirror-update kernel: [1208283.784551] afs: Lost contact with file server 104.130.138.161 in cell openstack.org (code -512) (all multi-homed ip addresses down for the server) | 04:30 |
| ianw | Mar 8 00:32:03 mirror-update kernel: [1208284.183767] afs: failed to store file (110) | 04:30 |
| ianw | which is probably due to legitimate transport errors outside of our control | 04:31 |
| auristor | code -512 is -ERESTARTSYS | 04:31 |
| auristor | its a client side bug in the openafs linux client | 04:31 |
| *** zhurong has quit IRC | 04:32 | |
| auristor | basically, the openafs client doesn't know how to handle signals interrupting its operations | 04:32 |
| *** slaweq has joined #openstack-infra | 04:33 | |
| ianw | is there anything to be done about it? | 04:35 |
| ianw | pabelanger: ^ | 04:35 |
| auristor | the failed to store file (110) is a VBUSY error. The volume was in use by the volserver | 04:35 |
| *** harlowja has joined #openstack-infra | 04:37 | |
| *** edmondsw has joined #openstack-infra | 04:37 | |
| *** edmondsw has quit IRC | 04:37 | |
| ianw | pabelanger / persia: I thought the repo sync was complete, but -> http://paste.openstack.org/show/694479/ | 04:37 |
| *** dhajare has joined #openstack-infra | 04:37 | |
| *** slaweq has quit IRC | 04:38 | |
| ianw | i don't know what happened. i've rerun it again in a screen and see what happens. | 04:38 |
| ianw | i'm mostly afk for the next few days | 04:38 |
| *** jappleii__ has joined #openstack-infra | 04:42 | |
| *** jappleii__ has quit IRC | 04:43 | |
| *** slaweq has joined #openstack-infra | 04:43 | |
| *** danpawlik has joined #openstack-infra | 04:44 | |
| *** threestrands_ has quit IRC | 04:44 | |
| *** udesale_ has joined #openstack-infra | 04:45 | |
| *** hongbin has quit IRC | 04:46 | |
| *** slaweq has quit IRC | 04:48 | |
| *** danpawlik has quit IRC | 04:49 | |
| auristor | what openafs version is the client/. | 04:50 |
| *** pgadiya has joined #openstack-infra | 04:51 | |
| *** janki has joined #openstack-infra | 04:51 | |
| auristor | is it 1.6.18 or newer? | 04:52 |
| auristor | there is a partial fix for -ERESTARTSYS errors in 1.6.18 | 04:53 |
| *** slaweq has joined #openstack-infra | 04:53 | |
| *** _ari_ has quit IRC | 04:57 | |
| *** rnoriega has quit IRC | 04:58 | |
| *** weshay|PTO has quit IRC | 04:58 | |
| *** pabelanger has quit IRC | 04:58 | |
| *** slaweq has quit IRC | 04:58 | |
| *** haleyb has quit IRC | 04:59 | |
| *** otherwiseguy has quit IRC | 04:59 | |
| *** myoung|off has quit IRC | 04:59 | |
| *** links has joined #openstack-infra | 04:59 | |
| *** links has quit IRC | 04:59 | |
| *** threestrands has joined #openstack-infra | 05:00 | |
| auristor | Looks like OpenAFS 1.6.7-1ubuntu1.1-debian built 2018-02-23 | 05:01 |
| auristor | I have no idea what backports might have been applied to the ubuntu 1.6.7 distribution | 05:01 |
| *** gcb has joined #openstack-infra | 05:02 | |
| *** jaosorior has quit IRC | 05:02 | |
| *** slaweq has joined #openstack-infra | 05:04 | |
| auristor | as far as I can tell from http://changelogs.ubuntu.com/changelogs/pool/universe/o/openafs/openafs_1.6.7-1ubuntu1.1/changelog only security updates have been applied by ubuntu. | 05:06 |
| *** slaweq has quit IRC | 05:08 | |
| auristor | possible options. build from upstream or use a non-openafs client that properly handles signals. | 05:08 |
| *** slaweq has joined #openstack-infra | 05:14 | |
| *** links has joined #openstack-infra | 05:16 | |
| *** slaweq has quit IRC | 05:19 | |
| *** danpawlik has joined #openstack-infra | 05:22 | |
| *** slaweq has joined #openstack-infra | 05:24 | |
| *** threestrands has quit IRC | 05:25 | |
| *** danpawlik has quit IRC | 05:27 | |
| *** slaweq has quit IRC | 05:28 | |
| *** slaweq has joined #openstack-infra | 05:34 | |
| *** slaweq has quit IRC | 05:39 | |
| *** ramishra has joined #openstack-infra | 05:39 | |
| *** janki has quit IRC | 05:42 | |
| *** slaweq has joined #openstack-infra | 05:44 | |
| *** claudiub has joined #openstack-infra | 05:46 | |
| *** slaweq has quit IRC | 05:49 | |
| *** wolverineav has joined #openstack-infra | 05:50 | |
| *** snapiri has joined #openstack-infra | 05:51 | |
| *** slaweq has joined #openstack-infra | 05:55 | |
| *** cshastri has joined #openstack-infra | 05:56 | |
| *** pcaruana has joined #openstack-infra | 05:57 | |
| *** aeng has quit IRC | 05:58 | |
| *** slaweq has quit IRC | 05:59 | |
| *** danpawlik has joined #openstack-infra | 06:01 | |
| *** masber has joined #openstack-infra | 06:03 | |
| *** slaweq has joined #openstack-infra | 06:05 | |
| *** harlowja has quit IRC | 06:05 | |
| *** danpawlik has quit IRC | 06:06 | |
| *** pcaruana has quit IRC | 06:08 | |
| *** slaweq has quit IRC | 06:09 | |
| *** david-lyle has joined #openstack-infra | 06:09 | |
| *** janki has joined #openstack-infra | 06:10 | |
| *** dhajare_ has joined #openstack-infra | 06:12 | |
| *** slaweq has joined #openstack-infra | 06:15 | |
| *** dhajare has quit IRC | 06:16 | |
| *** dhajare_ has quit IRC | 06:17 | |
| *** germs has quit IRC | 06:17 | |
| *** zhurong has joined #openstack-infra | 06:18 | |
| *** slaweq has quit IRC | 06:19 | |
| *** germs has joined #openstack-infra | 06:22 | |
| *** wolverineav has quit IRC | 06:23 | |
| *** dims has quit IRC | 06:24 | |
| *** slaweq has joined #openstack-infra | 06:25 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add queue size to tenant overview https://review.openstack.org/548248 | 06:27 |
| *** slaweq has quit IRC | 06:30 | |
| *** dims has joined #openstack-infra | 06:30 | |
| *** danpawlik has joined #openstack-infra | 06:33 | |
| *** germs has quit IRC | 06:33 | |
| *** slaweq has joined #openstack-infra | 06:35 | |
| *** danpawlik has quit IRC | 06:37 | |
| *** slaweq has quit IRC | 06:40 | |
| *** jamesdenton has quit IRC | 06:44 | |
| *** slaweq has joined #openstack-infra | 06:45 | |
| *** kjackal has joined #openstack-infra | 06:50 | |
| *** slaweq has quit IRC | 06:50 | |
| *** ykarel has joined #openstack-infra | 06:51 | |
| *** masber has quit IRC | 06:55 | |
| *** slaweq has joined #openstack-infra | 06:56 | |
| *** eumel8_ has joined #openstack-infra | 06:57 | |
| *** slaweq has quit IRC | 07:00 | |
| *** olaph has quit IRC | 07:01 | |
| *** olaph1 has joined #openstack-infra | 07:01 | |
| *** eumel8_ has quit IRC | 07:01 | |
| *** kjackal has quit IRC | 07:02 | |
| *** kjackal has joined #openstack-infra | 07:02 | |
| AJaeger | dhellmann: looking at https://review.openstack.org/#/c/550603/ - it looks there'S nothing repo specific in it. You could define the job in openstack-zuul-jobs and add the jobs to project-config as well. Makes it easier to change it for 300 versions... | 07:03 |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix for rhel7 iso image creation. https://review.openstack.org/548585 | 07:05 |
| openstackgerrit | Merged openstack/diskimage-builder master: secondary architectures use different url https://review.openstack.org/549037 | 07:05 |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix for passing user defined value for satellite cert for rhel-common. https://review.openstack.org/547255 | 07:05 |
| *** slaweq has joined #openstack-infra | 07:06 | |
| *** danpawlik has joined #openstack-infra | 07:09 | |
| *** tedlit has joined #openstack-infra | 07:10 | |
| *** slaweq has quit IRC | 07:11 | |
| *** Douhet has quit IRC | 07:12 | |
| *** Douhet has joined #openstack-infra | 07:13 | |
| *** danpawlik has quit IRC | 07:14 | |
| *** gus has quit IRC | 07:14 | |
| *** gus has joined #openstack-infra | 07:15 | |
| *** slaweq has joined #openstack-infra | 07:16 | |
| *** gongysh has joined #openstack-infra | 07:19 | |
| *** slaweq has quit IRC | 07:21 | |
| *** rcernin has quit IRC | 07:22 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Drop kingbird, networking-hpe and trio2o from g-r sync https://review.openstack.org/550415 | 07:22 |
| *** masber has joined #openstack-infra | 07:23 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix console stream colors https://review.openstack.org/550730 | 07:26 |
| AJaeger | dirk: already in the office? | 07:26 |
| *** slaweq has joined #openstack-infra | 07:26 | |
| *** agopi has quit IRC | 07:28 | |
| *** slaweq has quit IRC | 07:30 | |
| *** jlabarre has quit IRC | 07:31 | |
| *** jlabarre has joined #openstack-infra | 07:31 | |
| *** florianf has joined #openstack-infra | 07:33 | |
| *** ramishra has quit IRC | 07:33 | |
| *** kjackal has quit IRC | 07:34 | |
| *** kjackal has joined #openstack-infra | 07:35 | |
| *** ramishra has joined #openstack-infra | 07:35 | |
| *** slaweq has joined #openstack-infra | 07:36 | |
| *** tedlit has quit IRC | 07:38 | |
| *** danpawlik has joined #openstack-infra | 07:40 | |
| *** ykarel has quit IRC | 07:40 | |
| *** slaweq has quit IRC | 07:41 | |
| *** andreas_s has joined #openstack-infra | 07:43 | |
| *** danpawlik has quit IRC | 07:44 | |
| *** slaweq has joined #openstack-infra | 07:47 | |
| *** hashar has joined #openstack-infra | 07:47 | |
| *** slaweq has quit IRC | 07:52 | |
| openstackgerrit | Daniel Lublin proposed openstack-infra/git-review master: Allow choosing which field to use as author when naming branch https://review.openstack.org/444574 | 07:52 |
| *** armaan has quit IRC | 07:56 | |
| *** armaan has joined #openstack-infra | 07:56 | |
| *** slaweq has joined #openstack-infra | 07:57 | |
| *** lpetrut has joined #openstack-infra | 08:02 | |
| *** dingyichen has quit IRC | 08:03 | |
| *** pcaruana has joined #openstack-infra | 08:04 | |
| *** slaweq_ has joined #openstack-infra | 08:07 | |
| dirk | AJaeger: in a few minutes yes | 08:10 |
| *** danpawlik has joined #openstack-infra | 08:11 | |
| *** slaweq_ has quit IRC | 08:12 | |
| *** jtomasek has joined #openstack-infra | 08:17 | |
| *** jtomasek has quit IRC | 08:17 | |
| *** namnh has quit IRC | 08:17 | |
| *** jtomasek has joined #openstack-infra | 08:17 | |
| *** slaweq_ has joined #openstack-infra | 08:17 | |
| *** danpawlik has quit IRC | 08:20 | |
| *** slaweq_ has quit IRC | 08:22 | |
| AJaeger | dirk: can we quickly chat about the g-r changes? Seems there's some communication problem between us... | 08:25 |
| *** dbecker has joined #openstack-infra | 08:25 | |
| dirk | AJaeger: sure. meet at the coffee machine? :) | 08:26 |
| AJaeger | on my way... | 08:26 |
| *** slaweq_ has joined #openstack-infra | 08:27 | |
| *** ralonsoh has joined #openstack-infra | 08:28 | |
| *** slaweq_ has quit IRC | 08:32 | |
| *** yamamoto has quit IRC | 08:33 | |
| *** tesseract has joined #openstack-infra | 08:36 | |
| *** florianf has quit IRC | 08:37 | |
| *** slaweq_ has joined #openstack-infra | 08:38 | |
| *** tedlit has joined #openstack-infra | 08:38 | |
| *** florianf has joined #openstack-infra | 08:38 | |
| *** gongysh has quit IRC | 08:39 | |
| *** tedlit has quit IRC | 08:40 | |
| *** cshastri_ has joined #openstack-infra | 08:41 | |
| *** cshastri has quit IRC | 08:41 | |
| *** dbecker has quit IRC | 08:41 | |
| *** yamamoto has joined #openstack-infra | 08:42 | |
| *** amoralej|off is now known as amoralej | 08:42 | |
| *** slaweq_ has quit IRC | 08:42 | |
| *** pcaruana has quit IRC | 08:43 | |
| *** dtantsur|afk has quit IRC | 08:43 | |
| *** adarazs has quit IRC | 08:43 | |
| *** tesseract has quit IRC | 08:43 | |
| *** danpawlik has joined #openstack-infra | 08:47 | |
| *** slaweq_ has joined #openstack-infra | 08:48 | |
| *** mgoddard_ has joined #openstack-infra | 08:49 | |
| *** gongysh has joined #openstack-infra | 08:49 | |
| *** jtomasek has quit IRC | 08:49 | |
| *** yamamoto has quit IRC | 08:50 | |
| *** jtomasek has joined #openstack-infra | 08:50 | |
| *** dtantsur has joined #openstack-infra | 08:50 | |
| *** adarazs has joined #openstack-infra | 08:51 | |
| *** pcaruana has joined #openstack-infra | 08:52 | |
| *** tesseract has joined #openstack-infra | 08:52 | |
| *** slaweq_ has quit IRC | 08:52 | |
| *** jpich has joined #openstack-infra | 08:54 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove converted cl-openstack-client job https://review.openstack.org/550755 | 08:57 |
| *** yamamoto has joined #openstack-infra | 08:57 | |
| *** slaweq_ has joined #openstack-infra | 08:58 | |
| *** yamamoto has quit IRC | 08:58 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove cl-openstack-client job https://review.openstack.org/550756 | 08:59 |
| *** yamamoto has joined #openstack-infra | 09:00 | |
| gibi | gmann_: thanks | 09:00 |
| *** adarazs has quit IRC | 09:01 | |
| *** dtantsur has quit IRC | 09:01 | |
| *** pcaruana has quit IRC | 09:02 | |
| *** tesseract has quit IRC | 09:02 | |
| *** slaweq_ has quit IRC | 09:03 | |
| *** shardy has joined #openstack-infra | 09:03 | |
| *** owalsh_ has quit IRC | 09:03 | |
| *** zhenguo has joined #openstack-infra | 09:05 | |
| *** yamamoto has quit IRC | 09:05 | |
| *** dtantsur has joined #openstack-infra | 09:06 | |
| *** adarazs has joined #openstack-infra | 09:06 | |
| *** slaweq_ has joined #openstack-infra | 09:08 | |
| *** jtomasek_ has joined #openstack-infra | 09:10 | |
| openstackgerrit | Xing Zhang proposed openstack-infra/system-config master: Update doc enumerated list in gerrit https://review.openstack.org/550757 | 09:11 |
| *** slaweq_ has quit IRC | 09:13 | |
| *** jtomasek has quit IRC | 09:14 | |
| *** pcaruana has joined #openstack-infra | 09:15 | |
| persia | ianw: Looking at the afs volume, the pool seems to contain both xenial and bionic packages (as expected): I think it is just the indicies that had issues. | 09:15 |
| *** yamamoto has joined #openstack-infra | 09:15 | |
| *** tesseract has joined #openstack-infra | 09:16 | |
| persia | ianw: Good luck with your move: there aren't enough current tests to break much if it doesn't fix itself during regular updates | 09:16 |
| *** slaweq_ has joined #openstack-infra | 09:18 | |
| *** lucas-afk is now known as lucasagomes | 09:19 | |
| *** yamamoto has quit IRC | 09:20 | |
| *** ociuhandu has joined #openstack-infra | 09:21 | |
| *** ociuhandu has quit IRC | 09:21 | |
| *** slaweq_ has quit IRC | 09:23 | |
| *** pblaho has joined #openstack-infra | 09:26 | |
| *** pcichy has quit IRC | 09:26 | |
| *** slaweq_ has joined #openstack-infra | 09:28 | |
| *** adarazs has quit IRC | 09:30 | |
| *** yamamoto has joined #openstack-infra | 09:30 | |
| *** adarazs has joined #openstack-infra | 09:30 | |
| *** dtantsur has quit IRC | 09:31 | |
| *** tesseract has quit IRC | 09:32 | |
| *** pcaruana has quit IRC | 09:32 | |
| *** pblaho has quit IRC | 09:33 | |
| *** slaweq_ has quit IRC | 09:33 | |
| *** yamamoto has quit IRC | 09:35 | |
| *** dtantsur has joined #openstack-infra | 09:38 | |
| *** slaweq_ has joined #openstack-infra | 09:39 | |
| *** s-shiono has quit IRC | 09:39 | |
| *** zhurong has quit IRC | 09:40 | |
| *** weshay has joined #openstack-infra | 09:40 | |
| *** _ari_ has joined #openstack-infra | 09:40 | |
| *** haleyb has joined #openstack-infra | 09:41 | |
| *** pabelanger has joined #openstack-infra | 09:41 | |
| *** gfidente has joined #openstack-infra | 09:41 | |
| *** gfidente has joined #openstack-infra | 09:41 | |
| *** otherwiseguy has joined #openstack-infra | 09:42 | |
| *** slaweq_ has quit IRC | 09:43 | |
| *** rnoriega has joined #openstack-infra | 09:44 | |
| *** yamamoto has joined #openstack-infra | 09:45 | |
| *** pcaruana has joined #openstack-infra | 09:45 | |
| *** pblaho has joined #openstack-infra | 09:46 | |
| *** tesseract has joined #openstack-infra | 09:46 | |
| *** derekh has joined #openstack-infra | 09:49 | |
| *** slaweq_ has joined #openstack-infra | 09:49 | |
| *** yamamoto has quit IRC | 09:50 | |
| *** salv-orl_ has quit IRC | 09:53 | |
| *** slaweq_ has quit IRC | 09:53 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: configloader: check for unknown shadow projects https://review.openstack.org/550763 | 09:56 |
| *** salv-orlando has joined #openstack-infra | 09:56 | |
| *** slaweq_ has joined #openstack-infra | 09:59 | |
| *** shardy is now known as shardy_afk | 09:59 | |
| *** yamamoto has joined #openstack-infra | 10:00 | |
| openstackgerrit | eldad marciano proposed openstack-infra/grafyaml master: Introduce grafana-piechart-panel. https://review.openstack.org/550764 | 10:02 |
| *** owalsh has joined #openstack-infra | 10:03 | |
| *** slaweq_ has quit IRC | 10:04 | |
| *** yamamoto has quit IRC | 10:05 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add known hosts for all users https://review.openstack.org/548642 | 10:05 |
| *** jpena|off is now known as jpena | 10:05 | |
| *** dmellado has quit IRC | 10:08 | |
| *** slaweq_ has joined #openstack-infra | 10:09 | |
| *** dmellado has joined #openstack-infra | 10:13 | |
| *** annp has quit IRC | 10:13 | |
| *** slaweq_ has quit IRC | 10:14 | |
| *** yamamoto has joined #openstack-infra | 10:15 | |
| *** tosky has joined #openstack-infra | 10:16 | |
| *** danpawlik has quit IRC | 10:16 | |
| *** jpena is now known as jpena|off | 10:19 | |
| *** slaweq_ has joined #openstack-infra | 10:19 | |
| *** panda|off is now known as panda | 10:20 | |
| *** yamamoto has quit IRC | 10:20 | |
| *** yamamoto has joined #openstack-infra | 10:23 | |
| *** yamamoto has quit IRC | 10:23 | |
| *** slaweq_ has quit IRC | 10:24 | |
| *** pbourke has quit IRC | 10:25 | |
| *** pbourke has joined #openstack-infra | 10:26 | |
| *** electrofelix has joined #openstack-infra | 10:28 | |
| *** slaweq_ has joined #openstack-infra | 10:30 | |
| *** yamamoto has joined #openstack-infra | 10:30 | |
| *** slaweq_ has quit IRC | 10:34 | |
| *** slaweq_ has joined #openstack-infra | 10:40 | |
| *** danpawlik has joined #openstack-infra | 10:42 | |
| *** slaweq_ has quit IRC | 10:45 | |
| *** gcb has quit IRC | 10:46 | |
| *** jamesmcarthur has joined #openstack-infra | 10:46 | |
| *** danpawlik has quit IRC | 10:47 | |
| *** gcb has joined #openstack-infra | 10:50 | |
| *** slaweq_ has joined #openstack-infra | 10:50 | |
| *** e0ne has joined #openstack-infra | 10:50 | |
| *** jamesmcarthur has quit IRC | 10:51 | |
| *** e0ne has quit IRC | 10:54 | |
| *** slaweq_ has quit IRC | 10:55 | |
| *** danpawlik has joined #openstack-infra | 10:57 | |
| *** erlon has joined #openstack-infra | 10:58 | |
| *** pgadiya has quit IRC | 10:59 | |
| *** slaweq_ has joined #openstack-infra | 11:00 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to delete banners per location https://review.openstack.org/550777 | 11:02 |
| *** danpawlik has quit IRC | 11:04 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoint to delete banners per location https://review.openstack.org/550777 | 11:04 |
| *** danpawlik has joined #openstack-infra | 11:05 | |
| *** slaweq_ has quit IRC | 11:05 | |
| *** ramishra has quit IRC | 11:10 | |
| *** slaweq_ has joined #openstack-infra | 11:10 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Replaces yaml.load() with yaml.safe_load() https://review.openstack.org/543839 | 11:15 |
| *** zhenguo has quit IRC | 11:15 | |
| *** pcichy has joined #openstack-infra | 11:15 | |
| *** slaweq_ has quit IRC | 11:15 | |
| *** pgadiya has joined #openstack-infra | 11:16 | |
| *** slaweq_ has joined #openstack-infra | 11:21 | |
| *** ramishra has joined #openstack-infra | 11:23 | |
| *** gongysh has quit IRC | 11:23 | |
| *** udesale__ has joined #openstack-infra | 11:25 | |
| *** slaweq_ has quit IRC | 11:26 | |
| *** udesale_ has quit IRC | 11:27 | |
| *** florianf has quit IRC | 11:30 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: PUT /api/v1/summits/{id}/locations/{location_id}/banners/{banner_id} https://review.openstack.org/550788 | 11:31 |
| *** slaweq_ has joined #openstack-infra | 11:31 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: PUT /api/v1/summits/{id}/locations/{location_id}/banners/{banner_id} https://review.openstack.org/550788 | 11:32 |
| *** tpsilva has joined #openstack-infra | 11:35 | |
| *** slaweq_ has quit IRC | 11:35 | |
| *** udesale__ has quit IRC | 11:36 | |
| *** florianf has joined #openstack-infra | 11:37 | |
| *** tosky__ has joined #openstack-infra | 11:37 | |
| *** tosky is now known as Guest55975 | 11:37 | |
| *** tosky__ is now known as tosky | 11:37 | |
| *** felipemonteiro has joined #openstack-infra | 11:41 | |
| *** slaweq_ has joined #openstack-infra | 11:41 | |
| *** olaph has joined #openstack-infra | 11:44 | |
| slaweq | hi | 11:44 |
| slaweq | I have a question about aio and multinode devstack topology in scenario tests | 11:44 |
| *** olaph1 has quit IRC | 11:45 | |
| slaweq | I wanted to test something so I pushed simple patch like https://review.openstack.org/#/c/550612/1 to enable multinode on linuxbridge job | 11:45 |
| slaweq | but it did not work as I expected and it looks from job logs that it is still run on single node | 11:45 |
| slaweq | can You maybe tell me if I missed something what should be changed also or how to do it properly? | 11:46 |
| *** slaweq_ has quit IRC | 11:46 | |
| *** e0ne has joined #openstack-infra | 11:46 | |
| *** ldnunes has joined #openstack-infra | 11:48 | |
| *** e0ne has quit IRC | 11:48 | |
| *** olaph1 has joined #openstack-infra | 11:51 | |
| evrardjp | is there some infra core that can add the openstack-ansible-core group into https://review.openstack.org/#/admin/groups/1847,members so that we can manage members? I forgot to do that long ago for role: https://review.openstack.org/#/c/516884/ | 11:51 |
| *** slaweq_ has joined #openstack-infra | 11:51 | |
| *** olaph has quit IRC | 11:52 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/storyboard master: Migration script: optional parameters to filter by tags https://review.openstack.org/549222 | 11:52 |
| *** slaweq_ has quit IRC | 11:55 | |
| *** janki has quit IRC | 11:57 | |
| *** shardy_afk is now known as shardy | 11:59 | |
| evrardjp | same for tacker... https://review.openstack.org/#/admin/groups/1824,members needs openstack-ansible-core https://review.openstack.org/#/c/482873/ | 11:59 |
| *** jamesdenton has joined #openstack-infra | 12:01 | |
| frickler | evrardjp: added you to both groups so you can continue yourself. infra-root: ^^ | 12:01 |
| *** nicolasbock has joined #openstack-infra | 12:01 | |
| *** slaweq_ has joined #openstack-infra | 12:01 | |
| evrardjp | thanks frickler | 12:03 |
| frickler | slaweq: did a quick look and it seems more changes are needed. will need some more digging, can do so in a bit | 12:03 |
| slaweq | frickler: thx, I will be grateful for any help on that | 12:05 |
| slaweq | I'm not very familiar with this infra stuff :/ | 12:05 |
| *** slaweq_ has quit IRC | 12:06 | |
| AJaeger | config-core, could you review https://review.openstack.org/550553 https://review.openstack.org/549850 https://review.openstack.org/550755 , please? A few small project-config updates | 12:06 |
| AJaeger | slaweq: you need to request multiple nodes as well in your job configuration | 12:07 |
| AJaeger | slaweq: better discuss with andreaf how to convert the job to the Zuul v3 native syntax and then go from there to multinode. Updating the old legacy jobs is not really beneficial in the long run. | 12:08 |
| slaweq | AJaeger: thx, I will try | 12:08 |
| slaweq | AJaeger: currently I only want to check some test failures if it will be the same on multinode setup, I don't want to switch this linuxbridge job in master branch | 12:09 |
| *** jaosorior has joined #openstack-infra | 12:09 | |
| slaweq | so I will try to do it as it is now for now :) | 12:10 |
| *** e0ne has joined #openstack-infra | 12:11 | |
| *** jaosorior has quit IRC | 12:11 | |
| *** slaweq_ has joined #openstack-infra | 12:11 | |
| *** panda is now known as panda|lunch | 12:15 | |
| *** lucasagomes is now known as lucas-hungry | 12:15 | |
| *** felipemonteiro has quit IRC | 12:16 | |
| *** slaweq_ has quit IRC | 12:16 | |
| *** slaweq_ has joined #openstack-infra | 12:22 | |
| *** caphrim007 has quit IRC | 12:22 | |
| *** caphrim007 has joined #openstack-infra | 12:23 | |
| *** pgadiya has quit IRC | 12:23 | |
| *** hemna_ has joined #openstack-infra | 12:24 | |
| *** slaweq_ has quit IRC | 12:26 | |
| *** haleyb_ has joined #openstack-infra | 12:27 | |
| *** masuberu has joined #openstack-infra | 12:27 | |
| *** pabelanger_ has joined #openstack-infra | 12:27 | |
| *** rnoriega_ has joined #openstack-infra | 12:27 | |
| *** _ari__ has joined #openstack-infra | 12:28 | |
| *** otherwiseguy_ has joined #openstack-infra | 12:28 | |
| *** weshay_ has joined #openstack-infra | 12:29 | |
| *** pabelanger has quit IRC | 12:29 | |
| *** _ari_ has quit IRC | 12:30 | |
| *** otherwiseguy has quit IRC | 12:30 | |
| *** rnoriega has quit IRC | 12:31 | |
| *** masber has quit IRC | 12:31 | |
| *** weshay has quit IRC | 12:31 | |
| *** haleyb has quit IRC | 12:31 | |
| *** florianf has quit IRC | 12:31 | |
| *** slaweq_ has joined #openstack-infra | 12:32 | |
| *** e0ne has quit IRC | 12:32 | |
| *** yamamoto has quit IRC | 12:32 | |
| *** jtomasek_ is now known as jtomasek | 12:35 | |
| dhellmann | if zuul finds the same job configured multiple times for the same repo (say it is part of two job templates, or added globally and locally) does it get confused or does it run the job one time? | 12:36 |
| *** danpawlik has quit IRC | 12:36 | |
| *** e0ne has joined #openstack-infra | 12:36 | |
| *** zhipeng has joined #openstack-infra | 12:36 | |
| *** pgadiya has joined #openstack-infra | 12:36 | |
| *** slaweq_ has quit IRC | 12:36 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup Queens translation sync for tripleo-ui https://review.openstack.org/550814 | 12:38 |
| *** yamamoto has joined #openstack-infra | 12:38 | |
| *** e0ne has quit IRC | 12:40 | |
| *** janki has joined #openstack-infra | 12:41 | |
| *** slaweq_ has joined #openstack-infra | 12:42 | |
| AJaeger | dhellmann: if it'S globally and locally, it will only run once, will just work fine. | 12:43 |
| *** r-daneel has joined #openstack-infra | 12:43 | |
| AJaeger | dhellmann: you could have the job definied in one place - and just add it to zuul.yaml everywhere | 12:43 |
| AJaeger | dhellmann: I see no reason so far to have the *job* in 300 repos | 12:44 |
| AJaeger | dhellmann: but you only pushed on change ;) | 12:44 |
| dhellmann | AJaeger : we're still working out how to do this 300 times, so I'm experimenting | 12:44 |
| dhellmann | that was easier to do with a change in 1 repo | 12:44 |
| *** dhajare has joined #openstack-infra | 12:45 | |
| AJaeger | dhellmann: do two and let's review ;) let's avoid duplication... | 12:45 |
| dhellmann | if we can have the job defined in 1 place and just add it to projects, that does simplify the process somewhat | 12:45 |
| dhellmann | although with at least 3 variants on in-tree zuul config it's still not trivial | 12:45 |
| *** florianf has joined #openstack-infra | 12:46 | |
| *** slaweq_ has quit IRC | 12:47 | |
| dhellmann | even if we define the job globally we can't add it to the check-requirements template until all of the projects pass the job | 12:47 |
| dhellmann | I was hoping to not have to keep track of that, so maybe we just leave the lower-constraints job out of the template indefinitely | 12:47 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: do not treat newton as closed to releases https://review.openstack.org/550817 | 12:48 |
| dhellmann | AJaeger : ^^ would help the tripleo and ansible teams | 12:49 |
| dhellmann | EmilienM , evrardjp , amoralej : ^^ | 12:49 |
| *** slaweq_ has joined #openstack-infra | 12:52 | |
| *** lucas-hungry is now known as lucasagomes | 12:53 | |
| *** slaweq_ has quit IRC | 12:57 | |
| evrardjp | dhellmann: thanks | 12:59 |
| *** liuyulong has quit IRC | 12:59 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove jenkins dir from README.rst https://review.openstack.org/549850 | 13:01 |
| *** salv-orlando has quit IRC | 13:01 | |
| *** salv-orlando has joined #openstack-infra | 13:02 | |
| *** slaweq_ has joined #openstack-infra | 13:02 | |
| *** danpawlik has joined #openstack-infra | 13:03 | |
| *** rkukura has quit IRC | 13:04 | |
| *** VW has joined #openstack-infra | 13:05 | |
| *** r-daneel has quit IRC | 13:05 | |
| AJaeger | dhellmann: +2a | 13:06 |
| *** salv-orlando has quit IRC | 13:06 | |
| dhellmann | AJaeger, mordred: thanks | 13:06 |
| *** slaweq_ has quit IRC | 13:07 | |
| AJaeger | mordred: neutron and horizon fails with requirements ;( Did you see https://review.openstack.org/#/c/550475/ ? | 13:08 |
| mordred | AJaeger: I did not - looking | 13:09 |
| *** bobh has joined #openstack-infra | 13:10 | |
| dhellmann | there's a new lower-constraints.txt that has to be updated | 13:10 |
| dhellmann | just include the most current version of the projects there | 13:10 |
| dhellmann | mordred : ^^ | 13:10 |
| mordred | oh - neat | 13:10 |
| dhellmann | I'm still working on convincing them that we don't need that file, but for now... | 13:10 |
| *** pabelanger_ is now known as pabelanger | 13:10 | |
| AJaeger | mordred: that'S the eays part - the difficult part are neutron/horizon unit tests; Check their tox.ini file... | 13:11 |
| AJaeger | ... see the failures there | 13:11 |
| mordred | yah ... was just looking at that | 13:11 |
| EmilienM | dhellmann: thank you | 13:12 |
| *** slaweq_ has joined #openstack-infra | 13:13 | |
| mordred | AJaeger: ah. the .[test] trick | 13:13 |
| *** amoralej is now known as amoralej|lunch | 13:13 | |
| *** germs has joined #openstack-infra | 13:14 | |
| *** germs has quit IRC | 13:14 | |
| *** germs has joined #openstack-infra | 13:14 | |
| *** edmondsw has joined #openstack-infra | 13:14 | |
| *** olaph1 is now known as olaph | 13:14 | |
| AJaeger | mordred: yeah ;( | 13:14 |
| openstackgerrit | Merged openstack-infra/project-config master: do not treat newton as closed to releases https://review.openstack.org/550817 | 13:14 |
| mordred | AJaeger, dhellmann: I wonder ... maybe we should put horizon and neutron in blacklist.txt instead of upper-constraints.txt - since their usage is a bit different than libraries? | 13:14 |
| AJaeger | mordred: and that is used in a few other places - see the etherpad | 13:14 |
| dhellmann | mordred : maybe? | 13:15 |
| AJaeger | mordred: would work as well | 13:15 |
| AJaeger | dirk: ^ | 13:15 |
| AJaeger | prometheanfire: ^ | 13:15 |
| AJaeger | mordred: I think the changes you're working on with building need a good summary and email to openstack-dev - seeing prometheanfire's questions on the review | 13:17 |
| *** slaweq_ has quit IRC | 13:17 | |
| *** cshastri_ has quit IRC | 13:20 | |
| mordred | AJaeger: agree | 13:20 |
| mordred | AJaeger: I've got a patch for fixing horizon ready | 13:21 |
| *** jpich has quit IRC | 13:21 | |
| mordred | which we should get landed regardless of the other thing | 13:21 |
| mordred | AJaeger: which is the etherpad? | 13:21 |
| *** jpich has joined #openstack-infra | 13:22 | |
| *** slaweq__ has joined #openstack-infra | 13:23 | |
| *** cshastri has joined #openstack-infra | 13:24 | |
| *** rnoriega_ is now known as rnoriega | 13:24 | |
| *** udesale has joined #openstack-infra | 13:24 | |
| *** germs has quit IRC | 13:25 | |
| AJaeger | https://etherpad.openstack.org/p/zuulv3-remove-zuul-cloner | 13:25 |
| AJaeger | mordred: still the same ;) | 13:25 |
| AJaeger | mordred: I added many lines to it last night | 13:26 |
| *** pgadiya has quit IRC | 13:27 | |
| *** slaweq__ has quit IRC | 13:28 | |
| *** bobh has quit IRC | 13:28 | |
| prometheanfire | AJaeger: mordred not sure blacklist.txt is the right place, considering the description we have for it, I'm still not sure what they are being used as libs for | 13:29 |
| prometheanfire | wasn't separating the client lib bits from the project a thing? | 13:29 |
| AJaeger | prometheanfire: right now projects like all the dashboard repos, need to install horizon for their CI. Similar with networking repos. mordred is working on a better way to do this for CI. | 13:30 |
| *** udesale has quit IRC | 13:31 | |
| *** udesale has joined #openstack-infra | 13:31 | |
| mordred | prometheanfire: yah - this is about the horizon and neutron plugins, which currently are all special-cased becaue they depend on neutron and horizon via direct git links ... | 13:32 |
| AJaeger | mordred: there will be a more packages coming - if you look what the tools/tox_install.sh scripts currently install. Soem install nova, others other networking repos. | 13:33 |
| prometheanfire | ah, plugin repos | 13:33 |
| mordred | prometheanfire: but because we don't allow git links in requirements files, they have tox_install.sh wrapper scripts which describe the requirement - effectively bypassing the whole system | 13:33 |
| *** slaweq__ has joined #openstack-infra | 13:33 | |
| mordred | http://git.openstack.org/cgit/openstack/networking-bgpvpn/tree/tools/tox_install.sh#n62 <-- good example | 13:33 |
| *** rlandy has joined #openstack-infra | 13:34 | |
| AJaeger | prometheanfire: and this works https://review.openstack.org/#/c/550387/ | 13:34 |
| AJaeger | prometheanfire: (with exception of requirements check failing - and that's what triggered your questions ;) | 13:34 |
| *** agopi has joined #openstack-infra | 13:35 | |
| *** slaweq__ has quit IRC | 13:38 | |
| mordred | AJaeger, prometheanfire: I pushed up patches to neutron and horizon fixing their tox.ini and added those to the depends-on for the requirements change | 13:38 |
| *** salv-orlando has joined #openstack-infra | 13:39 | |
| prometheanfire | mordred: sure | 13:40 |
| AJaeger | mordred: that won't make toabctl happy who pushed those [test] in. | 13:40 |
| AJaeger | toabctl: see https://review.openstack.org/550475 | 13:40 |
| prometheanfire | I think expanding the definition of blacklist could make sense, but like tony said (I think), I think a ml message would be nice | 13:40 |
| AJaeger | mordred: we have in oslo.* some cases - see etherpad - where ".[something]" is used - and need a solution for those as well | 13:41 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add subunit2sql check database server and workers https://review.openstack.org/520192 | 13:41 |
| prometheanfire | it also doesn't help for currently developed neutron/horizon | 13:42 |
| AJaeger | time for some cycling, will be back later... | 13:42 |
| prometheanfire | master hasn't had a release yet I don't think | 13:42 |
| AJaeger | prometheanfire: we have a release! | 13:43 |
| toabctl | AJaeger, ? | 13:43 |
| AJaeger | prometheanfire: pypi.python.org/pypi/neutron | 13:43 |
| *** slaweq_ has joined #openstack-infra | 13:43 | |
| AJaeger | toabctl: see discussion of last 20 mins here - and check depends-on from 550475 | 13:43 |
| *** dprince has joined #openstack-infra | 13:44 | |
| *** mriedem has joined #openstack-infra | 13:45 | |
| mordred | AJaeger: k - I pushed up apatch to keystoneauth (one of the outlier repos listed at the bottom) | 13:46 |
| mordred | AJaeger: I don't see that issue in oslo.db ... maybe it got fixed already? | 13:47 |
| *** rosmaita has joined #openstack-infra | 13:47 | |
| *** slaweq_ has quit IRC | 13:48 | |
| prometheanfire | AJaeger: is that from master? | 13:48 |
| *** trown|outtypewww is now known as trown|rover | 13:48 | |
| mordred | AJaeger, toabctl: yah - sorry about the .[test] casualty - I liked it as an approach - but with the way constraints work it's just unfeasible to keep unfortunately | 13:48 |
| toabctl | AJaeger, I still don't see where I am/was involved. maybe defining test deps in extra_requires ? | 13:49 |
| *** dave-mccowan has joined #openstack-infra | 13:49 | |
| toabctl | mordred, where do you want to remove it? | 13:49 |
| toabctl | mordred, are you saying that we can not define soft requirements anymore? | 13:50 |
| mordred | toabctl: from all tox.ini files. we basically can't reference . in the deps section in any way and have constraints and tox-siblings work | 13:50 |
| mordred | toabctl: we can totally define soft requirements | 13:50 |
| mordred | toabctl: we just have to interface with them differently in tox.ini | 13:51 |
| toabctl | mordred, how? can you point me to a patch? | 13:51 |
| mordred | toabctl: https://review.openstack.org/#/c/550837/ | 13:51 |
| *** links has quit IRC | 13:51 | |
| toabctl | mordred, with that patch, requests-kerberos and friends end up in install_requires and pkg_resources might complain if the modules are not there.not nice | 13:53 |
| *** slaweq_ has joined #openstack-infra | 13:53 | |
| mordred | toabctl: why would they end up in install_requires? we're only adding them to test-reuqirements | 13:53 |
| toabctl | ah. true. sorry | 13:54 |
| *** lbragstad has joined #openstack-infra | 13:54 | |
| mordred | *phew* - I was worried I'd missed a big hole :) | 13:55 |
| pabelanger | I'm going to spend some time debugging bionic wheels this morning, we didn't copy them to AFS for some reason: http://logs.openstack.org/periodic/git.openstack.org/openstack/requirements/master/publish-wheel-mirror-ubuntu-bionic/80f3aef/ | 13:55 |
| mtreinish | infra-root: I'm not seeing any gerrit events on firehose, can someone check if germqtt (on firehose.o.o) is still running? | 13:56 |
| *** eharney has joined #openstack-infra | 13:57 | |
| *** amoralej|lunch is now known as amoralej | 13:57 | |
| *** slaweq_ has quit IRC | 13:58 | |
| *** erlon has quit IRC | 13:58 | |
| fungi | i'll look | 13:59 |
| mtreinish | fungi: thanks | 13:59 |
| fungi | Active: failed (Result: exit-code) since Tue 2018-02-27 16:37:19 UTC | 14:00 |
| fungi | perhaps we crashed it upgrading mosquitto? | 14:01 |
| fungi | at any rate, i've started it again now | 14:01 |
| mtreinish | fungi: great, thanks. Yeah I see events now | 14:02 |
| *** panda|lunch is now known as panda | 14:02 | |
| mtreinish | fungi: hmm, the 27th was a bit before we installed the new mosquitto version | 14:02 |
| *** caphrim007 has quit IRC | 14:03 | |
| *** kiennt26_ has joined #openstack-infra | 14:03 | |
| *** caphrim007 has joined #openstack-infra | 14:03 | |
| *** Goneri has joined #openstack-infra | 14:03 | |
| mtreinish | oh, that's probably when I screwed up the config and was setting the websocket port to 'listener True' | 14:03 |
| *** slaweq_ has joined #openstack-infra | 14:04 | |
| mtreinish | fungi: it might make sense to check the other daemons, like lpmqtt and mqtt_statsd | 14:04 |
| fungi | looking | 14:04 |
| *** dtantsur is now known as dtantsur|brb | 14:05 | |
| fungi | Active: failed (Result: exit-code) since Wed 2018-01-10 19:34:00 UTC | 14:05 |
| fungi | that was lpmqtt | 14:05 |
| mtreinish | heh, well luckily for that one it saves state in imap | 14:06 |
| fungi | yeah, anyway it's started again | 14:06 |
| fungi | mqtt_statsd never crashed | 14:06 |
| fungi | Active: active (running) since Thu 2018-01-18 15:24:50 UTC | 14:06 |
| *** dbecker has joined #openstack-infra | 14:06 | |
| mtreinish | ok cool | 14:07 |
| fungi | running for several weeks | 14:07 |
| *** caphrim007 has quit IRC | 14:08 | |
| *** slaweq_ has quit IRC | 14:08 | |
| mtreinish | oh, I just noticed the date on lpmqtt, it's not been running for ~2 months | 14:09 |
| mtreinish | lol, I guess no one was relying on those events | 14:10 |
| *** HeOS has joined #openstack-infra | 14:11 | |
| *** slaweq___ has joined #openstack-infra | 14:14 | |
| *** snapiri has quit IRC | 14:16 | |
| *** edmondsw_ has joined #openstack-infra | 14:17 | |
| auristor | pabelanger: are you around? | 14:17 |
| *** edmondsw has quit IRC | 14:18 | |
| *** slaweq___ has quit IRC | 14:18 | |
| *** r-daneel has joined #openstack-infra | 14:20 | |
| pabelanger | auristor: I am | 14:20 |
| *** HeOS has quit IRC | 14:20 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Rename get_schema to getSchema https://review.openstack.org/550670 | 14:22 |
| auristor | did you see the discussion from last night regarding -ERESTARTSYS errors on mirror-update.openstack.org? | 14:22 |
| auristor | ianw asked me to follow up with you | 14:23 |
| openstackgerrit | Merged openstack-infra/nodepool master: Extend config API with getSupportedLabels() https://review.openstack.org/550671 | 14:24 |
| *** efoley has joined #openstack-infra | 14:24 | |
| *** slaweq__ has joined #openstack-infra | 14:24 | |
| pabelanger | auristor: yah, right now we are just using stock client from trusty, but that server is scheduled to be updated to xenial | 14:24 |
| pabelanger | that would get us: https://packages.ubuntu.com/xenial/openafs-client | 14:25 |
| *** olaph1 has joined #openstack-infra | 14:25 | |
| pabelanger | however bionic has 1.8.0~pre5-1, I am not sure if that is better to move too | 14:25 |
| auristor | 1.8.0 is beta and there are still issues to be discovered there | 14:26 |
| *** olaph has quit IRC | 14:26 | |
| auristor | the stock xenial client doesn't include the partial -ERESTARTSYS fix | 14:27 |
| pabelanger | k | 14:27 |
| pabelanger | something we might be able to backport? | 14:28 |
| *** slaweq__ has quit IRC | 14:29 | |
| auristor | openstack should just build the latest upstream stable release instead of relying upon ubuntu distributed packages which have never in my experience been kept up to date | 14:29 |
| *** kiennt26_ has quit IRC | 14:29 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack https://review.openstack.org/549608 | 14:29 |
| auristor | it has never made sense to me that linux distributions selectively backport the changes that they feel are important as opposed to simply shipping the changes that the upstream development team believes is important. | 14:30 |
| andreaf | slaweq please let me know if you need any help with job migration | 14:30 |
| fungi | auristor: unfortunately the same could be said for almost every piece of software we run, so we end up having to make compromises between the handful of things we have time to automate building from upstream source and the things we can just get by running from a binary distribution | 14:31 |
| andreaf | slaweq my patch series for multinode is https://review.openstack.org/#/q/topic:multinode_zuulv3+status:open+label:Workflow%253D0 if that helps | 14:31 |
| slaweq | andreaf: hi, no, I'm not doing real migration, only some test for now | 14:31 |
| auristor | most of your software isn't a kernel module | 14:31 |
| slaweq | and with tips AJaeger I think it is going good now | 14:31 |
| slaweq | but I will back to You if I will need some help, thx a lot :) | 14:32 |
| andreaf | slaweq np | 14:32 |
| fungi | auristor: the reason distros selectively backport fixes instead of always providing the latest release is that many upstreams will introduce backward-incompatibilities from one release to the next and users would prefer to only consume backward-incompatible changes at distro release boundaries rather than at random unexpected points in time | 14:32 |
| *** armaan has quit IRC | 14:33 | |
| *** armaan has joined #openstack-infra | 14:33 | |
| auristor | openafs has long term stable releases. many other projects do not | 14:33 |
| fungi | though that's more the case for stable distributions. rolling distributions with no firm release boundary tend to operate more loosely | 14:34 |
| *** gongysh has joined #openstack-infra | 14:34 | |
| *** annp_ has joined #openstack-infra | 14:34 | |
| *** slaweq__ has joined #openstack-infra | 14:34 | |
| *** gongysh has quit IRC | 14:34 | |
| auristor | the problem is that backporting only security fixes means that all of the work that is performed to track the linux kernel doesn't get backported until and unless a compilation failure occurs | 14:35 |
| *** gouthamr has joined #openstack-infra | 14:35 | |
| fungi | auristor: sure, but imagine you're, say, debian packaging 40k+ different applications and services. there's no clear standard means of equating a stable branch model from one upstream community to the next so they tend to assume all software introduces breaking changes | 14:35 |
| auristor | The long term solution is to switch to kafs | 14:35 |
| auristor | kafs is the in-tree afs client | 14:36 |
| fungi | stable distros tend to treat the kernel the same way too, backporting kernel patches to the version they released with rather than blindly consuming a stable kernel branch | 14:36 |
| auristor | none of the linux distributions that I am aware of enable it when building their linux kernels but if you want a kernel module that is going to track the kernel that is really the only way to ensure that there is consistency | 14:37 |
| fungi | though upstream providing a stable branch with some no-new-feature guarantees does tend to provide some additional confidence in selecting packages from it to backport | 14:37 |
| fungi | er, patches from it | 14:38 |
| *** slaweq__ has quit IRC | 14:38 | |
| fungi | yeah, i agree kafs will be nice | 14:39 |
| auristor | I do not mean to have a religious discussion on this topic. The problem that openstack is seeing on mirror-update is because the Linux kernel changed somewhere around 4.1 to permit signals to interrupt a larger number of in-kernel operations that are initiated by the openafs cache manager. | 14:39 |
| fungi | hopefully when ubuntu 18.04 lts releases next month it'll have a new enough linux kernel we can start trying kafs | 14:40 |
| *** beagles is now known as beagles|brb | 14:40 | |
| auristor | openafs still does not have a proper fix for the problem but it does have a partial fix which covers the most common case which was interrupting splice operations | 14:40 |
| fungi | and yes, it sounds like a bug we should raise with ubuntu to request they backport the necessary openafs fixes for their newer kernl | 14:41 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: configloader: check for unknown shadow projects https://review.openstack.org/550763 | 14:42 |
| fungi | thanks for the details auristor! | 14:42 |
| auristor | as for the other issue which was the VBUSY (110) error. You should try to identify what volume operation was taking place on the volume in question. | 14:43 |
| auristor | the openafs client when it receives a VBUSY is supposed to sleep and retry up to 100 times with a 15 second sleep between each retry | 14:44 |
| *** slaweq__ has joined #openstack-infra | 14:44 | |
| *** jaosorior has joined #openstack-infra | 14:45 | |
| auristor | the openafs fileserver and volserver have an audit log option. They generate a lot of data but that data is very useful to debugging issues that clients are facing. | 14:45 |
| auristor | openstack does not currently generate the audit data but it might want to consider doing so | 14:46 |
| *** olaph has joined #openstack-infra | 14:48 | |
| *** slaweq__ has quit IRC | 14:49 | |
| *** Swami has joined #openstack-infra | 14:49 | |
| *** olaph1 has quit IRC | 14:49 | |
| openstackgerrit | Merged openstack-infra/zuul master: Normalize hostname for statsd https://review.openstack.org/547309 | 14:50 |
| *** dbecker has quit IRC | 14:53 | |
| AJaeger | toabctl: mordred is basically reverting your change https://review.openstack.org/#/c/495847/ | 14:53 |
| pabelanger | auristor: thanks for the pointers, I'll see about how we can enable the audit data | 14:54 |
| *** slaweq__ has joined #openstack-infra | 14:54 | |
| *** masber has joined #openstack-infra | 14:56 | |
| *** olaph has quit IRC | 14:56 | |
| AJaeger | config-core, could you review https://review.openstack.org/550553 https://review.openstack.org/550755 , please? A few small project-config updates | 14:56 |
| *** melwitt has quit IRC | 14:59 | |
| *** masuberu has quit IRC | 14:59 | |
| *** yamahata has joined #openstack-infra | 14:59 | |
| *** slaweq__ has quit IRC | 14:59 | |
| *** olaph has joined #openstack-infra | 15:00 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove gitdm legacy jobs https://review.openstack.org/550553 | 15:03 |
| AJaeger | thanks, dmsimard | 15:04 |
| *** zoli is now known as zoli|mtg | 15:04 | |
| openstackgerrit | Eric Harney proposed openstack-infra/openstack-zuul-jobs master: Disable grenade-dsvm-cinder-mn-sub-volbak on newton/ocata https://review.openstack.org/550860 | 15:04 |
| *** zoli|mtg is now known as zoli | 15:04 | |
| *** slaweq__ has joined #openstack-infra | 15:05 | |
| *** hamzy has quit IRC | 15:05 | |
| *** psachin has quit IRC | 15:06 | |
| *** melwitt has joined #openstack-infra | 15:06 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove converted cl-openstack-client job https://review.openstack.org/550755 | 15:07 |
| *** melwitt is now known as Guest70075 | 15:07 | |
| *** slaweq__ has quit IRC | 15:09 | |
| *** esberglu has joined #openstack-infra | 15:10 | |
| *** salv-orl_ has joined #openstack-infra | 15:10 | |
| openstackgerrit | Merged openstack-infra/zuul master: Fix console stream colors https://review.openstack.org/550730 | 15:11 |
| *** beagles|brb is now known as beagles | 15:12 | |
| mordred | infra-root: ok - I'm going to take another stab at un-emergencying zuul01 | 15:12 |
| *** salv-orlando has quit IRC | 15:12 | |
| *** yamamoto has quit IRC | 15:14 | |
| mordred | actually - no - I've got to step away for a few minutes in a few - I'll do it as soon as I'm back | 15:15 |
| *** slaweq__ has joined #openstack-infra | 15:15 | |
| clarkb | pabelanger: ready to tag glean? | 15:15 |
| clarkb | pabelanger: do you want to do it or should I? | 15:16 |
| *** yamamoto has joined #openstack-infra | 15:16 | |
| pabelanger | clarkb: sure, you can tag if you like | 15:17 |
| clarkb | pabelanger: you probably understand the bug that is being fixed a bit better for writing up the tag message | 15:18 |
| pabelanger | clarkb: okay, no issue. I'll do it in a moment | 15:19 |
| pabelanger | also | 15:19 |
| pabelanger | http://mirror.dfw.rax.openstack.org/wheel/ubuntu-18.04-x86_64/ | 15:19 |
| pabelanger | we have bionic wheels | 15:20 |
| persia | \o/ | 15:20 |
| *** slaweq__ has quit IRC | 15:20 | |
| mordred | fungi: TIL that yarn (the tool we're using to install javascript packages in thenew zuul toolchain) has a license listing command: "yarn licenses list" | 15:21 |
| *** eernst has joined #openstack-infra | 15:21 | |
| *** yamamoto has quit IRC | 15:21 | |
| fungi | neat | 15:22 |
| AJaeger | config-core, two followup cleanups for review, please: https://review.openstack.org/#/c/550756/ and https://review.openstack.org/#/c/550554/ | 15:22 |
| AJaeger | pabelanger: woot | 15:22 |
| fungi | mordred: in theory pip could do that too... if maintainers actually filled in the license field in the trove metadata accurately | 15:22 |
| *** masber has quit IRC | 15:22 | |
| mordred | fungi: :) | 15:24 |
| *** edmondsw_ is now known as edmondsw | 15:24 | |
| mordred | fungi: amuinsgly enough - in our dependency list - spdx-license-ids does not list alicense :) | 15:25 |
| mordred | (although its readme does) | 15:25 |
| *** slaweq__ has joined #openstack-infra | 15:25 | |
| clarkb | mordred: of the good things that github has done is make it much harder to create repos without a license | 15:26 |
| *** germs has joined #openstack-infra | 15:26 | |
| *** germs has quit IRC | 15:26 | |
| *** germs has joined #openstack-infra | 15:26 | |
| *** salv-orl_ has quit IRC | 15:26 | |
| mordred | ++ | 15:26 |
| clarkb | hopefully yarn license list is a further carrot for people making the license terms clear | 15:26 |
| AJaeger | anybody here reviewing openstack-planet? I have a change to import the test as Zuul v3 native job at https://review.openstack.org/545712 - reviews welcome, please | 15:27 |
| mordred | OH - I read it wrong. spdx-license-ids uses "Unlicense" which asserts public domain | 15:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Update jquery to version 3 https://review.openstack.org/550871 | 15:29 |
| *** yamamoto has joined #openstack-infra | 15:29 | |
| *** hamzy has joined #openstack-infra | 15:30 | |
| *** slaweq__ has quit IRC | 15:30 | |
| mordred | clarkb: ^^ that seems to work just fine | 15:30 |
| *** germs has quit IRC | 15:30 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove gitdm legacy jobs https://review.openstack.org/550554 | 15:31 |
| *** annp_ has quit IRC | 15:34 | |
| *** yamamoto has quit IRC | 15:34 | |
| *** slaweq has quit IRC | 15:34 | |
| *** slaweq__ has joined #openstack-infra | 15:34 | |
| *** slaweq has joined #openstack-infra | 15:35 | |
| *** hamzy has quit IRC | 15:35 | |
| *** yamamoto has joined #openstack-infra | 15:38 | |
| *** yamamoto has quit IRC | 15:38 | |
| openstackgerrit | Luke Hinds proposed openstack-infra/irc-meetings master: Changes for Security Group / SIG https://review.openstack.org/550877 | 15:38 |
| *** caphrim007 has joined #openstack-infra | 15:39 | |
| *** slaweq__ has quit IRC | 15:39 | |
| *** annp_ has joined #openstack-infra | 15:40 | |
| *** slaweq has quit IRC | 15:40 | |
| *** hamzy has joined #openstack-infra | 15:41 | |
| fungi | clarkb: you mean github makes it harder now to get into this situation? https://github.com/oubiwann/coin-toss/issues/1 | 15:42 |
| fungi | i wonder if oubiwann has forsaken computers entirely or something | 15:43 |
| clarkb | fungi: yes, they basically have a tooltip clippy thing that offers you a buffet of licenses with short descriptions of how they work | 15:43 |
| clarkb | fungi: and I think if you pick one they automatically do a pull request into your project with the appropriate files | 15:43 |
| clarkb | or maybe even seed the enw repo with that content | 15:43 |
| fungi | neat | 15:44 |
| *** slaweq has joined #openstack-infra | 15:45 | |
| *** bobh has joined #openstack-infra | 15:46 | |
| *** VW_ has joined #openstack-infra | 15:49 | |
| *** slaweq has quit IRC | 15:50 | |
| *** edmondsw has quit IRC | 15:50 | |
| *** edmondsw has joined #openstack-infra | 15:51 | |
| *** VW has quit IRC | 15:52 | |
| *** electrofelix has quit IRC | 15:52 | |
| *** VW has joined #openstack-infra | 15:53 | |
| *** VW_ has quit IRC | 15:53 | |
| *** VW has quit IRC | 15:53 | |
| *** VW has joined #openstack-infra | 15:54 | |
| *** olaph1 has joined #openstack-infra | 15:55 | |
| *** edmondsw has quit IRC | 15:55 | |
| *** slaweq has joined #openstack-infra | 15:56 | |
| *** claudiub has quit IRC | 15:56 | |
| *** olaph has quit IRC | 15:57 | |
| *** dtantsur|brb is now known as dtantsur | 15:58 | |
| *** cfriesen has joined #openstack-infra | 15:58 | |
| cfriesen | is this the right place to talk about launchpad issues? | 15:58 |
| clarkb | https://review.openstack.org/#/c/550860/1 is one config-core should probably review to help out stable branch maintenance | 15:59 |
| clarkb | cfriesen: maybe? we dno't operate launchpad but do consume it in a variety of ways so depends on where the issue is likely | 15:59 |
| *** udesale has quit IRC | 15:59 | |
| cfriesen | clarkb: it won't add comments to a bug for me...keeps telling me to try again in a few minutes. I can load it fine though. | 16:00 |
| cfriesen | https://bugs.launchpad.net/keystone/+bug/1754184 | 16:00 |
| openstack | Launchpad bug 1754184 in OpenStack Identity (keystone) "Unified limits API shouldn't return a list of all limits" [Medium,In progress] - Assigned to wangxiyuan (wangxiyuan) | 16:00 |
| *** slaweq has quit IRC | 16:00 | |
| cfriesen | looks like complaining about it fixed it. :) | 16:01 |
| clarkb | cfriesen: for that you'll likely need to contact launchpad/canonical | 16:01 |
| pabelanger | clarkb: 1.10.3 is fine for glean? | 16:01 |
| persia | cfriesen: If you're having a usability bug with launchper, the #launchpad channel is the usual support channel for launchpad (but good news that it is fixed) | 16:01 |
| clarkb | persia: ya its jsut a bug fix so that should be fine | 16:01 |
| clarkb | er | 16:01 |
| clarkb | pabelanger: ^ sorry persia | 16:01 |
| persia | pabelanger: ^^ | 16:01 |
| cfriesen | persia: thanks for the tip | 16:01 |
| *** cfriesen has left #openstack-infra | 16:01 | |
| pabelanger | clarkb: ack | 16:02 |
| mtreinish | fungi: hmm, I haven't seen any launchpad events since you restarted lpmqtt. I wonder if something happened to the imap server, or the launchpad subscription | 16:04 |
| *** pcaruana has quit IRC | 16:06 | |
| *** slaweq has joined #openstack-infra | 16:06 | |
| *** kjackal has quit IRC | 16:06 | |
| *** kjackal has joined #openstack-infra | 16:06 | |
| *** cshastri has quit IRC | 16:08 | |
| clarkb | pabelanger: ianw any idea why corvus was only +1 on https://review.openstack.org/#/c/540198/2 ? | 16:10 |
| *** david-lyle has quit IRC | 16:10 | |
| clarkb | and then ya how do we update existing volumes? | 16:10 |
| clarkb | er I guess those are server settings not volume settings | 16:10 |
| *** slaweq has quit IRC | 16:10 | |
| pabelanger | clarkb: oh, not sure. but we should wait until corvus is back online for guidance | 16:11 |
| openstackgerrit | Merged openstack-infra/zuul master: Update jquery to version 3 https://review.openstack.org/550871 | 16:11 |
| *** jaosorior has quit IRC | 16:12 | |
| *** germs has joined #openstack-infra | 16:13 | |
| *** germs has quit IRC | 16:13 | |
| *** germs has joined #openstack-infra | 16:13 | |
| *** slaweq has joined #openstack-infra | 16:16 | |
| *** germs has quit IRC | 16:18 | |
| *** olaph1 is now known as olaph | 16:18 | |
| *** Swimingly has quit IRC | 16:18 | |
| *** hongbin has joined #openstack-infra | 16:19 | |
| *** eernst has quit IRC | 16:19 | |
| *** rkukura has joined #openstack-infra | 16:20 | |
| *** Swimingly has joined #openstack-infra | 16:20 | |
| *** Swimingly has quit IRC | 16:20 | |
| *** Swimingly has joined #openstack-infra | 16:20 | |
| *** slaweq has quit IRC | 16:20 | |
| *** zhipeng has quit IRC | 16:24 | |
| *** slaweq has joined #openstack-infra | 16:26 | |
| *** salv-orlando has joined #openstack-infra | 16:27 | |
| *** slaweq has quit IRC | 16:31 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove cl-openstack-client job https://review.openstack.org/550756 | 16:31 |
| *** VW has quit IRC | 16:32 | |
| *** annp_ has quit IRC | 16:32 | |
| *** germs has joined #openstack-infra | 16:32 | |
| *** germs has joined #openstack-infra | 16:32 | |
| *** r-daneel has quit IRC | 16:32 | |
| *** salv-orlando has quit IRC | 16:32 | |
| *** kjackal has quit IRC | 16:33 | |
| *** germs has quit IRC | 16:33 | |
| *** germs has joined #openstack-infra | 16:36 | |
| *** germs has quit IRC | 16:36 | |
| *** germs has joined #openstack-infra | 16:36 | |
| *** slaweq has joined #openstack-infra | 16:36 | |
| *** yamamoto has joined #openstack-infra | 16:38 | |
| *** danpawlik has quit IRC | 16:38 | |
| *** VW_ has joined #openstack-infra | 16:40 | |
| *** slaweq has quit IRC | 16:41 | |
| *** prometheanfire has quit IRC | 16:43 | |
| *** andreas_s has quit IRC | 16:44 | |
| *** hemna_ has quit IRC | 16:44 | |
| *** yamamoto has quit IRC | 16:45 | |
| *** slaweq has joined #openstack-infra | 16:45 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Disable grenade-dsvm-cinder-mn-sub-volbak on newton/ocata https://review.openstack.org/550860 | 16:46 |
| *** slaweq__ has joined #openstack-infra | 16:47 | |
| *** andreas_s has joined #openstack-infra | 16:48 | |
| *** kjackal has joined #openstack-infra | 16:50 | |
| *** ramishra has quit IRC | 16:50 | |
| *** lpetrut has quit IRC | 16:51 | |
| *** slaweq__ has quit IRC | 16:51 | |
| *** andreas_s_ has joined #openstack-infra | 16:52 | |
| *** eernst has joined #openstack-infra | 16:52 | |
| *** andreas__ has joined #openstack-infra | 16:53 | |
| *** andreas_s has quit IRC | 16:53 | |
| *** harlowja has joined #openstack-infra | 16:54 | |
| *** jamesmcarthur has joined #openstack-infra | 16:54 | |
| *** dhajare has quit IRC | 16:55 | |
| *** armaan has quit IRC | 16:55 | |
| *** kjackal has quit IRC | 16:56 | |
| *** andreas_s_ has quit IRC | 16:56 | |
| *** slaweq__ has joined #openstack-infra | 16:57 | |
| *** niedbalski has quit IRC | 16:58 | |
| *** andreas__ has quit IRC | 16:58 | |
| openstackgerrit | Luke Hinds proposed openstack-infra/irc-meetings master: Changes required for security project > sig https://review.openstack.org/550929 | 17:00 |
| *** slaweq__ has quit IRC | 17:01 | |
| *** david-lyle has joined #openstack-infra | 17:04 | |
| *** hemna_ has joined #openstack-infra | 17:04 | |
| *** kjackal has joined #openstack-infra | 17:05 | |
| *** slaweq__ has joined #openstack-infra | 17:07 | |
| *** jrist has quit IRC | 17:10 | |
| *** slaweq__ has quit IRC | 17:11 | |
| *** shoogz has quit IRC | 17:13 | |
| *** hashar is now known as hasharDinner | 17:13 | |
| *** shoogz has joined #openstack-infra | 17:15 | |
| *** kjackal has quit IRC | 17:15 | |
| *** jpich has quit IRC | 17:16 | |
| *** slaweq__ has joined #openstack-infra | 17:17 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Migration Error with Suspended User https://review.openstack.org/532706 | 17:17 |
| *** gyee has joined #openstack-infra | 17:17 | |
| *** slaweq__ has quit IRC | 17:21 | |
| *** eumel8 has joined #openstack-infra | 17:22 | |
| *** olaph1 has joined #openstack-infra | 17:24 | |
| *** olaph has quit IRC | 17:25 | |
| *** salv-orlando has joined #openstack-infra | 17:27 | |
| *** slaweq__ has joined #openstack-infra | 17:27 | |
| SamYaple | im working on setting up gerrit and zuulv3 internally, is there a canonical way to do this in the form of a guide somewhere? ive seen a few around | 17:28 |
| clarkb | SamYaple: zuulv3 docs should document how to set it up with gerrit (and github) | 17:28 |
| fungi | SamYaple: if the question is as much about setting up gerrit, we have some documentation describing how _we_ do it, but gerrit also has great install documentation | 17:29 |
| fungi | SamYaple: https://docs.openstack.org/infra/system-config/gerrit.html | 17:30 |
| fungi | bootstrapping an initial admin user is somewhat manual | 17:31 |
| *** xarses has quit IRC | 17:31 | |
| SamYaple | ah perfect. thanks fungi and clarkb . this is enough to get me going for a bit | 17:31 |
| fungi | though we should look into revising that to take advantage of the magic "gerrit code review" built-in account | 17:31 |
| SamYaple | still ahve to get internal acls to make it work | 17:31 |
| *** jrist has joined #openstack-infra | 17:32 | |
| *** slaweq__ has quit IRC | 17:32 | |
| clarkb | our docs seem to focus on how to set up gerrit out way and less about general gerrit setup iirc | 17:34 |
| clarkb | which if that is what youwant is probably fine :) | 17:34 |
| SamYaple | it is. we are looking for a close-to-infra setup since this will only be for our internal openstack stuff | 17:35 |
| *** rosmaita has quit IRC | 17:35 | |
| SamYaple | side note, is there an official deadline for talks to be approved for Vancouver? gotta be soon right? | 17:36 |
| SamYaple | need that to submit for travel | 17:36 |
| fungi | i heard they were sending notification to speakers later this week i think? | 17:36 |
| *** jamesmcarthur has quit IRC | 17:36 | |
| fungi | i'll double-check | 17:36 |
| *** Swami has quit IRC | 17:36 | |
| *** jrist has quit IRC | 17:37 | |
| *** slaweq__ has joined #openstack-infra | 17:37 | |
| *** jamesmcarthur has joined #openstack-infra | 17:38 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Changes required for security project > sig https://review.openstack.org/550929 | 17:38 |
| fungi | SamYaple: i was wrong, it's supposed to be sometime around the middle or end of next week | 17:38 |
| fungi | official pronouncement has been "week of march 16th" | 17:39 |
| SamYaple | got it. thats fine. thanks fungi | 17:39 |
| fungi | any time | 17:39 |
| *** yamamoto has joined #openstack-infra | 17:40 | |
| *** xarses has joined #openstack-infra | 17:41 | |
| *** gfidente is now known as gfidente|afk | 17:41 | |
| *** slaweq__ has quit IRC | 17:42 | |
| *** trown|rover is now known as trown|lunch | 17:42 | |
| mordred | SamYaple: if you want both a gerrit and a zuulv3, you may also want to check out https://softwarefactory-project.io/docs/ | 17:43 |
| fungi | ahh, yes, turns out this is already a thing ;) | 17:43 |
| SamYaple | being completely unfamiliar with 3rd-party integration, would that still work for that mordred? | 17:44 |
| fungi | tristanC is our best go-to in here for sf questions, if you have any | 17:45 |
| clarkb | SamYaple: ya you'd just point the zuul at our gerrit too | 17:45 |
| fungi | right, zuul v3 supports connections to multiple gerrits | 17:45 |
| SamYaple | niiiiice. thanks for the help everyone. plenty of reading to do now | 17:45 |
| clarkb | SamYaple: on gotcha to keep in mind is that if you have an openstack/nova in your gerrit that will confuse things a bit in zuul if using a single tenant since we have an openstack/zuul too | 17:46 |
| clarkb | but you should be able to split those up by tenant | 17:46 |
| *** yamamoto has quit IRC | 17:46 | |
| *** janki has quit IRC | 17:47 | |
| *** edmondsw has joined #openstack-infra | 17:47 | |
| SamYaple | im not quite following. i dont have an openstack/nova repo, if thats what youre asking (well we do, but know by a different name) | 17:47 |
| mordred | clarkb: it shouldn't confuse anything - each project's canonical name is actually a fully qualified name - so the upstream nova is git.openstack.org/openstack/nova and SamYaple's would be git.samyaple.com/openstack/nova | 17:47 |
| *** lpetrut has joined #openstack-infra | 17:47 | |
| mordred | clarkb: referring to things as just openstack/nova is shorthand so people don't have to type as much - but if there's overlap, zuul will make you fully qualify | 17:48 |
| *** janki has joined #openstack-infra | 17:48 | |
| clarkb | mordred: ah ok | 17:48 |
| *** slaweq__ has joined #openstack-infra | 17:48 | |
| clarkb | mordred: so we could rewrite all our configs to be canonical? | 17:48 |
| *** janki has quit IRC | 17:48 | |
| clarkb | (its probably not a bad idea to do that out of canonicalness) | 17:48 |
| mordred | clarkb: yes, we totally could | 17:48 |
| mordred | clarkb: indeed - I was just thinking for some of the jobs intended to be re-used, it might be a friendly thing to do | 17:48 |
| clarkb | but probably also a massive change that at his point would just be pain | 17:48 |
| mordred | yah | 17:49 |
| mordred | let's wait until we rename or don't rename all the repos | 17:49 |
| mordred | SamYaple: tl;dr - yah, would totally support 3rd-arty integration ... also, tristanC is a good person to ping about softwarefactory if you look at it and have issues/questions. also dmsimard | 17:50 |
| *** xarses_ has joined #openstack-infra | 17:50 | |
| *** edmondsw has quit IRC | 17:50 | |
| SamYaple | awesome. totally rad as the kids are saying | 17:51 |
| dmsimard | yeah, happy to help | 17:51 |
| fungi | could mostly be done as one change to project-config and one change to openstack-zuul-jobs and then expect individual projects to take care of it themselves if and when they want to? | 17:51 |
| fungi | or would there be situations where we need lock-step change of project names in different repos? | 17:52 |
| *** slaweq__ has quit IRC | 17:52 | |
| dmsimard | fungi: yeah, in fact we're just now winding down zuul v2 on review.rdoproject.org and we're actually not going to "upgrade" to zuul v3, we're enabling zuul v3 *to* review.rdoproject.org's gerrit from softwarefactory-project.io with a standalone tenant and everything | 17:52 |
| dmsimard | https://softwarefactory-project.io/zuul/rdoproject.org/status.html <-- | 17:53 |
| fungi | neat | 17:53 |
| *** dtantsur is now known as dtantsur|afk | 17:53 | |
| *** xarses has quit IRC | 17:53 | |
| fungi | and a sane way to go about it | 17:53 |
| dmsimard | I know multi-tenancy is still fairly uncharted territory but we're happy to chart that :) | 17:53 |
| fungi | whatever new lands you discover, you get to name after yourself too | 17:53 |
| fungi | the soverign kingdom of dmsimardia | 17:54 |
| SamYaple | samtropolis | 17:54 |
| dmsimard | let's... not do that :) | 17:54 |
| fungi | er, sovereign | 17:54 |
| fungi | fungitopia | 17:55 |
| clarkb | dmsimard: how areyou handling gating? I guess projects must convert to v3 totally for gating once they are ready? | 17:55 |
| dmsimard | clarkb: yeah the plan is to flip the switch on a project basis | 17:56 |
| *** armaan has joined #openstack-infra | 17:56 | |
| dmsimard | clarkb: (We don't have 1500 projects like upstream) | 17:56 |
| fungi | that does probably make it a little more convenient | 17:57 |
| fungi | also you probably don't have tens of thousands of jobs to reimplement in a new language | 17:57 |
| *** VW_ has quit IRC | 17:57 | |
| dmsimard | Yeah, it's actually not worth it for us to try and make the zuul migration script work for us | 17:57 |
| dmsimard | fungi: exactly | 17:57 |
| *** slaweq__ has joined #openstack-infra | 17:58 | |
| *** VW_ has joined #openstack-infra | 18:01 | |
| *** slaweq__ has quit IRC | 18:03 | |
| jlvillal | Review request openstack-infra/puppet-gerritbot: Have gerritbot install from git: https://review.openstack.org/#/c/546700/ Has one +2 already. Thanks! | 18:03 |
| *** lucasagomes is now known as lucas-afk | 18:04 | |
| *** felipemonteiro has joined #openstack-infra | 18:05 | |
| *** VW_ has quit IRC | 18:06 | |
| *** edmondsw has joined #openstack-infra | 18:07 | |
| *** derekh has quit IRC | 18:07 | |
| *** slaweq__ has joined #openstack-infra | 18:08 | |
| *** r-daneel has joined #openstack-infra | 18:10 | |
| *** slaweq__ has quit IRC | 18:12 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:13 | |
| *** VW has joined #openstack-infra | 18:15 | |
| AJaeger | infra-root, could I get a second +2 on this infra-manual change to better explain new project creation? https://review.openstack.org/#/c/528375/ | 18:18 |
| clarkb | AJaeger: I'll take a look | 18:18 |
| AJaeger | thanks, clarkb. | 18:18 |
| clarkb | jlvillal: I'm your first +2 right? | 18:18 |
| *** slaweq__ has joined #openstack-infra | 18:18 | |
| AJaeger | there're also a few other open reviews for infra-manual if anybody is interested... | 18:18 |
| mordred | infra-root: ok - NOW I'm going to try unsticking puppet on zuul01 | 18:20 |
| clarkb | mordred: am here to help debug further if necessary | 18:20 |
| *** psachin has joined #openstack-infra | 18:20 | |
| mordred | clarkb: woot. fingers crossed it just all works as it's supposed to this time | 18:21 |
| AJaeger | mnaser: could you review this puppet related change, please? https://review.openstack.org/#/c/550339/ | 18:21 |
| *** slaweq__ has quit IRC | 18:23 | |
| mordred | infra-root : done - zuul.openstack.org looks correct ... | 18:25 |
| mordred | and log streaming also looks correct (thanks for the css fix tobiash) | 18:25 |
| *** mgoddard_ has quit IRC | 18:25 | |
| * clarkb tries hard refresh | 18:26 | |
| *** agopi has quit IRC | 18:26 | |
| jlvillal | clarkb, Yes! :) | 18:26 |
| mordred | incidentally, moving forward we should't need hard refreshes anymore ... | 18:26 |
| clarkb | mordred: does this include jquery update yet or will that come after enabling puppet? | 18:26 |
| mordred | the webpack output js bundles are hash-named | 18:26 |
| *** agopi has joined #openstack-infra | 18:26 | |
| mordred | clarkb: includes the jquery update | 18:26 |
| *** harlowja has quit IRC | 18:26 | |
| tobiash | \o/ | 18:26 |
| * mordred should write up a little summary of the webpack output pieces somewhere ... | 18:27 | |
| pabelanger | new CSS | 18:27 |
| tobiash | mordred: I just put this into production too an hour ago | 18:27 |
| mordred | tobiash: \o/ | 18:27 |
| *** edmondsw has quit IRC | 18:27 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Better explain needed changes https://review.openstack.org/528375 | 18:27 |
| *** andreww has joined #openstack-infra | 18:28 | |
| clarkb | mordred: that must become part of the vendor.js? | 18:28 |
| mordred | also -if anyone needs to do in-browser js debugging, we're serving complete map files, so your browser js debugger should be able to show you non-minified javascript (and if it doesn't, it's a bug) | 18:28 |
| *** felipemonteiro has quit IRC | 18:28 | |
| *** slaweq__ has joined #openstack-infra | 18:29 | |
| clarkb | mordred: firefox doesn't appear to be showing non minified at least not by default | 18:29 |
| clarkb | oh I'm looking at the network side of things though maybe console will do the right thing | 18:29 |
| *** VW has quit IRC | 18:29 | |
| mordred | clarkb: yah - dev console is the one thatknows how to side-load map files | 18:29 |
| pabelanger | neat! maybe I can finally figure out how to add back finger:// urls :) | 18:29 |
| clarkb | confirmed, the debugger shows normal sources | 18:30 |
| clarkb | and from that I see updated jquery | 18:30 |
| mordred | clarkb: there are three files - manifest.js - vendor.js and main.js - all the zuul-web code should be in main.js - vendor.js is the bundle containing all the deps (since they change less frequently, so browsers can cache that bundle longer) and manifest is build artifacts that contain timestamps - may change with every build, but it doesn't matter since it's tiny | 18:30 |
| mordred | clarkb: woot! | 18:30 |
| tobiash | clarkb: are all elements in diskimage-builder tested? | 18:30 |
| tobiash | I found the package which breaks me | 18:30 |
| tobiash | it's ca-certificates-java on xenial | 18:31 |
| clarkb | tobiash: no not all elements will be tested | 18:31 |
| *** xarses_ has quit IRC | 18:31 | |
| clarkb | tobiash: the testing we do that builds full images and boots them is fairly limited due to test runtime constraints | 18:31 |
| tobiash | clarkb: where do I have to inject that to try to reproduce in openstack ci? | 18:31 |
| mordred | mnaser: we can finally get back to the work you started in refactoring the status page! | 18:31 |
| clarkb | tobiash: probably in the nodepool src integration jobs. They run against dib and will install dib (and its elements from source) then build an image with them | 18:32 |
| tobiash | clarkb: I'd like to see if that's en environmental problem I have | 18:32 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove newton jobs https://review.openstack.org/548352 | 18:32 |
| clarkb | tobiash: probably the update you need is to update the nodepool elements list in that job | 18:32 |
| tobiash | thanks, will try that later | 18:32 |
| clarkb | tobiash: nodepool/devstack/plugin.sh to update the nodepool dib config | 18:33 |
| tobiash | but for the time being, I removed all java stuff (was legacy leftovers) from my dibs which unbreaks me for recent dib | 18:33 |
| *** slaweq__ has quit IRC | 18:33 | |
| *** edmondsw has joined #openstack-infra | 18:33 | |
| AJaeger | config-core, please review these two cleanups for openstack-zuul-jobs: https://review.openstack.org/#/c/550190/ https://review.openstack.org/#/c/548352/ | 18:35 |
| *** r-daneel_ has joined #openstack-infra | 18:35 | |
| *** edmondsw has quit IRC | 18:35 | |
| *** edmondsw_ has joined #openstack-infra | 18:35 | |
| *** r-daneel has quit IRC | 18:35 | |
| *** r-daneel_ is now known as r-daneel | 18:35 | |
| AJaeger | dmsimard: are https://review.openstack.org/549245 and https://review.openstack.org/547130 still needed? I think we solved them differently and they could be abandoned | 18:36 |
| AJaeger | dmsimard: and also https://review.openstack.org/545994 | 18:36 |
| AJaeger | mordred: do we still need https://review.openstack.org/528484 ? | 18:37 |
| dmsimard | AJaeger: abandoned the first two, https://review.openstack.org/#/c/545994/ is for something else and I still need it | 18:38 |
| AJaeger | dmsimard: thanks | 18:38 |
| mordred | AJaeger: yah - I think we can recheck then land it | 18:38 |
| dmsimard | AJaeger: thanks for helping me stay on top of my things :) | 18:39 |
| *** slaweq__ has joined #openstack-infra | 18:39 | |
| * dmsimard doesn't have any cores for the amount of threads he's working on | 18:39 | |
| dmsimard | s/any/enough/ | 18:39 |
| AJaeger | ;) | 18:40 |
| AJaeger | dirk: what about https://review.openstack.org/548967 and https://review.openstack.org/547779 - are those still needed? | 18:40 |
| AJaeger | zuul experts, https://review.openstack.org/#/c/510907/ has three +2s - but is not merged. Any reason to not +A this now? | 18:41 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove glance rally job definitions https://review.openstack.org/550190 | 18:41 |
| AJaeger | mordred: oh, we just forgot to recheck? That's sad ;( | 18:42 |
| *** yamamoto has joined #openstack-infra | 18:42 | |
| mordred | AJaeger: :) | 18:42 |
| *** amoralej is now known as amoralej|off | 18:43 | |
| clarkb | AJaeger: 510907 looks like maybe pabelanger and corvus didn't realize they both +2'd at about the same time | 18:43 |
| clarkb | AJaeger: probably safe to approve it | 18:43 |
| mordred | dmsimard: we used to have a Sun box in the drizzle build farm that had 256 hardware threads and could do really impressively massive parallel builds | 18:43 |
| *** VW has joined #openstack-infra | 18:43 | |
| *** slaweq__ has quit IRC | 18:44 | |
| *** VW has quit IRC | 18:44 | |
| *** olaph has joined #openstack-infra | 18:44 | |
| clarkb | mordred: niagara2? | 18:44 |
| mordred | dmsimard: otoh - each individual thread was SUPER slow - so the total time to do a build was about the same as doing the same build on a mac mini | 18:44 |
| mordred | clarkb: yah | 18:44 |
| clarkb | ya 1.2ghz and had to share integer and fp units with other cores iirc | 18:44 |
| *** VW has joined #openstack-infra | 18:44 | |
| mordred | I'll tell you what - make -j on that box would find _every_ flaw in your makefile dependencies | 18:44 |
| *** olaph1 has quit IRC | 18:45 | |
| *** olaph1 has joined #openstack-infra | 18:46 | |
| *** germs has quit IRC | 18:48 | |
| *** yamamoto has quit IRC | 18:48 | |
| *** olaph has quit IRC | 18:48 | |
| *** tesseract has quit IRC | 18:49 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove newton jobs https://review.openstack.org/548352 | 18:49 |
| *** slaweq__ has joined #openstack-infra | 18:49 | |
| AJaeger | andreaf: could you resolve the conflict in https://review.openstack.org/#/c/540890, please? I see consensus to move this but code has changed a bit... | 18:49 |
| *** edmondsw_ has quit IRC | 18:53 | |
| *** edmondsw has joined #openstack-infra | 18:53 | |
| *** sshnaidm|ptg has joined #openstack-infra | 18:53 | |
| *** slaweq__ has quit IRC | 18:54 | |
| *** bobh has quit IRC | 18:54 | |
| *** pcichy has quit IRC | 18:55 | |
| *** david-lyle has quit IRC | 18:56 | |
| *** germs has joined #openstack-infra | 18:56 | |
| *** germs has quit IRC | 18:56 | |
| *** germs has joined #openstack-infra | 18:56 | |
| *** trown|lunch is now known as trown|rover | 18:57 | |
| *** trown|rover is now known as trown|lunch | 18:58 | |
| *** trown|lunch is now known as trown|rover | 18:58 | |
| *** slaweq__ has joined #openstack-infra | 18:59 | |
| *** jamesmcarthur has quit IRC | 19:00 | |
| *** panda is now known as panda|off | 19:03 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/pipelines route https://review.openstack.org/541521 | 19:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/jobs.html page to display jobs https://review.openstack.org/535545 | 19:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects web page https://review.openstack.org/537870 | 19:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Fix indentation and renable the eslint rule https://review.openstack.org/545671 | 19:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/jobs/{job_name} route https://review.openstack.org/550978 | 19:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects routes https://review.openstack.org/550979 | 19:03 |
| *** edmondsw has quit IRC | 19:03 | |
| *** edmondsw has joined #openstack-infra | 19:03 | |
| *** slaweq__ has quit IRC | 19:04 | |
| *** r-daneel has quit IRC | 19:04 | |
| *** r-daneel has joined #openstack-infra | 19:04 | |
| mordred | infra-root: I'm taking zuul01 out of the emergency file | 19:05 |
| clarkb | mordred: thanks | 19:05 |
| mordred | infra-root: (unless anyone has any objections) | 19:05 |
| mordred | clarkb: mirror.regionone.tripleo-test-cloud-rh1.openstack.org is not a thing anymore right? | 19:05 |
| *** smcginnis has left #openstack-infra | 19:05 | |
| clarkb | mordred: that seems right? pabelanger can probably confirm | 19:06 |
| mordred | clarkb: also - we're aware wiki.openstack.org is in the emergency file? | 19:06 |
| clarkb | mordred: yes, I want to say the wiki is still in limbo | 19:06 |
| mordred | kk | 19:06 |
| mordred | pabelanger: I can still ssh to mirror.regionone.tripleo-test-cloud-rh1.openstack.org - so maybe it should stay in the emergency file? | 19:06 |
| *** ralonsoh has quit IRC | 19:07 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Parameterize the test-setup role https://review.openstack.org/510907 | 19:08 |
| *** slaweq__ has joined #openstack-infra | 19:09 | |
| mnaser | mordred: woo, im not sure where that patch is by now :D | 19:09 |
| *** harlowja has joined #openstack-infra | 19:11 | |
| gema | clarkb: I am going to make a pledge to our members for HW at our next event, can you give me a back of the envelope number as to how many vCPUs/memory would be needed to cover all the openstack projects on ARM64? Peak capacity I guess is what I am after | 19:11 |
| openstackgerrit | Tobias Henkel proposed openstack/diskimage-builder master: DNM: test ca-certificates-java https://review.openstack.org/550981 | 19:11 |
| gema | clarkb: will probably be asking for clouds at different sitest/vendors | 19:11 |
| gema | sites* | 19:11 |
| gema | ianw: ^ | 19:11 |
| *** SumitNaiksatam has quit IRC | 19:11 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: DNM: dib test ca-certificates-java https://review.openstack.org/550982 | 19:12 |
| clarkb | gema: http://grafana.openstack.org/dashboard/db/nodepool is probably a good place to look. In particular the in-use nodes. That count is for VMs used. Until we have performance numbers on arm its hard to know exactly how well that lines up | 19:13 |
| *** Swami has joined #openstack-infra | 19:13 | |
| gema | clarkb: ok | 19:13 |
| clarkb | gema: our total quota of x86 test vm nodes floats around 1k right now adn during peak utilization (feature freeze typically is a busy) we hit that limit for most of the day every working day | 19:13 |
| openstackgerrit | Tobias Henkel proposed openstack/diskimage-builder master: DNM: dib run test ca-certificates-java https://review.openstack.org/550983 | 19:14 |
| clarkb | gema: one thing to keep in mind is to start we probably won't run as many overall jobs on arm simply because we'll have to sort through bugs and fix things so not everything will be testable | 19:14 |
| gema | 1k nodes meaning 8vCPU/8G ram nodes? | 19:14 |
| clarkb | gema: yes | 19:14 |
| gema | ack | 19:14 |
| *** slaweq__ has quit IRC | 19:14 | |
| gema | clarkb: yep, I am trying to give them a long term goal | 19:14 |
| * persia wishes gema excellent results from such a call for pledges | 19:14 | |
| clarkb | on the low end 250 test vm nodes is probably a good place to start to start doing larger scale testing then grow from there as demand works? | 19:14 |
| clarkb | (its a balancing act between askign for too much and getting chased away and asking for too little and not getting work done :) ) | 19:15 |
| gema | clarkb: yep, I know | 19:15 |
| persia | Starting from a couple hundred (ideally from different providers) for basic testing makes sense. | 19:15 |
| fungi | mordred: clarkb: yes, wiki very much in limbo, waiting for me or someone to have time to finish getting it config-managed (it never has been in reality) | 19:15 |
| persia | If we end up with 1K or more, we might usefully have a discussion about how to influence demand. | 19:15 |
| fungi | our actual wiki.o.o is a symlink to wiki-upgrade-test.o.o which is a snapshot of an old non-configuration-managed, hand-deployed server from the dawn of time | 19:15 |
| gema | clarkb: thanks, will sift through grafana as well, but you gave what I need, I think | 19:15 |
| clarkb | gema: ya the graphite/grafana data is probably the best source of info | 19:16 |
| clarkb | gema: happy to answer other questions if you have them | 19:16 |
| gema | yep, thank you guys! | 19:16 |
| fungi | we have a configuration-managed wiki-dev.o.o which is not quite working and needs some more puppetry still as well as someone to troubleshoot why openid auth isn't working for it | 19:16 |
| AJaeger | gema: for example, I don't think we need to build docs on arm. | 19:16 |
| AJaeger | gema: and neither linters - so that removes some short-running but very frequent jobs | 19:17 |
| persia | AJaeger: We should at least run some of that, if only to make sure we can. | 19:17 |
| persia | (assuming we have sufficient capacity, etc.) | 19:17 |
| gema | AJaeger: you may want to run them on both at different times to ensure coverage? | 19:17 |
| persia | I remember there being some issues in a certain distribution when the default arch for stuff that didn't need to run on every arch changed from i386 to amd64, and more things broke than anyone anticipated. | 19:18 |
| AJaeger | a linter or docs building should be architecture independent, so no need to run them on two archs. | 19:18 |
| *** edmondsw has quit IRC | 19:18 | |
| *** harlowja has quit IRC | 19:18 | |
| gema | AJaeger: true, but at the end of the day you want to make sure the tooling for such builds is available on all archs | 19:18 |
| *** edmondsw has joined #openstack-infra | 19:18 | |
| AJaeger | persia: some duplicate testing might be nice - but I wouldn't overdo it. But that really depends how much nodes we get ;) | 19:18 |
| persia | AJaeger: Assuming capacity, maybe we can define those jobs in such a way that they would run on the first arch nodepool can make available? | 19:18 |
| persia | AJaeger: Absolutely :) | 19:18 |
| gema | AJaeger: which may or may not be the case, although in this case I think it is | 19:18 |
| *** ldnunes has quit IRC | 19:19 | |
| * mordred is excited about the various scheduling corner-cases the arm work is providing | 19:19 | |
| gema | mordred: indeed | 19:19 |
| AJaeger | persia, gema: In the bring up phase, I suggest to look to figure out where we expect problems and run those tests regularly. Once we have those stable, let's test more... | 19:19 |
| clarkb | persia: ya over time we might have labels like ubuntu-xenial, ubuntu-xenial-x86, ubuntu-xenial-arm64 then jobs that don't care can run on either | 19:19 |
| *** slaweq__ has joined #openstack-infra | 19:19 | |
| clarkb | jobs that do care can specify | 19:19 |
| clarkb | (this has the chance of introducing gate blockign bugs if we aren't careful but overall benefit should outweigh that if it means more capacity to get stuff done() | 19:20 |
| persia | AJaeger: For now, I think we're just trying to make sure we *can* test, and then will have selected projects bring up selected jobs on the limited capacity. Until we have a least 25x current capacity, I don't think we can do much. | 19:20 |
| AJaeger | persia, gema : I just wanted to point out that we probably do not need to run each and every job on both archs - and thus can life with fewer resources. | 19:20 |
| gema | AJaeger: totally agree with that | 19:21 |
| AJaeger | If we get 2000 powerful nodes, we can move jobs to arm ;) | 19:21 |
| persia | Part of the problem is that the way that we currently define nodesets means that we have to define each job separately for each architecture, which complicates things. | 19:21 |
| mordred | AJaeger: right? | 19:21 |
| clarkb | persia: or have generic labels like in my example | 19:21 |
| persia | Once we have a few hundred nodes, it becomes interesting to look at how to have jobs that run on whatever they can. | 19:21 |
| clarkb | persia: so ubuntu-xenial could mean x86 or arm64 then we make arch specific labels for people that need them | 19:21 |
| persia | clarkb: I like generic labels. I don't know how to define "ubuntu-xenial" in the nodepool config. | 19:22 |
| clarkb | that would require a bit of reworking of current jobs but is doable | 19:22 |
| AJaeger | yeah, quite a few interesting problems - looking forward to those ;) | 19:22 |
| gema | alright, let's get the capacity first, then we can figure out the scheduling | 19:22 |
| mordred | yup. all the issues show up when X goes from 1 to 2, it turns out | 19:22 |
| persia | I think *most* jobs wouldn't need reworking with a generic labels model (well, all the ARM jobs, but there aren't many yet). | 19:22 |
| clarkb | gema: ++ hope it goes well :) | 19:22 |
| gema | thanks, will let you know :D | 19:23 |
| * mordred hands gema a bunny rabbit | 19:23 | |
| *** edmondsw has quit IRC | 19:23 | |
| gema | mordred: lol | 19:23 |
| gema | thanks :D | 19:23 |
| *** jamesmcarthur has joined #openstack-infra | 19:23 | |
| *** slaweq__ has quit IRC | 19:24 | |
| tobiash | persia: nodepool already provides the needed abstraction layers for doing multiarch labels | 19:24 |
| *** edmondsw has joined #openstack-infra | 19:24 | |
| *** bobh has joined #openstack-infra | 19:24 | |
| persia | clarkb: Oh, on nomenclature, we probably want "ubuntu-xenial-arm64" and "ubuntu-xenial-amd64" to avoid mixing layers (x86_64 <-> aarch64). | 19:24 |
| tobiash | on the top level you define labels and in the provider.pools you have the supported labels per pool | 19:24 |
| *** danpawlik has joined #openstack-infra | 19:25 | |
| tobiash | you just need to list the same label in a x86 and an arm pool and you have that | 19:25 |
| persia | tobiash: Are there docs, or should I code-dive? I'd be delighted to get stuck into making "ubuntu-xenial" multiarch (with only "ubuntu-xenial-amd64" providers today) | 19:25 |
| tobiash | persia: labels (top level object): https://docs.openstack.org/infra/nodepool/configuration.html#labels | 19:26 |
| tobiash | and providers: https://docs.openstack.org/infra/nodepool/configuration.html#openstack-driver | 19:26 |
| tobiash | note that the provides list in the pools their supported labels | 19:26 |
| tobiash | s/provides/providers | 19:27 |
| tobiash | the diskimages the provider.pool.labels.diskimage refer to can be different | 19:28 |
| *** edmondsw has quit IRC | 19:28 | |
| *** edmondsw has joined #openstack-infra | 19:28 | |
| *** slaweq__ has joined #openstack-infra | 19:30 | |
| *** danpawlik has quit IRC | 19:30 | |
| *** bobh has quit IRC | 19:30 | |
| clarkb | the neat thing about testing liek this is openstack manages to touch all the things so if there are bugs to be found we will probably find them :) | 19:30 |
| clarkb | dirk: did you manage to root cause that networking bug any further? | 19:31 |
| persia | tobiash: Thanks. I think I have to dig through what we have a bit to understand how to apply that, but at first glance, it looks like none of the actual job definitions have to change at all. | 19:31 |
| gema | yeah, we will probably hit some races | 19:31 |
| persia | Well, except some of the arch-specific jobs (like wheel builders). | 19:31 |
| *** ldnunes has joined #openstack-infra | 19:31 | |
| *** bobh has joined #openstack-infra | 19:31 | |
| clarkb | persia: and any jobs that would be broken due to bugs. The conservative thing to do would be to switch all existing jobs to amd64 specific labels | 19:32 |
| tobiash | persia: in order to not break the jobs we micht want to do the multiarch on ubuntu-xenial-multiarch or something like that | 19:32 |
| clarkb | then switch them one by one or in groups based on pre merge test results on arm64 too | 19:32 |
| *** jamesmcarthur has quit IRC | 19:32 | |
| fungi | clarkb: gema: also once we're getting at least 100 nodes of capacity consistenly out of these environments, we can add linaro (or whoever is responsible for coordinating the donation) to https://www.openstack.org/foundation/companies/#infra-donors | 19:33 |
| persia | My thought would be to make sure all the amd64 providers are appropriately annotated, and some of the arch-specific jobs are changed, and not configure any arm clouds to provide "ubuntu-xenial". | 19:33 |
| mordred | yah - also, while we still have less arm nodes, limiting them to things where there's a higher reward, like devstack jobs, instead of all ubuntu-xenial where you might waste all the quota on pep8 jobs and not really prove anything about arm | 19:33 |
| *** harlowja has joined #openstack-infra | 19:33 | |
| gema | fungi: yep, will let our members know | 19:33 |
| persia | From that point, we can run selected test jobs to identify what works and what doesn't, and as things work, slowly expose the label (or adjust projects to be arch-specific, if necessary) | 19:33 |
| *** jamesmcarthur has joined #openstack-infra | 19:34 | |
| gema | mordred: +1, I was thinking devstack and kolla (since they keep telling us they cannot test our images) is a good place to start | 19:34 |
| *** slaweq__ has quit IRC | 19:34 | |
| persia | mordred: I believe the currently proposed ARM jobs consist of 1) wheel builders, 2) devstack, and 3) pep8. | 19:34 |
| gema | persia: kolla | 19:34 |
| persia | (3) is mostly there as a means of seeing if we can test (not yet), and I expect it not to be merged. | 19:34 |
| gema | persia: they were the ones instigating the entire thing :D | 19:34 |
| persia | gema: Excellent. I didn't see that yet. | 19:35 |
| fungi | they are good instigators! | 19:35 |
| persia | Indeed. | 19:35 |
| gema | persia: pep8 doesn't add much | 19:35 |
| *** jrist has joined #openstack-infra | 19:35 | |
| mordred | persia: ++ | 19:35 |
| fungi | instigation as a service | 19:35 |
| gema | fungi: indeed | 19:35 |
| mordred | gema: well, pep8 adds "does the system work for the most basic possible job" | 19:35 |
| gema | mordred: yeah, as an initial thing to test the provider, but it's not a high reward job (as you put it) | 19:36 |
| mordred | gema: but I agree, in general the value of running pep8 for validating openstack running on arm is ... very low | 19:36 |
| mordred | gema: ++ | 19:36 |
| *** _ari__ is now known as _ari_ | 19:36 | |
| gema | and after devstack and kolla, maybe nova and neutron | 19:36 |
| gema | keystone also expressed interest due to the crypto deps they have | 19:37 |
| *** bobh has quit IRC | 19:37 | |
| *** edmondsw has quit IRC | 19:38 | |
| *** jrist has quit IRC | 19:39 | |
| gema | anyway, calling it a day, thank you all for the insights | 19:40 |
| *** slaweq__ has joined #openstack-infra | 19:40 | |
| *** bobh has joined #openstack-infra | 19:40 | |
| persia | I believe the only two things the pep8 test is still testing are a) completing the ubuntu-ports mirror (pool and lists seem populated, but dists/ is oddly bare) and b) the ubuntu-xenial-aarch64 wheels mirror (in-progress, needs AFS admin, has a volunteer) | 19:40 |
| persia | After that, we can stop testing it (as not a good use of our limited resources) | 19:40 |
| *** prometheanfire has joined #openstack-infra | 19:41 | |
| *** edmondsw has joined #openstack-infra | 19:42 | |
| *** jrist has joined #openstack-infra | 19:42 | |
| *** agopi has quit IRC | 19:42 | |
| mordred | persia: ++ | 19:42 |
| pabelanger | mordred: clarkb yah, that mirror is no more | 19:42 |
| pabelanger | however it may still be online | 19:43 |
| *** edmondsw has quit IRC | 19:43 | |
| fungi | mtreinish: i suspect http://paste.openstack.org/show/695687/ indicates we ceased receiving new messages from lp around december 20 | 19:43 |
| *** yamamoto has joined #openstack-infra | 19:44 | |
| *** olaph1 has quit IRC | 19:44 | |
| fungi | though exim's mainlog shows messages getting delivered from bounces@canonical.com to the lpmqtt mailbox | 19:45 |
| *** slaweq__ has quit IRC | 19:45 | |
| *** edmondsw has joined #openstack-infra | 19:45 | |
| fungi | so maybe i'm misinterpreting the cyrus spool | 19:45 |
| *** edmondsw has quit IRC | 19:45 | |
| *** bobh has quit IRC | 19:45 | |
| * fungi needs to step away for a little while to cook dinner | 19:45 | |
| *** olaph has joined #openstack-infra | 19:46 | |
| *** r-daneel_ has joined #openstack-infra | 19:47 | |
| *** r-daneel has quit IRC | 19:47 | |
| *** r-daneel_ is now known as r-daneel | 19:47 | |
| *** danpawlik has joined #openstack-infra | 19:49 | |
| *** yamamoto has quit IRC | 19:50 | |
| *** slaweq__ has joined #openstack-infra | 19:50 | |
| *** r-daneel has quit IRC | 19:50 | |
| dmsimard | mordred: http://logs.openstack.org/71/545671/10/check/build-javascript-content/07bf929/npm/html/status.html confuses me (but it's nice that it works) | 19:51 |
| *** r-daneel has joined #openstack-infra | 19:51 | |
| *** r-daneel has quit IRC | 19:52 | |
| *** r-daneel has joined #openstack-infra | 19:52 | |
| persia | dmsimard: Is it the content, or that the URL works that is confusing? | 19:52 |
| *** bobh has joined #openstack-infra | 19:54 | |
| *** slaweq__ has quit IRC | 19:55 | |
| persia | If the latter, I'll mention that for Storyboard, this is considered a very convenient way to quickly examine the effects of javascript changes. If the former, I don't know anything. | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects routes https://review.openstack.org/550979 | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/pipelines route https://review.openstack.org/541521 | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/jobs.html page to display jobs https://review.openstack.org/535545 | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects web page https://review.openstack.org/537870 | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Fix indentation and renable the eslint rule https://review.openstack.org/545671 | 19:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects web page https://review.openstack.org/537870 | 19:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Fix indentation and renable the eslint rule https://review.openstack.org/545671 | 19:57 |
| mordred | dmsimard: \o/ | 19:58 |
| * mordred considers confusing dmsimard a successful part of any day | 19:58 | |
| *** bobh has quit IRC | 19:59 | |
| mordred | dmsimard: but yeah, like persia said, we started doing that pattern for storyboard. it's facilitated by having the js/html stuff be a standalone thing that talks to a remote api - as opposed to a more 'traditional' web app where there is server-side templating/rendering of html | 19:59 |
| dmsimard | persia: it's mostly an awesome confusion, like, hey, that works | 20:00 |
| mordred | (and is one of the reasons I've become such an ardent supporter of that model) | 20:00 |
| *** slaweq__ has joined #openstack-infra | 20:00 | |
| * persia vaguely hopes that every web UI in OpenStack eventually moves in that direction | 20:00 | |
| mordred | ++ | 20:00 |
| dmsimard | mordred: it's actually pretty interesting and with the component split of ara I might consider doing something like that -- I haven't yet settled on the "frontend" consumption model | 20:00 |
| *** slaweq__ has quit IRC | 20:01 | |
| * dmsimard is not a frontend person | 20:01 | |
| *** slaweq__ has joined #openstack-infra | 20:01 | |
| mordred | dmsimard: I _highly_ recommend such a split - and would be happy to help you consider it | 20:01 |
| rm_work | is there a pattern we typically use for bash checks that "needle in haystack"? like shorthand for [[ "$VAR" = "thing1" ]] || [[ "$VAR" = "thing2" ]] | 20:01 |
| mtreinish | fungi: hmm, well iirc we have lpmqtt configured to delete the messages after it pushes the mqtt event | 20:02 |
| dmsimard | mordred: I'll probably need help when I get to that point, I suck at angular/react/vuejs/$hipframework :) | 20:03 |
| mordred | dmsimard: well - I did too until about 6 months ago - I have learned _many_ things since then - hopefully enough that I can help you out there | 20:04 |
| mnaser | so when should i start hacking on my old angular patch | 20:04 |
| * mnaser has a few flights with idle time | 20:04 | |
| *** psachin has quit IRC | 20:04 | |
| mordred | mnaser: now is great. just be sure to start with https://review.openstack.org/#/c/545671 as the base so you don't have to fight an indentation rework patch | 20:05 |
| mnaser | mordred: clarkb: pabelanger: and i think i might see you at ONS too! | 20:05 |
| mnaser | s/might/will/ so we can catch up there | 20:05 |
| mordred | mnaser: the status page is even already inside of an angular controller already | 20:05 |
| mordred | mnaser: woot! | 20:05 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: DNM: dib test ca-certificates-with-fix https://review.openstack.org/550990 | 20:05 |
| clarkb | mnaser: I am literally in the process of booking atht trip right now | 20:05 |
| * persia suddenly regrets having decided to miss ONS this year | 20:05 | |
| mnaser | oh sweet, that is a whole amount of work already done | 20:05 |
| pabelanger | mnaser: sadly, I won't be going. But should be a good meet up | 20:06 |
| mnaser | pabelanger: aw darn | 20:06 |
| clarkb | pabelanger: you should make sure fatih knows as space was limited | 20:06 |
| mnaser | ^ yeah | 20:06 |
| * mnaser is waiting on a wait-list | 20:06 | |
| pabelanger | clarkb: yah, I can ping him on email, but did mention at PTG | 20:06 |
| mnaser | i'm booking my flight to come earlier for it anyways.. in hopes of no-shows | 20:06 |
| clarkb | currently looking at hotels and wondering why they are all so pricey. LA I guess | 20:06 |
| mnaser | yeah it looks like the hotel for the venue is sold out? | 20:07 |
| clarkb | mnaser: note Fatih's thing is over the weekend not during normal ons | 20:07 |
| clarkb | mnaser: ya I think you can get booked there on non conf rate | 20:07 |
| mordred | mnaser: ping me if you're about to start hacking on things - I have a personal todo-list item to extract the places where we're calling the rest api into a Service - which might overlap a little with your status work - but as long as we keep chatting it should be fine | 20:07 |
| mnaser | clarkb: oh yeah, so ill be coming in earlier to be able to catch it | 20:07 |
| clarkb | but its like $350/night | 20:07 |
| *** r-daneel_ has joined #openstack-infra | 20:07 | |
| mnaser | mordred: i will do so, probably more towards the end of the month to be honest, a lot going on right now | 20:08 |
| *** r-daneel has quit IRC | 20:08 | |
| *** r-daneel_ is now known as r-daneel | 20:08 | |
| mnaser | clarkb: im still getting my ticket to ONS and havent gotten to the flight part yet so if you find something reasonable and close, let me know :> | 20:08 |
| pabelanger | clarkb: email sent | 20:08 |
| *** sshnaidm|ptg is now known as sshnaidm|afk | 20:08 | |
| clarkb | mnaser: http://www.standardhotels.com/la/properties/downtown-la is on the cheaper end near the conf but I feel like I may not be cool enough for that hotel | 20:09 |
| mnaser | upside down logo | 20:09 |
| mordred | mnaser: ok. I'll probably be done with the bits of refactor I want to do by then | 20:09 |
| mnaser | mordred: perfect, just let me know what to build on top of | 20:10 |
| mnaser | (once it exists) | 20:10 |
| *** eernst has quit IRC | 20:10 | |
| mordred | mnaser: ++ | 20:10 |
| *** bobh has joined #openstack-infra | 20:10 | |
| *** salv-orlando has quit IRC | 20:10 | |
| * mnaser starts registering to ONS for the third time in hopes of not being interrupted again | 20:10 | |
| * mordred interrupts mnaser | 20:10 | |
| *** eernst has joined #openstack-infra | 20:10 | |
| mnaser | mordred: its okay, i wanted to go through a painfully long 4 page registration form another time anyways | 20:11 |
| * mordred interrupts mnaser again, just to be annoying | 20:12 | |
| mordred | are we there yet? are we there yet? | 20:12 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove storyboard webclient publication jobs https://review.openstack.org/528484 | 20:12 |
| mnaser | i dont know if anyone worked enough in the hosting industry to know this but | 20:12 |
| * mnaser perl udp.pl mordred | 20:12 | |
| clarkb | I think I will just book the standard because it is cheap | 20:13 |
| mnaser | ok so registered at ONS officially | 20:14 |
| *** bobh has quit IRC | 20:15 | |
| mnaser | book flight or hotel first has always been a dillema | 20:15 |
| AJaeger | mnaser: could you review this puppet related change, please? https://review.openstack.org/#/c/550339/ | 20:16 |
| mnaser | AJaeger: i thought i did but never pressed the submit, oops | 20:16 |
| mordred | mnaser: dude. I'm just impressed that you ran a perl script at me. I feel like wendar and I are the only people still around with significant perl backgrounds ... | 20:17 |
| AJaeger | mnaser: ;) | 20:18 |
| mnaser | i have a long perl past lol | 20:18 |
| tobiash | perl was the first scripting language I used, but not for long... ;) | 20:18 |
| AJaeger | perl? that was ~20 years ago... | 20:18 |
| * AJaeger is getting old ;( | 20:19 | |
| mnaser | are we hiding our windows history | 20:19 |
| mnaser | visual basic anyone? | 20:19 |
| *** rlandy has quit IRC | 20:19 | |
| mordred | AJaeger: yah - last time I wrote perl professionally was in 2000 - when I was living in amsterdam working for a startup that did visualization of competitive business intelligence | 20:19 |
| mordred | using, of course, graphviz as the actual visualization engine :) | 20:19 |
| mnaser | i think that was my first "oh my god i just built an actual thing that runs with a gui" | 20:20 |
| tobiash | mnaser: yeah, my first programming language :) | 20:20 |
| mordred | mnaser, tobiash I have written C# for money - but I've somehow avoided ever writing any lines of visual basic | 20:20 |
| mordred | my first programing language was TI Basic though | 20:20 |
| *** dprince has quit IRC | 20:20 | |
| tobiash | now I feel young :) | 20:21 |
| mordred | tobiash: we had 4k of RAM!!!! | 20:21 |
| mordred | _so_ many things you can do in 4k of RAM - as long as none of them are parsing xml | 20:22 |
| *** dprince has joined #openstack-infra | 20:22 | |
| *** bobh has joined #openstack-infra | 20:22 | |
| *** olaph has quit IRC | 20:23 | |
| *** olaph has joined #openstack-infra | 20:24 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove puppet-openstack-libraries-jobs jobs https://review.openstack.org/550339 | 20:25 |
| *** bobh has quit IRC | 20:28 | |
| persia | Could someone poke https://review.openstack.org/545726 ? https://review.openstack.org/545703 landed, but the same job name in two places seems to cause the tests to run against older node. | 20:28 |
| persia | e.g. search for "Output node version" in http://logs.openstack.org/43/548343/1/check/nodejs-npm-run-lint/c9e56dd/job-output.txt.gz | 20:29 |
| *** bobh has joined #openstack-infra | 20:30 | |
| *** beagles is now known as beagles|biab | 20:34 | |
| *** bobh has quit IRC | 20:35 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove cursive legacy jobs https://review.openstack.org/550996 | 20:39 |
| fungi | mnaser: i hide any and all windows experience (for fear someone might ask me to recall any of it) | 20:40 |
| *** felipemonteiro has joined #openstack-infra | 20:40 | |
| fungi | there was a time when i put a lot of effort into integrating windows nt 3.5, windows 95 and sco openserver 5 | 20:40 |
| *** claudiub has joined #openstack-infra | 20:41 | |
| fungi | everything ended in 5 | 20:41 |
| *** bobh has joined #openstack-infra | 20:41 | |
| *** d0ugal_ has joined #openstack-infra | 20:42 | |
| mordred | fungi: I had an NT 3.5 server that was part of a ludicrous set of interdependencies involved in scanning barcodes with wireless scanners in warehouses | 20:42 |
| mordred | dos, os/2 and AIX were also all involved, amazingly enough | 20:43 |
| *** efoley has quit IRC | 20:43 | |
| mordred | surprisingly, none of that is on my resume anywhere | 20:43 |
| mordred | ;) | 20:43 |
| *** tosky has quit IRC | 20:44 | |
| *** d0ugal has quit IRC | 20:44 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove cursive legacy jobs https://review.openstack.org/550999 | 20:45 |
| *** yamamoto has joined #openstack-infra | 20:46 | |
| *** tosky has joined #openstack-infra | 20:47 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove cursive legacy jobs https://review.openstack.org/550999 | 20:48 |
| fungi | it pains me to think about how not-open sco "openserver" was | 20:48 |
| *** edmondsw has joined #openstack-infra | 20:49 | |
| fungi | though with their skunkworks cd you could still install a basic gnu toolchain | 20:50 |
| *** edmondsw has quit IRC | 20:50 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove cursive legacy jobs https://review.openstack.org/550996 | 20:50 |
| *** edmondsw has joined #openstack-infra | 20:51 | |
| *** yamamoto has quit IRC | 20:51 | |
| *** olaph1 has joined #openstack-infra | 20:52 | |
| *** olaph has quit IRC | 20:53 | |
| *** eernst has quit IRC | 20:54 | |
| *** eernst has joined #openstack-infra | 20:54 | |
| *** salv-orlando has joined #openstack-infra | 20:54 | |
| *** edmondsw has quit IRC | 20:55 | |
| tobiash | clarkb: got it to reproduce: http://logs.openstack.org/82/550982/1/check/nodepool-functional-py35-src/8edb463/controller/logs/builds/ubuntu-xenial-0000000012_log.txt.gz#_2018-03-08_20_29_25_749 | 20:56 |
| andreaf | AJaeger: ok ... the new code supports the case of empty value as well which was not supported before, so I need to keep that in and remove list | 20:57 |
| *** lpetrut has quit IRC | 20:58 | |
| tobiash | clarkb: while with the fix it works: http://logs.openstack.org/90/550990/1/check/nodepool-functional-py35-src/7a700e2/controller/logs/builds/ubuntu-xenial-0000000001_log.txt.gz#_2018-03-08_20_33_37_497 | 20:58 |
| clarkb | tobiash: cool ianw ^^ | 20:58 |
| *** dprince has quit IRC | 20:59 | |
| tobiash | that can be reproduced easily with a ubuntu-xenial build and installing ca-certificates-java via package-installs | 21:00 |
| *** tosky has quit IRC | 21:02 | |
| *** kjackal has joined #openstack-infra | 21:03 | |
| *** olaph1 is now known as olaph | 21:05 | |
| *** masber has joined #openstack-infra | 21:05 | |
| *** david-lyle has joined #openstack-infra | 21:07 | |
| *** edmondsw has joined #openstack-infra | 21:11 | |
| *** edmondsw has quit IRC | 21:11 | |
| *** edmondsw has joined #openstack-infra | 21:12 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove castellan legacy jobs https://review.openstack.org/551008 | 21:12 |
| *** prometheanfire has quit IRC | 21:12 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** prometheanfire has joined #openstack-infra | 21:17 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove castellan legacy jobs https://review.openstack.org/551011 | 21:18 |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove castellan legacy jobs https://review.openstack.org/551011 | 21:19 |
| *** eharney has quit IRC | 21:19 | |
| *** felipemonteiro has quit IRC | 21:22 | |
| *** nicolasbock has quit IRC | 21:23 | |
| *** eumel8 has quit IRC | 21:24 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove castellan legacy jobs https://review.openstack.org/551011 | 21:24 |
| *** eumel8 has joined #openstack-infra | 21:25 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove castellan legacy jobs https://review.openstack.org/551008 | 21:25 |
| *** eumel8 has quit IRC | 21:33 | |
| gema | mordred: you just reminded me of visual basic, C++ and java (all of which I did not manage to avoid back in the day where there was no github... just perforce)... x) | 21:33 |
| *** r-daneel has quit IRC | 21:34 | |
| *** pblaho has quit IRC | 21:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: DNM https://review.openstack.org/551015 | 21:36 |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove glance legacy job https://review.openstack.org/551016 | 21:37 |
| *** gouthamr has quit IRC | 21:38 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/openstack-zuul-jobs master: Remove glance legacy job https://review.openstack.org/551019 | 21:40 |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Remove glance legacy job https://review.openstack.org/551016 | 21:41 |
| *** trown|rover is now known as trown|outtypewww | 21:44 | |
| *** salv-orlando has quit IRC | 21:44 | |
| *** salv-orlando has joined #openstack-infra | 21:45 | |
| *** david-lyle has quit IRC | 21:45 | |
| *** aeng has joined #openstack-infra | 21:46 | |
| *** threestrands has joined #openstack-infra | 21:47 | |
| *** yamamoto has joined #openstack-infra | 21:47 | |
| *** salv-orlando has quit IRC | 21:49 | |
| *** r-daneel has joined #openstack-infra | 21:52 | |
| *** yamamoto has quit IRC | 21:53 | |
| *** yamamoto has joined #openstack-infra | 21:53 | |
| *** hemna_ has quit IRC | 21:55 | |
| *** salv-orlando has joined #openstack-infra | 21:55 | |
| *** rlandy has joined #openstack-infra | 21:56 | |
| *** gfidente|afk has quit IRC | 21:56 | |
| *** hamzy has quit IRC | 21:57 | |
| *** Goneri has quit IRC | 21:57 | |
| *** jrist has quit IRC | 21:58 | |
| *** bobh has quit IRC | 21:59 | |
| *** ihrachys has quit IRC | 21:59 | |
| *** danpawlik has quit IRC | 21:59 | |
| *** camunoz has joined #openstack-infra | 22:00 | |
| *** e0ne has joined #openstack-infra | 22:00 | |
| *** florianf has quit IRC | 22:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: DNM https://review.openstack.org/551015 | 22:08 |
| *** kjackal has quit IRC | 22:20 | |
| *** eernst has quit IRC | 22:21 | |
| *** eernst has joined #openstack-infra | 22:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: DNM https://review.openstack.org/551015 | 22:23 |
| *** claudiub has quit IRC | 22:24 | |
| mordred | infra-root: zuul01 has been removed from the emergency file... when I said earlier I was going to do that- I may have forgotten to :wq in the editor window :) | 22:25 |
| *** masber has quit IRC | 22:25 | |
| pabelanger | mordred: do you have any ideas on how we could run http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/mirror-workspace-git-repos/tasks/main.yaml#n9 but in an untrusted context? Right now, we don't allow shell execution on zuul-executor | 22:25 |
| *** claudiub has joined #openstack-infra | 22:25 | |
| *** rcernin has joined #openstack-infra | 22:25 | |
| pabelanger | mordred: if it was the git module in ansible, it likely would be fine but because command we block it | 22:26 |
| *** wolverineav has joined #openstack-infra | 22:28 | |
| *** smcginnis has joined #openstack-infra | 22:31 | |
| clarkb | ianw: tobiash I have rereviewed the encoding fix change and left a new comment on what may help explain what is going on | 22:32 |
| *** david-lyle has joined #openstack-infra | 22:32 | |
| *** d0ugal_ has quit IRC | 22:34 | |
| *** rcernin_ has joined #openstack-infra | 22:34 | |
| *** rcernin_ has quit IRC | 22:35 | |
| *** rcernin_ has joined #openstack-infra | 22:36 | |
| *** rcernin has quit IRC | 22:36 | |
| *** d0ugal_ has joined #openstack-infra | 22:36 | |
| jlvillal | So all the dependency patches seem to have merged for https://review.openstack.org/#/c/536746/ But it doesn't appear to be starting the gate job. Any ideas? | 22:36 |
| *** rcernin_ has quit IRC | 22:37 | |
| *** camunoz has quit IRC | 22:39 | |
| mordred | pabelanger: I'm not sure- I'm not sure there's a good reason we couldn't rework that to use the git module instead - but I'm curious why you want to run it in a different context (like what's the issue?) | 22:39 |
| *** armaan has quit IRC | 22:39 | |
| *** armaan has joined #openstack-infra | 22:39 | |
| pabelanger | mordred: issue is, in a multinode setup, I only want to push git repos to a single node, not all. today, our base jobs will push them to all | 22:39 |
| *** esberglu_ has joined #openstack-infra | 22:40 | |
| *** rcernin has joined #openstack-infra | 22:40 | |
| pabelanger | mordred: so, by only running that role on a specific host in playbook, I can achieve that | 22:40 |
| pabelanger | but, can't do that today, because delegate_to: localhost doesn't allow command | 22:40 |
| pabelanger | I agree, we likely should update the git module in ansible to support --mirror | 22:41 |
| mordred | yah | 22:41 |
| clarkb | jlvillal: they likely don't share a gate queue so you'll have to reapprove or recheck | 22:41 |
| clarkb | jlvillal: things are only auto enqueued when they are cogated together | 22:41 |
| jlvillal | clarkb, Ah thanks. | 22:41 |
| mordred | pabelanger: that makes me think that we should figure out some way *waves hands wildly* to update the base playbook to support the use case of "only want git repos on a subset of nodes" | 22:41 |
| mordred | pabelanger: oh! duh. host lists can include negative matchers - which can be groups, and which can be groups that don't exist | 22:42 |
| *** jlvillal has left #openstack-infra | 22:42 | |
| *** jlvillal has joined #openstack-infra | 22:42 | |
| *** esberglu has quit IRC | 22:43 | |
| mordred | pabelanger: we could update the base playbook play for syncing git repos to be hosts: 'all:!no-git' - and if you want a node to not get git repos pushed to it, just add it to the no-git group in your nodeset? | 22:43 |
| pabelanger | mordred: yah, I had an idea of how to do that, but it required adding extra-vars support into zuul. Then we can template the hosts setting with a {{ foo_hostlist | default(all) }}, but putting foo_hostlist into host / groups vars won't work, because it is loaded too late in ansible | 22:43 |
| pabelanger | mordred: Yah, I mean that would work too | 22:44 |
| *** edmondsw has quit IRC | 22:44 | |
| *** edmondsw has joined #openstack-infra | 22:44 | |
| pabelanger | maybe it is that easy | 22:44 |
| jlvillal | Did the Circle X button in http://zuul.openstack.org/ stop working for other people? In the "filters" box. | 22:44 |
| mordred | pabelanger: I think so - I'm not 100% sure how group set intersection works ... | 22:44 |
| jlvillal | I've tried it in Firefox and Chrome. | 22:45 |
| pabelanger | mordred: ack, I can poke more at it locally | 22:45 |
| mordred | jlvillal: yah. broken for me too ... I'm guessing it broke in the recent js patches :( | 22:45 |
| jlvillal | mordred, Thanks. and :( | 22:45 |
| mordred | pabelanger: we do this in remote_puppet_else.yaml: - hosts: '!review.openstack.org:!git0*:!zuul-scheduler:!afs*:!baremetal*:!controller*:!compute*:!puppetmaster*:!disabled' | 22:45 |
| mordred | pabelanger: so maybe instead of "all:!no-git" it just wants to be "!no-git" | 22:46 |
| mordred | pabelanger: (food for thought while you poke) | 22:46 |
| pabelanger | k | 22:46 |
| *** hasharDinner has quit IRC | 22:46 | |
| mordred | pabelanger: cause I think that's totally a reasonable thing for people with multi-node jobs to want | 22:47 |
| pabelanger | yah, I figure more then just me will eventually like that :) | 22:47 |
| *** armaan has quit IRC | 22:49 | |
| *** jrist has joined #openstack-infra | 22:49 | |
| *** armaan has joined #openstack-infra | 22:50 | |
| *** edmondsw has quit IRC | 22:51 | |
| *** edmondsw has joined #openstack-infra | 22:52 | |
| mordred | jlvillal: hrm. I'm looking at the code that handles that and it doesn't make any sense to me why it wouldn't work - or would have stopped working | 22:53 |
| *** masber has joined #openstack-infra | 22:54 | |
| *** tosky has joined #openstack-infra | 22:55 | |
| *** suhdood has joined #openstack-infra | 22:56 | |
| jlvillal | mordred, :( | 22:56 |
| *** edmondsw has quit IRC | 22:56 | |
| *** esberglu_ has quit IRC | 22:59 | |
| *** esberglu has joined #openstack-infra | 23:00 | |
| *** jamesmcarthur has quit IRC | 23:02 | |
| *** esberglu has quit IRC | 23:04 | |
| *** suhdood has quit IRC | 23:04 | |
| mordred | jlvillal: because I know you want a play-by-play - the x icon elementis not receiving the onclick ... | 23:08 |
| jlvillal | mordred, Thanks for figuring it out :) | 23:11 |
| *** wolverineav has quit IRC | 23:11 | |
| auristor | mordred pabelanger: to reduce the cost of pulling git repos everywhere you should look at the git virtual filesystem work that Microsoft did. https://gvfs.io/ | 23:12 |
| *** slaweq__ has quit IRC | 23:13 | |
| auristor | microsoft keeps all of their code in one git repo and it doesn't matter which subtrees are required by which nodes. only the altered files are pulled down to any node. | 23:13 |
| auristor | it uses the standard git distribution. I'm not sure what Linux specific bits will need to be written to implement the virtual file system layer. Its sort of like a fuse based overlay but not quite. | 23:15 |
| fungi | in this case we're trying to reduce runtime network dependence by pushing contents onto test nodes before job payloads are initiated, as network failures during job runtime are much harder to detect than if they're performed in advance | 23:17 |
| fungi | and in random service providers at the scale we're running individual jobs, every network operation we can eliminate during the job is one less chance for a random false negative | 23:18 |
| auristor | so you want to pin certain subtrees or directories or files on certain nodes | 23:18 |
| jlvillal | auristor, Looks like it is Windows 10 only. | 23:18 |
| *** esberglu has joined #openstack-infra | 23:18 | |
| auristor | yes, Microsoft's implement of the virtual file system is Windows 10 only. The git changes are universal and are supported by github | 23:19 |
| *** jrist has quit IRC | 23:19 | |
| auristor | https://arstechnica.com/gadgets/2017/11/microsoft-and-github-team-up-to-take-git-virtual-file-system-to-macos-linux/ | 23:22 |
| *** esberglu has quit IRC | 23:23 | |
| *** mriedem has quit IRC | 23:23 | |
| *** slaweq__ has joined #openstack-infra | 23:23 | |
| auristor | according to that article github is working on a linux version of the virtual file system to be delivered after a macOS port | 23:24 |
| *** yamamoto_ has joined #openstack-infra | 23:24 | |
| clarkb | enovance did something similar shoving all of your git objects into swift. But I think it was slow beacuse it lacked the virtual fs layer and everything was an http request to swift | 23:26 |
| auristor | yeah, that would hurt | 23:27 |
| auristor | AFS caching of the git content would be more efficient | 23:27 |
| *** VW_ has joined #openstack-infra | 23:27 | |
| *** yamamoto has quit IRC | 23:27 | |
| clarkb | fwiw our git repo cache on the images seems to have worked really well over time | 23:28 |
| *** slaweq__ has quit IRC | 23:28 | |
| clarkb | (which the syncing playbooks takes into account) | 23:29 |
| clarkb | (its why it is somewhat complicated rather than just a stright up copy | 23:29 |
| *** VW has quit IRC | 23:31 | |
| *** VW_ has quit IRC | 23:32 | |
| *** threestrands_ has joined #openstack-infra | 23:33 | |
| mordred | jlvillal: oh - I haven't figured anything out yet ... I've just identified at least one thing that's not working ... still a mystery as to _why_ or how to fix it :) | 23:33 |
| fungi | yeah, basically as long as things are working we maintain a <24h old copy of the repos which are present on the rootfs when a node is booted, and then push recent differences for the specific repos a given job needs during our setup phase | 23:34 |
| *** slaweq__ has joined #openstack-infra | 23:34 | |
| clarkb | jlvillal: mordred looks like if you highlight the text and delete it that works | 23:34 |
| clarkb | so at least you don't get stuck in that state | 23:34 |
| *** rcernin has quit IRC | 23:35 | |
| mordred | yes. there's definitely a workaround | 23:35 |
| *** rcernin has joined #openstack-infra | 23:35 | |
| *** threestrands has quit IRC | 23:36 | |
| *** tosky has quit IRC | 23:37 | |
| mordred | auristor: that's neat - unfortunately in this particular case the thing we're pushing around are the speculative commits that zuul has just computed for the test job in question that have not yet landed in any central repo - so regardless of how the underlying repos might be cached, we'll still need to get the speculative commits in place on test nodes so that they can be tested | 23:37 |
| *** yamamoto has joined #openstack-infra | 23:38 | |
| *** slaweq__ has quit IRC | 23:38 | |
| auristor | np | 23:38 |
| mordred | auristor: it's an interesting take on things though | 23:39 |
| mordred | heh. ZOMG ... this article though " Git wasn't designed for such vast numbers of developers—more than 3,000 actively working on the codebase. " | 23:39 |
| mordred | welcome to our life for the past several years microsoft | 23:39 |
| auristor | that has been their life for 30 years | 23:39 |
| mordred | yah - I'm just saying- we took a decidedly different approach to google and microsoft with dealing with k's of developers and source code - which does not involve a monorepo | 23:40 |
| mordred | it's nice to see we're not the only ones with the problem though :) | 23:40 |
| *** tosky has joined #openstack-infra | 23:41 | |
| auristor | if you watch the video they explain some of the reasons why small repos didn't work for them | 23:41 |
| *** yamamoto_ has quit IRC | 23:41 | |
| persia | The various articles linked from https://kernelnewbies.org/DevelopmentStatistics would suggest git was specifically designed for that number of developers (or more) | 23:41 |
| auristor | but not that size of repo | 23:41 |
| clarkb | you could also archive probably 80% of the history there maybe? (I have no real hard data to go off of) | 23:42 |
| *** wolverineav has joined #openstack-infra | 23:42 | |
| persia | auristor: small repos tend not to work for folk used to large repos, and vice versa. It is a matter of philosophy, rather than there being an answer. | 23:43 |
| clarkb | would be neat if shallow clones worked better | 23:43 |
| mordred | auristor: I don't see a video in that article? | 23:43 |
| auristor | video from gvfs.io | 23:43 |
| mordred | oh. gotcha | 23:43 |
| *** slaweq__ has joined #openstack-infra | 23:44 | |
| persia | clarkb: Shallow clones working better would make things faster, but in many cases, it is very useful to have full history when working on projects with multi-decade histories, as there is often no shared context for why things were done other than can be gleaned from commit messages at the time (often read in batches, e.g. everything that landed some week, rather than individual commits). | 23:44 |
| mordred | woot. I found a non-video page with explanations: https://www.visualstudio.com/learn/gvfs-design-history/ | 23:44 |
| clarkb | persia: ya but you can go looking for that specifically when you need it and ignore it otherwise | 23:45 |
| persia | Absolutely. | 23:45 |
| clarkb | persia: I've worked on code basese older than I am so I'm familar with some of that | 23:45 |
| clarkb | yay avionics | 23:45 |
| persia | I have yet to be able to make that claim. I'm not sure I'd want to be able to do so. | 23:45 |
| mordred | "Smaller repos would mean simpler scale challenges in each individual repo, but they also make it much more difficult to do cross-cutting changes that have to touch the code in all of those repos. Multiple repos also make your release process more complicated. In the end, if the scale issues can be solved, having one repo often makes the overall workflows far simpler." | 23:46 |
| auristor | it all depends on your ago :) | 23:46 |
| mordred | I'm poking at this because I find it interesting that the more we poke the more the underlying understanding of the problem statement is actually the same | 23:46 |
| mordred | but the choice of which part to solve is different | 23:47 |
| clarkb | of course we used borland star team so we all just hated the revision control system | 23:47 |
| clarkb | and it hated us | 23:47 |
| mordred | which is kind of neat | 23:47 |
| clarkb | I'm sure the code wasn't in revision control for a good chunk of its life too | 23:47 |
| *** jamesmcarthur has joined #openstack-infra | 23:47 | |
| *** wolverineav has quit IRC | 23:47 | |
| mordred | they decided writing a file system and keeping a monorepo view was the right way to allocate resources to the problem, we instead tackled cross-repo coordination and release issues | 23:47 |
| clarkb | mordred: I think some of that has to do with being a single organization vs many organizations | 23:47 |
| mordred | I think they lay out the tradeoff nicely | 23:48 |
| clarkb | mordred: we essentially map some of our human interaction and organizing onto the code bases | 23:48 |
| clarkb | for big single org big single repo | 23:48 |
| mordred | but they're not one single big org | 23:48 |
| mordred | they are a collection of strongly balkanized competing orgs | 23:48 |
| *** slaweq__ has quit IRC | 23:48 | |
| clarkb | mordred: windows isn't though is it? | 23:49 |
| *** s-shiono has joined #openstack-infra | 23:49 | |
| mordred | clarkb: there is no way 3000 developers are a single cohesive org | 23:49 |
| clarkb | mordred: I mean on paper they are | 23:49 |
| mordred | on paper we are too | 23:49 |
| persia | Many strongly balkanised competing orgs find monorepo better than silos in part because of the org chart structure. It permits commits that do not involve coordinating with multiple layers of management. | 23:49 |
| mordred | persia: indeed | 23:49 |
| persia | mordred: I work with at least one company with > 5000 developers that is actively a cohesive single org, and individual developers often wander between teams without much oversight (although reporting lines are adjusted quarterly or so to catch up). | 23:50 |
| persia | I also know other companies where no group of more than 5 people is permitted to speak to another without a third party mediating the discussion. There are many choices, most of which seem good in particular contexts. | 23:51 |
| *** jamesmcarthur has quit IRC | 23:51 | |
| mordred | also - they did explore multiple-repos stiched together and reference android's repo.py | 23:51 |
| persia | Personally, I feel monorepo is good when one starts with monorepo or finds monorepo a good way to work around internal comms issues. When one starts with multiple components, per-component development + integration automation feels more comfortable. | 23:52 |
| mordred | the gvfs-design-history is a really nice read | 23:52 |
| clarkb | fwiw we didn't do mono repo with borland starteam because i think we would haev all murdered each other if we tried | 23:52 |
| auristor | windows is not a single team with a single collective brain. they are not the Borg | 23:52 |
| clarkb | the check in semantics just weren't rich enough to allow distributed teams to effectively manipulate the code base without tons of communication | 23:53 |
| auristor | each team fights for resources and has their own priorities | 23:53 |
| *** slaweq__ has joined #openstack-infra | 23:54 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Propose a new time for weekly keystone meeting https://review.openstack.org/550260 | 23:55 |
| *** slaweq__ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!