| *** mriedem has joined #openstack-infra | 00:01 | |
| *** signed8bit is now known as signed8bit_Zzz | 00:04 | |
| *** jesusaur has quit IRC | 00:04 | |
| EmilienM | I was looking at http://status.openstack.org/openstack-health/#/?searchProject=tripleo&groupKey=build_name | 00:04 |
|---|---|---|
| EmilienM | and I found that the job name is also composed of the project name at the end, is it expected? | 00:04 |
| EmilienM | is it an openstcak health + zuul v3 thing? | 00:04 |
| *** bobh has quit IRC | 00:06 | |
| *** thorst has joined #openstack-infra | 00:08 | |
| *** thorst has quit IRC | 00:09 | |
| *** salv-orlando has quit IRC | 00:09 | |
| *** salv-orlando has joined #openstack-infra | 00:09 | |
| *** slaweq_ has joined #openstack-infra | 00:11 | |
| *** salv-orlando has quit IRC | 00:14 | |
| *** rakhmerov has quit IRC | 00:16 | |
| *** andreas_s has joined #openstack-infra | 00:16 | |
| *** slaweq_ has quit IRC | 00:16 | |
| gmann | clarkb: 1 quick question on zuulv3, can we append varibale's values in job definition? means base class have a set of value for variable and derived job append other value instead of override the original values. | 00:16 |
| *** asilenkov has quit IRC | 00:16 | |
| *** eumel8 has quit IRC | 00:17 | |
| *** dhill__ has joined #openstack-infra | 00:18 | |
| *** dhill_ has quit IRC | 00:18 | |
| *** rakhmerov has joined #openstack-infra | 00:19 | |
| clarkb | gmann if they are dict values that is how it works I think | 00:19 |
| clarkb | duplicate keys override new keys are added | 00:20 |
| *** asilenkov has joined #openstack-infra | 00:20 | |
| *** andreas_s has quit IRC | 00:20 | |
| *** vhosakot_ has joined #openstack-infra | 00:23 | |
| *** signed8bit_Zzz has quit IRC | 00:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove zk_cluster_members from iptables https://review.openstack.org/525352 | 00:23 |
| pabelanger | clarkb: ianw: mind a quick review^, removes firewall settings until we have servers online. Otherwise, we cannot start iptables | 00:24 |
| *** vhosakot has quit IRC | 00:26 | |
| gmann | clarkb: ok, i wanted for 'irrelevant-files' | 00:27 |
| ianw | pabelanger: is my comment there right? | 00:27 |
| *** hjensas has joined #openstack-infra | 00:28 | |
| *** hjensas has quit IRC | 00:28 | |
| *** hjensas has joined #openstack-infra | 00:28 | |
| *** tosky has quit IRC | 00:32 | |
| *** masber has quit IRC | 00:33 | |
| *** yamamoto has quit IRC | 00:36 | |
| *** lewo``` has joined #openstack-infra | 00:36 | |
| *** vhosakot has joined #openstack-infra | 00:37 | |
| *** lewo`` has quit IRC | 00:37 | |
| *** vhosakot_ has quit IRC | 00:38 | |
| *** yamamoto has joined #openstack-infra | 00:38 | |
| pabelanger | ianw: yup, right | 00:39 |
| *** masber has joined #openstack-infra | 00:41 | |
| *** dizquierdo has quit IRC | 00:42 | |
| *** danpawlik has joined #openstack-infra | 00:42 | |
| *** yamamoto has quit IRC | 00:44 | |
| *** danpawlik_ has quit IRC | 00:44 | |
| *** kiennt26 has joined #openstack-infra | 00:44 | |
| *** hjensas has quit IRC | 00:44 | |
| *** vhosakot has quit IRC | 00:46 | |
| *** masber has quit IRC | 00:47 | |
| *** armax has quit IRC | 00:47 | |
| *** jamesmca_ has quit IRC | 00:50 | |
| *** felipemonteiro has quit IRC | 00:51 | |
| *** slaweq_ has joined #openstack-infra | 00:51 | |
| *** slaweq_ has quit IRC | 00:56 | |
| *** gyee has quit IRC | 00:56 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 01:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove file extension when building SimpleLayout https://review.openstack.org/525356 | 01:02 |
| ianw | jeblair: ^ hope you don't mind, wanted to level up on the details of zuul's unit testing so dug into that one a little | 01:02 |
| *** zhurong has joined #openstack-infra | 01:04 | |
| ianw | clarkb: i don't know why translate is in the disabled list ... should we take translate-dev out and let puppet run against it for a while as testing? | 01:04 |
| ianw | i was just about to manually apply that users update, but seems like we should just let puppet run and if there's issues, debug | 01:04 |
| *** matbu has quit IRC | 01:09 | |
| *** psachin has joined #openstack-infra | 01:10 | |
| *** salv-orlando has joined #openstack-infra | 01:10 | |
| *** dhinesh_ has quit IRC | 01:14 | |
| *** salv-orlando has quit IRC | 01:15 | |
| *** dhinesh has joined #openstack-infra | 01:15 | |
| *** matbu has joined #openstack-infra | 01:16 | |
| *** dhinesh_ has joined #openstack-infra | 01:17 | |
| *** dhinesh has quit IRC | 01:20 | |
| *** mat128 has joined #openstack-infra | 01:21 | |
| *** signed8bit has joined #openstack-infra | 01:22 | |
| *** slaweq_ has joined #openstack-infra | 01:23 | |
| *** jesusaur has joined #openstack-infra | 01:23 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 01:24 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Update playbook paths with extension https://review.openstack.org/525359 | 01:24 |
| *** caphrim007_ has joined #openstack-infra | 01:24 | |
| *** gouthamr has quit IRC | 01:24 | |
| *** liujiong has joined #openstack-infra | 01:25 | |
| gmann | clarkb: 'irrelevant-files' is list of regex, does zuul append this list or override ? | 01:26 |
| *** cshastri has joined #openstack-infra | 01:26 | |
| openstackgerrit | Le Hou proposed openstack-infra/infra-manual master: Gerrit generate Http password can`t contain "/" https://review.openstack.org/525096 | 01:27 |
| *** slaweq_ has quit IRC | 01:27 | |
| *** matbu has quit IRC | 01:27 | |
| *** caphrim007 has quit IRC | 01:27 | |
| *** jamesmcarthur has joined #openstack-infra | 01:28 | |
| *** caphrim007_ has quit IRC | 01:28 | |
| *** cuongnv has joined #openstack-infra | 01:31 | |
| *** jamesmcarthur has quit IRC | 01:31 | |
| *** jamesmcarthur has joined #openstack-infra | 01:32 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove zk_cluster_members from iptables https://review.openstack.org/525352 | 01:32 |
| *** jamesmca_ has joined #openstack-infra | 01:33 | |
| *** jamesmcarthur has quit IRC | 01:33 | |
| *** jamesmcarthur has joined #openstack-infra | 01:33 | |
| *** Apoorva_ has joined #openstack-infra | 01:37 | |
| *** jamesmca_ has quit IRC | 01:37 | |
| *** Apoorva has quit IRC | 01:40 | |
| *** yamamoto has joined #openstack-infra | 01:41 | |
| *** bobh has joined #openstack-infra | 01:41 | |
| *** Apoorva_ has quit IRC | 01:41 | |
| *** slaweq_ has joined #openstack-infra | 01:45 | |
| *** gouthamr has joined #openstack-infra | 01:45 | |
| *** yamamoto has quit IRC | 01:46 | |
| *** slaweq_ has quit IRC | 01:49 | |
| *** hrubi has quit IRC | 01:57 | |
| *** matbu has joined #openstack-infra | 01:57 | |
| *** hrubi has joined #openstack-infra | 01:58 | |
| *** felipemonteiro has joined #openstack-infra | 01:58 | |
| *** zhurong has quit IRC | 02:00 | |
| *** mriedem has quit IRC | 02:01 | |
| *** slaweq_ has joined #openstack-infra | 02:02 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove file extension when building SimpleLayout https://review.openstack.org/525356 | 02:03 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Update playbook paths with extension https://review.openstack.org/525359 | 02:03 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 02:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Move send_command() into ZuulApp https://review.openstack.org/523211 | 02:05 |
| *** camunoz has quit IRC | 02:05 | |
| *** gcb has joined #openstack-infra | 02:06 | |
| *** slaweq_ has quit IRC | 02:07 | |
| *** armax has joined #openstack-infra | 02:08 | |
| *** matbu has quit IRC | 02:08 | |
| clarkb | ianw: ya I think we should let puppet run on the dev server | 02:09 |
| *** salv-orlando has joined #openstack-infra | 02:11 | |
| pabelanger | ianw: clarkb: zk01.o.o online, I'll stand up the other 2 here now | 02:12 |
| *** jamesmcarthur has quit IRC | 02:13 | |
| *** matbu has joined #openstack-infra | 02:15 | |
| *** salv-orlando has quit IRC | 02:16 | |
| *** felipemonteiro_ has joined #openstack-infra | 02:17 | |
| clarkb | gmann: lists are overrides aiui | 02:19 |
| *** signed8b_ has joined #openstack-infra | 02:20 | |
| *** felipemonteiro has quit IRC | 02:20 | |
| *** felipemonteiro_ has quit IRC | 02:20 | |
| *** felipemonteiro_ has joined #openstack-infra | 02:21 | |
| pabelanger | zk02.o.o online, moving onto zk03 | 02:22 |
| pabelanger | ianw: just seen you finally got access to amazon | 02:23 |
| *** pbourke_ has quit IRC | 02:23 | |
| *** signed8bit has quit IRC | 02:24 | |
| *** pbourke_ has joined #openstack-infra | 02:25 | |
| *** felipemonteiro_ has quit IRC | 02:25 | |
| *** zhurong has joined #openstack-infra | 02:30 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 02:30 |
| *** jesusaur has quit IRC | 02:30 | |
| *** jesusaur has joined #openstack-infra | 02:31 | |
| pabelanger | okay, all 3 online | 02:32 |
| *** annp has joined #openstack-infra | 02:33 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Revert "Remove zk_cluster_members from iptables" https://review.openstack.org/525365 | 02:33 |
| pabelanger | and I see an issue, myID needs to be numeric, right now we are using hostname | 02:37 |
| pabelanger | will have to add some regex to extra the number from hostname | 02:38 |
| *** signed8b_ is now known as signed8bit_Zzz | 02:38 | |
| *** slaweq_ has joined #openstack-infra | 02:39 | |
| *** masber has joined #openstack-infra | 02:39 | |
| *** caphrim007 has joined #openstack-infra | 02:39 | |
| *** signed8bit_Zzz has quit IRC | 02:43 | |
| *** slaweq_ has quit IRC | 02:44 | |
| *** caphrim007 has quit IRC | 02:44 | |
| *** gouthamr has quit IRC | 02:46 | |
| *** gouthamr has joined #openstack-infra | 02:46 | |
| *** jamesmcarthur has joined #openstack-infra | 02:51 | |
| *** hongbin has joined #openstack-infra | 02:51 | |
| *** caphrim007 has joined #openstack-infra | 02:58 | |
| *** dhinesh_ has quit IRC | 03:03 | |
| *** ramishra has joined #openstack-infra | 03:05 | |
| *** links has joined #openstack-infra | 03:07 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 03:09 |
| *** slaweq_ has joined #openstack-infra | 03:10 | |
| ianw | pabelanger: amazon? | 03:10 |
| pabelanger | ianw: http://mashable.com/2017/12/04/amazon-australia-launch/ | 03:12 |
| *** salv-orlando has joined #openstack-infra | 03:12 | |
| ianw | oh right, yeah ... awesome or the end of the world, depending on who you talk to :) | 03:13 |
| pabelanger | :) | 03:14 |
| pabelanger | ianw: mind a quick review: https://review.openstack.org/525365/ | 03:14 |
| pabelanger | reverts firewall settings now that servers are online | 03:14 |
| ianw | oh right | 03:15 |
| *** slaweq_ has quit IRC | 03:15 | |
| ianw | bah i really messed up squashing the wrong patches in this zuul unit test thing ... arggh | 03:15 |
| *** salv-orlando has quit IRC | 03:17 | |
| *** dhinesh has joined #openstack-infra | 03:17 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove file extension when building SimpleLayout https://review.openstack.org/525356 | 03:20 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Update playbook paths with extension https://review.openstack.org/525359 | 03:20 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 03:20 |
| *** gouthamr has quit IRC | 03:23 | |
| *** edmondsw has quit IRC | 03:26 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove file extension when building SimpleLayout https://review.openstack.org/525356 | 03:26 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Update playbook paths with extension https://review.openstack.org/525359 | 03:26 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions https://review.openstack.org/525239 | 03:26 |
| *** threestrands has joined #openstack-infra | 03:27 | |
| *** dhinesh has quit IRC | 03:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Default $NODEPOOL_PROVIDER https://review.openstack.org/490037 | 03:31 |
| *** Apoorva has joined #openstack-infra | 03:33 | |
| *** jamesmcarthur has quit IRC | 03:36 | |
| *** jamesmcarthur has joined #openstack-infra | 03:36 | |
| *** rosmaita has quit IRC | 03:37 | |
| *** jamesmcarthur has quit IRC | 03:39 | |
| openstackgerrit | Merged openstack-infra/system-config master: Revert "Remove zk_cluster_members from iptables" https://review.openstack.org/525365 | 03:39 |
| *** gongysh has joined #openstack-infra | 03:43 | |
| *** slaweq_ has joined #openstack-infra | 03:44 | |
| *** jamesmcarthur has joined #openstack-infra | 03:44 | |
| *** thorst has joined #openstack-infra | 03:44 | |
| *** thorst has quit IRC | 03:46 | |
| *** slaweq_ has quit IRC | 03:48 | |
| *** yamamoto has joined #openstack-infra | 03:49 | |
| *** thorst has joined #openstack-infra | 03:53 | |
| *** thorst has quit IRC | 03:54 | |
| *** dave-mccowan has quit IRC | 04:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Set myid for zookeeper to numeric https://review.openstack.org/525419 | 04:05 |
| *** bobh has quit IRC | 04:05 | |
| *** gongysh has quit IRC | 04:06 | |
| pabelanger | ianw: ^last one for the night! | 04:06 |
| *** hongbin has quit IRC | 04:07 | |
| *** coolsvap has joined #openstack-infra | 04:08 | |
| *** ykarel|away has joined #openstack-infra | 04:13 | |
| *** salv-orlando has joined #openstack-infra | 04:13 | |
| *** psachin has quit IRC | 04:15 | |
| *** salv-orlando has quit IRC | 04:18 | |
| *** slaweq_ has joined #openstack-infra | 04:18 | |
| *** hongbin has joined #openstack-infra | 04:20 | |
| *** slaweq_ has quit IRC | 04:22 | |
| *** pgadiya has joined #openstack-infra | 04:24 | |
| *** bhavik1 has joined #openstack-infra | 04:25 | |
| *** zhurong has quit IRC | 04:27 | |
| *** psachin has joined #openstack-infra | 04:29 | |
| *** psachin has quit IRC | 04:32 | |
| *** bobh has joined #openstack-infra | 04:33 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Set myid for zookeeper to numeric https://review.openstack.org/525419 | 04:33 |
| ianw | missing , | 04:33 |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add new repo for congress tempest plugin https://review.openstack.org/525052 | 04:35 |
| *** dhajare has joined #openstack-infra | 04:38 | |
| *** hongbin has quit IRC | 04:39 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add system-required jobs to congress-tempest-plugin https://review.openstack.org/525421 | 04:40 |
| *** dhinesh has joined #openstack-infra | 04:43 | |
| *** nicolasbock has quit IRC | 04:48 | |
| *** udesale has joined #openstack-infra | 04:53 | |
| *** shu-mutou has joined #openstack-infra | 04:53 | |
| *** slaweq_ has joined #openstack-infra | 04:54 | |
| *** zhurong has joined #openstack-infra | 04:54 | |
| *** jaosorior has joined #openstack-infra | 04:55 | |
| *** slaweq_ has quit IRC | 04:59 | |
| ianw | ahh, i guess --delete doesn't remove f25 when it's still on the server ... hmm, have to manually fix that | 05:01 |
| *** bobh has quit IRC | 05:01 | |
| *** ianychoi has joined #openstack-infra | 05:07 | |
| *** psachin has joined #openstack-infra | 05:09 | |
| *** salv-orlando has joined #openstack-infra | 05:14 | |
| *** edmondsw has joined #openstack-infra | 05:14 | |
| *** andreas_s has joined #openstack-infra | 05:16 | |
| *** salv-orlando has quit IRC | 05:18 | |
| *** edmondsw has quit IRC | 05:18 | |
| *** andreas_s has quit IRC | 05:21 | |
| *** jamesmcarthur has quit IRC | 05:24 | |
| *** threestrands has quit IRC | 05:25 | |
| *** dklyle has joined #openstack-infra | 05:25 | |
| *** dhajare has quit IRC | 05:27 | |
| *** david-lyle has quit IRC | 05:29 | |
| *** dklyle has quit IRC | 05:30 | |
| *** slaweq_ has joined #openstack-infra | 05:32 | |
| *** slaweq_ has quit IRC | 05:37 | |
| *** aeng has quit IRC | 05:38 | |
| *** slaweq_ has joined #openstack-infra | 05:39 | |
| *** Apoorva has quit IRC | 05:41 | |
| *** sree has joined #openstack-infra | 05:41 | |
| *** slaweq_ has quit IRC | 05:44 | |
| *** mat128 has quit IRC | 05:47 | |
| *** gongysh has joined #openstack-infra | 05:47 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 05:50 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DNM - test dependencies https://review.openstack.org/525469 | 05:53 |
| *** rlandy has quit IRC | 05:57 | |
| *** janki has joined #openstack-infra | 05:58 | |
| *** dhajare has joined #openstack-infra | 06:09 | |
| *** slaweq_ has joined #openstack-infra | 06:10 | |
| *** salv-orlando has joined #openstack-infra | 06:14 | |
| *** slaweq_ has quit IRC | 06:15 | |
| *** salv-orlando has quit IRC | 06:19 | |
| *** oanson has quit IRC | 06:20 | |
| *** oanson has joined #openstack-infra | 06:20 | |
| *** jamesmcarthur has joined #openstack-infra | 06:23 | |
| *** CrayZee has quit IRC | 06:24 | |
| *** snapiri has joined #openstack-infra | 06:24 | |
| *** pgadiya has quit IRC | 06:25 | |
| *** gongysh has quit IRC | 06:25 | |
| *** jamesmcarthur has quit IRC | 06:28 | |
| *** alexchadin has joined #openstack-infra | 06:32 | |
| *** cuongnv has quit IRC | 06:34 | |
| ianw | #status log translate-dev.o.o removed from emergency list | 06:39 |
| openstackstatus | ianw: finished logging | 06:39 |
| *** armaan has joined #openstack-infra | 06:40 | |
| ianw | eumel8: after the next run, the admin changes should deploy. let me know if anything goes wrong and we can look into it | 06:40 |
| ianw | i'll check the logs tomorrow and make sure puppet is behaving | 06:40 |
| *** pgadiya has joined #openstack-infra | 06:42 | |
| Wei_Liu | Ajaeger_: hi, where can I post a bug for zuul? | 06:43 |
| *** slaweq_ has joined #openstack-infra | 06:47 | |
| *** kiennt26 has quit IRC | 06:48 | |
| snapiri | ianw: could you please help me push forward https://review.openstack.org/#/c/520320/ ? you have already reviewed it, but it is somehow still stuck... | 06:50 |
| *** slaweq_ has quit IRC | 06:52 | |
| *** sree has quit IRC | 06:52 | |
| *** armaan has quit IRC | 06:54 | |
| *** sree_ has joined #openstack-infra | 06:55 | |
| *** sree_ is now known as Guest18385 | 06:55 | |
| Wei_Liu | hi, can I post a zuul bug to https://storyboard.openstack.org/#!/project/679? | 06:55 |
| ianw | Wei_Liu: see storyboard -> https://storyboard.openstack.org/#!/project/679 | 06:55 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci master: WIP, test CI with experimental undercloud upgrade https://review.openstack.org/515361 | 06:56 |
| Wei_Liu | ianw: yes, I got this link, but there is only 'create new story', not bug? | 06:56 |
| *** armax has quit IRC | 06:57 | |
| ianw | Wei_Liu: yeah, consider a story like a bug. it has tasks and things, but it's more or less a place to track issues | 06:57 |
| *** udesale__ has joined #openstack-infra | 06:58 | |
| *** udesale has quit IRC | 06:58 | |
| Wei_Liu | ianw: thanks . | 06:59 |
| ianw | clarkb: can you just look at 520320 to make sure it's ok. | 06:59 |
| *** kjackal has joined #openstack-infra | 06:59 | |
| *** kjackal_ has joined #openstack-infra | 06:59 | |
| *** Guest18385 has quit IRC | 06:59 | |
| ianw | snapiri: i don't have time to monitor it right now, but if not approved tomorrow my time i will and track it | 06:59 |
| *** Swimingly has quit IRC | 06:59 | |
| *** sree has joined #openstack-infra | 07:00 | |
| *** udesale has joined #openstack-infra | 07:00 | |
| *** Swimingly has joined #openstack-infra | 07:00 | |
| *** Swimingly has quit IRC | 07:00 | |
| *** Swimingly has joined #openstack-infra | 07:00 | |
| *** udesale__ has quit IRC | 07:02 | |
| ianw | i know it's pretty trivial but i don't want to just walk away :) | 07:05 |
| *** kiennt26 has joined #openstack-infra | 07:07 | |
| *** sree has quit IRC | 07:07 | |
| *** sree has joined #openstack-infra | 07:08 | |
| *** pgadiya has quit IRC | 07:10 | |
| *** dhajare has quit IRC | 07:13 | |
| *** salv-orlando has joined #openstack-infra | 07:15 | |
| *** dhinesh has quit IRC | 07:15 | |
| *** zhurong has quit IRC | 07:16 | |
| *** lewo``` has quit IRC | 07:18 | |
| *** lewo has joined #openstack-infra | 07:18 | |
| *** salv-orlando has quit IRC | 07:20 | |
| *** slaweq__ has joined #openstack-infra | 07:22 | |
| *** pgadiya has joined #openstack-infra | 07:23 | |
| *** slaweq_ has joined #openstack-infra | 07:25 | |
| *** slaweq__ has quit IRC | 07:26 | |
| *** salv-orlando has joined #openstack-infra | 07:26 | |
| *** gridinv has quit IRC | 07:28 | |
| *** slaweq_ has quit IRC | 07:29 | |
| *** pcaruana has joined #openstack-infra | 07:32 | |
| *** cuongnv has joined #openstack-infra | 07:32 | |
| *** jamesmcarthur has joined #openstack-infra | 07:34 | |
| *** sree has quit IRC | 07:37 | |
| *** sree has joined #openstack-infra | 07:37 | |
| gmann | clarkb: humm, i was thinking to keep some of the 'irrelevant-files' in base job definition and projects specific one they can append. but seems not possible | 07:38 |
| *** jamesmcarthur has quit IRC | 07:38 | |
| *** andreas_s has joined #openstack-infra | 07:41 | |
| gmann | clarkb: this comment, if you have any optimized way - https://review.openstack.org/#/c/521887/3/.zuul.yaml@124 | 07:43 |
| *** rcernin has quit IRC | 07:48 | |
| *** zhurong has joined #openstack-infra | 07:49 | |
| *** kjackal_ has quit IRC | 07:50 | |
| *** kjackal has quit IRC | 07:50 | |
| openstackgerrit | Merged openstack-dev/pbr master: Support Description-Content-Type metadata https://review.openstack.org/521658 | 07:51 |
| *** dbecker has joined #openstack-infra | 07:52 | |
| snapiri | ianw: thanks | 07:54 |
| *** dsariel has joined #openstack-infra | 07:54 | |
| *** salv-orlando has quit IRC | 07:57 | |
| *** salv-orlando has joined #openstack-infra | 07:57 | |
| *** kjackal_ has joined #openstack-infra | 07:58 | |
| *** kjackal has joined #openstack-infra | 07:58 | |
| *** ralonsoh has joined #openstack-infra | 08:01 | |
| *** salv-orlando has quit IRC | 08:02 | |
| *** ykarel_ has joined #openstack-infra | 08:06 | |
| *** kjackal_ has quit IRC | 08:06 | |
| *** kjackal has quit IRC | 08:06 | |
| *** jascott1 has quit IRC | 08:07 | |
| *** jascott1 has joined #openstack-infra | 08:07 | |
| *** ykarel|away has quit IRC | 08:08 | |
| *** kjackal_ has joined #openstack-infra | 08:09 | |
| *** kjackal has joined #openstack-infra | 08:09 | |
| *** jaosorior_ has joined #openstack-infra | 08:10 | |
| *** jascott1 has quit IRC | 08:12 | |
| *** jaosorior has quit IRC | 08:13 | |
| *** jtomasek has joined #openstack-infra | 08:16 | |
| *** Hal has joined #openstack-infra | 08:18 | |
| *** slaweq_ has joined #openstack-infra | 08:19 | |
| *** kjackal_ has quit IRC | 08:20 | |
| *** kjackal has quit IRC | 08:20 | |
| *** hashar has joined #openstack-infra | 08:21 | |
| *** kjackal has joined #openstack-infra | 08:21 | |
| *** kjackal_ has joined #openstack-infra | 08:21 | |
| *** kjackal has quit IRC | 08:22 | |
| *** kjackal_ has quit IRC | 08:22 | |
| *** armaan has joined #openstack-infra | 08:22 | |
| *** florianf has joined #openstack-infra | 08:22 | |
| *** shardy has joined #openstack-infra | 08:24 | |
| *** tesseract has joined #openstack-infra | 08:24 | |
| *** priteau has joined #openstack-infra | 08:29 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: revoke-sudo: only revoke when zuul is sudoer https://review.openstack.org/522261 | 08:30 |
| *** ccamacho has joined #openstack-infra | 08:32 | |
| *** rcernin has joined #openstack-infra | 08:33 | |
| *** andreas_s has quit IRC | 08:35 | |
| *** andreas_s has joined #openstack-infra | 08:36 | |
| *** ykarel_ is now known as ykarel | 08:38 | |
| *** xarses has quit IRC | 08:39 | |
| *** dsariel has quit IRC | 08:40 | |
| *** pcaruana has quit IRC | 08:40 | |
| *** alexchadin has quit IRC | 08:42 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 08:44 |
| *** jaosorior_ is now known as jaosorior | 08:47 | |
| *** andreas_s has quit IRC | 08:47 | |
| *** salv-orlando has joined #openstack-infra | 08:47 | |
| *** andreas_s has joined #openstack-infra | 08:47 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: revoke-sudo: only revoke when zuul is sudoer https://review.openstack.org/522261 | 08:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: bindep: fix install bindep_command fact name https://review.openstack.org/525503 | 08:52 |
| *** martinkopec has joined #openstack-infra | 08:52 | |
| *** jpena|off is now known as jpena | 08:55 | |
| *** gmann is now known as gmann_afk | 08:56 | |
| *** jpich has joined #openstack-infra | 08:56 | |
| *** salv-orlando has quit IRC | 08:57 | |
| *** salv-orlando has joined #openstack-infra | 08:57 | |
| *** sshnaidm|off is now known as sshnaidm|rover | 08:58 | |
| *** salv-orlando has quit IRC | 09:02 | |
| *** quite has quit IRC | 09:09 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: bindep: skip package install when not needed https://review.openstack.org/525506 | 09:09 |
| *** armaan has quit IRC | 09:10 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: tox: make install_sibling_packages pip import optional https://review.openstack.org/525507 | 09:13 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 09:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 09:15 |
| *** armaan has joined #openstack-infra | 09:20 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: fetch-tox-output: remove --ignore-missing-args https://review.openstack.org/525510 | 09:20 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: negative test https://review.openstack.org/522438 | 09:22 |
| *** cody-somerville has joined #openstack-infra | 09:22 | |
| *** makowals has quit IRC | 09:25 | |
| *** makowals has joined #openstack-infra | 09:25 | |
| *** dtantsur|afk has quit IRC | 09:30 | |
| *** lucas-afk is now known as lucasagomes | 09:31 | |
| *** dtantsur has joined #openstack-infra | 09:33 | |
| *** dtantsur has quit IRC | 09:33 | |
| *** dtantsur has joined #openstack-infra | 09:33 | |
| *** dtantsur has quit IRC | 09:33 | |
| *** jamesmcarthur has joined #openstack-infra | 09:35 | |
| *** dizquierdo has joined #openstack-infra | 09:36 | |
| *** dtantsur has joined #openstack-infra | 09:38 | |
| *** e0ne has joined #openstack-infra | 09:39 | |
| *** derekh has joined #openstack-infra | 09:39 | |
| *** jamesmcarthur has quit IRC | 09:40 | |
| *** quite has joined #openstack-infra | 09:41 | |
| *** namnh has joined #openstack-infra | 09:45 | |
| Wei_Liu | ianw: hello, I am configuring the secret of my log server, I used my local private key which is generated by command "ssh-keygen -t rsa", when I start a job, I got an error: "Ciphertext length must be equal to key size", should I change "!encrypted/pkcs1-oaep"? | 09:47 |
| *** eumel8 has joined #openstack-infra | 09:51 | |
| *** owalsh_ is now known as owalsh | 09:52 | |
| eumel8 | good morning | 09:53 |
| eumel8 | I have some issues today on https://openstackid-dev.openstack.org/ Openid handshake doesn't work like yesterday. Is it me or an issue with DNS? | 09:54 |
| *** ganso has joined #openstack-infra | 09:55 | |
| *** makowals_ has joined #openstack-infra | 09:57 | |
| *** makowals has quit IRC | 09:58 | |
| *** dsariel has joined #openstack-infra | 09:58 | |
| ianw | eumel8: sorry i don't have time to dig right now, but i'm not really aware that we changed anything relating to that (on purpose :) | 10:01 |
| eumel8 | ianw: oh, you're already there ;) | 10:02 |
| *** priteau has quit IRC | 10:03 | |
| *** priteau has joined #openstack-infra | 10:04 | |
| eumel8 | ianw: just wondering, openid login worked correctly yesterday, then you merged the new admin list and today the openid login doesn't work anymore. It seems like an DNS issue because openid redirects to https://172.99.124.99:443/ instead https://translate-dev.openstack.org:443/ | 10:04 |
| *** spiffxp has quit IRC | 10:04 | |
| *** vipul has quit IRC | 10:05 | |
| eumel8 | ianw: the error could be also on openid-dev side. or on my computer. | 10:05 |
| *** spiffxp has joined #openstack-infra | 10:05 | |
| *** liujiong has quit IRC | 10:06 | |
| *** vipul has joined #openstack-infra | 10:08 | |
| *** armaan has quit IRC | 10:09 | |
| *** priteau has quit IRC | 10:09 | |
| *** cuongnv has quit IRC | 10:10 | |
| *** tosky has joined #openstack-infra | 10:11 | |
| *** sambetts|afk is now known as sambetts | 10:14 | |
| *** priteau has joined #openstack-infra | 10:16 | |
| *** spiffxp has quit IRC | 10:18 | |
| *** sshnaidm|rover is now known as sshnaidm|rover|a | 10:18 | |
| *** sshnaidm|rover|a is now known as sshnaidm|afk | 10:18 | |
| *** vipul has quit IRC | 10:19 | |
| *** spiffxp has joined #openstack-infra | 10:21 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 10:21 |
| *** sboyron has joined #openstack-infra | 10:21 | |
| *** kiennt26 has quit IRC | 10:22 | |
| *** vipul has joined #openstack-infra | 10:22 | |
| *** sree has quit IRC | 10:23 | |
| *** sree has joined #openstack-infra | 10:24 | |
| *** bhavik1 has quit IRC | 10:26 | |
| *** namnh has quit IRC | 10:29 | |
| *** sree has quit IRC | 10:29 | |
| *** rcernin has quit IRC | 10:30 | |
| *** dsariel has quit IRC | 10:32 | |
| *** annp has quit IRC | 10:33 | |
| *** jamesmcarthur has joined #openstack-infra | 10:36 | |
| *** kjackal has joined #openstack-infra | 10:40 | |
| *** jamesmcarthur has quit IRC | 10:41 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 10:43 | |
| *** andreas_s has quit IRC | 10:47 | |
| *** andreas_s has joined #openstack-infra | 10:47 | |
| *** dhajare has joined #openstack-infra | 10:49 | |
| *** ldnunes has joined #openstack-infra | 10:50 | |
| *** daidv has quit IRC | 10:50 | |
| *** wolverineav has joined #openstack-infra | 10:52 | |
| *** markmcd has quit IRC | 10:54 | |
| *** dhajare has quit IRC | 10:54 | |
| *** ianychoi has quit IRC | 10:55 | |
| *** ianychoi has joined #openstack-infra | 10:55 | |
| *** andreas_s has quit IRC | 10:56 | |
| *** andreas_s has joined #openstack-infra | 10:57 | |
| *** makowals_ has quit IRC | 11:01 | |
| *** dsariel has joined #openstack-infra | 11:02 | |
| *** daidv has joined #openstack-infra | 11:05 | |
| *** cshastri has quit IRC | 11:05 | |
| *** andreas_s has quit IRC | 11:07 | |
| *** jascott1 has joined #openstack-infra | 11:10 | |
| *** andreas_s has joined #openstack-infra | 11:12 | |
| *** xarses has joined #openstack-infra | 11:13 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/openstack-zuul-jobs master: Remove freezer-web-ui legacy jobs https://review.openstack.org/525528 | 11:13 |
| *** jascott1 has quit IRC | 11:14 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Remove freezer-web-ui legacy jobs https://review.openstack.org/525530 | 11:16 |
| *** sree has joined #openstack-infra | 11:17 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/openstack-zuul-jobs master: Remove freezer-web-ui legacy jobs https://review.openstack.org/525528 | 11:17 |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Remove freezer-web-ui legacy jobs https://review.openstack.org/525530 | 11:18 |
| *** andreas_s has quit IRC | 11:22 | |
| *** andreas_s has joined #openstack-infra | 11:23 | |
| ianw | eumel8: yeah, i just re-enabled puppet too, so that might be likely. i will look in my morning if clarkb doesn't get to it :) | 11:25 |
| eumel8 | ianw: great, thx. Good Night :) | 11:26 |
| *** andreas_s has quit IRC | 11:27 | |
| *** yamamoto has quit IRC | 11:28 | |
| *** udesale has quit IRC | 11:29 | |
| *** adarazs is now known as adarazs_lunch | 11:35 | |
| *** jkilpatr has quit IRC | 11:36 | |
| *** jamesmcarthur has joined #openstack-infra | 11:37 | |
| *** janki has quit IRC | 11:39 | |
| *** jamesmcarthur has quit IRC | 11:41 | |
| *** katkapilatova has joined #openstack-infra | 11:42 | |
| *** katkapilatova has left #openstack-infra | 11:42 | |
| *** alexchadin has joined #openstack-infra | 11:42 | |
| *** andreas_s has joined #openstack-infra | 11:42 | |
| *** cshastri has joined #openstack-infra | 11:47 | |
| *** ramishra has quit IRC | 11:50 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 11:50 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove workaround for periodic jobs https://review.openstack.org/525541 | 11:52 |
| *** jkilpatr has joined #openstack-infra | 11:55 | |
| *** edmondsw has joined #openstack-infra | 11:58 | |
| *** smatzek has joined #openstack-infra | 11:59 | |
| *** ramishra has joined #openstack-infra | 12:02 | |
| *** nicolasbock has joined #openstack-infra | 12:03 | |
| *** armaan has joined #openstack-infra | 12:03 | |
| *** cshastri has quit IRC | 12:03 | |
| *** edmondsw has quit IRC | 12:05 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Move ironic-bare-metal meeting to the #openstack-ironic channel https://review.openstack.org/525259 | 12:07 |
| *** adarazs_lunch is now known as adarazs | 12:13 | |
| *** lucasagomes is now known as lucas-hungry | 12:13 | |
| *** bobh has joined #openstack-infra | 12:14 | |
| *** pgadiya has quit IRC | 12:23 | |
| *** yamamoto has joined #openstack-infra | 12:28 | |
| *** yamamoto has quit IRC | 12:31 | |
| *** yamamoto has joined #openstack-infra | 12:31 | |
| *** ykarel_ has joined #openstack-infra | 12:34 | |
| *** alexchadin has quit IRC | 12:34 | |
| *** alexchadin has joined #openstack-infra | 12:35 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 12:35 |
| *** zhurong has quit IRC | 12:36 | |
| *** camunoz has joined #openstack-infra | 12:36 | |
| *** ykarel has quit IRC | 12:37 | |
| *** jamesmcarthur has joined #openstack-infra | 12:37 | |
| *** yamamoto has quit IRC | 12:38 | |
| *** yamamoto has joined #openstack-infra | 12:40 | |
| *** alexchadin has quit IRC | 12:40 | |
| *** alexchadin has joined #openstack-infra | 12:41 | |
| openstackgerrit | Hengqing Hu proposed openstack-infra/storyboard master: Remove build_sphinx section from setup.cfg https://review.openstack.org/525588 | 12:42 |
| *** jamesmcarthur has quit IRC | 12:42 | |
| *** sree has quit IRC | 12:44 | |
| *** zhurong has joined #openstack-infra | 12:44 | |
| *** Goneri has quit IRC | 12:45 | |
| *** david-lyle has joined #openstack-infra | 12:48 | |
| *** jpena is now known as jpena|lunch | 12:48 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 12:50 |
| *** dprince has joined #openstack-infra | 12:58 | |
| AJaeger_ | gmann_afk: see https://docs.openstack.org/infra/manual/zuulv3.html#how-jobs-are-selected-to-run-in-zuul-v3 "As long as at least one variant matches a change, the job will run; a variant can’t be used to “undo” an earlier matching variant." - that might be what you run into... | 12:59 |
| *** david-lyle has quit IRC | 13:01 | |
| *** zhurong has quit IRC | 13:02 | |
| *** zhurong has joined #openstack-infra | 13:02 | |
| *** rosmaita has joined #openstack-infra | 13:03 | |
| *** jcoufal has joined #openstack-infra | 13:05 | |
| *** cshastri has joined #openstack-infra | 13:06 | |
| *** edmondsw has joined #openstack-infra | 13:06 | |
| *** ramishra has quit IRC | 13:08 | |
| *** alexchadin has quit IRC | 13:09 | |
| *** rhallisey has joined #openstack-infra | 13:10 | |
| *** bobh has quit IRC | 13:11 | |
| *** lucas-hungry is now known as lucasagomes | 13:14 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/525603 | 13:14 |
| *** dhajare has joined #openstack-infra | 13:16 | |
| *** kashyap has joined #openstack-infra | 13:18 | |
| *** alexchadin has joined #openstack-infra | 13:21 | |
| *** links has quit IRC | 13:22 | |
| *** signed8bit has joined #openstack-infra | 13:24 | |
| *** makowals has joined #openstack-infra | 13:26 | |
| *** dizquierdo has quit IRC | 13:26 | |
| *** zhurong has quit IRC | 13:27 | |
| *** cshastri has quit IRC | 13:27 | |
| *** hichihara has joined #openstack-infra | 13:28 | |
| *** bobh has joined #openstack-infra | 13:29 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 13:29 |
| *** trown|outtypewww is now known as trown | 13:30 | |
| *** udesale has joined #openstack-infra | 13:32 | |
| *** rlandy has joined #openstack-infra | 13:33 | |
| *** psachin has quit IRC | 13:33 | |
| *** ldnunes has quit IRC | 13:40 | |
| *** e0ne_ has joined #openstack-infra | 13:40 | |
| *** janki has joined #openstack-infra | 13:40 | |
| *** e0ne has quit IRC | 13:43 | |
| *** annp has joined #openstack-infra | 13:45 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS https://review.openstack.org/525608 | 13:45 |
| *** jkilpatr has quit IRC | 13:47 | |
| *** yamamoto has quit IRC | 13:47 | |
| *** jkilpatr has joined #openstack-infra | 13:48 | |
| *** mihalis68 has joined #openstack-infra | 13:48 | |
| *** mriedem has joined #openstack-infra | 13:53 | |
| openstackgerrit | Jonathan Bryce proposed openstack-infra/system-config master: Enable logging on Kata IRC Channels https://review.openstack.org/525246 | 13:53 |
| *** ldnunes has joined #openstack-infra | 13:54 | |
| *** signed8bit has quit IRC | 13:54 | |
| *** signed8bit has joined #openstack-infra | 13:55 | |
| *** dave-mccowan has joined #openstack-infra | 13:56 | |
| *** jpena|lunch is now known as jpena | 13:57 | |
| *** dave-mcc_ has joined #openstack-infra | 13:59 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 13:59 |
| *** gongysh has joined #openstack-infra | 13:59 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul feature/zuulv3: WIP: Git driver https://review.openstack.org/525614 | 14:00 |
| *** dave-mccowan has quit IRC | 14:01 | |
| *** ldnunes has quit IRC | 14:02 | |
| *** mat128 has joined #openstack-infra | 14:03 | |
| *** esberglu has joined #openstack-infra | 14:03 | |
| *** gongysh has quit IRC | 14:04 | |
| *** ramishra has joined #openstack-infra | 14:05 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix variable name in npm-publish job https://review.openstack.org/525326 | 14:05 |
| *** kgiusti has joined #openstack-infra | 14:05 | |
| kashyap | Hi folks, this is a recurring topic for at least 3 years now: Is there any plans to enable some "regions" with nested KVM? | 14:06 |
| kashyap | We just plain emulated hardware ("TCG") in our env, which in long-term is a bit a disservice. As it's not matching what operators deploy in production | 14:07 |
| fungi | kashyap: not effectively, no. basically we'd need to find a way to filter it down to just amd-based processors and we don't have processor level granularity control anywhere | 14:08 |
| fungi | can't trust that specific providers or even specific regions won't mix intel and amd processors | 14:09 |
| kashyap | fungi: Why just AMD-level processors? | 14:09 |
| *** thorst has joined #openstack-infra | 14:09 | |
| kashyap | fungi: Intel nVMX receives extensive security audit upstream KVM list | 14:09 |
| fungi | hardware accelerated nested kvm is unstable and not recommended on intel cpus. the linux kernel disables it on intel by default and only default enables it for amd cpus | 14:09 |
| kashyap | fungi: And FWIW, recently I ran into Google Cloud folks at a recent KVM conference in Prague, and they too began offering nested virt as Beta since a few weeks. | 14:09 |
| kashyap | fungi: Sorry, that "unstable" argument is bogus | 14:10 |
| kashyap | fungi: The KVM maintainers ask: "Where are the bug reports" | 14:10 |
| fungi | i suggest you take it up with the kernel maintaniers, but we've been basing it off their recommendations | 14:10 |
| kashyap | fungi: I did take it up with the KVM Kernel maintainers :-) | 14:10 |
| kashyap | It is a tunable for a reason; upstream defaults are not "absolutely golden" | 14:11 |
| fungi | so they're changing the default? | 14:11 |
| *** yamamoto has joined #openstack-infra | 14:11 | |
| kashyap | fungi: Not that I know of. But are we predicated on that? | 14:12 |
| *** jascott1 has joined #openstack-infra | 14:12 | |
| fungi | we've used it as a sign for when it's going to be okay to depend on it working in a stable fashion anywhere besides just amd cpus (where they _do_ have it enabled by default) | 14:12 |
| *** ykarel_ is now known as ykarel|afk | 14:14 | |
| kashyap | fungi: Okay, I'll discuss w/ the KVM / Kernel folks & get to you what I hear | 14:15 |
| kashyap | Thanks for the chat | 14:15 |
| dmsimard | I've been fairly reliably using nested KVM for several years now already, I think it's not as unstable as we're pretending it to be | 14:15 |
| dmsimard | At least as far back as icehouse with Intel Xeon E5 processors | 14:16 |
| fungi | we're not pretending... we know it's unstable on at least some hardware in use at some of our providers | 14:16 |
| *** ldnunes has joined #openstack-infra | 14:16 | |
| fungi | and we haven't told providers that stable, working hardware accel for nested virt is a requirement for donating instances | 14:16 |
| *** jascott1 has quit IRC | 14:16 | |
| dmsimard | That's fair, but then the answer should be that the providers aren't guaranteed to provide "stable" nested virtualization, not that nested virtualization itself is unstable | 14:17 |
| kashyap | fungi: BTW, related: I'm just told by the KVM maintainer that Intel is far more stable than AMD | 14:17 |
| fungi | phrase it how you like... on at least some processors with at least some kernel revisions still in production use in public clouds, vmx will crash out your instances at random in ways which are completely opaque to anyone who lacks access to the base level hypervisor | 14:18 |
| *** dhajare has quit IRC | 14:20 | |
| kashyap | fungi: Yes, I'm not pretending there aren't crashes some some processors. You're right in pointing that out. | 14:25 |
| kashyap | dmsimard: Also to be fair to fungi: if it isn't _announced_ clearly and loudly by the Kernel maintainers, then treating it with a bit of caution is understandable | 14:25 |
| fungi | and we don't have any good insight into which processors and hypervisor-level kernels are in use at which service providers donating resources. can't even pretend they use homogeneous hardware | 14:25 |
| fungi | so expecting it to work is a gamble | 14:26 |
| kashyap | fungi: So, talking to the KVM maintainer, there are a couple of things that needs addressing: e.g. migration and CPU modelling infra. Both are in-progress | 14:26 |
| kashyap | fungi: Yeah, that's true, and a fair point | 14:26 |
| fungi | i completely agree that if you're deploying your own cloud and have control over which hardware and kernels you use, it can probably work _great_ | 14:27 |
| fungi | but we don't do that, we reuse resources provided by others and don't even have insight into that layer of the systems to be able to troubleshoot when it doesn't work as designed | 14:28 |
| *** Goneri has joined #openstack-infra | 14:28 | |
| *** armaan has quit IRC | 14:29 | |
| fungi | as an example, we have direct evidence of a significant number of crashes attempting to enable nested virt acceleration in ovh, our largest donor at the moment. our primary contact there is their trouble ticket system where such questions can expect to get feedback from a level-1 support tech in a week or two | 14:29 |
| *** jcoufal has quit IRC | 14:29 | |
| *** signed8bit is now known as signed8bit_Zzz | 14:30 | |
| fungi | our second largest donor, rackspace, doesn't even support nested kvm acceleration because they run xen | 14:30 |
| fungi | so we're talking about a feature which isn't usable in at least our largest two donor providers right now | 14:31 |
| *** armaan has joined #openstack-infra | 14:31 | |
| kashyap | fungi: On your point about not knowing which processors / hypervisor-level Kernels, why should you need that info? Just trying to understand. Because: | 14:31 |
| fungi | that's the majority of our quota | 14:31 |
| kashyap | fungi: Shouldn't this suffice: If you check whether KVM character device (/dev/kvm) can be loaded, then they can assume the cloud provider has made decision that nested KVM is usable on their cloud? | 14:32 |
| kashyap | s/they/(the mythical) you/ | 14:32 |
| fungi | kashyap: in the case of ovh, we're trying to determine whether their choice to enable that is a conscious decision. we've reported the failures to them in passing and they've expressed an interest in looking into it... eventually | 14:33 |
| kashyap | fungi: I see, I didn't OVH enabled it. I'd be interested to know that | 14:33 |
| fungi | yeah, we explicitly disable it in our job configurations and recommend others writing/configuring test frameworks for our ci to do the same, because we can't tell where it will work reliably | 14:34 |
| *** alexchadin has quit IRC | 14:35 | |
| pabelanger | fungi: mind a review when you have a moment: https://review.openstack.org/525419/ sets up myID for zookeeper to be numeric, not hostname | 14:35 |
| *** signed8bit_Zzz is now known as signed8bit | 14:36 | |
| fungi | kashyap: and even then there are places where things like file injection via hostfs may bypass that and try to use nested virt on their own (i don't recall how far that investigation got last week) | 14:36 |
| kashyap | fungi: Understood; your position is reasonable. You're also just trying to maintain your sanity by trying to minimize the time you dig into hypervisor failures that are block Gate | 14:36 |
| kashyap | fungi: Yeah, I've been notified of it; looking at it as we speak | 14:37 |
| fungi | kashyap: in fact, we can't really dig into the hypervisor failures because we lack access to those hypervisors. the most we can hope to do is report them to the providers' support staff and cross our fingers they'll look into it | 14:37 |
| kashyap | fungi: Ah, right | 14:37 |
| kashyap | You're relying on the node providers | 14:38 |
| kashyap | fungi: I hear you; sorry if I sounded a bit too grumpy | 14:38 |
| kashyap | Your explanation brings a bit more nuance | 14:38 |
| fungi | no, it's fine. and you're right to point out that we shouldn't say "nested virt is unstable" without qualifying that it's unstable in our particular circumstances where we lack any control over the platforms where it's being provided | 14:38 |
| *** udesale has quit IRC | 14:40 | |
| dmsimard | yeah, I understand the logistics of it from the OpenStack infra perspective | 14:42 |
| dmsimard | the phrasing is important :) | 14:42 |
| fungi | pabelanger: i can take a look in a few... about to push out another security advisory and need to stick to our agreed-upon timetable for that | 14:42 |
| *** hichihara has quit IRC | 14:44 | |
| kashyap | fungi: Thanks for the conversation; I should probably file a ticket to track all requirements OpenStack cares about. And write updates as and when migration & CPU modelling infra topics taken addressed w.r.t nested | 14:45 |
| * kashyap makes a TODO item | 14:45 | |
| *** ldnunes has quit IRC | 14:46 | |
| AJaeger_ | config-core, please review ianw's change https://review.openstack.org/525050 to cache zanata-cli to remove one instability from our translation runs. | 14:46 |
| *** jaosorior has quit IRC | 14:46 | |
| AJaeger_ | I would be interested whether you agree with the approach on caching in nodepool ^ | 14:48 |
| pabelanger | fungi: np! when you have time | 14:48 |
| AJaeger_ | fungi, I think we should add #kata to accessbot as well, see https://review.openstack.org/#/c/525246 - don't we? | 14:49 |
| *** kiennt26 has joined #openstack-infra | 14:49 | |
| *** jamesmcarthur has joined #openstack-infra | 14:50 | |
| *** udesale has joined #openstack-infra | 14:50 | |
| fungi | AJaeger_: yes, if the infra team will be running any other bots in it we need accessbot to grant the appropriate access for them and for us to be able to troubleshoot or assist with channel ops tasks | 14:51 |
| dmsimard | AJaeger_: my knowledge of zanata is quite limited but I'll have a look | 14:52 |
| AJaeger_ | dmsimard: thanks, change is quite independ of zanata - the caching of it is the important part | 14:52 |
| *** gcb has quit IRC | 14:53 | |
| *** martinkopec has quit IRC | 14:53 | |
| *** gcb has joined #openstack-infra | 14:54 | |
| *** armax has joined #openstack-infra | 14:56 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 14:58 |
| *** martinkopec has joined #openstack-infra | 14:58 | |
| *** udesale has quit IRC | 14:59 | |
| *** ldnunes has joined #openstack-infra | 14:59 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config master: Add log-classify project template https://review.openstack.org/525639 | 14:59 |
| *** annp has quit IRC | 15:00 | |
| *** slaweq_ is now known as slaweq | 15:00 | |
| dmsimard | AJaeger_: +2 with a comment | 15:01 |
| AJaeger_ | fungi, could you review infra-manual changes again, please? https://review.openstack.org/524566 and https://review.openstack.org/520289 | 15:04 |
| AJaeger_ | dmsimard: thanks | 15:04 |
| *** dsariel has quit IRC | 15:06 | |
| *** caphrim007 has quit IRC | 15:07 | |
| *** shardy is now known as shardy_afk | 15:08 | |
| *** ykarel_ has joined #openstack-infra | 15:11 | |
| *** janki has quit IRC | 15:13 | |
| *** david-lyle has joined #openstack-infra | 15:13 | |
| *** janki has joined #openstack-infra | 15:14 | |
| *** ykarel|afk has quit IRC | 15:14 | |
| *** janki has quit IRC | 15:14 | |
| *** janki has joined #openstack-infra | 15:15 | |
| *** eumel8 has quit IRC | 15:17 | |
| *** dsariel has joined #openstack-infra | 15:21 | |
| *** sree has joined #openstack-infra | 15:21 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 15:23 |
| *** sree has quit IRC | 15:26 | |
| *** vhosakot has joined #openstack-infra | 15:28 | |
| *** gouthamr has joined #openstack-infra | 15:29 | |
| *** bobh has quit IRC | 15:30 | |
| *** armaan has quit IRC | 15:30 | |
| *** armaan has joined #openstack-infra | 15:30 | |
| *** rm_work has quit IRC | 15:32 | |
| *** xarses has quit IRC | 15:32 | |
| *** Apoorva has joined #openstack-infra | 15:32 | |
| *** hongbin has joined #openstack-infra | 15:33 | |
| *** Swimingly has quit IRC | 15:33 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Improve zanata-cli download https://review.openstack.org/525658 | 15:34 |
| AJaeger_ | dmsimard: done a followup change ^ | 15:34 |
| *** rbrndt has joined #openstack-infra | 15:36 | |
| *** dizquierdo has joined #openstack-infra | 15:36 | |
| *** udesale has joined #openstack-infra | 15:36 | |
| *** rm_work has joined #openstack-infra | 15:36 | |
| *** Apoorva has quit IRC | 15:37 | |
| *** sree has joined #openstack-infra | 15:37 | |
| *** martinkopec has quit IRC | 15:38 | |
| *** david-lyle has quit IRC | 15:39 | |
| *** Apoorva has joined #openstack-infra | 15:39 | |
| *** dsariel has quit IRC | 15:40 | |
| *** ramishra has quit IRC | 15:40 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add log-classify project https://review.openstack.org/522139 | 15:41 |
| mordred | AJaeger_, dhellmann, fungi: so - I had this idea that's maybe terrible but maybe not terrible that I wanted to run by you | 15:41 |
| dmsimard | uh oh | 15:41 |
| AJaeger_ | mordred: that sounds scary ;) | 15:41 |
| mordred | :) | 15:41 |
| *** udesale has quit IRC | 15:41 | |
| *** shardy_afk is now known as shardy | 15:42 | |
| *** udesale has joined #openstack-infra | 15:42 | |
| *** sree has quit IRC | 15:42 | |
| mordred | AJaeger_, dhellmann, fungi: tox supports plugins now ... what if we wrote a plugin, called it "openstack-tox" (or something) and had it implement the bits around requirements and constraints ... and maybe even had it add standard environments if they aren't there- like venv and docs and whatnot | 15:43 |
| mordred | and just made it a requirement for folks to install it | 15:43 |
| openstackgerrit | Merged openstack-infra/project-config master: Cache zanata cli tools https://review.openstack.org/525050 | 15:43 |
| mordred | it would allow us to manage some of the things, like this constraints thing, without making AJaeger_ do a bunch of patch bombs | 15:43 |
| mordred | the downside is that there isn't, best I can tell, a way to express in a tox.ini that a project needs/expects a particular tox plugin - so there might be local dev confusion for a bit | 15:44 |
| *** Swimingly has joined #openstack-infra | 15:44 | |
| *** Swimingly has quit IRC | 15:44 | |
| *** Swimingly has joined #openstack-infra | 15:44 | |
| fungi | mordred: sounds great--have a link to the tox plug-in implementation? curious if it can hotplug those through its normal python requirements installation mechanisms or if those have to be preinstalled? | 15:44 |
| mordred | but - if we made openstack-tox depend on tox, then we could just say "just pip install openstack-tox" | 15:44 |
| fungi | oh, you read my mind | 15:44 |
| mordred | http://tox.readthedocs.io/en/latest/plugins.html | 15:45 |
| * AJaeger_ not doing patch bombs would be greatly appreciated ;) | 15:45 | |
| fungi | openstack-tox depending on tox makes sense to me | 15:45 |
| mordred | fungi: maybe we could even make an upstream patch to tox to add support for listing a required plugin, and to have tox emit an error if it can't find it | 15:46 |
| fungi | we're already in an odd sort of limbo where the dev needs to jump through hoops to get new enough tox since sticking it in bindep is going to get them older tox from their distros than we're likely to support using | 15:46 |
| mordred | yah | 15:47 |
| AJaeger_ | yah, could work... | 15:47 |
| AJaeger_ | mordred: the idea is not so scary as I feared ;) | 15:47 |
| *** xarses has joined #openstack-infra | 15:47 | |
| fungi | and good call on having some way to express your tox.ini (or a specific env therein) requires a specific plugin | 15:47 |
| mordred | fungi, AJaeger_, dhellmann: the *other* terrible idea is that instead we could focus on the theoretical zuul-local-test-runner - and ditch tox in favor of just using a runner that knows how to read .zuul.yaml files | 15:48 |
| AJaeger_ | tristanC: did you forget to push the log-classify followup change? | 15:48 |
| *** openstackgerrit has quit IRC | 15:48 | |
| AJaeger_ | mordred: including required-projects? | 15:48 |
| mordred | but I kind of feel like we're far enough down the tox path at this point that at least taking a stab at tox plugins before we went whole-hog into a zuul replacement would be a better step | 15:48 |
| AJaeger_ | that would be nice... | 15:48 |
| fungi | mordred: we still need the local test runner anyway to make it possible for devs to run other (non-tox) jobs locally | 15:48 |
| mordred | AJaeger_: yah - I think it's totally possible - but may take longer to get solid | 15:48 |
| mordred | fungi: we do indeed | 15:49 |
| fungi | but i'm in favor of also supporting people considering the tox command-line tool as an ecosystem-standard entry point to running tests | 15:49 |
| fungi | at least for python projects | 15:49 |
| *** openstackgerrit has joined #openstack-infra | 15:49 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/525603 | 15:49 |
| fungi | we can't guarantee they'll be as close as possible to upstream testing if they do that, but if that's a thing they want we'll have the zuul runner utility they can switch to calling | 15:50 |
| AJaeger_ | mordred: btw. the worst with patch bombs is repos that are broken or dead. Getting a -1 from Zuul where you see that jobs cannot work, or a -2 with "the repos is dead" or no reaction at all is bad... | 15:50 |
| fungi | AJaeger_: i usually follow up with "please retire this repository" and a link to our retiring doc | 15:51 |
| jeblair | fungi, mordred: having a zuul local test runner that does something other than reproduce a previous run depends on a bunch of stuff that isn't in place yet (api server, etc) | 15:51 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config master: Add log-classify project template https://review.openstack.org/525639 | 15:51 |
| fungi | jeblair: right, i see it as more of a medium-future thing not a near-future thing | 15:52 |
| *** martinkopec has joined #openstack-infra | 15:52 | |
| fungi | for some definitions of medium and near | 15:52 |
| jeblair | yeah -- not sure whether it's more work than tox-plugin -- it's probably not less though. :) | 15:52 |
| fungi | agreed, both are worthwhile to have | 15:52 |
| AJaeger_ | fungi: I did but no reaction yet. Let's see... | 15:52 |
| mordred | ok. I may play around with a tox plugin real quick to see how it goes | 15:53 |
| *** dsariel has joined #openstack-infra | 15:53 | |
| mordred | from an infra-side, it will be pretty easy - have the openstack-tox base job install openstack-tox and done :) | 15:53 |
| jeblair | mordred: ya. i really hope they at least accept the "error on missing plugin decl" idea. that sounds simple. | 15:54 |
| AJaeger_ | mordred: once you've done it, let's write up a plan, please. | 15:55 |
| mordred | AJaeger_: I think the steps are, a) implement code b) roll it out c) document it d) write a plan e) propose it :) | 15:55 |
| mordred | (those may be in the wrong order) | 15:56 |
| AJaeger_ | I'd like a documented way on how to tackle this and why we do it that we can reference in reviews and mail discussion | 15:58 |
| *** slaweq is now known as slaweq_ | 15:58 | |
| AJaeger_ | mordred: looks good from 50000ft view ;) | 15:58 |
| AJaeger_ | fungi: regarding storyboard creation, do we need an infra-root to do anything for https://review.openstack.org/#/c/523939/ ? Otherwise I can approve... | 15:59 |
| jeblair | there's not much oxygen at 50000ft | 16:00 |
| AJaeger_ | mordred: btw. only 98 repos with tox_install.sh - down from 166. And still two dozen changes up for review | 16:01 |
| *** hamzy has quit IRC | 16:02 | |
| *** armaan has quit IRC | 16:04 | |
| clarkb | re nested virt, I would like to put an email together today (or this week) to OVH about what we've seen with reproduction cases | 16:04 |
| clarkb | hopefully I'll have time after the meeting to boot their ubuntu image and run a VM with nested virt (to confirm that crashes it) | 16:04 |
| fungi | AJaeger_: feel free to approve. adding a group for their repos starts to make more sense when they add a second one | 16:04 |
| fungi | AJaeger_: after it merges and the project shows up in sb, _then_ i'll start the bug import process | 16:05 |
| AJaeger_ | fungi, approved | 16:05 |
| *** ccamacho has quit IRC | 16:06 | |
| mordred | AJaeger_, jeblair: ooh, just realized - we could actually put the tox-install-siblings logic into the tox plugin - the plugin api allows for adding command line arguments, so we could add a --siblings option - but that way reproducing sibling logic locally would be easy too | 16:07 |
| AJaeger_ | nice | 16:07 |
| mordred | first things first - just seeing how hard it is to deal with expressing the constraints stuff properly | 16:08 |
| *** coolsvap has quit IRC | 16:08 | |
| AJaeger_ | one step at a time... | 16:08 |
| jeblair | mordred: cool! | 16:08 |
| *** dbecker has quit IRC | 16:09 | |
| *** bobh has joined #openstack-infra | 16:10 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix on summit event publishing process https://review.openstack.org/525674 | 16:10 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix on summit event publishing process https://review.openstack.org/525674 | 16:11 |
| *** jascott1 has joined #openstack-infra | 16:14 | |
| *** thorst has quit IRC | 16:15 | |
| openstackgerrit | Merged openstack-infra/project-config master: Allow the use of Storyboard for Kolla-Kubernetes https://review.openstack.org/523939 | 16:15 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 16:15 |
| AJaeger_ | mordred: is https://review.openstack.org/#/c/521145/ ready to merge ? Then let's ask for reviews... | 16:16 |
| *** jascott1 has quit IRC | 16:18 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 16:23 |
| *** udesale has quit IRC | 16:23 | |
| *** andreas_s has quit IRC | 16:26 | |
| dhellmann | mordred, AJaeger_ : my only concern is that we learn the lessons of pbr, and take care not to introduce too much magic in the plugin | 16:26 |
| *** andreas_s has joined #openstack-infra | 16:26 | |
| *** kiennt26 has quit IRC | 16:27 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix on summit event publishing process https://review.openstack.org/525678 | 16:28 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix on summit event publishing process https://review.openstack.org/525678 | 16:28 |
| *** andreas_s has quit IRC | 16:31 | |
| AJaeger_ | config-core, a couple of smaller reviews to approve, please: https://review.openstack.org/524563 https://review.openstack.org/524557 https://review.openstack.org/524256 https://review.openstack.org/525154 https://review.openstack.org/524574 https://review.openstack.org/525270 | 16:32 |
| *** ykarel__ has joined #openstack-infra | 16:32 | |
| mordred | dhellmann: yah. totally. I think I'd like to keep it simple and just about adding/enforcing a few basic config settings that are easy to get wrong | 16:32 |
| *** e0ne_ has quit IRC | 16:33 | |
| mordred | AJaeger_: oh - no, let me WIP that real quick - I found one more edge case yesterday that I think needs to be handled in the build-openstack-sphinx job | 16:33 |
| *** ykarel_ has quit IRC | 16:34 | |
| AJaeger_ | too many edge cases ;( | 16:35 |
| mordred | AJaeger_: yah. tell me about it | 16:35 |
| mordred | AJaeger_: this one is easy enough though ... | 16:36 |
| AJaeger_ | mordred: enforcing = tox linter? ;) | 16:36 |
| AJaeger_ | mordred: good... | 16:36 |
| mordred | AJaeger_: it's python version - we normaly run sphinx just with python in this setup, but some projects, such as zuul itself, are python3 only and need to also have sphinx and friends run under python3 | 16:36 |
| AJaeger_ | Argh ;( | 16:37 |
| AJaeger_ | good catch, mordred | 16:37 |
| mordred | yah- patch coming | 16:37 |
| *** hamzy_ has joined #openstack-infra | 16:37 | |
| mordred | I accidentally hit it - my local tox is installed with python3 which means I get python3 by default - and I discovered that python-openstacksdk's docs cannot be built with python3 becaues of a bug in a local validation plugin | 16:38 |
| mordred | but that reminded me that zuul's source code does not import in python2 :) | 16:38 |
| AJaeger_ | so, let's push a DNM test change for zuul as well up. We soon have one for each repo ;) | 16:38 |
| AJaeger_ | tristanC: did you see my comment on https://review.openstack.org/#/c/525639 ? Do you want to add noop-jobs? Or shall I +2? | 16:40 |
| *** hamzy has joined #openstack-infra | 16:42 | |
| *** hamzy_ has quit IRC | 16:46 | |
| *** mihalis68 has quit IRC | 16:48 | |
| *** martinkopec has quit IRC | 16:49 | |
| sshnaidm|rover | is it forbidden for you too? is it forbidden for you too? http://mirror.ord.rax.openstack.org:8080/rdo/centos7/3b/85/3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d/python2-oslo-service-1.26.0-0.20170921123949.1a973c4.el7.centos.noarch.rpm | 16:50 |
| *** jascott1 has joined #openstack-infra | 16:51 | |
| sboyron | for me yes | 16:51 |
| sboyron | it is | 16:51 |
| dmsimard | sshnaidm|rover: it likely caches a forbidden response from the upstream | 16:51 |
| fungi | sshnaidm|rover: sboyron: are you able to get it from any of our other mirrors? e.g., mirror.dfw.rax.openstack.org? | 16:51 |
| fungi | and yeah, the reason i ask is what dmsimard is suspecting too | 16:52 |
| dmsimard | sshnaidm|rover: https://trunk.rdoproject.org/centos7-master/3b/85/3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d/python2-oslo-service-1.26.0-0.20170921123949.1a973c4.el7.centos.noarch.rpm doesn't work either | 16:52 |
| fungi | that seems to confirm it, indeed | 16:52 |
| dmsimard | sshnaidm|rover: there's no python2-oslo-service package in that repo | 16:53 |
| sboyron | fungi: yes | 16:53 |
| sshnaidm|rover | dmsimard, yeah, other mirrors too | 16:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add use_python3 variable to sphinx role and job https://review.openstack.org/525688 | 16:53 |
| mordred | AJaeger_: ^^ | 16:53 |
| fungi | dmsimard: sboyron: sshnaidm|rover: guessing their index updating is out of sync with the actual package files | 16:53 |
| dmsimard | sshnaidm|rover: let's move to #rdo, this is something related to RDO :) | 16:53 |
| *** hamzy has quit IRC | 16:54 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: DNM testing new build-sphinx job works for python3 projects https://review.openstack.org/525690 | 16:55 |
| AJaeger_ | mordred: don't say don't with an apostrophe for ansible | 16:55 |
| mordred | AJaeger_: ^^ and a depends-on to test it | 16:55 |
| mordred | AJaeger_: good point :) | 16:55 |
| *** dizquierdo has quit IRC | 16:56 | |
| mordred | AJaeger_: wait - where did I use a don't ? | 16:56 |
| mordred | oh - it'll. I see it | 16:56 |
| dmsimard | You can use ', just enclose the string in double quotes | 16:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add use_python3 variable to sphinx role and job https://review.openstack.org/525688 | 16:57 |
| dmsimard | Same thing with : | 16:57 |
| mordred | dmsimard: yah - but in comments in shell blocks it causes much wailing and gnashing of teeth | 16:57 |
| dmsimard | It confuses yaml | 16:57 |
| dmsimard | Oh, yeah, in bash.. | 16:57 |
| dmsimard | Shell* | 16:57 |
| AJaeger_ | mordred: do you wnat to fix the typo as well? See my previous comment | 16:58 |
| dmsimard | Pretty sure I filed a bug in upstream ansible for that | 16:58 |
| AJaeger_ | mordred: or shall I fix quickly? | 16:59 |
| AJaeger_ | mordred: fixing it | 17:00 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Add use_python3 variable to sphinx role and job https://review.openstack.org/525688 | 17:00 |
| *** janki has quit IRC | 17:02 | |
| mordred | AJaeger_: thanks! | 17:02 |
| *** greghaynes has quit IRC | 17:03 | |
| *** derekh has quit IRC | 17:03 | |
| *** greghaynes has joined #openstack-infra | 17:04 | |
| *** jpich has quit IRC | 17:06 | |
| mordred | AJaeger_: then yes, if this one works, I think we're good to go - we may still have one or two things that break that we don't know about yet, but I think we know how to fix all of the patterns when they happen, so should be able to respond quickly | 17:06 |
| *** sboyron has quit IRC | 17:06 | |
| openstackgerrit | Jonathan Bryce proposed openstack-infra/project-config master: Add Kata Containers IRC projects https://review.openstack.org/525694 | 17:07 |
| *** Apoorva has quit IRC | 17:07 | |
| *** eumel8 has joined #openstack-infra | 17:07 | |
| *** kashyap has left #openstack-infra | 17:08 | |
| *** camunoz has quit IRC | 17:11 | |
| clarkb | interestingly using virt-install seems to work on ovh with nested virt (at least with cirros 0.4.0) | 17:15 |
| *** witek has joined #openstack-infra | 17:15 | |
| clarkb | time to test with UCA libvirt/kvm/etc | 17:15 |
| clarkb | then maybe we look at what nova might be doing that could break us? | 17:15 |
| *** slaweq_ has quit IRC | 17:19 | |
| *** pcaruana has joined #openstack-infra | 17:22 | |
| pabelanger | clarkb: mind taking a quick review of https://review.openstack.org/525419/ should help bring zk cluster online | 17:22 |
| *** pcaruana has quit IRC | 17:26 | |
| *** lucasagomes is now known as lucas-afk | 17:27 | |
| *** pcaruana has joined #openstack-infra | 17:27 | |
| *** waynr has joined #openstack-infra | 17:27 | |
| *** dtantsur is now known as dtantsur|afk | 17:27 | |
| clarkb | pabelanger: done, I wonder if we will need something that is more robust than that in the future | 17:27 |
| *** ldnunes has quit IRC | 17:28 | |
| pabelanger | clarkb: yah, open to suggestions for sure | 17:28 |
| *** ganso has quit IRC | 17:32 | |
| mordred | AJaeger_: fixing another error ... | 17:34 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add use_python3 variable to sphinx role and job https://review.openstack.org/525688 | 17:35 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Update sphinx jobs to use python3 https://review.openstack.org/525690 | 17:37 |
| *** florianf is now known as florianf|afk | 17:37 | |
| AJaeger_ | mordred: I don't think you can modify a final job, see my comment ^ | 17:39 |
| *** signed8bit is now known as signed8bit_Zzz | 17:39 | |
| *** Hal has quit IRC | 17:39 | |
| *** ldnunes has joined #openstack-infra | 17:42 | |
| AJaeger_ | otherwise those two look fine, mordred | 17:42 |
| eumel8 | clarkb: you have 5 minutes to restart wildfly on translate-dev.o.o? Something went wrong in the morning on the last puppet run. | 17:42 |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 17:44 |
| *** Apoorva has joined #openstack-infra | 17:45 | |
| *** Apoorva has quit IRC | 17:45 | |
| *** sambetts is now known as sambetts|afk | 17:45 | |
| clarkb | eumel8: ya I can take a look shortly | 17:46 |
| *** Apoorva has joined #openstack-infra | 17:46 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 17:47 | |
| eumel8 | clarkb: thx, ianw merged the admin user change and my feeling is that something goes wrong there. Maybe missing name resolution or something like this. | 17:48 |
| mordred | AJaeger_: https://review.openstack.org/525715 Add special docs build job | 17:48 |
| openstackgerrit | Merged openstack-infra/system-config master: Set myid for zookeeper to numeric https://review.openstack.org/525419 | 17:49 |
| AJaeger_ | mordred: LGTM, let's tell eumel8 and ianychoi about https://review.openstack.org/525715 | 17:53 |
| clarkb | eumel8: puppet itself doesn't really report any problems | 17:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Use the new sphinx PTI for publish jobs https://review.openstack.org/521557 | 17:54 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove build-openstack-sphinx-docs from i18n https://review.openstack.org/525717 | 17:54 |
| mordred | AJaeger_: there's one to remove the normal job from that repo, and a rebaed version of the publication update patch | 17:54 |
| *** caphrim007 has joined #openstack-infra | 17:54 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Update sphinx jobs to use python3 https://review.openstack.org/525690 | 17:54 |
| eumel8 | clarkb: have you restarted wildfly? | 17:55 |
| clarkb | eumel8: not yet trying to see if I can see anything broken | 17:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Use python3 for docs publication https://review.openstack.org/525718 | 17:55 |
| clarkb | eumel8: looks like I can hit it from http? is the problem more specific than just being down? | 17:55 |
| clarkb | oh is it that you can't login as admin as expected? | 17:56 |
| clarkb | (that may be what I am missing in which case ya a restart probably is necesasry) | 17:56 |
| eumel8 | clarkb: klick on login, for me is the openid login not working. | 17:56 |
| eumel8 | clarkb: or it's something strange with my account | 17:57 |
| clarkb | oh this is the openstackid-dev vs production problem I think | 17:57 |
| *** pcaruana has quit IRC | 17:58 | |
| clarkb | redirects are not working for me because of ssl anyways | 17:58 |
| clarkb | :/ | 17:58 |
| eumel8 | clarkb: yes, I heart someting about this. But it worked for me yesterday. | 17:58 |
| *** dizquierdo has joined #openstack-infra | 17:58 | |
| clarkb | eumel8: let me try restarting wildfly then just in case its not picking up config it needs | 17:59 |
| *** jamesmcarthur has quit IRC | 17:59 | |
| clarkb | eumel8: wildfly has been restarted | 18:00 |
| eumel8 | clarkb: ok | 18:00 |
| clarkb | ok seems to work now? | 18:01 |
| clarkb | that was weird, I think the problem was the redirect was being made to the ip address not the translate-dev name so that my browser got confused | 18:01 |
| *** trown is now known as trown|lunch | 18:02 | |
| *** ralonsoh has quit IRC | 18:03 | |
| *** signed8bit_Zzz is now known as signed8bit | 18:03 | |
| eumel8 | clarkb: yeah, it's working now | 18:04 |
| AJaeger_ | mordred: regarding i18n: They build PDFs and translations as well, and there has been discussion to do this for other repos as well. So, it's not PTI - but we need to handle that going forward for others | 18:04 |
| eumel8 | clarkb: ianw: I think it was something with DNS during puppet run or a missing openid library loading. Now it's working and we can make our tests again. | 18:06 |
| *** dizquierdo has quit IRC | 18:07 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul feature/zuulv3: WIP: Git driver https://review.openstack.org/525614 | 18:07 |
| *** dsariel has quit IRC | 18:08 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add Kata Containers IRC projects https://review.openstack.org/525694 | 18:08 |
| AJaeger_ | mordred: https://review.openstack.org/#/c/525715/ odes not work, see http://logs.openstack.org/15/525715/1/check/build-i18n-docs/bfb3ef5/html/ | 18:09 |
| *** makowals has quit IRC | 18:11 | |
| *** ykarel__ has quit IRC | 18:11 | |
| *** makowals has joined #openstack-infra | 18:11 | |
| eumel8 | AJaeger_ mordred: that mean, this will not work anymore: https://git.openstack.org/cgit/openstack/i18n/tree/tools/build-docs.sh ? | 18:11 |
| *** makowals has quit IRC | 18:12 | |
| *** makowals has joined #openstack-infra | 18:12 | |
| AJaeger_ | eumel8: it does | 18:12 |
| *** makowals has quit IRC | 18:13 | |
| *** makowals has joined #openstack-infra | 18:13 | |
| *** makowals has quit IRC | 18:13 | |
| *** makowals has joined #openstack-infra | 18:14 | |
| AJaeger_ | eumel8: it will work, just it gets published differently | 18:14 |
| *** makowals has quit IRC | 18:14 | |
| AJaeger_ | eumel8: please +2A https://review.openstack.org/525723 , build-docs is broken right now | 18:14 |
| AJaeger_ | eumel8: http://logs.openstack.org/15/525715/1/check/build-i18n-docs/bfb3ef5/job-output.txt.gz#_2017-12-05_17_53_24_576507 | 18:14 |
| eumel8 | AJaeger_ mordred: missing the language menu there: http://logs.openstack.org/15/525715/1/check/build-openstack-sphinx-docs/11872f0/html/ | 18:15 |
| *** makowals has joined #openstack-infra | 18:15 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Add finger gateway https://review.openstack.org/525276 | 18:15 |
| *** makowals has quit IRC | 18:15 | |
| clarkb | rm_work: re nested virt, do you happen to have the libvirt xml that nova uses for a crashed VM on ovh? | 18:15 |
| clarkb | rm_work: currently using virt-install and neither cirros or ubuntu have crashed yet with it | 18:16 |
| AJaeger_ | eumel8: that job was not touched as part of the change... | 18:16 |
| AJaeger_ | eumel8: compare http://logs.openstack.org/51/525051/1/check/build-openstack-sphinx-docs/f059b66/html/ | 18:17 |
| AJaeger_ | eumel8: what I want to say is: Your build-openstack-sphinx-docs job is broken, it does not run tox -e docs. mordred is fixing that for you now. | 18:18 |
| AJaeger_ | So, we remove build-openstack-sphinx-docs as part of his change set, see https://review.openstack.org/525717 | 18:18 |
| eumel8 | I try to follow... | 18:19 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Update sphinx jobs to use python3 https://review.openstack.org/525690 | 18:19 |
| AJaeger_ | mordred: fixing for you ^ | 18:20 |
| *** rbrndt has quit IRC | 18:21 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Use python3 for docs publication https://review.openstack.org/525718 | 18:21 |
| *** tesseract has quit IRC | 18:21 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 18:22 |
| eumel8 | AJaeger_: I investigated the build job in i18n repo yesterday and reviewed this language menue thing from amotoki which is the main part of the script. The idea was to move this to openstackdocstheme and rollout globally. | 18:24 |
| rm_work | clarkb: johnsom might, or maybe i can get it | 18:24 |
| clarkb | rm_work: I think nova may dump that xml when you boot the instance so should be in the job logs somewhere | 18:24 |
| AJaeger_ | eumel8: your publish job is different from the build job, so it should get published properly, just the building is not. | 18:25 |
| AJaeger_ | eumel8: if we roll this out globally, you break the docs publishing globally ;( | 18:26 |
| AJaeger_ | eumel8: best discuss with mordred ^ | 18:26 |
| AJaeger_ | that's why I gave a WIP on the PDF docs spec, it needs job changes and we're changing them right now | 18:26 |
| eumel8 | AJaeger_: not the current solution from amotoki. I'm testing something what's possible in openstackdocstheme, but it's not ready for a proposal. | 18:28 |
| *** jamesmcarthur has joined #openstack-infra | 18:29 | |
| *** jamesmcarthur has quit IRC | 18:30 | |
| *** jamesmcarthur has joined #openstack-infra | 18:30 | |
| rm_work | clarkb: i'll look for one of the runs, but they were a while back so i wonder if the logs get purged | 18:30 |
| clarkb | rm_work: they may have | 18:30 |
| clarkb | rm_work: can always push a throwaway change that exercises it though | 18:31 |
| clarkb | (it is also possible that this doesn't happen on ever ovh hypervisor and I've got a "good" one?) | 18:31 |
| *** tosky has quit IRC | 18:32 | |
| *** bobh has quit IRC | 18:32 | |
| clarkb | rm_work: we may also just need to give them instance uuids and see what they can see on their end to narrow it down | 18:33 |
| eumel8 | AJaeger_: fix is merged | 18:33 |
| EmilienM | dmsimard, pabelanger : slagle found a dns issue on https://review.openstack.org/#/c/524751/ (see last comment), is it something we should worry about? | 18:33 |
| dmsimard | EmilienM: looking | 18:34 |
| dmsimard | EmilienM: no | 18:34 |
| dmsimard | EmilienM: that's a known issue very likely caused by https://review.openstack.org/#/c/525228/ | 18:34 |
| dmsimard | EmilienM: or rather fixed by | 18:34 |
| rm_work | clarkb: found one i think | 18:35 |
| rm_work | http://logs.openstack.org/12/511112/6/gate/legacy-octavia-v1-dsvm-py3x-scenario-multinode/bb708ae/ | 18:35 |
| rm_work | clarkb: can you find it in that? | 18:35 |
| rm_work | oh hmm hold on, MAYBE this isn't it? | 18:35 |
| *** jpena is now known as jpena|off | 18:35 | |
| rm_work | johnsom: ^^ does this look right: http://logs.openstack.org/12/511112/6/gate/legacy-octavia-v1-dsvm-py3x-scenario-multinode/bb708ae/logs/libvirt/qemu/instance-00000002.txt.gz | 18:35 |
| clarkb | rm_work: http://logs.openstack.org/12/511112/6/gate/legacy-octavia-v1-dsvm-py3x-scenario-multinode/bb708ae/logs/screen-n-cpu.txt.gz#_Oct_16_09_48_09_949947 | 18:36 |
| johnsom | rm_work That crash is the right kvm issue | 18:36 |
| clarkb | uuids seem to match up, thanks | 18:36 |
| *** jamesmcarthur has quit IRC | 18:36 | |
| EmilienM | dmsimard: ok | 18:36 |
| clarkb | at the very least I can give ovh my libvirt xml and that libvirt xml and see if they notice anything | 18:36 |
| AJaeger_ | mordred: reviewed everything, i18n change is broken (see review), rest looks fine | 18:37 |
| dmsimard | clarkb: wait, you're still working on the libguestfs issue ? | 18:37 |
| * AJaeger_ goes offline again | 18:37 | |
| clarkb | dmsimard: no, this is the more generic OVH is broken and speaking to them in sydney they were interested in getting more info | 18:37 |
| dmsimard | oh, okay. | 18:37 |
| clarkb | dmsimard: so trying to put together enough data for them that they can look at it | 18:37 |
| dmsimard | I guess the libguestfs thing is a non-issue, probably worth letting them know about it though | 18:38 |
| dmsimard | kashyap will resume troubleshooting tomorrow | 18:38 |
| dmsimard | it's not obvious why the bugfix in nova seems to make matters worse | 18:38 |
| clarkb | rm_work: johnsom I'll get a paste up with the full data but I notice that nova does cpu match=exact | 18:39 |
| clarkb | rm_work: johnsom but virt-install is doing cpu match=exact with mode=custom | 18:39 |
| dmsimard | clarkb: I noticed that too, I'm not sure why | 18:39 |
| clarkb | also nova sets cpu shares | 18:39 |
| clarkb | so those are things to try on my test nodes, infra meeting coming up in 20 minutes though so I'll have to pick it up in the afternoon. Thanks for that link it helps | 18:40 |
| *** dhill__ has quit IRC | 18:43 | |
| *** dhill_ has joined #openstack-infra | 18:43 | |
| rm_work | clarkb: might want to save off logs from that, it's one of the more recent ones and it's running up against the purge date | 18:43 |
| rm_work | it seems | 18:43 |
| clarkb | rm_work: johnsom http://paste.openstack.org/show/628209/ the three things that stand out to me are the different cpu definitions, the cpu shares thing and the working instance seems to force running on a single cpu | 18:44 |
| clarkb | preserved at ^ | 18:44 |
| rm_work | clarkb: if there's stuff we could do to test out changes for these -- we can do that | 18:44 |
| clarkb | the os type is also different | 18:44 |
| rm_work | we can put up a revert to our OVH fix, which we can recheck till we get failures | 18:44 |
| rm_work | and we can add code to it to change these variables and see what happens | 18:45 |
| clarkb | rm_work: cool, I'll keep that in mind though my goal is a minimal reproduction case | 18:45 |
| rm_work | k well i went ahead and did the revert patch https://review.openstack.org/#/c/525729/ | 18:46 |
| rm_work | I'll poke at it until I get a fail just whenever it finishes runs | 18:46 |
| rm_work | not difficult | 18:46 |
| rm_work | at least that'll get us a newer one | 18:46 |
| rm_work | and if you tell me how to fix those issues, I can start putting in those fixes | 18:47 |
| johnsom | clarkb The patch adam linked has the qemu command line. I think a minimal case would be to run that with a cirros image. | 18:48 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Fix typo in zookeeper election firewall port https://review.openstack.org/525730 | 18:49 |
| pabelanger | clarkb: mind a quick +3 for firewall typo^ | 18:49 |
| clarkb | johnsom: ya, I just don't want them to test it independently and come back saying it works (because it currently does work for me if I remove nova from the equation so trying to narrow it down) | 18:52 |
| johnsom | clarkb Ah, ok, cool. Also note, the qemu stuff there is the artful import, not the stock xenial. I know I tried the hardware type fix once and it did not solve this, but it may be related to the packages. | 18:53 |
| *** dizquierdo has joined #openstack-infra | 18:53 | |
| clarkb | ya I'm running with the UCA packages | 18:54 |
| *** armaan has joined #openstack-infra | 18:55 | |
| clarkb | its ovh base ubuntu + UCA packages + virt-install (because its an easy way to kvm) | 18:55 |
| johnsom | clarkb Check the seabios and all the qemu packages. | 18:55 |
| *** david-lyle has joined #openstack-infra | 18:55 | |
| clarkb | yes virt-install deps on all that | 18:56 |
| clarkb | and dist-upgrade pulls them all from UCA | 18:56 |
| johnsom | Ok | 18:56 |
| clarkb | its basically the same process that devstack uses to get there | 18:56 |
| *** jamesmcarthur has joined #openstack-infra | 18:57 | |
| clarkb | virsh edit doesn't seem to actually make chagnes stick though :/ | 18:58 |
| clarkb | will have to just define new instances | 18:58 |
| *** shardy has quit IRC | 18:58 | |
| clarkb | but first infra meeting | 18:58 |
| clarkb | Infra team meeting in ~2 minutes over in #openstack-meeting | 18:59 |
| *** wolverineav has quit IRC | 19:00 | |
| *** wolverineav has joined #openstack-infra | 19:01 | |
| *** david-lyle has quit IRC | 19:01 | |
| pabelanger | the zk emails are me, I am trying to figure out a binding issue with zookeeper for admin ports | 19:01 |
| *** armaan has quit IRC | 19:02 | |
| *** armaan has joined #openstack-infra | 19:03 | |
| *** ldnunes has quit IRC | 19:06 | |
| *** Goneri has quit IRC | 19:10 | |
| *** hamzy has joined #openstack-infra | 19:10 | |
| pabelanger | So, it seems zookeeper will use the hostname to resolve which IP address to bind for the admin ports, and because we have: 127.0.1.1 zk01.openstack.org zk01 in /etc/hosts, it results on using 127.0.1.1, suggestions? | 19:10 |
| pabelanger | I can remove it from /etc/hosts, but then we need to update hostname, as zk01 doesn't resolve | 19:11 |
| pabelanger | i'm trying to see if there is an address setting in zoo.cfg, but seeing nothing atm | 19:11 |
| fungi | seems like at least a feature request to the zk upstream | 19:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Use the new sphinx PTI for special publish jobs https://review.openstack.org/521557 | 19:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Switch remaining docs publications jobs to sphinx https://review.openstack.org/525734 | 19:14 |
| *** trown|lunch is now known as trown | 19:14 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Make AFS marker roles honor sphinx variables https://review.openstack.org/525735 | 19:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Migrate special docs jobs to build-openstack-sphinx-docs https://review.openstack.org/525736 | 19:14 |
| mordred | AJaeger_: ^^ I made some more patches - the most important to look at is I split the project-config patch into two - https://review.openstack.org/521557 switches infra docs publish jobs and adds the python3 versions needed by zuul | 19:15 |
| *** dizquierdo has quit IRC | 19:15 | |
| mordred | AJaeger_: so I think we can land that one and use it to verify that publication works as expected on repos where we're more tolerant of a break if we got something wrong | 19:16 |
| mordred | AJaeger_: then https://review.openstack.org/525734 does the switch for publication | 19:16 |
| openstackgerrit | Ian Main proposed openstack-infra/tripleo-ci master: DNM, update logging for undercloud containers https://review.openstack.org/518972 | 19:16 |
| mordred | AJaeger_: also - the two ozj patches are for migrating the other sphinx jobs (api-ref and friends) - and updating the ansible defaults for our AFS roles | 19:16 |
| mordred | jeblair, pabelanger: ^^ would love if y'all could look at https://review.openstack.org/525735 at least - you can see it in use on https://review.openstack.org/525734 | 19:17 |
| *** ldnunes has joined #openstack-infra | 19:18 | |
| *** rbrndt has joined #openstack-infra | 19:21 | |
| openstackgerrit | Merged openstack-infra/system-config master: Fix typo in zookeeper election firewall port https://review.openstack.org/525730 | 19:26 |
| *** electrofelix has quit IRC | 19:27 | |
| *** yamamoto has quit IRC | 19:27 | |
| *** Apoorva_ has joined #openstack-infra | 19:28 | |
| *** tosky has joined #openstack-infra | 19:28 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:31 | |
| *** Apoorva has quit IRC | 19:31 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/system-config master: Add dmsimard to infra-root user keys https://review.openstack.org/525738 | 19:35 |
| *** esberglu_ has joined #openstack-infra | 19:40 | |
| *** kgiusti has quit IRC | 19:42 | |
| *** esberglu has quit IRC | 19:43 | |
| dmsimard | AJaeger_, mordred: the single quote thing I mentioned earlier https://github.com/ansible/ansible/issues/28674 | 19:45 |
| smcginnis | Release job failure: http://lists.openstack.org/pipermail/release-job-failures/2017-December/000677.html | 19:46 |
| smcginnis | I thought we had fixed this job before. | 19:46 |
| smcginnis | I see legacy-npm-upload defined in openstack-zuul-jobs. | 19:47 |
| *** kgiusti has joined #openstack-infra | 19:49 | |
| *** dizquierdo has joined #openstack-infra | 19:54 | |
| *** kjackal has quit IRC | 19:55 | |
| *** kjackal has joined #openstack-infra | 19:55 | |
| *** caphrim007 has quit IRC | 19:56 | |
| *** smatzek has quit IRC | 19:58 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/system-config master: Add dmsimard to infra-root user keys https://review.openstack.org/525738 | 20:00 |
| *** csomerville has joined #openstack-infra | 20:00 | |
| pabelanger | mordred: we should totally move mirror-update into zuulv3 periodic pipeline, now that we know AFS works well | 20:01 |
| ianw | pabelanger: i was wondering about that, but things like the fedora update that took about 5+ hours yesterday ... definitely have to figure out how to fiddle timeouts | 20:02 |
| *** dizquierdo has quit IRC | 20:03 | |
| pabelanger | ianw: yah, I think we still need a manual bootstrap process for initial vos release | 20:03 |
| *** florianf|afk has quit IRC | 20:04 | |
| jbryce | Following up on that last item in the meeting, opendev 2018 is not yet scheduled, but I would expect it to be in the August-September timeframe | 20:05 |
| fungi | thanks jbryce! looking forward to it | 20:05 |
| *** jrist has quit IRC | 20:05 | |
| pabelanger | infra-root: are we okay to delete proposal.slave / release.slave / signing.ci now? | 20:06 |
| *** armaan has quit IRC | 20:07 | |
| openstackgerrit | Merged openstack-infra/os-loganalyze master: Add clickable CRITICAL link https://review.openstack.org/520297 | 20:07 |
| openstackgerrit | Merged openstack-infra/os-loganalyze master: Support severity filtering for dragonflow logs https://review.openstack.org/520320 | 20:07 |
| fungi | pabelanger: ianw: i guess the main benefit we get from moving mirror updating into zuul is public logging of the individual runs? otherwise we're just treating it as an overly-complex cron replacement | 20:07 |
| fungi | oh, i suppose we also have a lot of the afs publishing boilerplate zuulified, so we reduce duplicating that stuff | 20:07 |
| *** Hal has joined #openstack-infra | 20:08 | |
| *** florianf|afk has joined #openstack-infra | 20:08 | |
| ianw | and i guess less special pets, or severless, or whatever it's called these days | 20:08 |
| fungi | and one more server we can stop babysitting. right | 20:09 |
| fungi | heh, "serverless" | 20:09 |
| *** caphrim007 has joined #openstack-infra | 20:09 | |
| fungi | i think that term usually refers to "lambda functions as a service" | 20:09 |
| fungi | which i suppose you could consider zuul/nodepool to provide insofar as it abstracts away most of the server part from the people writing the functions they want run | 20:10 |
| fungi | so... sure! | 20:10 |
| fungi | anyway, i'm sold on the idea | 20:10 |
| pabelanger | dmsimard: https://etherpad.openstack.org/p/infra-sprint-xenial-upgrades now has more servers | 20:11 |
| ianw | and it runs remote, so let's throw edge computing in there | 20:11 |
| fungi | an edge case! | 20:11 |
| fungi | pabelanger: yes, delete delete delete | 20:11 |
| *** wolverineav has quit IRC | 20:11 | |
| dmsimard | pabelanger: btw, those would be reinstalled correct ? We're not interested in doing dist-upgrades ? | 20:12 |
| openstackgerrit | Stibbons proposed openstack-dev/pbr master: allow version override only for non pkgmetadata https://review.openstack.org/524421 | 20:13 |
| *** wolverineav has joined #openstack-infra | 20:13 | |
| ianw | my feeling has been it's good to periodically do !dist-upgrades to prove that in a DR case it works | 20:14 |
| fungi | also, allows us to do more hitless cutovers for most things | 20:15 |
| dmsimard | I've never been much of a fan of dist upgrades (other than my laptop, thank you Fedora you work great) | 20:15 |
| ianw | we'd probably benefit from periodic reboots too; we're certainly moving to a more "HA" environment with various things where that might be more possible | 20:15 |
| fungi | i do dist-upgrade on my personal machines and servers, but i run debian | 20:15 |
| *** camunoz has joined #openstack-infra | 20:16 | |
| pabelanger | dmsimard: right, we usually bring online the new server, make sure it works, migrate data if needed, then update DNS to new server | 20:16 |
| fungi | ianw: honestly, we should be doing better about tracking our need to reboot things. we have unattended upgrades updating kernels for security fixes we end up not actually running by not getting around to rebooting until forced by a provider outage, crash, whatever | 20:16 |
| pabelanger | dmsimard: in the case of ethercalc01.o.o, we | 20:17 |
| pabelanger | err | 20:17 |
| fungi | dmsimard: luckily we tend to keep stateful data in trove instances or on cinder volumes, so we don't need to copy data from the old server to the new one | 20:17 |
| *** ldnunes has quit IRC | 20:17 | |
| dmsimard | fungi: the problem I have with dist-upgrades is that they're not tested | 20:17 |
| dmsimard | fungi: in the sense that your integration jobs will test from-scratch deployments on the targetted release | 20:18 |
| pabelanger | dmsimard: in the case of ethercalc01.o.o, we'd launch ethercalc02.o.o, check to see what data needs to migrate (like detach volumes), schedule outage (if needed), switch dns for ethercalc.o.o to ethercalc02.o.o, then remove ethercalc01.o.o | 20:18 |
| ianw | fungi: rackspace do seem to run a (slightly unintentional?) reboot-as-a-service for us :) | 20:18 |
| dmsimard | but you're rarely going to be installing on, say, trusty and then do a dist-upgrade during the job and test that stuff still works | 20:18 |
| fungi | dmsimard: right, that's basically why i do dist upgrades on my personal systems... to test them and report bugs back to the distro. but i can afford the downtime and enjoy digging into the broken when that happens ;) | 20:18 |
| pabelanger | dmsimard: logstash-workers, we can just delete each one then launch as xenail with same hostname, then just update DNS to new ip | 20:18 |
| dmsimard | pabelanger: let's put that kind of notes in the pad | 20:19 |
| *** AlienBlood has joined #openstack-infra | 20:19 | |
| pabelanger | yah, we could start a section about upgrades in https://docs.openstack.org/infra/system-config/ | 20:19 |
| *** efried_cya_wed has quit IRC | 20:20 | |
| pabelanger | dmsimard: would be a good opportunity for you or frickler dive that docs, shouldn't take much to get something going for next week | 20:21 |
| pabelanger | dmsimard: the only time I know of us doing dist-upgrade was on lists.o.o, so we could keep IP address | 20:21 |
| dmsimard | yeah I already planned on going through the existing docs for the components I'll be hitting and refreshing them as necessary | 20:22 |
| pabelanger | fungi: okay, will wait for clarkb to confirm about old jenkins servers, then will delete | 20:22 |
| fungi | pabelanger: and the wiki server, because of lack of puppetry for it | 20:23 |
| clarkb | (I'm lunching so will be a bit) | 20:23 |
| fungi | pabelanger: though in the case of wiki.openstack.org we booted a server called wiki-upgrade-test.openstack.org and then dist-upgraded that to confirm the wiki could be upgraded safely | 20:23 |
| ianw | infra-core: also, if new people are jumping into launch-node maybe something like https://review.openstack.org/#/c/440928/ will help ... a few ui features to add some defaults and a overview/confirmation prompt | 20:24 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 20:24 |
| fungi | however, before deleting it, due to a race condition in the precise-to-trusty upgrade for the iptables-persistent package we ended up leaving it unfirewalled, it got compromised through its elasticsearch api, and we had to hurriedly migrate over to the upgrade test server so we could shut off the hax0red one | 20:25 |
| *** e0ne has joined #openstack-infra | 20:25 | |
| fungi | the race condition being in the order in which we applied puppet manifests to it (which is why the upgrade test server didn't suffer the same fate--it wasn't in puppet) | 20:26 |
| *** xarses has quit IRC | 20:27 | |
| openstackgerrit | Stibbons proposed openstack-dev/pbr master: add version fallback env var when no git upstream https://review.openstack.org/524421 | 20:27 |
| fungi | though i think any effort we put into upgrading the current production wiki is better spent on making sure our puppet-mediawiki module works on wiki-dev.o.o and then build a new xenial-based wiki server with proper puppeting | 20:28 |
| pabelanger | yah | 20:28 |
| *** yamamoto has joined #openstack-infra | 20:28 | |
| *** efried_cya_wed has joined #openstack-infra | 20:30 | |
| *** edmondsw has quit IRC | 20:30 | |
| jesusaur | if zuul still expected to remove the verified vote when starting tests after a recheck? | 20:31 |
| jesusaur | s/if/is/ | 20:31 |
| *** rwsu has quit IRC | 20:31 | |
| *** rwsu has joined #openstack-infra | 20:31 | |
| fungi | jesusaur: no, it hasn't done that since at least v1.x days | 20:32 |
| jesusaur | oh, huh | 20:32 |
| fungi | it only removes its vote when enqueuing into the gate pipeline | 20:32 |
| *** yamamoto has quit IRC | 20:35 | |
| *** mmethot has joined #openstack-infra | 20:37 | |
| fungi | jesusaur: though, i should clarify. it's probably entirely possible to configure it to _still_ do that, but we stopped having zuul.openstack.org do it for check pipeline runs long, long ago | 20:37 |
| mmethot | hey guys, might be a stupid question... What user is used when doing tests with Zuul? getting a tty issue which shouldnt be as NOPASSWD is set :-/ | 20:37 |
| dmsimard | mmethot: which zuul ? | 20:37 |
| fungi | jesusaur: so depending on what you mean by "zuul" (the software, or the server we're running) the answer could be entirely different | 20:37 |
| mmethot | Asking for cinder project | 20:37 |
| mmethot | https://review.openstack.org/#/c/524728/ | 20:38 |
| mmethot | I would say software not server | 20:38 |
| dmsimard | mmethot: do you have a link ? | 20:38 |
| jesusaur | fungi: ya, I meant zuul.o.o and was confused when my recheck didn't clear zuul's previous +2 | 20:38 |
| dmsimard | mmethot: to the failure in the logs, I mean | 20:38 |
| mmethot | dmsimard, sure on sec | 20:38 |
| mmethot | http://logs.openstack.org/28/524728/3/check/openstack-tox-py27/81a7200/job-output.txt.gz | 20:39 |
| mmethot | Stderr: u'sudo: no tty present and no askpass program specified\n' | 20:39 |
| mmethot | search for that last post | 20:39 |
| pabelanger | mmethot: it will be the 'zuul' user, which jobs are run under | 20:39 |
| fungi | mmethot: sudo gets turned off in unit test jobs, so that's sudo's opaque and noncommittal way of indicating you're not allowed to run it | 20:40 |
| mordred | mmethot: that seems to be trying to execute something with sudo in a unittest - we revoke sudo for unittests on purpose | 20:40 |
| pabelanger | mmethot: if you need sudo, you'll need to stop using revoke-sudo role | 20:40 |
| mordred | and three of us answer at once :) | 20:40 |
| mmethot | awesome, thanks for the info | 20:40 |
| mmethot | unsure how to proceed though "stop using revoke-sudo role" | 20:41 |
| mordred | well - don't do that in this case | 20:41 |
| fungi | mmethot: basically, we don't want devs to be worried that if they run `tox -e py27` on their workstation, you might have some code buried in there which does something with sudo | 20:41 |
| mmethot | aha aiight | 20:41 |
| mmethot | fungi, so failure is by design, or I should rework this somehow? | 20:41 |
| mordred | you'll need to figure out how to mock or fake the sudo call in question in the unit tests ... so yo might need a unittest-specific utils.get_root_helper() or something | 20:41 |
| mordred | mmethot: yes | 20:42 |
| mordred | if it's a thing that you absolutely can't test without sudo, it's likely more suitable for a functional test - I don't know enough about the guts here to get much more specific advice | 20:43 |
| mmethot | mordred, alright thanks for the insight. I'm pretty green at commiting to ops, so I'll have to figure that out I guess | 20:43 |
| *** slaweq has joined #openstack-infra | 20:43 | |
| mordred | mmethot: I betcha someone over in cinder land might be able to help more deeply ... smcginnis you around? ^^ | 20:43 |
| *** gyee has joined #openstack-infra | 20:44 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/system-config master: Add frickler to infra-root user keys https://review.openstack.org/525748 | 20:44 |
| frickler | dmsimard: thanks for going first, so I had a template ;) | 20:44 |
| * frickler EODs now | 20:45 | |
| fungi | lgtm! | 20:45 |
| *** caphrim007 has quit IRC | 20:46 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Switch remaining docs publications jobs to sphinx https://review.openstack.org/525734 | 20:46 |
| *** caphrim007 has joined #openstack-infra | 20:47 | |
| smcginnis | mordred, mmethot: I haven't looked (catching up between moving around) but sounds like something needs to be mocked out. Shouldn't be doing anything that needs sudo. | 20:47 |
| mordred | dmsimard: got a sec to look at https://review.openstack.org/#/c/525688/ ? | 20:47 |
| *** caphrim007 has quit IRC | 20:49 | |
| *** caphrim007 has joined #openstack-infra | 20:49 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: cistatus.html: update OVB jobs https://review.openstack.org/525751 | 20:50 |
| mmethot | smcginnis, yeah I think I'll need to rework the test | 20:51 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Remove alien_list command https://review.openstack.org/525177 | 20:54 |
| *** Apoorva_ has quit IRC | 20:57 | |
| *** Apoorva has joined #openstack-infra | 20:57 | |
| *** Goneri has joined #openstack-infra | 20:59 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config master: neutron: also drop -api job from master gate https://review.openstack.org/525754 | 21:03 |
| smcginnis | fungi: And idea on this one? http://lists.openstack.org/pipermail/release-job-failures/2017-December/000677.html | 21:07 |
| fungi | smcginnis: ahh, right, meant to pick that up and take a look. clearly a configuration issue... | 21:08 |
| fungi | "Unable to freeze job graph: Dependent job legacy-npm-upload not found" | 21:09 |
| smcginnis | fungi: I see the job definition, so I'm not sure where the disconnect is. | 21:09 |
| fungi | checking openstack/monasca-grafana-datasource to see if they've done anything fun in there first | 21:09 |
| dmsimard | mordred: looking | 21:09 |
| *** nicolasbock has quit IRC | 21:10 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config master: Remove docs jobs from tripleo-upgrade https://review.openstack.org/525758 | 21:10 |
| fungi | smcginnis: the good news is that there is no special zuul configuration in their repo at least, and only one branch | 21:10 |
| mwhahaha | EmilienM: -^ is that the right spot? | 21:10 |
| *** Apoorva_ has joined #openstack-infra | 21:10 | |
| fungi | smcginnis: so presumably this is broken for every repo trying to use that job | 21:11 |
| EmilienM | mwhahaha: you're the new tripleo/zuul expert. | 21:11 |
| mwhahaha | pffft | 21:11 |
| smcginnis | fungi: That's in the right repo, right? | 21:12 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config master: Fixed grafana neutron board for new scenario/api job names https://review.openstack.org/525759 | 21:12 |
| fungi | smcginnis: that's what i'm attempting to confirm. starting from http://codesearch.openstack.org/?q=legacy-npm-upload because i'm lazy | 21:12 |
| *** hamzy has quit IRC | 21:12 | |
| *** AlienBlood has quit IRC | 21:13 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] Move prepare-zanata-client to o-z-j https://review.openstack.org/525760 | 21:14 |
| ianw | dmsimard / AJaeger : ^ what do you think of moving down this path? I'm worried that role gets no testing, when it could | 21:14 |
| *** Apoorva has quit IRC | 21:14 | |
| dmsimard | mordred: it's kinda weird that we're moving sphinx builds away from tox and then woops, turns out tox was convenient after all | 21:17 |
| dmsimard | I don't have context on that move so I'm probably missing something obvious | 21:17 |
| dmsimard | looks like we're now jumping through a couple hoops to make up for the fact that we no longer have tox, creating and using venvs, etc. | 21:18 |
| *** jtomasek has quit IRC | 21:18 | |
| fungi | dmsimard: partly because we're told almost no python projects outside openstack use tox to set up sphinx, but also sphinx should be totally usable by non-python projects and adding tox configuration to them just to be able to generate documentation is marginally distasteful | 21:18 |
| dmsimard | makes our life pretty darn convenient though doesn't it | 21:19 |
| fungi | oh, sure | 21:19 |
| fungi | smcginnis: yeah, i'm confused by this one... i'm sure i'm missing something obvious | 21:20 |
| mordred | dmsimard: oh - we'll get it removed from the ones it's still being used for :) | 21:22 |
| smcginnis | fungi: At least I'm not the only one. :) | 21:22 |
| ianw | pabelanger: all those mirrors in your list are xenial right? or is it just not pruned yet? | 21:22 |
| dmsimard | mordred: I'm really itching a rewrite of that shell block in an ansible task here https://review.openstack.org/#/c/525688/4/roles/ensure-sphinx/tasks/main.yaml | 21:22 |
| *** kgiusti has left #openstack-infra | 21:23 | |
| dmsimard | but I can take a stab at it as a follow up | 21:23 |
| fungi | smcginnis: i find it marginally weird that the job definition defines a dependency on publish-openstack-python-tarball but then we add that same dependency everywhere we derive it in projects.yaml | 21:23 |
| fungi | smcginnis: i'm wondering if that's a typo... none of our other legacy job definitions have a dependencies map | 21:24 |
| fungi | er, list | 21:24 |
| pabelanger | ianw: I stil need to confirm, I look the info from manifests/site.pp in our nodes section | 21:24 |
| mordred | dmsimard: yah - that seems like a good follow up for sure | 21:24 |
| *** armax has quit IRC | 21:25 | |
| *** [HeOS] has quit IRC | 21:25 | |
| smcginnis | fungi: Yeah, I wonder what would be a reason for that. | 21:25 |
| *** e0ne has quit IRC | 21:25 | |
| ianw | urgh, a "playbook doesn't exist" or something would have been nice for my typo in https://review.openstack.org/#/c/525760/ | 21:26 |
| *** Apoorva_ has quit IRC | 21:26 | |
| *** caphrim007 has quit IRC | 21:26 | |
| *** Apoorva has joined #openstack-infra | 21:26 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] Move prepare-zanata-client to o-z-j https://review.openstack.org/525760 | 21:26 |
| fungi | smcginnis: git blame says it was added to the definition by https://review.openstack.org/507943 but at the time there were other jobs in there with dependencies specified too | 21:27 |
| jlvillal | clarkb: ianw: As a note the clickable CRITICAL link is working. Thanks for the reviews. http://logs.openstack.org/13/525713/1/check/ironic-tempest-dsvm-ipa-partition-uefi-pxe_ipmitool-tinyipa/b98dcf8/logs/screen-ir-api.txt.gz?level=CRITICAL | 21:27 |
| pabelanger | woot! | 21:27 |
| pabelanger | zookeeper cluster looks to be running: http://paste.openstack.org/show/628221/ | 21:28 |
| pabelanger | so, we need to figure out how to proceed about modficiation to /etc/hosts | 21:28 |
| pabelanger | that's the only non-puppet change we needed | 21:29 |
| smcginnis | fungi: There has been a release for this one since that patch. | 21:29 |
| fungi | smcginnis: yeah, this line of inquiry may be a red herring | 21:30 |
| *** edmondsw has joined #openstack-infra | 21:30 | |
| *** aeng has joined #openstack-infra | 21:31 | |
| dmsimard | mordred: testing an approach, I'll send something in a few | 21:32 |
| *** caphrim007 has joined #openstack-infra | 21:33 | |
| mordred | dmsimard: cool | 21:33 |
| rm_work | clarkb: instant repro on my revert patch :) http://logs.openstack.org/29/525729/1/check/octavia-v1-dsvm-scenario-multinode/94dbdac/logs/libvirt/qemu/instance-00000002.txt.gz | 21:34 |
| *** mat128 has quit IRC | 21:34 | |
| rm_work | clarkb: if you have some quick stuff i could try (around reconfiguring nova maybe? you mentioned some stuff) I would throw it in there and try | 21:34 |
| *** jkilpatr has quit IRC | 21:35 | |
| Shrews | pabelanger: oh, we're going to run a cluster now? neat | 21:35 |
| *** rbrndt has quit IRC | 21:36 | |
| Shrews | pabelanger: how is the existing data migrated? | 21:38 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add sphinx_python variable to sphinx role and job https://review.openstack.org/525763 | 21:39 |
| *** jamesmcarthur has quit IRC | 21:39 | |
| dmsimard | mordred: ^ I submitted as a different patch so it's easier to diff | 21:39 |
| dmsimard | mordred: tl;dr switching from shell to pip, iterate with fileglob to find the files we want (and not do anything if the file isn't there) and switch the use_python3 to a sphinx_python which defaults to python2 | 21:40 |
| *** rbrndt has joined #openstack-infra | 21:41 | |
| AJaeger_ | mordred: commented on https://review.openstack.org/#/c/521557 | 21:41 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add sphinx_python variable to sphinx role and job https://review.openstack.org/525763 | 21:43 |
| pabelanger | Shrews: so, we still need to figure that out. But I think we can just join nodepool.o.o to our zk cluster, and data will replicate? | 21:43 |
| pabelanger | Shrews: plan on reading up on that tonight / tomorrow | 21:43 |
| fungi | jeblair: mordred: i'm coming up short trying to solve the failure smcginnis spotted. attempting to run release pipeline jobs for openstack/monasca-grafana-datasource results in "Unable to freeze job graph: Dependent job legacy-npm-upload not found:" even though legacy-npm-upload is defined in openstack-zuul-jobs just like the other legacy jobs | 21:44 |
| fungi | failure reported 19:43:05z today | 21:45 |
| *** jrist has joined #openstack-infra | 21:46 | |
| fungi | there is a little bit of an oddity insofar as users of this job are declaring variants but just adding explicit job dependencies which are also present in the job definition itself | 21:46 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 21:46 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Allow for multiple playbooks to be run https://review.openstack.org/525765 | 21:46 |
| dmsimard | fungi: is this in a particular branch perhaps ? | 21:46 |
| fungi | master | 21:46 |
| pabelanger | #status log zk01.o.o, zk02.o.o and zk03.o.o now online and SSH keys accepted into puppetmaster.o.o. Currently no production servers are connected to them. | 21:47 |
| openstackstatus | pabelanger: finished logging | 21:47 |
| fungi | dmsimard: the project which hit this only has a master branch | 21:47 |
| AJaeger_ | fungi, shouldn't legacy-npm-upload be a final job anyhow? | 21:47 |
| fungi | AJaeger_: oh, perhaps that's the same old problem again | 21:47 |
| clarkb | rm_work: not yet just starting to dig into it. My plan is to make a new instance by hand using the nova xml to see if that reproduces, then whittle back the nova xml to look more like what virt-install uses to see if the problem goes away | 21:48 |
| clarkb | pabelanger: what is it you wanted me to look at? | 21:48 |
| AJaeger_ | fungi: it's not a final job currently - and only uploads to tarballs, so no secrets. | 21:48 |
| jeblair | fungi, smcginnis, mordred: i can look into it, gimme a min. | 21:48 |
| fungi | AJaeger_: yeah, doesn't look like any of the legacy jobs are set to final | 21:49 |
| *** ihrachys has quit IRC | 21:49 | |
| AJaeger_ | fungi: but it has "dependencies: publish-openstack-python-tarball" | 21:49 |
| pabelanger | clarkb: if we can delete our old static slaves for zuulv2. proposal.slave / release.slave / ci-signing.ci | 21:49 |
| smcginnis | Thanks! | 21:49 |
| AJaeger_ | fungi: is publish-openstack-python-tarball setup for the repo? | 21:49 |
| *** ihrachys has joined #openstack-infra | 21:49 | |
| pabelanger | clarkb: pretty sure all that logic has been migrated into zuulv3 jobs | 21:49 |
| fungi | AJaeger_: right, it's the last remaining job definition in the legacy jobs set which has any dependencies declared | 21:49 |
| dmsimard | clarkb: should frickler and I add ourselves to accessbot ? | 21:49 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 21:49 |
| *** trown is now known as trown|outtypewww | 21:50 | |
| AJaeger_ | fungi, and publish-openstack-python-tarball is not set in project-config as job | 21:50 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 21:50 |
| AJaeger_ | fungi: but it has "dependencies: publish-openstack-python-tarball" | 21:51 |
| AJaeger_ | fungi: let me propose a change quickly... | 21:51 |
| clarkb | dmsimard: I think that is up to you. There hasn't been a strong 1:1 root to irc op relationship (though there is overlap) | 21:51 |
| clarkb | dmsimard: we've had other volunteers that are non roots and had roots that aren't ops | 21:51 |
| dmsimard | clarkb: it's mostly about those #status things. | 21:51 |
| dmsimard | which I guess comes with it | 21:51 |
| clarkb | dmsimard: oh ya for that it is probably useful | 21:52 |
| fungi | AJaeger_: good eye! i didn't think to look for that since the error says "Dependent job legacy-npm-upload not found" but it's actually the publish-openstack-python-tarball job, a dependency of legacy-npm-upload, which isn't found | 21:52 |
| jeblair | clarkb, dmsimard: that's not accessbot | 21:52 |
| dmsimard | jeblair: it's not ? | 21:52 |
| fungi | dmsimard: statusbot | 21:52 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add missing dependency for release job https://review.openstack.org/525769 | 21:53 |
| AJaeger_ | fungi: ^ | 21:53 |
| dmsimard | fungi: thanks, found it | 21:53 |
| *** ihrachys has quit IRC | 21:54 | |
| *** ihrachys has joined #openstack-infra | 21:54 | |
| jeblair | AJaeger_, fungi, smcginnis: i bet there's an easy string formatting change to zuul that would make that better. :) | 21:55 |
| fungi | jeblair: yeah, i'm a step ahead of you there, just trying to untangle the logic in _getParentJobNamesRecursively() | 21:55 |
| fungi | it *looks* right, which is probably why it got through review the first time ;) | 21:55 |
| fungi | i'm guessing there's an off-by-one error in the iteration i'm just not spotting | 21:56 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/system-config master: Add dmsimard to infra-root user keys and statusbot https://review.openstack.org/525738 | 21:56 |
| *** flwang has quit IRC | 21:56 | |
| jeblair | fungi: the function is right, the error message is bogus | 21:56 |
| *** wolverineav has quit IRC | 21:57 | |
| *** wolverineav has joined #openstack-infra | 21:57 | |
| fungi | jeblair: ooh, the old dependent vs dependant dilemma | 21:57 |
| fungi | yeah, i can make that clear | 21:57 |
| clarkb | pabelanger: I think we can clean those up. I guess the only thing we really need to worry about are the secrets but we can always just make new ones if necessary | 21:58 |
| *** smatzek has joined #openstack-infra | 21:59 | |
| *** rhallisey has quit IRC | 21:59 | |
| pabelanger | clarkb: okay, I'll add them to the list to delete | 22:00 |
| *** jamesmcarthur has joined #openstack-infra | 22:00 | |
| pabelanger | clarkb: and take a look at what secrets are in hiera | 22:00 |
| *** Apoorva_ has joined #openstack-infra | 22:00 | |
| AJaeger_ | jeblair: can't we check this earlier? Zuul does a lot of sanity checking already but this error is only thrown when the job is tried to run. We shouldn't have merged the change at all. Or is that not easy possible to check? | 22:00 |
| rm_work | clarkb: yeah ok that makes sense | 22:01 |
| *** flwang has joined #openstack-infra | 22:01 | |
| jeblair | AJaeger_: it is not possible | 22:01 |
| rm_work | just remember I can throw shit at the wall too and see if it sticks, doesn't cost me much time to just throw a line in a file and let the CI do tests | 22:01 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul feature/zuulv3: Correct exception for missing job dependencies https://review.openstack.org/525773 | 22:01 |
| fungi | jeblair: smcginnis: AJaeger_: ^ | 22:01 |
| fungi | no idea if that's too verbose (or even technically accurate) | 22:02 |
| *** wolverineav has quit IRC | 22:03 | |
| jeblair | fungi: suggestion for even more helpful msg | 22:04 |
| jeblair | (inline) | 22:04 |
| *** gouthamr has quit IRC | 22:04 | |
| *** Apoorva has quit IRC | 22:04 | |
| *** smatzek has quit IRC | 22:04 | |
| fungi | jeblair: potentially a (related) issue, we aren't including the tracebacks themselves in the smtp reporter? http://lists.openstack.org/pipermail/release-job-failures/2017-December/000677.html | 22:04 |
| *** threestrands has joined #openstack-infra | 22:05 | |
| *** threestrands has quit IRC | 22:05 | |
| *** threestrands has joined #openstack-infra | 22:05 | |
| *** rcernin has joined #openstack-infra | 22:05 | |
| fungi | wasn't until i went digging in the exception raised that i noticed it's not included in the e-mail we send | 22:05 |
| clarkb | rm_work: initial testing shows that the nova libvirt definition works. I did have to swap out some things like the network as I don't have a neutron though | 22:06 |
| jeblair | fungi: yeah, we filter out tracebacks in reporters; most of the run-time errors are captured with special exception handlers | 22:06 |
| rm_work | clarkb: hmm, k | 22:06 |
| clarkb | rm_work: so I am really confused | 22:06 |
| rm_work | there's a "reproduce.sh" or something isn't there? :P | 22:07 |
| clarkb | about to try it with an ubuntu image next though | 22:07 |
| rm_work | we see it with cirros as well as ubuntu | 22:07 |
| clarkb | rm_work: there is, but I'd like to get somethign small enough that ovh can realistically work with | 22:07 |
| *** priteau has quit IRC | 22:07 | |
| rm_work | roger | 22:09 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul feature/zuulv3: Correct exception for missing job dependencies https://review.openstack.org/525773 | 22:09 |
| *** smatzek has joined #openstack-infra | 22:09 | |
| fungi | jeblair: thanks! | 22:10 |
| jeblair | fungi: ty! | 22:10 |
| fungi | didn't know if it was kosher to repr the current_job | 22:10 |
| fungi | jeblair: anyway, the reason i mention the missing/filtered tracebacks is that in that situation the trailing ": " is potentially confusing | 22:11 |
| fungi | leading me to expect some additional text following it | 22:12 |
| * fungi has to disappear for a few minutes... brb | 22:13 | |
| *** dave-mcc_ is now known as dave-mccowan | 22:15 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] Move prepare-zanata-client to o-z-j https://review.openstack.org/525760 | 22:16 |
| *** makowals has joined #openstack-infra | 22:18 | |
| *** smatzek has quit IRC | 22:18 | |
| dmsimard | ianw: forgot to reply earlier but I'll +1 anything about extending coverage and keeping stuff outside of project-config where relevant | 22:18 |
| *** dprince has quit IRC | 22:18 | |
| ianw | dmsimard: one thing i just realised is it's not really a generic role, in that we'll have to gate "if debuntish" on testing the role, which might be new | 22:19 |
| dmsimard | we should be wary when reviewing stuff that adds new playbooks/roles in project-config and consider if it should go in openstack-zuul-jobs or zuul-jobs | 22:19 |
| dmsimard | ianw: not generic in the sense that it's only ever meant to run on Ubuntu ? | 22:19 |
| ianw | there's no point porting it just for the sake of testing when it's never used, imo | 22:19 |
| *** yamahata has joined #openstack-infra | 22:19 | |
| ianw | well yeah, those tranlate jobs i can't see running on not ubuntu | 22:20 |
| dmsimard | ianw: we can have distro-specific tests maybe, like include: ubuntu.yml when: ansible_distribution == ubuntu | 22:20 |
| *** armax has joined #openstack-infra | 22:20 | |
| dmsimard | it's not terrible | 22:20 |
| ianw | yep, as long as we don't have some self-imposed rule that o-z-j should be 100% portable. i don't think we do | 22:20 |
| dmsimard | ianw: well, I think that ideally, things should be written in a cross-distro compatible way where possible (i.e, use "package" vs "yum" or "apt" modules) | 22:21 |
| dmsimard | but if we're not expecting to run zanata on anything else than ubuntu that's fine too | 22:21 |
| ianw | ++ | 22:22 |
| dmsimard | maybe we could add a fail-fast at the beginning of the role if we're not running ubuntu, for example | 22:22 |
| dmsimard | with a friendly error | 22:22 |
| dmsimard | so that people don't spend time troubleshooting if they end up trying to run it on centos for some reason | 22:22 |
| *** erlon has quit IRC | 22:22 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] Move prepare-zanata-client to o-z-j https://review.openstack.org/525760 | 22:22 |
| *** wolverineav has joined #openstack-infra | 22:25 | |
| *** jamesmcarthur has quit IRC | 22:28 | |
| clarkb | rm_work: ok I have learned things. Your failing VM does not have -enable-kvm passed to qemu-system-x86_64 but my working ones to | 22:29 |
| clarkb | s/to/do | 22:29 |
| clarkb | rm_work: I'm about to try this manually removing that flag to see if it breaks | 22:29 |
| rm_work | hmmmmm | 22:30 |
| rm_work | that's ... umm... interesting | 22:30 |
| rm_work | how would that not be passed | 22:30 |
| *** snapiri has quit IRC | 22:30 | |
| clarkb | rm_work: http://logs.openstack.org/12/511112/6/gate/legacy-octavia-v1-dsvm-py3x-scenario-multinode/bb708ae/logs/libvirt/qemu/instance-00000002.txt.gz its definitely missing from the command there | 22:31 |
| clarkb | but ya not sure why its missing | 22:31 |
| rm_work | uhhh ok right but like | 22:31 |
| rm_work | that's not something WE do | 22:31 |
| rm_work | right | 22:31 |
| *** snapiri has joined #openstack-infra | 22:31 | |
| clarkb | no thats noav | 22:31 |
| clarkb | and or libvirt | 22:31 |
| *** jascott1 has quit IRC | 22:31 | |
| rm_work | so it'd be a nova or libvirt bug? | 22:31 |
| clarkb | which could explain why I am having such a hard time reproducing here | 22:31 |
| rm_work | well, let's see if it changes things in your test :P | 22:31 |
| clarkb | because virsh/virt-install just work | 22:31 |
| clarkb | ya I just now have to sort out how to do qemu-system-x86_64 manually | 22:32 |
| *** jascott1 has joined #openstack-infra | 22:32 | |
| johnsom | It still has "accel=kvm" though... | 22:32 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Improve zanata-cli download https://review.openstack.org/525658 | 22:34 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: prep-zanata: fix stat typo https://review.openstack.org/525777 | 22:34 |
| ianw | dmsimard: ^ so that picked up at least one typo ... i'll keep working on it (after kindergarten christmas concert ... wish me luck :) | 22:34 |
| clarkb | johnsom: ya | 22:36 |
| *** jascott1 has quit IRC | 22:36 | |
| clarkb | johnsom: the difference seems to be full kvm virtualization support vs normal kvm? at least if I am reading the docs properly | 22:36 |
| jesusaur | any infra-root around who feels like digging in some logs? https://review.openstack.org/#/c/517658/ doesn't want to merge after passing gate | 22:36 |
| *** jamesmcarthur has joined #openstack-infra | 22:37 | |
| *** makowals has quit IRC | 22:40 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Correct exception for missing job dependencies https://review.openstack.org/525773 | 22:40 |
| clarkb | running without enable-kvm has not crashed from my foreground logs at least. I do see the unsupported cpu feature though | 22:40 |
| clarkb | but I also am having a hard time figuring out where its console ended up so not sure it even booted | 22:40 |
| *** gouthamr has joined #openstack-infra | 22:42 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 22:43 |
| *** eumel8 has quit IRC | 22:44 | |
| *** yamahata has quit IRC | 22:49 | |
| *** lihi has quit IRC | 22:50 | |
| clarkb | dansmith: do you know if there is a difference between qemu-system-x86_64 -enable-kvm accel=kvm and qemu-system-x86_64 accel=kvm ? | 22:50 |
| dansmith | I do not, sorry | 22:51 |
| *** lihi has joined #openstack-infra | 22:51 | |
| *** wolverineav has quit IRC | 22:51 | |
| *** rbrndt has quit IRC | 22:52 | |
| smcginnis | fungi: Sorry, was afk for awhile. Was that patch a fix, or better reporting of the problem? | 22:53 |
| clarkb | they are related in the code /me is sorting out if they are any difference | 22:53 |
| AJaeger_ | jesusaur: rebase - see the orange circle around parent? | 22:54 |
| AJaeger_ | and the black on on the parent on the right? | 22:54 |
| *** signed8b_ has joined #openstack-infra | 22:54 | |
| clarkb | looks like they may be redundant afterall | 22:54 |
| *** rbrndt has joined #openstack-infra | 22:54 | |
| clarkb | odd that there would be two ways to set the same flag or maybe not all that odd because software | 22:54 |
| AJaeger_ | jesusaur: your change is based on change 1, not on 4; so gerrit waits for rebase ;( | 22:55 |
| *** slaweq has quit IRC | 22:55 | |
| *** signed8bit has quit IRC | 22:58 | |
| openstackgerrit | K Jonathan Harker proposed openstack/diskimage-builder master: zypper: fix package removal https://review.openstack.org/517658 | 22:59 |
| jesusaur | AJaeger_: thanks, that was pretty hard to notice | 23:00 |
| *** esberglu_ has quit IRC | 23:01 | |
| *** esberglu has joined #openstack-infra | 23:01 | |
| *** pcrews has quit IRC | 23:03 | |
| *** yamahata has joined #openstack-infra | 23:04 | |
| *** pcrews has joined #openstack-infra | 23:06 | |
| *** esberglu has quit IRC | 23:06 | |
| AJaeger_ | jesusaur: and I was wrong in one aspect - the black circle means merged,just the orange one was the hint ;( | 23:08 |
| AJaeger_ | if you don't know it, you wont't see it ;( | 23:09 |
| jesusaur | im actually a little surprised that zuul didn't complain before starting the gate jobs | 23:09 |
| jesusaur | but not that surprised because I know how complicated those code paths are | 23:10 |
| AJaeger_ | ihrachys: thanks, just saw your networking-onos approval. They had enough time to review... | 23:11 |
| *** smatzek has joined #openstack-infra | 23:12 | |
| *** slaweq has joined #openstack-infra | 23:13 | |
| *** yamahata has quit IRC | 23:13 | |
| *** esberglu has joined #openstack-infra | 23:14 | |
| *** hashar has quit IRC | 23:15 | |
| *** dhinesh has joined #openstack-infra | 23:16 | |
| *** smatzek has quit IRC | 23:17 | |
| *** slaweq has quit IRC | 23:18 | |
| *** esberglu has quit IRC | 23:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: prep-zanata: fix stat typo https://review.openstack.org/525777 | 23:20 |
| *** dave-mccowan has quit IRC | 23:23 | |
| clarkb | rm_work: johnsom I'm currently running tempest against an openstack with kvm enabled to try and reproduce it any way I can | 23:24 |
| clarkb | so far it seems to be working? | 23:24 |
| clarkb | maybe I did end up with a good hypervisor | 23:25 |
| johnsom | Ha, ok. I'm surprised this so hard to repro. | 23:25 |
| clarkb | is it possible that your jobs are not properly enabling kvm? | 23:26 |
| clarkb | (I am reproducing with a vanilla tempest job reproduce.sh with the libvirt backend updated to kvm from qemu) | 23:27 |
| *** signed8b_ is now known as signed8bit_Zzz | 23:27 | |
| *** Apoorva_ has quit IRC | 23:27 | |
| *** Apoorva has joined #openstack-infra | 23:27 | |
| rm_work | clarkb: you can see our reproduce.sh, does it look wrong for that? | 23:29 |
| rm_work | I don't know what it's SUPPOSED to look like | 23:29 |
| johnsom | clarkb: https://github.com/openstack/octavia/blob/master/octavia/tests/contrib/gate_hook.sh#L33 | 23:29 |
| johnsom | That is the extent of our enable KVM | 23:30 |
| clarkb | ok thats all I've done too | 23:31 |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 23:31 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed Presentation selection_status query filter https://review.openstack.org/525784 | 23:32 |
| clarkb | johnsom: rm_work I think next step is recycle these instances and try again | 23:32 |
| clarkb | there is a non zero chance that it is hypervisor dependent and its tripping over some very specific cpu problem | 23:33 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed Presentation selection_status query filter https://review.openstack.org/525784 | 23:33 |
| rm_work | clarkb: i mean... for us it's 100% of the time on OVH I believe | 23:33 |
| rm_work | but maybe that's not true? could be we just miss the ones that work, selection bias | 23:33 |
| clarkb | oh you know what could be the region too | 23:33 |
| mordred | dmsimard: https://review.openstack.org/#/c/525763/2 looks great in general - one review comment though | 23:33 |
| clarkb | I am in bhs1, where did that job that failed run /me looks | 23:34 |
| johnsom | Yeah, I think it's pretty much 100% of the time with the OVH instances. | 23:34 |
| clarkb | gra1 | 23:34 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 23:34 |
| clarkb | so next step is probably boot instance in gra1 and not bhs1 and try again | 23:34 |
| *** camunoz has quit IRC | 23:34 | |
| rm_work | eh also bhs1 | 23:34 |
| rm_work | http://logs.openstack.org/29/525729/1/check/octavia-v1-dsvm-scenario-multinode/94dbdac/logs/libvirt/qemu/instance-00000002.txt.gz | 23:34 |
| *** edmondsw has quit IRC | 23:34 | |
| rm_work | this is the one that JUST failed today | 23:34 |
| clarkb | ok | 23:34 |
| rm_work | from my revert patch | 23:34 |
| rm_work | http://logs.openstack.org/29/525729/1/check/octavia-v1-dsvm-scenario-multinode/94dbdac/ | 23:35 |
| *** edmondsw has joined #openstack-infra | 23:35 | |
| clarkb | I can only report what I have observed whcih is instance booted in bhs1 running on the infra xenial image is working | 23:35 |
| rm_work | maybe try doing the other stuff we do? | 23:35 |
| clarkb | so either its a hypervisor thing, a not 100% failure, or maybe cirros isn't actually enough but there is something more going on than just make instance in ovh and it breaks | 23:35 |
| rm_work | we do some other change to nova... | 23:36 |
| rm_work | one sec | 23:36 |
| johnsom | When we see it, it's both the cirros and ubuntu cloud image that trigger it. Neither boot. | 23:36 |
| rm_work | http://logs.openstack.org/29/525729/1/check/octavia-v1-dsvm-scenario-multinode/94dbdac/logs/etc/nova/nova-cpu.conf.txt.gz | 23:36 |
| rm_work | errr | 23:37 |
| johnsom | rm_work If you are thinking of the hardware type thing, we don't do that in the gates | 23:37 |
| rm_work | i was expecting to see something in there for the issue with the xenial vs zesty repo | 23:37 |
| rm_work | ah | 23:37 |
| rm_work | ok | 23:37 |
| rm_work | yes that was what i was expecting to see | 23:37 |
| johnsom | I tried that and it didn't make a difference | 23:37 |
| rm_work | k | 23:37 |
| rm_work | nevermind then | 23:37 |
| rm_work | clarkb: *can you* try our reproduce? | 23:38 |
| johnsom | We don't do anything else to nova that I am aware of. | 23:38 |
| rm_work | http://logs.openstack.org/29/525729/1/check/octavia-v1-dsvm-scenario-multinode/94dbdac/logs/reproduce.sh | 23:38 |
| clarkb | rm_work: ya I can try that the next time too | 23:38 |
| rm_work | for us it is difficult to test because we have to roll the dice on each run and hope we get one on OVH | 23:38 |
| * clarkb makes an instance in gra1 | 23:38 | |
| johnsom | clarkb One thing, we use config drive with nova, wonder if that is the difference. Hmmm, but do we do that with cirros? I don't think so | 23:39 |
| *** caphrim007 has quit IRC | 23:40 | |
| clarkb | I am not sure if this tempest run will use config drive but one of the manually booted test VMs did | 23:40 |
| clarkb | but good to know as that is a factor that could affect it | 23:41 |
| *** jamesmcarthur has quit IRC | 23:41 | |
| johnsom | I am looking for our cirros boot call. I would be surprised if it uses config drive. | 23:41 |
| johnsom | No, just a basic nova call | 23:42 |
| clarkb | this process is reminding me why we don't generally debug this stuff... was hoping it would be easy to give ovh a simple reproduction then hand off to them | 23:42 |
| *** yamahata has joined #openstack-infra | 23:43 | |
| clarkb | in other news, I've also confirmed that the ipv6 addrs for our ovh instances are not in the metadata | 23:43 |
| clarkb | so I/we will want to follow up on that too | 23:44 |
| *** caphrim007 has joined #openstack-infra | 23:44 | |
| clarkb | mordred: ^ you might actually know more about that maybe? | 23:44 |
| clarkb | the openstack apis tell you what the ipv6 addresses are but the instance itself isn't told about it from what I can see | 23:46 |
| clarkb | ok I have the reproduce.sh above running in gra1 now | 23:47 |
| clarkb | lets see how that goes | 23:47 |
| clarkb | but then I need to call it a day I think | 23:47 |
| *** caphrim007 has quit IRC | 23:48 | |
| clarkb | oh wait thats a multinode job | 23:49 |
| clarkb | things may not work quite right on my test setup in that case, but we'll see | 23:49 |
| clarkb | looked like we had failures on the primary node so shoudl catch it in single node | 23:49 |
| clarkb | and it just failed because I don't have the multinode stuff ok | 23:51 |
| clarkb | we are going to try it single node | 23:51 |
| *** kazsh has left #openstack-infra | 23:53 | |
| fungi | smcginnis: looks like nobody responded to you (and i got roped into going out to the bar for dni-dins...) but AJaeger_'s 525769 is the fix and my 525773 was just window dressing for next time we hit anything similar so i don't rabbit-hole on a misleading error | 23:54 |
| *** kazsh has joined #openstack-infra | 23:56 | |
| kazsh | Hi Infra root, could you kindly give one more +2 to https://review.openstack.org/#/c/525028/ ? need to land this change for our queens-2 release. | 23:56 |
| *** edmondsw has quit IRC | 23:57 | |
| AJaeger_ | kazsh: how is this related to queens-2? | 23:58 |
| AJaeger_ | kazsh: That change will not change a single line for queens-2 | 23:58 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Create a test matrix role https://review.openstack.org/524402 | 23:59 |
| clarkb | mriedem: any idea why nova doesn't set the libvirt instance name to be the name of the instance in nova? | 23:59 |
| *** mriedem is now known as mriedem_away | 23:59 | |
| clarkb | mriedem: is that so you can have conflicting instance names? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!