| ianw | #status log all afs fileservers running with new settings per https://review.openstack.org/#/c/540198/6/doc/source/afs.rst ; monitoring but no current issues | 00:00 |
|---|---|---|
| *** germs has joined #openstack-infra | 00:01 | |
| *** germs has quit IRC | 00:01 | |
| *** germs has joined #openstack-infra | 00:01 | |
| openstackstatus | ianw: finished logging | 00:01 |
| *** rlandy is now known as rlandy|bbl | 00:02 | |
| *** dhill__ has quit IRC | 00:04 | |
| *** tosky has quit IRC | 00:04 | |
| *** aeng has joined #openstack-infra | 00:05 | |
| *** germs has quit IRC | 00:05 | |
| *** dingyichen has joined #openstack-infra | 00:07 | |
| *** yamamoto has quit IRC | 00:26 | |
| *** yamamoto has joined #openstack-infra | 00:28 | |
| *** yamamoto has quit IRC | 00:28 | |
| *** rosmaita has quit IRC | 00:32 | |
| *** aeng has quit IRC | 00:35 | |
| *** aeng has joined #openstack-infra | 00:35 | |
| *** hongbin has joined #openstack-infra | 00:40 | |
| *** lifeless_ has joined #openstack-infra | 00:46 | |
| *** lifeless has quit IRC | 00:46 | |
| *** wolverineav has quit IRC | 00:54 | |
| *** wolverineav has joined #openstack-infra | 00:57 | |
| *** odyssey4me has quit IRC | 00:59 | |
| *** odyssey4me has joined #openstack-infra | 00:59 | |
| *** cshastri has joined #openstack-infra | 00:59 | |
| *** aeng has quit IRC | 01:02 | |
| *** wolverineav has quit IRC | 01:03 | |
| *** wolverineav has joined #openstack-infra | 01:04 | |
| *** yamamoto has joined #openstack-infra | 01:07 | |
| *** aeng has joined #openstack-infra | 01:10 | |
| *** wxy has joined #openstack-infra | 01:10 | |
| *** wolverineav has quit IRC | 01:11 | |
| *** Kevin_Zheng has joined #openstack-infra | 01:14 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: negative test https://review.openstack.org/522438 | 01:16 |
| *** jlabarre has quit IRC | 01:16 | |
| *** yamamoto has quit IRC | 01:27 | |
| *** camunoz has quit IRC | 01:36 | |
| *** eernst has quit IRC | 01:51 | |
| *** eernst has joined #openstack-infra | 01:53 | |
| *** annp has joined #openstack-infra | 01:56 | |
| *** andreww has quit IRC | 01:56 | |
| *** eernst has quit IRC | 01:58 | |
| *** germs has joined #openstack-infra | 02:02 | |
| *** germs has quit IRC | 02:06 | |
| *** wolverineav has joined #openstack-infra | 02:08 | |
| *** andreww has joined #openstack-infra | 02:11 | |
| *** Nil_ has quit IRC | 02:12 | |
| *** andreww has quit IRC | 02:16 | |
| *** iyamahat has quit IRC | 02:20 | |
| *** yamahata has quit IRC | 02:21 | |
| *** gongysh has joined #openstack-infra | 02:25 | |
| *** jbadiapa has quit IRC | 02:29 | |
| *** dave-mccowan has quit IRC | 02:31 | |
| *** r-daneel has joined #openstack-infra | 02:32 | |
| *** r-daneel_ has joined #openstack-infra | 02:34 | |
| *** r-daneel has quit IRC | 02:36 | |
| *** r-daneel_ is now known as r-daneel | 02:36 | |
| *** myoung|bbl is now known as myoung | 02:39 | |
| *** links has joined #openstack-infra | 02:40 | |
| *** rfolco has quit IRC | 02:40 | |
| *** yolanda has quit IRC | 02:44 | |
| *** yolanda has joined #openstack-infra | 02:45 | |
| *** salv-orl_ has joined #openstack-infra | 02:50 | |
| *** salv-orlando has quit IRC | 02:52 | |
| *** yolanda has quit IRC | 02:53 | |
| *** yolanda has joined #openstack-infra | 02:54 | |
| *** liujiong has joined #openstack-infra | 02:57 | |
| *** wolverineav has quit IRC | 02:58 | |
| *** psachin has joined #openstack-infra | 03:01 | |
| *** wolverineav has joined #openstack-infra | 03:04 | |
| *** ramishra has joined #openstack-infra | 03:05 | |
| *** jamesmcarthur has joined #openstack-infra | 03:13 | |
| *** sree has joined #openstack-infra | 03:13 | |
| *** sree has quit IRC | 03:14 | |
| *** sree has joined #openstack-infra | 03:14 | |
| *** zerick has quit IRC | 03:14 | |
| *** cshastri has quit IRC | 03:16 | |
| *** zerick has joined #openstack-infra | 03:18 | |
| *** wolverineav has quit IRC | 03:18 | |
| *** suhdood has joined #openstack-infra | 03:19 | |
| *** zerick has quit IRC | 03:20 | |
| *** rlandy|bbl is now known as rlandy | 03:22 | |
| *** wolverineav has joined #openstack-infra | 03:22 | |
| *** rlandy has quit IRC | 03:24 | |
| *** bhavik1 has joined #openstack-infra | 03:28 | |
| *** cshastri has joined #openstack-infra | 03:31 | |
| *** suhdood has quit IRC | 03:33 | |
| *** eernst has joined #openstack-infra | 03:40 | |
| *** dhajare has joined #openstack-infra | 03:42 | |
| *** gongysh has quit IRC | 03:42 | |
| *** aeng has quit IRC | 03:43 | |
| *** aeng has joined #openstack-infra | 03:44 | |
| *** yamamoto has joined #openstack-infra | 03:52 | |
| *** eernst has quit IRC | 03:52 | |
| *** bhavik1 has quit IRC | 03:53 | |
| *** hongbin has quit IRC | 04:00 | |
| *** yamamoto has quit IRC | 04:01 | |
| *** dhajare has quit IRC | 04:02 | |
| *** germs has joined #openstack-infra | 04:03 | |
| *** germs has quit IRC | 04:03 | |
| *** germs has joined #openstack-infra | 04:03 | |
| *** yamamoto has joined #openstack-infra | 04:04 | |
| *** germs has quit IRC | 04:07 | |
| *** yamamoto has quit IRC | 04:08 | |
| *** yamamoto has joined #openstack-infra | 04:09 | |
| *** yamamoto has quit IRC | 04:14 | |
| *** wolverineav has quit IRC | 04:15 | |
| *** yamamoto has joined #openstack-infra | 04:16 | |
| *** armaan has quit IRC | 04:17 | |
| *** armaan has joined #openstack-infra | 04:18 | |
| *** jamesmcarthur has quit IRC | 04:18 | |
| *** ykarel has joined #openstack-infra | 04:22 | |
| *** liujiong has quit IRC | 04:22 | |
| *** liujiong has joined #openstack-infra | 04:23 | |
| *** armaan has quit IRC | 04:25 | |
| *** armaan has joined #openstack-infra | 04:26 | |
| *** yamamoto has quit IRC | 04:27 | |
| *** myoung is now known as myoung|afk | 04:28 | |
| *** yamamoto has joined #openstack-infra | 04:28 | |
| *** andreww has joined #openstack-infra | 04:29 | |
| *** andreas_s has joined #openstack-infra | 04:29 | |
| *** andreas_s has quit IRC | 04:34 | |
| *** wolverineav has joined #openstack-infra | 04:42 | |
| *** yamamoto has quit IRC | 04:43 | |
| *** yamamoto has joined #openstack-infra | 04:46 | |
| *** pgadiya has joined #openstack-infra | 04:54 | |
| *** liujiong has quit IRC | 04:58 | |
| *** liujiong has joined #openstack-infra | 04:59 | |
| *** wolverineav has quit IRC | 05:00 | |
| *** wolverineav has joined #openstack-infra | 05:01 | |
| *** lpetrut has joined #openstack-infra | 05:02 | |
| *** wolverineav has quit IRC | 05:05 | |
| *** imacdonn has quit IRC | 05:14 | |
| *** imacdonn has joined #openstack-infra | 05:14 | |
| *** dhajare has joined #openstack-infra | 05:15 | |
| *** armaan has quit IRC | 05:31 | |
| *** armaan has joined #openstack-infra | 05:31 | |
| *** ramishra has quit IRC | 05:35 | |
| *** claudiub has joined #openstack-infra | 05:45 | |
| *** CrayZee has joined #openstack-infra | 05:50 | |
| *** armaan has quit IRC | 05:53 | |
| *** armaan has joined #openstack-infra | 05:54 | |
| *** kjackal has joined #openstack-infra | 05:59 | |
| *** lpetrut has quit IRC | 06:00 | |
| *** armaan has quit IRC | 06:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/554418 | 06:04 |
| *** germs has joined #openstack-infra | 06:04 | |
| *** aeng has quit IRC | 06:05 | |
| *** germs has quit IRC | 06:08 | |
| *** lpetrut has joined #openstack-infra | 06:12 | |
| *** masber has quit IRC | 06:12 | |
| *** e0ne has joined #openstack-infra | 06:21 | |
| *** psachin has quit IRC | 06:27 | |
| *** hoangcx has joined #openstack-infra | 06:35 | |
| hoangcx | hi team, I know we have a gate job that running against ubuntu. | 06:36 |
| hoangcx | I want to set up another job (tempest job) that running against CentOS for testing with specific driver. Is it possible? If yes, could you please give me a tip to create job? | 06:37 |
| hoangcx | thanks a lot | 06:38 |
| mtreinish | hoangcx: probably: https://github.com/openstack-dev/devstack/blob/master/.zuul.yaml#L11-L19 is a good starting point | 06:39 |
| mtreinish | that being said I don't think the centos jobs work, they're not really being maintained | 06:40 |
| *** andreww has quit IRC | 06:40 | |
| *** andreww has joined #openstack-infra | 06:40 | |
| mtreinish | err actually that should be: https://github.com/openstack-dev/devstack/blob/master/.zuul.yaml#L361-L370 not what I linked before | 06:42 |
| mtreinish | they go together, but the real job definition is the second link (the first just defines the nodeset) | 06:44 |
| *** masber has joined #openstack-infra | 06:44 | |
| *** psachin has joined #openstack-infra | 06:47 | |
| *** masber has quit IRC | 06:47 | |
| *** masber has joined #openstack-infra | 06:47 | |
| Jeffrey4l | have two question about zuulv3, what's the relation ship for in-project jobs between branches ? for example, if i add a jobs in master branch. will it run on stable branch? | 06:50 |
| Jeffrey4l | this question come from https://review.openstack.org/554429 | 06:50 |
| Jeffrey4l | question 2: is there any possible way or easier way for developer to re-trigger a job in tag pipeline? | 06:52 |
| *** jbadiapa has joined #openstack-infra | 06:53 | |
| *** lpetrut has quit IRC | 06:57 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an Azure driver https://review.openstack.org/554432 | 07:07 |
| hoangcx | mtreinish: thanks for the pointer. I will start from there | 07:08 |
| *** d0ugal has joined #openstack-infra | 07:12 | |
| *** d0ugal has quit IRC | 07:12 | |
| *** d0ugal has joined #openstack-infra | 07:12 | |
| *** jamesmcarthur has joined #openstack-infra | 07:18 | |
| *** d0ugal has quit IRC | 07:21 | |
| *** haint_ has joined #openstack-infra | 07:23 | |
| *** jamesmcarthur has quit IRC | 07:23 | |
| *** rcernin has quit IRC | 07:23 | |
| *** rcernin has joined #openstack-infra | 07:24 | |
| *** rcernin has quit IRC | 07:24 | |
| haint_ | Hi everyone, my patch is good with Zuul check, but with Zuul gate, it shows RETRY_LIMIT (https://review.openstack.org/#/c/553464/), what should I do? | 07:24 |
| *** armaan has joined #openstack-infra | 07:25 | |
| ianw | haint_: hmm | 07:29 |
| ianw | 2018-03-20 05:41:14.353342 | LOOP [mirror-workspace-git-repos : Synchronize src repos to workspace directory] | 07:29 |
| ianw | 2018-03-20 05:41:14.932476 | primary -> localhost | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ | 07:29 |
| ianw | 2018-03-20 05:41:14.933175 | primary -> localhost | @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ | 07:29 |
| ianw | that's really weird. i wonder if it's an old node? | 07:30 |
| *** alexchadin has joined #openstack-infra | 07:30 | |
| haint_ | I work on docs, I don't know much about the other test of kolla | 07:31 |
| haint_ | what should i do then? | 07:32 |
| *** salv-orl_ has quit IRC | 07:32 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/554418 | 07:33 |
| *** salv-orlando has joined #openstack-infra | 07:33 | |
| *** salv-orlando has quit IRC | 07:33 | |
| *** salv-orlando has joined #openstack-infra | 07:33 | |
| *** pcaruana has joined #openstack-infra | 07:34 | |
| *** alexchadin has quit IRC | 07:36 | |
| *** alexchadin has joined #openstack-infra | 07:37 | |
| *** pcichy has joined #openstack-infra | 07:37 | |
| Jeffrey4l | haint_, recheck should works. let us wait the result. | 07:41 |
| *** d0ugal has joined #openstack-infra | 07:48 | |
| AJaeger | Jeffrey4l: to answer your questions: 1) https://docs.openstack.org/infra/manual/zuulv3.html#stable-branches documents that you need to backport your playbooks, roles and zuul.yaml. 2) there's no way currently | 07:50 |
| haint_ | ianw, Jeffrey4l, how can I recheck at Zuul gate? | 07:51 |
| ianw | haint_: just leave a comment "recheck" and it will run it through again | 07:52 |
| haint_ | thanks | 07:53 |
| ianw | that is an odd failure, we should keep an eye if there's more; particularly if it's from a single provider | 07:53 |
| *** shardy has joined #openstack-infra | 07:54 | |
| Jeffrey4l | haint_, you have left a "recheck" comment. it already trigger the gate. :D | 07:54 |
| Jeffrey4l | AJaeger, understood. thanks | 07:54 |
| *** liujiong has quit IRC | 07:57 | |
| *** tesseract has joined #openstack-infra | 08:00 | |
| *** namnh has joined #openstack-infra | 08:01 | |
| *** armaan has quit IRC | 08:02 | |
| *** andreas_s has joined #openstack-infra | 08:02 | |
| *** germs has joined #openstack-infra | 08:05 | |
| *** germs has quit IRC | 08:05 | |
| *** germs has joined #openstack-infra | 08:05 | |
| *** hashar has joined #openstack-infra | 08:05 | |
| *** jtomasek has joined #openstack-infra | 08:05 | |
| *** kjackal has quit IRC | 08:05 | |
| *** shardy has quit IRC | 08:08 | |
| *** priteau has joined #openstack-infra | 08:08 | |
| *** germs has quit IRC | 08:08 | |
| alexchadin | hi, I try to use "nodeset: openstack-two-node" and zuul launches two devstack nodes at the same time. so some services on compute node sends requests to DB, but DB is placed on controller node and isn't ready yet. | 08:10 |
| alexchadin | how can I launch them in serial mode (controller->compute)? | 08:11 |
| openstackgerrit | Merged openstack-infra/system-config master: Update AFS fileserver settings https://review.openstack.org/540198 | 08:11 |
| openstackgerrit | Merged openstack-infra/system-config master: Switch opensuse mirroring to mirrors.rit.edu https://review.openstack.org/554278 | 08:11 |
| *** jpena|off is now known as jpena | 08:11 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add notes on reprepro _addreference https://review.openstack.org/554089 | 08:12 |
| *** armaan has joined #openstack-infra | 08:13 | |
| *** shardy has joined #openstack-infra | 08:13 | |
| *** hoangcx has left #openstack-infra | 08:17 | |
| *** kjackal has joined #openstack-infra | 08:18 | |
| alexchadin | AJaeger: ^ | 08:20 |
| alexchadin | AJaeger: parent job is devstack-tempest | 08:20 |
| *** shardy is now known as shardy_afk | 08:26 | |
| *** chenying has joined #openstack-infra | 08:28 | |
| AJaeger | alexchadin: better ask on #openstack-qa in that case - and see how the others are done | 08:30 |
| *** Kevin_Zheng has quit IRC | 08:30 | |
| *** _alastor_ has quit IRC | 08:30 | |
| *** zxiiro has quit IRC | 08:30 | |
| alexchadin | AJaeger: thanks | 08:30 |
| *** _alastor_ has joined #openstack-infra | 08:31 | |
| *** Kevin_Zheng has joined #openstack-infra | 08:31 | |
| *** fbouliane has quit IRC | 08:31 | |
| *** zxiiro has joined #openstack-infra | 08:32 | |
| *** fbouliane has joined #openstack-infra | 08:33 | |
| *** e0ne has quit IRC | 08:33 | |
| *** electrofelix has joined #openstack-infra | 08:38 | |
| *** HeOS has joined #openstack-infra | 08:38 | |
| *** armaan has quit IRC | 08:43 | |
| *** armaan has joined #openstack-infra | 08:43 | |
| *** amoralej|off is now known as amoralej | 08:45 | |
| *** lpetrut has joined #openstack-infra | 08:49 | |
| *** florianf has joined #openstack-infra | 08:49 | |
| *** lpetrut_ has joined #openstack-infra | 08:50 | |
| *** lpetrut has quit IRC | 08:50 | |
| *** pcichy has quit IRC | 08:50 | |
| *** shardy_afk is now known as shardy | 08:54 | |
| *** dbecker has joined #openstack-infra | 08:56 | |
| *** alexchadin has quit IRC | 08:58 | |
| *** alexchadin has joined #openstack-infra | 08:59 | |
| *** lucas-pto is now known as lucasagomes | 09:00 | |
| *** andreas_s has quit IRC | 09:01 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update Ironic meeting https://review.openstack.org/554361 | 09:01 |
| *** andreas_s has joined #openstack-infra | 09:01 | |
| *** d0ugal has quit IRC | 09:02 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement a VMWare driver https://review.openstack.org/554463 | 09:03 |
| *** dhajare has quit IRC | 09:04 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an Azure driver https://review.openstack.org/554432 | 09:05 |
| *** jcoufal has joined #openstack-infra | 09:06 | |
| *** mkelnermishal has joined #openstack-infra | 09:06 | |
| *** dingyichen has quit IRC | 09:06 | |
| *** mkelnermishal has left #openstack-infra | 09:06 | |
| *** jpich has joined #openstack-infra | 09:07 | |
| *** alexchadin has quit IRC | 09:09 | |
| *** andreas_s has quit IRC | 09:10 | |
| *** alexchadin has joined #openstack-infra | 09:10 | |
| *** andreas_s has joined #openstack-infra | 09:13 | |
| *** pcichy has joined #openstack-infra | 09:17 | |
| *** tosky has joined #openstack-infra | 09:21 | |
| *** dhajare has joined #openstack-infra | 09:21 | |
| *** andreas_s has quit IRC | 09:22 | |
| *** andreas_s has joined #openstack-infra | 09:22 | |
| *** efoley has joined #openstack-infra | 09:27 | |
| *** gfidente has joined #openstack-infra | 09:30 | |
| *** gfidente has joined #openstack-infra | 09:30 | |
| *** ralonsoh has joined #openstack-infra | 09:35 | |
| *** dhajare has quit IRC | 09:35 | |
| *** andreas_s has quit IRC | 09:36 | |
| *** andreas_s has joined #openstack-infra | 09:37 | |
| *** armaan has quit IRC | 09:38 | |
| *** armaan has joined #openstack-infra | 09:39 | |
| *** derekh has joined #openstack-infra | 09:40 | |
| *** dsariel has joined #openstack-infra | 09:42 | |
| *** kjackal has quit IRC | 09:44 | |
| *** dhajare has joined #openstack-infra | 09:48 | |
| *** e0ne has joined #openstack-infra | 09:55 | |
| *** andreas_s has quit IRC | 09:56 | |
| *** andreas_s has joined #openstack-infra | 09:57 | |
| *** yamamoto has quit IRC | 10:04 | |
| *** alexchadin has quit IRC | 10:04 | |
| *** germs has joined #openstack-infra | 10:05 | |
| *** germs has quit IRC | 10:05 | |
| *** germs has joined #openstack-infra | 10:05 | |
| *** andreas_s has quit IRC | 10:07 | |
| *** andreas_s has joined #openstack-infra | 10:07 | |
| *** yamamoto has joined #openstack-infra | 10:09 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/552316 | 10:09 |
| *** germs has quit IRC | 10:10 | |
| *** namnh has quit IRC | 10:10 | |
| evrardjp | tonyb: is there something preventing the EOLing now? | 10:14 |
| *** yamamoto has quit IRC | 10:14 | |
| jianghuaw_ | hi, how does the job - release-openstack-python make decision on the "Py Version". | 10:23 |
| jianghuaw_ | I see some OS packages have it as py2 and some as py2.py3. | 10:24 |
| *** sree has quit IRC | 10:28 | |
| *** ralonsoh_ has joined #openstack-infra | 10:33 | |
| *** sshnaidm|afk is now known as sshnaidm|sick | 10:35 | |
| *** sambetts|afk is now known as sambetts | 10:36 | |
| *** ralonsoh has quit IRC | 10:37 | |
| *** jpena is now known as jpena|brb | 10:38 | |
| *** jcoufal_ has joined #openstack-infra | 10:42 | |
| *** witek_ is now known as witek | 10:43 | |
| *** masber has quit IRC | 10:43 | |
| *** jcoufal has quit IRC | 10:45 | |
| *** armaan has quit IRC | 10:46 | |
| *** garyk has joined #openstack-infra | 10:56 | |
| *** cshastri has quit IRC | 10:56 | |
| *** michalkm has joined #openstack-infra | 10:59 | |
| *** rcernin has joined #openstack-infra | 11:02 | |
| *** dhajare has quit IRC | 11:02 | |
| *** ralonsoh__ has joined #openstack-infra | 11:03 | |
| *** rcernin has quit IRC | 11:06 | |
| *** ralonsoh_ has quit IRC | 11:07 | |
| *** masber has joined #openstack-infra | 11:08 | |
| *** adarazs is now known as adarazs_lunch | 11:08 | |
| *** yamamoto has joined #openstack-infra | 11:10 | |
| *** masuberu has joined #openstack-infra | 11:12 | |
| *** dhajare has joined #openstack-infra | 11:12 | |
| *** yamamoto has quit IRC | 11:12 | |
| *** yamamoto has joined #openstack-infra | 11:12 | |
| *** masber has quit IRC | 11:14 | |
| *** annp has quit IRC | 11:15 | |
| *** zoli is now known as zoli|lunch | 11:15 | |
| *** tpsilva has joined #openstack-infra | 11:20 | |
| *** pcaruana has quit IRC | 11:23 | |
| *** pbourke_ has quit IRC | 11:23 | |
| *** pbourke_ has joined #openstack-infra | 11:23 | |
| *** psachin has quit IRC | 11:28 | |
| *** jcoufal has joined #openstack-infra | 11:28 | |
| *** pcichy has quit IRC | 11:29 | |
| *** zoli|lunch is now known as zoli | 11:30 | |
| *** jcoufal_ has quit IRC | 11:32 | |
| *** psachin has joined #openstack-infra | 11:33 | |
| *** ldnunes has joined #openstack-infra | 11:36 | |
| *** jpena|brb is now known as jpena | 11:37 | |
| *** yamamoto has quit IRC | 11:40 | |
| *** yamamoto has joined #openstack-infra | 11:41 | |
| *** armaan has joined #openstack-infra | 11:48 | |
| *** Yumeng has quit IRC | 11:52 | |
| *** pcaruana has joined #openstack-infra | 11:55 | |
| haint_ | ianw, Jeffrey4l, thanks, my patch is merged. | 11:58 |
| *** efoley has quit IRC | 12:01 | |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| *** sree has joined #openstack-infra | 12:04 | |
| *** krenczewski has joined #openstack-infra | 12:04 | |
| *** sree_ has joined #openstack-infra | 12:05 | |
| *** sree_ is now known as Guest61245 | 12:05 | |
| *** lucasagomes is now known as lucas-hungry | 12:06 | |
| *** germs has joined #openstack-infra | 12:06 | |
| *** germs has quit IRC | 12:06 | |
| *** germs has joined #openstack-infra | 12:06 | |
| *** sree has quit IRC | 12:08 | |
| *** jaosorior has quit IRC | 12:09 | |
| *** germs has quit IRC | 12:10 | |
| *** odyssey4me has quit IRC | 12:11 | |
| *** odyssey4me has joined #openstack-infra | 12:11 | |
| krenczewski | Hi, I am trying to setup zuul jub, but it looks like my playbook isn not even run. I am testing this here: https://review.openstack.org/#/c/554238/ Please advise where to look for errors | 12:11 |
| *** aviau has quit IRC | 12:12 | |
| *** trown|outtypewww is now known as trown|ruck | 12:12 | |
| *** aviau has joined #openstack-infra | 12:12 | |
| *** rfolco has joined #openstack-infra | 12:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Set up cyborg-specs repository https://review.openstack.org/553975 | 12:14 |
| AJaeger | krenczewski: commented on one unrelated issue | 12:14 |
| AJaeger | let me check one more thing | 12:15 |
| krenczewski | Sure @AJaeger | 12:15 |
| krenczewski | Thanks for input | 12:15 |
| *** edmondsw has joined #openstack-infra | 12:17 | |
| AJaeger | krenczewski: http://logs.openstack.org/38/554238/10/check/contrail-integration/084b813/job-output.txt.gz#_2018-03-20_11_20_39_182447 shows that it was run - but was no output | 12:18 |
| krenczewski | My run_tests.sh is only single echo, shouldn't this be a PASS status? | 12:19 |
| AJaeger | krenczewski: it fails before - you include a role that does not exist | 12:21 |
| AJaeger | krenczewski: you might want to use an ansible linter ,see what we'Ve done for project-config or openstack-zuul-jobs | 12:22 |
| *** jaosorior has joined #openstack-infra | 12:23 | |
| krenczewski | AJaeger Thank, I will lokk into this | 12:23 |
| *** boden has joined #openstack-infra | 12:24 | |
| *** kjackal has joined #openstack-infra | 12:28 | |
| krenczewski | AJaeger Which job should I include to have devstack+patch under test deployed on vm? | 12:30 |
| *** dprince has joined #openstack-infra | 12:30 | |
| *** openstackgerrit has quit IRC | 12:33 | |
| *** rlandy has joined #openstack-infra | 12:33 | |
| *** efoley has joined #openstack-infra | 12:39 | |
| *** r-daneel has quit IRC | 12:41 | |
| *** d0ugal has joined #openstack-infra | 12:41 | |
| *** d0ugal has quit IRC | 12:41 | |
| *** d0ugal has joined #openstack-infra | 12:41 | |
| *** VW has joined #openstack-infra | 12:43 | |
| *** jpena is now known as jpena|lunch | 12:44 | |
| *** kgiusti has joined #openstack-infra | 12:50 | |
| *** myoung|afk is now known as myoung|rover | 12:55 | |
| *** panda is now known as panda|lunch | 12:57 | |
| *** rkukura has quit IRC | 12:57 | |
| *** Goneri has joined #openstack-infra | 12:59 | |
| *** myoung|rover is now known as myoung|rover|mtg | 13:00 | |
| *** openstackgerrit has joined #openstack-infra | 13:01 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/openstack-zuul-jobs master: Revert "Temporarily make legacy-tempest-dsvm-neutron-src NV" https://review.openstack.org/554323 | 13:01 |
| *** agopi has joined #openstack-infra | 13:03 | |
| *** rosmaita has joined #openstack-infra | 13:09 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/bindep master: SUSE: Update openSUSE Tumbleweed references for lsb-release-3.X.X https://review.openstack.org/505657 | 13:10 |
| *** lucas-hungry is now known as lucasagomes | 13:10 | |
| *** michalkm has quit IRC | 13:11 | |
| *** Guest61245 has quit IRC | 13:14 | |
| *** sree has joined #openstack-infra | 13:14 | |
| *** pickle has joined #openstack-infra | 13:16 | |
| *** mriedem has joined #openstack-infra | 13:18 | |
| *** iyamahat has joined #openstack-infra | 13:18 | |
| *** sree has quit IRC | 13:19 | |
| *** iyamahat_ has joined #openstack-infra | 13:19 | |
| *** psachin has quit IRC | 13:21 | |
| *** ldnunes has quit IRC | 13:21 | |
| *** iyamahat has quit IRC | 13:22 | |
| beisner | hi infra friends - do you have an hsm in place for barbican ci or for production? i'm looking into acquiring some hsm units, but would like to poll the audience re: specific models and experiences with those models. | 13:23 |
| *** armaan has quit IRC | 13:24 | |
| *** armaan has joined #openstack-infra | 13:25 | |
| *** adarazs_lunch is now known as adarazs | 13:25 | |
| *** sree has joined #openstack-infra | 13:27 | |
| *** hongbin has joined #openstack-infra | 13:30 | |
| *** pgadiya has quit IRC | 13:30 | |
| *** r-daneel has joined #openstack-infra | 13:32 | |
| *** panda|lunch is now known as panda | 13:34 | |
| mordred | jianghuaw_: the release-openstack-python job runs 'python setup.py sdist bdist_wheel' - that makes a 'universal' wheel (py2.py3) if '[wheel]\nuniversal=1' is in setup.cfg | 13:34 |
| mordred | jianghuaw_: pretty much all openstack projects should have universal=1 - the only time a wheel would not be universal is if it has some C extensions or similar | 13:35 |
| jianghuaw_ | mordred, thanks very much. | 13:36 |
| mordred | AJaeger: ugh. the siblings patch is still unhappy :( | 13:36 |
| *** r-daneel has quit IRC | 13:36 | |
| *** sree has quit IRC | 13:39 | |
| *** esberglu has quit IRC | 13:39 | |
| pabelanger | morning | 13:41 |
| *** esberglu has joined #openstack-infra | 13:42 | |
| *** jpena|lunch is now known as jpena | 13:42 | |
| *** amoralej|lunch is now known as amoralej | 13:43 | |
| *** jlabarre has joined #openstack-infra | 13:43 | |
| pabelanger | mordred: anyideas? just seen in nodepool-builder debug log: http://paste.openstack.org/show/706083/ | 13:44 |
| pabelanger | Shrews: too^ | 13:45 |
| *** ldnunes has joined #openstack-infra | 13:45 | |
| pabelanger | mnaser: looks like new raw images uploaded over night, are you around to try enabling nodepool again? | 13:45 |
| mnaser | pabelanger: i am, lets give it a shot | 13:45 |
| pabelanger | k 1 min | 13:46 |
| *** jamesmcarthur has joined #openstack-infra | 13:47 | |
| *** jamesmcarthur has quit IRC | 13:47 | |
| *** jamesmcarthur has joined #openstack-infra | 13:48 | |
| AJaeger | mordred: yeah ;( | 13:48 |
| pabelanger | mnaser: okay, should be coming online now | 13:48 |
| pabelanger | hmm | 13:48 |
| pabelanger | Error in creating the server: Build of instance ec427131-4c1c-4b1f-be71-f7b0a5d73fe5 aborted: VolumeSizeExceedsAvailableQuota: Requested volume or snapshot exceeds allowed gigabytes quota. Requested 80G, quota is 1600G and 1600G has been consumed | 13:49 |
| pabelanger | I think we might have leaked volumes | 13:49 |
| mnaser | probably | 13:49 |
| mnaser | let me see if i can clean them up | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: dashboard: add /{tenant}/job.html page to display job details https://review.openstack.org/535545 | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: dashboard: add /{tenant}/projects.html web page https://review.openstack.org/537870 | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Fix indentation and renable the eslint rule https://review.openstack.org/545671 | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Shift html templates into components https://review.openstack.org/551327 | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4 https://review.openstack.org/551987 | 13:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 13:49 |
| pabelanger | mnaser: yah, I can see then | 13:49 |
| pabelanger | let me set server to 0 to make it easy | 13:49 |
| pabelanger | 1 sec | 13:50 |
| Shrews | pabelanger: no idea. was something updated recently? | 13:50 |
| pabelanger | Shrews: we changed clouds.yaml yesterday | 13:50 |
| mnaser | pabelanger: ok ill wait till you set to 0 | 13:50 |
| pabelanger | mnaser: okay, looks like we might have launched 2 nodes | 13:51 |
| mnaser | pabelanger: successfully, i assume? | 13:51 |
| *** links has quit IRC | 13:51 | |
| mnaser | pabelanger: im here all day, want to let them finish their jobs? | 13:51 |
| *** mihalis68 has joined #openstack-infra | 13:52 | |
| mordred | pabelanger: oh - that's exciting | 13:52 |
| pabelanger | mnaser: I should be able to see which volumes they are. Let me open an etherpad | 13:52 |
| mnaser | pabelanger: ok cool | 13:52 |
| jianghuaw_ | mordred, thanks. I'm making os-xenapi to be universal: https://review.openstack.org/#/c/554543/1/setup.cfg | 13:52 |
| mnaser | time to stress test the cinder api i guess, i dont think any other cloud in there using bfv yet? | 13:52 |
| mordred | jianghuaw_: lgtm! | 13:52 |
| *** SamYaple has quit IRC | 13:52 | |
| jianghuaw_ | thanks. | 13:53 |
| mnaser | mordred: while you're here i'll poke you about this https://review.openstack.org/#/c/554351/ please :) | 13:53 |
| mordred | mnaser, pabelanger: oh wow, we're using boot-from-volume. neat! | 13:53 |
| pabelanger | mnaser: https://etherpad.openstack.org/p/6dB11tUPCC | 13:53 |
| pabelanger | mordred: yah, new flavors in vexxhost :) | 13:53 |
| mnaser | ok, ill clean all those other ones up | 13:53 |
| pabelanger | mnaser: ack | 13:53 |
| mnaser | i see 3 error instances which i think i can safely delete too? | 13:53 |
| mnaser | yeah it looks like cinder over quota made them go into error | 13:54 |
| pabelanger | mnaser: yah, if you want to get them too please | 13:54 |
| *** dmellado has quit IRC | 13:55 | |
| mordred | mnaser: +A | 13:55 |
| mnaser | mordred: merci | 13:55 |
| mnaser | pabelanger: sent a request to delete them all lets see how much successfully get cleaned up | 13:55 |
| mnaser | ok they all cleaned up | 13:55 |
| mordred | Shrews, pabelanger: only thing I can think of is one thread calling reset() racing another thread calling load | 13:55 |
| pabelanger | mnaser: confirmed | 13:56 |
| mnaser | pabelanger: we should be all cleaned up, we can try going back to 10 again | 13:56 |
| pabelanger | mnaser: kk, bumping to 10 again now | 13:57 |
| mnaser | so just an idea to throw at infra/zuul team, it would be interesting to have support to boot servers on two networks | 13:58 |
| mnaser | the use case would be, we can plug the mirror on the internal network and it would go through a 10gbit network rather than a 1gb public uplink | 13:58 |
| mnaser | now its quite the hassle running dual nics but it might be a really cool optimization to speed things up and take load off compute nodes public ports when it can go through private | 13:59 |
| mordred | mnaser: we actually already support multiple networks in nodepool - the tripleo cloud used it for reasons back in the day | 13:59 |
| mnaser | another interesting alternative would be to host some zuul-agent inside the cloud itself which talks to the main zuul scheduler | 14:00 |
| mordred | mnaser: the harder part, I think, would be handling _using_ that second network on the nodes in a way that the image content still worked on all of the clouds | 14:00 |
| *** gouthamr has joined #openstack-infra | 14:00 | |
| mnaser | that would minimize public ip usage possibly | 14:00 |
| mnaser | mordred: yeah, but i would defer that problem to glean | 14:00 |
| mnaser | glean would configure the interfaces on boot, so image content could be the same | 14:00 |
| mordred | mnaser: there is a zuul story for being able to run chunks of the control plane per-cloud-region and have those have cloud-region affinity | 14:01 |
| pabelanger | ++ | 14:01 |
| mnaser | ok looks like vms are going up too | 14:02 |
| mnaser | and one just disappeared | 14:02 |
| AJaeger | mordred: so, the tox-siblings confuses me, hope you have a good idea | 14:02 |
| mnaser | is there a way for us to know if it just successfully did a job | 14:02 |
| pabelanger | mnaser: yah, looks like launching fine now | 14:02 |
| mnaser | can you still telnet to an ip and get log output or thats no longer a thing, it all has to go through zuul | 14:03 |
| *** eharney has joined #openstack-infra | 14:03 | |
| pabelanger | mnaser: finger | 14:03 |
| pabelanger | or nc | 14:03 |
| *** eernst has joined #openstack-infra | 14:04 | |
| pabelanger | finger build-uuid@zuul.o.o | 14:04 |
| *** stevebaker has quit IRC | 14:04 | |
| mnaser | yeah but i'd have to find a build running on our cloud which means going through status.json | 14:04 |
| mnaser | or /status i guess :P | 14:04 |
| mnaser | oh, looks like status has no listing or any info about where a job is running | 14:05 |
| *** germs has joined #openstack-infra | 14:07 | |
| *** germs has quit IRC | 14:07 | |
| *** germs has joined #openstack-infra | 14:07 | |
| *** finucannot is now known as stephenfin | 14:07 | |
| *** bobh has joined #openstack-infra | 14:07 | |
| pabelanger | oh, yah. Hmm, let me see if I can find one | 14:08 |
| *** sai_ is now known as sai-mtg | 14:09 | |
| *** SamYaple has joined #openstack-infra | 14:11 | |
| mordred | AJaeger: I'm ... I don't have a fix in mind yet - but I'm still poking at it | 14:11 |
| *** germs has quit IRC | 14:11 | |
| *** dhajare has quit IRC | 14:11 | |
| *** yamamoto_ has joined #openstack-infra | 14:12 | |
| *** yamamoto has quit IRC | 14:12 | |
| pabelanger | mnaser: finger a88acc4fb5f44cd89505516e57de9518@zuul.openstack.org | 14:12 |
| pabelanger | is on vexxhost | 14:12 |
| mnaser | okay cool, let's see how it goes | 14:13 |
| pabelanger | looks like pep8 | 14:13 |
| *** dhajare has joined #openstack-infra | 14:13 | |
| mnaser | looks like https://review.openstack.org/552933 so we'll see timing | 14:13 |
| mnaser | (it should be faster, a lot faster than before.) | 14:13 |
| AJaeger | mordred: I thought removing tox_install completely would fix it - but https://review.openstack.org/554292 shows it didn't ;( | 14:14 |
| pabelanger | might take a few jobs to warm up AFS, but yah | 14:14 |
| AJaeger | mordred: thanks for poking at it | 14:14 |
| mnaser | is there someone at the foundation whos at irc who i can poke at for the job board to get something posted up (it's probably in some queue, but be nice to get it moving) | 14:15 |
| corvus | Shrews: when i run that finger command, it disconnects after 10 seconds of idleness | 14:15 |
| mnaser | corvus: ok, me too, thought it was a normal thing because i usually never use finger | 14:15 |
| pabelanger | that should be fixed | 14:15 |
| pabelanger | 1 sec | 14:15 |
| mnaser | it looks like the build is over though | 14:15 |
| pabelanger | https://review.openstack.org/546735 | 14:16 |
| corvus | oh do we need to restart fingergw | 14:16 |
| pabelanger | think we need to restart executors still | 14:16 |
| pabelanger | or fingergw :) | 14:16 |
| corvus | so that was merged on the 14th | 14:16 |
| corvus | zuul 22578 0.0 0.1 1028464 37152 ? Sl Feb24 7:35 /usr/bin/python3 /usr/local/bin/zuul-fingergw | 14:17 |
| corvus | i'll restart it now | 14:17 |
| pabelanger | ack | 14:17 |
| corvus | done | 14:17 |
| pabelanger | could I get another review on https://review.openstack.org/554296/ to fix puppet-gerrit rspec tests with zuul-cloner | 14:20 |
| *** pcaruana has quit IRC | 14:21 | |
| *** eharney_ has joined #openstack-infra | 14:23 | |
| *** myoung|rover|mtg is now known as myoung|rover | 14:23 | |
| jlvillal | gerritbot review request: https://review.openstack.org/#/c/545469/ Some cleanup/refactoring and adding unit tests. Has one +2 Thanks! | 14:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerrit master: Allow user to toggle gerrit-initial-init https://review.openstack.org/554279 | 14:23 |
| pabelanger | or https://review.openstack.org/495594/ | 14:24 |
| *** eharney has quit IRC | 14:24 | |
| *** armaan has quit IRC | 14:25 | |
| *** armaan has joined #openstack-infra | 14:25 | |
| *** sree has joined #openstack-infra | 14:26 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Uninstall and reinstall siblings one at a time https://review.openstack.org/554297 | 14:27 |
| mordred | AJaeger: ^^ I think that'll do it | 14:27 |
| *** felipemonteiro has joined #openstack-infra | 14:27 | |
| *** pcaruana has joined #openstack-infra | 14:28 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:29 | |
| *** sree has quit IRC | 14:30 | |
| pabelanger | mordred: corvus: mind another quick review: https://review.openstack.org/554321/ cacti entry for new vexxhost mirror | 14:31 |
| fungi | beisner: not sure if anybody's responded to you yet, but no we don't have any physical hsm in infra systems. we don't really manage any hardware at all, and relying on an hsm which isn't under our physical control seems extremely fragile (even insecure) | 14:32 |
| *** felipemonteiro has quit IRC | 14:32 | |
| fungi | as for a personal hsm, i haven't really found one i liked though it's been a while since i last looked (i should probably check again and see what's out there nowadays) | 14:33 |
| *** dhajare has quit IRC | 14:34 | |
| *** eharney_ is now known as eharnye | 14:34 | |
| *** eharnye is now known as eharney | 14:34 | |
| *** ykarel is now known as ykarel|away | 14:34 | |
| fungi | i've heard of a few circulating based on open hardware designs, so might be tempted to just build one | 14:34 |
| *** gouthamr has quit IRC | 14:35 | |
| fungi | i have a tough time trusting black-box hardware as it is | 14:35 |
| *** Nil_ has joined #openstack-infra | 14:35 | |
| *** hemna_ has joined #openstack-infra | 14:36 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 14:37 |
| *** d0ugal has quit IRC | 14:38 | |
| *** camunoz has joined #openstack-infra | 14:39 | |
| *** stevebaker has joined #openstack-infra | 14:42 | |
| cmurphy | pabelanger: want to grab these for me? https://review.openstack.org/495119 https://review.openstack.org/495629 https://review.openstack.org/495611 | 14:43 |
| pabelanger | cmurphy: sure | 14:44 |
| pabelanger | +3, thanks! | 14:45 |
| *** cshastri has joined #openstack-infra | 14:45 | |
| cmurphy | ty | 14:45 |
| cmurphy | i like it when my open patch queue gets shorter :) | 14:46 |
| *** sree has joined #openstack-infra | 14:47 | |
| *** eharney_ has joined #openstack-infra | 14:50 | |
| *** gouthamr has joined #openstack-infra | 14:50 | |
| mordred | AJaeger: I've rechecked https://review.openstack.org/#/c/554300/ - I'm optimistic this time :) | 14:50 |
| AJaeger | mordred: small but subtile change ;) | 14:51 |
| *** sree has quit IRC | 14:51 | |
| *** eharney has quit IRC | 14:51 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add mirror02.ca-ymq-1.vexxhost.openstack.org to cacti.o.o https://review.openstack.org/554321 | 14:53 |
| pabelanger | mnaser: looks like all 10 nodes are online now at vexxhost | 14:53 |
| *** dmellado has joined #openstack-infra | 14:54 | |
| *** electrofelix has quit IRC | 14:54 | |
| clarkb | mnaser: mordred osic used multiple nics and limestone appears to be set up that way too | 14:55 |
| *** r-daneel has joined #openstack-infra | 14:55 | |
| clarkb | but those were for ipv6 on one and ipv4 on another. Also rax is multiple nics too | 14:55 |
| pabelanger | oh, right. for limestone, we'll need an ipv4 address for AFS mirror things too | 14:56 |
| pabelanger | was trying to remember how we set that up for osic | 14:56 |
| *** dmellado has quit IRC | 14:56 | |
| *** armaan has quit IRC | 14:57 | |
| mordred | clarkb: huh. I may have missed the fun of adding limestone ... so TIL there is a cloud provider in Dallas I didn't know about before | 14:57 |
| clarkb | pabelanger: the mirror itself will have a floating ip (at least that is initial plan after discussion yesterday) and afs over that | 14:57 |
| clarkb | pabelanger: then all the test nodes can talk to the mirror over ipv6 | 14:57 |
| *** armaan has joined #openstack-infra | 14:57 | |
| pabelanger | yah, that does sound familiar | 14:57 |
| clarkb | same as we had with osiuc | 14:57 |
| *** ykarel|away has quit IRC | 14:59 | |
| rosmaita | mordred: when you have a few minutes, please take a look at https://review.openstack.org/#/c/553641/5 ... just wondering if you've seen this error before & know what it is before I start digging (there | 14:59 |
| mordred | clarkb: rax is multiple nics - but we've never done anything to make them use the rax private interface to talk to the mirror or anything like that | 14:59 |
| rosmaita | s a link for you to look at on the review) | 14:59 |
| clarkb | mordred: we do use those nics for the multinode network overlays though | 14:59 |
| clarkb | mordred: because those don't seem to work when going through floating ips/NAT (so we just private across the board) | 15:00 |
| mordred | rosmaita: nothing jumps out at me immediate | 15:00 |
| mordred | clarkb: ++ | 15:00 |
| rosmaita | mordred: thanks! | 15:00 |
| *** dtantsur|afk is now known as dtantsur | 15:00 | |
| *** dmellado has joined #openstack-infra | 15:01 | |
| mordred | rosmaita: that said - I'll be interested to learn what's broken :) | 15:01 |
| *** jistr is now known as jistr|mtg | 15:01 | |
| logan- | just catching up but it is single nic | 15:01 |
| rosmaita | mordred: will keep you posted | 15:02 |
| *** dprince has quit IRC | 15:03 | |
| logan- | so limestone is different than osic in that regard.. single nic dual stack (ipv4 private + snat; ipv6 dhcp global/public) w/ ipv4 public floating available as needed | 15:03 |
| *** dmellado has quit IRC | 15:04 | |
| pabelanger | #status log nl03.o.o removed from emergency file on puppetmaster.o.o | 15:04 |
| openstackstatus | pabelanger: finished logging | 15:04 |
| AJaeger | mordred: failures in https://review.openstack.org/554292 for tox-siblings | 15:05 |
| *** dmellado has joined #openstack-infra | 15:05 | |
| *** stevebaker has quit IRC | 15:06 | |
| clarkb | logan-: can we attach floating IPs to "Flat External? | 15:06 |
| clarkb | (anyways we'll sort it out) | 15:06 |
| logan- | yessir | 15:07 |
| clarkb | oh wiat I can't see the subnets on flat external. Only on gateway network but that one has the ipv6 and private ipv4 so I think we use gateway network and floating ips | 15:08 |
| clarkb | (I dislike this neutron behavior) | 15:08 |
| *** Swanson has quit IRC | 15:09 | |
| *** d0ugal has joined #openstack-infra | 15:09 | |
| *** stevebaker has joined #openstack-infra | 15:09 | |
| *** sree has joined #openstack-infra | 15:10 | |
| fungi | oh, is it that neutron considers the v4 and v6 addresses different layer 3 networks on the same layer 2 broadcast domain? | 15:10 |
| fungi | if so, that's surprisingly sane (i thought their "network" model used to terribly conflate layers 2 and 3) | 15:11 |
| clarkb | correct subnets are different than networks and you can have multiple subnets on a single network. | 15:13 |
| clarkb | The problem is on these shared global networks you often don't have permission to see the subnets | 15:13 |
| clarkb | because the subnets are system owned or something | 15:13 |
| logan- | yeah I tested pulling an IP from that network. it doesn't show subnets but it seemed to pull a floating ip just fine from flat external :) | 15:15 |
| *** dmellado has quit IRC | 15:16 | |
| *** eharney_ is now known as eharney | 15:16 | |
| *** eernst has quit IRC | 15:16 | |
| fungi | oh, got it, so neutron terminology maps as network=layer2, subnet=layer3? | 15:16 |
| clarkb | fungi: ya | 15:17 |
| *** agopi is now known as agopi|lunch | 15:17 | |
| *** stevebaker has quit IRC | 15:17 | |
| * fungi sometimes wonders whether there were any network engineers around for that original discussion | 15:17 | |
| *** armaan has quit IRC | 15:19 | |
| pabelanger | clarkb: fungi: mind looking at https://review.openstack.org/#/q/topic:gerrit-initial-init today, it should be a way to 2 step brining review01-dev.o.o online | 15:19 |
| *** armaan has joined #openstack-infra | 15:19 | |
| *** agopi|lunch has quit IRC | 15:21 | |
| *** sree has quit IRC | 15:23 | |
| *** VW_ has joined #openstack-infra | 15:25 | |
| *** VW_ has quit IRC | 15:27 | |
| *** VW_ has joined #openstack-infra | 15:27 | |
| *** yamamoto_ has quit IRC | 15:27 | |
| *** sree has joined #openstack-infra | 15:28 | |
| fungi | heading out to grab an early lunch, back in a while | 15:28 |
| *** VW has quit IRC | 15:29 | |
| *** dave-mccowan has joined #openstack-infra | 15:29 | |
| *** bhavik1 has joined #openstack-infra | 15:34 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit master: Switch to using openstack-infra/puppet-openstack_infra_spec_helper https://review.openstack.org/554296 | 15:34 |
| *** stevebaker has joined #openstack-infra | 15:36 | |
| *** jistr|mtg is now known as jistr | 15:36 | |
| clarkb | pabelanger: ya I'll take a look in a few. Just booting up morning first | 15:36 |
| *** sree has quit IRC | 15:37 | |
| pabelanger | ack | 15:42 |
| *** sree has joined #openstack-infra | 15:46 | |
| *** bhavik1 has quit IRC | 15:46 | |
| dmsimard | clarkb, logan-: btw I'm still working on standing the mirror up | 15:46 |
| dmsimard | the config that logan- gave me for clouds.yaml last night works | 15:46 |
| dmsimard | but it required an update for shade | 15:46 |
| *** stevebaker has quit IRC | 15:46 | |
| dmsimard | (launch-env uses an ancient version of ansible and shade) | 15:47 |
| dmsimard | http://paste.openstack.org/raw/706232/ | 15:48 |
| *** pickle1 has joined #openstack-infra | 15:48 | |
| *** felipemonteiro_ has quit IRC | 15:48 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:49 | |
| *** pickle is now known as dhill_ | 15:49 | |
| dmsimard | ssh works now but it's failing on the various checks like ping and etc. looking. | 15:49 |
| dmsimard | From review.openstack.org icmp_seq=1 Destination unreachable: Beyond scope of source address | 15:49 |
| dmsimard | wiki.openstack.org is 100% packet loss | 15:49 |
| *** dsariel has quit IRC | 15:50 | |
| dmsimard | trying again with --keep | 15:50 |
| *** jlabarre has quit IRC | 15:51 | |
| clarkb | dmsimard: if there are security groups enabled you may have to modify their rules | 15:52 |
| clarkb | (though our cloud setup thing should've taken care of that) | 15:52 |
| logan- | you will probably need to drop 'iface ens3 inet6 dhcp' into /etc/network/interfaces.d somewhere since ubuntus upstream images dont do ipv6 dhcp by default | 15:52 |
| *** pickle1 has quit IRC | 15:53 | |
| logan- | assuming you are seeing 'beyond scope of source address' over v6 | 15:53 |
| dmsimard | yeah that's over v6 | 15:53 |
| dmsimard | brb | 15:53 |
| *** stevebaker has joined #openstack-infra | 15:53 | |
| pabelanger | cloud-launcher should open them, if it was ran | 15:54 |
| *** dhill_ has quit IRC | 15:55 | |
| *** pickle has joined #openstack-infra | 15:55 | |
| *** salv-orlando has quit IRC | 15:56 | |
| *** salv-orlando has joined #openstack-infra | 15:57 | |
| *** pickle is now known as dhill_ | 15:57 | |
| *** salv-orlando has quit IRC | 15:57 | |
| *** pickle1 has joined #openstack-infra | 15:57 | |
| *** salv-orlando has joined #openstack-infra | 15:57 | |
| *** sree has quit IRC | 16:01 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Uninstall and reinstall siblings one at a time https://review.openstack.org/554297 | 16:01 |
| AJaeger | mordred: found a problem in your change, please double check ^ | 16:01 |
| *** jamielennox has quit IRC | 16:01 | |
| *** stevebaker has quit IRC | 16:02 | |
| *** stevebaker has joined #openstack-infra | 16:04 | |
| *** VW_ has quit IRC | 16:05 | |
| *** myoung|rover is now known as myoung|rover|mtg | 16:05 | |
| *** felipemonteiro_ has quit IRC | 16:06 | |
| *** dkehn_ has joined #openstack-infra | 16:06 | |
| *** VW has joined #openstack-infra | 16:06 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoints https://review.openstack.org/554610 | 16:06 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoints https://review.openstack.org/554610 | 16:07 |
| *** dkehn has quit IRC | 16:08 | |
| *** pcichy has joined #openstack-infra | 16:10 | |
| clarkb | pabelanger: commented on the puppet-gerrit change | 16:10 |
| *** stevebaker has quit IRC | 16:12 | |
| *** stevebaker has joined #openstack-infra | 16:14 | |
| *** ldnunes has quit IRC | 16:14 | |
| *** ldnunes has joined #openstack-infra | 16:14 | |
| pabelanger | clarkb: replied | 16:14 |
| *** hashar is now known as hasharAway | 16:15 | |
| clarkb | pabelanger: and responded :) | 16:16 |
| pabelanger | clarkb: ah, I believe you are correct: http://logs.openstack.org/83/554283/2/check/legacy-infra-puppet-apply-3/50f3baf/openstack-infra/system-config/applytest/puppetapplytest02.final.out | 16:18 |
| pabelanger | I can see it running in the log | 16:18 |
| pabelanger | I'll update | 16:18 |
| *** masuberu has quit IRC | 16:18 | |
| *** rkukura has joined #openstack-infra | 16:18 | |
| mordred | clarkb, logan-: fwiw, you can get floating ips from any network that has "router:external" set to True | 16:20 |
| mordred | (which I know because I originally thought that flag was a flag indicating that a network could route packets north/south-bound off the cloud - but it's not, it's a flag that indicates a router can be attached to a network) | 16:20 |
| mordred | and of course a router isn't a _router_ as much as a router is a nat gateway | 16:21 |
| clarkb | routers do route between private networks too but ya for most users likely ^ is the use of the router | 16:22 |
| *** andreas_s has quit IRC | 16:22 | |
| *** stevebaker has quit IRC | 16:22 | |
| *** stevebaker has joined #openstack-infra | 16:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerrit master: Allow user to toggle gerrit-initial-init https://review.openstack.org/554279 | 16:25 |
| *** gyee has joined #openstack-infra | 16:26 | |
| *** andreas_s has joined #openstack-infra | 16:26 | |
| *** yamamoto has joined #openstack-infra | 16:28 | |
| *** salv-orlando has quit IRC | 16:28 | |
| clarkb | pabelanger: oh my suggestion was to remove the else block entirely and put the file for the init script in your if block | 16:28 |
| *** salv-orlando has joined #openstack-infra | 16:28 | |
| clarkb | pabelanger: I think that simplifies things a bit | 16:28 |
| clarkb | pabelanger: but maybe it makes more logical sense to put all the init stuff in there | 16:30 |
| logan- | mordred: gotcha | 16:30 |
| clarkb | pabelanger: I do think we may end up with a broken symlink in the current patchset | 16:30 |
| clarkb | pabelanger: since the gerrit-initial-init will only be satisifed by the exec true | 16:31 |
| pabelanger | clarkb: yah, I think there is a spiders web of dependencies, which I am having trouble keeping track of | 16:31 |
| *** cshastri has quit IRC | 16:31 | |
| pabelanger | I don't think we can move File[/etc/init.d/gerrit] into the block, as other things in puppet will depend on it | 16:31 |
| pabelanger | yah, I think it will create a broken symlink | 16:32 |
| clarkb | right so the problem is less spider web and that the whole thing depends on that initial init or the regular init | 16:32 |
| clarkb | and if you don't do either one of those things nothing else is really worthd oing | 16:32 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 16:33 |
| *** salv-orlando has quit IRC | 16:33 | |
| *** wolverineav has joined #openstack-infra | 16:33 | |
| pabelanger | clarkb: the big one is gerrit-start, which requires init.d/gerrit | 16:33 |
| clarkb | they form the foundatuion of everything else around configure and start a gerrit service and without them most everything else doesn't make sense | 16:33 |
| *** yamamoto has quit IRC | 16:34 | |
| *** stevebaker has quit IRC | 16:35 | |
| *** armaan has quit IRC | 16:35 | |
| clarkb | you almost want a top level "configure gerrit" flag which short circuits. Which in puppet land is expressed by not including that code in the first place I think | 16:35 |
| *** andreas_s has quit IRC | 16:36 | |
| *** armaan has joined #openstack-infra | 16:36 | |
| dmsimard | logan-: do you do anything special that your VMs have ens3 instead of eth0 ? Just wondering because there might be assumptions around the name of the primary NIC. | 16:36 |
| clarkb | dmsimard: no that is an ubuntu thing. They use biosdevname | 16:36 |
| pabelanger | clarkb: yah, we really just want the gerrit users / group created. So we can then mount the home directory | 16:36 |
| dmsimard | clarkb: is that new ? | 16:36 |
| clarkb | dmsimard: I think it started with trusty or xenial? | 16:37 |
| logan- | xenial | 16:37 |
| dmsimard | clarkb: but if I look at the executors (for example) they have eth0 | 16:37 |
| pabelanger | clarkb: maybe we just update system-config to just call gerrit::user | 16:37 |
| logan- | it was an optional package on trusty but yeah if you purge the biosdevname package it should revert back to ethX naming | 16:37 |
| *** sree has joined #openstack-infra | 16:37 | |
| pabelanger | clarkb: rather then mucking with puppet-gerrit | 16:38 |
| clarkb | pabelanger: maybe the thing to do is a level higher do an include gerrit::user ; if (init_gerrit) include gerrit::server (I'm hand waving a little bit) | 16:38 |
| clarkb | pabelanger: ya | 16:38 |
| *** jamielennox has joined #openstack-infra | 16:38 | |
| pabelanger | +1 | 16:38 |
| dmsimard | clarkb: I guess we need to change http://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/launch-node.py#n122 | 16:38 |
| *** wolverineav has quit IRC | 16:38 | |
| clarkb | dmsimard: I think it depends on your cloud images (executors are in rackspace which use rax images) and the devices exposed to the VM (rackspace is again different running on xen) | 16:39 |
| clarkb | dmsimard: but the ubuntu default is biosdevname and I think kvm/qemu default is that ens* | 16:39 |
| *** wolverineav has joined #openstack-infra | 16:39 | |
| *** stevebaker has joined #openstack-infra | 16:39 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/system-config master: modules: openstack_project: Mirror some additional openSUSE repositories https://review.openstack.org/554620 | 16:40 |
| clarkb | dmsimard: ya maybe a ip link | grep eth0 && the stuff on that line | 16:40 |
| dmsimard | It's really itching me to rewrite launch-node in Ansible :/ | 16:41 |
| clarkb | dmsimard: it already has a || true there | 16:41 |
| clarkb | dmsimard: so thats a non issue | 16:41 |
| dmsimard | clarkb: yeah it doesn't fail the deployment, I was just pointing out that it did raise an error though | 16:42 |
| *** sree has quit IRC | 16:42 | |
| *** bradm has quit IRC | 16:42 | |
| *** rfolco is now known as rfolco_brb | 16:42 | |
| *** trown|ruck is now known as trown|lunch | 16:42 | |
| *** camunoz has quit IRC | 16:43 | |
| *** dprince has joined #openstack-infra | 16:44 | |
| dmsimard | logan-: yeah cloud-init configures "iface ens3 inet dhcp" in /etc/network/interfaces.d/50-cloud-init.cfg | 16:45 |
| logan- | yup echo 'iface ens3 inet6 dhcp' >> /etc/network/interfaces && systemctl restart networking will give you working v6 in there | 16:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add gerrit_configure flag to review-dev01.o.o https://review.openstack.org/554624 | 16:47 |
| *** jamesmcarthur has quit IRC | 16:47 | |
| pabelanger | clarkb: okay, I think it is that simple^ | 16:47 |
| dmsimard | logan-: yeah, okay -- I'll figure something out. Thanks. | 16:47 |
| logan- | nps | 16:47 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/system-config master: modules: openstack_project: Mirror some additional openSUSE repositories https://review.openstack.org/554620 | 16:47 |
| *** kashyap has joined #openstack-infra | 16:49 | |
| clarkb | dmsimard: the problem is launch node wants to use ipv6 because neutron has told it that ipv6 should be working? | 16:49 |
| dmsimard | clarkb: it tries to do ping6 because the node has a v6 IP and cloud-init/ubuntu doesn't set up the interface to do dhcp6 by default | 16:49 |
| clarkb | ya ok | 16:49 |
| clarkb | I guess vexxhost's images configure dhcp on boot | 16:50 |
| clarkb | er ipv6 dhcp | 16:50 |
| logan- | i feel like the real question is why cloud-init doesnt configure v6 dhcp. havent dug into it so im not sure if its an issue with ancient cloud-init version on xenial or something lacking in the nova metadata | 16:50 |
| dmsimard | logan-: right, because it sets up the v4 dhcp | 16:51 |
| logan- | yea for public cloud we just bake in the inet6 dhcp to the image currently :/ | 16:51 |
| clarkb | it would not surprise me if it had to do with the configdrive/metadata data | 16:51 |
| clarkb | iirc neutron and nova changed keys for that info and it broke tools like glean? | 16:51 |
| *** pickle1 has quit IRC | 16:52 | |
| *** dhill_ has quit IRC | 16:52 | |
| *** pickle has joined #openstack-infra | 16:52 | |
| pabelanger | yes, IIRC, we had to boot mirror with ipv4 only on osic, then drop a network interface script to bring up inet6 | 16:52 |
| pabelanger | then reboot and it worked | 16:52 |
| logan- | just tested on an instance in there, the metadata is available http://paste.openstack.org/raw/706308/ I guess it is something with cloud-init | 16:53 |
| logan- | oh well | 16:53 |
| pabelanger | i thought we disabled cloud-init on images | 16:54 |
| clarkb | logan-: "type": "ipv6_dhcpv6-stateful", is I think where tools like cloud init get confused | 16:54 |
| pabelanger | or does that run before puppet disables it | 16:54 |
| clarkb | logan-: beacuse neutron and nova have disagreed on what those types should be over time | 16:54 |
| logan- | ah interesting | 16:54 |
| clarkb | pabelanger: this is all boot time. Long before puppet runs | 16:54 |
| kashyap | A random Git question: for me `git fetch origin` is just sitting there and hanging: | 16:54 |
| fungi | also that's not configdrive, that's the aws-like metadata-over-network stuff? | 16:54 |
| kashyap | [remote "origin"] | 16:54 |
| kashyap | url = https://github.com/openstack/nova.git | 16:54 |
| kashyap | fetch = +refs/heads/*:refs/remotes/origin/* | 16:54 |
| clarkb | fungi: ya but the data is the same in config drive | 16:54 |
| fungi | got it | 16:54 |
| kashyap | No dice even with OpenStack's own Git: | 16:55 |
| kashyap | [remote "cgit"] | 16:55 |
| kashyap | url = https://git.openstack.org/openstack/nova | 16:55 |
| kashyap | fetch = +refs/heads/*:refs/remotes/cgit/* | 16:55 |
| *** eernst has joined #openstack-infra | 16:55 | |
| * kashyap wonders if he's missing anything | 16:55 | |
| *** felipemonteiro has joined #openstack-infra | 16:55 | |
| clarkb | kashyap: those both look sane | 16:56 |
| clarkb | kashyap: can you git either location in your browser? | 16:56 |
| clarkb | s/git/hit/ | 16:56 |
| kashyap | Yes, very much so. Not an MTU problem or some such | 16:56 |
| kashyap | (I'm on home n/w.) | 16:56 |
| clarkb | also likely not ipv6 problem as github doesn't ipv6 | 16:56 |
| clarkb | kashyap: considering it is both github and our service I'm inclined to think it is something local to you. Firewall or dns maybe? | 16:57 |
| clarkb | but if browser works over https in both cases that likely rules out both firewall and dns problems | 16:57 |
| kashyap | Yeah, it's certainly PEBKAC | 16:57 |
| kashyap | It worked briefly yesterday (where I also saw this) | 16:58 |
| mordred | kashyap: when you try with the cgit remote - you're doing 'git fetch cgit' yeah? | 16:58 |
| clarkb | doing a local update of nova is not fast. But it does work | 16:58 |
| kashyap | mordred: Yep | 16:59 |
| kashyap | mordred: clarkb: Here's the output of: GIT_CURL_VERBOSE=1 GIT_TRACE=1 git pull | 16:59 |
| mordred | kashyap: k. just making sure / suggesting the silly tihngs :) | 16:59 |
| kashyap | http://paste.openstack.org/show/706318/ | 16:59 |
| *** masuberu has joined #openstack-infra | 16:59 | |
| kashyap | You can see the TLS auth succeeded there | 16:59 |
| mordred | TIL about GIT_CURL_VERBOSE | 16:59 |
| *** HeOS has quit IRC | 16:59 | |
| kashyap | It's handy :-) | 16:59 |
| *** camunoz has joined #openstack-infra | 17:00 | |
| kashyap | clarkb: The only difference is, I changed from bare 'git://' to 'https://' on 'origin' | 17:00 |
| * kashyap is completely baffled | 17:00 | |
| kashyap | Just want to hit `git review`, and hit the kitchen to make some food; this is preventing me... | 17:00 |
| *** stevebaker has quit IRC | 17:00 | |
| clarkb | git:// will use a completely different protocol and backend servers | 17:00 |
| clarkb | but it also not using tls | 17:00 |
| *** myoung|rover|mtg is now known as myoung|rover | 17:01 | |
| kashyap | Yeah, I realize that | 17:01 |
| kashyap | clarkb: That's my .git/config; you see anything wonky there? http://paste.openstack.org/show/706324/ | 17:01 |
| clarkb | kashyap: what does strace look like? is it just waiting for data? | 17:01 |
| * kashyap goes to run it | 17:02 | |
| kashyap | clarkb: It's just hung at a read() call: | 17:02 |
| kashyap | fcntl(16, F_GETFL) = 0 (flags O_RDONLY) | 17:02 |
| kashyap | close(16) = 0 | 17:02 |
| kashyap | write(14, "list\n", 5) = 5 | 17:02 |
| kashyap | read(13, | 17:02 |
| *** lucasagomes is now known as lucas-afk | 17:03 | |
| clarkb | I'm guessing a tcpdump would also confirm packets stop moving | 17:03 |
| clarkb | the remote might be trying to make a new pack for you? but I would be surprised if that ever took more than a minute | 17:03 |
| kashyap | clarkb: The funny thing is, I can fetch from 'https' remotes for other repos, such as libvirt | 17:04 |
| *** agopi has joined #openstack-infra | 17:04 | |
| kashyap | That should surely eliminate n/w problems | 17:04 |
| *** felipemonteiro_ has joined #openstack-infra | 17:04 | |
| *** pickle has quit IRC | 17:04 | |
| *** pickle has joined #openstack-infra | 17:05 | |
| clarkb | kashyap: ya so probably its working out what refs you need and packing them? | 17:05 |
| kashyap | clarkb: Okay; maybe it's just slowness on my side; I ran a fresh clone from: https://git.openstack.org/openstack/nova | 17:05 |
| kashyap | (It's slowly downloading.) | 17:05 |
| clarkb | assuming you fetch libvirt from github | 17:05 |
| kashyap | clarkb: Yep, I fetched libvirt remote from a maintainer from GitHub indeed | 17:05 |
| dmsimard | logan-, clarkb: should we patch this in the image ? or handle it in launch-node ? what about nodepool VMs.. are our images set up properly ? | 17:05 |
| fungi | kashyap: some of our long-time ibm compatriots may recall a period where they couldn't do git over https from their offices due to broken transparent proxying forced on them by management | 17:06 |
| clarkb | dmsimard: nodepool VMs will use glean. I'm not sure if glean handles ipv6_dhcpv6-stateful type interfaces properly. But if it does it should just work. If it doesn't we'll have to add support for that to glean | 17:06 |
| pabelanger | clarkb: dmsimard: logan-: Some notes when we rebuild mirror.regionone.osic-cloud1.openstack.org with ipv4/ipv6 support: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-08-23.log.html#t2016-08-23T19:51:31 | 17:06 |
| kashyap | fungi: Hehe. I'm at home; and actually am able to clone from HTTPS in a sperate dir. So I'll just wait and see what happens | 17:06 |
| pabelanger | should give steps we did last time | 17:07 |
| clarkb | dmsimard: as for the image I think I'd just get the mirror up (comment out the ipv6 stuff in launch node if you have to), then set up ipv6 after (which is what I think we did with osic?) | 17:07 |
| fungi | kashyap: okay, so at least you can't blame your employer for this one ;) | 17:07 |
| clarkb | dmsimard: then go bug cloud-init and nova neutron as necessary to get support for this in place | 17:07 |
| dmsimard | clarkb: I guess that could work | 17:07 |
| * clarkb checks glean | 17:08 | |
| *** felipemonteiro has quit IRC | 17:08 | |
| kashyap | fungi: Heh, no. I'm a remotee, my only "in-person" colleague is the water bottle near by & a rubber-duck, with which I debug sometimes | 17:08 |
| fungi | we can certainly get support into glean extremely quickly | 17:08 |
| pabelanger | I thought we fixed this in system-config, checking | 17:08 |
| clarkb | glean will not handle this | 17:08 |
| clarkb | it only handles type == ipv6 | 17:08 |
| *** felipemonteiro has joined #openstack-infra | 17:08 | |
| fungi | and at least we have incriminating evidence, er, know people responsible for nova and cloud-init that we can make it happen there somewhat fast too | 17:08 |
| *** stevebaker has joined #openstack-infra | 17:09 | |
| logan- | just out of curiosity im going to upload a bionic image to test | 17:09 |
| fungi | delay for nova is that it only releases semi-annually. for cloud-init the delay is getting new packages into distros | 17:09 |
| clarkb | also we still don't handle rhel ipv6 in glean? | 17:09 |
| clarkb | mordred: ^ you may be interestd in this conversation | 17:10 |
| pabelanger | clarkb: right | 17:10 |
| logan- | im wondering if newer versions of cloud-init might handle this better | 17:10 |
| pabelanger | still needs to be added | 17:10 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/irc-meetings master: Make slaweq the main chair for neutron-ci meeting https://review.openstack.org/554634 | 17:10 |
| clarkb | pabelanger: how did that work in osic? | 17:10 |
| pabelanger | just dhcp | 17:11 |
| pabelanger | with old settings? | 17:11 |
| *** felipemonteiro_ has quit IRC | 17:11 | |
| pabelanger | well | 17:11 |
| pabelanger | hmm | 17:11 |
| *** bkero- has quit IRC | 17:11 | |
| fungi | i doubt osic did dhcp6, but could be wrong | 17:11 |
| mordred | clarkb: what's the tl;dr - I'm having trouble grokking the scrollback | 17:12 |
| fungi | more likely osic was slaac | 17:12 |
| clarkb | mordred: nova/releasenotes/notes/added-network-metadata-7784295884f65c09.yaml they basically increased the number of ipv6 interface types | 17:12 |
| *** pickle has quit IRC | 17:12 | |
| fungi | and relied on dhcp4 for things like dns servers | 17:12 |
| clarkb | mordred: glean doesn't support any of them | 17:12 |
| clarkb | mordred: additionally red hat distros don't support any ipv6 in glean from what I can tell | 17:13 |
| *** pickle has joined #openstack-infra | 17:13 | |
| clarkb | fungi: ya I guess the distro default could be slaac and it would just work magically in that case | 17:13 |
| mordred | clarkb: awesome. so we need to add support for more types of ipv6 interfaces as well as rh? | 17:13 |
| clarkb | mordred: ya | 17:13 |
| mordred | sweet | 17:13 |
| clarkb | also not sure what suse is using | 17:13 |
| clarkb | maybe they match red hat distro type? | 17:13 |
| *** bobh has quit IRC | 17:13 | |
| fungi | clarkb: well, would "work magically" with the right plumbing in nova to also predict eui64 slaac addresses by knowing the instance's mac | 17:13 |
| kashyap | clarkb: mriedem: "Works now". | 17:14 |
| mordred | their networking config stack is the same ... so I think we should get support for both suse and rh at the same time | 17:14 |
| mordred | clarkb: my biggest issue adding rh support is that I don't actually know how to configure rh network config properly for the different ipv6 types - so that would need to be someone else | 17:14 |
| clarkb | ya looks like suse is covered under the rh interface config | 17:14 |
| mordred | clarkb: do we need this for mirror servers or just for nodepool? | 17:15 |
| * mordred wonders if it's finally time to sort out "use images we build ourselves for control plane services" | 17:15 | |
| *** zoli is now known as zoli|gone | 17:15 | |
| *** zoli|gone is now known as zoli | 17:16 | |
| fungi | mordred: just for nodepool | 17:16 |
| mordred | ok. cool | 17:16 |
| fungi | we're relying on cloud-init for the persistent server instances | 17:16 |
| * mordred supposes we could always just puppet a network config if needed for mirror servers | 17:16 | |
| fungi | for now anyway | 17:16 |
| fungi | mordred: well, we'd still need launch-server workarounds to bootstrap up to the point where we puppet configuration into place | 17:17 |
| *** pickle has quit IRC | 17:17 | |
| clarkb | reading glean I think I now grok it a bit better. 'ipv6' means static address config | 17:17 |
| *** pickle has joined #openstack-infra | 17:17 | |
| mordred | fungi: indeed | 17:17 |
| clarkb | not understanding the type would then rely on slaac and RAs to do interface magic otherwise | 17:17 |
| fungi | but we can also just make the choice to only put persistent rh-based servers in providers where we don't have this sort of complication for now | 17:17 |
| mordred | yes | 17:17 |
| clarkb | whcih must be how any of this worked on osic | 17:17 |
| mordred | so - in this case, the update to nova makes things better for glean | 17:18 |
| mordred | as it should be able to detect if it needs to configure dhcp6 or not | 17:18 |
| clarkb | ya though I wonder if it would also continue to just work due to RAs | 17:18 |
| clarkb | dhcpv6 still sends RAs right? | 17:18 |
| clarkb | at least under neutron I think it does? so maybe this will just work(tm) | 17:18 |
| mordred | maybe? I'm not sure - I'd hope so | 17:19 |
| fungi | clarkb: yes, i have a strong memory of osic being eui64 slaac (which nova has some plumbing for guessing and returning through the api) and v6 router advertisements | 17:19 |
| *** stevebaker has quit IRC | 17:19 | |
| fungi | clarkb: dhcp6 is not just one thing... you have stateful and stateless dhcp6 | 17:19 |
| clarkb | fungi: right this is stateful but I thouht neutron did RAs always btu could be wrong about that | 17:20 |
| fungi | the former does address assignment, the latter does not... both still mostly expect you to do router advertisements but you can also inject routes via dhcp6 leases i think | 17:20 |
| clarkb | actually if the mirror nodes aren't just working then maybe not | 17:20 |
| mordred | so basicaly glean can be told "here is your static ipv6 address" "ipv6 will be availble but via slaac" "ipv6 will be available via stateful dhpc6" "ipv6 will be available via stateless dhcp6" | 17:20 |
| clarkb | anyways we'll know soon enough when we boot a nodepool image | 17:20 |
| clarkb | mordred: ya | 17:21 |
| kashyap | clarkb: See my `git review` time: | 17:21 |
| kashyap | $> time git review | 17:21 |
| kashyap | To ssh://review.openstack.org:29418/openstack/nova.git | 17:21 |
| kashyap | * [new branch] HEAD -> refs/publish/master/bug/1750829 | 17:21 |
| kashyap | real 6m47.306s | 17:21 |
| kashyap | user 0m1.184s | 17:21 |
| kashyap | sys 0m0.872s | 17:21 |
| fungi | kashyap: that's abominably abysmal... are you seeing any packet loss? what sort of rtt? | 17:21 |
| kashyap | fungi: rtt to review.o.o? | 17:22 |
| fungi | kashyap: yeah | 17:22 |
| fungi | kashyap: also do you have v6 connectivity to the internet or just v4? (sorry if you already mentioned this earlier) | 17:23 |
| kashyap | $> ping -c2 review.openstack.org | 17:23 |
| kashyap | PING review.openstack.org (104.130.246.91) 56(84) bytes of data. | 17:23 |
| kashyap | 64 bytes from review.openstack.org (104.130.246.91): icmp_seq=1 ttl=52 time=197 ms | 17:23 |
| kashyap | 64 bytes from review.openstack.org (104.130.246.91): icmp_seq=2 ttl=52 time=220 ms | 17:23 |
| kashyap | --- review.openstack.org ping statistics --- | 17:23 |
| kashyap | 2 packets transmitted, 2 received, 0% packet loss, time 1001ms | 17:23 |
| kashyap | rtt min/avg/max/mdev = 197.625/208.856/220.088/11.240 ms | 17:23 |
| kashyap | fungi: v4. 2018 is the year, I'm going to revamp my home Wi-Fi setup | 17:23 |
| fungi | that's a fairly high rtt | 17:23 |
| clarkb | that is in line with cross ocean rtt though | 17:24 |
| fungi | right | 17:24 |
| kashyap | Fibre is not here in Ghent (Belgium) yet :-( | 17:24 |
| fungi | not an _extremely_ high rtt | 17:24 |
| fungi | not like internet via orbital repeater | 17:24 |
| kashyap | Heh | 17:24 |
| clarkb | are the window sizes super small too? | 17:24 |
| fungi | you laugh. plenty of us here survived it with only minimal scarring | 17:24 |
| rosmaita | can someone take a look at https://review.openstack.org/#/c/554291/1 ? am i super-unlucky, or is there a problem with neutron-grenade on stable/queens? | 17:25 |
| kashyap | fungi: Sorry, I realize. I only brushed past the "dial-up age"; so I can't get to laugh | 17:25 |
| clarkb | rosmaita: pike was broken yesterday and day before which broke queens grenade because you have to upgrade from pike to queens | 17:25 |
| dmsimard | kashyap: ISPs have just started deploying residential 1 Gbps connectivity in Canada in urban areas.. and it's expensive as hell :p | 17:25 |
| fungi | i expect window sizes are being negotiated dynamically, so you're likely to only see what they are mid-transfer by capturing a session with, e.g., tcpdump | 17:26 |
| * kashyap has those upload/download speeds: | 17:26 | |
| kashyap | Download: 5.14 Mbits/s | 17:26 |
| kashyap | Upload: 3.99 Mbits/s | 17:26 |
| dmsimard | oh wow, I couldn't *live* with that throughput :( | 17:26 |
| clarkb | rosmaita: looking now to see if it is still broken | 17:26 |
| rosmaita | clarkb: ty | 17:26 |
| kashyap | dmsimard: A colleague in The Netherlands (not in Amsterdam even) says he's got quite a nice deal for Fiber | 17:26 |
| fungi | that's not a terrible transfer rate, but maybe i'm showing my age | 17:26 |
| dmsimard | fungi: it's not terrible by any means, I'm just not the only user of bandwidth at home :) | 17:27 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add gerrit_configure flag to review-dev01.o.o https://review.openstack.org/554624 | 17:27 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint https://review.openstack.org/554640 | 17:27 |
| *** stevebaker has joined #openstack-infra | 17:28 | |
| fungi | clarkb: for completeness... looking at the dhcp6 spec there are standard options for dhcp6.rtprefix, dhcp6.next-hop and dhcp6.next-hop-rt-prefix which can be used in place of router advertisements | 17:29 |
| clarkb | rosmaita: http://logs.openstack.org/91/554291/1/check/neutron-grenade/363e852/logs/screen-q-agt.txt.gz confirmed. neutron agent is failing to start due to using pip improperly I think which then causes nova to fail to boot instances | 17:29 |
| *** salv-orlando has joined #openstack-infra | 17:29 | |
| clarkb | smcginnis: is ^ that log the problem you are sorting through? | 17:29 |
| clarkb | fungi: ya I think RAs are super common but not necessary if dhcping | 17:29 |
| clarkb | fungi: so will depend on how neutron does it | 17:29 |
| *** lpetrut_ has quit IRC | 17:30 | |
| *** priteau has quit IRC | 17:30 | |
| fungi | clarkb: but i'm pretty sure almost everyone who is anyone thinks route and prefix instructions over dhcp6 is an ugly kluge | 17:30 |
| *** yamamoto has joined #openstack-infra | 17:30 | |
| logan- | well bionic booted with working ipv6, but the netplan networkd interface has "DHCP=ipv4" so who knows why | 17:30 |
| rosmaita | clarkb: thanks for checking | 17:31 |
| *** mihalis68 has quit IRC | 17:31 | |
| dmsimard | "Running: ['/etc/ansible/hosts/openstack', '--list']" <--- been waiting for a good couple minutes now :/ | 17:32 |
| clarkb | rosmaita: oh ya thats ryu doing it so fairly certain it is the problem smcginnis is working through on stable | 17:32 |
| dmsimard | strace'd the process and it seems to not be stuck or anything | 17:32 |
| logan- | http://paste.openstack.org/raw/706354/ bionic output fwiw | 17:32 |
| clarkb | dmsimard: if you ran it with a clouds.yaml that includes nodepool nodes it may be taking forever (also may make our puppet ansible unhappy) | 17:32 |
| dmsimard | clarkb: I didn't specify a clouds.yaml so assuming /etc/openstack/clouds.yaml | 17:33 |
| *** florianf has quit IRC | 17:33 | |
| *** masuberu has quit IRC | 17:33 | |
| clarkb | ya if not specified it should be the correct file | 17:33 |
| dmsimard | more or less just following http://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/README | 17:33 |
| *** HeOS has joined #openstack-infra | 17:33 | |
| *** salv-orlando has quit IRC | 17:34 | |
| fungi | logan-: definitely doesn't look like eui64 addressing, so almost certainly not slaac. looks directly assigned by something (neutron?) | 17:34 |
| clarkb | dmsimard: I'm guessing some cloud is out to lunch doing a listing then | 17:34 |
| logan- | yeah it is neutron dhcp6 | 17:34 |
| clarkb | fungi: I'm guessing I was wrong about neutron stateful dhcp6 and they don't RA in that case | 17:35 |
| *** ralonsoh__ has quit IRC | 17:35 | |
| *** e0ne has quit IRC | 17:35 | |
| logan- | https://github.com/continuouspw/openstack-ci-cloud/blob/28a2652bc5abd836dcf19a1ef1e7f6f1d785c321/network_bootstrap/bootstrap-neutron.yml#L81-L93 is the neutron subnet in question | 17:35 |
| *** yamamoto has quit IRC | 17:36 | |
| fungi | clarkb: well, hard to say whether the prefix is assigned via router advertisement (stateful dhcp6 by defualt just gives you the host addressing part) | 17:36 |
| clarkb | fungi: except I would expect that the xenial image would just work if it had RAs | 17:37 |
| fungi | would need to look at the dhcp client logging and/or packet capture ras | 17:37 |
| fungi | but yeah, probably a good indication if xenial is borken | 17:37 |
| clarkb | neutron api docs list the valid ra modes for neutron but don't explain how it changes neutron behavior | 17:39 |
| *** bkero has quit IRC | 17:39 | |
| *** ldnunes has quit IRC | 17:39 | |
| *** baoli has joined #openstack-infra | 17:39 | |
| *** pickle has quit IRC | 17:39 | |
| pabelanger | mnaser: how is nodepool looking on provider side? Any extra impact with boot-from-volume? | 17:40 |
| *** baoli has quit IRC | 17:40 | |
| pabelanger | mnaser: looking at logstash, I don't see any timeouts with vexxhost atm | 17:40 |
| pabelanger | mnaser: wanted to see your thoughts on bringing more nodes online? Not sure what the (new) limit would be | 17:40 |
| clarkb | also since we have logan- here the easiest thing for us might be to change it to slaac or stateless ipv6? | 17:41 |
| clarkb | I have a hunch that would make it work for the mirror and our glean nodes | 17:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 17:41 |
| pabelanger | clarkb: if we can, might be worth a try | 17:41 |
| *** bkero has joined #openstack-infra | 17:41 | |
| clarkb | *stateless dhcpv6 | 17:42 |
| clarkb | fungi: ^ you propbably have opinions on that? | 17:42 |
| *** bkero1 has joined #openstack-infra | 17:42 | |
| *** pickle has joined #openstack-infra | 17:43 | |
| fungi | i'm generally in favor of stateless dhcp6 (when needed, or no dhcp6 at all) and slaac+ra but am not sure what neutron/nova explicitly support in that regard | 17:43 |
| fungi | i unfortunately lack a bit of depth where configuration options for openstack services are concerned | 17:44 |
| *** stevebaker has quit IRC | 17:44 | |
| clarkb | fungi: https://developer.openstack.org/api-ref/network/v2/#subnets expland the create api | 17:44 |
| *** pickle has quit IRC | 17:44 | |
| clarkb | slaac, dhcpv6-stateless and dhcpv6-stateful seem to be the options | 17:45 |
| *** trown|lunch is now known as trown|ruck | 17:45 | |
| *** pickle has joined #openstack-infra | 17:45 | |
| *** bkero1 has quit IRC | 17:46 | |
| fungi | and "dhcp-stateless" is dhcp6+slaac whereas "slaac" is just slaac with no dhcp6 at all? | 17:46 |
| fungi | for some reason my browser is not finding "slaac" on that page | 17:47 |
| *** jlabarre has joined #openstack-infra | 17:47 | |
| clarkb | fungi: you have to expland the api query thing | 17:47 |
| clarkb | they are folded by default | 17:47 |
| clarkb | using the "detail" button | 17:47 |
| fungi | oh, that's fancifully magic | 17:47 |
| *** bkero1 has joined #openstack-infra | 17:47 | |
| *** HeOS has quit IRC | 17:47 | |
| clarkb | and ya I think your parsing of that must be correct | 17:48 |
| clarkb | cloudnull probably knows all the details | 17:48 |
| *** florianf has joined #openstack-infra | 17:48 | |
| logan- | looks like osic was using dhcpv6-stateless https://gist.github.com/cloudnull/4e34276a8e690fb54146d03a73ec44b4 | 17:49 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoint https://review.openstack.org/554640 | 17:49 |
| clarkb | logan-: fwiw if there isn't a reason on your end to keep using stateful I expect that stateless would be more straightforward for us | 17:49 |
| logan- | ok | 17:49 |
| clarkb | (probably want to coordinate with dmsimard if we change that) | 17:49 |
| dmsimard | ¯\_(ツ)_/¯ | 17:50 |
| dmsimard | ansible inventory list is still going | 17:50 |
| logan- | dont think its an issue either way for me | 17:50 |
| dmsimard | but otherwise the mirror is up | 17:50 |
| *** jpich has quit IRC | 17:50 | |
| fungi | the main reason i can think of anyone would want to do dhcp6-stateful is if you're mixing explicit assignments from other systems in the same v6 allocation _or_ you're married to having neutron proxy to an external address management system | 17:50 |
| dmsimard | well, up as in created.. puppet probably hasn't run yet | 17:50 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Make slaweq the main chair for neutron-ci meeting https://review.openstack.org/554634 | 17:51 |
| clarkb | dmsimard: thats odd | 17:51 |
| dmsimard | clarkb: it is | 17:51 |
| clarkb | dmsimard: can you check netstat to see what cloud it is connected to? | 17:51 |
| logan- | yeah fungi, we have to use dhcp6-stateful in our public cloud because it is calico/l3 based, so we have to deal with getting dhcp6 clients working in our image build process :/ | 17:51 |
| clarkb | or tcpdump I guess | 17:51 |
| dmsimard | clarkb: I've been following "strace -p 25198" on puppetmaster and it's not stuck or anything.. | 17:52 |
| fungi | if you can carve your neutron "subnets" for v6 up into dedicated routed prefixes, there's no real reason for dhcp6-stateful that i'm aware of | 17:52 |
| clarkb | logan-: in that case may be it is better for us to help figure out stateful things? | 17:52 |
| clarkb | dmsimard: do you see node names in there? | 17:52 |
| clarkb | I wonder if it did find the nodepool nodes somehow | 17:52 |
| *** derekh has quit IRC | 17:52 | |
| dmsimard | clarkb: it's mostly unreadable garbage i.e, http://paste.openstack.org/raw/706376/ | 17:53 |
| *** ldnunes has joined #openstack-infra | 17:53 | |
| dmsimard | let me see network wise | 17:53 |
| logan- | clarkb: makes my life easier if it works :) but im also happy to switch it over to stateless dhcp6 on this cloud if it is too much of a time sink | 17:53 |
| dmsimard | clarkb: http://paste.openstack.org/raw/706379/ | 17:53 |
| clarkb | dmsimard: another idea is you said you had to update shade, maybe that isn't working | 17:53 |
| *** stevebaker has joined #openstack-infra | 17:54 | |
| dmsimard | clarkb: oh, good point.. maybe updating shade fixed the floating IP issue but caused another | 17:54 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add ansible-role-statsd project https://review.openstack.org/554646 | 17:54 |
| dmsimard | clarkb: If I try the list script manually (only scoped to the limestone region) is returns immediately but let me unscope it just out of curiosity | 17:54 |
| clarkb | dmsimard: the version of the openstack inventory script is copied out of the version of ansible we are using iirc | 17:55 |
| dmsimard | "/etc/ansible/hosts/openstack --list" returns immediately so it's probably pulling from cache | 17:55 |
| dmsimard | I stopped the launch node for now, no point.. it was just looping endlessly | 17:55 |
| *** panda is now known as panda|bbl | 17:56 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add ansible-role-statsd zuul jobs https://review.openstack.org/554648 | 17:57 |
| fungi | dmsimard: you might poke around in /var/cache/ansible-inventory/ansible-inventory.cache and see if you spot anything unusual | 17:57 |
| dmsimard | yeah that's where I'm looking right now. | 17:58 |
| fungi | oh, right, you're saying you think the cache is probably fine | 17:58 |
| fungi | and uncached is taking forever | 17:58 |
| smcginnis | clarkb: Late catching up, but yes, that was the error we were fixing. | 18:00 |
| smcginnis | rosmaita: Should be clear now, so a recheck should take care of it. | 18:00 |
| clarkb | dmsimard: looks like it was talking to rackspace | 18:00 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add gerrit_configure flag to review-dev01.o.o https://review.openstack.org/554624 | 18:00 |
| *** bkero has quit IRC | 18:01 | |
| *** dhajare has joined #openstack-infra | 18:01 | |
| *** bkero has joined #openstack-infra | 18:02 | |
| *** wolverineav has quit IRC | 18:03 | |
| *** rfolco_brb is now known as rfolco | 18:03 | |
| *** wolverineav has joined #openstack-infra | 18:03 | |
| *** pickle has quit IRC | 18:03 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Add bootstrap alert message when conf loading errors exists https://review.openstack.org/554652 | 18:04 |
| *** pickle has joined #openstack-infra | 18:04 | |
| *** myoung|rover is now known as myoung|biab | 18:05 | |
| *** camunoz has quit IRC | 18:06 | |
| *** salv-orlando has joined #openstack-infra | 18:07 | |
| *** stevebaker has quit IRC | 18:07 | |
| *** camunoz has joined #openstack-infra | 18:07 | |
| dmsimard | clarkb: the cache file is updated but then it just kinda hangs | 18:09 |
| *** pbourke_ has quit IRC | 18:09 | |
| clarkb | dmsimard: maybe try with older shade? | 18:10 |
| mordred | don't ever try with older shade | 18:10 |
| fungi | smcginnis: awesome, i've gone ahead approving 554323 now | 18:10 |
| dmsimard | mordred: launch-node is pinned to ansible 2.1 and shade 1.11 | 18:10 |
| mordred | ok. we should fix that | 18:11 |
| mordred | shade 1.11 is not supported in any way | 18:11 |
| dmsimard | Indeed | 18:11 |
| mordred | current version is 1.27.1 :) | 18:11 |
| dmsimard | I'm sort of in this rabbit hole right now, I had to update shade to even be able to spawn a node properly | 18:11 |
| dmsimard | We'll see where it leads us :D | 18:11 |
| mordred | dmsimard: how can I help you out of your rabbit hole? | 18:11 |
| fungi | EmilienM: even when i don't have time to read all of the weekly owl, i at least make sure to check on the owl fact at the end. thanks for making my week just a little bit better! | 18:11 |
| mordred | dmsimard: or, rather - please to let me know if you need help | 18:11 |
| *** jamesmcarthur has joined #openstack-infra | 18:12 | |
| *** sambetts is now known as sambetts|afk | 18:13 | |
| dmsimard | mordred: yeah I'll figure it out, just need a bit of time, thanks | 18:13 |
| *** lpetrut has joined #openstack-infra | 18:13 | |
| clarkb | dmsimard: is it worth keeping the ara middleware meeting topic for this week? anything new to report now that most of the changes are merged? | 18:14 |
| mordred | fungi, EmilienM: ++ ... also, that made me think of this: https://imgur.com/a/sMyeg - from the tokyo summit when sandy went to the owl cafe | 18:15 |
| * clarkb is doing meeting prep | 18:15 | |
| smcginnis | fungi: Thanks | 18:15 |
| dmsimard | clarkb: we can drop it | 18:15 |
| *** armaan has quit IRC | 18:15 | |
| *** dtantsur is now known as dtantsur|afk | 18:16 | |
| *** armaan has joined #openstack-infra | 18:16 | |
| *** stevebaker has joined #openstack-infra | 18:16 | |
| clarkb | mordred: re older shade it shouldn't hurt to check if that is what triggered the behavior change right? I mean worst case we delete the old cache file because the format changed and its incompatible and just make a new one | 18:16 |
| *** rkukura has quit IRC | 18:18 | |
| *** jpena is now known as jpena|away | 18:18 | |
| mordred | clarkb: well - I mean, it shouldn't hurt - but 1.11 is SO OLD that anything we learned from that would not be terribly useful - and I think just figuring out what's broken currently is more valuable | 18:18 |
| *** bkero1 has quit IRC | 18:19 | |
| clarkb | mordred: well we aren't sure shade is at fault... | 18:19 |
| clarkb | just a quick way to isolate the behavior | 18:19 |
| *** kjackal has quit IRC | 18:20 | |
| mordred | possibly - although I used launch-node 2 weeks ago to launch a node and it worked | 18:21 |
| *** kjackal has joined #openstack-infra | 18:21 | |
| mordred | biggest issue (which you covered already) is to make sure the inventory step isn't using the clouds.yaml that has the nodepool regions in it | 18:21 |
| mordred | since that will be super unhappy | 18:21 |
| EmilienM | fungi, mordred : ahah, thx ;-) funny thing with owls is that there are tons of facts, so keep updated ;-) | 18:21 |
| clarkb | mordred: can you update https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames with concrete info on your project rename? | 18:22 |
| clarkb | mordred: right now its a bit hand wavy based on me knowing you want to do a rename but not knowing from what to what | 18:22 |
| *** diablo_rojo has quit IRC | 18:22 | |
| fungi | yeah, we'd love to schedule our first rename of the zuul v3 era soon ;) | 18:22 |
| *** harlowja has joined #openstack-infra | 18:23 | |
| fungi | i even have a (probably very broken) new process proposed for review | 18:23 |
| fungi | looking forward to finding out exactly how broken in how many places | 18:23 |
| *** pickle has quit IRC | 18:25 | |
| *** pickle has joined #openstack-infra | 18:25 | |
| *** gfidente is now known as gfidente|afk | 18:27 | |
| mordred | clarkb: yes! | 18:28 |
| *** stevebaker has quit IRC | 18:29 | |
| *** gyee has quit IRC | 18:30 | |
| *** apetrich has quit IRC | 18:30 | |
| *** pickle has quit IRC | 18:31 | |
| *** pickle has joined #openstack-infra | 18:31 | |
| *** dave-mccowan has quit IRC | 18:32 | |
| *** yamamoto has joined #openstack-infra | 18:32 | |
| *** apetrich has joined #openstack-infra | 18:33 | |
| clarkb | logan-: reading calico docs it says the address mode must be dhcpv6 stateful but doesn't say that the ra mode needs to be dhcpv6-stateful. Do you know if one implies the other in neutron? | 18:33 |
| beisner | fungi - ha! agree re: secrets in a mysterious shoebox - appreciate your input as always. | 18:34 |
| *** pickle has quit IRC | 18:35 | |
| *** pickle has joined #openstack-infra | 18:35 | |
| *** stevebaker has joined #openstack-infra | 18:36 | |
| fungi | clarkb: good point. from a protocol standpoint the two can be entirely complimentary (use dhcp6 for host portion assignment, ra for prefixes and routes) | 18:36 |
| *** diablo_rojo has joined #openstack-infra | 18:37 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rename python-openstacksdk to openstacksdk https://review.openstack.org/554662 | 18:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Enable storyboard for openstacksdk https://review.openstack.org/554663 | 18:37 |
| *** yamamoto has quit IRC | 18:37 | |
| AJaeger | mordred: https://review.openstack.org/554292 looks fine now - but https://review.openstack.org/554300 not yet | 18:38 |
| fungi | clarkb: also that should ideally be independent of stateful vs stateless too (consider it a 2x2 matrix) | 18:38 |
| *** pickle has quit IRC | 18:38 | |
| AJaeger | mordred: I've rechecked https://review.openstack.org/554222 | 18:38 |
| clarkb | logan-: also I think if the cloud you spun up for us is using calico to mimic production we should try to make it work this way first. But if not then switching to stateless would be a nice fallback | 18:38 |
| logan- | clarkb: not sure, it seems separate in the neutron API though. im happy to change it either way since this is a private separate cloud that does not use calico it should work fine with w/e. i just copied the network config from what we do on public ;) | 18:38 |
| *** pickle has joined #openstack-infra | 18:38 | |
| clarkb | logan-: ah if it doesn't use calico then I think maybe changing it will be the simplest thing. I didn't want to change it if we would have to move away from some existing config mimicing production for debug purposes but we won't be testing calico either way here | 18:39 |
| clarkb | logan-: I think it will help speed up bootstrapping quite a bit to change that | 18:39 |
| logan- | cool | 18:39 |
| *** efoley has quit IRC | 18:40 | |
| logan- | so both of these to dhcpv6-stateless? https://github.com/continuouspw/openstack-ci-cloud/blob/master/network_bootstrap/bootstrap-neutron.yml#L92-L93 | 18:40 |
| logan- | or just RA mode? | 18:41 |
| mordred | AJaeger: oh! yeah - we're gonna need the tox_install removal for it to work - since tox_install is going to be potentially making the same mistake | 18:41 |
| logan- | i suspect address mode can't change with ports active | 18:41 |
| clarkb | logan-: I think whatever osic used should be fine which was dhcpv6-stateless and ya we probably need to coordindate with dmsimard so that no ports are in use to change it | 18:41 |
| logan- | ok | 18:41 |
| dmsimard | logan-: there's nothing important spun up yet | 18:41 |
| mordred | AJaeger: yup. in fact, tox_install.sh as it is in the patch where you are removing it is buggy and is not in fact doing the correct thing either | 18:42 |
| logan- | dmsimard: ok cool. will commence rewiring | 18:42 |
| mordred | AJaeger: so any instances of that doing the intended thing are accidental | 18:42 |
| mordred | AJaeger: I'm going to add 554222 to the depends-on list of 554300 | 18:42 |
| *** dhajare has quit IRC | 18:42 | |
| *** andreas_s has joined #openstack-infra | 18:45 | |
| AJaeger | mordred: so, we need to merge https://review.openstack.org/554297 and https://review.openstack.org/552865 - and then we can get rid of tox_install.sh from the project. | 18:46 |
| *** dave-mccowan has joined #openstack-infra | 18:46 | |
| *** stevebaker has quit IRC | 18:46 | |
| AJaeger | requirements team - prometheanfire, dirk, could you review 552865 , please? | 18:46 |
| AJaeger | and once tox_install is removed, vmware-nsxlib is fine again... | 18:46 |
| AJaeger | mordred: we should document this a bit more as guideance for teams | 18:47 |
| mordred | AJaeger: 554300 updated - and also squashed in the depends-on patch with the new test so that it'll run the test | 18:47 |
| mordred | AJaeger: agree - once we've got a pattern that fully works, let's document it very well | 18:48 |
| *** stevebaker has joined #openstack-infra | 18:48 | |
| *** pickle has quit IRC | 18:48 | |
| AJaeger | mordred: update https://docs.openstack.org/infra/manual/zuulv3.html#installation-of-sibling-requirements ? | 18:48 |
| mordred | AJaeger: yah | 18:49 |
| AJaeger | and then we could send an email with details | 18:49 |
| *** andreas_s has quit IRC | 18:50 | |
| *** pickle has joined #openstack-infra | 18:50 | |
| *** arxcruz is now known as arxcruz|off | 18:53 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Revert "Temporarily make legacy-tempest-dsvm-neutron-src NV" https://review.openstack.org/554323 | 18:53 |
| clarkb | five minute warning for the infra meeting. See you all in #openstack-meeting soonish | 18:56 |
| fungi | the countdown is making it feel more exciting than usual | 18:57 |
| mordred | fungi: it would be even more exciting if it was the final countdown | 18:57 |
| *** stevebaker has quit IRC | 18:57 | |
| fungi | na na na naaa, na na na na na! | 18:58 |
| logan- | dmsimard: done | 18:58 |
| dmsimard | logan-: ok so what's the end result ? sorry I didn't follow the entire thing | 18:59 |
| dmsimard | logan-: I mean, do we still need to add that dhcp6 to the nic ? | 18:59 |
| logan- | the v6 net mode is now dhcpv6-stateless instead of dhcpv6-stateful | 19:00 |
| clarkb | dmsimard: logan- my expectation is that now the ubuntu xenial image will work with ipv6 | 19:00 |
| clarkb | because it will ra and get its address and it will just work | 19:00 |
| *** pcichy has quit IRC | 19:00 | |
| clarkb | similarly this is how the nodepool nodes will just work | 19:00 |
| clarkb | (needs to be tested of course) | 19:00 |
| dmsimard | clarkb: ack | 19:00 |
| *** shardy has quit IRC | 19:01 | |
| logan- | booted a xenial node, seems to work | 19:02 |
| *** dave-mccowan has quit IRC | 19:03 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Add a loading_errors info to {tenant}/info endpoint https://review.openstack.org/553873 | 19:04 |
| *** amoralej is now known as amoralej|off | 19:06 | |
| *** stevebaker has joined #openstack-infra | 19:06 | |
| AJaeger | mordred: indeed, tox_install still causes problems -see http://logs.openstack.org/22/554222/3/check/openstack-tox-pep8/b03ccff/ | 19:07 |
| *** pickle has joined #openstack-infra | 19:08 | |
| mordred | fungi: I signed the rocky key and pushed it back up, but the webpage on sks-keyservers.net doesn't show my signature - did I do something wrong? | 19:10 |
| *** jamesmcarthur has quit IRC | 19:11 | |
| *** jamesmcarthur has joined #openstack-infra | 19:13 | |
| *** myoung|biab is now known as myoung|rover | 19:14 | |
| *** eernst has quit IRC | 19:15 | |
| fungi | mordred: probably not, it just takes time to get replicated to the keyserver your browser is hitting. it's a pool of independently-run keyservers with a laggy replication between them | 19:16 |
| fungi | if it's not showing up in a couple hours, then maybe consider you made a mistake | 19:16 |
| mordred | fungi: kk. cool | 19:16 |
| *** eernst has joined #openstack-infra | 19:18 | |
| *** VW_ has joined #openstack-infra | 19:21 | |
| *** eernst has quit IRC | 19:23 | |
| *** VW has quit IRC | 19:25 | |
| *** VW_ has quit IRC | 19:25 | |
| *** bobh has joined #openstack-infra | 19:27 | |
| pabelanger | AJaeger: did I do https://review.openstack.org/554646/ right? for new project | 19:27 |
| pabelanger | followed the updated docs :) | 19:27 |
| *** psachin has joined #openstack-infra | 19:28 | |
| *** eernst has joined #openstack-infra | 19:28 | |
| AJaeger | pabelanger: yeah, +2 | 19:29 |
| *** stevebaker has quit IRC | 19:30 | |
| *** VW has joined #openstack-infra | 19:31 | |
| *** pickle has quit IRC | 19:31 | |
| prometheanfire | AJaeger: k | 19:31 |
| *** eernst has quit IRC | 19:32 | |
| *** pickle has joined #openstack-infra | 19:32 | |
| *** yamamoto has joined #openstack-infra | 19:34 | |
| *** eernst has joined #openstack-infra | 19:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add gerrit_configure flag to review-dev01.o.o https://review.openstack.org/554624 | 19:35 |
| *** stevebaker has joined #openstack-infra | 19:36 | |
| logan- | dmsimard: one thing before you populate the mirror... would it be possible to mount a volume for the bulk mirror data | 19:36 |
| dmsimard | logan-: yes, that was the plan | 19:36 |
| logan- | great ok | 19:36 |
| dmsimard | 100GB isn't enough :) | 19:36 |
| logan- | thanks | 19:36 |
| *** dave-mccowan has joined #openstack-infra | 19:36 | |
| pabelanger | yah, 200GB should be enough | 19:37 |
| *** d34dh0r53 has quit IRC | 19:37 | |
| *** eernst has quit IRC | 19:37 | |
| *** d34dh0r53 has joined #openstack-infra | 19:37 | |
| *** yamamoto has quit IRC | 19:39 | |
| *** eernst has joined #openstack-infra | 19:40 | |
| *** eernst_ has joined #openstack-infra | 19:42 | |
| *** eernst__ has joined #openstack-infra | 19:43 | |
| *** eernst_ has quit IRC | 19:43 | |
| AJaeger | mordred: blazar-nova and compute-hyperv install nova - but it's not on pypi yet ;( so, need to wait for tox_install removal on those two | 19:43 |
| fungi | right, we usually want 100gb dedicated for apache proxy cache _and_ another 100gb dedicated for afs cache | 19:43 |
| fungi | just because they tend to expand and contract a bit as automated processes run to cull old data (especially where the apache cache is concerned) | 19:44 |
| *** diablo_rojo has quit IRC | 19:44 | |
| *** psachin has quit IRC | 19:44 | |
| *** eernst has quit IRC | 19:44 | |
| *** stevebaker has quit IRC | 19:45 | |
| *** stevebaker has joined #openstack-infra | 19:45 | |
| AJaeger | mordred: is https://review.openstack.org/554300 looking fine now? | 19:47 |
| *** psachin has joined #openstack-infra | 19:47 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Add release notes jobs to python-brick-cinderclient-ext https://review.openstack.org/554677 | 19:50 |
| logan- | fungi: yup no worries, use all the volume space you need. 20tb of ceph available in there | 19:51 |
| mordred | AJaeger: it's not - but yours is - so I'm thinking I got the depends-on links wrong? | 19:51 |
| *** salv-orlando has quit IRC | 19:51 | |
| *** salv-orlando has joined #openstack-infra | 19:52 | |
| mordred | AJaeger: yup. incorrect depends-on | 19:52 |
| mordred | AJaeger: lemme try one more time | 19:52 |
| mordred | AJaeger: I think your 292 change has convinced me it's working though | 19:53 |
| AJaeger | mordred: I'm convinced as well ;) | 19:53 |
| *** e0ne has joined #openstack-infra | 19:53 | |
| *** tesseract has quit IRC | 19:56 | |
| *** salv-orlando has quit IRC | 19:56 | |
| *** armaan has quit IRC | 19:57 | |
| *** stevebaker has quit IRC | 19:58 | |
| *** stevebaker has joined #openstack-infra | 19:59 | |
| *** eernst__ has quit IRC | 20:02 | |
| *** masber has joined #openstack-infra | 20:02 | |
| AJaeger | mordred: what about https://review.openstack.org/#/c/531825/ - a couple of pypi projects are not setup yet. How do you want to continue that one? And is the releaseteam on board to push everything on pypi? | 20:02 |
| *** dave-mccowan has quit IRC | 20:03 | |
| *** HeOS has joined #openstack-infra | 20:04 | |
| *** dave-mccowan has joined #openstack-infra | 20:04 | |
| *** armaan has joined #openstack-infra | 20:05 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add ansible-role-statsd project https://review.openstack.org/554646 | 20:07 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing 554684 https://review.openstack.org/554685 | 20:07 |
| *** eernst has joined #openstack-infra | 20:07 | |
| pabelanger | infra-root: https://review.openstack.org/554624/ passed test, for 2 step review-dev01.o.o | 20:08 |
| *** stevebaker has quit IRC | 20:08 | |
| *** stevebaker has joined #openstack-infra | 20:08 | |
| *** psachin has quit IRC | 20:08 | |
| *** psachin has joined #openstack-infra | 20:09 | |
| *** germs has joined #openstack-infra | 20:10 | |
| *** germs has quit IRC | 20:10 | |
| *** germs has joined #openstack-infra | 20:10 | |
| *** tellesnobrega has quit IRC | 20:11 | |
| clarkb | re slack irc bridges, I don't think we'd go about setting those up ourselves, but nothing stops people from using them or the matrix freenode bridge (I know some people are using the matrix freenode bridge and are apparently happy with it) | 20:12 |
| clarkb | I'd happily help anyone get connected with the irc client of their choice | 20:12 |
| *** stevebaker has quit IRC | 20:13 | |
| *** germs has quit IRC | 20:13 | |
| *** psachin has quit IRC | 20:14 | |
| pabelanger | never heard of matrix freenode bridge | 20:15 |
| fungi | yeah, the hosting something ourselves discussion was more about https://thelounge.chat/docs/ | 20:15 |
| fungi | er, https://thelounge.chat/ | 20:15 |
| fungi | web irc client with persistent profiles and bouncer-like behavior to accumulate activity while you're not connected to it | 20:16 |
| *** rkukura has joined #openstack-infra | 20:16 | |
| fungi | the discussions i had with docaedo about that (it was a suggestion of his a couple years ago but still looks actively developed and increasing in popularity) is that the challenges are going to be around account management and abuse prevention | 20:17 |
| SamYaple | we are now (ab)using bindep to also manage pip deps in a common format (profiles select appropriate packages and python libs where appropriate) with LOCI. Does anyone see any issues with that long term? https://github.com/openstack/loci/blob/master/pydep.txt | 20:19 |
| clarkb | SamYaple: you should probably be using setuptools extras instead | 20:20 |
| *** iyamahat_ has quit IRC | 20:20 | |
| SamYaple | this isnt a python package though | 20:20 |
| SamYaple | unless i misunderstand | 20:20 |
| *** iyamahat_ has joined #openstack-infra | 20:20 | |
| clarkb | SamYaple: you don't have to be a python package to use setuptools | 20:21 |
| clarkb | but I can see how that might feel unnatural | 20:21 |
| fungi | if these are distro packages of python libs (looks like they are?) it should work out just fine | 20:21 |
| clarkb | SamYaple: in your example the deps are for keystone at least. So you could install keystone with an extras for kdap | 20:21 |
| SamYaple | clarkb: ah i see your point. i hadnt considered that | 20:22 |
| SamYaple | let me play with that | 20:22 |
| fungi | depends on how they're installing keystone too, but yes that makes sense | 20:22 |
| SamYaple | fungi: inthis case its being consumed here https://github.com/openstack/loci/blob/master/scripts/install.sh#L54-L55 | 20:23 |
| SamYaple | which is pip installing whatever bindep spits out | 20:23 |
| *** stevebaker has joined #openstack-infra | 20:23 | |
| clarkb | I think making sure our python packages for things like nova and keystone accurately reflect their optional deps is valuable even if you end up not using them direclty | 20:23 |
| fungi | ahh, using pip to install things bindep says are missing could lead to some challenges | 20:23 |
| SamYaple | clarkb: agreed. and i could make loci work with that if it was a community goal thing | 20:23 |
| *** florianf has quit IRC | 20:24 | |
| fungi | bindep is focused on system packages... it could probably be extended to use pip as another package manager, but it lacks that logic today | 20:24 |
| SamYaple | fungi: it doesnt, it just spits out a list of all options (-l newline) | 20:24 |
| SamYaple | im bypassing the system package logic | 20:24 |
| fungi | SamYaple: how does it know what's already installed? | 20:24 |
| SamYaple | it doesnt | 20:25 |
| *** dprince has quit IRC | 20:25 | |
| SamYaple | apt/yum will handle already installed bits (since we use this in the container) | 20:25 |
| tonyb | evrardjp: No just me being slow sorry | 20:25 |
| SamYaple | and there wont be any pip packages since this gets setup in a virtualenv | 20:25 |
| fungi | SamYaple: well, given that bindep is designed to compare a manifest of packages and the local system and tell you what's missing, this is a bit of a stretch use case for it, i'll grant you | 20:26 |
| fungi | you seem to mainly be using it as a cross-platform package list parser | 20:26 |
| fungi | or not even actually cross-platform for that matter | 20:27 |
| SamYaple | yea. like i said, we are (ab)using bindep a bit. but if its in a way that is likely to remainthe same..... | 20:27 |
| fungi | given that it lacks options to disable checking the installed package set, i wouldn't guarantee it will act ina stable fashion | 20:28 |
| fungi | if there's an installed system package it finds which has the same name as a package you need from pypi, it'll get silently omitted | 20:28 |
| SamYaple | nope | 20:29 |
| SamYaple | we pass `-l newline` | 20:29 |
| SamYaple | itll spit it out still | 20:29 |
| *** priteau has joined #openstack-infra | 20:29 | |
| fungi | oh! i missed that we added --list-all | 20:30 |
| *** stevebaker has quit IRC | 20:30 | |
| fungi | i guess i reviewed that in https://review.openstack.org/492693 | 20:30 |
| SamYaple | haha | 20:31 |
| fungi | late last year | 20:31 |
| *** esberglu has quit IRC | 20:31 | |
| fungi | (i was even the one to approve it) | 20:31 |
| SamYaple | yea thats why i thought it was funny you were saying that | 20:31 |
| *** dave-mccowan has quit IRC | 20:31 | |
| SamYaple | (i spent alot of time in bindep history) | 20:31 |
| SamYaple | for the groups patch | 20:31 |
| fungi | i have a mind like a steel sieve | 20:31 |
| *** eharney has quit IRC | 20:31 | |
| SamYaple | lol | 20:31 |
| SamYaple | ok, so my take away is its iffy, but should be fairly stable, even though its used a bit outside of its design | 20:32 |
| SamYaple | no immediate breaking plans | 20:32 |
| fungi | yeah, seems you're just using it as a conditional string list parser | 20:32 |
| SamYaple | more or less, there are a few different tools we looked at | 20:32 |
| fungi | i don't think we'd break what you're relying on there, but it seems like swatting a fly with a buick | 20:32 |
| SamYaple | but this was the most "openstacky" | 20:32 |
| *** masber has quit IRC | 20:32 | |
| SamYaple | thats an apt description | 20:33 |
| *** openstackgerrit has quit IRC | 20:33 | |
| SamYaple | we landed on it because we already needed a venv to install inthe container (and bindep is tiny to install with shared depsto the openstack service to be installed) and this was a known format in the community | 20:34 |
| *** esberglu has joined #openstack-infra | 20:34 | |
| *** camunoz has quit IRC | 20:34 | |
| fungi | yeah, at least we designed bindep to have no dependencies itself | 20:35 |
| fungi | well, minimal deps anyway | 20:35 |
| fungi | pbr and parsley | 20:35 |
| *** yamamoto has joined #openstack-infra | 20:35 | |
| *** stevebaker has joined #openstack-infra | 20:36 | |
| * fungi need to go run some errands, will bbiaw | 20:36 | |
| *** yamamoto has quit IRC | 20:41 | |
| *** stevebaker has quit IRC | 20:44 | |
| *** kjackal has quit IRC | 20:48 | |
| *** edmondsw has quit IRC | 20:51 | |
| *** panda|bbl is now known as panda | 20:51 | |
| *** felipemonteiro_ has joined #openstack-infra | 20:51 | |
| *** stevebaker has joined #openstack-infra | 20:51 | |
| *** salv-orlando has joined #openstack-infra | 20:52 | |
| *** felipemonteiro has quit IRC | 20:54 | |
| *** jamesmcarthur has quit IRC | 20:55 | |
| *** dmellado has joined #openstack-infra | 20:56 | |
| *** openstackgerrit has joined #openstack-infra | 20:57 | |
| openstackgerrit | greghaynes proposed openstack-dev/pbr master: Support v1.2.3 versioning https://review.openstack.org/554696 | 20:57 |
| *** salv-orlando has quit IRC | 20:57 | |
| openstackgerrit | greghaynes proposed openstack-dev/pbr master: Support v1.2.3 versioning https://review.openstack.org/554696 | 20:58 |
| *** dmellado has quit IRC | 20:58 | |
| *** dave-mccowan has joined #openstack-infra | 21:00 | |
| pabelanger | could I get another review on https://review.openstack.org/554624/ | 21:00 |
| *** trown|ruck is now known as trown|outtypewww | 21:00 | |
| pabelanger | https://review.openstack.org/554313/ would be nice too, since that was needed to launch vexxhost mirror | 21:01 |
| openstackgerrit | Merged openstack-infra/grafyaml master: Add Custom Template Type https://review.openstack.org/544305 | 21:01 |
| *** dmellado has joined #openstack-infra | 21:02 | |
| *** jamesmcarthur has joined #openstack-infra | 21:03 | |
| *** jamesmcarthur has quit IRC | 21:04 | |
| *** jamesmcarthur has joined #openstack-infra | 21:04 | |
| *** pickle has quit IRC | 21:06 | |
| *** pickle has joined #openstack-infra | 21:06 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint https://review.openstack.org/554699 | 21:07 |
| *** dmellado has quit IRC | 21:08 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoint https://review.openstack.org/554699 | 21:09 |
| *** stevebaker has quit IRC | 21:09 | |
| *** camunoz has joined #openstack-infra | 21:09 | |
| *** stevebaker has joined #openstack-infra | 21:10 | |
| *** jlabarre has quit IRC | 21:11 | |
| *** dmellado has joined #openstack-infra | 21:12 | |
| *** dmellado has quit IRC | 21:13 | |
| *** bobh has quit IRC | 21:13 | |
| *** myoung|rover is now known as myoung|off | 21:13 | |
| *** myoung|off is now known as myoung|bbl | 21:13 | |
| *** dmellado has joined #openstack-infra | 21:15 | |
| *** haleyb has quit IRC | 21:15 | |
| *** prometheanfire has quit IRC | 21:15 | |
| *** pickle has quit IRC | 21:16 | |
| *** myoung|bbl is now known as myoung|rover | 21:16 | |
| *** pickle has joined #openstack-infra | 21:16 | |
| *** VW has quit IRC | 21:16 | |
| *** prometheanfire has joined #openstack-infra | 21:16 | |
| *** ldnunes has quit IRC | 21:17 | |
| *** stevebaker has quit IRC | 21:20 | |
| openstackgerrit | megan guiney proposed openstack-infra/subunit2sql master: Add delete by uuid functions https://review.openstack.org/537775 | 21:21 |
| *** diablo_rojo has joined #openstack-infra | 21:21 | |
| *** jcoufal has quit IRC | 21:23 | |
| *** jcoufal has joined #openstack-infra | 21:25 | |
| *** agopi has quit IRC | 21:26 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing 554684 https://review.openstack.org/554685 | 21:28 |
| *** kgiusti has left #openstack-infra | 21:30 | |
| clarkb | I'm getting nerdsniped by pbr bugs | 21:30 |
| *** dmellado has quit IRC | 21:32 | |
| *** haleyb has joined #openstack-infra | 21:32 | |
| clarkb | pabelanger: done | 21:33 |
| clarkb | small thing on the launch node change | 21:33 |
| *** e0ne has quit IRC | 21:33 | |
| pabelanger | clarkb: Good catch | 21:34 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add volume-size flag to launch-node https://review.openstack.org/554313 | 21:35 |
| pabelanger | okay, I'm going to step away for food | 21:35 |
| *** esberglu has quit IRC | 21:35 | |
| *** bradm has joined #openstack-infra | 21:37 | |
| *** yamamoto has joined #openstack-infra | 21:37 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoints https://review.openstack.org/554710 | 21:38 |
| *** jamesmcarthur has quit IRC | 21:39 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoints https://review.openstack.org/554710 | 21:39 |
| *** esberglu_ has joined #openstack-infra | 21:40 | |
| *** VW has joined #openstack-infra | 21:41 | |
| *** yamamoto has quit IRC | 21:43 | |
| *** lpetrut has quit IRC | 21:44 | |
| openstackgerrit | Clark Boylan proposed openstack-dev/pbr master: Make docs on env vars a little clearer https://review.openstack.org/554712 | 21:45 |
| *** esberglu_ has quit IRC | 21:45 | |
| *** ssbarnea has quit IRC | 21:46 | |
| *** wznoinsk_ has quit IRC | 21:46 | |
| *** HeOS has quit IRC | 21:46 | |
| *** myoung|rover is now known as myoung|afk | 21:46 | |
| *** HeOS has joined #openstack-infra | 21:48 | |
| *** dizquierdo has joined #openstack-infra | 21:48 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add zuul-stream remote tests https://review.openstack.org/554714 | 21:48 |
| *** gfidente|afk has quit IRC | 21:49 | |
| *** gouthamr has quit IRC | 21:49 | |
| *** boden has quit IRC | 21:51 | |
| *** jcoufal has quit IRC | 21:51 | |
| *** VW has quit IRC | 21:51 | |
| *** ssbarnea has joined #openstack-infra | 21:52 | |
| *** dizquierdo has quit IRC | 21:53 | |
| *** wznoinsk has joined #openstack-infra | 21:53 | |
| *** salv-orlando has joined #openstack-infra | 21:53 | |
| *** dmellado has joined #openstack-infra | 22:04 | |
| *** panda is now known as panda|off | 22:04 | |
| fungi | clarkb: have a link to the nerdy pbr bugs? i sometimes enjoy python packaging distractions | 22:07 |
| clarkb | fungi: it was mostly doing triage on all the untriged bugs | 22:07 |
| clarkb | I pointed it out to the oslo team too and got through 5 or 6 myself | 22:07 |
| *** jbadiapa has quit IRC | 22:07 | |
| fungi | yikes | 22:07 |
| clarkb | fungi: things like why doesnt this random pep440 version work. well because pbr does semver subset of pep 440 | 22:08 |
| fungi | and yeah, the oslo team seems to have their fair share of unmonitored wasteland much like we do | 22:08 |
| clarkb | some of it was devstack not working | 22:09 |
| clarkb | in any case I hope I put a small dent in it | 22:09 |
| *** Swanson has joined #openstack-infra | 22:09 | |
| *** germs has joined #openstack-infra | 22:10 | |
| *** germs has quit IRC | 22:10 | |
| *** germs has joined #openstack-infra | 22:10 | |
| Swanson | Hi. So tempest.api.volume.admin.test_group_snapshots.GroupSnapshotsV319Test is failing on stable/pike. My patch is a driver patch miles from this. This a known issue? | 22:12 |
| clarkb | Swanson: can you provide a link to the failure? | 22:13 |
| *** rcernin has joined #openstack-infra | 22:13 | |
| clarkb | there was a known issur with packaging that has since been fixed but without logs hard to say if tht is what hit your job | 22:13 |
| *** diablo_rojo has quit IRC | 22:13 | |
| Swanson | https://review.openstack.org/#/c/554656/1 | 22:14 |
| *** diablo_rojo has joined #openstack-infra | 22:14 | |
| *** germs has quit IRC | 22:14 | |
| *** priteau has quit IRC | 22:15 | |
| *** priteau has joined #openstack-infra | 22:15 | |
| *** slagle has quit IRC | 22:16 | |
| *** dave-mccowan has quit IRC | 22:17 | |
| *** slagle has joined #openstack-infra | 22:17 | |
| *** jamesmcarthur has joined #openstack-infra | 22:18 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/irc-meetings master: Remove WOS Mentoring Meeting https://review.openstack.org/554723 | 22:18 |
| *** felipemonteiro_ has quit IRC | 22:18 | |
| clarkb | Swanson: I'll take a look in a few | 22:19 |
| Swanson | clarkb, thanks! | 22:19 |
| *** priteau has quit IRC | 22:20 | |
| *** stevebaker has joined #openstack-infra | 22:27 | |
| *** dave-mccowan has joined #openstack-infra | 22:29 | |
| *** ianychoi__ is now known as ianychoi | 22:32 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Migration Error with Suspended User https://review.openstack.org/532706 | 22:37 |
| *** yamamoto has joined #openstack-infra | 22:39 | |
| clarkb | Swanson: that doesn't look like the known issue that was recently fixed | 22:41 |
| *** jamesmcarthur has quit IRC | 22:41 | |
| *** CrayZee has quit IRC | 22:41 | |
| clarkb | Swanson: it appears that a volume operation timed out and reading the logs I don't think it failedexceptionally was just slow? | 22:43 |
| *** hongbin has quit IRC | 22:44 | |
| *** yamamoto has quit IRC | 22:45 | |
| *** andreas_s has joined #openstack-infra | 22:47 | |
| Swanson | clarkb, yeah, it looked like it just timed out. I think it did it twice. | 22:47 |
| Swanson | clarkb, I'll kick it off before I leave tonite and see what it does. | 22:48 |
| *** armaan has quit IRC | 22:48 | |
| clarkb | Swanson: the known issue was causing neutron agent to fail to start properly | 22:48 |
| clarkb | so you'd see an exception immediately in that log | 22:49 |
| Swanson | clarkb, Thanks! I think my test failures have been well away from that. | 22:50 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Duplicating Users at Migration Time https://review.openstack.org/554726 | 22:51 |
| *** andreas_s has quit IRC | 22:51 | |
| *** eernst has quit IRC | 22:54 | |
| *** eernst has joined #openstack-infra | 22:55 | |
| *** eernst has quit IRC | 22:56 | |
| *** eernst has joined #openstack-infra | 22:56 | |
| *** harlowja has quit IRC | 22:57 | |
| *** tpsilva has quit IRC | 22:57 | |
| *** eernst has quit IRC | 22:58 | |
| clarkb | fungi: what is typical delay on seeing a new signature on a key on the keyservers? I'm just double checking my signing of release key and it seems to be taking a while to show up | 23:00 |
| clarkb | ah there it is now. | 23:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard master: Duplicating Users at Migration Time https://review.openstack.org/554726 | 23:01 |
| *** hasharAway has quit IRC | 23:01 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard master: Duplicating Users at Migration Time https://review.openstack.org/554726 | 23:03 |
| *** masber has joined #openstack-infra | 23:03 | |
| *** rlandy is now known as rlandy|bbl | 23:03 | |
| *** masuberu has joined #openstack-infra | 23:04 | |
| *** eernst has joined #openstack-infra | 23:05 | |
| fungi | clarkb: i've seen upwards of a couple hours. the keyserver your client uploads to is not necessarily the same one your browser hits. the pool of keyservers is a loosely federated network operated by multiple parties joined by a very laggy replication protocol | 23:05 |
| *** eernst_ has joined #openstack-infra | 23:06 | |
| *** eernst__ has joined #openstack-infra | 23:07 | |
| *** masber has quit IRC | 23:08 | |
| *** eernst has quit IRC | 23:09 | |
| *** eernst_ has quit IRC | 23:10 | |
| ianw | and occasionally you get sent to one that has an invalid ssl certificate, which seems an odd thing for a keyserver | 23:12 |
| *** eernst__ has quit IRC | 23:12 | |
| *** rfolco has quit IRC | 23:13 | |
| openstackgerrit | Clark Boylan proposed openstack-dev/pbr master: Better Sem-Ver header handling https://review.openstack.org/554730 | 23:14 |
| clarkb | fungi: ^ related to pbr nerd sniping | 23:14 |
| clarkb | fungi: you might want to double check my git there | 23:15 |
| clarkb | I believe it hsould be completely backward compatible in this application while also fixing the bug in question | 23:15 |
| openstackgerrit | Merged openstack-infra/storyboard master: Migration Error with Suspended User https://review.openstack.org/532706 | 23:16 |
| *** HeOS has quit IRC | 23:19 | |
| corvus | i strongly advocate not using sem-ver footers in commit messages. if anyone is considering them, please let me know so i can try to talk you out of it. | 23:20 |
| *** jpena|away is now known as jpena|off | 23:21 | |
| clarkb | corvus: I'm not sure who the reporters of those two bugs are | 23:21 |
| clarkb | corvus: or of anyone actually using those headers | 23:21 |
| clarkb | but I figure they should work reliably if they are used :/ | 23:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add zuul-stream remote tests https://review.openstack.org/554714 | 23:23 |
| *** jamesmcarthur has joined #openstack-infra | 23:24 | |
| corvus | clarkb, ianw: can you review this devstack change to support plugin dependencies? https://review.openstack.org/522054 | 23:24 |
| clarkb | corvus: ya I'll take a look. Just finishing up a triage on another pbr bug | 23:28 |
| *** jamesmcarthur has quit IRC | 23:29 | |
| *** Anticime1 is now known as Anticimex | 23:29 | |
| ianw | ok | 23:30 |
| clarkb | https://bugs.launchpad.net/pbr/+bug/1667310 is a fun one | 23:32 |
| openstack | Launchpad bug 1667310 in PBR "Unable to use URLs as requirement specifiers" [Undecided,Confirmed] | 23:32 |
| *** mriedem has quit IRC | 23:34 | |
| *** tosky has quit IRC | 23:34 | |
| fungi | i have to agree with corvus, the sem-ver footers parsing was well-intended but a bit too magic and makes release automation mildly simpler at the expense of making meatspace release management harder | 23:39 |
| fungi | ultimately you still need people reviewing release numbering at release time anyway | 23:40 |
| fungi | and you can't take back things you put in commit messages | 23:40 |
| *** yamamoto has joined #openstack-infra | 23:41 | |
| clarkb | fungi: ya I think it is the taking back things in commit messages that becomes problematic | 23:43 |
| fungi | that especially yes | 23:43 |
| *** yamamoto has quit IRC | 23:46 | |
| clarkb | corvus: reading https://review.openstack.org/#/c/522054/5/roles/write-devstack-local-conf/library/test.py I'm having a hard time understanding where the order of foo bar baz comes from if not the ordering in the dict itself | 23:48 |
| *** harlowja has joined #openstack-infra | 23:49 | |
| *** jlabarre has joined #openstack-infra | 23:50 | |
| clarkb | if I am reading the ansible plugin code properly it should be in a settings file in the plugins themselves but foo bar and baz don't seem to exist to that extent? | 23:51 |
| *** mriedem has joined #openstack-infra | 23:52 | |
| *** camunoz has quit IRC | 23:53 | |
| clarkb | corvus: left some comments I think its mostly ok just lacking a test for that particular case | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!