*** bnemec has quit IRC | 00:02 | |
*** bobh has joined #openstack-infra | 00:27 | |
*** Weifan has quit IRC | 00:29 | |
*** bobh has quit IRC | 00:34 | |
*** bnemec has joined #openstack-infra | 00:35 | |
*** whoami-rajat has quit IRC | 00:41 | |
*** bobh has joined #openstack-infra | 00:46 | |
*** gyee has quit IRC | 00:47 | |
*** bobh has quit IRC | 00:50 | |
*** bobh has joined #openstack-infra | 01:07 | |
*** bobh has quit IRC | 01:23 | |
*** bobh has joined #openstack-infra | 01:24 | |
*** bobh has quit IRC | 01:28 | |
*** whoami-rajat has joined #openstack-infra | 01:30 | |
*** bobh has joined #openstack-infra | 01:33 | |
*** bobh has quit IRC | 01:48 | |
*** liuyulong has quit IRC | 01:50 | |
*** bhavikdbavishi has joined #openstack-infra | 01:53 | |
*** sshnaidm|ptg has joined #openstack-infra | 02:11 | |
*** bobh has joined #openstack-infra | 02:15 | |
*** gmann has quit IRC | 02:17 | |
*** bhavikdbavishi1 has joined #openstack-infra | 02:18 | |
*** bhavikdbavishi has quit IRC | 02:20 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 02:20 | |
*** bobh has quit IRC | 02:23 | |
*** yamamoto has quit IRC | 02:29 | |
*** tdasilva has quit IRC | 02:30 | |
*** eharney has quit IRC | 02:41 | |
pabelanger | ianw: Have you started looking into fedora-30 for DIB? | 02:54 |
---|---|---|
openstackgerrit | Paul Belanger proposed zuul/nodepool master: DNM: Switch to fedora-30 for nodepool tests https://review.opendev.org/656608 | 03:01 |
*** yamamoto has joined #openstack-infra | 03:12 | |
*** rfolco|ruck is now known as rfolco|pto | 03:15 | |
*** yamamoto has quit IRC | 03:18 | |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: DNM - test fedora-30 https://review.opendev.org/656610 | 03:29 |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: DNM - test fedora-30 https://review.opendev.org/656610 | 03:30 |
*** yamamoto has joined #openstack-infra | 03:48 | |
*** betherly has joined #openstack-infra | 03:50 | |
*** betherly has quit IRC | 03:55 | |
*** bhavikdbavishi has quit IRC | 04:16 | |
*** bhavikdbavishi has joined #openstack-infra | 04:17 | |
*** psachin has joined #openstack-infra | 04:22 | |
*** sshnaidm|ptg has quit IRC | 04:38 | |
*** yamamoto has quit IRC | 04:47 | |
*** bhavikdbavishi has quit IRC | 04:54 | |
*** bhavikdbavishi has joined #openstack-infra | 04:54 | |
*** yamamoto has joined #openstack-infra | 05:02 | |
*** kjackal has joined #openstack-infra | 05:08 | |
*** gmann has joined #openstack-infra | 05:10 | |
*** jbadiapa has quit IRC | 05:21 | |
*** yamamoto has quit IRC | 05:29 | |
*** yamamoto has joined #openstack-infra | 05:41 | |
*** e0ne has joined #openstack-infra | 05:44 | |
*** e0ne has quit IRC | 05:45 | |
*** yamamoto has quit IRC | 05:46 | |
*** yamamoto has joined #openstack-infra | 05:47 | |
*** yamamoto has quit IRC | 06:06 | |
*** yboaron has joined #openstack-infra | 06:08 | |
*** kjackal has quit IRC | 06:17 | |
*** bhavikdbavishi has quit IRC | 06:25 | |
*** kjackal has joined #openstack-infra | 06:30 | |
*** yamamoto has joined #openstack-infra | 06:31 | |
*** yamamoto has quit IRC | 06:36 | |
*** kjackal has quit IRC | 06:40 | |
openstackgerrit | Alec Hothan proposed openstack/project-config master: Remove docs-on-readthedocs-failing from kloudbuster project https://review.opendev.org/656604 | 06:51 |
*** bhavikdbavishi has joined #openstack-infra | 07:08 | |
*** yamamoto has joined #openstack-infra | 07:10 | |
*** Lucas_Gray has joined #openstack-infra | 07:10 | |
*** pcaruana has joined #openstack-infra | 07:14 | |
*** shardy has joined #openstack-infra | 07:19 | |
*** yboaron has quit IRC | 07:21 | |
*** Lucas_Gray has quit IRC | 07:23 | |
*** jtomasek has joined #openstack-infra | 07:26 | |
*** Lucas_Gray has joined #openstack-infra | 07:27 | |
*** larainema has quit IRC | 07:32 | |
*** jpich has joined #openstack-infra | 07:40 | |
*** quiquell|off is now known as quiquell|ptg | 07:56 | |
*** yamamoto has quit IRC | 08:08 | |
*** gmann has quit IRC | 08:19 | |
*** psachin has quit IRC | 08:20 | |
*** yboaron has joined #openstack-infra | 08:25 | |
*** yamamoto has joined #openstack-infra | 08:25 | |
*** Wryhder has joined #openstack-infra | 08:26 | |
*** Lucas_Gray has quit IRC | 08:27 | |
*** Wryhder is now known as Lucas_Gray | 08:27 | |
*** yboaron_ has joined #openstack-infra | 08:28 | |
*** yamamoto has quit IRC | 08:28 | |
*** yboaron has quit IRC | 08:31 | |
ianw | pabelanger: yeah not quite yet -- i thought i'd upgrade locally and that did *not* go well. something happens and it runs out of memory during the upgrade, and so i had double packages installed everywhere. tried to fix it for a bit but luckily i snapshotted before ... | 08:40 |
AJaeger | ianw: ianw is fedora-28 really our latest fedora or was devstack forgotten to update? See https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L55 | 08:44 |
openstackgerrit | Merged openstack/project-config master: Remove docs-on-readthedocs-failing from kloudbuster project https://review.opendev.org/656604 | 08:52 |
*** kjackal has joined #openstack-infra | 09:06 | |
*** yamamoto has joined #openstack-infra | 09:12 | |
*** yamamoto has quit IRC | 09:18 | |
*** bhavikdbavishi has quit IRC | 09:23 | |
*** Lucas_Gray has quit IRC | 09:23 | |
*** yamamoto has joined #openstack-infra | 09:24 | |
*** Lucas_Gray has joined #openstack-infra | 09:25 | |
*** yamamoto has quit IRC | 09:31 | |
openstackgerrit | Sorin Sbarnea proposed openstack/diskimage-builder master: Avoid breaking virtualenv on python3 https://review.opendev.org/656467 | 09:34 |
*** bhavikdbavishi has joined #openstack-infra | 09:35 | |
*** rascasoft has quit IRC | 09:38 | |
*** rascasoft has joined #openstack-infra | 09:42 | |
lifeless | corvus: de nada :) | 09:58 |
*** kjackal has quit IRC | 10:06 | |
*** kjackal has joined #openstack-infra | 10:09 | |
*** yamamoto has joined #openstack-infra | 10:12 | |
*** yamamoto has quit IRC | 10:17 | |
*** betherly has joined #openstack-infra | 10:24 | |
*** hwoarang has quit IRC | 10:36 | |
*** hwoarang has joined #openstack-infra | 10:37 | |
*** slaweq has joined #openstack-infra | 11:18 | |
*** noama has joined #openstack-infra | 11:19 | |
*** bhavikdbavishi has quit IRC | 11:27 | |
ianw | AJaeger: it is our latest, i have patches out for updating to fedora 29 but they never made it in. sometimes it happens when there's just not enough people caring :/ | 11:28 |
*** xarses_ has quit IRC | 11:37 | |
*** bhavikdbavishi has joined #openstack-infra | 11:38 | |
*** Lucas_Gray has quit IRC | 11:39 | |
*** rfarr has joined #openstack-infra | 11:43 | |
*** bhavikdbavishi has quit IRC | 12:06 | |
*** slaweq has quit IRC | 12:08 | |
*** slaweq has joined #openstack-infra | 12:09 | |
*** kgiusti has joined #openstack-infra | 12:10 | |
*** kgiusti has left #openstack-infra | 12:13 | |
pabelanger | ianw: :( I did the fedora-30 last night with out issue. | 12:23 |
pabelanger | ianw: but so far, it seem get-pip.py is broken on fedora-30: http://logs.openstack.org/10/656610/2/check/nodepool-functional-py35-redhat-src/caa26ff/controller/logs/builds/fedora-30-0000000001_log.txt.gz#_2019-05-01_03_56_37_006 | 12:24 |
pabelanger | will have to dig more into it later | 12:24 |
*** bhavikdbavishi has joined #openstack-infra | 12:28 | |
*** rfarr_ has joined #openstack-infra | 12:34 | |
*** rfarr has quit IRC | 12:34 | |
*** ianychoi_ has quit IRC | 12:35 | |
*** rlandy has joined #openstack-infra | 12:35 | |
*** ianychoi_ has joined #openstack-infra | 12:35 | |
AJaeger | ianw: I see. | 12:38 |
pabelanger | AJaeger: fedora-28 should be EOL in less then 30 days, so could be the montivation need to migrate | 12:40 |
pabelanger | needed* | 12:40 |
*** kopecmartin|off has quit IRC | 12:40 | |
*** aaronsheffield has joined #openstack-infra | 12:47 | |
*** rfarr_ has quit IRC | 12:47 | |
*** rfarr has joined #openstack-infra | 12:48 | |
*** pcaruana has quit IRC | 12:49 | |
*** mriedem has joined #openstack-infra | 12:50 | |
*** yamamoto has joined #openstack-infra | 12:52 | |
*** pcaruana has joined #openstack-infra | 12:54 | |
*** ianychoi_ has quit IRC | 13:00 | |
*** bhavikdbavishi has quit IRC | 13:14 | |
*** auristor has quit IRC | 13:17 | |
mriedem | is anyone aware of any zuul v3 job examples where the job is sending a file down to one of the nodes, like a policy file to the controller? | 13:19 |
mriedem | or is that just standard ansible and i'd need to use zuul variables to build the proper path on the proper host | 13:20 |
pabelanger | when you say sending a file down, you mean between nodes? | 13:21 |
mriedem | i want to define a nova policy.yaml file in my job and then transfer it to the controller host | 13:22 |
mriedem | i could do this with hacking devstack, but that seems like the wrong way | 13:22 |
mriedem | so i'm assuming i can use the copy module https://docs.ansible.com/ansible/latest/modules/copy_module.html#copy-module to send a file to the controller and build the dest param from zuul variables | 13:24 |
pabelanger | so, I am not aware of an existing job to do that, however that concept is pretty standard in ansible. It sounds like we just need to figure out where it is defined and use the synchronize task to copy it to controller. | 13:24 |
pabelanger | yah, copy also works too | 13:24 |
mriedem | can i write the file contents in the job def using a variable? or do i need a real policy.yaml file somewhere in the nova repo to copy? | 13:25 |
*** mtreinish has joined #openstack-infra | 13:25 | |
mriedem | forgive my ansible ignorance | 13:25 |
mriedem | was thinking like: | 13:25 |
mriedem | vars: | 13:25 |
mriedem | policy_yaml: | | 13:26 |
mriedem | some.nova.policy.rule=rule:admin_or_owner | 13:26 |
pabelanger | you could do it that way, but you'd then need to use template module to write it on the controller | 13:26 |
mriedem | heh i suppose i should just cat it | 13:26 |
mriedem | *er not cat | 13:26 |
mriedem | just write it out with a remote exec | 13:26 |
mriedem | although i'm not sure in what order things run in these jobs, i.e. i really need this in post-config once the /etc/nova dir is setup | 13:29 |
*** yamamoto has quit IRC | 13:31 | |
mriedem | i think i can maybe fart around after looking through the existing tasks here http://logs.openstack.org/22/655222/9/check/nova-multi-cell/3596d01/ara-report/ | 13:32 |
mriedem | thanks | 13:33 |
*** mriedem has quit IRC | 13:33 | |
*** e0ne has joined #openstack-infra | 13:34 | |
*** Goneri has joined #openstack-infra | 13:38 | |
*** e0ne has quit IRC | 13:41 | |
*** markvoelker has joined #openstack-infra | 13:41 | |
*** ianychoi has joined #openstack-infra | 13:42 | |
*** auristor has joined #openstack-infra | 13:49 | |
*** kjackal has quit IRC | 14:05 | |
*** rascasoft has quit IRC | 14:06 | |
*** rascasoft has joined #openstack-infra | 14:08 | |
*** yamamoto has joined #openstack-infra | 14:09 | |
*** kjackal has joined #openstack-infra | 14:11 | |
*** markvoelker has quit IRC | 14:15 | |
*** bobh has joined #openstack-infra | 14:16 | |
*** yamamoto has quit IRC | 14:17 | |
*** yamamoto has joined #openstack-infra | 14:18 | |
*** bobh has quit IRC | 14:21 | |
*** kjackal has quit IRC | 14:25 | |
*** zbr|rover has quit IRC | 14:27 | |
*** zbr has joined #openstack-infra | 14:30 | |
*** slaweq has quit IRC | 14:32 | |
openstackgerrit | Sorin Sbarnea proposed openstack/diskimage-builder master: Bypass pip-and-virtualenv for later redhat distros https://review.opendev.org/656636 | 14:34 |
*** zbr is now known as zbr|rover | 14:35 | |
*** armax has joined #openstack-infra | 14:36 | |
*** efried has joined #openstack-infra | 14:37 | |
*** efried1 has joined #openstack-infra | 14:39 | |
*** jtomasek has quit IRC | 14:40 | |
*** slaweq has joined #openstack-infra | 14:41 | |
*** efried has quit IRC | 14:42 | |
fungi | i'm planning to be in the security sig bof (room 507) first today | 14:42 |
clarkb | Im going to be un 4b for the openlab session | 14:43 |
*** efried1 has quit IRC | 14:44 | |
*** mriedem has joined #openstack-infra | 14:45 | |
zbr|rover | pabelanger: hi | 14:49 |
*** dklyle has joined #openstack-infra | 14:49 | |
pabelanger | o/ | 14:52 |
corvus | mriedem: yeah copy module can work like that -- use "content" instead of "src" to use the string yaml in the value as the content of the file instead of an existing file on disk | 14:55 |
corvus | we do that in opendev to write out some simple config files | 14:55 |
corvus | er, make that "the string value in the yaml" | 14:56 |
*** e0ne has joined #openstack-infra | 14:56 | |
mriedem | corvus: thanks | 14:56 |
*** mattw4 has joined #openstack-infra | 15:01 | |
zbr|rover | pabelanger: re DIB and the fact that f28 virtualenv is messed by current version of pip-and-virtualenv element.... | 15:01 |
zbr|rover | my take on that is we cannot really perform a virtualenv install from source without messing the system version, and probably we are better off not doing in on newer platforms. | 15:02 |
pabelanger | zbr|rover: sure, understand. ianw is running point there, however as another way, without updating did, if you set that variable in your downstream nodepool.yaml, you don't even mess with source installs of pip and virtualenv, it should just ensure that the distro versions are installed | 15:03 |
pabelanger | so, that could be another way of getting virtualenv working, without having to do a DIB release and carry more code in the source-pip-and-virtual files | 15:04 |
pabelanger | zbr|rover:however, it should work on fedora-29, I use it without issues for downstream stuff too | 15:04 |
zbr|rover | pabelanger: sure, going to look now into that as it would be faster to do it this way. and we can look to sort the upstream logic later, with less pressure. | 15:04 |
zbr|rover | mainly I do not have anything against installing source versions using --user --- so they do not override the system ones. | 15:05 |
zbr|rover | the problem comes when you start to override system files (symlinks, modules,....) | 15:05 |
pabelanger | zbr|rover: yah, I know with fedora we do some special things for openstack, but at the cost of modifying OS level pip / virtualenv. But we may have to rethink that process with releae of rhel8 / centos8 and multiple system level pythons | 15:06 |
*** dims has quit IRC | 15:09 | |
*** yamamoto has quit IRC | 15:09 | |
*** e0ne has quit IRC | 15:10 | |
*** e0ne has joined #openstack-infra | 15:11 | |
*** dims has joined #openstack-infra | 15:17 | |
*** e0ne has quit IRC | 15:19 | |
*** efried has joined #openstack-infra | 15:19 | |
*** dklyle has quit IRC | 15:22 | |
zbr|rover | pabelanger: is this what you suggested? https://softwarefactory-project.io/r/#/c/15462/ | 15:22 |
pabelanger | zbr|rover: exactly | 15:24 |
pabelanger | by default DIB will do source installs | 15:24 |
*** slaweq has quit IRC | 15:30 | |
openstackgerrit | David Ames proposed openstack/project-config master: Add new Keystone SAML Mellon charm repositories https://review.opendev.org/656657 | 15:36 |
zbr|rover | pabelanger: thanks. | 15:38 |
mriedem | corvus: like this? https://review.opendev.org/#/c/656656/1/roles/setup-multi-cell-policy/tasks/main.yaml | 15:39 |
pabelanger | np | 15:39 |
* mriedem is an ansible newb | 15:39 | |
*** mriedem has quit IRC | 15:40 | |
*** e0ne has joined #openstack-infra | 15:40 | |
openstackgerrit | Nicolas Hicher proposed openstack/diskimage-builder master: openssh-server: harden sshd config https://review.opendev.org/653890 | 15:42 |
openstackgerrit | David Ames proposed openstack/project-config master: Add new Keystone SAML Mellon charm repositories https://review.opendev.org/656657 | 15:42 |
clarkb | now 505/506 to see fatih talk zuul and banking | 15:44 |
*** Lucas_Gray has joined #openstack-infra | 15:44 | |
*** bnemec has quit IRC | 15:44 | |
*** mriedem has joined #openstack-infra | 15:46 | |
*** slaweq has joined #openstack-infra | 15:49 | |
fungi | as am i | 15:50 |
*** rascasoft has quit IRC | 15:51 | |
*** yamamoto has joined #openstack-infra | 15:52 | |
*** rascasoft has joined #openstack-infra | 15:52 | |
*** gyee has joined #openstack-infra | 15:54 | |
*** bnemec has joined #openstack-infra | 15:55 | |
*** yamamoto has quit IRC | 15:56 | |
*** Lucas_Gray has quit IRC | 16:00 | |
*** noama has quit IRC | 16:02 | |
*** igordc has joined #openstack-infra | 16:02 | |
*** gmann has joined #openstack-infra | 16:12 | |
clarkb | our vexxhost sjc1 nodes are failing nodepool ssh connection checks so aren't being used | 16:14 |
clarkb | the ssh connectivity is going over ipv6 so could be related to the addition of ipv6 there | 16:14 |
clarkb | I can ping6 opendev.org so ipv6 is working there at some level | 16:16 |
*** yboaron_ has quit IRC | 16:16 | |
*** Lucas_Gray has joined #openstack-infra | 16:18 | |
*** shardy has quit IRC | 16:19 | |
*** tjgresha has joined #openstack-infra | 16:21 | |
*** jpich has quit IRC | 16:25 | |
*** e0ne has quit IRC | 16:25 | |
*** sshnaidm has joined #openstack-infra | 16:28 | |
*** rfolco has joined #openstack-infra | 16:29 | |
*** rfolco|pto has quit IRC | 16:29 | |
*** bobh has joined #openstack-infra | 16:29 | |
*** imacdonn has quit IRC | 16:30 | |
*** imacdonn has joined #openstack-infra | 16:31 | |
fungi | aspiers: when you get a break, last sentence of https://docs.openstack.org/infra/system-config/irc.html#logging is what you're looking for | 16:35 |
*** slaweq has quit IRC | 16:36 | |
fungi | after the break i'll be in 507 for diversity wg discussions the next two schedule slots | 16:37 |
*** mriedem has quit IRC | 16:38 | |
openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove barbican api-ref https://review.opendev.org/656671 | 16:38 |
*** michael-beaver has joined #openstack-infra | 16:39 | |
*** whoami-rajat has quit IRC | 16:40 | |
*** sshnaidm has quit IRC | 16:40 | |
*** bnemec has quit IRC | 16:43 | |
*** slaweq has joined #openstack-infra | 16:44 | |
*** mriedem has joined #openstack-infra | 16:45 | |
*** efried has quit IRC | 16:45 | |
*** e0ne has joined #openstack-infra | 16:54 | |
corvus | mrhillsman: lgtm | 16:57 |
corvus | mriedem: ^ ( sorry mrhillsman ) | 16:57 |
*** Wryhder has joined #openstack-infra | 16:57 | |
mriedem | thanks | 16:58 |
*** bnemec has joined #openstack-infra | 16:58 | |
*** Lucas_Gray has quit IRC | 16:59 | |
*** Wryhder is now known as Lucas_Gray | 16:59 | |
corvus | evrardjp: https://docs.opendev.org/opendev/base-jobs/latest/docker-image.html for your reading pleasure | 17:00 |
openstackgerrit | Ivan Kolodyazhny proposed openstack/reviewstats master: Add cinder-tempest-plugin repository for Cinder https://review.opendev.org/656675 | 17:01 |
*** mriedem has quit IRC | 17:04 | |
*** whoami-rajat has joined #openstack-infra | 17:06 | |
openstackgerrit | Merged zuul/nodepool master: Fix leaked loggers https://review.opendev.org/656575 | 17:09 |
*** Weifan has joined #openstack-infra | 17:11 | |
*** mattw4 has quit IRC | 17:11 | |
*** jtomasek has joined #openstack-infra | 17:11 | |
evrardjp | corvus thanks | 17:12 |
openstackgerrit | Ivan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects https://review.opendev.org/656680 | 17:13 |
*** Lucas_Gray has quit IRC | 17:16 | |
*** Weifan has quit IRC | 17:19 | |
*** igordc has quit IRC | 17:19 | |
*** e0ne has quit IRC | 17:21 | |
*** Weifan has joined #openstack-infra | 17:23 | |
*** Weifan has quit IRC | 17:24 | |
*** Weifan has joined #openstack-infra | 17:25 | |
*** bnemec has quit IRC | 17:25 | |
*** bobh has quit IRC | 17:27 | |
*** Weifan has quit IRC | 17:28 | |
kota_ | hello anyone knows how we could setup a library from master branch in github in *devstack* gate job? | 17:31 |
kota_ | for fixing py3 compatibility issue, we want to use eventlet master at github.com/eventlet/eventlet but no idea how to setup for devstack gate template. | 17:32 |
Shrews | infra-root: restarting nodepool launchers to pick up a memory leak fix | 17:33 |
clarkb | Shrews: +1 | 17:33 |
clarkb | kota_: you'll likely need to modify devstack to do that. I think it currently only knows how to install openstack libs from source | 17:33 |
clarkb | kota_: the opnstack-qa channel may be a better place to ask though | 17:34 |
Shrews | #status log Nodepool launchers restarted on commit f58a2a2b68c58f9626170795dba10b75e96cd551 to pick up memory leak fix | 17:34 |
openstackstatus | Shrews: finished logging | 17:34 |
kota_ | clarkb: i see, will try to the openstack-qa channel | 17:35 |
mordred | SotK: I believe timburke is the one who was telling us about the swift-all-in-one-with-keystone | 17:35 |
kota_ | clarkb: quick question to understand how the gate works. the devstack in the gate working under tox virtualenv? or system-wide? | 17:36 |
kota_ | ah, it might be also for #openstack-qa channel. | 17:36 |
openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Raise hacking version and fix pep8 errors https://review.opendev.org/655911 | 17:37 |
openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Raise hacking version and fix pep8 errors https://review.opendev.org/655911 | 17:38 |
*** efried has joined #openstack-infra | 17:38 | |
*** bnemec has joined #openstack-infra | 17:39 | |
*** slaweq has quit IRC | 17:40 | |
openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Add cinderlib repository for Cinder https://review.opendev.org/656682 | 17:41 |
*** slaweq has joined #openstack-infra | 17:43 | |
*** mattw4 has joined #openstack-infra | 17:49 | |
*** sshnaidm has joined #openstack-infra | 17:53 | |
*** slaweq has quit IRC | 17:54 | |
*** Weifan has joined #openstack-infra | 17:54 | |
*** dciabrin has joined #openstack-infra | 17:55 | |
*** bnemec has quit IRC | 18:03 | |
*** e0ne has joined #openstack-infra | 18:04 | |
openstackgerrit | Ivan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects https://review.opendev.org/656680 | 18:06 |
*** e0ne has quit IRC | 18:10 | |
*** e0ne has joined #openstack-infra | 18:10 | |
*** jamesmcarthur has joined #openstack-infra | 18:10 | |
mnaser | clarkb: running ping6 since yesteday | 18:16 |
mnaser | https://www.irccloud.com/pastebin/iwcCCtnt/ | 18:16 |
mnaser | what's the nodepool ip so I can try and do some troubleshooting.. maybe the problem is on the nodepool side and not our cloud? | 18:17 |
clarkb | mnaser: 2604:e100:3:0:f816:3eff:fede:2089 was an example dest ip and trying to ssh from 2001:4800:7818:104:be76:4eff:fe04:9240 | 18:21 |
clarkb | mnaser: I can ping6 opendev.org from 2001:4800:7818:104:be76:4eff:fe04:9240 | 18:21 |
*** mriedem has joined #openstack-infra | 18:21 | |
clarkb | mnaser: is it possible the hosts aren't getting RAs in a reasonable amount of time? (nodepool will retry ssh connections for some time before timing out) | 18:21 |
*** e0ne has quit IRC | 18:22 | |
*** kjackal has joined #openstack-infra | 18:22 | |
mnaser | clarkb: could be? I can double check how often we send RA's | 18:22 |
mnaser | that's a valid possibility | 18:22 |
mnaser | clarkb: do you think you can try ssh-ing into a freshly provisioned machine over ipv4? | 18:22 |
clarkb | mnaser: ya I can boot one outside of nodepool and then try to get on via ipv3 | 18:23 |
*** Goneri has quit IRC | 18:23 | |
*** e0ne has joined #openstack-infra | 18:25 | |
*** e0ne has quit IRC | 18:25 | |
clarkb | hrm not sure how to boot from volume with openstackclient | 18:27 |
clarkb | do I really have to create a volume first ? | 18:27 |
mnaser | with openstackclient... yes ;( | 18:32 |
*** dciabrin has quit IRC | 18:33 | |
clarkb | mnaser: I've booted clarkb-test in sjc1 uuid 1ac45415-c165-401e-bb1f-0fb7b93375dc | 18:35 |
clarkb | I can't hit it on ipv4 or ipv6 yet | 18:35 |
clarkb | it is possible this is an imag eproblem though the same image is working on other clouds I think | 18:35 |
clarkb | it is about 4 minute sold | 18:35 |
clarkb | (also possible that I did something wrong in the create a volume from an image then boot from it process) | 18:35 |
*** dklyle has joined #openstack-infra | 18:39 | |
mnaser | clarkb: did you want to check console logs and see what’s up with? | 18:42 |
*** jamesmcarthur has quit IRC | 18:44 | |
*** dklyle has quit IRC | 18:45 | |
clarkb | mnaser: there werent any | 18:51 |
*** jamesmcarthur has joined #openstack-infra | 18:52 | |
*** kjackal has quit IRC | 18:55 | |
*** jamesmcarthur has quit IRC | 19:02 | |
*** jamesmcarthur has joined #openstack-infra | 19:04 | |
*** sshnaidm has quit IRC | 19:05 | |
*** jamesmcarthur has quit IRC | 19:09 | |
*** jamesmcarthur has joined #openstack-infra | 19:14 | |
*** jamesmcarthur has quit IRC | 19:17 | |
*** Goneri has joined #openstack-infra | 19:18 | |
*** jamesmcarthur has joined #openstack-infra | 19:19 | |
*** ijw has joined #openstack-infra | 19:21 | |
*** ijw has quit IRC | 19:25 | |
*** ijw has joined #openstack-infra | 19:26 | |
*** mriedem has quit IRC | 19:29 | |
*** ijw has quit IRC | 19:30 | |
*** dciabrin has joined #openstack-infra | 19:32 | |
*** e0ne has joined #openstack-infra | 19:36 | |
clarkb | mnaser: ya no console log and no networking. So either I didn't do boot from volume properly, our image is broken, or the hypervisor is sad? | 19:36 |
mnaser | clarkb: I am heading back to venue (in an Uber now :)) and I’ll check this out. Surprised console log shows nothing | 19:37 |
*** efried has quit IRC | 19:38 | |
clarkb | mnaser: ya it exits 0 with no output on stderr or stdout | 19:38 |
*** ramishra has joined #openstack-infra | 19:39 | |
openstackgerrit | Ivan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects https://review.opendev.org/656680 | 19:42 |
*** dklyle has joined #openstack-infra | 19:42 | |
*** ramishra has quit IRC | 19:45 | |
*** bnemec has joined #openstack-infra | 19:47 | |
*** markvoelker has joined #openstack-infra | 20:00 | |
*** efried has joined #openstack-infra | 20:02 | |
mnaser | clarkb: hmm https://usercontent.irccloud-cdn.com/file/7LCNdYxE/image.png | 20:03 |
clarkb | mnaser: ok so good chance I did boot from volume wrong | 20:04 |
clarkb | I created a volume with the --image flag then did server create --volume that-volume | 20:04 |
mnaser | that seems right | 20:05 |
mnaser | im gonna try to see a node pool booted vm | 20:06 |
clarkb | do I need to set a flag to make it a bootable volume? | 20:06 |
mnaser | I just found an arbitrarily booted vm by nodepool | 20:06 |
mnaser | 38.108.68.208 | 20:06 |
mnaser | pingable over ipv4 | 20:06 |
mnaser | wanna check if it has ipv6? | 20:07 |
clarkb | that one has come up | 20:08 |
fungi | yeah, 2604:e100:3:0:f816:3eff:fe86:22ec is reachable for me | 20:08 |
clarkb | 2604:e100:3:0:f816:3eff:fe86:22ec/64 is its address and I can telnet to port 22 | 20:08 |
fungi | i can ssh in | 20:08 |
mnaser | I was just trying to arbitrarily pick one that seems to be failing somehow and we can login and see what happens there | 20:08 |
clarkb | ok here is a thing looking at logs it seems to be xenial not bionic? | 20:09 |
clarkb | so maybe there is something wrong with our image? | 20:09 |
mnaser | so maybe the bionic image was borked? | 20:09 |
clarkb | s/bionic/xenial/ but ya | 20:10 |
mnaser | ah yes | 20:10 |
clarkb | let me look at hashes | 20:10 |
*** markvoelker has quit IRC | 20:12 | |
clarkb | hrm ya the checksums we have in nb02.openstack.org:/opt/nodepool_dib don't match what glance reports | 20:13 |
clarkb | I thoguth we provided the checksum on upload and glance is supposed to error if they don't match? | 20:13 |
clarkb | fungi: can you cross check ^ that for me just to make sure I'm not crazy? | 20:13 |
clarkb | but if that is the case maybe we delete the image and see if a new upload is happier? | 20:14 |
clarkb | oh ya its size is totally off too | 20:16 |
*** bnemec has quit IRC | 20:16 | |
clarkb | we've also filled the disk on nb01 | 20:17 |
clarkb | I'm going to delete the image in sjc1 and that should force a reupload iirc | 20:18 |
fungi | looking now... been handling a private request to redact something from mailing list archives | 20:26 |
*** slaweq has joined #openstack-infra | 20:27 | |
fungi | clarkb: recent nova is supposed to check glance checksums before booting, but i think cinder does not yet | 20:28 |
clarkb | fungi: the issue was the image in glance was smaller tha ehat we had on disk and a different checksum | 20:28 |
fungi | #status log redacted a phone number from posts to the women-of-openstack mailing list in response to a forwarded private request | 20:29 |
clarkb | I would expect glance to check the checksum we provide against what it received but doesnt appear to | 20:29 |
openstackstatus | fungi: finished logging | 20:29 |
fungi | clarkb: that may be an optimization to consider for the sdk? | 20:29 |
clarkb | in any case nodepool should be deleting that bad jmage and switching to the older one | 20:29 |
fungi | as in, make sure glance reports the expected checksum for what i think i uploaded | 20:29 |
corvus | i had a vague idea that the checksums were just used by the sdk to determine whether an image was changed? | 20:30 |
*** Goneri has quit IRC | 20:36 | |
*** pcaruana has quit IRC | 20:42 | |
*** dklyle has quit IRC | 20:44 | |
*** Lucas_Gray has joined #openstack-infra | 20:45 | |
*** e0ne has quit IRC | 20:47 | |
*** Goneri has joined #openstack-infra | 20:49 | |
*** rcernin has quit IRC | 20:53 | |
*** dklyle has joined #openstack-infra | 20:53 | |
*** jtomasek has quit IRC | 20:54 | |
*** jamesmcarthur has quit IRC | 20:57 | |
*** dklyle has quit IRC | 20:59 | |
*** efried has quit IRC | 21:01 | |
*** dciabrin has quit IRC | 21:06 | |
*** dciabrin has joined #openstack-infra | 21:06 | |
*** dciabrin has quit IRC | 21:13 | |
*** jamesmcarthur has joined #openstack-infra | 21:14 | |
*** slaweq has quit IRC | 21:15 | |
*** sthussey has joined #openstack-infra | 21:22 | |
*** ijw has joined #openstack-infra | 21:24 | |
*** mriedem has joined #openstack-infra | 21:26 | |
*** e0ne has joined #openstack-infra | 21:32 | |
*** bnemec has joined #openstack-infra | 21:32 | |
*** dklyle has joined #openstack-infra | 21:34 | |
*** e0ne has quit IRC | 21:34 | |
*** ijw has quit IRC | 21:34 | |
*** ijw has joined #openstack-infra | 21:35 | |
*** e0ne has joined #openstack-infra | 21:39 | |
*** ijw has quit IRC | 21:39 | |
*** e0ne has quit IRC | 21:47 | |
*** dklyle has quit IRC | 21:50 | |
*** jamesmcarthur has quit IRC | 21:51 | |
*** jamesmcarthur has joined #openstack-infra | 21:52 | |
*** dklyle has joined #openstack-infra | 21:56 | |
*** rfarr has quit IRC | 21:57 | |
*** jamesmcarthur has quit IRC | 21:57 | |
*** jamesmcarthur has joined #openstack-infra | 21:59 | |
*** e0ne has joined #openstack-infra | 22:03 | |
*** mriedem has quit IRC | 22:04 | |
*** dklyle has quit IRC | 22:06 | |
*** rh-jelabarre has quit IRC | 22:06 | |
*** bnemec has quit IRC | 22:07 | |
*** slaweq has joined #openstack-infra | 22:09 | |
*** efried has joined #openstack-infra | 22:13 | |
*** rlandy is now known as rlandy|bbl | 22:18 | |
*** whoami-rajat has quit IRC | 22:20 | |
*** tjgresha_nope has joined #openstack-infra | 22:22 | |
*** tjgresha has quit IRC | 22:25 | |
*** jamesmcarthur has quit IRC | 22:30 | |
*** kei-ichi has joined #openstack-infra | 22:33 | |
*** e0ne has quit IRC | 22:34 | |
*** dklyle has joined #openstack-infra | 22:36 | |
*** Goneri has quit IRC | 22:41 | |
*** dklyle has quit IRC | 22:42 | |
*** slaweq has quit IRC | 22:44 | |
fungi | infra(/opendev?) project update starting now | 22:45 |
*** dciabrin has joined #openstack-infra | 22:51 | |
*** samueldmq has joined #openstack-infra | 22:53 | |
*** slaweq has joined #openstack-infra | 22:54 | |
*** mriedem has joined #openstack-infra | 22:58 | |
*** bnemec has joined #openstack-infra | 22:59 | |
*** Weifan has quit IRC | 23:01 | |
*** lmiccini has quit IRC | 23:01 | |
mriedem | corvus: btw that copy task worked, thanks again | 23:01 |
fungi | that's excellent news | 23:02 |
*** Weifan has joined #openstack-infra | 23:02 | |
*** bdodd has quit IRC | 23:04 | |
*** efried has quit IRC | 23:05 | |
*** slaweq has quit IRC | 23:07 | |
*** lmiccini has joined #openstack-infra | 23:08 | |
*** aaronsheffield has quit IRC | 23:09 | |
*** Lucas_Gray has quit IRC | 23:09 | |
*** rcernin has joined #openstack-infra | 23:10 | |
*** bnemec has quit IRC | 23:11 | |
*** e0ne has joined #openstack-infra | 23:11 | |
clarkb | remote: https://review.opendev.org/656719 Fixes for the Denver 2019 project update | 23:12 |
*** dklyle has joined #openstack-infra | 23:13 | |
*** yamamoto has joined #openstack-infra | 23:18 | |
fungi | we ought to switch to a wildcard branch match for the opendev/publications repo in gerritbot | 23:24 |
clarkb | fungi: I have that change up thought it needs work after renames | 23:25 |
clarkb | s/thought/though/ | 23:25 |
fungi | aha, then i shall endeavor to just find yours and not duplicate that effort | 23:29 |
fungi | but maybe not until after dinner | 23:29 |
*** bnemec has joined #openstack-infra | 23:33 | |
*** e0ne has quit IRC | 23:38 | |
*** dklyle has quit IRC | 23:39 | |
*** Weifan has quit IRC | 23:39 | |
*** betherly has quit IRC | 23:46 | |
*** mriedem has quit IRC | 23:48 | |
*** gyee has quit IRC | 23:49 | |
paladox | btw https://bugs.chromium.org/p/gerrit/issues/detail?id=10381 is the issue i opened fungi clarkb corvus | 23:54 |
*** bnemec has quit IRC | 23:54 | |
*** betherly has joined #openstack-infra | 23:56 | |
fungi | neat! maybe we won 't have to abandon using the /p/ urls then | 23:56 |
paladox | that issue's been open for a while :) | 23:56 |
paladox | though i did ask one of the maintainers about it in a pm. | 23:57 |
paladox | so he may look at it next week (he said) | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!