| *** ddieterly has quit IRC | 00:02 | |
| *** zhurong has quit IRC | 00:06 | |
| *** vikasc has joined #openstack-infra | 00:08 | |
| *** thorst has joined #openstack-infra | 00:13 | |
| *** dingyichen has joined #openstack-infra | 00:16 | |
| *** thorst has quit IRC | 00:17 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Remove lbaas v1 jobs from neutron-lbaas https://review.openstack.org/358245 | 00:19 |
|---|---|---|
| openstackgerrit | Tony Breeds proposed openstack-infra/release-tools: Do not abort if README file not found https://review.openstack.org/358360 | 00:19 |
| *** thorst has joined #openstack-infra | 00:21 | |
| *** thorst_ has joined #openstack-infra | 00:23 | |
| *** thorst has quit IRC | 00:26 | |
| *** shashank_hegde has joined #openstack-infra | 00:28 | |
| prometheanfire | lifeless mordred jeblair: https://bugs.launchpad.net/vitrage/+bug/1612352 in reguards to a agpl lib used in testing | 00:38 |
| openstack | Launchpad bug 1612352 in Vitrage "exrex missing from global-requirements and upper-constraints" [Undecided,New] | 00:38 |
| prometheanfire | lifeless mordred jeblair: vitrage doesn't seem responsive to me about this though :( | 00:39 |
| prometheanfire | tonyb: ^ | 00:39 |
| prometheanfire | personally I think it's fine to add to have as it's just test-requirements, but I don't want to add it to requirements myself as I am not a member of the vitrage project | 00:40 |
| mordred | prometheanfire: I agree, I think looking at it that it's fine ... although it might make the test cases that use it need to be GPL/AGPL - but those are still test cases and not application code itself | 00:41 |
| prometheanfire | right | 00:42 |
| mordred | prometheanfire: I think your suggestion of a question to legal-discuss@ is right on | 00:42 |
| prometheanfire | right now I can't get any response from that team | 00:42 |
| prometheanfire | I feel like I should remove them from projects.txt until they respond | 00:42 |
| mordred | ttx: ^^ when you wake up, any chance you have a contact from the vitrage team? | 00:42 |
| prometheanfire | also https://github.com/asciimoo/exrex/issues/16 | 00:43 |
| mordred | heh. I'd imagine that to be a wontfix ... but you never know | 00:43 |
| prometheanfire | true, just pointing out that it exists | 00:44 |
| tonyb | prometheanfire: uplaod a review dropping vitrage from projects.txt and add the PTL as a reviewer. | 00:44 |
| prometheanfire | k | 00:44 |
| tonyb | prometheanfire: we can reach out directly and then make a decision in a week or so | 00:44 |
| prometheanfire | ya | 00:44 |
| mordred | (as a person who gpl's the things he writes by default on purpose, I know I would close such a bug as wontfix myself, but one never knows what people's motivations are) | 00:44 |
| tonyb | prometheanfire: Thanks for checking those update failures. | 00:45 |
| tonyb | prometheanfire: we might want to consider a m/l similar to release-job-failures | 00:45 |
| mordred | ++ | 00:45 |
| prometheanfire | it's them and solum-web-ui (or something like that) that are failing at this point | 00:45 |
| prometheanfire | solum I emailed an interal racker on the team to fix, will bug tomorrow about it | 00:46 |
| prometheanfire | tonyb: mind if I cc you on that too? | 00:46 |
| prometheanfire | should probably track that in a bug though | 00:46 |
| tonyb | prometheanfire: go for it | 00:46 |
| *** gildub has quit IRC | 00:47 | |
| tonyb | prometheanfire: Yeah keep it as public as possible there aren't any trade secrets here ;P | 00:47 |
| prometheanfire | ya, it was just a mater of someone knowing who to contact | 00:48 |
| tonyb | that looks like a cool library. I wonder if there is a more (license) compatible option ? | 00:48 |
| *** sputnik13 has joined #openstack-infra | 00:55 | |
| *** sputnik13 has quit IRC | 00:56 | |
| *** sputnik13 has joined #openstack-infra | 00:56 | |
| openstackgerrit | Merged openstack-infra/shade: Stop getting extra flavor specs where they're useless https://review.openstack.org/355252 | 00:58 |
| openstackgerrit | Merged openstack-infra/shade: Change deprecated assertEquals to assertEqual https://review.openstack.org/358260 | 00:58 |
| *** gildub has joined #openstack-infra | 00:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:59 | |
| *** markvoelker has joined #openstack-infra | 00:59 | |
| prometheanfire | mordred: do you happen to have a link to a recent release-job failure? | 01:01 |
| *** ddieterly has joined #openstack-infra | 01:02 | |
| prometheanfire | mordred: want to make sure it's just those two projects | 01:04 |
| *** markvoelker has quit IRC | 01:04 | |
| *** fguillot has joined #openstack-infra | 01:05 | |
| *** salv-orlando has joined #openstack-infra | 01:06 | |
| *** salv-orlando has quit IRC | 01:08 | |
| *** sputnik13 has quit IRC | 01:09 | |
| *** sputnik13 has joined #openstack-infra | 01:12 | |
| *** zhurong has joined #openstack-infra | 01:13 | |
| mordred | prometheanfire: I don't, sorry | 01:13 |
| prometheanfire | np | 01:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow image and flavor by name for create_server https://review.openstack.org/355251 | 01:17 |
| *** JerryOpenix has joined #openstack-infra | 01:21 | |
| *** yanyanhu has joined #openstack-infra | 01:24 | |
| *** sputnik13 has quit IRC | 01:32 | |
| *** gouthamr has quit IRC | 01:35 | |
| *** ddieterly has quit IRC | 01:35 | |
| *** kzaitsev_mb has quit IRC | 01:36 | |
| *** ddieterly has joined #openstack-infra | 01:36 | |
| *** thorst_ has quit IRC | 01:37 | |
| *** nwkarsten has joined #openstack-infra | 01:40 | |
| *** ramishra has joined #openstack-infra | 01:48 | |
| *** mmedvede_ has joined #openstack-infra | 01:54 | |
| openstackgerrit | Merged openstack-infra/shade: Get the status of the ip with ip.get('status') https://review.openstack.org/256025 | 01:58 |
| *** ddieterly is now known as ddieterly[away] | 02:01 | |
| *** ddieterly[away] is now known as ddieterly | 02:03 | |
| *** yamamoto_ has joined #openstack-infra | 02:05 | |
| *** baoli has joined #openstack-infra | 02:07 | |
| *** thorst has joined #openstack-infra | 02:11 | |
| *** thorst has quit IRC | 02:11 | |
| *** thorst has joined #openstack-infra | 02:12 | |
| *** ddieterly has quit IRC | 02:13 | |
| *** salv-orlando has joined #openstack-infra | 02:16 | |
| *** salv-orlando has quit IRC | 02:19 | |
| *** thorst has quit IRC | 02:20 | |
| *** Jeffrey4l has joined #openstack-infra | 02:24 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:32 | |
| *** csmart has quit IRC | 02:33 | |
| *** csmart has joined #openstack-infra | 02:35 | |
| *** kzaitsev_mb has quit IRC | 02:37 | |
| *** yuanying has quit IRC | 02:46 | |
| *** yuanying has joined #openstack-infra | 02:50 | |
| *** jcoufal has joined #openstack-infra | 02:51 | |
| *** baoli has quit IRC | 02:55 | |
| *** fguillot has quit IRC | 02:58 | |
| *** baoli has joined #openstack-infra | 02:59 | |
| *** baoli has quit IRC | 02:59 | |
| *** tqtran has joined #openstack-infra | 03:02 | |
| *** tqtran has quit IRC | 03:06 | |
| *** gouthamr has joined #openstack-infra | 03:07 | |
| *** krtaylor has quit IRC | 03:10 | |
| *** baoli has joined #openstack-infra | 03:12 | |
| *** jcoufal has quit IRC | 03:16 | |
| *** baoli has quit IRC | 03:16 | |
| *** jcoufal has joined #openstack-infra | 03:18 | |
| *** thorst has joined #openstack-infra | 03:18 | |
| *** jcoufal has quit IRC | 03:20 | |
| *** thorst has quit IRC | 03:26 | |
| *** salv-orlando has joined #openstack-infra | 03:26 | |
| *** julim has quit IRC | 03:27 | |
| *** sdague has quit IRC | 03:32 | |
| ianw | pabelanger: dunno what's up with todays f24 build. can't replicate. mirror failure perhaps hidden by output capture of pkg-installs is about my best bet | 03:33 |
| *** salv-orlando has quit IRC | 03:33 | |
| *** nwkarsten has quit IRC | 03:34 | |
| *** vikrant has joined #openstack-infra | 03:39 | |
| *** kushal has joined #openstack-infra | 03:43 | |
| *** yuanying has quit IRC | 03:45 | |
| *** yuanying has joined #openstack-infra | 03:48 | |
| *** amitgandhinz has quit IRC | 03:52 | |
| *** yamahata has quit IRC | 04:05 | |
| *** gildub has quit IRC | 04:05 | |
| *** gouthamr has quit IRC | 04:11 | |
| *** icey|vacation has quit IRC | 04:17 | |
| *** nwkarsten has joined #openstack-infra | 04:17 | |
| *** thorst has joined #openstack-infra | 04:25 | |
| *** nwkarsten has quit IRC | 04:28 | |
| *** thorst has quit IRC | 04:30 | |
| *** salv-orlando has joined #openstack-infra | 04:36 | |
| *** david-lyle has quit IRC | 04:37 | |
| *** sarob has quit IRC | 04:40 | |
| *** ManishD has joined #openstack-infra | 04:41 | |
| ManishD | HI, I see Xen CI failure for various patches on review board with the following error: tempest.exceptions.TimeoutException: Request timed out | 04:41 |
| ManishD | Appears issue with Xen infra, can someone help or take care of it | 04:41 |
| ManishD | Its afecting many patches | 04:41 |
| *** eranrom has quit IRC | 04:43 | |
| *** salv-orlando has quit IRC | 04:43 | |
| *** abregman has joined #openstack-infra | 04:46 | |
| *** krtaylor has joined #openstack-infra | 04:50 | |
| *** pcaruana has quit IRC | 04:55 | |
| *** nwkarsten has joined #openstack-infra | 04:55 | |
| *** pgadiya has joined #openstack-infra | 04:59 | |
| *** nwkarsten has quit IRC | 05:02 | |
| *** zz_dimtruck is now known as dimtruck | 05:02 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use separated SSL endpoint environment file https://review.openstack.org/356488 | 05:05 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Inject CA certificate via service profile https://review.openstack.org/357791 | 05:05 |
| *** nwkarsten has joined #openstack-infra | 05:06 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Pass TRIPLEO_ROOT directory to heat_deploy_times.sh https://review.openstack.org/356946 | 05:07 |
| *** amotoki has joined #openstack-infra | 05:11 | |
| *** jamielennox is now known as jamielennox|away | 05:18 | |
| *** yamahata has joined #openstack-infra | 05:18 | |
| *** jaosorior has joined #openstack-infra | 05:23 | |
| *** thorst has joined #openstack-infra | 05:27 | |
| *** jtomasek has joined #openstack-infra | 05:28 | |
| *** thorst has quit IRC | 05:36 | |
| *** links has joined #openstack-infra | 05:38 | |
| *** links has quit IRC | 05:38 | |
| *** dabukalam has quit IRC | 05:39 | |
| *** dabukalam has joined #openstack-infra | 05:39 | |
| *** oanson has joined #openstack-infra | 05:40 | |
| *** megm has quit IRC | 05:42 | |
| *** megm has joined #openstack-infra | 05:44 | |
| *** cloudnull has quit IRC | 05:46 | |
| *** irtermite has quit IRC | 05:46 | |
| *** sigmavirus has quit IRC | 05:46 | |
| *** d34dh0r53 has quit IRC | 05:46 | |
| *** eglute has quit IRC | 05:46 | |
| *** salv-orlando has joined #openstack-infra | 05:46 | |
| *** r-mibu has quit IRC | 05:47 | |
| *** eglute has joined #openstack-infra | 05:47 | |
| *** d34dh0r53 has joined #openstack-infra | 05:48 | |
| *** d34dh0r53 has quit IRC | 05:48 | |
| *** eglute has quit IRC | 05:48 | |
| *** baoli has joined #openstack-infra | 05:49 | |
| *** eglute has joined #openstack-infra | 05:49 | |
| *** eglute has quit IRC | 05:49 | |
| *** amitgandhinz has joined #openstack-infra | 05:49 | |
| *** eglute has joined #openstack-infra | 05:50 | |
| *** d34dh0r53 has joined #openstack-infra | 05:51 | |
| *** eglute has quit IRC | 05:51 | |
| *** d34dh0r53 has quit IRC | 05:51 | |
| *** r-mibu has joined #openstack-infra | 05:52 | |
| *** baoli has quit IRC | 05:53 | |
| *** salv-orlando has quit IRC | 05:54 | |
| *** eglute has joined #openstack-infra | 05:54 | |
| *** eglute has quit IRC | 05:54 | |
| *** amitgandhinz has quit IRC | 05:55 | |
| *** caowei has joined #openstack-infra | 05:58 | |
| *** florianf has joined #openstack-infra | 06:00 | |
| *** senk has joined #openstack-infra | 06:01 | |
| *** pt_15 has joined #openstack-infra | 06:03 | |
| *** eglute has joined #openstack-infra | 06:05 | |
| *** d34dh0r53 has joined #openstack-infra | 06:06 | |
| *** salv-orlando has joined #openstack-infra | 06:07 | |
| *** cloudnull has joined #openstack-infra | 06:07 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add check-requirements to openstack-ansible-specs https://review.openstack.org/358411 | 06:08 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add check-requirements to openstack-ansible-specs https://review.openstack.org/358411 | 06:09 |
| *** nwkarsten has quit IRC | 06:09 | |
| *** gnuoy` is now known as gnuoy | 06:13 | |
| *** _coolsvap_ has joined #openstack-infra | 06:15 | |
| *** _coolsvap_ is now known as coolsvap | 06:15 | |
| *** coolsvap has quit IRC | 06:16 | |
| *** coolsvap has joined #openstack-infra | 06:16 | |
| *** baoli has joined #openstack-infra | 06:16 | |
| *** baoli has quit IRC | 06:16 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: add post-send script option https://review.openstack.org/355135 | 06:16 |
| *** slaweq_ has joined #openstack-infra | 06:25 | |
| *** dimtruck is now known as zz_dimtruck | 06:27 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:35 | |
| *** thorst has joined #openstack-infra | 06:35 | |
| yolanda | good morning | 06:37 |
| *** kzaitsev_mb has quit IRC | 06:40 | |
| SamYaple | morning | 06:40 |
| *** thorst has quit IRC | 06:41 | |
| *** sarob has joined #openstack-infra | 06:41 | |
| *** Apoorva has joined #openstack-infra | 06:41 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: switch to python-db-jobs https://review.openstack.org/335551 | 06:42 |
| *** dizquierdo has joined #openstack-infra | 06:45 | |
| *** sarob has quit IRC | 06:46 | |
| *** esikachev has joined #openstack-infra | 06:47 | |
| *** kushal has quit IRC | 06:50 | |
| *** ganesan has joined #openstack-infra | 06:51 | |
| *** rcernin has joined #openstack-infra | 06:51 | |
| *** pcaruana has joined #openstack-infra | 06:52 | |
| *** amitgandhinz has joined #openstack-infra | 06:52 | |
| *** Apoorva has quit IRC | 06:52 | |
| *** dfflanders has joined #openstack-infra | 06:54 | |
| *** matbu|afk is now known as matbu | 06:54 | |
| *** amitgandhinz has quit IRC | 06:56 | |
| *** rwsu has joined #openstack-infra | 06:58 | |
| *** Na3iL has joined #openstack-infra | 06:58 | |
| *** andreas_s has joined #openstack-infra | 06:59 | |
| *** kdas__ has joined #openstack-infra | 07:01 | |
| openstackgerrit | Merged openstack-infra/project-config: Glare https://review.openstack.org/352519 | 07:01 |
| openstackgerrit | Merged openstack-infra/project-config: Skip functional-magnum-k8s/swarm-ironic job https://review.openstack.org/357658 | 07:04 |
| *** ManishD has quit IRC | 07:05 | |
| *** zhurong has quit IRC | 07:09 | |
| *** tesseract- has joined #openstack-infra | 07:09 | |
| *** ganesan has quit IRC | 07:10 | |
| *** nwkarsten has joined #openstack-infra | 07:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix skipping files for magnum functional jobs https://review.openstack.org/357659 | 07:12 |
| openstackgerrit | Merged openstack-infra/project-config: Add networking-odl for grafana dashboard https://review.openstack.org/353226 | 07:13 |
| openstackgerrit | Merged openstack-infra/project-config: Add lib-forward-testing to os-client-config and osc-lib https://review.openstack.org/355052 | 07:13 |
| openstackgerrit | Merged openstack-infra/project-config: Remove lbaas v1 jobs from neutron-lbaas https://review.openstack.org/358245 | 07:13 |
| openstackgerrit | Merged openstack-infra/project-config: Enable QoS on neutron for python-openstacksdk. https://review.openstack.org/357230 | 07:13 |
| openstackgerrit | Merged openstack-infra/project-config: Remove Neutron tests from Monasca job https://review.openstack.org/357969 | 07:13 |
| openstackgerrit | Merged openstack-infra/project-config: Make gate-tempest-dsvm-multinode-live-migration gating for nova https://review.openstack.org/356043 | 07:13 |
| *** zhurong has joined #openstack-infra | 07:13 | |
| openstackgerrit | Merged openstack-infra/project-config: Make gate-neutron-dynamic-routing-dsvm-functional voting. https://review.openstack.org/357980 | 07:13 |
| *** nwkarsten has quit IRC | 07:14 | |
| *** salv-orl_ has joined #openstack-infra | 07:15 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable Ubuntu binary deployment for Kolla on master https://review.openstack.org/358253 | 07:16 |
| *** salv-orlando has quit IRC | 07:18 | |
| *** vincentll has joined #openstack-infra | 07:18 | |
| *** mkoderer__ has quit IRC | 07:19 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-refstack: Fix lint error on puppet-refstack https://review.openstack.org/358444 | 07:21 |
| openstackgerrit | Merged openstack-infra/project-config: setup translation job for keystonemiddleware https://review.openstack.org/357949 | 07:21 |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo in the pypi-extract-name.py https://review.openstack.org/355692 | 07:22 |
| *** shashank_hegde has quit IRC | 07:22 | |
| openstackgerrit | kyle liu proposed openstack-infra/project-config: Add new project networking-zte https://review.openstack.org/355278 | 07:23 |
| *** _nadya_ has joined #openstack-infra | 07:25 | |
| *** rcernin has quit IRC | 07:25 | |
| *** _nadya_ has quit IRC | 07:25 | |
| *** _nadya_ has joined #openstack-infra | 07:25 | |
| *** ganesan has joined #openstack-infra | 07:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Add held nodes to singlestat for nodepool dashboard https://review.openstack.org/354843 | 07:26 |
| openstackgerrit | Merged openstack-infra/project-config: designate: Add a non-voting job with postgres as DB backend https://review.openstack.org/354141 | 07:26 |
| *** Na3iL has quit IRC | 07:26 | |
| openstackgerrit | Merged openstack-infra/puppet-askbot: Add explicit configuration support for Akismet https://review.openstack.org/347020 | 07:27 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove DocBook XML publishing for trove https://review.openstack.org/358446 | 07:27 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 07:28 |
| *** jpich has joined #openstack-infra | 07:30 | |
| *** abregman_ has joined #openstack-infra | 07:30 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove DocBook XML publishing for trove https://review.openstack.org/358446 | 07:31 |
| *** vinaypotluri has quit IRC | 07:31 | |
| *** abregman has quit IRC | 07:32 | |
| *** salv-orl_ has quit IRC | 07:32 | |
| *** berendt has joined #openstack-infra | 07:33 | |
| *** shashank_hegde has joined #openstack-infra | 07:33 | |
| *** DrifterZA has joined #openstack-infra | 07:34 | |
| *** kdas__ has quit IRC | 07:36 | |
| *** dtardivel has joined #openstack-infra | 07:36 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:37 | |
| *** hichihara has quit IRC | 07:38 | |
| *** abregman_ has quit IRC | 07:38 | |
| *** thorst has joined #openstack-infra | 07:39 | |
| *** kzaitsev_mb has quit IRC | 07:41 | |
| *** shashank_hegde has quit IRC | 07:42 | |
| *** hashar has joined #openstack-infra | 07:42 | |
| *** itisha has joined #openstack-infra | 07:43 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Add networking-cumulus project https://review.openstack.org/354784 | 07:45 |
| *** thorst has quit IRC | 07:46 | |
| *** yaume has joined #openstack-infra | 07:46 | |
| *** dizquierdo has quit IRC | 07:46 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add check-requirements to openstack-ansible-specs https://review.openstack.org/358411 | 07:47 |
| *** esikachev has quit IRC | 07:48 | |
| *** JerryOpenix has quit IRC | 07:48 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add ceph_client and haproxy_server repositories to OSA https://review.openstack.org/358333 | 07:49 |
| *** matthewbodkin has joined #openstack-infra | 07:50 | |
| *** pilgrimstack has joined #openstack-infra | 07:50 | |
| *** abregman_ has joined #openstack-infra | 07:51 | |
| *** ganesan has quit IRC | 07:52 | |
| *** amitgandhinz has joined #openstack-infra | 07:52 | |
| *** yaume has quit IRC | 07:53 | |
| *** kushal has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack-dev/pbr: Change assertTrue(isinstance()) by optimal assert https://review.openstack.org/357569 | 07:53 |
| *** yaume has joined #openstack-infra | 07:53 | |
| *** eranrom has joined #openstack-infra | 07:53 | |
| *** yaume_ has joined #openstack-infra | 07:54 | |
| *** yaume has quit IRC | 07:55 | |
| *** ifarkas_afk is now known as ifarkas | 07:56 | |
| *** amitgandhinz has quit IRC | 07:58 | |
| *** ccamacho has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** esikachev has joined #openstack-infra | 08:04 | |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Fix neutron failure rates dashboard integrated jobs list https://review.openstack.org/358462 | 08:04 |
| *** asettle has joined #openstack-infra | 08:05 | |
| *** markvoelker has joined #openstack-infra | 08:05 | |
| *** matrohon has joined #openstack-infra | 08:06 | |
| Krenair | should I file a bug about designate-dashboard tests being broken? | 08:07 |
| *** hferenc has joined #openstack-infra | 08:08 | |
| *** ihrachys has joined #openstack-infra | 08:09 | |
| Krenair | they've succeeded twice over ten runs | 08:09 |
| *** mlekkas_ has joined #openstack-infra | 08:09 | |
| *** eranrom has quit IRC | 08:09 | |
| *** markvoelker has quit IRC | 08:10 | |
| *** nwkarsten has joined #openstack-infra | 08:11 | |
| *** ihrachys has quit IRC | 08:12 | |
| *** salv-orlando has joined #openstack-infra | 08:14 | |
| *** Na3iL has joined #openstack-infra | 08:15 | |
| *** nwkarsten has quit IRC | 08:16 | |
| *** derekh has joined #openstack-infra | 08:16 | |
| *** yamamoto_ has quit IRC | 08:17 | |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: net-bgpvpn : move tempest tests to the gate queue https://review.openstack.org/352401 | 08:17 |
| *** coolsvap is now known as _coolsvap_ | 08:18 | |
| *** yamamoto_ has joined #openstack-infra | 08:18 | |
| *** ihrachys has joined #openstack-infra | 08:20 | |
| *** yamamoto_ has quit IRC | 08:23 | |
| *** yaume has joined #openstack-infra | 08:23 | |
| *** mfedosin has joined #openstack-infra | 08:24 | |
| *** eranrom has joined #openstack-infra | 08:25 | |
| *** vincentll has quit IRC | 08:26 | |
| *** yaume_ has quit IRC | 08:27 | |
| *** asettle has quit IRC | 08:27 | |
| *** vincentll has joined #openstack-infra | 08:28 | |
| *** eranrom has quit IRC | 08:29 | |
| *** jaosorior has quit IRC | 08:30 | |
| *** jaosorior has joined #openstack-infra | 08:31 | |
| *** bethwhite_ has joined #openstack-infra | 08:31 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove support for legacy rh1 https://review.openstack.org/347918 | 08:33 |
| *** lucas-afk is now known as lucasagomes | 08:34 | |
| *** yuanying has quit IRC | 08:34 | |
| *** yuanying has joined #openstack-infra | 08:35 | |
| *** asettle has joined #openstack-infra | 08:35 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:37 | |
| *** DrifterZA has quit IRC | 08:41 | |
| *** DrifterZA has joined #openstack-infra | 08:42 | |
| *** kzaitsev_mb has quit IRC | 08:42 | |
| *** thorst has joined #openstack-infra | 08:44 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/358478 | 08:45 |
| *** dingyichen has quit IRC | 08:45 | |
| *** huanxie has joined #openstack-infra | 08:46 | |
| *** yuanying has quit IRC | 08:47 | |
| *** sarob has joined #openstack-infra | 08:47 | |
| *** yuanying has joined #openstack-infra | 08:49 | |
| *** Goneri has joined #openstack-infra | 08:51 | |
| *** thorst has quit IRC | 08:51 | |
| *** hashar has quit IRC | 08:52 | |
| *** pgadiya has quit IRC | 08:52 | |
| *** sarob has quit IRC | 08:52 | |
| *** amitgandhinz has joined #openstack-infra | 08:53 | |
| *** hashar has joined #openstack-infra | 08:54 | |
| *** amitgandhinz has quit IRC | 08:58 | |
| openstackgerrit | Ananth Narayan S proposed openstack-infra/project-config: Add new project RSC to openstack repo https://review.openstack.org/341966 | 08:59 |
| *** baoli has joined #openstack-infra | 09:00 | |
| *** ihrachys has quit IRC | 09:00 | |
| *** chem``` is now known as chem | 09:01 | |
| *** chem has quit IRC | 09:02 | |
| *** chem has joined #openstack-infra | 09:02 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute021.vanilla IP addresses https://review.openstack.org/358490 | 09:04 |
| *** ihrachys has joined #openstack-infra | 09:05 | |
| *** mfedosin has quit IRC | 09:05 | |
| *** aarefiev_ is now known as aarefiev | 09:06 | |
| *** pgadiya has joined #openstack-infra | 09:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:06 | |
| *** baoli has quit IRC | 09:06 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 09:06 |
| *** markvoelker has joined #openstack-infra | 09:06 | |
| *** tqtran has joined #openstack-infra | 09:06 | |
| *** yamahata has quit IRC | 09:07 | |
| *** ihrachys has quit IRC | 09:09 | |
| *** markvoelker has quit IRC | 09:11 | |
| *** tqtran has quit IRC | 09:11 | |
| *** ihrachys has joined #openstack-infra | 09:11 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute022.vanilla IP addresses and enable node https://review.openstack.org/358495 | 09:12 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute021.vanilla IP addresses https://review.openstack.org/358490 | 09:12 |
| *** nwkarsten has joined #openstack-infra | 09:12 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute023.vanilla IP addresses https://review.openstack.org/358497 | 09:14 |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: net-bgpvpn : move tempest tests to the gate queue https://review.openstack.org/352401 | 09:16 |
| *** nwkarsten has quit IRC | 09:17 | |
| *** pgadiya has quit IRC | 09:18 | |
| *** pgadiya has joined #openstack-infra | 09:18 | |
| *** yanyanhu has quit IRC | 09:21 | |
| *** kzaitsev_mb has quit IRC | 09:23 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:25 | |
| *** sshnaidm has quit IRC | 09:26 | |
| *** dizquierdo has joined #openstack-infra | 09:26 | |
| *** yamamoto has joined #openstack-infra | 09:26 | |
| *** ihrachys has quit IRC | 09:27 | |
| *** ihrachys has joined #openstack-infra | 09:29 | |
| lifeless | prometheanfire: well that specific bug had two separate thingsl I suggest filing a new bug about the license aspect | 09:29 |
| *** kzaitsev_mb has quit IRC | 09:31 | |
| *** dtantsur|afk is now known as dtantsur | 09:37 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute024.vanilla IP addresses https://review.openstack.org/358513 | 09:42 |
| *** Thelo_ has joined #openstack-infra | 09:42 | |
| *** tosky has joined #openstack-infra | 09:43 | |
| *** kushal has quit IRC | 09:44 | |
| *** ihrachys_ has joined #openstack-infra | 09:45 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute025.vanilla IP addresses https://review.openstack.org/358514 | 09:45 |
| *** ihrachys has quit IRC | 09:45 | |
| *** sandanar has joined #openstack-infra | 09:47 | |
| *** thorst has joined #openstack-infra | 09:48 | |
| *** ihrachys_ has quit IRC | 09:48 | |
| *** ihrachys has joined #openstack-infra | 09:49 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute026.vanilla IP addresses https://review.openstack.org/358520 | 09:53 |
| *** amitgandhinz has joined #openstack-infra | 09:54 | |
| *** e0ne has joined #openstack-infra | 09:54 | |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Fix bridge creation in no vlan use case https://review.openstack.org/357261 | 09:55 |
| openstackgerrit | Merged openstack-infra/puppet-refstack: Fix lint error on puppet-refstack https://review.openstack.org/358444 | 09:55 |
| *** thorst has quit IRC | 09:55 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute027.vanilla IP addresses https://review.openstack.org/358523 | 09:57 |
| berendt | We have a spambot in #openstack-kolla. How is it possible to kick the bot? | 09:57 |
| *** amitgandhinz has quit IRC | 09:58 | |
| *** zhurong has quit IRC | 09:58 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute028.vanilla IP addresses https://review.openstack.org/358526 | 10:00 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Move other-requirements.txt to bindep.txt https://review.openstack.org/354866 | 10:04 |
| *** markvoelker has joined #openstack-infra | 10:07 | |
| *** Goneri has quit IRC | 10:07 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add rcarrillocruz as auth nick on statusbot https://review.openstack.org/358533 | 10:08 |
| berendt | spambot issue solved | 10:09 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute030.vanilla IP addresses https://review.openstack.org/358534 | 10:10 |
| *** markvoelker has quit IRC | 10:12 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute029.vanilla IP addresses https://review.openstack.org/358536 | 10:12 |
| *** ihrachys has quit IRC | 10:13 | |
| *** huanxie has quit IRC | 10:14 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute024.vanilla IP addresses https://review.openstack.org/358513 | 10:15 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Set nova key to compute https://review.openstack.org/358538 | 10:16 |
| *** ihrachys has joined #openstack-infra | 10:16 | |
| *** Goneri has joined #openstack-infra | 10:18 | |
| *** dfflanders has quit IRC | 10:25 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:25 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Set nova key to compute https://review.openstack.org/358538 | 10:25 |
| odyssey4me | yolanda if you have a moment, I'd appreciate a review of https://review.openstack.org/358333 | 10:27 |
| odyssey4me | oops - I meant https://review.openstack.org/358333 | 10:28 |
| odyssey4me | lol, same thing | 10:28 |
| yolanda | odyssey4me, looking | 10:30 |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/358478 | 10:32 |
| *** sshnaidm has joined #openstack-infra | 10:32 | |
| odyssey4me | thanks yolanda :) | 10:32 |
| *** ihrachys has quit IRC | 10:33 | |
| yolanda | np | 10:33 |
| *** ihrachys has joined #openstack-infra | 10:33 | |
| *** mfedosin has joined #openstack-infra | 10:37 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute021.vanilla IP addresses https://review.openstack.org/358490 | 10:39 |
| *** yaume_ has joined #openstack-infra | 10:41 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute023.vanilla IP addresses https://review.openstack.org/358497 | 10:41 |
| openstackgerrit | Merged openstack-infra/system-config: Set compute025.vanilla IP addresses https://review.openstack.org/358514 | 10:42 |
| openstackgerrit | Merged openstack-infra/project-config: Add ceph_client and haproxy_server repositories to OSA https://review.openstack.org/358333 | 10:42 |
| *** ihrachys has quit IRC | 10:43 | |
| *** yaume has quit IRC | 10:44 | |
| *** DrifterZA has quit IRC | 10:44 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute026.vanilla IP addresses https://review.openstack.org/358520 | 10:44 |
| *** DrifterZA has joined #openstack-infra | 10:45 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute027.vanilla IP addresses https://review.openstack.org/358523 | 10:45 |
| openstackgerrit | Merged openstack-infra/system-config: Set compute028.vanilla IP addresses https://review.openstack.org/358526 | 10:46 |
| rcarrillocruz | odyssey4me: heya, out of curiosity, how's the status for deploying OSA on metal with Bifrost? has it been implemented yet? | 10:46 |
| odyssey4me | rcarrillocruz no-one is working on that to my knowledge... as a project we've left the decision of getting an OS on the host to the deployer | 10:47 |
| odyssey4me | there are many well established solutions out there | 10:47 |
| rcarrillocruz | ah good, i kind of rememebr some post or spec about it | 10:47 |
| *** sarob has joined #openstack-infra | 10:48 | |
| odyssey4me | rcarrillocruz we have an ironic role for deploying Ironic for an openstack environment... but quite honestly using standalone ironic seems a little silly when you have Cobbler/MaaS which are better known and well established | 10:48 |
| odyssey4me | it's my understanding that bifrost was a project established for test purposes, which somehow became used in Triple-O... | 10:49 |
| *** ihrachys has joined #openstack-infra | 10:49 | |
| odyssey4me | nothing stops a deployer using bifrost, or whatever, to do the host OS deployment... it's just not something we as a project really want to get into - far too opinionated and thorny | 10:50 |
| rcarrillocruz | how's the upgrade story ? do you gate on doing upgrades and such? | 10:51 |
| rcarrillocruz | i see from docs that upgrade script is kind of experimental | 10:51 |
| rcarrillocruz | ? | 10:51 |
| *** sarob has quit IRC | 10:52 | |
| *** eranrom has joined #openstack-infra | 10:53 | |
| *** thorst has joined #openstack-infra | 10:54 | |
| *** amitgandhinz has joined #openstack-infra | 10:55 | |
| openstackgerrit | Merged openstack-infra/system-config: Add rcarrillocruz as auth nick on statusbot https://review.openstack.org/358533 | 10:58 |
| odyssey4me | rcarrillocruz we're playing a bit of catch up - the upgrades aren't gate tested due to the duration, really... but we have downstream consumers testing upgrades in their own CI | 10:59 |
| *** mdrabe has joined #openstack-infra | 10:59 | |
| *** amitgandhinz has quit IRC | 10:59 | |
| rcarrillocruz | i see | 10:59 |
| odyssey4me | the liberty->mitaka upgrade process is busy going through some rigorous testing by RPC and we'll learn from that to improve the upgrade process for newton | 10:59 |
| odyssey4me | newton is the first tie we're hoping to release with a functional upgrade process at release time | 10:59 |
| odyssey4me | so this cycle we're going to be far more strict about feature freeze | 11:00 |
| odyssey4me | previous cycles we were not | 11:00 |
| odyssey4me | this cycle N3->RC is all about stabilisation, upgrade work and bug fixing | 11:00 |
| *** thorst has quit IRC | 11:01 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute030.vanilla IP addresses https://review.openstack.org/358534 | 11:01 |
| odyssey4me | this will mean that we contribute to the overall success of Mitaka->Newton upgrades for all projects | 11:01 |
| *** ihrachys_ has joined #openstack-infra | 11:01 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute022.vanilla IP addresses and enable node https://review.openstack.org/358495 | 11:02 |
| *** ihrachys has quit IRC | 11:02 | |
| *** openstackgerrit has quit IRC | 11:03 | |
| *** openstackgerrit has joined #openstack-infra | 11:04 | |
| *** sdague has joined #openstack-infra | 11:06 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute024.vanilla IP addresses https://review.openstack.org/358513 | 11:07 |
| *** markvoelker has joined #openstack-infra | 11:08 | |
| *** tqtran has joined #openstack-infra | 11:08 | |
| *** ramishra has quit IRC | 11:08 | |
| *** rodrigods has quit IRC | 11:11 | |
| *** rodrigods has joined #openstack-infra | 11:11 | |
| *** markvoelker has quit IRC | 11:12 | |
| *** tqtran has quit IRC | 11:13 | |
| *** nwkarsten has joined #openstack-infra | 11:14 | |
| *** ramishra has joined #openstack-infra | 11:14 | |
| *** dtantsur is now known as dtantsur|brb | 11:14 | |
| *** amotoki has quit IRC | 11:15 | |
| *** amotoki has joined #openstack-infra | 11:15 | |
| openstackgerrit | Merged openstack-infra/storyboard: Add example commands for the Teams api https://review.openstack.org/339123 | 11:15 |
| *** eeiden has quit IRC | 11:16 | |
| *** ramishra has quit IRC | 11:17 | |
| *** weshay has quit IRC | 11:17 | |
| *** jak-jak_ has quit IRC | 11:17 | |
| *** dhellmann has quit IRC | 11:17 | |
| *** trown has quit IRC | 11:17 | |
| *** pt_15 has quit IRC | 11:17 | |
| *** dhellmann has joined #openstack-infra | 11:17 | |
| *** nwkarsten has quit IRC | 11:18 | |
| *** pt_15 has joined #openstack-infra | 11:18 | |
| *** weshay has joined #openstack-infra | 11:18 | |
| *** trown has joined #openstack-infra | 11:19 | |
| *** salv-orlando has quit IRC | 11:19 | |
| *** ramishra has joined #openstack-infra | 11:19 | |
| *** eeiden has joined #openstack-infra | 11:20 | |
| wznoinsk | hi all, what would be the preffered way to have all NICs using dhcp on Ubuntu instance (ironic baremetal node if that makes any differentce) ? | 11:20 |
| *** salv-orlando has joined #openstack-infra | 11:21 | |
| *** salv-orl_ has joined #openstack-infra | 11:22 | |
| *** kushal has joined #openstack-infra | 11:22 | |
| openstackgerrit | Merged openstack-infra/system-config: Set compute029.vanilla IP addresses https://review.openstack.org/358536 | 11:24 |
| *** salv-orlando has quit IRC | 11:25 | |
| ttx | mordred: only the PTL, emai laddress is in the projects.yaml file in governance | 11:27 |
| *** mugsie|alt has quit IRC | 11:27 | |
| *** mugsie|alt has joined #openstack-infra | 11:28 | |
| *** ldnunes has joined #openstack-infra | 11:29 | |
| dulek | Hi, is anyone able to help me debug what've gone wrong here: http://logs.openstack.org/14/353014/1/experimental/gate-grenade-dsvm-cinder-multinode-nv/f41be67/ ? | 11:30 |
| dulek | "[ERROR] /opt/stack/new/grenade/inc/upgrade:54 Failure in /opt/stack/new/grenade/projects/70_cinder/upgrade.sh" | 11:30 |
| dulek | This isn't really helpful, is there a file with more detailed error? | 11:30 |
| *** jkilpatr has joined #openstack-infra | 11:31 | |
| *** ihrachys_ has quit IRC | 11:33 | |
| jroll | dulek: it's right above there, http://logs.openstack.org/14/353014/1/experimental/gate-grenade-dsvm-cinder-multinode-nv/f41be67/logs/grenade.sh.txt.gz#_2016-08-10_02_13_32_962 | 11:34 |
| jroll | (of course, that isn't much more helpful) | 11:35 |
| jroll | odyssey4me: rcarrillocruz: bifrost is totally intended as a cobbler replacement sort of thing | 11:36 |
| *** openstackstatus has quit IRC | 11:36 | |
| rcarrillocruz | jroll: i know, that's why we use it ;-) | 11:36 |
| jroll | hehe | 11:37 |
| *** openstackstatus has joined #openstack-infra | 11:38 | |
| *** ChanServ sets mode: +v openstackstatus | 11:38 | |
| openstackgerrit | Merged openstack-infra/release-tools: fix release notes for final releases https://review.openstack.org/352550 | 11:39 |
| openstackgerrit | Merged openstack-infra/release-tools: aclmanager: Reuse releasetools.governance code https://review.openstack.org/355464 | 11:39 |
| openstackgerrit | Merged openstack-infra/release-tools: Remove Release Managers from post-release groups https://review.openstack.org/355465 | 11:39 |
| openstackgerrit | Merged openstack-infra/release-tools: Authenticate before doing group membership tests https://review.openstack.org/355466 | 11:40 |
| openstackgerrit | Merged openstack-infra/release-tools: Use os.path functions instead of string slices https://review.openstack.org/355467 | 11:40 |
| *** woodster_ has joined #openstack-infra | 11:42 | |
| *** jak-jak has joined #openstack-infra | 11:42 | |
| *** jak-jak is now known as Guest62779 | 11:43 | |
| *** dprince has joined #openstack-infra | 11:43 | |
| *** Na3iL has quit IRC | 11:43 | |
| *** mat128|afk is now known as mat128 | 11:44 | |
| *** asettle has quit IRC | 11:46 | |
| prometheanfire | lifeless: looks like they are looking into removing it's usage, so action is being taken on both fronts at the same time | 11:47 |
| *** Thelo_ has quit IRC | 11:49 | |
| *** thorst has joined #openstack-infra | 11:49 | |
| *** jaosorior has quit IRC | 11:50 | |
| *** jaosorior has joined #openstack-infra | 11:50 | |
| *** _sigmavirus24 has joined #openstack-infra | 11:52 | |
| *** salv-orl_ has quit IRC | 11:53 | |
| *** asselin has joined #openstack-infra | 11:53 | |
| *** salv-orlando has joined #openstack-infra | 11:54 | |
| *** _sigmavirus24 is now known as sigmavirus | 11:54 | |
| *** sigmavirus has joined #openstack-infra | 11:54 | |
| *** amitgandhinz has joined #openstack-infra | 11:55 | |
| *** asselin_ has quit IRC | 11:56 | |
| *** nwkarsten has joined #openstack-infra | 11:56 | |
| *** asettle has joined #openstack-infra | 11:57 | |
| *** e0ne has quit IRC | 11:59 | |
| *** e0ne has joined #openstack-infra | 12:00 | |
| *** baoli has joined #openstack-infra | 12:00 | |
| *** amitgandhinz has quit IRC | 12:00 | |
| *** baoli_ has joined #openstack-infra | 12:01 | |
| stevemar | leaving "check periodic" in a review will run the period job for a project right? | 12:01 |
| *** hferenc has quit IRC | 12:01 | |
| rcarrillocruz | i'm afraid not | 12:03 |
| rcarrillocruz | experimental queue | 12:03 |
| rcarrillocruz | you can trigger it with 'check experimental' | 12:03 |
| rcarrillocruz | the periodic pipeline is a timer trigger | 12:03 |
| rcarrillocruz | http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n167 | 12:04 |
| rcarrillocruz | that's for periodic | 12:04 |
| rcarrillocruz | whereas for 'experimental' | 12:04 |
| rcarrillocruz | http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n161 | 12:04 |
| *** baoli has quit IRC | 12:05 | |
| rcarrillocruz | it's a gerrit event trigger, with that regex | 12:05 |
| *** alex_xu has quit IRC | 12:08 | |
| *** markvoelker has joined #openstack-infra | 12:09 | |
| *** alex_xu has joined #openstack-infra | 12:09 | |
| *** hferenc has joined #openstack-infra | 12:09 | |
| *** kgiusti has joined #openstack-infra | 12:11 | |
| *** moravec1 has joined #openstack-infra | 12:12 | |
| *** rods has quit IRC | 12:12 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Update GRUB_MKCONFIG for detecting what's installed https://review.openstack.org/358588 | 12:12 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Set nova key to compute https://review.openstack.org/358538 | 12:13 |
| *** moravec1 has quit IRC | 12:13 | |
| *** markvoelker has quit IRC | 12:13 | |
| *** moravec has quit IRC | 12:14 | |
| *** Jeffrey4l_ has joined #openstack-infra | 12:15 | |
| *** moravec has joined #openstack-infra | 12:16 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Update portage only if needed https://review.openstack.org/358592 | 12:16 |
| *** Jeffrey4l has quit IRC | 12:16 | |
| *** pradk has joined #openstack-infra | 12:16 | |
| dulek | jroll: Thanks, it actually is helpful. c-vol is missing there on a primary node, so it could be expected. Now the interesting thing is that in other run this check passed… | 12:17 |
| *** asettle has quit IRC | 12:19 | |
| *** rods has joined #openstack-infra | 12:20 | |
| *** markvoelker has joined #openstack-infra | 12:20 | |
| *** lucasagomes is now known as lucas-hungry | 12:20 | |
| stevemar | rcarrillocruz: well that stinks :) | 12:20 |
| rcarrillocruz | heh | 12:21 |
| *** e0ne has quit IRC | 12:21 | |
| *** e0ne has joined #openstack-infra | 12:21 | |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: net-bgpvpn : move tempest tests to the gate queue https://review.openstack.org/352401 | 12:22 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set iLO/public/provisioning addresses and metadata for compute043.vanilla https://review.openstack.org/358598 | 12:22 |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: net-bgpvpn : move tempest tests to the gate queue https://review.openstack.org/352401 | 12:24 |
| *** moravec has quit IRC | 12:25 | |
| *** dstanek_ has quit IRC | 12:25 | |
| *** xyang1 has joined #openstack-infra | 12:26 | |
| *** dstanek has joined #openstack-infra | 12:26 | |
| *** tpsilva has joined #openstack-infra | 12:26 | |
| *** jaosorior is now known as jaosorior_brb | 12:26 | |
| *** psilvad has joined #openstack-infra | 12:27 | |
| *** dstanek has quit IRC | 12:27 | |
| *** dstanek has joined #openstack-infra | 12:27 | |
| *** caowei has quit IRC | 12:28 | |
| *** asettle has joined #openstack-infra | 12:29 | |
| *** eranrom has quit IRC | 12:30 | |
| *** edmondsw has joined #openstack-infra | 12:30 | |
| *** e0ne has quit IRC | 12:31 | |
| *** e0ne has joined #openstack-infra | 12:32 | |
| *** dstanek has quit IRC | 12:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow image and flavor by name for create_server https://review.openstack.org/355251 | 12:33 |
| *** dstanek has joined #openstack-infra | 12:33 | |
| *** oanson has quit IRC | 12:34 | |
| *** eranrom has joined #openstack-infra | 12:35 | |
| *** pgadiya has quit IRC | 12:36 | |
| *** eranrom has quit IRC | 12:36 | |
| *** rhallisey has joined #openstack-infra | 12:37 | |
| *** gouthamr has joined #openstack-infra | 12:37 | |
| *** rlandy has joined #openstack-infra | 12:40 | |
| *** jcoufal has joined #openstack-infra | 12:41 | |
| *** sandanar has quit IRC | 12:42 | |
| *** Na3iL has joined #openstack-infra | 12:44 | |
| *** sarob has joined #openstack-infra | 12:49 | |
| *** salv-orlando has quit IRC | 12:50 | |
| Jokke_ | did anyone ever figure this out? [Zuul] standard output/error still open after child exited | 12:50 |
| Jokke_ | Quick google did not give anything else than logs from this channel from June | 12:51 |
| Jokke_ | and I'm seeing a lot of those in multiple jobs | 12:51 |
| *** sarob has quit IRC | 12:53 | |
| *** e0ne has quit IRC | 12:54 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Send notifications to subscribers for worklists https://review.openstack.org/354730 | 12:55 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Make it possible to get worklist/board timeline events via the API https://review.openstack.org/354729 | 12:55 |
| *** e0ne has joined #openstack-infra | 12:55 | |
| *** ccamacho is now known as ccamacho|lunch | 12:56 | |
| *** amitgandhinz has joined #openstack-infra | 12:56 | |
| *** rfolco has joined #openstack-infra | 12:56 | |
| *** rwsu has quit IRC | 12:57 | |
| *** raildo has joined #openstack-infra | 12:57 | |
| *** clenimar has joined #openstack-infra | 12:58 | |
| *** mgagne_ has quit IRC | 13:00 | |
| *** mgagne_ has joined #openstack-infra | 13:00 | |
| *** amitgandhinz has quit IRC | 13:01 | |
| *** gouthamr is now known as gouthamr|afk | 13:04 | |
| openstackgerrit | Emily Hugenbruch proposed openstack-infra/irc-meetings: Create a new meeting for WOS-mentoring https://review.openstack.org/356467 | 13:04 |
| *** jheroux has joined #openstack-infra | 13:07 | |
| *** yaume has joined #openstack-infra | 13:08 | |
| *** notnownikki has joined #openstack-infra | 13:08 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Enable compute005.vanilla and set all IPs and metadata https://review.openstack.org/358631 | 13:09 |
| *** edmondsw has quit IRC | 13:09 | |
| *** eset has quit IRC | 13:10 | |
| *** ddieterly has joined #openstack-infra | 13:10 | |
| *** abregman_ is now known as abregman|mtg | 13:10 | |
| *** yaume_ has quit IRC | 13:10 | |
| *** ddieterly has quit IRC | 13:14 | |
| *** markusry has joined #openstack-infra | 13:14 | |
| *** vikrant has quit IRC | 13:14 | |
| *** dtantsur|brb is now known as dtantsur | 13:16 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Add curl to the list of packages https://review.openstack.org/358636 | 13:17 |
| *** lucas-hungry is now known as lucasagomes | 13:18 | |
| *** julim has joined #openstack-infra | 13:18 | |
| *** markusry has quit IRC | 13:19 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute038.vanilla IPs and metadata https://review.openstack.org/358638 | 13:19 |
| pabelanger | morning | 13:20 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Send notifications to subscribers for worklists https://review.openstack.org/354730 | 13:20 |
| *** superdan is now known as dansmith | 13:21 | |
| odyssey4me | pabelanger how do we feel about pushing this button? https://review.openstack.org/357356 | 13:21 |
| *** amitgandhinz has joined #openstack-infra | 13:22 | |
| *** adreznec has joined #openstack-infra | 13:23 | |
| *** Guest37793 is now known as zeus | 13:24 | |
| *** zeus has joined #openstack-infra | 13:24 | |
| mordred | morning pabelanger ! | 13:24 |
| *** adreznec has quit IRC | 13:25 | |
| Zara | fungi: thanks for enabling the storyboard-gerrit plugin! :D (and on saturday! :o) | 13:26 |
| *** adreznec has joined #openstack-infra | 13:26 | |
| *** moravec has joined #openstack-infra | 13:26 | |
| Zara | and thanks again zaro! I was going to wake until I thought people had woken up but I'm getting more paranoid that they're already up and I'm just not paying attention. | 13:27 |
| pabelanger | odyssey4me: we're still seeing some configure_mirror.sh failures, but not as often. About 1-3 nodes an hour. I wonder if our pump is not happening faster enough. Landing https://review.openstack.org/#/c/355695/ could help with that. Eventually, I'd like to pull down console logs on failures, to help debug | 13:28 |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Remove q-lbaas from this tempest list, as it is being removed https://review.openstack.org/358259 | 13:28 |
| pabelanger | aside from that, the recent changes are holding up well | 13:28 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set compute056.chocolate IPs and metadata https://review.openstack.org/358644 | 13:29 |
| odyssey4me | pabelanger yeah, the failures on launch are way, way down | 13:29 |
| odyssey4me | I saw mordred doing some work around console logs on the w/end | 13:29 |
| mordred | odyssey4me: yup | 13:30 |
| odyssey4me | pabelanger I think that greghaynes is looking for more input for https://review.openstack.org/356456 | 13:30 |
| mordred | https://review.openstack.org/#/c/358232/ ready for review | 13:30 |
| *** mikelk has joined #openstack-infra | 13:31 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Refactor TaskManager to be more generic https://review.openstack.org/358646 | 13:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add submit_function method to TaskManager https://review.openstack.org/358647 | 13:31 |
| *** sdague has quit IRC | 13:32 | |
| Zara | (now I've read backscroll, hmmm, verify status plugin?) | 13:33 |
| *** hongbin has joined #openstack-infra | 13:33 | |
| *** alexz__ has joined #openstack-infra | 13:33 | |
| *** aarefiev_ has joined #openstack-infra | 13:33 | |
| *** esberglu has joined #openstack-infra | 13:33 | |
| *** vsaienko2 has joined #openstack-infra | 13:34 | |
| *** e0ne_ has joined #openstack-infra | 13:34 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support dual-stack neutron networks https://review.openstack.org/357517 | 13:34 |
| *** melwitt_ is now known as melwitt | 13:34 | |
| mordred | and there's the other one that's osic relevant (for multi-node) ... which should now work since occ 1.20.0 has been released | 13:34 |
| pabelanger | great | 13:35 |
| *** aarefiev has quit IRC | 13:36 | |
| *** e0ne has quit IRC | 13:36 | |
| *** vsaienko1 has quit IRC | 13:36 | |
| *** sshnaidm has quit IRC | 13:36 | |
| *** azvyagintsev has quit IRC | 13:37 | |
| *** hpe-hj has joined #openstack-infra | 13:37 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support dual-stack neutron networks https://review.openstack.org/357517 | 13:39 |
| *** ansmith has joined #openstack-infra | 13:39 | |
| *** _ari_ has joined #openstack-infra | 13:42 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Remove notify on key setup https://review.openstack.org/358652 | 13:43 |
| openstackgerrit | Merged openstack-infra/release-tools: Do not abort if README file not found https://review.openstack.org/358360 | 13:44 |
| *** abregman|mtg is now known as abregman | 13:44 | |
| *** kzaitsev_mb has quit IRC | 13:46 | |
| *** inc0 has joined #openstack-infra | 13:46 | |
| *** sdake has joined #openstack-infra | 13:46 | |
| *** ccamacho|lunch is now known as ccamacho | 13:50 | |
| *** sdake_ has joined #openstack-infra | 13:50 | |
| *** notnownikki has quit IRC | 13:50 | |
| *** briancurtin has quit IRC | 13:51 | |
| *** notnownikki has joined #openstack-infra | 13:51 | |
| *** tonytan4ever has joined #openstack-infra | 13:51 | |
| *** sshnaidm has joined #openstack-infra | 13:51 | |
| *** briancurtin has joined #openstack-infra | 13:52 | |
| *** sdake has quit IRC | 13:53 | |
| *** cody-somerville has quit IRC | 13:54 | |
| rcarrillocruz | pabelanger: heya, you have access to rackspace dns ? | 13:55 |
| rcarrillocruz | like the panel | 13:55 |
| *** Julien-zte has joined #openstack-infra | 13:55 | |
| *** zz_dimtruck is now known as dimtruck | 13:56 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add support for fetching console logs from servers https://review.openstack.org/358232 | 13:56 |
| mordred | pabelanger: thanks | 13:56 |
| *** kzaitsev_mb has joined #openstack-infra | 13:56 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Remove unnecessary NodePoolBuilder thread https://review.openstack.org/356676 | 13:58 |
| *** ddieterly has joined #openstack-infra | 14:00 | |
| *** yaume_ has joined #openstack-infra | 14:01 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Enable compute055.chocolate and set IPs and metadata https://review.openstack.org/358659 | 14:02 |
| rcarrillocruz | pabelanger: yolanda added for me controller00, compute00[0-2] but they are not resolving | 14:03 |
| rcarrillocruz | not sure what happened | 14:03 |
| rcarrillocruz | fungi: ^ would be good to get access/being bootstrapped on how to use the cloud panels | 14:03 |
| rcarrillocruz | to speed up infra cloud things | 14:03 |
| *** _nadya_ has quit IRC | 14:03 | |
| yolanda | sorry, i was on a meeting but i'm back again | 14:03 |
| *** ddieterly is now known as ddieterly[away] | 14:04 | |
| *** yaume has quit IRC | 14:04 | |
| yolanda | mm actually i did a mistake there, rcarrillocruz . I added for openstack.org and i should have added for ic.openstack.org domain | 14:05 |
| rcarrillocruz | ahk | 14:05 |
| rcarrillocruz | vanilla.ic.openstack.org | 14:05 |
| rcarrillocruz | ++ | 14:05 |
| yolanda | i don't remember doing like that last time, but noticed now, let me correct | 14:05 |
| rcarrillocruz | thx a bunch | 14:05 |
| fungi | yolanda: yeah, we're just about at the 500 record per zone limit rackspace imposes, so decided (a few months ago) to make a subdomain zone for ic.openstack.org to relieve some of the pressure there | 14:06 |
| *** Julien-zte has quit IRC | 14:06 | |
| yolanda | makes sense | 14:06 |
| *** kushal has quit IRC | 14:07 | |
| fungi | it seemed like the easiest large set of dns records to rehome | 14:07 |
| *** edmondsw has joined #openstack-infra | 14:07 | |
| yolanda | rcarrillocruz, i updated correctly now | 14:08 |
| rcarrillocruz | \o/ | 14:08 |
| *** ddieterly[away] is now known as ddieterly | 14:08 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add a tempest job for python-ironic-inspector-client https://review.openstack.org/358663 | 14:09 |
| *** jcoufal has quit IRC | 14:10 | |
| *** andreww has quit IRC | 14:10 | |
| *** slaweq__ has joined #openstack-infra | 14:10 | |
| *** burgerk has joined #openstack-infra | 14:10 | |
| *** cinerama has quit IRC | 14:11 | |
| *** tqtran has joined #openstack-infra | 14:11 | |
| cloudnull | morning | 14:11 |
| *** jcoufal has joined #openstack-infra | 14:11 | |
| anteaya | morning cloudnull | 14:12 |
| Shrews | mordred: why do you hate reno notes??? | 14:13 |
| anteaya | cloudnull: how are all things oisc this morning? | 14:13 |
| mordred | Shrews: did I do anything reno-note worthy? | 14:13 |
| *** slaweq_ has quit IRC | 14:13 | |
| Shrews | mordred: new functionality | 14:13 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Add management of /etc/nova/ssl/private directory https://review.openstack.org/358668 | 14:14 |
| wznoinsk | hi all, are there any plans to support glean/simple-init dib element on ubuntu 14? | 14:14 |
| Shrews | mordred: support dual-stack nets, support image/flavor names | 14:14 |
| fungi | i've considered release notes to be akin to the classic "NEWS" file (things like behavior changes or backward incompatibilities users need to know about), while adding features feels more like something for a ChangeLog to me | 14:14 |
| cloudnull | anteaya: I think its good? | 14:14 |
| anteaya | wznoinsk: meaning will glean be packaged by debian? | 14:15 |
| cloudnull | no news is good news | 14:15 |
| cloudnull | :) | 14:15 |
| anteaya | cloudnull: yay! | 14:15 |
| *** tqtran has quit IRC | 14:15 | |
| wznoinsk | anteaya: will it support operating systems using upstart rather | 14:15 |
| *** slaweq_ has joined #openstack-infra | 14:15 | |
| *** pilgrimstack1 has joined #openstack-infra | 14:15 | |
| anteaya | wznoinsk: ah | 14:15 |
| cloudnull | error node launch attempts seem to be gone now. | 14:15 |
| fungi | wznoinsk: if you're asking whether you can use glean/simple-init, it already does? we build ubuntu 14.04 images with it, no problem | 14:15 |
| anteaya | cloudnull: woooo | 14:16 |
| *** penguinolog has quit IRC | 14:16 | |
| cloudnull | so again great work on the image improvements everyone :) | 14:16 |
| fungi | wznoinsk: are you using http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/ubuntu-minimal or trying to do something else with it? | 14:16 |
| mordred | Shrews: oh. yeah. I guess those are noteworthy | 14:16 |
| *** pilgrimstack has quit IRC | 14:16 | |
| fungi | but yeah, those items Shrews mentioned are more along the lines of behavior changes, so seem relevant | 14:18 |
| *** sdake_ is now known as sdake | 14:18 | |
| wznoinsk | fungi: I'd imagine it's working seeing your nodepool.yaml ;-) it maybe old version of the element I have tho, glean-install installs systemd service files | 14:18 |
| fungi | wznoinsk: sounds like it thinks you want something later than 14.04 (did ubuntu maybe switch to systemd in 14.10?) | 14:18 |
| wznoinsk | fungi: using dib from pip (1.18.2) | 14:18 |
| *** slaweq__ has quit IRC | 14:18 | |
| *** mtanino has joined #openstack-infra | 14:19 | |
| fungi | wznoinsk: yeah, we pip install diskimage-builder from pypi onto our nodepool server as well | 14:19 |
| wznoinsk | fungi: http://paste.openstack.org/show/562218/ | 14:19 |
| *** sleviim has joined #openstack-infra | 14:19 | |
| *** jschwarz has joined #openstack-infra | 14:20 | |
| fungi | wznoinsk: oh, it may be that glean has a systemd unit file installed whether or not you're running systemd. i'll check | 14:20 |
| *** nwkarsten has quit IRC | 14:20 | |
| *** sshnaidm has quit IRC | 14:21 | |
| *** nwkarsten has joined #openstack-infra | 14:21 | |
| fungi | nope | 14:22 |
| sdake | hey cats - having trouble adding a channel operator via the flags option to chanserv for openstack-kolla | 14:22 |
| fungi | wznoinsk: ls: cannot access :/usr/lib/systemd/system: No such file or directory | 14:22 |
| sdake | [07:18:13] <sdake>flags #openstack-kolla berendt +o | 14:22 |
| sdake | [07:18:14] -ChanServ-You are not authorized to execute this command. | 14:22 |
| sleviim | hi all, i'm trying to fill in the "contact information" form, and by pressing "Save Changes", i'm getting the following error message: Code Review - ErrorServer ErrorCannot store contact information. | 14:23 |
| wznoinsk | fungi: http://paste.openstack.org/show/562221/ | 14:23 |
| sleviim | can anyone assist me with that? | 14:23 |
| *** rbrndt has joined #openstack-infra | 14:24 | |
| *** BobBall_AWOL is now known as BobBall | 14:24 | |
| wznoinsk | sleviim: udpate your contact info on https://www.openstack.org/profile/ | 14:24 |
| fungi | sdake: `/msg chanserv access #openstack-kolla list` says your account has flags +Aeortv | 14:24 |
| anteaya | sleviim: ensure you have followed all the information on http://docs.openstack.org/infra/manual/developers.html#account-setup | 14:24 |
| *** nwkarsten has quit IRC | 14:25 | |
| anteaya | sleviim: if you still have a problem, please read: https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ | 14:25 |
| sdake | fungi ya i saw that via flags list - not sure what it means :) | 14:25 |
| *** berendt has quit IRC | 14:25 | |
| fungi | sdake: you're trying to do `/msg chanserv access #openstack-kolla add berendt +o` i guess? or something else? | 14:26 |
| sdake | yup | 14:26 |
| *** berendt has joined #openstack-infra | 14:26 | |
| sdake | [07:18:13] <sdake>flags #openstack-kolla berendt +o | 14:26 |
| sdake | [07:18:14] -ChanServ-You are not authorized to execute this command. | 14:26 |
| sdake | let me try your syntax | 14:26 |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: [trove] Add more nv scenario tests https://review.openstack.org/354881 | 14:26 |
| *** abregman_ has joined #openstack-infra | 14:26 | |
| *** abregman has quit IRC | 14:27 | |
| sdake | your syntax fails as well | 14:27 |
| sdake | fungi ^^ | 14:27 |
| fungi | sdake: yeah, i'm trying to find freenode's answer key for all of chanserv's flags to see what is required for that to work | 14:27 |
| sdake | fungi cool let me check with you | 14:28 |
| *** thiagop has joined #openstack-infra | 14:28 | |
| fungi | sdake: aha, `/msg chanserv help flags` does seem to enumerate all of them | 14:28 |
| fungi | sdake: i think you need +s | 14:29 |
| wznoinsk | fungi: I have this dir cause npt installed a shim there: http://paste.openstack.org/show/562225/ | 14:29 |
| sdake | fungi +f and +s are the two things i'm issing | 14:29 |
| sdake | not sure what they do :) | 14:30 |
| wznoinsk | should if os.path.exists('/usr/lib/systemd'): | 14:30 |
| wznoinsk | be rather if os.path.exists('/usr/lib/systemd/system'): | 14:30 |
| wznoinsk | then? | 14:30 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Correct iLO IP and rack number for compute19.chocolate https://review.openstack.org/358675 | 14:30 |
| fungi | sdake: +f is for setting up channel forwarding | 14:30 |
| fungi | sdake: i just now ran `/msg chanserv access #openstack-kolla add sdake +Aeorstv` and is indicates ir added +s for you. try again? | 14:30 |
| fungi | er, indicates it added | 14:31 |
| sdake | still not authorized | 14:31 |
| sdake | iok all set fungi thanks :) | 14:32 |
| fungi | sdake: ahh, i misread the list. it did also need +f which i thought i remembered as being forwarding access but the help says it was channel access list modification permission | 14:33 |
| sdake | have to give full +Aeorstv rather then just +o | 14:33 |
| fungi | +Aeforstv in fact | 14:33 |
| fungi | +Aefortv might also be sufficient. you may not need set permission to alter channel access lists | 14:34 |
| fungi | but anyway, you're all set now | 14:34 |
| sleviim | anteaya: Thanks! i'll try those | 14:34 |
| *** cinerama has joined #openstack-infra | 14:34 | |
| anteaya | sleviim: my suspistion is your emails don't match or you don't have the correct membership type with the foundation | 14:34 |
| anteaya | suspicion* | 14:35 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add controller00 and compute00[1-2] vanilla to puppetmaster ansible inventory https://review.openstack.org/358679 | 14:36 |
| *** kzaitsev_mb has quit IRC | 14:36 | |
| *** kushal has joined #openstack-infra | 14:36 | |
| rcarrillocruz | folks, can I get that ^ reviews, i'd like to start testing the puppet applies on the infracloud | 14:37 |
| rcarrillocruz | s/reviews/reviewed | 14:37 |
| rcarrillocruz | pls | 14:37 |
| *** sshnaidm has joined #openstack-infra | 14:37 | |
| *** eantyshev has joined #openstack-infra | 14:38 | |
| sleviim | anteaya: trying to update my profile, getting "Your Session has expired!." | 14:38 |
| sleviim | anteaya: tried via firefox and chrome | 14:38 |
| *** roxanaghe has joined #openstack-infra | 14:39 | |
| eantyshev | jeblair: Would you please look again at https://review.openstack.org/#/c/238988 (keepalive in zuul)? | 14:39 |
| *** eantyshev has left #openstack-infra | 14:39 | |
| anteaya | sleviim: you are are logged into review.openstack.org, yes? | 14:40 |
| anteaya | sleviim: and you are on this page: https://review.openstack.org/#/settings/contact yes? | 14:40 |
| sleviim | anteaya: yes for both questions | 14:40 |
| anteaya | sleviim: and you have Contact information last updated on somewhere on that page, plus a date and time | 14:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Refactor TaskManager to be more generic https://review.openstack.org/358646 | 14:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add submit_function method to TaskManager https://review.openstack.org/358647 | 14:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Change naming style of submitTask https://review.openstack.org/358684 | 14:41 |
| anteaya | sleviim: for me I have: Contact information last updated on Aug 22, 2016 at 10:40 AM. | 14:41 |
| anteaya | sleviim: what do you have? | 14:41 |
| sleviim | anteaya: got directed to here: https://review.openstack.org/#/dashboard/self and shows no changes at all | 14:42 |
| anteaya | sleviim: can you log out and log back in again, please? pick one browser to work on, not both please | 14:43 |
| *** cody-somerville has joined #openstack-infra | 14:43 | |
| anteaya | sleviim: when I am logged in I see my name in the top right hand corner | 14:44 |
| *** roxanaghe has quit IRC | 14:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support dual-stack neutron networks https://review.openstack.org/357517 | 14:44 |
| anteaya | when I am not logged in I see: Sign In in the top right hand corner | 14:44 |
| anteaya | sleviim: if you see Sign In, please sign in | 14:44 |
| sleviim | anteaya: i saw my name all long, i've re-signed in | 14:45 |
| anteaya | great | 14:45 |
| anteaya | what url are you looking ag? | 14:45 |
| anteaya | at* | 14:45 |
| sleviim | anteaya: still nothing appears under my changes | 14:45 |
| anteaya | nothing will appear under your contact information | 14:46 |
| anteaya | what does your timestamp say? | 14:46 |
| anteaya | Contact information last updated on Aug 22, 2016 at 10:40 AM. | 14:46 |
| anteaya | the contact information is stored on a separate database to protect privacy | 14:46 |
| anteaya | gerrit can take the input but can't display it | 14:47 |
| anteaya | look for your timestamp to show your data has been updated | 14:47 |
| wznoinsk | fungi: I see similar problem with glean as with dhcp-all-interfaces, happens to late: http://paste.openstack.org/show/562230/ | 14:48 |
| *** anthonyper has quit IRC | 14:48 | |
| wznoinsk | just FYI, not sure whether it's fixable properly | 14:48 |
| fungi | wznoinsk: any guess what we're doing that it's not an issue for us? | 14:48 |
| *** anthonyper has joined #openstack-infra | 14:49 | |
| *** eharney has joined #openstack-infra | 14:49 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow image and flavor by name for create_server https://review.openstack.org/355251 | 14:49 |
| yolanda | mordred, are you aware of some problems with python-openstackclient latest release? i'm hitting errors with 3.0.0 that released today. When using os-client-config i'm getting errors for TypeError: _validate_auth() takes exactly 3 arguments (4 given) | 14:49 |
| yolanda | i downgraded to 2.6.0 and my config worked | 14:49 |
| *** eharney has quit IRC | 14:49 | |
| mordred | yolanda: yes. there is a problem, there is a patch up to fix it | 14:49 |
| *** senk has quit IRC | 14:49 | |
| yolanda | ok thx | 14:50 |
| wznoinsk | fungi: well, sometimes someone else fixes it via gerrit ;-) | 14:50 |
| mordred | yolanda: the fix is in the gate currently - as soon as it lands, we'll get a release cut | 14:50 |
| sleviim | anteaya: where should i take my timestamp from? | 14:50 |
| anteaya | sleviim: https://review.openstack.org/#/settings/contact | 14:51 |
| yolanda | do you have the link handy? just for curiosity | 14:51 |
| fungi | wznoinsk: i don't understand what you mean there... are you suggesting we're running a fix backported from an unreleased commit or something? | 14:51 |
| sleviim | anteaya: i need to put in my data - it shows me the form of Mailing Address, country etc. | 14:51 |
| anteaya | sleviim: http://imgur.com/a/aGHyy | 14:52 |
| *** bethwhite_ has quit IRC | 14:52 | |
| anteaya | sleviim: correct | 14:52 |
| *** yamamoto has quit IRC | 14:52 | |
| anteaya | sleviim: and once the database has any data at all you will see "Contact information last updated on Aug 22, 2016 at 10:40 AM." | 14:52 |
| wznoinsk | fungi: ah, nevermind, let's restart... the problem with glean I have is running after cloud-init-nonet sees static-network-up so kinda too late, I was looking into upstart service dependencies/events a bit and can't see a good way to fix that as of yet | 14:52 |
| sleviim | anteaya: i have no time stamp an this page | 14:52 |
| *** vinaypotluri has joined #openstack-infra | 14:53 | |
| anteaya | sleviim: then you have never entered data in the db | 14:53 |
| anteaya | sleviim: and the system would like you to | 14:53 |
| fungi | wznoinsk: we're using the ubuntu-minimal element from the diskimage-builder 1.18.2 release according to pip, so presumably the same version that's being used to set up your images as well? | 14:53 |
| sleviim | anteaya: i would like it either, but what is missing? | 14:53 |
| anteaya | enter some contact information and click the save changes button | 14:54 |
| rcarrillocruz | ianw: when you get around give me a ping | 14:54 |
| *** salv-orlando has joined #openstack-infra | 14:54 | |
| wznoinsk | I'm using ubuntu (cloudimg), I was probably confusing you a bit as I was talking about two issues in last 25mins: 1. glean-install installing systemd files on ubuntu 14(upstart) - https://bugs.launchpad.net/diskimage-builder/+bug/1615673 , 2. glean running to late in bootup process | 14:55 |
| openstack | Launchpad bug 1615673 in diskimage-builder "simple-init's glean-install installs systemd service files on ubuntu 14 (upstart)" [Undecided,New] | 14:55 |
| timrc | mordred: I'm curious how that opensack-client bug got passed testing... | 14:55 |
| timrc | openstack* | 14:55 |
| sleviim | anteaya: i tried, but all the time - even by using other explorers and restart those - it shows me the same error : Code Review - ErrorServer ErrorCannot store contact information | 14:55 |
| mordred | wznoinsk, fungi: glean isn't really designed to be run _with_ cloud-init ... | 14:55 |
| mordred | it replaces cloud-init | 14:55 |
| rcarrillocruz | yup | 14:55 |
| anteaya | sleviim: did you read this? https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ | 14:55 |
| rcarrillocruz | i can concur ^ | 14:55 |
| rcarrillocruz | from infracloud and all | 14:55 |
| mordred | timrc: yah - there are a few holes. we're working on plugging htme | 14:56 |
| wznoinsk | mordred: will it retrieve vendor/user/network/metadata from metadata service ? | 14:56 |
| rcarrillocruz | they collide, as they try to do the same things with interfaces | 14:56 |
| *** bethwhite_ has joined #openstack-infra | 14:56 | |
| mordred | wznoinsk: no, it will retreive them from config-drive | 14:56 |
| sleviim | anteaya: yeah, i got into that link, but on the openstack site i've got another error, of "your session has expired" | 14:56 |
| anteaya | then start another session by logging in | 14:57 |
| sleviim | anteaya: tried to, still didn't work | 14:57 |
| mordred | wznoinsk: it also will not do any user-data scripts or anything - it will set up networking and retreive an ssh key from config-drive metadata | 14:57 |
| *** ggnel_t has quit IRC | 14:57 | |
| *** salv-orlando has quit IRC | 14:57 | |
| anteaya | what do you mean, what will not work, on what site? | 14:57 |
| mordred | if you need user-data scripts or metadata service, you'll need to use cloud-init | 14:57 |
| anteaya | sleviim: we seem to be going in circles and I need to you give me more details please | 14:58 |
| mordred | but I do not expect using both to ever work | 14:58 |
| fungi | wznoinsk: just confirmed looking at our image build logs at http://nodepool.openstack.org/ that we're pip installing glean from pypi as well, so not using any backports of unreleased fixes for anything | 14:58 |
| *** hockeynut has joined #openstack-infra | 14:58 | |
| anteaya | sleviim: I can't help you if you don't tell me what you are doing, full sentences really help | 14:58 |
| fungi | wznoinsk: but as mordred says, we don't use clout-init at all. glean was sort of invented to replace it for this particular use case | 14:58 |
| sleviim | anteaya: ok | 14:58 |
| jroll | mordred: side question: do you expect to ever add metadata service support to glean? | 14:59 |
| mordred | jroll: nope | 14:59 |
| jroll | mordred: k, thanks :) | 14:59 |
| sleviim | anteaya: | 14:59 |
| fungi | jroll: are there public clouds where the metadata service is reliable? we've had terrible experience with it only working some of the time | 15:00 |
| mordred | jroll: it's inherently less scalable than config-drive, and consuming would require more depends | 15:00 |
| *** jaosorior_brb is now known as jaosorior | 15:00 | |
| mordred | jroll: we've basically written off metadata service as OMG NEVER TOUCH EVER | 15:00 |
| jroll | mordred: yep, figured as much | 15:00 |
| fungi | the main thing the metadata service has going for it is that its contents can be changed/updated over the course of an instance's lifetime, but that's not really a feature where glean is concerned | 15:01 |
| wznoinsk | yep, you usually have everything assuming dib does the filesystem and config-drive gives basic network info for simple-init setup, I would like to use metadata service - config drive didn't play with my ironic deployed nodes at first and not yet sure how it should work and if at all | 15:01 |
| jroll | fungi: I'm not sure, but I've been noodling with the idea of an (optional) guest agent that works across all types of compute, for hot-plugging volumes/networks/etc. including ironic, which of course you can't update the config drive on :) | 15:01 |
| *** mdrabe_ has joined #openstack-infra | 15:01 | |
| fungi | wznoinsk: interesting... rcarrillocruz is bifrosting machines right now using glean and no cloud-init | 15:01 |
| wznoinsk | didn't expect these wrong-order problems between networking dhcp config and cloud-init, may need to get back and check the config-drive route | 15:02 |
| sleviim | anteaya: first, i've got this error on https://review.openstack.org, trying to update my contact details: Code Review - ErrorServer ErrorCannot store contact information | 15:02 |
| jroll | wznoinsk: configdrive should just work with ironic stuff | 15:02 |
| openstackgerrit | Merged openstack-infra/system-config: Add controller00 and compute00[1-2] vanilla to puppetmaster ansible inventory https://review.openstack.org/358679 | 15:02 |
| rcarrillocruz | i concur what jroll said ^, it just works | 15:02 |
| *** kzaitsev_mb has joined #openstack-infra | 15:02 | |
| *** _nadya_ has joined #openstack-infra | 15:02 | |
| sleviim | anteaya: then, i've found the link you've sent me, and trying to log in as a foundation member | 15:02 |
| rcarrillocruz | in infracloud, we use ironic with bifrost and glean | 15:02 |
| rcarrillocruz | works a treat | 15:02 |
| fungi | jroll: you can't effectively update configdrives for virtual machine instances either, right? seems like the operating system would freak out if a mounted non-network filesystem's contents changed out from under it | 15:02 |
| *** eharney has joined #openstack-infra | 15:03 | |
| *** nwkarste_ has joined #openstack-infra | 15:03 | |
| rcarrillocruz | and when i started doing my poc with bifrost, i started using 'ubuntu' dib element, not 'ubuntu-minimal' ,,plus glean | 15:03 |
| rcarrillocruz | and as i discovered later | 15:03 |
| rcarrillocruz | all sorts of issues | 15:03 |
| rcarrillocruz | due to the fact of cloud-init colliding with glean when configuring devices | 15:03 |
| jroll | fungi: I've no clue, you could be right :) however they also have ways of passing data from the host to the guest (e.g. xenstore) | 15:03 |
| *** mdrabe has quit IRC | 15:03 | |
| sleviim | anteaya: i couldn't login - i thought i can't remember my password - and tried to recover it, but by pressing "send" after putting my mail, it says Your Session has expired!. | 15:04 |
| fungi | jroll: right, hypervisor-specific mechanisms that work more like remote/network filesystems (hostfs, et cetera) | 15:04 |
| mordred | jroll: yah. we know all about that | 15:04 |
| wznoinsk | rcarrillocruz: AFAIK cloud-init isn't configuring networking interfaces (at least by default) | 15:04 |
| mordred | jroll: those have screwed us up many times | 15:04 |
| anteaya | sleviim: so you are looking at https://openstackid.org/accounts/user/login | 15:04 |
| jroll | fungi: ironic instances have no way to pass info in, so I'm thinking metadata service (if it's improved to be reliable and such) is an answer that can work for everyone | 15:04 |
| mordred | jroll: config-drive works great with ironic | 15:04 |
| rcarrillocruz | wznoinsk: when i used 'ubuntu' dib element i didn't configure anything specific on cloud-init, yet it would indeed configure net interfaces | 15:04 |
| sleviim | anteaya: yep, this is one of my open pages | 15:04 |
| *** bin_ has joined #openstack-infra | 15:04 | |
| anteaya | sleviim: you clicked "Forgot Password" and when to ttps://www.openstack.org/Security/lostpassword | 15:04 |
| anteaya | sleviim: yes? | 15:04 |
| anteaya | went* | 15:05 |
| mordred | jroll: once I have an ssh key on the machine, I do not want the cloud to ever pass new things "in" | 15:05 |
| mordred | fwiw | 15:05 |
| rcarrillocruz | not sure if that behavior changed tho, last time i had both was like a year ago | 15:05 |
| jroll | mordred: right, I know :) | 15:05 |
| sleviim | anteaya: exactly | 15:05 |
| jroll | mordred: from above, I've been noodling with the idea of an (optional) guest agent that works across all types of compute, for hot-plugging volumes/networks/etc. | 15:05 |
| mordred | jroll: nod. as long as it's optional, I will not scream | 15:05 |
| jroll | mordred: and I know that isn't something *you* (or most people with cattle) want, but pets are still a thing | 15:05 |
| jroll | indeed :) | 15:05 |
| mordred | jroll: I don't want this for pets either | 15:06 |
| mordred | jroll: in fact, I REALLY don't want it for pets | 15:06 |
| mordred | I have config management for them | 15:06 |
| mordred | and when the cloud "does things" to my machines | 15:06 |
| mordred | it means it's fighting my config management | 15:06 |
| mordred | and I want my config management to always win | 15:06 |
| mordred | if I added a new device via cloud api, I can pretty easily add mounting it to the config management | 15:07 |
| wznoinsk | rcarrillocruz: I'm not using cloud-init dib element as using 'ubuntu' element (ubuntu ccloud image) already has one | 15:07 |
| jroll | mordred: s/pets/artisinal hand crafted servers managed by people that click buttons in a control panel/ | 15:07 |
| fungi | jroll: we've had unpleasantness in the past when, for example, rackspace decided to re-ip their internal recursive resolvers and so "helpfully" rewrote everyone's /etc/resolv.conf (whether or not they were using the old resolvers before) | 15:07 |
| wznoinsk | rcarrillocruz: and it doesn't do anything to my nic | 15:07 |
| mordred | jroll: yah. for those, I grok what you're saying | 15:07 |
| rcarrillocruz | wznoinsk: yup, i know, that's the exact setup i had : 'ubuntu' dib element plus 'glean' | 15:07 |
| jroll | mordred: for example, trying to teach someone how to use iscsiadm to mount a cinder volume | 15:07 |
| rcarrillocruz | and cloud-init would mess with glean | 15:07 |
| rcarrillocruz | but again, that was a year ago | 15:08 |
| *** asettle has quit IRC | 15:08 | |
| jroll | fungi: yeah, I don't intend for this thing to ever touch an instance where the user did not explicitly ask for it | 15:08 |
| anteaya | sleviim: I confirm: http://imgur.com/a/VlK0s | 15:08 |
| mordred | jroll: heh. I mean, they shouldn't need to though, right? it should just show up as like /dev/mapper/cinder-volume-name ? | 15:08 |
| *** dizquierdo has quit IRC | 15:08 | |
| jschwarz | anteaya, for what it's worth, I can also confirm this | 15:08 |
| rcarrillocruz | and even if you want to have both, i would just stick to cloud-init if you want metadata capabilties | 15:08 |
| mordred | oh, I guess that bit is harder in ironic | 15:08 |
| jroll | mordred: not in ironic \o/ | 15:08 |
| *** yamahata has joined #openstack-infra | 15:08 | |
| mordred | nevermind | 15:08 |
| jroll | :) | 15:08 |
| anteaya | jschwarz: thank you | 15:08 |
| jschwarz | anteaya, welcome :) | 15:08 |
| anteaya | fungi: openstackid password reset requests are currently broken | 15:08 |
| anteaya | fungi: with whom do I file a bug? | 15:08 |
| fungi | anteaya: oh, that's fun. looking | 15:09 |
| anteaya | fungi: thank you | 15:09 |
| anteaya | fungi: sleviim has been having a great time with it | 15:09 |
| wznoinsk | rcarrillocruz: I guess you mean cloud-init got info from config-drive to configure network interfaces then yes, it would configure nics, I@m not using config-drive as of now, I'll look into using one | 15:09 |
| fungi | anteaya: what's the symptom? i'm trying to spot it in scrollback | 15:09 |
| jroll | mordred: hotplugging network interfaces is a similar problem, "here, just go to /etc/network/interfaces and add it... no, it has to be a bond slave. you don't know what a vlan is? here... oh btw, call neutron api to get the mac address, you'll need it" :( | 15:09 |
| *** esikachev has quit IRC | 15:09 | |
| fungi | anteaya: does it just never send you an e-mail or something? | 15:09 |
| anteaya | fungi: when I go to log into the foundation website and get the openstackid login, I click forgot password and get: http://imgur.com/a/VlK0s | 15:10 |
| jschwarz | fungi, it gives you a "Your Session has expired!." error | 15:10 |
| fungi | cute | 15:10 |
| mordred | jroll: maybe those people should be using serverless and not ironic servers? ;) | 15:10 |
| anteaya | yeah, new folks are really enjoying this feature | 15:10 |
| anteaya | and also I don't get a reset email | 15:10 |
| jroll | mordred: heh. | 15:11 |
| mordred | jroll: but I'm trolling, as a seasoned admin when I first started using cloud servers there were several things that were opaque to me and help like that would have been appreciated | 15:11 |
| mordred | jroll: because step 1 was always "do it by hand" - then step 2 was "automate what I did" | 15:11 |
| fungi | anteaya: weird. when i click "forgot password" it gives me a page with a form asking me to enter my e-mail address | 15:11 |
| mordred | jroll: if you do make such a thing, I recommend making it log what it did so that someone can use it to learn how to automate things in the fugture | 15:11 |
| jschwarz | fungi, enter your email for me please | 15:12 |
| fungi | anteaya: you're not getting that far? | 15:12 |
| jschwarz | and push the button | 15:12 |
| mordred | jroll: bonus points for the logs indicating in some manner where it got the info _from_ | 15:12 |
| anteaya | fungi: yes, fill in the form and click send | 15:12 |
| fungi | ahh | 15:12 |
| jroll | mordred: interesting idea, I like it :) | 15:12 |
| *** xwizard has joined #openstack-infra | 15:12 | |
| jschwarz | jackpot | 15:12 |
| mordred | jroll: "scsi id {x} retreived from metadata service /foo/bar/file.json - running iscsiadm do-something {x}" or something | 15:13 |
| jroll | right right | 15:13 |
| fungi | anteaya: yep, i can confirm as well. i'll see if we can fast-track a fix for this, but since it's the password reset on www.openstack.org (not really openstackid afaik) the correct bug reporting interface is the openstack-org tracker on launchpad | 15:13 |
| *** csomerville has joined #openstack-infra | 15:13 | |
| anteaya | fungi: may I leave this with you? | 15:13 |
| fungi | anteaya: you got it | 15:13 |
| anteaya | fungi: as I trust you have the fastrack power here | 15:13 |
| *** Jeffrey4l_ has quit IRC | 15:13 | |
| anteaya | my gratitude | 15:14 |
| anteaya | sleviim: thank you, you have helped us find a bug that needs fixing | 15:14 |
| anteaya | sleviim: you have made a wonderful contribution to openstack already and we are very grateful | 15:14 |
| anteaya | sleviim: well done | 15:14 |
| sleviim | anteaya: thank you for your time and all around! | 15:15 |
| anteaya | :) | 15:15 |
| anteaya | welcome | 15:15 |
| *** markusry has joined #openstack-infra | 15:15 | |
| *** cody-somerville has quit IRC | 15:16 | |
| fungi | anteaya: sleviim: jschwarz: smarcet is digging into it now | 15:18 |
| anteaya | fungi: sleviim jschwarz thank you | 15:18 |
| *** andreas_s has quit IRC | 15:18 | |
| fungi | hopefully i'll know something shortly | 15:18 |
| anteaya | awesome | 15:19 |
| mordred | fungi: while you're playing matchmaker ... | 15:19 |
| anteaya | sleviim: have a cup of tea, once we hear the reset password process is fixed we can try again | 15:19 |
| * fungi is now known as yenta | 15:19 | |
| mordred | fungi: we should probably try to facilitate some time for smarcet and craige to have some high-bandwidth overlap to poke at the pholio/openstackid issue | 15:19 |
| anteaya | fungi: I've always considered you yenta | 15:20 |
| anteaya | I just never said it out loud | 15:20 |
| sleviim | anteaya, yenta, smarcet: btw, this also happens when trying to register a new Foundation Member account | 15:20 |
| mordred | I have a hunch it's one of those "10 minutes of concentrated back and forth likely fix the issue" sorts of things | 15:20 |
| sleviim | so... :< | 15:20 |
| anteaya | sleviim: I believe it, lets ensure both workflows are tested when the fix is up | 15:20 |
| *** annegentle has joined #openstack-infra | 15:20 | |
| *** vhosakot has joined #openstack-infra | 15:21 | |
| *** Jeffrey4l_ has joined #openstack-infra | 15:22 | |
| *** berendt has quit IRC | 15:24 | |
| *** annegentle has quit IRC | 15:24 | |
| *** _coolsvap_ is now known as coolsvap | 15:24 | |
| jamesmcarthur | anteaya: fungi: The problem w/ the forgot password is fixed now. | 15:26 |
| jamesmcarthur | we had a problem with the silverstripe cache | 15:26 |
| openstackgerrit | Waldemar Znoinski proposed openstack-infra/glean: use /usr/lib/systemd/system to discover systemd init linux https://review.openstack.org/358713 | 15:26 |
| mordred | wznoinsk: wow | 15:27 |
| jamesmcarthur | mordred: I think you're right re: the pholio thing. smarcet: is taking a look at it, but might be easier to put them in a room together. | 15:28 |
| *** sleviim has quit IRC | 15:29 | |
| mordred | wznoinsk: seems TheJulia poked at this issue some too - https://review.openstack.org/#/c/279818/ ... might be worth reading the commen trail there | 15:29 |
| mordred | wznoinsk: (I am now doing that as well) | 15:29 |
| fungi | thanks jamesmcarthur! smarcet knocked that out remarkably quickly | 15:29 |
| wznoinsk | mordred: thanks | 15:30 |
| * TheJulia feels bad for not getting back to it | 15:30 | |
| fungi | i wonder if sleviim saw the update before leaving the channel | 15:30 |
| mordred | of course, the thing in the ubuntu wiki won't work | 15:30 |
| mordred | since dib is running in a chroot | 15:30 |
| mordred | so pid 1 isn't going to necessarily match, yeah? | 15:31 |
| TheJulia | nope, it won't | 15:31 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/puppet-infracloud: Fix infracloud public range gateway https://review.openstack.org/358718 | 15:31 |
| *** esikachev has joined #openstack-infra | 15:31 | |
| *** vincentll has quit IRC | 15:31 | |
| anteaya | fungi: I don't think so | 15:31 |
| anteaya | fungi: the person picked up on yenta so I have faith they will try tomorrow | 15:31 |
| mordred | zomg | 15:32 |
| mordred | This is required since systemd provides a file called "-.slice". After the shell has expanded the asterisk ("*"), that file gets passed to the command in question (grep, cat, etc) and that command will then attempt to interpret "-.slice" as a command-line option rather than a filename. | 15:32 |
| anteaya | jamesmcarthur: is a person able to create a new foundation membership as well? | 15:32 |
| anteaya | jamesmcarthur: sleviim reported that also was broken | 15:32 |
| *** armax has joined #openstack-infra | 15:33 | |
| jamesmcarthur | anteaya: sleviim: yes - all the same issue. Resolved for all users. | 15:33 |
| anteaya | jamesmcarthur: thank you | 15:33 |
| openstackgerrit | Merged openstack-infra/glean: Remove discover from test-requirements https://review.openstack.org/345797 | 15:33 |
| jamesmcarthur | np :) | 15:34 |
| zigo | mordred: Hi there! Do you know why the Debian mirror doesn't include a Release.gpg ? (ie: it cannot be authenticated and therefore, debootstrap for setting-up sbuild fails... see https://review.openstack.org/#/c/358715/ and it's log at http://logs.openstack.org/15/358715/1/check/pkgdeb-build-openstack-pkg-tools/cff6de2/console.html ) | 15:34 |
| fungi | zigo: are we mirroring with something other than reprepro? i thought its only option was to make a new release file... if so we'd need to sign that and add the key used to the secure-apt keychain on our job nodes | 15:36 |
| *** ifarkas is now known as ifarkas_afk | 15:37 | |
| zigo | fungi: Then probably we should switch to something else than reprepro. It seems really not adapted to mirroring. | 15:37 |
| zigo | fungi: It's really annoying to use httpredir, as it often fails. | 15:37 |
| zigo | (crc or size missmatch, and such) | 15:37 |
| mordred | we have discussed rsync, but nobody has implemented the work yet | 15:38 |
| fungi | zigo: yeah, reprepro's mirroring is targeted more at making partial or composite mirrors (where you would need fresh indexing) | 15:38 |
| pabelanger | it is on my list | 15:38 |
| mordred | pabelanger is a magical but busy human | 15:39 |
| zigo | Ok. | 15:39 |
| pabelanger | for now, I would not depend on Release.gpg | 15:39 |
| *** gyee has joined #openstack-infra | 15:39 | |
| *** asettle has joined #openstack-infra | 15:39 | |
| *** csomerville has quit IRC | 15:39 | |
| *** esikachev has quit IRC | 15:39 | |
| zigo | pabelanger: The issue is that it's a must for sbuild-create... | 15:39 |
| *** csomerville has joined #openstack-infra | 15:39 | |
| fungi | zigo: as for httpredir, that's basically unmaintained for a while now and people really shouldn't be relying on it (see the threads recently on debian-devel where Mithrandir was comparing with the cdn'd deb.debian.net service) | 15:39 |
| zigo | pabelanger: So my only option is to first setup using httpredir.debian.org, *THEN* edit sources.list and do a sbuild-update. | 15:39 |
| fungi | er, s/deb.debian.net/deb.debian/org/ | 15:40 |
| zigo | fungi: That's what Mithrandir wrote indeed, but Raphael Geisler (the author and maintainer of httpredir.debian.org) don't agree ! :) | 15:40 |
| *** harlowja_at_home has joined #openstack-infra | 15:40 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/puppet-infracloud: Fix infracloud public range gateway https://review.openstack.org/358718 | 15:41 |
| mordred | well, I mean, eventually we want to use neither around here | 15:41 |
| pabelanger | zigo: Ya, you'll have to do that for now. | 15:41 |
| zigo | Right. | 15:41 |
| rcarrillocruz | pabelanger: mind reviewing ^ | 15:41 |
| fungi | zigo: i thought raphael admitted it was mostly unmaintained for going on a year now? | 15:41 |
| rcarrillocruz | i totally forgot i had that as hardocded fix in-place, but that's kept in version control | 15:41 |
| rcarrillocruz | thus my latest deployments failed to get a sane route to the intarweb | 15:41 |
| zigo | fungi: "mostly unmaintained" is "quite ok" when written by Raphael. | 15:42 |
| fungi | zigo: i'll dig the thread back up, but i think he said he was going to try to start maintaining it properly again | 15:42 |
| *** matrohon has quit IRC | 15:42 | |
| fungi | zigo: as far as actually removing broken mirrors from it, for example | 15:42 |
| fungi | the broken mirror detection has been terrible in the httpredir backend for a while, to the point where it's not much better than just using a dns round-robin pool | 15:42 |
| rcarrillocruz | thx mordred pabelanger | 15:43 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Requirements repo publishes from master only https://review.openstack.org/358724 | 15:43 |
| *** baoli_ has quit IRC | 15:43 | |
| zigo | pabelanger: Your script should be picking-up a new build for subunit in a bit now. | 15:43 |
| zigo | pabelanger: I added a --force-orig-source when building with git-buildpackage, but I'm not sure if that's the right way. | 15:44 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Requirements repo publishes from master only https://review.openstack.org/358724 | 15:44 |
| zigo | pabelanger: Maybe I should first attempt to download the orig from our repo, see if it fails, and use that flag if we don't have the orig yet? | 15:44 |
| pabelanger | zigo: okay, I'll keep an eye out for the job | 15:45 |
| *** thiagolib has joined #openstack-infra | 15:45 | |
| zigo | mordred: Do you know reprepro's behavior in this regard? | 15:45 |
| pabelanger | zigo: Ya, that might work | 15:45 |
| zigo | pabelanger: I'm not so sure how querying for the existance of that file should be done though. Check if there's a 404 with wget? | 15:46 |
| mordred | zigo: I do not :( | 15:46 |
| pabelanger | zigo: Ya, that seems like the only way right now | 15:47 |
| zigo | Ok. | 15:47 |
| *** andreww has joined #openstack-infra | 15:49 | |
| *** ilyashakhat has joined #openstack-infra | 15:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Fetch server console log if ready_script fails https://review.openstack.org/358730 | 15:52 |
| *** Sukhdev has joined #openstack-infra | 15:52 | |
| *** _nadya_ has quit IRC | 15:53 | |
| rcarrillocruz | going afk for a bit, later folks | 15:53 |
| *** yamamoto has joined #openstack-infra | 15:54 | |
| *** sdake has quit IRC | 15:54 | |
| *** sdake has joined #openstack-infra | 15:55 | |
| pleia2 | good morning | 15:56 |
| fungi | zigo: yeah, on the "shutting down httpredir" thread, the last thing i saw from raphael was https://lists.debian.org/debian-project/2016/04/msg00025.html where he indicated in april that he though he would starting having time to maintain it again. given the #1 pain point is it sending people to broken mirrors (which seems to still be happening) and no further status updates to the ml, i suspect he | 15:56 |
| fungi | ended up not having as much time as he anticipated for supporting it after all | 15:56 |
| pleia2 | home now, wtih a working computer and my favorite keyboard :) | 15:56 |
| pleia2 | which apparently still doesn't help me type any better | 15:57 |
| *** weshay is now known as weshay_afk | 15:58 | |
| zigo | pabelanger: http://mirror.dfw.rax.openstack.org/debian-openstack/pool/main/s/subunit/ <--- Subunit got published as we expected! :) | 15:59 |
| zigo | I'm all set now, then ... | 15:59 |
| zigo | \o/ | 15:59 |
| zigo | Time to write the doc, i guess. | 15:59 |
| *** Swami has joined #openstack-infra | 15:59 | |
| zigo | Probably something to be done after the release though. | 15:59 |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron-lib source periodic job to networking-ovn https://review.openstack.org/357079 | 16:00 |
| * notmorgan yawns | 16:00 | |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: [trove] Add more nv scenario tests https://review.openstack.org/354881 | 16:00 |
| zigo | Hum... b3 is due next week, not end of this week, right? | 16:00 |
| *** Jeffrey4l_ has quit IRC | 16:00 | |
| * notmorgan sees is anyone else yawns (are yawns contagious over irc?) | 16:01 | |
| dmsimard | zigo: http://releases.openstack.org/newton/schedule.html | 16:01 |
| fungi | zigo: right... http://releases.openstack.org/newton/schedule.html | 16:01 |
| fungi | dmsimard is quick on the draw | 16:01 |
| *** yamamoto has quit IRC | 16:02 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup DocBook XML publishing https://review.openstack.org/358734 | 16:02 |
| dmsimard | zigo: so sept 1st | 16:02 |
| fungi | zigo: i think releases are usually on thursdays? in which case it'll probably be september 1 | 16:02 |
| pabelanger | zigo: and jessie-newton is correct, right? | 16:02 |
| dmsimard | fungi: again! *gun smoking* | 16:02 |
| *** puiterwi1 has joined #openstack-infra | 16:02 | |
| fungi | dmsimard you're like han solo over there | 16:02 |
| *** puiterwijk has quit IRC | 16:02 | |
| *** puiterwi1 is now known as puiterwijk | 16:02 | |
| zigo | pabelanger: Right. | 16:02 |
| mordred | notmorgan: :) | 16:03 |
| *** dgonzalez has quit IRC | 16:03 | |
| *** bradjones has quit IRC | 16:03 | |
| zigo | pabelanger: Now, I'm trying to add a change to subunit, and see if it breaks reimporting a new version or what ... | 16:03 |
| pabelanger | zigo: Nice, let fly the package builds | 16:03 |
| *** tonytan_brb has joined #openstack-infra | 16:03 | |
| *** katyafervent_awa has quit IRC | 16:03 | |
| zigo | pabelanger: My hope is to release all of Newton using -infra ! :) | 16:03 |
| pabelanger | Pretty cool: http://logs.openstack.org/10/10ce22854bc3d4bfd7e0d159ab1fbfb9f6c4dbe6/post/ | 16:03 |
| zigo | We're on good tracks to do that. | 16:03 |
| pabelanger | GPG signed too | 16:03 |
| zigo | Yup. | 16:04 |
| *** dteselkin has quit IRC | 16:04 | |
| pabelanger | zigo: Ya, that would be great | 16:04 |
| mordred | \o/ | 16:04 |
| mordred | so exciting! | 16:04 |
| zigo | pabelanger: Though we really need to have the public key published somewhere. | 16:04 |
| *** sshnaidm has quit IRC | 16:04 | |
| *** furlongm has joined #openstack-infra | 16:04 | |
| *** tlbr_ has quit IRC | 16:04 | |
| zigo | I doubled-guess it with the error from apt yelling about the (long) key ID. | 16:04 |
| zigo | :) | 16:04 |
| pabelanger | I think fungi has a change for that | 16:04 |
| nibalizer | oh right I should be attesting to the infra key huh | 16:04 |
| fungi | zigo: it's in progress. that depends on https://review.openstack.org/353692 | 16:04 |
| dmsimard | mordred: you're doing a good PTL job :p | 16:05 |
| zigo | fungi: I don't really see why this depends on HTTP. | 16:05 |
| *** amrith has quit IRC | 16:05 | |
| *** dgonzalez has joined #openstack-infra | 16:05 | |
| fungi | zigo: though the public key is already in the keyserver network with some of our signatures on it | 16:05 |
| *** prometheanfire has quit IRC | 16:05 | |
| zigo | HTTPS I mean. | 16:05 |
| fungi | zigo: just didn't want to be asserting key fingerprints on an http site | 16:05 |
| mordred | dmsimard: if by good job, you mean "doing literally nothing but standing here watching zigo and pabelanger be super productive" - then yes :) | 16:05 |
| zigo | fungi: Yeah, I saw that, and used it ! :) | 16:05 |
| *** eharney_ has joined #openstack-infra | 16:05 | |
| *** tonytan4ever has quit IRC | 16:05 | |
| *** aorourke has joined #openstack-infra | 16:05 | |
| *** dteselkin has joined #openstack-infra | 16:06 | |
| *** furlongm_ has quit IRC | 16:06 | |
| *** frickler has quit IRC | 16:06 | |
| *** bradjones has joined #openstack-infra | 16:06 | |
| *** bradjones has quit IRC | 16:06 | |
| *** bradjones has joined #openstack-infra | 16:06 | |
| zigo | fungi: Using https to assert the validity of a gpg key is a travesty... | 16:06 |
| zigo | fungi: I'm really much more comfortable with the key being signed by you. | 16:06 |
| *** esikachev has joined #openstack-infra | 16:06 | |
| fungi | zigo: the idea being that if people are going to that page to figure out the key fingerprint, then chances are they don't already have record of our individual public keys either, so having some semi-trusted channel for publishing the fingerprint is preferred | 16:06 |
| *** katyafervent_awa has joined #openstack-infra | 16:06 | |
| zigo | (which is what I checked) | 16:06 |
| *** prometheanfire has joined #openstack-infra | 16:06 | |
| *** e0ne_ has quit IRC | 16:07 | |
| zigo | fungi: A message to the mailing list with the repo's fingerprint in it, and signed by you would also be welcome. | 16:07 |
| fungi | i agree i find the assurances provided through the web of trust much stronger than https on a website, but it's at least something | 16:07 |
| zigo | Just my 2 cents ... | 16:07 |
| zigo | :) | 16:07 |
| fungi | zigo: also planned, i just wanted to make sure the info was also published on the releases site when i do that | 16:07 |
| *** frickler has joined #openstack-infra | 16:07 | |
| zigo | ok | 16:07 |
| fungi | i expect we're still a few weeks out from that | 16:07 |
| * zigo shuts up now and goes back to work. | 16:07 | |
| notmorgan | mordred: ++ | 16:07 |
| *** amrith has joined #openstack-infra | 16:08 | |
| fungi | but also the newton cycle key is sort of a dry run. not all our tarballs were signed with it either as it went into production halfway into the cycle | 16:08 |
| *** pkoniszewski has quit IRC | 16:08 | |
| notmorgan | mordred: but you're lieing - clearly you are not standing, you are lounging... and depending on the heat, by the pool | 16:08 |
| *** eharney has quit IRC | 16:08 | |
| notmorgan | mordred: ;) | 16:08 |
| *** eharney_ is now known as eharney | 16:09 | |
| mordred | notmorgan: you are, it turns out, correct | 16:10 |
| *** jamespage has quit IRC | 16:10 | |
| *** dougshelley66 has quit IRC | 16:10 | |
| fungi | zigo: but yeah, we're down to documenting now. there are various bits of operational and user-facing documentation i want to have in place prior to making a broad announcement | 16:10 |
| fungi | nearly done | 16:10 |
| *** bookwar has quit IRC | 16:10 | |
| *** pkoniszewski has joined #openstack-infra | 16:10 | |
| *** niska` has quit IRC | 16:11 | |
| *** niska has joined #openstack-infra | 16:11 | |
| *** salv-orlando has joined #openstack-infra | 16:11 | |
| *** dougshelley66 has joined #openstack-infra | 16:11 | |
| clarkb | good morning | 16:11 |
| *** asettle has quit IRC | 16:11 | |
| clarkb | mordred: I saw we go an occ release, did shade happen yet? | 16:11 |
| clarkb | I can help restart nodepool and check the private addr recording in osic if so | 16:12 |
| mordred | clarkb: nope. there was a little niggle which is in flight to fix it | 16:12 |
| clarkb | in shade? | 16:12 |
| *** bookwar has joined #openstack-infra | 16:12 | |
| mordred | no, in the interaction between occ and osc | 16:12 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Build wholedisk images capable of UEFI secure boot https://review.openstack.org/333888 | 16:12 |
| mordred | patch should be landing rsn | 16:12 |
| clarkb | huh ok | 16:13 |
| mordred | also, a gate job has been added to prevent such things from popping up in the future | 16:13 |
| *** jamespage has joined #openstack-infra | 16:13 | |
| *** tlbr has joined #openstack-infra | 16:13 | |
| *** jamespage has quit IRC | 16:13 | |
| *** jamespage has joined #openstack-infra | 16:13 | |
| *** Jeffrey4l_ has joined #openstack-infra | 16:14 | |
| *** sarob has joined #openstack-infra | 16:14 | |
| *** shashank_hegde has joined #openstack-infra | 16:15 | |
| *** csomerville has quit IRC | 16:15 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Send notifications to subscribers for worklists https://review.openstack.org/354730 | 16:16 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Spec for changing the block device handling https://review.openstack.org/336946 | 16:16 |
| *** jpich has quit IRC | 16:16 | |
| *** yamahata has quit IRC | 16:16 | |
| *** njohnston has joined #openstack-infra | 16:17 | |
| *** yaume_ has quit IRC | 16:18 | |
| clarkb | mordred: if the problem is between occ and osc why does shade care? couldnt we release shade and use the new occ? | 16:18 |
| anteaya | morning clarkb | 16:18 |
| anteaya | family is in the house, must be social and have lunch with them | 16:19 |
| *** tchaypo has quit IRC | 16:19 | |
| *** lindsayk has quit IRC | 16:19 | |
| *** samyewell has quit IRC | 16:19 | |
| clarkb | now I need breakfast | 16:19 |
| openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Run the AMQP 1.0 oslo.messaging tests on Python 3.4 https://review.openstack.org/358745 | 16:20 |
| *** samyewell has joined #openstack-infra | 16:21 | |
| *** lindsayk has joined #openstack-infra | 16:21 | |
| *** tchaypo has joined #openstack-infra | 16:21 | |
| *** csomerville has joined #openstack-infra | 16:23 | |
| *** asettle has joined #openstack-infra | 16:23 | |
| *** abregman_ has quit IRC | 16:23 | |
| mordred | clarkb: becuase shade has a functional test job that uses osc to find the image it should use for the test | 16:23 |
| *** Thelo_ has joined #openstack-infra | 16:24 | |
| *** vhosakot has quit IRC | 16:24 | |
| *** weshay_afk is now known as weshay | 16:24 | |
| mordred | clarkb: if the version of occ a shade patch needs messes up osc (the current problem) then the gate job won't work. shade _itself_ will work fine | 16:24 |
| mordred | this is why adding the gate job between occ and osc that was missing is important | 16:24 |
| mordred | so that we don't wind up in the weird combination game again | 16:24 |
| *** vhosakot has joined #openstack-infra | 16:25 | |
| *** DrifterZA has quit IRC | 16:26 | |
| *** esikachev has quit IRC | 16:27 | |
| *** tesseract- has quit IRC | 16:28 | |
| *** asettle has quit IRC | 16:28 | |
| *** stewie925 has quit IRC | 16:28 | |
| *** csomerville has quit IRC | 16:29 | |
| *** pcaruana has quit IRC | 16:29 | |
| *** stew925 has joined #openstack-infra | 16:30 | |
| karthikp_ | Hi, Please could somebody review this in their free time? Thanks! https://review.openstack.org/#/c/355678/ | 16:30 |
| *** shashank_hegde has quit IRC | 16:31 | |
| *** vhosakot has quit IRC | 16:31 | |
| *** mdrabe_ is now known as mdrabe | 16:32 | |
| *** lucasagomes is now known as lucas-afk | 16:32 | |
| *** Jeffrey4l_ has quit IRC | 16:33 | |
| jeblair | karthikp_: hi, most of us have very good systems for finding patches to review, and so it is not necessary to ask for reviews in channel, unless something is urgent enough that you think people need to stop what they are working on and look at your patch. | 16:33 |
| jeblair | karthikp_: if that is the case, please don't just link to the change, also include a reason for why it is urgently needed. | 16:33 |
| *** sandanar has joined #openstack-infra | 16:33 | |
| jeblair | karthikp_: in the case of a grenade patch, you may find more interested reviewers in the #openstack-qa channel | 16:34 |
| *** claudiub has joined #openstack-infra | 16:34 | |
| *** eharney_ has joined #openstack-infra | 16:35 | |
| pabelanger | jeblair: clarkb: So, we're averaging 2 launch failures an a hour OSIC. Way down from last week | 16:36 |
| jeblair | pabelanger: that's due to the urandom fix? | 16:36 |
| *** matthewbodkin has quit IRC | 16:36 | |
| jeblair | pabelanger: (i mean, the improvement is due to that?) | 16:36 |
| clarkb | pabelanger: you had mentioned that you had some newton on xenail changes last week? Where can I find them? (not finding them quickly by searching for changes owned by you) | 16:36 |
| clarkb | pabelanger: or maybe you have unwritten changes for that that you want to write? | 16:37 |
| *** harlowja_at_home has quit IRC | 16:37 | |
| karthikp_ | jeblair: This is kind of urgent. We need to have this merged so that we can start testing our gate job on cinder patches for newton. I have tried pinging folks in openstack-qa..but i almost never get a good response. But I will try | 16:37 |
| *** jmccrory_away is now known as jmccrory | 16:37 | |
| *** dimtruck is now known as zz_dimtruck | 16:37 | |
| *** eharney has quit IRC | 16:37 | |
| jeblair | karthikp_: are you aware of "Depends-On:"? | 16:38 |
| pabelanger | jeblair: Yes, the pump is working great. We still have a few DNS failures, I haven't had a chance to debug them yet. It might be possible the pump is fill slower then expected in those cases | 16:38 |
| mugsie | hey - is there anyone who can do a osc-lb release? | 16:39 |
| clarkb | pabelanger: a long shot possibility for thsoe failures is we are still using ipv4 dns lookups and nat is failing (though I think that is unlikely) | 16:39 |
| mugsie | We are blocked by a broken os-client-config as the released version of osc-lib does not have the new version blacklisted ... and it is breaking things for the python-designateclient tests | 16:40 |
| mordred | mugsie: it's in work | 16:40 |
| pabelanger | clarkb: right, I think we are still racing for DNS. https://review.openstack.org/#/c/355695/ will protect better on that I think | 16:40 |
| mugsie | mordred: sweet | 16:40 |
| mugsie | just saw *all* of our patches failing :( | 16:41 |
| pabelanger | clarkb: https://review.openstack.org/#/c/352614/ was the tox changes, I need to clean it up still | 16:41 |
| mordred | mugsie: yah. it's an unhappy | 16:41 |
| *** erlon has joined #openstack-infra | 16:41 | |
| mordred | mugsie: fwiw, osc-lib stuff and humans exist in #openstack-sdks - should you ever need to poke deeper | 16:41 |
| mugsie | -_- | 16:41 |
| mugsie | of course | 16:41 |
| mugsie | I even have it open | 16:42 |
| clarkb | pabelanger: thanks, I updated the topic so that I can find it again when its cleaned uip | 16:42 |
| pabelanger | jeblair: clarkb: I also started on https://review.openstack.org/#/c/358730/ this morning, adding an option to nodepool to fetch console logs if our ready-script fails | 16:42 |
| pabelanger | clarkb: thanks | 16:42 |
| clarkb | pabelanger: keep in mind that some clouds don't allow console log fetching so we need to handle failure gracefully there | 16:42 |
| pabelanger | clarkb: Ya, mordred added that into shade I believe | 16:43 |
| *** ilyashakhat has quit IRC | 16:43 | |
| mordred | yup | 16:44 |
| *** eharney_ is now known as eharney | 16:44 | |
| *** Goneri has quit IRC | 16:44 | |
| mordred | clarkb: https://review.openstack.org/#/c/358232/ | 16:44 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Fix infracloud public range gateway https://review.openstack.org/358718 | 16:44 |
| *** tphummel has joined #openstack-infra | 16:45 | |
| mordred | clarkb: it returns empty string if the cloud does not support console logs | 16:45 |
| *** vhosakot has joined #openstack-infra | 16:45 | |
| *** rwsu has joined #openstack-infra | 16:46 | |
| clarkb | mordred: are the failed jobs there related to the osc/occ thing? | 16:47 |
| mordred | yes | 16:47 |
| mordred | will recheck as soon as the osc 3.0.1 lands | 16:47 |
| mordred | clarkb: https://review.openstack.org/#/c/358757/ | 16:48 |
| *** Goneri has joined #openstack-infra | 16:50 | |
| *** _nadya_ has joined #openstack-infra | 16:50 | |
| jeblair | pabelanger: i'm confused by that -- if the ready script fails, i would think that the output of the ready script would be the most important thing. i think it would be a fairly rare case that one would need the console log. | 16:50 |
| jeblair | pabelanger: i'm pretty sure we do output the ready script output on failure, so i'm confused by the statement that "we are blind to what the possible failures are" | 16:51 |
| *** sshnaidm has joined #openstack-infra | 16:51 | |
| mordred | jeblair: I believe a lot of the recent ready script failures have been caused by things that need info from the console log to diagnose. it may not be a generally true statement | 16:52 |
| fungi | jeblair: my understanding is that we want console logs recorded on nodepool's failure to connect to the node to run the ready script | 16:53 |
| *** jerryz has joined #openstack-infra | 16:53 | |
| *** yamahata has joined #openstack-infra | 16:53 | |
| mordred | yah | 16:53 |
| mordred | that | 16:53 |
| jeblair | fungi: that is an entirely different situation! :) | 16:53 |
| fungi | so less that the ready scripts are a problem, but that we need to diagnose why nodepool can't connect and run them | 16:53 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 16:53 |
| jeblair | however it is not what the patch says it does, nor is it what the patch does | 16:53 |
| jeblair | but i could get behind *that* | 16:53 |
| fungi | yeah, i haven't seen this new patch yet | 16:53 |
| openstackgerrit | Petr Kovar proposed openstack-infra/project-config: Add Install Guide Jobs to Barbican https://review.openstack.org/358769 | 16:54 |
| mordred | fungi says better words than me | 16:54 |
| fungi | more just regurgitating what we'd discussed wanting last week | 16:54 |
| fungi | so maybe that got translated incorrectly into code | 16:54 |
| *** dims has quit IRC | 16:54 | |
| fungi | ahh, 358730 (missed in my earlier skimming) | 16:55 |
| *** jaosorior has quit IRC | 16:55 | |
| pabelanger | jeblair: yes, it is poorly written. The goal was to have nodepool collect additional debug logs, if the ready-script failed, rather then expand our ready-script to start collecting logs | 16:55 |
| *** derekh has quit IRC | 16:55 | |
| *** nwkarste_ has quit IRC | 16:56 | |
| *** dims has joined #openstack-infra | 16:56 | |
| jeblair | pabelanger: right, but this patch collects the logs on any failure -- i think it would be better to collect them only on connection failure. also, i think we would not need to make it optional in that case. | 16:56 |
| clarkb | mordred: commented on 358232 | 16:56 |
| zigo | telnet://169.45.71.90:19885/ <-- This one seem to have died. | 16:56 |
| zigo | pabelanger: What to do in such a case? | 16:57 |
| pabelanger | jeblair: sure, I can make those changes | 16:57 |
| *** nwkarsten has joined #openstack-infra | 16:57 | |
| *** ManishD has joined #openstack-infra | 16:57 | |
| ManishD | HI, I see Xen CI failure for various patches on review board with the following error: tempest.exceptions.TimeoutException: Request timed out | 16:57 |
| ManishD | Appears issue with Xen infra, can someone help or take care of it | 16:57 |
| ManishD | Its afecting many patches | 16:57 |
| jeblair | pabelanger: cool. i also left some review comments. | 16:57 |
| mordred | clarkb: thanks! | 16:58 |
| clarkb | ManishD: you will need to contact the Xen CI folks. There should be an email addr associated with the account leaving the gerrit comments or you can look up the CI details on the wiki | 16:58 |
| *** lucas-afk is now known as lucasagomes | 16:58 | |
| fungi | pabelanger: after reading through the implementation you went with in 358730, i'm in agreement with jeblair. it does what i think we want, just needs to do it under the specific circumstances we want. if the connection succeeds but the script fails, what sorts of failure modes are you envisioning where the ready script couldn't collect and output the debug info we want? | 16:59 |
| openstackgerrit | Merged openstack/diskimage-builder: Add "audit"package to yum-minimal https://review.openstack.org/352263 | 17:00 |
| *** aviau_ has quit IRC | 17:00 | |
| ManishD | thanks clarkb | 17:00 |
| cloudnull | pabelanger: if you can forward me a list of the failures I can poke at those specific hosts to make sure there are no issues on the backend . | 17:00 |
| cloudnull | re: OSIC launch failures due to DNS | 17:01 |
| *** hashar has quit IRC | 17:01 | |
| fungi | ManishD: i think BobBall works on the xen ci, or at least might know what's going on with it. for the ci-specific pages with contact information, there's an index at https://wiki.openstack.org/wiki/ThirdPartySystems | 17:01 |
| *** nwkarsten has quit IRC | 17:01 | |
| ManishD | Thanks fungi | 17:02 |
| pabelanger | cloudnull: 832d7125-20a3-454a-ba35-7e0db607fbe7 is the most recent | 17:02 |
| cloudnull | ok | 17:03 |
| *** csomerville has joined #openstack-infra | 17:03 | |
| *** Thelo_ has quit IRC | 17:04 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Ensure per-resource caches work without global cache https://review.openstack.org/358776 | 17:04 |
| pabelanger | cloudnull: 4380baac-8925-46ee-a712-c4daf98e5f1b just failed | 17:06 |
| *** amotoki has quit IRC | 17:06 | |
| *** tonytan4ever has joined #openstack-infra | 17:06 | |
| *** ilyashakhat has joined #openstack-infra | 17:06 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add support for fetching console logs from servers https://review.openstack.org/358232 | 17:06 |
| *** inc0 has quit IRC | 17:07 | |
| *** baoli has joined #openstack-infra | 17:07 | |
| *** csomerville has quit IRC | 17:08 | |
| *** inc0 has joined #openstack-infra | 17:08 | |
| *** tonytan_brb has quit IRC | 17:08 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add Worklists and Boards to About Page https://review.openstack.org/355912 | 17:10 |
| *** sarob has quit IRC | 17:11 | |
| *** zz_dimtruck is now known as dimtruck | 17:12 | |
| *** sarob has joined #openstack-infra | 17:12 | |
| clarkb | mordred: slight worry that by saying not '' then b'' and u'' both become valid (depending on version of python) | 17:13 |
| *** tqtran has joined #openstack-infra | 17:13 | |
| clarkb | but I guess the '' comes from shade itself and not novaclient so we don't ahve to worry about the return typeschangign under us | 17:13 |
| *** mikelk has quit IRC | 17:13 | |
| mordred | clarkb: oy. do you think we shold do len(log) != 0 instead? | 17:14 |
| clarkb | mordred: ya I Think that would be slightly ebtter | 17:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Ensure per-resource caches work without global cache https://review.openstack.org/358776 | 17:14 |
| fungi | clarkb: does using an explicit inequality operator work around that behavior? | 17:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add support for fetching console logs from servers https://review.openstack.org/358232 | 17:15 |
| mordred | fungi: nope. just checked | 17:15 |
| mordred | >>> b'' == u'' | 17:15 |
| mordred | False | 17:15 |
| fungi | oh, i see, python3 considers b'' different from '' and u'' | 17:15 |
| fungi | but python2.7 considers them all equal | 17:16 |
| clarkb | mordred: thats better thanks +2 | 17:16 |
| fungi | just tested myself | 17:16 |
| mordred | woot! | 17:16 |
| *** tqtran has quit IRC | 17:17 | |
| *** csomerville has joined #openstack-infra | 17:21 | |
| *** berendt has joined #openstack-infra | 17:21 | |
| *** sputnik13 has joined #openstack-infra | 17:23 | |
| jeblair | aww, i'm too late to make a log(len) != 0 joke | 17:23 |
| openstackgerrit | Roopak Parikh proposed openstack-infra/project-config: Adnreas, would you be able to review the changes, I have incorporated your feedback. https://review.openstack.org/358782 | 17:23 |
| cloudnull | pabelanger: nothing of any real note on those compute nodes. | 17:23 |
| mordred | jeblair: it's never too late for a log(len) != 0 joke | 17:23 |
| *** edtubill has joined #openstack-infra | 17:24 | |
| cloudnull | both instances are running of different compute nodes and both nodes have other VMs running without issues. | 17:24 |
| cloudnull | nothing notable in the lgos | 17:24 |
| cloudnull | **logs | 17:24 |
| cloudnull | :| | 17:24 |
| *** asettle has joined #openstack-infra | 17:25 | |
| clarkb | cloudnull: any chance it isn't difficult to see if there was nat trouble? running out of ports or similar? (I have no idea how difficult it is to check that with the neutron NAT setup) | 17:25 |
| *** ddieterly is now known as ddieterly[away] | 17:25 | |
| *** shashank_hegde has joined #openstack-infra | 17:26 | |
| *** e0ne has joined #openstack-infra | 17:26 | |
| cloudnull | I can. just a moment | 17:27 |
| zigo | pabelanger: mordred: fungi: It looks like reprepro doesn't mind if I always build with --force-orig-source, and the orig file always being referenced in the .changes, so I'll continue this way. | 17:28 |
| zigo | :) | 17:28 |
| *** rajinir has joined #openstack-infra | 17:28 | |
| *** inc0 has quit IRC | 17:28 | |
| mordred | zigo: excellnet | 17:29 |
| zigo | Now, I'll play the "temporarily disable test and remove unavailable build-depends" game for a bit ... | 17:29 |
| *** AJaeger has joined #openstack-infra | 17:31 | |
| *** asettle has quit IRC | 17:31 | |
| *** phschwartz has quit IRC | 17:31 | |
| *** ManishD has quit IRC | 17:33 | |
| pabelanger | cloudnull: Ya, I suspect in some cases 30 second timeout on host git.openstack.org is not long enough | 17:33 |
| *** tqtran has joined #openstack-infra | 17:35 | |
| *** cody-somerville has joined #openstack-infra | 17:36 | |
| pabelanger | clarkb: did we want to pull the trigger on https://review.openstack.org/#/c/357356/ and ride out our current launch node errors? Currently we see 2 an hour, upgrading we should be at 4\ | 17:36 |
| *** csomerville has quit IRC | 17:38 | |
| *** inc0 has joined #openstack-infra | 17:39 | |
| *** Thelo_ has joined #openstack-infra | 17:39 | |
| *** aviau has joined #openstack-infra | 17:40 | |
| *** zul has quit IRC | 17:40 | |
| *** raunak has joined #openstack-infra | 17:41 | |
| *** sandanar has quit IRC | 17:42 | |
| rajinir | Was anything changed in the devstak-gate? Thepre-hook script is failing and not able to find the / are failing, /opt/stack/new/devstack/local.conf: No such file or directory. | 17:43 |
| AJaeger | Hi team, I'm back and slowly trying to catch up.... | 17:43 |
| *** lucasagomes is now known as lucas-dinner | 17:43 | |
| *** e0ne has quit IRC | 17:43 | |
| *** sambetts is now known as sambetts|afk | 17:43 | |
| AJaeger | could I get a review on https://review.openstack.org/358724, please? As part of the xenial move, we added publishing of docs for requirements repo on stable branches - but those are not ready ;( Thus, no changes can merge to stable/liberty for requirements repo | 17:44 |
| *** Apoorva has joined #openstack-infra | 17:44 | |
| anteaya | AJaeger: welcome back | 17:45 |
| anteaya | AJaeger: tell me about the sea | 17:45 |
| rajinir | :q | 17:46 |
| *** e0ne has joined #openstack-infra | 17:46 | |
| *** zul has joined #openstack-infra | 17:48 | |
| *** notnownikki has quit IRC | 17:48 | |
| AJaeger | anteaya: nice - not too warm (but that meant only one time swimming in the sea - but dipping my feet every day;-). Lots of relaxing and having fun with the kids... | 17:48 |
| *** berendt has quit IRC | 17:48 | |
| anteaya | yay! | 17:48 |
| anteaya | congratulations | 17:48 |
| AJaeger | thanks | 17:49 |
| anteaya | that sounds wonderful | 17:49 |
| AJaeger | it was - the kids were super-happy and then I'm as well ;) | 17:49 |
| clarkb | pabelanger: ya I think we should do that 2/hour is fairly low | 17:50 |
| AJaeger | thanks, anteaya and pleia2 for the reviews | 17:50 |
| clarkb | pabelanger: and we will just have to keep an eye on it to make sure it doesn't get much worse with the doubled quota | 17:50 |
| clarkb | pabelanger: want me to approve? | 17:50 |
| *** Goneri has quit IRC | 17:50 | |
| anteaya | AJaeger: nice :) | 17:50 |
| anteaya | happy kids! | 17:51 |
| AJaeger | jamespage: Do you know why https://review.openstack.org/354917 fails? Something wrong with the Canonical CI? | 17:52 |
| pabelanger | clarkb: agreed, I plan on debugging it still. I'd like to see 0 if possible! | 17:52 |
| anteaya | AJaeger: well it is nice to have you back | 17:52 |
| pabelanger | clarkb: feel free to approve | 17:52 |
| pabelanger | clarkb: OVH launch errors are down too | 17:52 |
| AJaeger | anteaya: thanks. I noticed that the time for Newton is closing and thus pushed some docs releases out ;) | 17:53 |
| clarkb | ya just compared to other clouds I think 2/hour isn't crazy | 17:53 |
| clarkb | I approved it | 17:53 |
| anteaya | AJaeger: you observant person, you :) | 17:53 |
| clarkb | cloudnull: fyi ^ just approved the chagne to double the osic nodepool quota | 17:53 |
| *** kzaitsev_mb has quit IRC | 17:53 | |
| openstackgerrit | Merged openstack-infra/project-config: Set the launchpad name for api-wg https://review.openstack.org/355885 | 17:53 |
| clarkb | pabelanger: and with https://review.openstack.org/#/c/355695/1/nodepool/scripts/configure_mirror.sh the thought is that if we wait long enough we will see dns resolution eventually succeed? I guess there isn't much harm in trying that | 17:53 |
| clarkb | will require an image rebuild though | 17:54 |
| clarkb | (keep that in mind when determiningif it helped) | 17:54 |
| fungi | clarkb: pabelanger: though as we grow these, we need to continue keeping an eye on performance of the mirror server there, but also central resources such as our git farm | 17:54 |
| AJaeger | Time for final cleanup of DocBook XML building: https://review.openstack.org/#/c/358446 and https://review.openstack.org/#/c/358734 (currently WIP while I discuss) | 17:54 |
| clarkb | fungi: yup | 17:54 |
| *** DrifterZA has joined #openstack-infra | 17:54 | |
| fungi | i'm excited that we've got providers coming online with increasing amounts of capacity--i still expect that we're going to discover new and previously unknown scaling issues with our architecture as we do that | 17:55 |
| pabelanger | clarkb: right, there is a race between ssh and unbound before of the default systemd configuration. So if check dns a few times, I am hoping it will work | 17:55 |
| *** ramishra has quit IRC | 17:55 | |
| clarkb | pabelanger: oh systemd can start ssh before unbound even when we don't have urandom issues? gotcha | 17:55 |
| *** ramishra has joined #openstack-infra | 17:55 | |
| mordred | fungi: I'm excited to discover those new and exciting scaling issues | 17:55 |
| clarkb | fungi: fwiw the mirror in osic looks very happy | 17:56 |
| anteaya | yay happy mirror | 17:56 |
| clarkb | fungi: its pushing a lot of bits but memory/cpu/disk/etc are happyness | 17:56 |
| *** tosky has quit IRC | 17:56 | |
| clarkb | the git farm is likely the one to watch | 17:56 |
| sc68cal | mordred: just catching up, see your gate error | 17:56 |
| *** bnemec-pto is now known as bnemec | 17:56 | |
| sc68cal | mordred: did you figure it out, or is it still an issue | 17:57 |
| fungi | clarkb: agreed. from what i gather there's not a lot of tenant contention in osic (yet), and no bandwidth caps | 17:57 |
| mordred | sc68cal: figured it out - thanks! | 17:57 |
| *** e0ne has quit IRC | 17:57 | |
| clarkb | and once this osc/occ/shade business is sorted out we can have osic run multinode jobs again | 17:57 |
| mordred | ++ | 17:58 |
| pabelanger | yay | 17:58 |
| mordred | cloudnull, pabelanger: out of curiosity - anything weird with 2001:4800:1ae1:18:f816:3eff:fe18:3343 that you can see? I'm showing that as running a test, but I cannot nc 2001:4800:1ae1:18:f816:3eff:fe18:3343 19885 ... it just hangs | 17:58 |
| fungi | mordred: ssh to it hangs too. i encountered a couple last week in a similar situation | 17:59 |
| pabelanger | mordred: it just got deleted | 18:00 |
| fungi | and there it goes | 18:00 |
| cloudnull | mordred: telnet was working | 18:00 |
| fungi | yep | 18:00 |
| fungi | i suspect most of my issue was bad luck and lagging zuul status | 18:00 |
| jamespage | AJaeger, yeah - transient dependency issue - should be resolved now | 18:00 |
| jamespage | charm-recheck should trigger that check again | 18:00 |
| mordred | ah - neat | 18:01 |
| *** Goneri has joined #openstack-infra | 18:01 | |
| *** phschwartz has joined #openstack-infra | 18:01 | |
| mordred | cloudnull: wait - telnet was working for you? | 18:01 |
| cloudnull | it was. | 18:01 |
| openstackgerrit | Merged openstack-infra/project-config: Requirements repo publishes from master only https://review.openstack.org/358724 | 18:01 |
| openstackgerrit | Merged openstack-infra/project-config: Increase the quota in the OSIC cloud1 https://review.openstack.org/357356 | 18:02 |
| mordred | hrm. so ... that might be some sort of clue - it was not working for me | 18:02 |
| *** _ari_ has quit IRC | 18:02 | |
| *** _ari__ has joined #openstack-infra | 18:02 | |
| mordred | I wonder if somewhere something evil happened with routing such that you have a route to it but outside doesn't | 18:02 |
| cloudnull | mordred: https://snag.gy/uW3Hfh.jpg | 18:02 |
| cloudnull | just a screen shot of my connection before i killed it | 18:02 |
| *** _ari__ has quit IRC | 18:02 | |
| cloudnull | and i hit return a few times to make sure new data was coming in | 18:02 |
| *** _ari_ has joined #openstack-infra | 18:02 | |
| mordred | cloudnull: neat. yeah - I got absolutely nothing | 18:02 |
| anteaya | yay 250 more nodes | 18:03 |
| anteaya | thanks cloudnull | 18:03 |
| cloudnull | mordred: :\ | 18:03 |
| cloudnull | mordred: cloud? | 18:03 |
| cloudnull | :) | 18:03 |
| mordred | cloudnull: cloud | 18:03 |
| cloudnull | anteaya: :D | 18:03 |
| anteaya | yay \o/ | 18:03 |
| cloudnull | clarkb: after digging in I can't see any smoking guns that would be impacting NAT+Neutron. we've lots of active ports but not a bazillion, no orphans and nothing off w/ the l3 agent etc that would impact the v6 GATEWAY NET. | 18:04 |
| cloudnull | ima follow up with some of our netsec folks and see if they see anything upstream, but from where I am it all LGTM | 18:04 |
| *** bin_ has quit IRC | 18:04 | |
| clarkb | cloudnull: ya I think that pabelangers theory that ssh comes up before unbound is likely the cause | 18:04 |
| * clarkb makes a script to forward ipv6 nc through irc screen box | 18:05 | |
| mordred | if only there was a straightforward way to run startup scripts in a predictable order | 18:05 |
| clarkb | or maybe I just need an alias | 18:05 |
| cloudnull | mordred: maybe one day. | 18:06 |
| clarkb | mordred: I do have to say systemd is an improvement over upstart. Particularly since it seems to properly organize sysv init scripts | 18:06 |
| mordred | no arguments | 18:07 |
| cloudnull | we should design a new system! we could call it ^sys | 18:07 |
| bkero | openrc p good :) | 18:07 |
| cloudnull | or maybe just ΛɯǝʇsʎS | 18:08 |
| openstackgerrit | Merged openstack-infra/project-config: Add smarter dns checking for configure_mirror.sh https://review.openstack.org/355695 | 18:08 |
| cloudnull | that be a good name for an init system | 18:08 |
| openstackgerrit | Merged openstack-infra/project-config: Update networking-ovn grafana dashboard https://review.openstack.org/356511 | 18:09 |
| mordred | cloudnull: that would be the best init system | 18:09 |
| AJaeger | thanks, jamespage | 18:09 |
| *** nwkarsten has joined #openstack-infra | 18:10 | |
| *** dtantsur is now known as dtantsur|afk | 18:11 | |
| clarkb | my favorite is when you run jenkins in docker | 18:11 |
| clarkb | then jenkins is your zombie reaper (it doesn't work) | 18:11 |
| *** eranrom has joined #openstack-infra | 18:13 | |
| *** e0ne has joined #openstack-infra | 18:14 | |
| *** pvaneck has joined #openstack-infra | 18:15 | |
| *** andreww is now known as xarses | 18:16 | |
| AJaeger | pabelanger: is https://review.openstack.org/#/c/355203/ now fine? That's the puppet change for bindep.txt. | 18:20 |
| pabelanger | AJaeger: it is! +3 | 18:21 |
| AJaeger | thanks! That unblocks a few of my changes ;) | 18:23 |
| *** vhosakot has quit IRC | 18:24 | |
| *** e0ne has quit IRC | 18:25 | |
| *** vhosakot has joined #openstack-infra | 18:25 | |
| *** ddieterly[away] has quit IRC | 18:26 | |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: [trove] Add more nv scenario tests https://review.openstack.org/354881 | 18:26 |
| AJaeger | fungi, thanks for answering the bindep questions on the mailing list while I was gone! | 18:27 |
| fungi | AJaeger: my pleasure | 18:27 |
| *** sdake has quit IRC | 18:29 | |
| AJaeger | fungi, you mentioned that you wanted to add some examples to the docs. Have you done this? I can help as well... | 18:29 |
| rajinir | Solved my CI failure. It was jenkins security issue and wasn't passing parameters | 18:29 |
| fungi | AJaeger: i haven't yet. i was just going to cut and paste one or two of our example additions and add a section in the bindep docs for them with some explanatory prose for each | 18:29 |
| fungi | AJaeger: but if you have a moment to tackle that, i'm happy for you to put it together | 18:30 |
| *** e0ne has joined #openstack-infra | 18:30 | |
| *** timello has quit IRC | 18:30 | |
| AJaeger | fungi, let me give it a try - and feel free to take over if you have other ideas ;) | 18:30 |
| *** hpe-hj has quit IRC | 18:31 | |
| *** ddieterly has joined #openstack-infra | 18:31 | |
| *** ilyashakhat has quit IRC | 18:33 | |
| *** markvoelker has quit IRC | 18:33 | |
| *** ddieterly is now known as ddieterly[away] | 18:34 | |
| *** DrifterZA has quit IRC | 18:36 | |
| *** _nadya_ has quit IRC | 18:36 | |
| openstackgerrit | Merged openstack-infra/project-config: Update puppet integration jobs to use bindep.txt https://review.openstack.org/355203 | 18:36 |
| *** piet has joined #openstack-infra | 18:37 | |
| *** timello has joined #openstack-infra | 18:38 | |
| asselin | rcarrillocruz, you around? ansible launch node isn't working anymore...somehow the ansible_ssh_private_key_file fact isn't getting set. Do you have time to help debug? | 18:38 |
| *** kushal has quit IRC | 18:40 | |
| asselin | rcarrillocruz, pre_tasks doesn't seem to be executed before trying to connect to the server....?? | 18:40 |
| *** e0ne has quit IRC | 18:40 | |
| *** florianf has quit IRC | 18:43 | |
| clarkb | http://paste.openstack.org/show/562259/ is my script for the ipv6 challenged (like me!) that want to use a simple ssh proxy to cat the job console logs | 18:45 |
| clarkb | pabelanger: ^ fyi, not sureif you got your HE tunnel going | 18:45 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/bindep: Give some examples https://review.openstack.org/358811 | 18:45 |
| AJaeger | fungi ^ | 18:45 |
| clarkb | also taht took far too long to get right :\ but still less time than derping with a tunnel I guess | 18:46 |
| *** Na3iL has quit IRC | 18:47 | |
| pabelanger | clarkb: Nice. Ya, I have my 6to4 tunnel setup. But haven't tested | 18:47 |
| pabelanger | should do that now | 18:47 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Add curl to the list of packages https://review.openstack.org/358636 | 18:47 |
| AJaeger | project-config cores, could I get some review love on https://review.openstack.org/#/c/358446/ - to remove DocBook publishing from trove - trove removed the content some weeks ago... | 18:52 |
| *** cody-somerville has quit IRC | 18:53 | |
| *** piet has quit IRC | 18:54 | |
| *** Hal has quit IRC | 18:54 | |
| *** Hal has joined #openstack-infra | 18:55 | |
| *** Sukhdev has quit IRC | 18:55 | |
| *** piet has joined #openstack-infra | 18:55 | |
| pabelanger | 512 nodes in osic just went live! http://grafana.openstack.org/dashboard/db/nodepool-osic | 18:56 |
| *** e0ne has joined #openstack-infra | 18:56 | |
| *** ddieterly[away] is now known as ddieterly | 18:56 | |
| *** piet has quit IRC | 18:57 | |
| AJaeger | woot! Thanks, cloudnull and osic! | 18:58 |
| pleia2 | :) | 18:58 |
| *** cody-somerville has joined #openstack-infra | 18:59 | |
| *** cody-somerville has quit IRC | 18:59 | |
| *** cody-somerville has joined #openstack-infra | 18:59 | |
| pleia2 | pabelanger: that sails us way over 1000 for the first time, I think | 19:00 |
| rcarrillocruz | asselin: not really around, but there haven't been any new changes to the role or the unmerged launch playbook you are using, so shoulud be environmental to the Ansible distro? not running pre-tasks sounds like an Ansible ansible problem to me | 19:01 |
| *** Goneri has quit IRC | 19:01 | |
| *** csomerville has joined #openstack-infra | 19:02 | |
| cloudnull | woot! | 19:03 |
| pabelanger | pleia2: our best was 1.209k nodes back in Janurary: http://grafana.openstack.org/dashboard/db/zuul-status?from=1440270204035&to=1471892604035 | 19:03 |
| pabelanger | were at 1.199k now I think | 19:03 |
| pleia2 | pabelanger: aha, so close :) | 19:03 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add deb-python-fixtures to packaging-deb https://review.openstack.org/358819 | 19:04 |
| AJaeger | jamespage: what's the OpenStack charms channel you use? | 19:04 |
| pleia2 | so I guess this is the best post HPE Cloud | 19:04 |
| pabelanger | pleia2: we'll pass it soon enough. We have a new cloud from OSIC to bring online, cloud8! | 19:04 |
| clarkb | one short of cloud 9 | 19:04 |
| AJaeger | jamespage: nevermind, found it | 19:04 |
| pabelanger | just waiting for some DNS and SSL configuration to be finished | 19:04 |
| pleia2 | pabelanger: awesome :) | 19:05 |
| zigo | pabelanger: fungi: Could you allow deb-python-fixtures ? | 19:05 |
| zigo | It's missing, and blocking. | 19:05 |
| *** cody-somerville has quit IRC | 19:05 | |
| clarkb | it almost looks like nodepool is making the instances quicker than zuul/gearman can schedule them | 19:07 |
| anteaya | clarkb: what is happening? | 19:08 |
| anteaya | have we encountered a new scaling bug? | 19:08 |
| *** Thelo__ has joined #openstack-infra | 19:08 | |
| anteaya | mordred: ^^ | 19:08 |
| clarkb | anteaya: maybe, I have a feeling it will settle itself out when we aren't building 200 something nodes at once | 19:09 |
| pabelanger | we just build 307 instances in osic-cloud1 with out a single launch failure | 19:09 |
| clarkb | its possible the job registrations on the gearman side are progressing sl owly | 19:09 |
| anteaya | pabelanger: wooot! | 19:09 |
| pabelanger | clarkb: ya, it looks like that | 19:09 |
| anteaya | clarkb: yeah, 307 nodes at once is a bit unusual | 19:09 |
| clarkb | I think once we reach a steadier state it will be less noticeable | 19:09 |
| clarkb | its just the big jump that is a problem | 19:10 |
| cloudnull | pabelanger: NICE! | 19:10 |
| anteaya | it is a great problem | 19:10 |
| anteaya | cloudnull: thank you for the problem | 19:10 |
| cloudnull | you're welcome? | 19:10 |
| anteaya | ha ha ha | 19:10 |
| *** Thelo_ has quit IRC | 19:10 | |
| *** Thelo__ is now known as Thelo_ | 19:10 | |
| pabelanger | clarkb: ya, starting to get assigned now | 19:11 |
| pabelanger | since no launch failures in osic-cloud1 | 19:11 |
| pabelanger | s/since/still* | 19:11 |
| anteaya | yay | 19:11 |
| clarkb | pabelanger: the time to ready did jump up but i think that may also be another steady state less problematic issue. Likely cauise for that is thread starvation in nodepool just being unable to quickly ready all the instances | 19:12 |
| *** ilyashakhat has joined #openstack-infra | 19:13 | |
| AJaeger | pabelanger: could you review https://review.openstack.org/#/q/status:open+projects:openstack/ansible-role+branch:master+topic:bindep-mv and https://review.openstack.org/355038 , please? That's the other-requirements -> bindep.txt rename | 19:14 |
| pabelanger | AJaeger: sure | 19:14 |
| *** salv-orl_ has joined #openstack-infra | 19:16 | |
| *** Goneri has joined #openstack-infra | 19:16 | |
| odyssey4me | it appears that some of our xenial jobs aren't running in the gate and I'd appreciate a hand figuring out where the skip is coming from - a sample job is https://review.openstack.org/357849 | 19:16 |
| *** csomerville has quit IRC | 19:16 | |
| *** cody-somerville has joined #openstack-infra | 19:16 | |
| *** senk has joined #openstack-infra | 19:16 | |
| odyssey4me | you'll notice that the job is voting in check, but didn't go through for gate | 19:16 |
| *** raunak has quit IRC | 19:16 | |
| AJaeger | thanks, pabelanger | 19:16 |
| *** dtardivel has quit IRC | 19:17 | |
| anteaya | odyssey4me: so you are missing gate-openstack-ansible-os_neutron-ansible-func-ubuntu-xenial | 19:17 |
| anteaya | yes? | 19:17 |
| AJaeger | pabelanger: do you know what's up with the two failing ones? That seems unrelated | 19:17 |
| odyssey4me | anteaya yes, that's the one | 19:18 |
| *** e0ne has quit IRC | 19:18 | |
| *** e0ne_ has joined #openstack-infra | 19:18 | |
| pabelanger | AJaeger: yes, new version of the linter is causing some issue. I'll clean them up later today | 19:18 |
| AJaeger | thanks | 19:18 |
| *** salv-orlando has quit IRC | 19:19 | |
| anteaya | odyssey4me: looking | 19:19 |
| *** berendt has joined #openstack-infra | 19:20 | |
| AJaeger | odyssey4me: very easy: the template ansible-role-functional-jobs-xenial only adds the job for check queue. | 19:22 |
| AJaeger | That's wrong - add a gate queue as well. | 19:22 |
| rcarrillocruz | oh AJaeger , nice to see you back | 19:22 |
| rcarrillocruz | hope you had a great vaca | 19:22 |
| rcarrillocruz | :-) | 19:22 |
| AJaeger | odyssey4me: line 308 in zuul/layout.yaml | 19:22 |
| AJaeger | rcarrillocruz: I had - thanks | 19:22 |
| odyssey4me | AJaeger oh, I thought I had verified that | 19:22 |
| odyssey4me | lemme look again | 19:22 |
| anteaya | odyssey4me: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n308 | 19:23 |
| anteaya | yeah what AJaeger said | 19:23 |
| odyssey4me | ah, I'm sorry - I missed that :/ | 19:24 |
| odyssey4me | ok, let me fix that up - thanks AJaeger and anteaya | 19:24 |
| anteaya | welcome | 19:24 |
| *** berendt has quit IRC | 19:25 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add xenial gate check to ansible-role-functional-jobs-xenial template https://review.openstack.org/358824 | 19:26 |
| odyssey4me | pabelanger ^ not sure who else that may affect? my only other option would be to do it per repo | 19:26 |
| anteaya | odyssey4me: please don't do it per repo | 19:27 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add xenial gate check to ansible-role-functional-jobs-xenial template https://review.openstack.org/358824 | 19:27 |
| odyssey4me | anteaya I would certainly prefer not to :) | 19:27 |
| anteaya | me too | 19:27 |
| odyssey4me | I figure that seeing as it's a voting template, even if it does affect other repositories, it should be fine | 19:28 |
| *** senk has quit IRC | 19:28 | |
| odyssey4me | the -nv template is available too | 19:28 |
| pabelanger | odyssey4me: Looks right, if project complain, they should be using -nv job | 19:28 |
| odyssey4me | :) happy with that | 19:29 |
| *** senk has joined #openstack-infra | 19:29 | |
| *** salv-orl_ has quit IRC | 19:29 | |
| *** piet has joined #openstack-infra | 19:29 | |
| *** eranrom has quit IRC | 19:29 | |
| *** moravec has quit IRC | 19:30 | |
| *** david-lyle has joined #openstack-infra | 19:30 | |
| *** burgerk has quit IRC | 19:30 | |
| *** Sukhdev has joined #openstack-infra | 19:31 | |
| clarkb | pabelanger: fungi http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4943&rra_id=all we spiked up to almost gigabit there | 19:32 |
| *** markvoelker has joined #openstack-infra | 19:32 | |
| clarkb | cloudnull: ^ is gigabit our effective limit or is there 10Gbe in this env? | 19:32 |
| openstackgerrit | Merged openstack-infra/puppet-refstack: Make sure libffi-dev is installed https://review.openstack.org/358034 | 19:32 |
| clarkb | cloudnull: or maybe lacp | 19:32 |
| pabelanger | clarkb: Wow, nice | 19:32 |
| fungi | oh, yeah we could set up lacp on the instance pretty trivially | 19:33 |
| *** eranrom has joined #openstack-infra | 19:33 | |
| *** markvoelker_ has joined #openstack-infra | 19:34 | |
| clarkb | fungi: but only if the underlying hypervisor would support it | 19:34 |
| *** eranrom has quit IRC | 19:34 | |
| fungi | oh, right, we would need raw nic passthrough for that | 19:34 |
| fungi | with dedicated nics | 19:34 |
| fungi | nevermind ;) | 19:34 |
| clarkb | I think that as long as the hypervisor does more than gigabit we should be able to in the instances too? | 19:35 |
| *** e0ne_ has quit IRC | 19:35 | |
| clarkb | I am not sure how kvm's virtio nics work when ti comes to that | 19:35 |
| fungi | unless there's a faked rate for the nic | 19:35 |
| pabelanger | clarkb: just hit 11min time to ready in osic-clou1 | 19:36 |
| fungi | i expect it's either 10gbit or multiple 1000baset with lacp, but honestly have no clue. if it's multiple 1000baset with interface round-robin for guest nics instead though... | 19:37 |
| fungi | hopefully cloudnull knows | 19:37 |
| *** piet has quit IRC | 19:37 | |
| *** markvoelker has quit IRC | 19:37 | |
| *** _nadya_ has joined #openstack-infra | 19:38 | |
| mordred | infra ... breaking clouds since 2011 | 19:39 |
| clarkb | pabelanger: ya, we'll have to see if that ends up being consistent across all providers (implying its nodepool not keeping up) or if its load related on the cloud side. Maybe a little both | 19:39 |
| *** piet has joined #openstack-infra | 19:39 | |
| pabelanger | clarkb: ya, I think if nodepool was less bursty, it would a more consistent time | 19:40 |
| clarkb | it looks like time to ready for the other clouds is still mostly sane | 19:40 |
| *** cody-somerville has quit IRC | 19:40 | |
| clarkb | so likely the cloud just being unhappy to boot hundreds of instances all at once :) | 19:41 |
| cloudnull | clarkb: the interfaces are bonded 10GBE w/ LACP | 19:41 |
| *** cody-somerville has joined #openstack-infra | 19:41 | |
| *** cody-somerville has joined #openstack-infra | 19:41 | |
| clarkb | cloudnull: great so as long as kvm doesn't hard cap us to gigabit on our nic we should be fine | 19:41 |
| *** rcernin has joined #openstack-infra | 19:41 | |
| cloudnull | +1 | 19:41 |
| cloudnull | we're not setting anything in place that would limit you. | 19:42 |
| *** david-lyle has quit IRC | 19:42 | |
| fungi | also that spike looks somewhat anomalous | 19:42 |
| cloudnull | however IDK if KVM has some baked in liitations. | 19:42 |
| clarkb | fungi: it was right after all the nodes booted | 19:42 |
| clarkb | fungi: so the anomoly is jobs starting on a large chunk of nodes all at once | 19:42 |
| *** sdake has joined #openstack-infra | 19:42 | |
| fungi | so when we do restarts/reenqueues for maintenance we might trigger similar hits on all providers (relative to their quotas anyway) | 19:43 |
| *** cody-somerville has quit IRC | 19:43 | |
| *** cody-somerville has joined #openstack-infra | 19:43 | |
| *** cody-somerville has joined #openstack-infra | 19:43 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add element for setting sysctl values https://review.openstack.org/356582 | 19:45 |
| *** david-lyle has joined #openstack-infra | 19:46 | |
| cloudnull | fungi clarkb looks like time to ready is leveling out. | 19:47 |
| cloudnull | at least in grafana | 19:47 |
| pabelanger | ya, 3mins over the last 5 | 19:48 |
| clarkb | cloudnull: ya I expect it to reach a more steady state as we burn through the zuul backlog | 19:48 |
| fungi | yep, that seems reasonable now that we're not slamming the cloud quite so hard | 19:48 |
| *** markvoelker has joined #openstack-infra | 19:48 | |
| pabelanger | Yup | 19:48 |
| krotscheck | Any cores around to help review a DSVM job for the javascript sdk? https://review.openstack.org/#/c/348056/ | 19:48 |
| *** markvoelker_ has quit IRC | 19:51 | |
| pabelanger | clarkb: fungi: we'll need to keep an eye on the zuul-launchers now, since we are putting more pressure on them | 19:52 |
| *** beagles is now known as beagles_biab | 19:53 | |
| mordred | krotscheck: xvfb-start is after revoke-sudo ... that is ok? | 19:53 |
| krotscheck | mordred: Should be. | 19:54 |
| krotscheck | mordred: If not, then the other jobs have been giving us some mighty odd false positives. | 19:54 |
| mordred | krotscheck: neat! | 19:55 |
| mordred | krotscheck: odd false positives are awesome | 19:55 |
| pabelanger | cloudnull: 1 hour in, not a single launch node failure | 19:56 |
| pabelanger | \o/ | 19:56 |
| clarkb | pabelanger: greghaynes any idea what dib did here http://paste.openstack.org/show/562279/ shows taht we made a vhd but then failed the build? | 19:56 |
| *** Hal has quit IRC | 19:56 | |
| *** Hal has joined #openstack-infra | 19:56 | |
| pabelanger | clarkb: no, that looks right | 19:57 |
| *** bnemec has quit IRC | 19:57 | |
| *** matrohon has joined #openstack-infra | 19:57 | |
| clarkb | pabelanger: but it returned 1 and failed | 19:57 |
| cloudnull | pabelanger: that's amazing! | 19:57 |
| *** inc0 has quit IRC | 19:57 | |
| * cloudnull knocks on wood | 19:57 | |
| clarkb | something about tmpfs check | 19:57 |
| jlvillal | Does "Depends-On" support circular dependency. Basically I would like both patches to get merged together. As they are referencing each other, in a documentation kind of way. | 19:57 |
| clarkb | jlvillal: no | 19:57 |
| greghaynes | clarkb: that looks like a success? | 19:57 |
| clarkb | greghaynes: whats the return 1? | 19:58 |
| jlvillal | clarkb: Thanks | 19:58 |
| *** burgerk has joined #openstack-infra | 19:58 | |
| clarkb | hrm if thats success we don't have that image on disk | 19:58 |
| openstackgerrit | Merged openstack-infra/project-config: Add xenial gate check to ansible-role-functional-jobs-xenial template https://review.openstack.org/358824 | 19:58 |
| greghaynes | clarkb: thats inside of the cleanup - its a check if you are using tmpfs | 19:58 |
| pabelanger | clarkb: I think it has done that for a while | 19:58 |
| clarkb | ok, so problem is maybe with nodepool? basically that image does not exist | 19:58 |
| greghaynes | clarkb: but that isnt causing the trap exit - that return 1 happens inside an if | 19:58 |
| greghaynes | clarkb: hrm | 19:58 |
| greghaynes | clarkb: yea, that should have created the file | 19:59 |
| *** asettle has joined #openstack-infra | 19:59 | |
| *** asettle has quit IRC | 19:59 | |
| zigo | mordred: Could you please help me to add deb-python-fixtures ? https://review.openstack.org/#/c/358819/ | 19:59 |
| greghaynes | clarkb: so either nodepool or something super wierd going on that I cant see | 19:59 |
| *** tonytan4ever has quit IRC | 19:59 | |
| *** raunak has joined #openstack-infra | 19:59 | |
| * clarkb checks the nodepool proper log | 19:59 | |
| clarkb | pabelanger: also I am going to clean up the dib image storage dir, we have leaked some images in there that we don't need anymore | 19:59 |
| *** tonytan4ever has joined #openstack-infra | 20:00 | |
| *** senk has quit IRC | 20:00 | |
| pabelanger | clarkb: ack | 20:00 |
| clarkb | http://paste.openstack.org/show/562284/ | 20:01 |
| clarkb | so nodepool did ask for it to be dleted | 20:01 |
| *** burgerk has quit IRC | 20:01 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/bindep: Give some examples https://review.openstack.org/358811 | 20:02 |
| clarkb | I don't see anything in the nodepoold log related to that though. Maybe someone manually deleted it? | 20:03 |
| mordred | I did not manually delete it | 20:05 |
| pabelanger | I've noticed that too, our dib-image-list for xenail and precise hasn't updated in a while. I wonder if it is because image builds are taking so long now, that we've exposed some odd behavior in image cleanup | 20:05 |
| *** ddieterly is now known as ddieterly[away] | 20:05 | |
| clarkb | pabelanger: the weird thing is it happens immediately after being built, not adjacent to one of the cron triggers (I think we cron less often than that) | 20:06 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add a wiki-dev.o.o server to test newer mediawiki https://review.openstack.org/358246 | 20:06 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Set the Apache ServerAdmin on wiki.o.o from hiera https://review.openstack.org/358834 | 20:06 |
| mordred | krotscheck: lgtm +2 | 20:07 |
| krotscheck | mordred: Thanks! | 20:07 |
| clarkb | pabelanger: 2016-08-21 18:34:00,909 INFO nodepool.NodePool: Deleting image id: 904 which is 8.00025207334 hours old | 20:09 |
| *** qwang has left #openstack-infra | 20:09 | |
| *** tqtran has quit IRC | 20:09 | |
| clarkb | pabelanger: I didn't realize it would request to delete the image before it was even done building | 20:09 |
| mordred | clarkb: THIS IMAGE TOOK TOO LONG TO BUILD AND IS NOW TOO OLD!!! | 20:10 |
| clarkb | I think the issue is that ya the builds take so long that we fail the if ready check | 20:10 |
| clarkb | mordred: ya | 20:10 |
| clarkb | ok I think I see the issue and will work on a patch | 20:10 |
| pabelanger | sadness, 8hour image builds | 20:11 |
| mordred | I keep meaning to dig in to figuring out why they're 8 hours, but then I don't actually do that | 20:11 |
| clarkb | pabelanger: I don't think its taking 8 hours for one image, but we queue them all up at once so the aggregate is > 8 hours | 20:11 |
| pabelanger | I'll loop back to puppet-nodepool refactor this week | 20:11 |
| fungi | here's a strange ansible/ssh related job failure... https://review.openstack.org/353692 | 20:11 |
| pabelanger | clarkb: Ya, I think you are right | 20:11 |
| fungi | the job console log for gate-infra-puppet-apply-debian-jessie just cuts out after ~3 minutes | 20:12 |
| pabelanger | we're building 2 fedora images right now | 20:12 |
| *** ddieterly[away] is now known as ddieterly | 20:12 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for registering a watch. https://review.openstack.org/358835 | 20:12 |
| fungi | the ansible log shows an ssh timeout error | 20:12 |
| pabelanger | ianw: when do you think we can drop fedora23? | 20:12 |
| fungi | but it still marked the job as failed rather than post_failure or requeuing it | 20:12 |
| *** tqtran has joined #openstack-infra | 20:13 | |
| pabelanger | fungi: Ya, ansible flagged it as failed, not unreachable | 20:14 |
| clarkb | heh its a one line change, I just have to figure out how to test it now :) | 20:14 |
| pabelanger | fungi: and we only reqeueue unreachable right now | 20:14 |
| *** markvoelker has quit IRC | 20:14 | |
| fungi | pabelanger: i'm guessing ansible returned an exit code we weren't expecting for that, huh? | 20:14 |
| fungi | is this a common occurrence? | 20:15 |
| pabelanger | fungi: I've seen it happen a few times, but I haven't figured out how to correct it. | 20:15 |
| pabelanger | fungi: but ya, we get -1 from ansible-playbook | 20:15 |
| *** piet has quit IRC | 20:15 | |
| fungi | thanks. unfortunate i guess | 20:16 |
| *** gouthamr|afk is now known as gouthamr | 20:16 | |
| *** AJaeger has quit IRC | 20:16 | |
| *** dprince has quit IRC | 20:17 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for registering a watch. https://review.openstack.org/358837 | 20:17 |
| fungi | wow, looks like zuul's already caught up with its backlog for the day | 20:17 |
| fungi | or very nearly there anyway | 20:18 |
| pabelanger | fungi: I've been meaning to try using async_status to see if it exposes more information, maybe we can improve our error handling. | 20:18 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Increase jessie min-ready to 5 https://review.openstack.org/358838 | 20:20 |
| *** _ari_ has quit IRC | 20:20 | |
| *** sdake has quit IRC | 20:21 | |
| *** dteselkin has quit IRC | 20:23 | |
| pabelanger | zigo: you shouldn't need ^. The reason for the slowness was just lack of nodes. You should notice a large improvement now that we bumped osic-cloud1 to 512 nodes | 20:23 |
| pabelanger | zigo: deb-python-traceback2 is already processing in post, only after 5mins | 20:24 |
| *** dteselkin has joined #openstack-infra | 20:27 | |
| *** jcoufal_ has joined #openstack-infra | 20:27 | |
| pabelanger | zigo: we can also start talking about optimizing the chroot process too. Create the initial chroot when we build the image, then you just need to update it | 20:27 |
| pabelanger | should cut down the amount of time needed for package builds | 20:28 |
| zigo | pabelanger: I'd prefer if we wait until I can use the local mirror, together with sources + Release.gpg. | 20:28 |
| pabelanger | zigo: sure, that is fine. But we could have some talks about how to do it | 20:28 |
| zigo | pabelanger: I very much agree that setting-up sbuild on each build is a waste. | 20:29 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Don't delete building DIB images https://review.openstack.org/358843 | 20:29 |
| *** salv-orlando has joined #openstack-infra | 20:29 | |
| clarkb | pabelanger: fungi ^ I think that is the fix | 20:29 |
| *** moravec has joined #openstack-infra | 20:30 | |
| clarkb | now to cleanup leaked images on the server | 20:30 |
| zigo | pabelanger: How would you see it done ? Should it be a dib element? | 20:30 |
| mordred | clarkb: that does not seem immediately wrong | 20:30 |
| pabelanger | zigo: Ya, likely an element | 20:31 |
| *** jcoufal has quit IRC | 20:31 | |
| zigo | pabelanger: An element can be a shell script, right? | 20:31 |
| mordred | zigo: is a shell script by default :) | 20:31 |
| zigo | :) | 20:31 |
| clarkb | mordred: the commit message does note one potentially "bad" sideeffect but I Think that is preferable to the current behavior | 20:31 |
| mordred | well, a collection of shell scripts | 20:31 |
| mordred | clarkb: yes - I agree | 20:32 |
| pabelanger | zigo: we can likely write a simple wrapper element to call your sbuild create script from deb-openstack-pkg-tools | 20:33 |
| clarkb | we have a bunch of older images from ~april I am removing | 20:33 |
| clarkb | as well as a few that are less stale than that | 20:33 |
| *** salv-orlando has quit IRC | 20:34 | |
| zigo | Right. | 20:34 |
| *** cody-somerville has quit IRC | 20:34 | |
| *** sdake has joined #openstack-infra | 20:35 | |
| *** kgiusti has left #openstack-infra | 20:35 | |
| zigo | mordred: Can you allow python-fixtures ? https://review.openstack.org/#/c/358819/ | 20:37 |
| zigo | I don't understand why this one fails to build: https://review.openstack.org/#/c/358351/ | 20:37 |
| zigo | It looks like it's just dying. | 20:37 |
| zigo | pabelanger: Is there a timeout somehow? | 20:37 |
| rcarrillocruz | pabelanger, clarkb , crinkle : i''ve deployed controller00, compute00[0-2] and they're on DNS now | 20:37 |
| rcarrillocruz | running puppet on controller00 as we speak | 20:38 |
| *** david-lyle has quit IRC | 20:38 | |
| rcarrillocruz | that will give us a smallish cloud to fix up the puppet things we may encounter | 20:38 |
| rcarrillocruz | if you want to take a peak | 20:38 |
| *** piet has joined #openstack-infra | 20:38 | |
| *** david-lyle has joined #openstack-infra | 20:39 | |
| *** rwsu has quit IRC | 20:39 | |
| rcarrillocruz | we need to modify the site.pp accordingly | 20:40 |
| rcarrillocruz | we still have hpuswest/hpuseast naming | 20:40 |
| rcarrillocruz | crashing now | 20:40 |
| rcarrillocruz | later | 20:40 |
| pabelanger | zigo: Yes, the default is 30mins | 20:40 |
| pabelanger | rcarrillocruz: thanks for the update | 20:40 |
| *** xarses has quit IRC | 20:41 | |
| zigo | pabelanger: It stopped doing anything after 3 minutes. :/ | 20:41 |
| *** xarses has joined #openstack-infra | 20:42 | |
| pabelanger | zigo: the job ran for 34m | 20:42 |
| *** xarses has quit IRC | 20:42 | |
| *** cody-somerville has joined #openstack-infra | 20:42 | |
| *** cody-somerville has joined #openstack-infra | 20:42 | |
| *** xarses has joined #openstack-infra | 20:43 | |
| pabelanger | zigo: how long is the longest package build? | 20:43 |
| *** xarses has quit IRC | 20:43 | |
| pabelanger | we likely need to just bump the timeout | 20:43 |
| *** ddieterly has quit IRC | 20:43 | |
| zigo | pabelanger: In this case, the job started at 16:46, and wasn't finished at 17:21. | 20:43 |
| *** xarses has joined #openstack-infra | 20:43 | |
| zigo | pabelanger: Stuff like Nova or Neutron can run for more than 1h. | 20:43 |
| zigo | pabelanger: 1h30 at most, I'd say. | 20:44 |
| pabelanger | okay, so you'll need to bump the build-timeout: setting to 90 | 20:44 |
| *** xarses has quit IRC | 20:44 | |
| *** david-lyle has quit IRC | 20:44 | |
| *** david-lyle_ has joined #openstack-infra | 20:44 | |
| *** david-lyle_ has quit IRC | 20:44 | |
| openstackgerrit | Merged openstack-infra/system-config: Set up HTTPS for releases.openstack.org site https://review.openstack.org/353692 | 20:44 |
| *** xarses has joined #openstack-infra | 20:44 | |
| *** xarses has quit IRC | 20:45 | |
| *** xarses has joined #openstack-infra | 20:45 | |
| *** dimtruck is now known as zz_dimtruck | 20:45 | |
| clarkb | pabelanger: ok cleared out a bunch of older raw, qcow2, and vhds | 20:47 |
| clarkb | pabelanger: now to clear out the dib .d dirs | 20:47 |
| pabelanger | great | 20:48 |
| *** zz_dimtruck is now known as dimtruck | 20:48 | |
| clarkb | greghaynes: is it intentional that dib leaves the .d dirs behind? | 20:49 |
| greghaynes | yes, those should just have a manifest in them IIRC | 20:50 |
| greghaynes | and be super tiny | 20:50 |
| openstackgerrit | Merged openstack/os-client-config: Precedence final solution https://review.openstack.org/358279 | 20:50 |
| clarkb | ya they are small, less concerned about disk use and just the noise | 20:50 |
| openstackgerrit | Varun Gadiraju proposed openstack-infra/project-config: Migrating vars that devstack_gate uses to vars in DEVSTACK_LOCAL_CONFIG https://review.openstack.org/354344 | 20:51 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Increase packaging-deb timeouts https://review.openstack.org/358857 | 20:51 |
| zigo | pabelanger: Like this, I believe? | 20:52 |
| clarkb | greghaynes: we probably want the builder to delete the .d dir when it delets the images? | 20:52 |
| zigo | It feels weird, but I need webkit2gtk so sphinx can be built. | 20:52 |
| pabelanger | zigo: yup | 20:53 |
| zigo | clarkb: Can you also approve the timeout increase at https://review.openstack.org/358857 please ? | 20:53 |
| *** kzaitsev_mb has joined #openstack-infra | 20:55 | |
| *** ilyashakhat has quit IRC | 20:55 | |
| greghaynes | clarkb: Yea, seems easy enough. Not sure if dib has an option to disable it, looking | 20:55 |
| *** yamahata has quit IRC | 20:56 | |
| clarkb | pabelanger: ok the volume should be relatively clean now. The other thing we can try is removing the cache as that tends to result in smaller images which build quicker | 20:56 |
| clarkb | pabelanger: what do you think? should we go ahead and remove the cache and how that tomorrows image builds happen in a reasonable amount of time? | 20:56 |
| *** yamahata has joined #openstack-infra | 20:56 | |
| *** raildo has quit IRC | 20:58 | |
| pabelanger | clarkb: sure, lets give it a shot | 20:58 |
| clarkb | pabelanger: looks like we have a ubuntu-trusty build going that nodepoold doesn't know about though | 20:59 |
| pabelanger | ya, I think nodepool has already deleted it | 21:00 |
| pabelanger | but diskimage-create still running | 21:00 |
| *** jkilpatr has quit IRC | 21:00 | |
| clarkb | ya I think that must be what happend due to the same thing that hit xenial | 21:00 |
| mwhahaha | hmm anyone aware of any issues on gerrit? I tried a rebase via the ui and got an unable to create new object error | 21:00 |
| clarkb | its running the giant mv of doom, I am not sure if it is safe/clean to interrupt that | 21:01 |
| clarkb | pabelanger: I will remoev the cache once that is done as I think it will be today's last image build | 21:01 |
| pabelanger | clarkb: okay | 21:01 |
| *** dgonzalez has quit IRC | 21:01 | |
| clarkb | mwhahaha: is it possible that there is a merge conflict? | 21:01 |
| *** hichihara has joined #openstack-infra | 21:01 | |
| mwhahaha | indeed, sorry missed that | 21:02 |
| mwhahaha | i miss the old ui for merge conflicts | 21:02 |
| *** dgonzalez has joined #openstack-infra | 21:03 | |
| mwhahaha | hmm shouldn't be a merge conflict actually | 21:03 |
| clarkb | pabelanger: our vhd images are up to 21GB which I think is part of the issue here | 21:03 |
| *** rattboi has joined #openstack-infra | 21:03 | |
| *** csomerville has joined #openstack-infra | 21:04 | |
| *** salv-orlando has joined #openstack-infra | 21:04 | |
| *** julim has quit IRC | 21:05 | |
| *** cody-somerville has quit IRC | 21:07 | |
| *** Thelo_ has quit IRC | 21:11 | |
| *** mfedosin has quit IRC | 21:12 | |
| *** eranrom has joined #openstack-infra | 21:13 | |
| *** dteselkin has quit IRC | 21:17 | |
| *** eranrom has quit IRC | 21:18 | |
| *** salv-orlando has quit IRC | 21:19 | |
| *** salv-orlando has joined #openstack-infra | 21:19 | |
| *** david-lyle_ has joined #openstack-infra | 21:19 | |
| mordred | clarkb: that's a big image | 21:20 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Update doc publishing spec for AFS https://review.openstack.org/276482 | 21:20 |
| *** salv-orlando has quit IRC | 21:20 | |
| *** salv-orlando has joined #openstack-infra | 21:20 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Allow disabling manifests https://review.openstack.org/358865 | 21:20 |
| greghaynes | clarkb: ^ | 21:20 |
| *** thorst has quit IRC | 21:20 | |
| greghaynes | clarkb: is that an ubuntu image? | 21:20 |
| greghaynes | clarkb: because we should really fix that double kernel bug on ubuntu | 21:21 |
| *** dteselkin has joined #openstack-infra | 21:21 | |
| clarkb | greghaynes: its our images yes (I think all of them are looking bloated like that) | 21:21 |
| greghaynes | ah | 21:21 |
| *** ldnunes has quit IRC | 21:21 | |
| clarkb | fixing the double kernel thing will help a bit too :) | 21:21 |
| clarkb | I wonder if we do similar on fedora/centos | 21:21 |
| greghaynes | clarkb: I dont think so | 21:22 |
| greghaynes | its an issue with debootstrap specifically | 21:22 |
| clarkb | I think centos ends up being our smallest base image, then ubuntu, then fedora | 21:24 |
| clarkb | fedora images are close to 500MB when you drop all the extra infra stuff | 21:24 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for sending cluster heartbeat https://review.openstack.org/358867 | 21:25 |
| *** Adri2000_ is now known as Adri2000 | 21:25 | |
| *** Adri2000 has quit IRC | 21:25 | |
| *** Adri2000 has joined #openstack-infra | 21:25 | |
| *** xarses has quit IRC | 21:25 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for sending cluster heartbeat https://review.openstack.org/358867 | 21:26 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Update doc publishing spec for AFS https://review.openstack.org/276482 | 21:27 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for sending cluster heartbeat https://review.openstack.org/358867 | 21:27 |
| jeblair | loquacities, mordred, fungi, clarkb, jhesketh: I updated the docs in afs spec proposal: https://review.openstack.org/276482 | 21:27 |
| jeblair | i think we will be able to get that done relatively quickly and easily | 21:28 |
| *** jkilpatr has joined #openstack-infra | 21:28 | |
| *** baoli has quit IRC | 21:28 | |
| jeblair | but i will need some help on it if we decide to do it | 21:28 |
| mordred | jeblair: I can help | 21:28 |
| jeblair | the cool part is that we can set up some more kerberos principals for folks who want to help make sure the dir structure in afs is correct :) | 21:29 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add new ZK method for sending cluster heartbeat https://review.openstack.org/358868 | 21:30 |
| fungi | sounds exciting. i really want to say i'll help, but chances are i won't have time to do much more than review changes for it | 21:30 |
| jeblair | mordred, fungi: should we aim for a week of comments on that, then voting on it on aug 30? | 21:31 |
| fungi | though maybe if we wrap up the wiki and release automation stuff soon i'll have some additional free time on my hands | 21:31 |
| fungi | jeblair: sounds good to me | 21:31 |
| Shrews | aaaaand... gerrit is gone bye-bye | 21:32 |
| Shrews | or is this a clue that i should just stop working? | 21:32 |
| fungi | gertty is showing me sync errors | 21:32 |
| mordred | it's back | 21:33 |
| mordred | and snappy! | 21:33 |
| *** david-lyle_ has quit IRC | 21:34 | |
| *** adriant has joined #openstack-infra | 21:35 | |
| *** thiagop has quit IRC | 21:35 | |
| Shrews | jeblair: seems an ansible async timeout can cause incomplete logs, perhaps? see http://logs.openstack.org/76/356676/2/check/gate-nodepool-python27-db-ubuntu-xenial/4fdae33/_zuul_ansible/ansible_log.txt at 20:27:35,453 mark | 21:37 |
| *** eharney has quit IRC | 21:37 | |
| ianw | greghaynes / clarkb : so on that O_NONBLOCK thing, i did systemtap SyS_fcntl during a xenial build looking for smoking guns of things turning it on for stdout, unsurprisingly nothing came up | 21:37 |
| jeblair | Shrews: referring to the fact that it ends with "TASK [copy]"? | 21:38 |
| ianw | greghaynes / clarkb : i think maybe the best we can do is possibly detect it in dib-run-parts after an element runs, and warn/bail | 21:38 |
| Shrews | jeblair: well, that too, but also that it moves to the publishers playbook w/o posting the zuul_runner status | 21:38 |
| *** kzaitsev_mb has quit IRC | 21:39 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Batch calls to list_floating_ips https://review.openstack.org/315697 | 21:39 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Ensure per-resource caches work without global cache https://review.openstack.org/358776 | 21:39 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Move list_server cache to dogpile https://review.openstack.org/358871 | 21:39 |
| greghaynes | ianw: hrm, I must be missing some context - this is related to the EAGAIN that cat gets, right? | 21:39 |
| greghaynes | last I remember was just finding out cat was getting that signal, did we figure something else out? | 21:39 |
| *** edtubill has quit IRC | 21:40 | |
| *** yamahata has quit IRC | 21:40 | |
| jeblair | Shrews: the ending with copy is because it's actually copying that file -- it's the last task of the publisher playbook -- it's as close as we can get :) | 21:40 |
| *** claudiub has quit IRC | 21:40 | |
| clarkb | greghaynes: I think ianw is trying to figure out why it would try to write non blocking? | 21:41 |
| clarkb | since it should jsut block? | 21:41 |
| Shrews | jeblair: ok. the other might be an issue, though | 21:41 |
| jeblair | Shrews: but the other thing is interesting. i can hop on the launcher and see if zuul reported anything interesting there that didn't make it into that log. | 21:41 |
| clarkb | https://review.openstack.org/#/c/358843/ passed jenkins testing. Maybe we can get that in for when we restart nodepool for the shade/occ fixes too? | 21:42 |
| greghaynes | clarkb: ianw ah. Does an EAGAIN not happen on write if write buffers are full even if its not O_NONBLOCK? | 21:42 |
| clarkb | mordred: speaking of did we get a release yet? | 21:42 |
| *** xarses has joined #openstack-infra | 21:42 | |
| greghaynes | I guess not, itll just block like youre saying | 21:42 |
| *** jheroux has quit IRC | 21:42 | |
| clarkb | ya it should just block aiui | 21:42 |
| jeblair | Shrews: it looks like we hit the zuul-launcher fallback timeout: http://paste.openstack.org/show/562295/ | 21:43 |
| greghaynes | ianw: so IIRC you can also open a socket as nonblocking without an explicit fcntl | 21:43 |
| mordred | clarkb: yes | 21:43 |
| mordred | clarkb: I'm just about to recheck things | 21:43 |
| clarkb | mordred: awesome. once you have done that maybe you can review my change and we can get all of taht in together | 21:44 |
| *** rhallisey has quit IRC | 21:44 | |
| mordred | clarkb: ++ | 21:44 |
| mordred | clarkb: I think I already +2'd your change? | 21:44 |
| ianw | greghaynes: yes, you can specify it to open() ... but since this is stdout it's already opened when you start, so that's why i had the thought maybe something is fcntl()ing it. but it could be way more covered up under dup()s etc | 21:44 |
| greghaynes | yea, hrm | 21:45 |
| clarkb | mordred: https://review.openstack.org/#/c/358843/ does not show a +2 from you | 21:45 |
| mordred | clarkb: I blame gerrit | 21:45 |
| mordred | clarkb: I definitely +2'd it in my mind | 21:45 |
| ianw | greghaynes: and i also can't replicate it outside the upstream nodepool machine ... so ... yeah. annoying | 21:46 |
| *** yamahata has joined #openstack-infra | 21:46 | |
| greghaynes | ianw: hrm. I wonder if python creates the fd and dup2's it in to stdout | 21:48 |
| greghaynes | as part of the subprocess call | 21:48 |
| *** ansmith has quit IRC | 21:49 | |
| *** yamamoto has joined #openstack-infra | 21:50 | |
| clarkb | pabelanger: arg xenial was up after trusty. However the image conversion process seemed to go much much faster on the trusty build after I cleaned up the volume. I wonder if read/write speeds degrade as we fill taht volume | 21:50 |
| *** yamamoto has quit IRC | 21:51 | |
| *** xarses has quit IRC | 21:51 | |
| clarkb | pabelanger: gonna let this build run to see if the build time is any faster | 21:52 |
| *** xarses has joined #openstack-infra | 21:52 | |
| *** markvoelker has joined #openstack-infra | 21:52 | |
| *** xarses has quit IRC | 21:52 | |
| clarkb | it started at 2147UTC | 21:53 |
| mordred | clarkb: that would be a thing that would be fun to know | 21:53 |
| ianw | greghaynes: it does create a pipe and dups it for stdin/stdout, but i think if you dup()ed it, then fiddled, you'd still break it. but almost impossible to trace through something like a dib run | 21:54 |
| mordred | clarkb: I'm getting close to eod - so I think it'll probably be best to do the restart tomorrow | 21:54 |
| clarkb | mordred: ok | 21:54 |
| mordred | I'd really like to be on hand to watch, just to be safe | 21:54 |
| clarkb | yup np | 21:54 |
| mordred | woot | 21:54 |
| *** xarses has joined #openstack-infra | 21:54 | |
| clarkb | mordred: we won't need new images or anything once its done so that reduces the overhead | 21:54 |
| clarkb | I am however going to try and get a new xenial image up across the board today so we can merge the ntpdate change | 21:54 |
| *** xarses has quit IRC | 21:54 | |
| clarkb | and with that done our major provider issues are mostly solved I think. Then time to dig into xenialing stuff again | 21:55 |
| *** ilyashakhat has joined #openstack-infra | 21:55 | |
| *** xarses has joined #openstack-infra | 21:55 | |
| mordred | yah | 21:55 |
| *** xarses has quit IRC | 21:55 | |
| mordred | I can actually poke at ansible/zuul things once this set of stuff is done | 21:56 |
| *** xarses has joined #openstack-infra | 21:56 | |
| *** esberglu has quit IRC | 21:56 | |
| *** xarses has quit IRC | 21:56 | |
| *** xarses has joined #openstack-infra | 21:57 | |
| *** xarses has quit IRC | 21:57 | |
| *** vhosakot has quit IRC | 21:58 | |
| *** xarses has joined #openstack-infra | 21:58 | |
| *** xarses has quit IRC | 21:58 | |
| *** xarses has joined #openstack-infra | 21:59 | |
| greghaynes | ianw: is this on python 2 or 3? | 21:59 |
| *** ilyashakhat has quit IRC | 21:59 | |
| *** xarses has quit IRC | 21:59 | |
| greghaynes | ianw: If I am reading the code correctly, on py2 stdout and stderr are replaced with io.open(.., bufsize=0) and on py2 bufsize=-1 | 22:00 |
| greghaynes | 0 should mean unbuffered/blocking I think | 22:00 |
| *** xarses has joined #openstack-infra | 22:00 | |
| clarkb | 2 on nodepool.o.o | 22:00 |
| greghaynes | hrm, wierd | 22:00 |
| *** matrohon has quit IRC | 22:01 | |
| greghaynes | there is a blurb about bufsize=0 leading to perf issues, which is interesting | 22:02 |
| greghaynes | and also how they turned it on by default in py3 | 22:02 |
| greghaynes | so I wonder if this actually means 'run in a very unperformant nonblocking mode' | 22:02 |
| lifeless | greghaynes: wait what? | 22:04 |
| greghaynes | lifeless: so backing way up - were stabbing in the dark trying to figure out why a subprocess.Popen(disk-image-create...) results in cat getting a EAGAIN when it is writing out a large chunk of data in in the subprocess | 22:05 |
| greghaynes | and right now were going 'why is stdout even set O_NONBLOCK' | 22:05 |
| greghaynes | because ianw saw no fcntl to that effect when tracing | 22:06 |
| ianw | greghaynes: you'll have to put the parts together yourself, but see something like http://paste.openstack.org/show/562297/ | 22:07 |
| *** sdague has joined #openstack-infra | 22:08 | |
| ianw | put a couple of dups() in there, and i think that's what's happening essentially | 22:08 |
| sdague | hey, quick, ping devstack-gate change we'd really like - https://review.openstack.org/#/c/357443/ - clarkb, et all | 22:09 |
| *** edmondsw has quit IRC | 22:10 | |
| greghaynes | lifeless: and what I was noticing there is - subprocess.Popen changed the default bufsize arg to -1 from 0 in py3 | 22:11 |
| *** eggshell has joined #openstack-infra | 22:11 | |
| greghaynes | lifeless: and theres a blurb about 0 being unperformant, so kind of wondering if that might be part of why our buffers are getting filled | 22:12 |
| clarkb | sdague: that will mean that most of the tests will default to using metadata server right? | 22:12 |
| clarkb | sdague: and I think we stopped doing that due to reliability? | 22:13 |
| sdague | clarkb: a very long time ago | 22:13 |
| sdague | we haven't seen a substantial reliability drop in that pg job | 22:13 |
| clarkb | well the pg job runs its own metadata service which this won't do if I read mriedem's comments correctly. But I am game to try it | 22:14 |
| clarkb | just keep it in mind if you start notiving ssh failures pick up or similar | 22:14 |
| *** eggshell has quit IRC | 22:14 | |
| *** caowei has joined #openstack-infra | 22:14 | |
| anteaya | openstack east is listed 3 times on upcoming events on https://groups.openstack.org/home | 22:14 |
| sdague | http://tinyurl.com/h27cxgl | 22:14 |
| anteaya | who would clean that up? | 22:14 |
| sdague | clarkb: it has the same number of workers actually, it just has a different parent process | 22:15 |
| clarkb | so we have two equivalent ways of something something? yay I guess? | 22:15 |
| *** jamielennox|away is now known as jamielennox | 22:15 | |
| *** mctaylor has joined #openstack-infra | 22:15 | |
| *** mctaylor has quit IRC | 22:16 | |
| *** eggshell has joined #openstack-infra | 22:16 | |
| anteaya | sorry 5 times, the fourth entry choose a different syntax | 22:17 |
| clarkb | anteaya: I think mrmartin and fifieldt are admins on the groups service | 22:17 |
| *** tpsilva has quit IRC | 22:18 | |
| sdague | clarkb: nova multihost requires that your run the md server in a dedicated process on every node | 22:19 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add os_watcher to OpenStack-Ansible https://review.openstack.org/358883 | 22:19 |
| sdague | why we decided to do it on the control node, I have no idea | 22:19 |
| sdague | maybe because it was simplers/ | 22:19 |
| sdague | simpler? | 22:19 |
| anteaya | clarkb: thank you | 22:20 |
| sdague | but, it really has functional effect to run it as an oslo.service with dedicated workers managed by nova-api, or by nova-metadata | 22:20 |
| sdague | sorry, "no functional effect" | 22:20 |
| *** itisha has quit IRC | 22:20 | |
| *** hichihara has quit IRC | 22:21 | |
| clarkb | gotcha so the biggest difference is when doing multihost and watning to terminate the nat'd 169 addr on the hypervisor | 22:22 |
| sdague | right, exactly | 22:23 |
| sdague | it's a way to not have to actually do all the funky stuff in your physical routers | 22:23 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Adds our repo key before apt-get update https://review.openstack.org/358886 | 22:24 |
| zigo | pabelanger: apt-get update broke on me, not sure why, but this patch should fix it. | 22:24 |
| *** rajinir has quit IRC | 22:25 | |
| *** jkilpatr has quit IRC | 22:26 | |
| zigo | ianw: Could you please +2 workflow these 2 tiny patches? They are easy to review, and are blockers for me: https://review.openstack.org/#/c/358857/ https://review.openstack.org/#/c/358886/ | 22:26 |
| *** sshnaidm is now known as sshnaidm|afk | 22:28 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add os_watcher to OpenStack-Ansible https://review.openstack.org/358883 | 22:30 |
| openstackgerrit | Merged openstack-infra/project-config: Rename ovn-native-l3 gate job to ovn-native-services https://review.openstack.org/352676 | 22:32 |
| clarkb | the xenial build just started its mega mv | 22:32 |
| *** jkilpatr has joined #openstack-infra | 22:32 | |
| clarkb | so about 45 minutes of running elements and now the raw image creation and qcow2/vhd conversions | 22:33 |
| *** david-lyle_ has joined #openstack-infra | 22:37 | |
| *** bnemec has joined #openstack-infra | 22:37 | |
| *** yamamoto has joined #openstack-infra | 22:37 | |
| *** Julien-zte has joined #openstack-infra | 22:38 | |
| *** markvoelker has quit IRC | 22:39 | |
| *** csomerville has quit IRC | 22:40 | |
| *** tqtran has quit IRC | 22:41 | |
| *** xarses_ has joined #openstack-infra | 22:42 | |
| *** tqtran has joined #openstack-infra | 22:44 | |
| *** xarses has quit IRC | 22:45 | |
| *** beagles_biab is now known as beagles | 22:45 | |
| cloudnull | how would i go about checking to see if an instance is running via noodpool within OpenStack CI? | 22:46 |
| cloudnull | I used to use "/etc/nodepool" as an indicator however it seems that file is not found. | 22:46 |
| clarkb | cloudnull: if you give me a uuid I can check really quickly | 22:46 |
| cloudnull | is /etc/nodepool supposed to be a file or a directory ? | 22:47 |
| clarkb | if there is no /etc/nodepool then either it isn't a nodepool host or ndoepool hasn't managed to write that out yet | 22:47 |
| clarkb | cloudnull: a directory | 22:47 |
| cloudnull | ok so pebkac :) | 22:47 |
| cloudnull | nevermind | 22:47 |
| *** david-lyle has joined #openstack-infra | 22:49 | |
| *** hongbin has quit IRC | 22:51 | |
| *** jcoufal_ has quit IRC | 22:51 | |
| *** Sukhdev has quit IRC | 22:51 | |
| *** david-lyle_ has quit IRC | 22:52 | |
| *** rbrndt has quit IRC | 22:53 | |
| *** dkehn has quit IRC | 22:54 | |
| oomichi | hi, can someone take a look at bugdaystats patches for a single cycle term? | 22:55 |
| *** dkehn_ has quit IRC | 22:55 | |
| *** nwkarsten has quit IRC | 22:55 | |
| oomichi | that just outputs daily data at this time: https://review.openstack.org/#/q/status:open+project:openstack-infra/bugdaystats+branch:master+topic:add-range | 22:56 |
| *** dkehn has joined #openstack-infra | 22:56 | |
| *** nwkarsten has joined #openstack-infra | 22:56 | |
| anteaya | oomichi: pleia2 might be able to review your patches | 22:57 |
| anteaya | she spent time with bugday in the past | 22:57 |
| pleia2 | I can put them on my list for tomorrow | 22:57 |
| oomichi | anteaya: oh, cool. thanks for your info :) | 22:57 |
| oomichi | pleia2: thanks :) | 22:58 |
| pleia2 | sure thing | 22:58 |
| *** nwkarsten has quit IRC | 23:00 | |
| *** hockeynut has quit IRC | 23:00 | |
| *** asettle has joined #openstack-infra | 23:02 | |
| *** rlandy has quit IRC | 23:02 | |
| *** tbarron is now known as tbarron|gone | 23:02 | |
| *** david-lyle has quit IRC | 23:02 | |
| *** gouthamr has quit IRC | 23:05 | |
| *** nwkarsten has joined #openstack-infra | 23:06 | |
| *** _nadya_ has quit IRC | 23:06 | |
| *** dkehn_ has joined #openstack-infra | 23:08 | |
| *** asettle has quit IRC | 23:10 | |
| openstackgerrit | Varun Gadiraju proposed openstack-infra/project-config: Migrating vars that devstack_gate uses to vars in DEVSTACK_LOCAL_CONFIG https://review.openstack.org/354344 | 23:11 |
| *** eggshell has quit IRC | 23:12 | |
| *** hockeynut has joined #openstack-infra | 23:15 | |
| *** xarses_ is now known as xarses | 23:15 | |
| *** pt_15 has quit IRC | 23:16 | |
| *** sdake has quit IRC | 23:16 | |
| clarkb | the mv took 45 minutes. Not sure that is appreciably faster | 23:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Fix typos in afs doc publishing spec https://review.openstack.org/358903 | 23:18 |
| *** sdague has quit IRC | 23:18 | |
| *** sarob has quit IRC | 23:22 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Switch from old recaptcha to recaptcha-nocaptcha https://review.openstack.org/358202 | 23:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Standardize HTTPS and vhost configuration https://review.openstack.org/358136 | 23:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Clean up old recaptcha parameters https://review.openstack.org/358210 | 23:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Parameterize database connection settings https://review.openstack.org/358195 | 23:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Update scope.lookupvar() to shorter scope[] calls https://review.openstack.org/358194 | 23:23 |
| *** xyang1 has quit IRC | 23:25 | |
| *** eggshell has joined #openstack-infra | 23:25 | |
| *** tonytan4ever has quit IRC | 23:25 | |
| *** dkehn has quit IRC | 23:25 | |
| *** dkehn_ has quit IRC | 23:25 | |
| *** dimtruck is now known as zz_dimtruck | 23:27 | |
| pabelanger | fungi: I'm thinking we should add a copy of our GPG public key into our nodepool nodes, so jobs can easily add them if needed. EG: debian-openstack jobs | 23:28 |
| *** rwsu has joined #openstack-infra | 23:28 | |
| clarkb | qemu convert took about 12 minutes | 23:30 |
| clarkb | and resulted in an 8GB image | 23:30 |
| clarkb | *8GB qcow2 image | 23:31 |
| *** dkehn has joined #openstack-infra | 23:32 | |
| *** rwsu has quit IRC | 23:32 | |
| *** sdake has joined #openstack-infra | 23:33 | |
| *** Julien-zte has quit IRC | 23:33 | |
| fungi | pabelanger: sure, that seems like a reasonable thing to just build into our images | 23:33 |
| fungi | probably not much point in putting it in a ready script since it's not region-specific | 23:34 |
| *** baoli has joined #openstack-infra | 23:35 | |
| clarkb | just have the jenkins/zuul user pretrust it? | 23:36 |
| *** dkehn_ has joined #openstack-infra | 23:38 | |
| fungi | that's one option, though still means a network call to retrieve it | 23:38 |
| *** rwsu has joined #openstack-infra | 23:39 | |
| clarkb | ok that image build took almost two hours | 23:39 |
| fungi | and building a gnupg keychain onto the images is at least as much work as simply dumping a copy of the openpgp public key to a file that can be used/imported in whatever ways a job needs | 23:40 |
| clarkb | pabelanger: fungi I am going to move the dib_cache out of the way now and rebuild xenial | 23:40 |
| clarkb | and we can see if that gets us smaller quicker builds | 23:40 |
| fungi | clarkb: sounds good. looking forward to the details once you have them | 23:40 |
| *** piet has quit IRC | 23:41 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/glean: Revise systemd determination to verify systemctl presence https://review.openstack.org/279818 | 23:41 |
| *** thorst has joined #openstack-infra | 23:44 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/glean: Revise systemd determination to verify systemctl presence https://review.openstack.org/279818 | 23:48 |
| *** fguillot has joined #openstack-infra | 23:49 | |
| *** piet has joined #openstack-infra | 23:50 | |
| TheJulia | NobodyCam: ^^^ I noted as we just discussed. Please give it a try and post back. For now, I've marked it review -1 since I'm not in a position to test it. | 23:53 |
| *** xarses has quit IRC | 23:53 | |
| *** sdake has quit IRC | 23:55 | |
| *** thorst_ has joined #openstack-infra | 23:55 | |
| *** thorst has quit IRC | 23:58 | |
| *** mtanin___ has joined #openstack-infra | 23:58 | |
| *** jerryz has quit IRC | 23:59 | |
| *** dingyichen has joined #openstack-infra | 23:59 | |
| *** mtanino has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
