mtreinish | clarkb: off the top of my head no, I'd have to dig it up in the nova code | 00:00 |
---|---|---|
*** dfflanders_ has joined #openstack-infra | 00:00 | |
*** Jeffrey4l_ has joined #openstack-infra | 00:00 | |
*** adrian_otto has quit IRC | 00:01 | |
*** adrian_otto has joined #openstack-infra | 00:01 | |
mtreinish | SpamapS: heh, that's also approaching the biggest python stack trace I've seen. It's only topped by ones with osprofiler that call itself a dozen or so times in the middle | 00:01 |
clarkb | mtreinish: I can do the grepping. Such fun | 00:02 |
*** thorst has quit IRC | 00:02 | |
*** ddieterly has joined #openstack-infra | 00:02 | |
*** pahuang_ has joined #openstack-infra | 00:02 | |
*** csomerville has quit IRC | 00:03 | |
*** amitgandhinz has quit IRC | 00:03 | |
*** aeng has quit IRC | 00:03 | |
*** pahuang has quit IRC | 00:04 | |
SpamapS | mtreinish: indeed! | 00:04 |
*** kzaitsev_mb has quit IRC | 00:04 | |
* SpamapS wonders why he feels proud of that | 00:04 | |
*** sflanigan has joined #openstack-infra | 00:05 | |
*** adrian_otto has quit IRC | 00:06 | |
*** Sukhdev has quit IRC | 00:06 | |
*** darvon has joined #openstack-infra | 00:06 | |
clarkb | network_data.json appears to be more correct | 00:06 |
*** camunoz has quit IRC | 00:06 | |
*** dingyichen has joined #openstack-infra | 00:07 | |
clarkb | I had confused vendor* with network* | 00:07 |
clarkb | I wonder if network_info.json is a rax thing then nova used network_data.json | 00:08 |
*** csomerville has joined #openstack-infra | 00:08 | |
*** salv-orlando has joined #openstack-infra | 00:08 | |
*** harlowja has quit IRC | 00:10 | |
clarkb | sambetts|afk: ok I see now that everything gets stuff into a dict there anyways which is then passed along and sorted later | 00:12 |
clarkb | we should clean up that comment and all the sorted things I think | 00:12 |
clarkb | to make it clearer they aren't required, but of course I have no idea if that will somehow break stuff | 00:12 |
mgagne | clarkb: I think network_info.json is used by bifrost | 00:15 |
*** xenogear has quit IRC | 00:15 | |
*** aeng has joined #openstack-infra | 00:15 | |
mgagne | clarkb: https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-configdrives-dynamic/tasks/main.yml#L41 | 00:15 |
mgagne | unfortunately, the official name found in Nova is "network_data.json" | 00:16 |
mgagne | to be more precise: https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-configdrives-dynamic/tasks/main.yml#L53-L57 | 00:16 |
clarkb | mgagne: ya that is what I am discovering | 00:16 |
mgagne | vendor data was used by RAX when Nova didn't have it yet | 00:16 |
clarkb | mgagne: I think that may be because rax used network_info to start too? | 00:16 |
clarkb | oh | 00:17 |
mgagne | clarkb: it was vendor data | 00:17 |
*** EricGonczer_ has quit IRC | 00:17 | |
clarkb | so we have 3 files all doing the same thing? | 00:17 |
mgagne | with a networkinfo key or something | 00:17 |
* clarkb bows down to the interface gods and asks forgiveness | 00:17 | |
SpamapS | mtreinish: whoa that's.. weird | 00:17 |
mgagne | fun fact, with RAX, you will find the VLAN mac_address in the ethernet_mac_address field while with nova, it's in vlan_mac_address. :D | 00:18 |
*** Sukhdev has joined #openstack-infra | 00:18 | |
mgagne | I discovered it the hard way today :-/ | 00:18 |
clarkb | mgagne: maybe we should buy a goat and sacrifice it to get better interfaces | 00:19 |
clarkb | or do a raindance or something | 00:19 |
clarkb | hogepodge: ^ totally a defcore thing | 00:19 |
mgagne | and it was supposed to be a "standard" interface for network config, now we have 3 standards :D | 00:20 |
mgagne | but yea, vendora_data.json is supposed to be RAX specific so I wouldn't count it. as for bifrost... ¯\_(ツ)_/¯ | 00:21 |
anteaya | +1 raindance | 00:21 |
openstackgerrit | Eric Brown proposed openstack-infra/project-config: Enable py35 voting for Bandit project https://review.openstack.org/337862 | 00:21 |
*** salv-orlando has quit IRC | 00:22 | |
notmorgan | mtreinish: lol | 00:22 |
mtreinish | SpamapS: yeah it looked weird from my quick glance at it | 00:22 |
notmorgan | mtreinish: "just copy" | 00:22 |
notmorgan | hah | 00:22 |
mtreinish | notmorgan: well ignoring the migration specific parts :) | 00:22 |
*** camunoz has joined #openstack-infra | 00:23 | |
notmorgan | mtreinish: yeah i was just going with something like that. just a little simplier | 00:23 |
*** mtanino has quit IRC | 00:27 | |
pabelanger | EmilienM: mtreinish: I haven't touch stackviz DIB element, it should be installed last I checked (few weeks ago) | 00:27 |
pabelanger | clarkb: I am not sure about the spike | 00:27 |
pabelanger | clarkb: about to test our puppet-iptables fix now | 00:27 |
clarkb | pabelanger: kk | 00:28 |
*** ddieterly has quit IRC | 00:30 | |
mtreinish | pabelanger: ok, I wasn't sure. Like I said I wasn't watching it too closely. I just knew you were fighting issues with it a while ago | 00:31 |
openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Add alembic migration support https://review.openstack.org/136589 | 00:31 |
notmorgan | clarkb, jeblair: ^ need to add the "check modles vs schema" bit but that is most of it now. | 00:31 |
notmorgan | oh erm... missing something doh* | 00:32 |
notmorgan | [and not tested locally yet] so i'll mark it wip | 00:32 |
notmorgan | (doc change needed too) | 00:33 |
*** lvdongbing has joined #openstack-infra | 00:33 | |
pabelanger | mtreinish: EmilienM: I'll follow up in the morning see what is going on | 00:33 |
pabelanger | but nodepool.o.o should show what is happening | 00:34 |
mtreinish | EmilienM: oh, I knoew what it probably is, do you do the stackviz post processing in the puppet jobs? | 00:34 |
*** Apoorva has quit IRC | 00:34 | |
mtreinish | EmilienM: there is a devstack-gate step that builds the json output and copies the built js from nodepool to the log dir at the end of the run | 00:35 |
*** Sukhdev has quit IRC | 00:38 | |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Use constant for mac addr permanent type https://review.openstack.org/337931 | 00:38 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Sort output data once before we write it https://review.openstack.org/337932 | 00:38 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain difference between config drive files https://review.openstack.org/337933 | 00:38 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain vlan setup with interface names https://review.openstack.org/337934 | 00:38 |
clarkb | greghaynes: cinerama mgagne ^ I think I am making sense of some of the hard to read code there | 00:38 |
greghaynes | clarkb: nice. I basically have to reread all of glean to remember what any of it does :( | 00:39 |
clarkb | greghaynes: ya thats what I am learning too, so hoping this is a start at making it readable | 00:40 |
clarkb | its definitely not making everything understandable but I have to grok each peice as I go | 00:40 |
*** tonytan4ever has joined #openstack-infra | 00:42 | |
*** mriedem_away has quit IRC | 00:45 | |
clarkb | and hacking bites again | 00:46 |
* clarkb proposes we disable hacking on glean | 00:46 | |
*** tonytan4ever has quit IRC | 00:47 | |
*** piet has joined #openstack-infra | 00:47 | |
*** salv-orlando has joined #openstack-infra | 00:48 | |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain vlan setup with interface names https://review.openstack.org/337934 | 00:50 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain difference between config drive files https://review.openstack.org/337933 | 00:50 |
*** csomerville has quit IRC | 00:50 | |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Sort output data once before we write it https://review.openstack.org/337932 | 00:50 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Use constant for mac addr permanent type https://review.openstack.org/337931 | 00:50 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Ignore hacking rules https://review.openstack.org/337937 | 00:50 |
*** amotoki has joined #openstack-infra | 00:50 | |
*** pvaneck has quit IRC | 00:51 | |
*** Goneri has joined #openstack-infra | 00:53 | |
clarkb | hrm maybe its just H not H* | 00:53 |
*** dberube has joined #openstack-infra | 00:53 | |
*** dkehn__ has joined #openstack-infra | 00:53 | |
* clarkb caves and runs tests locally like he should | 00:53 | |
*** thorst has joined #openstack-infra | 00:54 | |
*** thorst has quit IRC | 00:55 | |
*** thorst has joined #openstack-infra | 00:56 | |
*** dkehn_ has quit IRC | 00:56 | |
pabelanger | fungi: pleia2: xenial mirror rebuilt, vos release mirror.ubuntu -localauth in progress | 00:57 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Ignore hacking rules https://review.openstack.org/337937 | 00:58 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain vlan setup with interface names https://review.openstack.org/337934 | 00:58 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain difference between config drive files https://review.openstack.org/337933 | 00:58 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Sort output data once before we write it https://review.openstack.org/337932 | 00:58 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Use constant for mac addr permanent type https://review.openstack.org/337931 | 00:58 |
clarkb | centos image is almost done building, I will queue up the uploads as soon as it finishes | 00:59 |
*** amitgandhinz has joined #openstack-infra | 01:00 | |
EmilienM | mtreinish: https://review.openstack.org/#/c/337898/ | 01:00 |
EmilienM | I changed something | 01:01 |
*** kzaitsev_mb has joined #openstack-infra | 01:02 | |
*** dberube has left #openstack-infra | 01:02 | |
*** salv-orlando has quit IRC | 01:03 | |
*** Goneri has quit IRC | 01:04 | |
*** thorst has quit IRC | 01:04 | |
*** amitgandhinz has quit IRC | 01:05 | |
*** shashank_hegde has joined #openstack-infra | 01:07 | |
*** harlowja has joined #openstack-infra | 01:09 | |
*** Goneri has joined #openstack-infra | 01:09 | |
openstackgerrit | Paul Belanger proposed openstack-infra/bindep: Do not merge https://review.openstack.org/337944 | 01:10 |
*** EricGonczer_ has joined #openstack-infra | 01:10 | |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: doc/definition.rst: add missing '/' into include path https://review.openstack.org/336274 | 01:11 |
*** shashank_hegde has quit IRC | 01:11 | |
clarkb | image conversions so slow | 01:13 |
*** piet has quit IRC | 01:13 | |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: scm.py: correct indention to fix sphinx-docs warning https://review.openstack.org/336275 | 01:14 |
*** thorst has joined #openstack-infra | 01:15 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add valid set of options parameters to convert_xml https://review.openstack.org/337381 | 01:17 |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add valid options for video-quality options to TestFairy https://review.openstack.org/337945 | 01:17 |
*** EricGonc_ has joined #openstack-infra | 01:17 | |
openstackgerrit | Henry Gessau proposed openstack-infra/project-config: [WIP] Switch from py34 to py35 for all of neutron https://review.openstack.org/337946 | 01:18 |
*** thorst has quit IRC | 01:18 | |
clarkb | and image uplaods for centos7 are queued | 01:19 |
clarkb | should start seeing happier jobs there in an hour or so | 01:19 |
*** EricGonczer_ has quit IRC | 01:20 | |
*** tqtran has quit IRC | 01:22 | |
pabelanger | https://review.openstack.org/#/c/337889/ | 01:24 |
*** rajinir has quit IRC | 01:24 | |
pabelanger | clarkb: that works locally as expected ^ | 01:25 |
*** EricGonc_ has quit IRC | 01:25 | |
pabelanger | jhesketh: If you don't mind reviewing too^ | 01:25 |
pabelanger | that will fix our firewall rules on centos-7 | 01:25 |
*** EricGonczer_ has joined #openstack-infra | 01:27 | |
pabelanger | and bindep is failing as expected now: http://logs.openstack.org/44/337944/1/check/gate-bindep-bindep-fallback-ubuntu-xenial/bbcf7da/console.html | 01:27 |
openstackgerrit | Henry Gessau proposed openstack-infra/project-config: [WIP] Switch from py34 to py35 for all of neutron https://review.openstack.org/337946 | 01:27 |
*** mtanino has joined #openstack-infra | 01:28 | |
*** salv-orlando has joined #openstack-infra | 01:29 | |
*** karthikp_ has joined #openstack-infra | 01:30 | |
openstackgerrit | Madhumitha Viswanathan proposed openstack-infra/jenkins-job-builder: Add partial support for maven-release-plugin https://review.openstack.org/313196 | 01:32 |
openstackgerrit | Eric Brown proposed openstack-infra/project-config: Enable py35 voting on oslo.vmware https://review.openstack.org/337949 | 01:32 |
*** Daisy has joined #openstack-infra | 01:33 | |
*** Goneri has quit IRC | 01:37 | |
*** weshay has quit IRC | 01:38 | |
*** karthikp_ has quit IRC | 01:38 | |
*** karthikp_ has joined #openstack-infra | 01:38 | |
openstackgerrit | Merged openstack-infra/project-config: Raise ubuntu-xenial min-ready https://review.openstack.org/337838 | 01:38 |
*** zhurong has joined #openstack-infra | 01:39 | |
*** chlong has quit IRC | 01:40 | |
*** sarob has quit IRC | 01:40 | |
*** sarob has joined #openstack-infra | 01:41 | |
*** yanyanhu has joined #openstack-infra | 01:43 | |
openstackgerrit | Merged openstack-infra/project-config: Make py35 jobs voting on tempest https://review.openstack.org/337748 | 01:44 |
*** salv-orlando has quit IRC | 01:45 | |
*** tphummel has quit IRC | 01:48 | |
*** Daisy has quit IRC | 01:49 | |
*** Daisy has joined #openstack-infra | 01:49 | |
*** Daisy_ has joined #openstack-infra | 01:50 | |
*** moravec has quit IRC | 01:51 | |
openstackgerrit | Merged openstack-infra/project-config: Remove php5 packages https://review.openstack.org/337816 | 01:52 |
pabelanger | bindep fixed on xenial ^ | 01:52 |
*** chlong has joined #openstack-infra | 01:53 | |
*** Daisy has quit IRC | 01:54 | |
*** moravec has joined #openstack-infra | 01:55 | |
*** thorst has joined #openstack-infra | 01:56 | |
*** thorst has quit IRC | 01:57 | |
*** thorst has joined #openstack-infra | 01:58 | |
*** esberglu has quit IRC | 01:59 | |
*** Daisy_ has quit IRC | 02:00 | |
*** Daisy has joined #openstack-infra | 02:00 | |
*** karthikp_ has quit IRC | 02:00 | |
*** Daisy has quit IRC | 02:01 | |
*** Daisy has joined #openstack-infra | 02:01 | |
*** elo has joined #openstack-infra | 02:01 | |
*** karthikp_ has joined #openstack-infra | 02:02 | |
*** tonytan4ever has joined #openstack-infra | 02:02 | |
*** asselin_ has joined #openstack-infra | 02:05 | |
*** thorst has quit IRC | 02:07 | |
*** tonytan4ever has quit IRC | 02:07 | |
*** karthikp_ has quit IRC | 02:08 | |
*** swat30 has quit IRC | 02:08 | |
pabelanger | rcarrillocruz: jhesketh: AJaeger: if you don't mind landing https://review.openstack.org/#/c/337889/ before DIBs tomorrow, that would be great. It will fix our firewall issues on centos-7 | 02:08 |
*** karthikp_ has joined #openstack-infra | 02:08 | |
pabelanger | and fix our centos-7-2-node images | 02:09 |
*** asselin__ has quit IRC | 02:09 | |
*** amotoki has quit IRC | 02:09 | |
*** amotoki has joined #openstack-infra | 02:10 | |
*** salv-orlando has joined #openstack-infra | 02:11 | |
*** camunoz has quit IRC | 02:12 | |
*** amitgandhinz has joined #openstack-infra | 02:13 | |
openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Add neutron-dynamic-routing to PROJECT list https://review.openstack.org/337958 | 02:15 |
*** tphummel has joined #openstack-infra | 02:17 | |
*** amitgandhinz has quit IRC | 02:18 | |
jhesketh | pabelanger: looking | 02:20 |
*** aviau has quit IRC | 02:20 | |
*** karthikp_ has quit IRC | 02:20 | |
*** aviau has joined #openstack-infra | 02:21 | |
*** tqtran has joined #openstack-infra | 02:21 | |
*** rhallisey has quit IRC | 02:21 | |
*** karthikp_ has joined #openstack-infra | 02:22 | |
*** rfolco has quit IRC | 02:23 | |
*** swat30 has joined #openstack-infra | 02:24 | |
*** EricGonczer_ has quit IRC | 02:26 | |
*** salv-orlando has quit IRC | 02:26 | |
*** tqtran has quit IRC | 02:26 | |
*** liusheng has quit IRC | 02:30 | |
*** tonytan4ever has joined #openstack-infra | 02:31 | |
*** aeng has quit IRC | 02:33 | |
*** amoralej|pto has quit IRC | 02:33 | |
*** sflanigan has quit IRC | 02:33 | |
*** amoralej has joined #openstack-infra | 02:33 | |
openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Update tempest job for neutron-dynamic-routing https://review.openstack.org/337964 | 02:38 |
*** roxanagh_ has joined #openstack-infra | 02:43 | |
*** Daisy_ has joined #openstack-infra | 02:46 | |
*** sflanigan has joined #openstack-infra | 02:46 | |
*** aeng has joined #openstack-infra | 02:47 | |
*** roxanagh_ has quit IRC | 02:48 | |
*** tonytan4ever has quit IRC | 02:48 | |
*** solumuser__ has joined #openstack-infra | 02:48 | |
*** Daisy has quit IRC | 02:49 | |
*** tonytan4ever has joined #openstack-infra | 02:49 | |
*** yuanying has quit IRC | 02:50 | |
*** Daisy_ has quit IRC | 02:50 | |
*** Daisy has joined #openstack-infra | 02:51 | |
*** gyee has quit IRC | 02:52 | |
*** salv-orlando has joined #openstack-infra | 02:52 | |
*** tphummel has quit IRC | 02:54 | |
*** Daisy has quit IRC | 02:56 | |
*** PollyZ has joined #openstack-infra | 02:57 | |
*** woodster_ has quit IRC | 02:59 | |
*** kien-ha has joined #openstack-infra | 02:59 | |
*** dfflanders_ has quit IRC | 03:02 | |
*** karthikp_ has quit IRC | 03:03 | |
*** karthikp_ has joined #openstack-infra | 03:04 | |
*** thorst has joined #openstack-infra | 03:05 | |
*** yamamoto has joined #openstack-infra | 03:05 | |
*** roxanagh_ has joined #openstack-infra | 03:06 | |
*** tonytan_brb has joined #openstack-infra | 03:06 | |
*** salv-orlando has quit IRC | 03:07 | |
*** coreyob has quit IRC | 03:08 | |
*** PollyZ_ has joined #openstack-infra | 03:09 | |
*** tonytan4ever has quit IRC | 03:09 | |
*** coreyob has joined #openstack-infra | 03:10 | |
*** thorst has quit IRC | 03:11 | |
*** PollyZ has quit IRC | 03:11 | |
*** asselin__ has joined #openstack-infra | 03:12 | |
*** amitgandhinz has joined #openstack-infra | 03:14 | |
*** asselin_ has quit IRC | 03:16 | |
*** amitgandhinz has quit IRC | 03:18 | |
*** julim has quit IRC | 03:21 | |
*** karthikp_ has quit IRC | 03:21 | |
*** amotoki has quit IRC | 03:26 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update TestFairy plugin https://review.openstack.org/337945 | 03:26 |
*** karthikp_ has joined #openstack-infra | 03:27 | |
*** roxanagh_ has quit IRC | 03:28 | |
*** ayoung has quit IRC | 03:30 | |
*** arif-ali has quit IRC | 03:32 | |
*** Daisy has joined #openstack-infra | 03:32 | |
*** salv-orlando has joined #openstack-infra | 03:33 | |
*** zhurong has quit IRC | 03:35 | |
*** amotoki has joined #openstack-infra | 03:35 | |
*** karthikp_ has quit IRC | 03:36 | |
*** zhurong has joined #openstack-infra | 03:36 | |
*** karthikp_ has joined #openstack-infra | 03:37 | |
*** Daisy has quit IRC | 03:37 | |
*** sflanigan has quit IRC | 03:40 | |
*** Daisy has joined #openstack-infra | 03:44 | |
*** kzaitsev_mb has quit IRC | 03:44 | |
*** DaiDV has joined #openstack-infra | 03:48 | |
*** Daisy has quit IRC | 03:48 | |
*** DaiDV has quit IRC | 03:48 | |
*** yuanying has joined #openstack-infra | 03:49 | |
*** karthikp_ has quit IRC | 03:49 | |
*** salv-orlando has quit IRC | 03:49 | |
*** karthikp_ has joined #openstack-infra | 03:50 | |
*** Daisy has joined #openstack-infra | 03:51 | |
*** PollyZ_ has quit IRC | 03:51 | |
*** itisha has joined #openstack-infra | 03:52 | |
*** arif-ali has joined #openstack-infra | 03:52 | |
*** amotoki has quit IRC | 03:55 | |
*** Daisy has quit IRC | 03:56 | |
*** Daisy has joined #openstack-infra | 03:58 | |
*** ramishra has quit IRC | 04:01 | |
*** roxanagh_ has joined #openstack-infra | 04:01 | |
*** Daisy has quit IRC | 04:02 | |
*** ramishra has joined #openstack-infra | 04:02 | |
*** aeng has quit IRC | 04:03 | |
*** Daisy has joined #openstack-infra | 04:03 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure gerrit commitmessage parameters https://review.openstack.org/316175 | 04:05 |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure gerrit commitmessage parameters https://review.openstack.org/316175 | 04:07 |
*** karthikp_ has quit IRC | 04:08 | |
*** adrian_otto has joined #openstack-infra | 04:08 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: switch to python-db-jobs https://review.openstack.org/335551 | 04:08 |
*** Daisy has quit IRC | 04:08 | |
*** thorst has joined #openstack-infra | 04:10 | |
*** dimtruck is now known as zz_dimtruck | 04:11 | |
*** karthikp_ has joined #openstack-infra | 04:12 | |
*** amotoki has joined #openstack-infra | 04:14 | |
*** Daisy has joined #openstack-infra | 04:14 | |
*** salv-orlando has joined #openstack-infra | 04:15 | |
*** thorst has quit IRC | 04:16 | |
*** solumuser__ has quit IRC | 04:18 | |
*** Daisy has quit IRC | 04:19 | |
*** aeng has joined #openstack-infra | 04:19 | |
*** karthikp_ has quit IRC | 04:20 | |
*** netsinn has quit IRC | 04:20 | |
*** karthikp_ has joined #openstack-infra | 04:21 | |
*** Daisy has joined #openstack-infra | 04:21 | |
*** sputnik13 has quit IRC | 04:22 | |
*** netsin has joined #openstack-infra | 04:23 | |
*** tqtran has joined #openstack-infra | 04:23 | |
*** amotoki has quit IRC | 04:25 | |
*** zhurong has quit IRC | 04:25 | |
*** Daisy has quit IRC | 04:26 | |
*** Daisy has joined #openstack-infra | 04:26 | |
*** tqtran has quit IRC | 04:28 | |
*** asselin_ has joined #openstack-infra | 04:28 | |
*** salv-orlando has quit IRC | 04:30 | |
*** Daisy has quit IRC | 04:31 | |
*** amitgandhinz has joined #openstack-infra | 04:31 | |
*** amotoki has joined #openstack-infra | 04:31 | |
*** asselin__ has quit IRC | 04:32 | |
*** shashank_hegde has joined #openstack-infra | 04:36 | |
*** amitgandhinz has quit IRC | 04:36 | |
*** adrian_otto has quit IRC | 04:37 | |
*** Daisy has joined #openstack-infra | 04:38 | |
*** karthikp_ has quit IRC | 04:38 | |
*** shashank_hegde has quit IRC | 04:38 | |
*** shashank_hegde has joined #openstack-infra | 04:40 | |
*** kzaitsev_mb has joined #openstack-infra | 04:41 | |
*** karthikp_ has joined #openstack-infra | 04:42 | |
*** psachin has joined #openstack-infra | 04:42 | |
*** Daisy has quit IRC | 04:44 | |
*** shashank_hegde has quit IRC | 04:44 | |
*** zhurong has joined #openstack-infra | 04:45 | |
*** Shrews has quit IRC | 04:45 | |
*** kzaitsev_mb has quit IRC | 04:46 | |
*** links has joined #openstack-infra | 04:48 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update support for BuildResultTrigger plugin https://review.openstack.org/321619 | 04:50 |
*** mrmartin has joined #openstack-infra | 04:50 | |
*** Daisy has joined #openstack-infra | 04:51 | |
*** karthikp_ has quit IRC | 04:52 | |
*** roxanagh_ has quit IRC | 04:53 | |
*** karthikp_ has joined #openstack-infra | 04:54 | |
*** Daisy has quit IRC | 04:56 | |
*** salv-orlando has joined #openstack-infra | 04:57 | |
openstackgerrit | Merged openstack-infra/project-config: Make ovn-native-l3 check job voting https://review.openstack.org/335624 | 04:57 |
*** Daisy has joined #openstack-infra | 04:57 | |
*** exploreshaifali has joined #openstack-infra | 04:58 | |
frickler | pabelanger: does https://review.openstack.org/337816 still need new xenial images being built before it takes effect? python35 jobs seem broken currently, probably since the xenial mirror rebuild | 04:59 |
frickler | http://logs.openstack.org/78/337878/1/check/gate-ceilometer-python35-nv/5535bf8/console.html#_2016-07-06_04_17_26_816850 | 05:00 |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update FSTrigger plugin https://review.openstack.org/328456 | 05:00 |
*** salv-orlando has quit IRC | 05:01 | |
*** karthikp_ has quit IRC | 05:04 | |
*** salv-orlando has joined #openstack-infra | 05:06 | |
*** DaiDV has joined #openstack-infra | 05:07 | |
*** Daisy has quit IRC | 05:08 | |
*** Shrews has joined #openstack-infra | 05:12 | |
*** thorst has joined #openstack-infra | 05:13 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update JaCoCo plugin https://review.openstack.org/320758 | 05:13 |
*** yamamoto has quit IRC | 05:14 | |
*** Daisy has joined #openstack-infra | 05:15 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update JaCoCo plugin https://review.openstack.org/320758 | 05:17 |
*** Daisy has quit IRC | 05:20 | |
*** thorst has quit IRC | 05:21 | |
*** Daisy has joined #openstack-infra | 05:22 | |
*** aaltman_ has joined #openstack-infra | 05:22 | |
*** aaltman has quit IRC | 05:22 | |
*** Daisy_ has joined #openstack-infra | 05:24 | |
*** sree has joined #openstack-infra | 05:25 | |
*** oanson has joined #openstack-infra | 05:26 | |
*** Daisy has quit IRC | 05:26 | |
*** Nikolay_St has joined #openstack-infra | 05:28 | |
*** dizquierdo has joined #openstack-infra | 05:29 | |
*** Daisy has joined #openstack-infra | 05:29 | |
*** asettle has joined #openstack-infra | 05:29 | |
*** savihou has joined #openstack-infra | 05:30 | |
*** Daisy_ has quit IRC | 05:32 | |
*** amitgandhinz has joined #openstack-infra | 05:32 | |
*** Daisy_ has joined #openstack-infra | 05:32 | |
*** cbader has quit IRC | 05:33 | |
*** cbader has joined #openstack-infra | 05:33 | |
*** mtanino has quit IRC | 05:34 | |
*** asettle has quit IRC | 05:34 | |
*** Daisy has quit IRC | 05:34 | |
*** amitgandhinz has quit IRC | 05:37 | |
*** solumuser__ has joined #openstack-infra | 05:37 | |
*** garyk1 has joined #openstack-infra | 05:38 | |
*** garyk1 has quit IRC | 05:38 | |
*** garyk1 has joined #openstack-infra | 05:39 | |
*** sputnik13 has joined #openstack-infra | 05:40 | |
*** mrmartin has quit IRC | 05:41 | |
*** jswarren__ has quit IRC | 05:45 | |
*** asselin__ has joined #openstack-infra | 05:47 | |
*** zhenguo_ has joined #openstack-infra | 05:48 | |
*** asselin_ has quit IRC | 05:51 | |
*** armax has quit IRC | 05:54 | |
*** yamamoto has joined #openstack-infra | 05:57 | |
*** Daisy_ has quit IRC | 05:57 | |
*** Daisy has joined #openstack-infra | 05:57 | |
*** itisha has quit IRC | 06:00 | |
*** Daisy has quit IRC | 06:00 | |
*** dchen has joined #openstack-infra | 06:03 | |
*** pcaruana has joined #openstack-infra | 06:05 | |
*** aeng has quit IRC | 06:07 | |
*** dingyichen has quit IRC | 06:07 | |
*** rcernin has joined #openstack-infra | 06:09 | |
*** asselin_ has joined #openstack-infra | 06:10 | |
*** Daisy has joined #openstack-infra | 06:11 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/338004 | 06:11 |
*** asselin has joined #openstack-infra | 06:13 | |
AJaeger | frickler: 337816 needs new images build, so tomorrow around this time. | 06:13 |
*** asselin__ has quit IRC | 06:13 | |
*** jak-jak has joined #openstack-infra | 06:14 | |
*** tonytan_brb has quit IRC | 06:14 | |
jak-jak | join ##chat | 06:14 |
AJaeger | frickler: indeed, that's now broken ;( we need to wait 24 hours roughly for new images. | 06:14 |
*** asselin__ has joined #openstack-infra | 06:14 | |
AJaeger | Or is any infra-root around that can rebuild ubuntu-xenial only and get those uploaded? | 06:14 |
*** andreas_s has joined #openstack-infra | 06:15 | |
*** asselin_ has quit IRC | 06:16 | |
*** aeng has joined #openstack-infra | 06:18 | |
*** asselin has quit IRC | 06:18 | |
*** thorst has joined #openstack-infra | 06:19 | |
*** dingyichen has joined #openstack-infra | 06:19 | |
*** nmagnezi has joined #openstack-infra | 06:22 | |
AJaeger | frickler: that means that all python 3.5 jobs will fail, correct? | 06:23 |
AJaeger | Yeah ;( | 06:24 |
* AJaeger sends a note | 06:24 | |
*** sree has quit IRC | 06:24 | |
AJaeger | #status notice All python 3.5 jobs are failing today, we need to build new xenial images first. | 06:26 |
openstackstatus | AJaeger: sending notice | 06:26 |
*** thorst has quit IRC | 06:26 | |
gmann | AJaeger: does it mean, it will fail till tomorrow we have new image | 06:26 |
gmann | AJaeger: most of the projects moved from nv to voting on that | 06:27 |
AJaeger | gmann: It will work tomorrow again once we have new images. | 06:27 |
-openstackstatus- NOTICE: All python 3.5 jobs are failing today, we need to build new xenial images first. | 06:27 | |
AJaeger | gmann: Only one project moved already, others just proposed. | 06:27 |
gmann | AJaeger: tempest one got merged | 06:28 |
gmann | https://review.openstack.org/#/c/337748/ | 06:28 |
*** jswarren has joined #openstack-infra | 06:28 | |
jhesketh | AJaeger: I can rebuild images | 06:28 |
AJaeger | gmann: and that is the only one ;) | 06:28 |
jhesketh | AJaeger: do you know why they are failing? 337816 doesn't look related (or I'm missing something) | 06:28 |
AJaeger | jhesketh: that would be great! | 06:28 |
gmann | AJaeger: i see :) | 06:28 |
openstackstatus | AJaeger: finished sending notice | 06:29 |
AJaeger | jhesketh: See http://logs.openstack.org/78/337878/1/check/gate-ceilometer-python35-nv/5535bf8/console.html#_2016-07-06_04_17_26_816850 | 06:29 |
frickler | jhesketh: there was an old php5-* package in the xenial mirror, that got cleaned up tonight | 06:29 |
*** sarob has quit IRC | 06:29 | |
AJaeger | jhesketh: : and bindep fallback list had this old php5 package in it. | 06:29 |
AJaeger | So, now we get "Package php5-cli is not available, but is referred to by another package." | 06:29 |
*** sarob has joined #openstack-infra | 06:30 | |
AJaeger | and the job exits | 06:30 |
AJaeger | jhesketh: 337816 removes the package from the bindep fallback list and now everything should be fine again. | 06:30 |
AJaeger | gmann: if python 3.5 voting on tempest is a severe blocker, we can revert... | 06:31 |
gmann | AJaeger: i was thinking about that, let's check with oomichi about that | 06:31 |
*** cshastri has joined #openstack-infra | 06:32 | |
gmann | oomichi: is it ok till tomorrow or should we revert 35 job to nv ? | 06:32 |
AJaeger | let'S see how long we need to update images, jhesketh is going to rebuild them now | 06:32 |
*** asselin_ has joined #openstack-infra | 06:32 | |
*** sarob has quit IRC | 06:32 | |
*** abregman has joined #openstack-infra | 06:33 | |
*** amitgandhinz has joined #openstack-infra | 06:33 | |
gmann | AJaeger: ok, it can be soon(by today itself) then should be fine | 06:33 |
jhesketh | AJaeger: ah I see, okay will take al ook | 06:33 |
AJaeger | thanks, gmann | 06:33 |
AJaeger | jhesketh: so, xenial images only | 06:34 |
jhesketh | yep | 06:34 |
*** harlowja has quit IRC | 06:34 | |
gmann | AJaeger: we have 5-6 patches with +A (mostly doc one )so we can wait | 06:35 |
*** asselin__ has quit IRC | 06:36 | |
AJaeger | gmann: please tell people to wait with rechecking ;) | 06:37 |
*** amitgandhinz has quit IRC | 06:37 | |
gmann | AJaeger: yea | 06:38 |
*** isaacb has joined #openstack-infra | 06:38 | |
*** asselin__ has joined #openstack-infra | 06:39 | |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/338004 | 06:41 |
*** Daisy has quit IRC | 06:42 | |
*** Daisy has joined #openstack-infra | 06:42 | |
*** kzaitsev_mb has joined #openstack-infra | 06:43 | |
*** asselin_ has quit IRC | 06:43 | |
*** hosanai has quit IRC | 06:44 | |
*** rdx_matt has joined #openstack-infra | 06:45 | |
*** tlian has quit IRC | 06:45 | |
*** kien-ha has quit IRC | 06:48 | |
*** kzaitsev_mb has quit IRC | 06:48 | |
*** bryan_att has quit IRC | 06:53 | |
*** dizquierdo has quit IRC | 06:54 | |
*** Daisy has quit IRC | 06:55 | |
*** Daisy has joined #openstack-infra | 06:56 | |
*** oferby has quit IRC | 06:57 | |
*** maishsk has joined #openstack-infra | 07:00 | |
*** Daisy has quit IRC | 07:00 | |
*** yanyanhu has quit IRC | 07:02 | |
*** ccamacho has joined #openstack-infra | 07:03 | |
*** amotoki has quit IRC | 07:03 | |
*** yanyanhu has joined #openstack-infra | 07:04 | |
*** pahuang_ has quit IRC | 07:06 | |
*** shashank_hegde has joined #openstack-infra | 07:08 | |
*** dtardivel has joined #openstack-infra | 07:09 | |
*** salv-orlando has quit IRC | 07:10 | |
*** amotoki has joined #openstack-infra | 07:12 | |
jhesketh | hmm, the build ran for a while and then failed with no obvoius reason... http://paste.openstack.org/show/526510/ | 07:13 |
jhesketh | there's plenty of disk space, so I'm going to try again | 07:13 |
*** tonytan4ever has joined #openstack-infra | 07:14 | |
*** slaweq has quit IRC | 07:18 | |
*** mrmartin has joined #openstack-infra | 07:18 | |
*** pahuang_ has joined #openstack-infra | 07:19 | |
*** bexelbie has quit IRC | 07:19 | |
*** zeih has joined #openstack-infra | 07:19 | |
*** tonytan4ever has quit IRC | 07:20 | |
*** tesseract- has joined #openstack-infra | 07:21 | |
*** bexelbie has joined #openstack-infra | 07:21 | |
*** Daisy has joined #openstack-infra | 07:24 | |
*** thorst has joined #openstack-infra | 07:25 | |
*** jlanoux has joined #openstack-infra | 07:26 | |
*** shardy has joined #openstack-infra | 07:26 | |
*** jlanoux has quit IRC | 07:26 | |
*** flepied has joined #openstack-infra | 07:27 | |
*** jlanoux has joined #openstack-infra | 07:27 | |
openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Revert "Make py35 jobs voting on tempest" https://review.openstack.org/338059 | 07:27 |
*** arif-ali has quit IRC | 07:28 | |
openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Revert "Make py35 jobs voting on tempest" https://review.openstack.org/338059 | 07:28 |
gmann | AJaeger: can you check this - https://review.openstack.org/#/c/338059/ | 07:28 |
openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: Give a more clear definition abount vm element in README https://review.openstack.org/338060 | 07:29 |
gmann | AJaeger: i think its better to revert the tempest one and we can revert revert once new image is ready | 07:29 |
*** Daisy has quit IRC | 07:29 | |
*** mikelk has joined #openstack-infra | 07:30 | |
*** yolanda has joined #openstack-infra | 07:30 | |
openstackgerrit | Jin Jing Lin proposed openstack-infra/project-config: Enable Neutron VPNaaS API CI tests https://review.openstack.org/337011 | 07:31 |
*** thorst has quit IRC | 07:31 | |
yolanda | good morning | 07:31 |
*** hferenc has joined #openstack-infra | 07:33 | |
gmann | yolanda: good morning | 07:33 |
gmann | yolanda: https://review.openstack.org/#/c/338059/ | 07:33 |
*** amitgandhinz has joined #openstack-infra | 07:33 | |
gmann | yolanda: can you please check this. | 07:34 |
yolanda | hi gmann | 07:35 |
yolanda | +2... i see it's a blocker | 07:35 |
gmann | yolanda: Thanks. | 07:36 |
*** Daisy has joined #openstack-infra | 07:36 | |
*** eezhova has joined #openstack-infra | 07:36 | |
*** dingyichen has quit IRC | 07:37 | |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Replace rcarrillocruz ssh key https://review.openstack.org/338067 | 07:37 |
*** dchen has quit IRC | 07:37 | |
*** dizquierdo has joined #openstack-infra | 07:37 | |
rcarrillocruz | yolanda: mind reviewing ^ pls | 07:37 |
*** yolanda has quit IRC | 07:38 | |
*** yolanda has joined #openstack-infra | 07:38 | |
*** Daisy has quit IRC | 07:38 | |
*** Daisy_ has joined #openstack-infra | 07:38 | |
*** amitgandhinz has quit IRC | 07:39 | |
*** ifarkas has joined #openstack-infra | 07:39 | |
*** jpich has joined #openstack-infra | 07:41 | |
*** zeih has quit IRC | 07:41 | |
*** bexelbie has quit IRC | 07:42 | |
*** yolanda has quit IRC | 07:43 | |
*** bexelbie has joined #openstack-infra | 07:43 | |
AJaeger | yolanda, could you review https://review.openstack.org/#/c/337889/ , please? pabelanger asked for it | 07:45 |
AJaeger | gmann: will approve ... | 07:45 |
AJaeger | jhesketh: that's sad ;( I have to leave now, so won't be around the next few hours... | 07:46 |
gmann | AJaeger: Thanks. yolanda just +A | 07:46 |
*** zeih has joined #openstack-infra | 07:47 | |
*** amotoki has quit IRC | 07:49 | |
*** yolanda has joined #openstack-infra | 07:49 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Make py35 jobs voting on tempest" https://review.openstack.org/338059 | 07:50 |
AJaeger | yolanda, could you review https://review.openstack.org/#/c/337889/ , please? pabelanger asked for it | 07:51 |
yolanda | AJaeger, sure | 07:52 |
AJaeger | thanks, yolanda. | 07:52 |
AJaeger | yolanda: FYI: We need new xenial images, all xenial builds are broken due to outdated bindep list and cleaned up xenial mirror. jhesketh is currently building images. | 07:52 |
*** kzaitsev_mb has joined #openstack-infra | 07:53 | |
* AJaeger will be back later | 07:54 | |
*** amotoki has joined #openstack-infra | 07:54 | |
yolanda | AJaeger, ok. I will be away for a bit as well, reinstalling SO | 07:54 |
*** slaweq has joined #openstack-infra | 07:54 | |
*** eezhova has quit IRC | 07:54 | |
*** eezhova has joined #openstack-infra | 07:56 | |
*** zeih has quit IRC | 07:56 | |
*** zeih has joined #openstack-infra | 07:57 | |
*** abregman is now known as abregman|mtg | 07:58 | |
*** garyk1 has quit IRC | 07:59 | |
*** yolanda has quit IRC | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
*** Daisy_ has quit IRC | 08:01 | |
*** Daisy has joined #openstack-infra | 08:01 | |
*** nbloom has joined #openstack-infra | 08:02 | |
*** DaiDV has quit IRC | 08:03 | |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Add Ceph to the OVB job https://review.openstack.org/338088 | 08:05 |
*** Daisy has quit IRC | 08:06 | |
jhesketh | the dib build failed again, trying to debug | 08:07 |
*** Daisy has joined #openstack-infra | 08:07 | |
rcarrillocruz | jhesketh: i'm seeing failures when cloning puppet-openstackid | 08:07 |
rcarrillocruz | looks like a mirror doesn't have that repo sane | 08:08 |
rcarrillocruz | http://paste.openstack.org/show/526515/ | 08:08 |
*** garyk1 has joined #openstack-infra | 08:08 | |
rcarrillocruz | which would explain failures like http://logs.openstack.org/67/338067/1/check/gate-infra-puppet-apply-ubuntu-precise/4c4c6c2/console.html | 08:08 |
jhesketh | rcarrillocruz: hmm, it seems to be missing refs for some reason http://git.openstack.org/cgit/openstack-infra/puppet-openstackid/refs/ | 08:09 |
rcarrillocruz | if you reload , you may eventually get refs | 08:10 |
*** zeih has quit IRC | 08:10 | |
rcarrillocruz | first time i clicked showed none, refreshed and now show refs | 08:10 |
rcarrillocruz | i still have to figure out how afs mirrors work in infra upstream, but looks to me as a mirror being sick | 08:10 |
jhesketh | ah, that indicates it's a git slave having trouble | 08:10 |
rcarrillocruz | ++ | 08:11 |
*** zeih has joined #openstack-infra | 08:11 | |
*** Daisy has quit IRC | 08:11 | |
*** dizquierdo has quit IRC | 08:13 | |
*** chem has joined #openstack-infra | 08:13 | |
*** Daisy has joined #openstack-infra | 08:14 | |
*** sorantis has joined #openstack-infra | 08:15 | |
*** hashar has joined #openstack-infra | 08:15 | |
*** csatari has quit IRC | 08:17 | |
*** csatari has joined #openstack-infra | 08:17 | |
*** abregman|mtg is now known as abregman | 08:19 | |
*** DaiDV has joined #openstack-infra | 08:20 | |
*** kzaitsev_mb has quit IRC | 08:22 | |
*** zeih has quit IRC | 08:22 | |
*** derekh has joined #openstack-infra | 08:24 | |
*** rubasov has left #openstack-infra | 08:24 | |
*** lucas|afk is now known as lucasagomes | 08:25 | |
*** shashank_hegde has quit IRC | 08:26 | |
*** hferenc has quit IRC | 08:27 | |
*** zeih has joined #openstack-infra | 08:27 | |
*** thorst has joined #openstack-infra | 08:29 | |
*** hferenc has joined #openstack-infra | 08:30 | |
*** BobBall_AWOL is now known as BobBall | 08:32 | |
*** sree_ has joined #openstack-infra | 08:34 | |
*** dizquierdo has joined #openstack-infra | 08:34 | |
*** sree_ is now known as Guest49528 | 08:34 | |
*** Daisy_ has joined #openstack-infra | 08:34 | |
*** amitgandhinz has joined #openstack-infra | 08:34 | |
*** asettle has joined #openstack-infra | 08:35 | |
*** asettle has quit IRC | 08:36 | |
*** asettle has joined #openstack-infra | 08:36 | |
*** thorst has quit IRC | 08:36 | |
*** Daisy has quit IRC | 08:37 | |
*** Guest49528 has quit IRC | 08:39 | |
*** priteau has joined #openstack-infra | 08:39 | |
*** amitgandhinz has quit IRC | 08:39 | |
frickler | jhesketh: there was some disk error affecting the rax-iad mirror yesterday, maybe that git slave issue is related | 08:40 |
jhesketh | frickler: thanks | 08:43 |
jhesketh | it appears that the repo is corrupt on a few git slaves, but for some reason I can't get gerrit replicate a fresh repo across... still looking into it | 08:43 |
*** asettle has quit IRC | 08:44 | |
*** Daisy has joined #openstack-infra | 08:46 | |
*** asettle has joined #openstack-infra | 08:47 | |
*** zeih has quit IRC | 08:47 | |
*** zeih has joined #openstack-infra | 08:48 | |
*** dizquierdo has quit IRC | 08:48 | |
*** Daisy_ has quit IRC | 08:49 | |
*** yanyanhu has quit IRC | 08:52 | |
*** ramishra has quit IRC | 08:52 | |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Add Ceph to the OVB job https://review.openstack.org/338088 | 08:53 |
*** yanyanhu has joined #openstack-infra | 08:54 | |
*** ramishra has joined #openstack-infra | 08:54 | |
*** dizquierdo has joined #openstack-infra | 08:57 | |
*** Daisy has quit IRC | 08:58 | |
*** Daisy has joined #openstack-infra | 08:59 | |
openstackgerrit | Artur Zarzycki proposed openstack-infra/project-config: Add fuel-ccp-ironic and fuel-ccp-searchlight https://review.openstack.org/337216 | 08:59 |
*** electrofelix has joined #openstack-infra | 09:00 | |
*** yolanda has joined #openstack-infra | 09:03 | |
*** Daisy has quit IRC | 09:03 | |
*** Daisy has joined #openstack-infra | 09:04 | |
*** mhickey has joined #openstack-infra | 09:06 | |
penguinolog | http://logs.openstack.org/98/338098/1/check/gate-fuel-devops-python35-nv/4000336/console.html -- oops, packages install again? | 09:08 |
*** Daisy has quit IRC | 09:08 | |
*** sputnik13 has quit IRC | 09:09 | |
*** acoles_ is now known as acoles | 09:09 | |
*** Daisy has joined #openstack-infra | 09:10 | |
*** makowals has joined #openstack-infra | 09:10 | |
*** sputnik13 has joined #openstack-infra | 09:11 | |
openstackgerrit | amrith proposed openstack-infra/irc-meetings: Update trove meeting information https://review.openstack.org/338127 | 09:13 |
*** dfflanders has quit IRC | 09:15 | |
*** sshnaidm|afk is now known as sshnaidm | 09:15 | |
*** john-davidge has joined #openstack-infra | 09:15 | |
openstackgerrit | Dimitri Mazmanov proposed openstack-infra/project-config: Add python-kingbirdclient to the project list https://review.openstack.org/337254 | 09:15 |
*** dfflanders has joined #openstack-infra | 09:16 | |
*** tonytan4ever has joined #openstack-infra | 09:16 | |
*** john-dav_ has joined #openstack-infra | 09:17 | |
openstackgerrit | Rob Cresswell proposed openstack-infra/irc-meetings: Update Horizon Meeting times https://review.openstack.org/338130 | 09:17 |
*** john-dav_ is now known as john-davidge_ | 09:17 | |
*** eezhova has quit IRC | 09:18 | |
openstackgerrit | amrith proposed openstack-infra/irc-meetings: Proposing OpenStack SWG Meeting https://review.openstack.org/338134 | 09:19 |
*** john-davidge has quit IRC | 09:20 | |
*** Daisy has quit IRC | 09:20 | |
*** tonytan4ever has quit IRC | 09:21 | |
*** jianghuaw has joined #openstack-infra | 09:22 | |
*** DaiDV has quit IRC | 09:22 | |
*** huanxie has joined #openstack-infra | 09:22 | |
*** SamYaple has quit IRC | 09:23 | |
jhesketh | rcarrillocruz, frickler: okay git01 and git06 are repaired... let me know how you go cloning/using puppet-openstackid | 09:23 |
*** eezhova has joined #openstack-infra | 09:24 | |
*** amotoki has quit IRC | 09:24 | |
rcarrillocruz | cool, let me recheck my changes | 09:24 |
*** esikachev has joined #openstack-infra | 09:24 | |
*** tqtran has joined #openstack-infra | 09:25 | |
*** Daisy has joined #openstack-infra | 09:26 | |
openstackgerrit | amrith proposed openstack-infra/irc-meetings: Proposing OpenStack SWG Meeting https://review.openstack.org/338134 | 09:26 |
*** tqtran has quit IRC | 09:29 | |
*** Hal has joined #openstack-infra | 09:30 | |
*** Hal is now known as Guest25627 | 09:30 | |
*** kzaitsev_mb has joined #openstack-infra | 09:30 | |
*** sambetts|afk is now known as sambetts | 09:30 | |
*** Daisy has quit IRC | 09:31 | |
openstackgerrit | Merged openstack-infra/release-tools: add a "ptl" command to show info about how to contact a PTL https://review.openstack.org/333462 | 09:34 |
*** thorst has joined #openstack-infra | 09:35 | |
*** amitgandhinz has joined #openstack-infra | 09:35 | |
*** ociuhandu has joined #openstack-infra | 09:36 | |
*** Daisy has joined #openstack-infra | 09:38 | |
*** mgould|afk is now known as mgould | 09:38 | |
*** DaiDV has joined #openstack-infra | 09:38 | |
*** amitgandhinz has quit IRC | 09:40 | |
AJaeger | penguinolog: see my email on openstack-dev and the previous notice about needing new xenial images. | 09:41 |
*** thorst has quit IRC | 09:42 | |
*** Daisy has quit IRC | 09:42 | |
*** lvdongbing has quit IRC | 09:43 | |
*** Daisy has joined #openstack-infra | 09:43 | |
*** zhurong has quit IRC | 09:44 | |
*** Daisy has quit IRC | 09:48 | |
openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add Ironic multinode job https://review.openstack.org/332490 | 09:48 |
*** ociuhandu has quit IRC | 09:48 | |
AJaeger | jhesketh: did the xenial images build fine now? | 09:48 |
*** Daisy has joined #openstack-infra | 09:49 | |
*** daemontool has joined #openstack-infra | 09:49 | |
jhesketh | AJaeger: no, just debugging them.. they are failing fetching bulkify so I suspect it's a mirror issue | 09:49 |
jhesketh | AJaeger: http://paste.openstack.org/show/526524/ if you're interested | 09:50 |
AJaeger | jhesketh: was it perhaps removed? You know that pabelanger recreated the mirror yesterday since we had a mirror of the beta tree and kept old packages in it. | 09:50 |
AJaeger | Ah, that's an external package ;( | 09:50 |
jhesketh | it's on the mirrors and I'm not sure why it resolves to an external link there.. (which works for me) | 09:51 |
AJaeger | works for me as well | 09:51 |
*** eezhova has quit IRC | 09:51 | |
*** tonytan4ever has joined #openstack-infra | 09:52 | |
openstackgerrit | Merged openstack-infra/project-config: Add new project Fuel CCP https://review.openstack.org/335584 | 09:54 |
*** sorantis has quit IRC | 09:56 | |
rcarrillocruz | pabelanger , clarkb : i've sorted out with the NET team access to baremetal00 | 09:57 |
rcarrillocruz | let me know later if you can access ( you should ) | 09:57 |
*** nwkarsten has joined #openstack-infra | 09:57 | |
*** daemontool has quit IRC | 09:58 | |
openstackgerrit | Merged openstack-infra/project-config: Publish os-performance-tools docs https://review.openstack.org/317005 | 09:58 |
*** daemontool has joined #openstack-infra | 09:58 | |
*** Daisy has quit IRC | 09:59 | |
*** zeih has quit IRC | 09:59 | |
openstackgerrit | Merged openstack-infra/project-config: Add channel openstack-swg https://review.openstack.org/337899 | 10:00 |
yolanda | AJaeger, can you check https://review.openstack.org/#/c/337105/2 ? | 10:00 |
*** links has quit IRC | 10:00 | |
*** nwkarsten has quit IRC | 10:01 | |
*** zeih has joined #openstack-infra | 10:02 | |
*** notnownikki has joined #openstack-infra | 10:02 | |
openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Turn on additional configurations for zmq f-tests https://review.openstack.org/337105 | 10:03 |
*** Daisy has joined #openstack-infra | 10:05 | |
jamespage | yolanda, ta :-) | 10:08 |
yolanda | jamespage, np | 10:09 |
openstackgerrit | Merged openstack-infra/project-config: Add cursive library https://review.openstack.org/337709 | 10:10 |
*** Daisy has quit IRC | 10:10 | |
*** hashar has quit IRC | 10:11 | |
*** yanyanhu has quit IRC | 10:11 | |
*** Guest25627 has quit IRC | 10:12 | |
*** sorantis has joined #openstack-infra | 10:12 | |
*** sputnik13 has quit IRC | 10:13 | |
openstackgerrit | Merged openstack-infra/project-config: Run identity v3 only job in ceilometer https://review.openstack.org/315224 | 10:16 |
*** Daisy has joined #openstack-infra | 10:17 | |
AJaeger | yolanda: good catch, looks fine now IMHO. | 10:17 |
openstackgerrit | Merged openstack-infra/project-config: Run Ceilometer functional tests in Identity v3-only https://review.openstack.org/315077 | 10:17 |
openstackgerrit | Merged openstack-infra/system-config: Replace hpuseast name for chocolate https://review.openstack.org/330580 | 10:18 |
*** sshnaidm is now known as sshnaidm|afk | 10:18 | |
yolanda | AJaeger, approved | 10:18 |
openstackgerrit | Merged openstack-infra/project-config: Add install-guide job to Aodh https://review.openstack.org/337357 | 10:19 |
openstackgerrit | Merged openstack-infra/project-config: Add Magnum functional test for k8s ironic https://review.openstack.org/337386 | 10:19 |
openstackgerrit | Merged openstack-infra/project-config: Add CI jobs for murano-plugin-networking-sfc https://review.openstack.org/337113 | 10:19 |
rcarrillocruz | jhesketh: the two changes i was getting failures cloning puppet-openstackid went thru , thx | 10:21 |
*** DaiDV has quit IRC | 10:21 | |
rcarrillocruz | now i hoping i can merge my new ssh key and root access changes | 10:21 |
*** huanxie has quit IRC | 10:21 | |
*** Daisy has quit IRC | 10:22 | |
*** Daisy has joined #openstack-infra | 10:22 | |
*** jianghuaw has left #openstack-infra | 10:23 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow superusers to delete comments https://review.openstack.org/338164 | 10:26 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow editing and deletion of comments to be disabled https://review.openstack.org/338165 | 10:26 |
openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Start using infra element instead of puppet https://review.openstack.org/295168 | 10:26 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 10:26 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 10:26 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test for deleting non-existing flavors https://review.openstack.org/303515 | 10:26 |
jhesketh | rcarrillocruz: cool, sounds like it's fixed | 10:27 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add test for delete flavor exception with betamax https://review.openstack.org/303529 | 10:27 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update test for setting flavor specs to use betamax https://review.openstack.org/304064 | 10:27 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update test_unset_flavor_specs to use betamax https://review.openstack.org/304073 | 10:27 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list https://review.openstack.org/304171 | 10:27 |
*** Daisy has quit IRC | 10:27 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test for list flavors based on betamax https://review.openstack.org/305718 | 10:27 |
*** Daisy has joined #openstack-infra | 10:28 | |
openstackgerrit | Merged openstack-infra/project-config: Fuel-mirror project is deprecated https://review.openstack.org/335868 | 10:28 |
openstackgerrit | Merged openstack-infra/project-config: Add repositories for Charm layers https://review.openstack.org/334880 | 10:28 |
openstackgerrit | Merged openstack-infra/project-config: Add repositories for Charm interfaces https://review.openstack.org/334502 | 10:29 |
openstackgerrit | Merged openstack-infra/project-config: Fix branches for reno jobs of oslo projects https://review.openstack.org/337128 | 10:29 |
openstackgerrit | Ferenc Horváth proposed openstack-infra/project-config: Add job which builds test images with watchdog support https://review.openstack.org/329832 | 10:29 |
*** salv-orlando has joined #openstack-infra | 10:31 | |
*** Daisy has quit IRC | 10:32 | |
*** Daisy has joined #openstack-infra | 10:34 | |
*** mrmartin has quit IRC | 10:36 | |
*** amitgandhinz has joined #openstack-infra | 10:36 | |
*** Daisy has quit IRC | 10:38 | |
*** rossella_s has quit IRC | 10:39 | |
*** rossella_s has joined #openstack-infra | 10:39 | |
*** Daisy has joined #openstack-infra | 10:39 | |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add compute090.chocolate metadata for better tracking https://review.openstack.org/337595 | 10:40 |
*** thorst has joined #openstack-infra | 10:40 | |
*** amitgandhinz has quit IRC | 10:41 | |
*** jed56 has joined #openstack-infra | 10:41 | |
*** salv-orlando has quit IRC | 10:42 | |
*** Daisy has quit IRC | 10:44 | |
*** Daisy has joined #openstack-infra | 10:45 | |
*** salv-orlando has joined #openstack-infra | 10:45 | |
*** thorst has quit IRC | 10:46 | |
*** vsaienko1 has left #openstack-infra | 10:47 | |
*** Daisy has quit IRC | 10:49 | |
*** Daisy has joined #openstack-infra | 10:50 | |
openstackgerrit | Merged openstack-infra/project-config: Turn on additional configurations for zmq f-tests https://review.openstack.org/337105 | 10:51 |
*** yamamoto has quit IRC | 10:54 | |
*** ociuhandu has joined #openstack-infra | 10:55 | |
*** amotoki has joined #openstack-infra | 10:55 | |
*** Daisy has quit IRC | 10:55 | |
*** john-davidge_ is now known as john-davidge | 10:55 | |
*** eezhova has joined #openstack-infra | 10:55 | |
*** zeih has quit IRC | 10:56 | |
*** Daisy has joined #openstack-infra | 10:56 | |
*** tpsilva has joined #openstack-infra | 10:56 | |
*** amotoki has quit IRC | 10:56 | |
*** asettle has quit IRC | 10:57 | |
*** asettle has joined #openstack-infra | 10:57 | |
*** zeih has joined #openstack-infra | 10:57 | |
*** Daisy has quit IRC | 11:00 | |
*** asettle has quit IRC | 11:02 | |
*** zeih has quit IRC | 11:02 | |
frickler | jhesketh: do we have a snapshot of the old xenial mirror? maybe reverting the mirror state would be a feasible workaround until the new image builds are succeeding | 11:03 |
*** coolsvap has joined #openstack-infra | 11:05 | |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Add rcarrillocruz as infra-root https://review.openstack.org/337692 | 11:11 |
rcarrillocruz | yolanda: ^ pls | 11:11 |
*** weshay has joined #openstack-infra | 11:14 | |
*** lucasagomes is now known as lucas|hungry | 11:17 | |
*** sshnaidm|afk is now known as sshnaidm | 11:19 | |
*** erlon has joined #openstack-infra | 11:19 | |
openstackgerrit | Merged openstack-infra/system-config: Replace rcarrillocruz ssh key https://review.openstack.org/338067 | 11:22 |
*** links has joined #openstack-infra | 11:24 | |
*** zeih has joined #openstack-infra | 11:25 | |
*** asettle has joined #openstack-infra | 11:25 | |
*** swat30 has quit IRC | 11:26 | |
openstackgerrit | Liam Young proposed openstack-infra/irc-meetings: Add Juju Openstack Charms Meeting https://review.openstack.org/338187 | 11:26 |
*** swat30 has joined #openstack-infra | 11:27 | |
yolanda | rcarrillocruz, sure | 11:28 |
*** claudiub has joined #openstack-infra | 11:28 | |
*** zeih has quit IRC | 11:29 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Fix tempest configuration https://review.openstack.org/331997 | 11:33 |
*** ldnunes has joined #openstack-infra | 11:34 | |
openstackgerrit | Markus Zoeller (markus_z) proposed openstack-infra/release-tools: update the script to expire old bug reports https://review.openstack.org/337642 | 11:36 |
*** esikachev has quit IRC | 11:36 | |
rcarrillocruz | thx | 11:40 |
*** rodrigods has quit IRC | 11:41 | |
*** rodrigods has joined #openstack-infra | 11:41 | |
*** mrmartin has joined #openstack-infra | 11:41 | |
*** kzaitsev_mb has quit IRC | 11:42 | |
*** yamamoto has joined #openstack-infra | 11:42 | |
*** esikachev has joined #openstack-infra | 11:47 | |
*** deadnull has joined #openstack-infra | 11:49 | |
*** thorst has joined #openstack-infra | 11:50 | |
coolsvap | can someone help kick a spam guest user in #openstack-meeting | 11:52 |
*** thorst_ has joined #openstack-infra | 11:52 | |
coolsvap | we have requirements meeting in 8 minutes | 11:52 |
*** thorst__ has joined #openstack-infra | 11:52 | |
*** zeih has joined #openstack-infra | 11:53 | |
*** markusry has joined #openstack-infra | 11:53 | |
*** aysyd has joined #openstack-infra | 11:54 | |
*** thorst has quit IRC | 11:54 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Update overcloud log retrieval of rh2 https://review.openstack.org/338209 | 11:55 |
*** thorst_ has quit IRC | 11:56 | |
*** rfolco has joined #openstack-infra | 11:56 | |
*** Nikolay_St has quit IRC | 11:56 | |
*** kzaitsev_mb has joined #openstack-infra | 11:57 | |
*** hrybacki|afk is now known as hrybacki | 11:58 | |
*** zeih has quit IRC | 11:58 | |
*** salv-orl_ has joined #openstack-infra | 11:59 | |
*** Daisy has joined #openstack-infra | 11:59 | |
*** esikachev has quit IRC | 12:00 | |
*** amoralej is now known as amoralej|lunch | 12:01 | |
*** EricGonczer_ has joined #openstack-infra | 12:01 | |
*** salv-orlando has quit IRC | 12:01 | |
*** permalac has joined #openstack-infra | 12:02 | |
*** exploreshaifali has quit IRC | 12:02 | |
*** yamamoto has quit IRC | 12:02 | |
*** EricGonc_ has joined #openstack-infra | 12:03 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove Fedora support from CI scripts https://review.openstack.org/338210 | 12:03 |
*** salv-orl_ has quit IRC | 12:03 | |
*** DaiDV has joined #openstack-infra | 12:03 | |
*** weshay is now known as weshay_mtg | 12:04 | |
*** DaiDV has quit IRC | 12:04 | |
*** Daisy has quit IRC | 12:04 | |
*** savihou has quit IRC | 12:05 | |
*** DaiDV has joined #openstack-infra | 12:05 | |
*** Daisy has joined #openstack-infra | 12:05 | |
*** kzaitsev_mb has quit IRC | 12:06 | |
*** EricGonczer_ has quit IRC | 12:07 | |
*** dprince has joined #openstack-infra | 12:08 | |
*** markusry has quit IRC | 12:08 | |
*** markusry has joined #openstack-infra | 12:08 | |
*** psilvad has joined #openstack-infra | 12:08 | |
*** Daisy has quit IRC | 12:09 | |
*** vgridnev has quit IRC | 12:10 | |
*** yamamoto has joined #openstack-infra | 12:10 | |
*** Daisy has joined #openstack-infra | 12:10 | |
*** leifmadsen_ is now known as leifmadsen | 12:12 | |
*** ldnunes_ has joined #openstack-infra | 12:12 | |
*** raildo-afk is now known as raildo | 12:14 | |
*** Daisy has quit IRC | 12:15 | |
*** ldnunes has quit IRC | 12:15 | |
*** dprince has quit IRC | 12:16 | |
*** dprince has joined #openstack-infra | 12:16 | |
*** Daisy has joined #openstack-infra | 12:16 | |
*** rhallisey has joined #openstack-infra | 12:16 | |
openstackgerrit | Arie Bregman proposed openstack-infra/shade: Allow to register nodes from file https://review.openstack.org/338216 | 12:18 |
*** yamamoto has quit IRC | 12:18 | |
*** yamamoto has joined #openstack-infra | 12:19 | |
*** nmagnezi has quit IRC | 12:19 | |
*** Daisy has quit IRC | 12:20 | |
*** lucas|hungry is now known as lucasagomes | 12:21 | |
*** Daisy has joined #openstack-infra | 12:22 | |
*** vgridnev has joined #openstack-infra | 12:22 | |
*** ccamacho has quit IRC | 12:24 | |
*** amitgandhinz has joined #openstack-infra | 12:25 | |
*** ccamacho has joined #openstack-infra | 12:25 | |
*** Daisy has quit IRC | 12:26 | |
*** kzaitsev_mb has joined #openstack-infra | 12:27 | |
*** tonytan4ever has quit IRC | 12:27 | |
*** savihou has joined #openstack-infra | 12:27 | |
*** hashar has joined #openstack-infra | 12:27 | |
*** Daisy has joined #openstack-infra | 12:27 | |
*** berendt has joined #openstack-infra | 12:27 | |
openstackgerrit | Neil Jerram proposed openstack-infra/project-config: Add experimental CI test for networking-calico https://review.openstack.org/338224 | 12:28 |
*** amitgandhinz has quit IRC | 12:29 | |
*** thorst__ is now known as thorst | 12:30 | |
*** yamamoto has quit IRC | 12:31 | |
*** yamamoto has joined #openstack-infra | 12:31 | |
*** Daisy has quit IRC | 12:32 | |
*** yamamoto has quit IRC | 12:32 | |
*** Daisy has joined #openstack-infra | 12:33 | |
*** yamamoto has joined #openstack-infra | 12:34 | |
openstackgerrit | Arie Bregman proposed openstack-infra/shade: Allow to register nodes from file https://review.openstack.org/338216 | 12:34 |
*** Daisy has quit IRC | 12:38 | |
*** tonytan4ever has joined #openstack-infra | 12:38 | |
*** Daisy has joined #openstack-infra | 12:38 | |
*** zz_dimtruck is now known as dimtruck | 12:39 | |
*** esikachev has joined #openstack-infra | 12:39 | |
openstackgerrit | Liam Young proposed openstack-infra/irc-meetings: Add Juju Openstack Charms Meeting https://review.openstack.org/338187 | 12:40 |
AJaeger | jhesketh: I fear that xenial builds failed again since we merged some repos, didn't it? | 12:40 |
*** zeih has joined #openstack-infra | 12:41 | |
*** ramishra has quit IRC | 12:43 | |
*** Daisy has quit IRC | 12:43 | |
*** bryan_att has joined #openstack-infra | 12:43 | |
*** rlandy has joined #openstack-infra | 12:43 | |
openstackgerrit | Liam Young proposed openstack-infra/irc-meetings: Add Juju Openstack Charms Meeting https://review.openstack.org/338187 | 12:43 |
*** ramishra has joined #openstack-infra | 12:44 | |
*** cshastri has quit IRC | 12:49 | |
*** pradk has joined #openstack-infra | 12:49 | |
*** eharney has joined #openstack-infra | 12:49 | |
*** zeih has quit IRC | 12:51 | |
savihou | Hello Core Reviewers, apologies again for nudging - would apreciate your help with my problematic kid - https://review.openstack.org/#/c/263026/ , Thanks! | 12:53 |
*** kushal has joined #openstack-infra | 12:53 | |
*** kushal has joined #openstack-infra | 12:53 | |
*** kzaitsev_mb has quit IRC | 12:54 | |
*** zeih has joined #openstack-infra | 12:55 | |
*** Daisy has joined #openstack-infra | 12:55 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow comments to be edited by their owner https://review.openstack.org/333418 | 12:55 |
*** kzaitsev_mb has joined #openstack-infra | 12:56 | |
AJaeger | savihou: for which repository is your review? | 12:57 |
*** tlian has joined #openstack-infra | 12:57 | |
savihou | AJaeger: Apologies, wrong channel :) | 12:58 |
AJaeger | Ah... | 12:58 |
*** Daisy has quit IRC | 12:59 | |
openstackgerrit | Neil Jerram proposed openstack-infra/project-config: Add experimental CI test for networking-calico https://review.openstack.org/338224 | 13:00 |
*** yamamoto has quit IRC | 13:00 | |
*** Goneri has joined #openstack-infra | 13:01 | |
openstackgerrit | Liam Young proposed openstack-infra/irc-meetings: Add Juju Openstack Charms Meeting https://review.openstack.org/338187 | 13:01 |
jhesketh | AJaeger: it was failing to get that package still but I haven't figured out why.. what merged repos are you refering to? | 13:01 |
*** abe_music has joined #openstack-infra | 13:02 | |
*** mdrabe has joined #openstack-infra | 13:03 | |
*** isaacb has quit IRC | 13:03 | |
*** weshay_mtg is now known as weshay | 13:04 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow editing and deletion of comments to be disabled https://review.openstack.org/338165 | 13:04 |
*** AL34N1X has joined #openstack-infra | 13:04 | |
*** woodster_ has joined #openstack-infra | 13:04 | |
AJaeger | jhesketh: looking at the log file, it seems it failed since it tried to access new repos while those were just beeing created - the usual problem if we approve new repos while images are building. | 13:04 |
*** cshastri has joined #openstack-infra | 13:04 | |
AJaeger | Oh, I just see the log file is continuing... | 13:05 |
AJaeger | but very large today - 18 M compared to yesterdays 5 M | 13:05 |
jhesketh | AJaeger: oh right.. I just kicked it off again so it might be that one | 13:05 |
jhesketh | AJaeger: yeah I had a few runs all failing at various networks or repos | 13:06 |
AJaeger | Ah, so it'S appending to the same log? Ok... | 13:06 |
*** Daisy has joined #openstack-infra | 13:06 | |
AJaeger | Ok, let's see what happens. Thanks, jhesketh | 13:06 |
jhesketh | yep, all appended... I could rotate them manually | 13:07 |
jhesketh | yep | 13:07 |
*** trown|outtypewww is now known as trown | 13:07 | |
*** kzaitsev_mb has quit IRC | 13:07 | |
*** jtomasek_ has joined #openstack-infra | 13:08 | |
*** dane-fichter has joined #openstack-infra | 13:09 | |
*** Daisy has quit IRC | 13:10 | |
dane-fichter | Hey if anyone on the infra team has a sec, could you add me (dane-fichter) to the cursive-core and cursive-release Gerrit groups? | 13:10 |
dane-fichter | AJaeger: ^ | 13:11 |
*** dfflanders has quit IRC | 13:11 | |
AJaeger | dane-fichter: I don't have those permissions, an infra-root needs to do this. | 13:11 |
*** jcoufal has joined #openstack-infra | 13:11 | |
*** Daisy has joined #openstack-infra | 13:12 | |
dane-fichter | AJaeger: How do I get in touch with someone on that team? | 13:12 |
yolanda | hi dane-fichter , i can help | 13:13 |
dane-fichter | hi yolanda | 13:13 |
dane-fichter | thanks | 13:13 |
AJaeger | dane-fichter: just asking here is enough as you see ;) | 13:13 |
yolanda | dane-fichter, do you have the change that you sent when you created that project handy? | 13:13 |
*** abe_music has left #openstack-infra | 13:14 | |
*** amoralej|lunch is now known as amoralej | 13:14 | |
dane-fichter | yolanda: https://review.openstack.org/#/c/337709/ | 13:14 |
gnuoy | Could someone help me understand why Jenkins is nack'ing https://review.openstack.org/#/c/338187 ? If I follow the link to the Jenkins run it seems to show a beutifully formatted page showing details of the meeting but I can't see an error. I'm sure I'm missing something obvious. | 13:15 |
yolanda | dane-fichter, i see that you have two accounts. One with the email in caps, another with email in lower case, what's prefered one? | 13:15 |
dane-fichter | yolanda: Oh god this again. hold on let me check | 13:15 |
*** solumuser__ has quit IRC | 13:16 | |
AJaeger | gnuoy: go to http://logs.openstack.org/87/338187/4/check/gate-irc-meetings-tox-ical/c1f72dd/console.html to get the log file | 13:16 |
dane-fichter | yolanda: lower case please. | 13:16 |
*** Daisy has quit IRC | 13:16 | |
*** kgiusti has joined #openstack-infra | 13:16 | |
gnuoy | AJaeger, thanks. | 13:16 |
*** mrmartin has quit IRC | 13:16 | |
yolanda | done | 13:17 |
dane-fichter | yolanda: thanks so much | 13:17 |
yolanda | anytime | 13:17 |
dane-fichter | for what it's worth y'all are extremely responsive and awesome | 13:17 |
*** zhurong has joined #openstack-infra | 13:18 | |
*** inc0 has joined #openstack-infra | 13:20 | |
fungi | AJaeger: that job used to only publish index.html if it passed, i thought | 13:20 |
fungi | i wonder if we somehow screwed it up in redoing the publishers for zuul v2.5 | 13:21 |
*** _ari_ has joined #openstack-infra | 13:22 | |
*** inc0_ has joined #openstack-infra | 13:22 | |
*** sigmavirus_away is now known as sigmavirus | 13:24 | |
*** mhickey has quit IRC | 13:24 | |
*** inc0 has quit IRC | 13:25 | |
*** amitgandhinz has joined #openstack-infra | 13:25 | |
*** zeih has quit IRC | 13:25 | |
*** tonytan4ever has quit IRC | 13:26 | |
*** tqtran has joined #openstack-infra | 13:26 | |
*** tonytan4ever has joined #openstack-infra | 13:27 | |
*** tonytan_brb has joined #openstack-infra | 13:27 | |
*** kzaitsev_mb has joined #openstack-infra | 13:27 | |
*** njohnston_ has joined #openstack-infra | 13:27 | |
*** tonytan4ever has quit IRC | 13:28 | |
AJaeger | fungi: ah - let's review it. | 13:28 |
*** rhallisey has quit IRC | 13:29 | |
*** bexelbie has quit IRC | 13:29 | |
AJaeger | fungi, the job has "copy-after-failure: true" | 13:29 |
*** amitgandhinz has quit IRC | 13:30 | |
*** yamamoto has joined #openstack-infra | 13:30 | |
*** tqtran has quit IRC | 13:30 | |
*** rhallisey has joined #openstack-infra | 13:30 | |
AJaeger | fungi, could you double check this? In infra.yaml | 13:30 |
*** isaacb has joined #openstack-infra | 13:30 | |
AJaeger | fungi, did you read backscroll about xenial images? OR do you want a short summary? | 13:30 |
*** amitgandhinz has joined #openstack-infra | 13:31 | |
*** njohnston_ is now known as njohnston | 13:32 | |
*** Daisy has joined #openstack-infra | 13:32 | |
*** esberglu has joined #openstack-infra | 13:32 | |
puiterwijk | jeblair: hi, just checking in if you had any updates or questions about Ipsilon? | 13:33 |
*** dkehn__ is now known as dkehn_ | 13:34 | |
fungi | AJaeger: yeah, i caught up on the xenial discussion | 13:35 |
rcarrillocruz | hey folks, i'll be off my afternoon/evening, my son is sick and i'll be taking care of him | 13:35 |
rcarrillocruz | fungi: got an email from a HPE program manager to have a call about the infracloud hw move | 13:36 |
*** esikachev has quit IRC | 13:36 | |
rcarrillocruz | i'll try to move it tomorrow and ask him for people from here to attend | 13:36 |
rcarrillocruz | all good? | 13:36 |
fungi | puiterwijk: smarcet should be back around this week, and we needed to find out what extensions to openid were implemented in openstackid which foundation web properties might be relying on | 13:36 |
fungi | rcarrillocruz: yep, works for me. thanks! | 13:36 |
puiterwijk | fungi: okay, sounds good. Feel free to let him ping me if he wants to discuss about it or anything | 13:37 |
AJaeger | rcarrillocruz: all the best for your son, don't get ill yourself! | 13:37 |
*** asettle has quit IRC | 13:37 | |
*** cardeois has joined #openstack-infra | 13:37 | |
*** Daisy has quit IRC | 13:37 | |
*** hashar has quit IRC | 13:37 | |
rcarrillocruz | indeed, cos when toddlers get sick *somehow* parents get sick multiplied by two or three :S | 13:37 |
*** amotoki has joined #openstack-infra | 13:37 | |
*** asettle has joined #openstack-infra | 13:37 | |
*** ayoung has joined #openstack-infra | 13:38 | |
*** coreycb` has quit IRC | 13:38 | |
*** hashar has joined #openstack-infra | 13:38 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Update trove meeting information https://review.openstack.org/338127 | 13:38 |
*** oanson has quit IRC | 13:38 | |
*** coreycb has joined #openstack-infra | 13:38 | |
*** solumuser__ has joined #openstack-infra | 13:38 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow comments to be edited by their owner https://review.openstack.org/333418 | 13:38 |
*** mhickey has joined #openstack-infra | 13:39 | |
*** itisha has joined #openstack-infra | 13:39 | |
*** pt_15 has joined #openstack-infra | 13:40 | |
AJaeger | rcarrillocruz: been there often enough ;( | 13:40 |
*** kzaitsev_mb has quit IRC | 13:41 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Update Horizon Meeting times https://review.openstack.org/338130 | 13:41 |
*** EricGonc_ has quit IRC | 13:42 | |
Shrews | TheJulia: you may want to review 338216 | 13:42 |
*** nwkarsten has joined #openstack-infra | 13:42 | |
*** dimtruck is now known as zz_dimtruck | 13:43 | |
*** kzaitsev_mb has joined #openstack-infra | 13:44 | |
*** kushal has quit IRC | 13:44 | |
*** Daisy has joined #openstack-infra | 13:44 | |
openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Adds ironic v3 only job https://review.openstack.org/304306 | 13:47 |
jhesketh | AJaeger, fungi: looks like xenial is stuck on doing the npm install again (it's about to fail) | 13:48 |
AJaeger | sad panda ;( | 13:48 |
*** Daisy has quit IRC | 13:48 | |
*** r-mibu has quit IRC | 13:49 | |
*** mrmartin has joined #openstack-infra | 13:49 | |
*** r-mibu has joined #openstack-infra | 13:49 | |
jhesketh | I don't think I'm going to have time to debug further sorry | 13:49 |
*** Daisy has joined #openstack-infra | 13:50 | |
frickler | fungi: is there any chance to get the xenial mirror back to the state where it had the php5 pkgs? that should get jobs running until fixed images are available | 13:50 |
AJaeger | fungi, could you take over from jhesketh, please? | 13:53 |
*** Daisy has quit IRC | 13:54 | |
*** eezhova has quit IRC | 13:54 | |
*** mriedem has joined #openstack-infra | 13:54 | |
frickler | fungi: if you are missing the packages, it seems I have them in some snapshots on my local xenial mirror | 13:54 |
TheJulia | Shrews: thank you | 13:54 |
*** jlanoux has quit IRC | 13:54 | |
*** xyang1 has joined #openstack-infra | 13:54 | |
*** Daisy has joined #openstack-infra | 13:55 | |
*** eezhova has joined #openstack-infra | 13:56 | |
*** esikachev has joined #openstack-infra | 13:57 | |
*** links has quit IRC | 13:57 | |
AJaeger | fungi, jhesketh : Can we reach the https://registry.npmjs.org/bulkify/-/bulkify-1.1.1.tgz from the nodepool server itself? | 13:57 |
*** nbloom has quit IRC | 13:58 | |
*** xarses has quit IRC | 13:58 | |
*** garyk1 has quit IRC | 13:58 | |
fungi | frickler: the problem with that idea is that what we were testing wasn't really xenial anyway | 13:58 |
fungi | AJaeger: i think krot_vaca_jul19 said something about npm being semi-broken on xenial | 13:59 |
*** rbrndt has joined #openstack-infra | 13:59 | |
AJaeger | ;( | 13:59 |
*** Daisy has quit IRC | 13:59 | |
fungi | frequent timeouts retrieving packages or something | 13:59 |
jhesketh | AJaeger: yes | 14:00 |
fungi | i can wget that url fine from nodepool.o.o but the npm version in the xenial chroot might be choking on it still | 14:00 |
AJaeger | So, how can we then build images with stackviz? Disable stackviz completely - or only for xenial? | 14:00 |
AJaeger | thanks for confirming that wget works | 14:00 |
*** Daisy has joined #openstack-infra | 14:01 | |
fungi | we could probably move the stackviz element up into the nodepool config (no longer depend on it in other elements) and then not include it on xenial | 14:01 |
fungi | or we could add a conditional to no-op in its element | 14:01 |
fungi | or... there are really countless options to make that happen | 14:01 |
timothyb89 | this may be an issue I can fix in stackviz itself? | 14:03 |
*** AL34N1X has quit IRC | 14:03 | |
fungi | timothyb89: perhaps. you could make it not use npm? | 14:03 |
*** julim has joined #openstack-infra | 14:03 | |
fungi | dunno how integral javascript is to stackviz's design | 14:03 |
timothyb89 | ah, well, that may be more difficult... but if its one failing dependency I may be able to work around it | 14:04 |
AJaeger | timothyb89: failure is http://paste.openstack.org/show/526524/ | 14:04 |
timothyb89 | sorry, still catching up on the issue | 14:04 |
*** savihou has quit IRC | 14:04 | |
*** PollyZ has joined #openstack-infra | 14:04 | |
AJaeger | timothyb89: so, npn imstall gets 502 on installing bulkify | 14:04 |
*** savihou has joined #openstack-infra | 14:04 | |
fungi | timothyb89: i think the issue is that npm on ubuntu 16.04 hits arbitrary timeouts at random (or semi-random) | 14:04 |
frickler | fungi: iiuc your xenial mirror was including pre-release packages of php5*, that got removed for final xenial release and now the jobs trying to install them are broken. I can offer you a snapshot of xenial repos from 20160329 that still has the packages. you could use these until the patch to not install php5 on xenial can take effect | 14:05 |
*** Daisy has quit IRC | 14:05 | |
*** zz_dimtruck is now known as dimtruck | 14:05 | |
fungi | frickler: sure, but that's not xenial. might as well just run jobs on trusty and install some newer packages | 14:05 |
fungi | it was a preview of xenial with old packages | 14:06 |
timothyb89 | fungi: it looks like its getting http errors from the server, it may be some degradation on npm's end, but probably not a timeout on ours | 14:06 |
*** Daisy has joined #openstack-infra | 14:06 | |
fungi | we should have never started relying on it in that state, but we didn't know | 14:06 |
fungi | jhesketh: what's the npm error we're getting on that lib? | 14:08 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Disable stackviz on xenial for now https://review.openstack.org/338276 | 14:08 |
AJaeger | fungi, I do not see a dependency on stackviz but I'm not a nodepool expert. What do you think of the change above? ^ | 14:08 |
*** SamYaple has joined #openstack-infra | 14:08 | |
timothyb89 | fungi, AJaeger: if it's just the one job failure, we may just be able to retry the image build? I'm not seeing any signs its anything but a random failure on npm's end | 14:09 |
fungi | AJaeger: perfect. the other half of what i was suggesting was apparently already the case | 14:09 |
*** jamesmcarthur has joined #openstack-infra | 14:09 | |
AJaeger | timothyb89: jhesketh has retried several times today already ;( | 14:09 |
*** thiagop has joined #openstack-infra | 14:09 | |
fungi | timothyb89: yeah, retries are apparently still hitting that error | 14:09 |
timothyb89 | oh, sorry, didn't see those logs | 14:10 |
AJaeger | timothyb89: see http://nodepool.openstack.org/dib.ubuntu-xenial.log for logs of retries | 14:10 |
AJaeger | timothyb89: that paste just contained the essence. | 14:10 |
AJaeger | timothyb89: it takes 90 mins to build an image - and it aborts after one hour or so ;( | 14:10 |
*** Daisy has quit IRC | 14:10 | |
fungi | i said "timeouts" earlier but really i don't recall much of the issue krot_vaca_jul19 was tracking other than npm is unreliable on xenial. i'm looking for the details on that now | 14:11 |
AJaeger | timothyb89: and right now we have xenial completely broken for non-dsvm jobs - so we need to fix it. | 14:11 |
*** cbader has quit IRC | 14:11 | |
*** dangers_away has quit IRC | 14:11 | |
*** electrofelix has quit IRC | 14:11 | |
timothyb89 | AJaeger: alright, makes sense. I suspect all we can do is wait for that npm mirror to update its cache | 14:11 |
*** solumuser__ has quit IRC | 14:12 | |
*** dangers_away has joined #openstack-infra | 14:12 | |
*** cbader has joined #openstack-infra | 14:12 | |
*** fernnest_ has joined #openstack-infra | 14:12 | |
*** Daisy has joined #openstack-infra | 14:12 | |
*** jtomasek_ has quit IRC | 14:12 | |
*** caowei has joined #openstack-infra | 14:12 | |
jeblair | fungi, AJaeger: would reverting to yesterday's xenial images help? | 14:12 |
timothyb89 | AJaeger, fungi: would it make sense to change the behavior of the stackviz script so it doesn't cause the whole job to fail? I think that should be an easy enough change | 14:12 |
*** isaacb has quit IRC | 14:12 | |
*** hashar_ has joined #openstack-infra | 14:12 | |
AJaeger | jeblair: not at all. We recreated the xenial mirror | 14:12 |
*** hashar_ has quit IRC | 14:13 | |
AJaeger | And our old images (all of them) have in the bindep list a reference to packages in the xenial mirror. | 14:13 |
*** AL34N1X has joined #openstack-infra | 14:13 | |
AJaeger | So, the only alternative is adding those broken packages to our mirror. | 14:13 |
fungi | jeblair: nope. the problem is that the bindep fallback list embedded in images up to now expect packages which are no longer ()and never should have been) on the mirror | 14:13 |
*** hashar_ has joined #openstack-infra | 14:13 | |
jeblair | gotcha | 14:13 |
*** fernnest has quit IRC | 14:14 | |
*** hashar has quit IRC | 14:14 | |
*** hongbin has joined #openstack-infra | 14:14 | |
fungi | apparently we synced the mirror before xenial was released, and ubuntu deleted packages from xenial between then and the release but reprepro doesn't remove them in that situation | 14:14 |
fungi | and so we had jobs installing packages which ubuntu didn't officially include in xenial | 14:15 |
fungi | and didn't realize it until yesterday | 14:15 |
*** amotoki has quit IRC | 14:15 | |
AJaeger | we should have first removed the entries from bindep; create new images and then recreated the mirror. But overlooked that first recreating the mirrors broke everything. | 14:16 |
AJaeger | AFAIK it's only python 3.5 and those jobs are non-voting... | 14:16 |
AJaeger | The only voting change was reverted already so that tempest can continue to merge. | 14:17 |
fungi | i think some projects move to xenial for their jobs already for newer versions of other things | 14:17 |
fungi | er, moved | 14:17 |
*** Daisy has quit IRC | 14:17 | |
AJaeger | fungi: yeah - but those are using devstack, not bindep fallback I guess. | 14:17 |
* AJaeger didn't check | 14:17 | |
fungi | ahh, fair point most of them _are_ devstack-based i think | 14:17 |
*** Daisy has joined #openstack-infra | 14:17 | |
AJaeger | At least there was nobody here yet complaining ;) | 14:18 |
fungi | well, frickler seems pretty urgent about something | 14:18 |
fungi | not sure if it's over a voting non-py35 job | 14:19 |
fungi | or something else | 14:19 |
mtreinish | AJaeger: I was gonna before the revert :) | 14:19 |
jhesketh | fungi: 502 (I can pull up the logs if you need) | 14:19 |
*** mdrabe has quit IRC | 14:20 | |
AJaeger | fungi: he showed nova and ceilometer logs for py35. But might be others he's interested in as well... | 14:20 |
fungi | jhesketh: nah, i was going to try to hunt down any npm bugs that might explain that error | 14:20 |
fungi | but now my workstation is severely overheating. i may need to drop offline for a while and try to hack a replacement fan into it somehow | 14:21 |
*** sorantis has quit IRC | 14:21 | |
*** Daisy has quit IRC | 14:22 | |
AJaeger | ;( | 14:23 |
fungi | downside to these ultra-compact computer models. unless they rely exclusively on passive cooling they include impossible to find super--tiny fans | 14:23 |
mtreinish | fungi: sounds like it's time for you to water cool it | 14:24 |
*** zhurong has quit IRC | 14:24 | |
fungi | that's so messy | 14:24 |
*** xarses has joined #openstack-infra | 14:25 | |
*** isaacb has joined #openstack-infra | 14:25 | |
fungi | for many years my younger brother was into active fluid cooling for overclocking purposes. it's a serious pain to maintain | 14:25 |
mtreinish | fungi: heh, not as messy as sticking it in a fish tank filled with mineral oil, which is another option :) | 14:25 |
openstackgerrit | Tim Buckley proposed openstack-infra/project-config: Ignore errors during stackviz build https://review.openstack.org/338288 | 14:26 |
timothyb89 | fungi, AJaeger, jhesketh, mtreinish: ^^^ | 14:26 |
abregman | I was asked to "add a reno release note" in shade with one of my patches. I have no idea what is the process to do that..can anyone explain? | 14:26 |
timothyb89 | that patch should help work around future errors like this | 14:26 |
*** mriedem1 has joined #openstack-infra | 14:26 | |
AJaeger | abregman: let me get you a link... | 14:26 |
mtreinish | abregman: http://docs.openstack.org/developer/reno/usage.html#creating-new-release-notes | 14:26 |
*** mriedem has quit IRC | 14:26 | |
abregman | mtreinish, AJaeger: thank you :) | 14:26 |
AJaeger | thanks, mtreinish ! You're too fast ;) | 14:27 |
fungi | i have a super-tiny fan i took out of a radio transmitter that didn't need it because i'm operating it in a very low-power mode, and though it's not the same size as the dead fan in this machine and i probably won't be able to reassemble the case fully with it in there, it's probably better than the present situation | 14:27 |
*** aarefiev has quit IRC | 14:28 | |
mtreinish | AJaeger: heh, it was just in my recent browser history. I've had to share it a few time the past few weeks | 14:28 |
*** mriedem1 is now known as mriedem | 14:29 | |
mtreinish | fungi: yeah, it's probably better than nothing | 14:29 |
fungi | even having closed out all non-essential applications and just running some xterms and simple console tools the cores have auto-scaled down to ~200mhz and all the thermocouples are reading 100c/alarm crit | 14:29 |
fungi | load average is only ~0.25 right now | 14:29 |
*** psachin has quit IRC | 14:30 | |
*** aarefiev has joined #openstack-infra | 14:30 | |
* fungi will be afk for 30 minutes or so | 14:30 | |
*** gordc has joined #openstack-infra | 14:31 | |
*** mdrabe has joined #openstack-infra | 14:31 | |
AJaeger | timothyb89: thanks for the change. Let's see what others say to it. Once that patch is in, we can revert mine. I'm not really happy about silent fails as you change does. | 14:31 |
fungi | oh, before i disappear... is devstack-gate relying on stackviz presence on images now? if so, rebuilding xenial without stackviz might break all devstack-based jobs on xenial? | 14:32 |
timothyb89 | AJaeger: neither am I, but npm is depressingly unreliable :( | 14:32 |
timothyb89 | fungi: devstack-gate will simply not build stackviz if /opt/stackviz doesn't exist | 14:33 |
AJaeger | thanks for confirming, timothyb89 | 14:33 |
fungi | timothyb89: okay, so we'll fail gracefully without stackviz on images. good to know | 14:33 |
*** sdake has joined #openstack-infra | 14:33 | |
*** AL34N1X has quit IRC | 14:33 | |
*** amotoki has joined #openstack-infra | 14:34 | |
Shrews | abregman: you should read http://docs.openstack.org/infra/shade/coding.html | 14:34 |
*** Daisy has joined #openstack-infra | 14:34 | |
*** psachin has joined #openstack-infra | 14:35 | |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Added missed exports to sahara-cli job https://review.openstack.org/338292 | 14:36 |
mtreinish | fungi: https://www.pugetsystems.com/submerged.php :) | 14:36 |
*** adrian_otto has joined #openstack-infra | 14:37 | |
*** Daisy has quit IRC | 14:38 | |
openstackgerrit | Tim Buckley proposed openstack-infra/project-config: Ignore errors during stackviz build https://review.openstack.org/338288 | 14:38 |
*** rossella_s has quit IRC | 14:39 | |
timothyb89 | fungi, AJaeger: ^^^ a few more safety checks while we're at it | 14:39 |
*** rossella_s has joined #openstack-infra | 14:39 | |
*** yamahata has joined #openstack-infra | 14:39 | |
dulek | Hi, can I get some infra cores feedback on devstack-gate patch: https://review.openstack.org/#/c/327619/ ? | 14:41 |
AJaeger | jeblair: still happy with 338288? | 14:41 |
*** Goneri has quit IRC | 14:42 | |
jeblair | yep | 14:42 |
*** exploreshaifali has joined #openstack-infra | 14:42 | |
*** weshay is now known as weshay_afk | 14:43 | |
*** exploreshaifali has quit IRC | 14:44 | |
AJaeger | So, should we take timothyb89's change - and abandon my https://review.openstack.org/338276 for rebuild? | 14:44 |
* AJaeger needs to leave now - I'm happy with whatever you all decide on doing - and will check in later tonight again | 14:45 | |
timothyb89 | AJaeger: it may still be best to put yours through if we need images rebuilt ASAP | 14:45 |
*** Daisy has joined #openstack-infra | 14:45 | |
*** caowei has quit IRC | 14:45 | |
*** PollyZ has quit IRC | 14:46 | |
*** exploreshaifali has joined #openstack-infra | 14:46 | |
*** PollyZ has joined #openstack-infra | 14:46 | |
*** hashar_ is now known as hashar | 14:49 | |
*** Daisy has quit IRC | 14:50 | |
*** EricGonczer_ has joined #openstack-infra | 14:50 | |
*** armax has joined #openstack-infra | 14:51 | |
*** Daisy has joined #openstack-infra | 14:51 | |
*** mhickey has quit IRC | 14:54 | |
openstackgerrit | Merged openstack-infra/project-config: Disable stackviz on xenial for now https://review.openstack.org/338276 | 14:55 |
*** Daisy has quit IRC | 14:56 | |
*** trown is now known as trown|brb | 14:56 | |
*** Daisy has joined #openstack-infra | 14:56 | |
*** adrian_otto has quit IRC | 14:57 | |
*** slaweq has quit IRC | 14:57 | |
*** maishsk has quit IRC | 14:58 | |
*** Swami has joined #openstack-infra | 14:58 | |
*** Swami_ has joined #openstack-infra | 14:58 | |
*** trown|brb is now known as trown | 15:00 | |
*** pilgrimstack has quit IRC | 15:00 | |
*** njohnston has left #openstack-infra | 15:00 | |
*** Julien-zte has joined #openstack-infra | 15:00 | |
*** Daisy has quit IRC | 15:01 | |
*** eezhova has quit IRC | 15:01 | |
*** karthikp_ has joined #openstack-infra | 15:01 | |
*** isaacb has quit IRC | 15:01 | |
*** Daisy has joined #openstack-infra | 15:02 | |
*** eezhova has joined #openstack-infra | 15:03 | |
*** nwkarsten has quit IRC | 15:04 | |
openstackgerrit | Arie Bregman proposed openstack-infra/shade: Allow to register nodes from file https://review.openstack.org/338216 | 15:04 |
*** nwkarsten has joined #openstack-infra | 15:04 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow editing and deletion of comments to be disabled https://review.openstack.org/338165 | 15:04 |
*** ddieterly has joined #openstack-infra | 15:05 | |
*** pcaruana has quit IRC | 15:06 | |
Shrews | SpamapS: since you had some comments on https://review.openstack.org/319395, will let you decide if it's ready to go | 15:06 |
*** mhickey has joined #openstack-infra | 15:06 | |
*** Daisy has quit IRC | 15:07 | |
*** harlowja has joined #openstack-infra | 15:07 | |
*** Daisy has joined #openstack-infra | 15:07 | |
*** tphummel has joined #openstack-infra | 15:08 | |
*** PollyZ has quit IRC | 15:08 | |
openstackgerrit | Arie Bregman proposed openstack-infra/shade: Allow to register nodes from file https://review.openstack.org/338216 | 15:08 |
*** nwkarsten has quit IRC | 15:09 | |
*** cbader has quit IRC | 15:09 | |
*** nmagnezi has joined #openstack-infra | 15:10 | |
*** psachin has quit IRC | 15:10 | |
*** rcernin has quit IRC | 15:10 | |
*** cshastri has quit IRC | 15:10 | |
*** psachin has joined #openstack-infra | 15:10 | |
*** Daisy has quit IRC | 15:12 | |
*** Daisy has joined #openstack-infra | 15:13 | |
slagle | pabelanger: is there a way to test experimental jobs with this? https://review.openstack.org/#/c/337889/ or do we need to just wait for it to merge? | 15:13 |
slagle | i wasn't sure if a depends-on would work | 15:14 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Update overcloud log retrieval of rh2 https://review.openstack.org/338209 | 15:14 |
*** gsilvis_ is now known as gsilvis | 15:14 | |
*** Swami__ has joined #openstack-infra | 15:18 | |
EmilienM | Shrews: is your async work merged in ansible ? I was not sure | 15:18 |
*** Daisy has quit IRC | 15:18 | |
*** rajinir has joined #openstack-infra | 15:18 | |
*** dprince has quit IRC | 15:18 | |
*** kzaitsev_mb has quit IRC | 15:18 | |
*** tonytan_brb is now known as tonytan4ever | 15:18 | |
*** Daisy has joined #openstack-infra | 15:19 | |
*** yamamoto has quit IRC | 15:19 | |
*** kzaitsev_mb has joined #openstack-infra | 15:20 | |
*** yamamoto has joined #openstack-infra | 15:20 | |
Shrews | EmilienM: neither mine nor mordred's have merged yet (mordred: you should add a 'ready_for_review' comment on yours to get the needs_rebase tag off) | 15:20 |
EmilienM | Shrews: ack | 15:21 |
EmilienM | Shrews: /me waiting for https://review.openstack.org/#/c/334464/ | 15:21 |
pabelanger | morning | 15:21 |
*** Swami has quit IRC | 15:21 | |
pabelanger | just catching up on backscroll now | 15:21 |
*** esikachev has quit IRC | 15:22 | |
*** Daisy has quit IRC | 15:23 | |
*** PollyZ has joined #openstack-infra | 15:23 | |
pabelanger | AJaeger: Right, we rebuilt of xenial mirror last night as a results the php5 packages were removed. Which would break python35 jobs using bindep fallback | 15:24 |
*** Daisy has joined #openstack-infra | 15:24 | |
therve | We're getting failures in heat when trying to boot up a qcow image in integration tests | 15:24 |
therve | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Unable%20to%20convert%20image%20to%20raw.%5C%22 | 15:25 |
*** inc0_ has quit IRC | 15:25 | |
therve | Started a lot around 2 days ago | 15:25 |
Shrews | EmilienM: there is an ansible core team meeting tomorrow. if i can remember, i'll bring those PRs up in the meeting | 15:25 |
*** Kiall has quit IRC | 15:25 | |
*** inc0 has joined #openstack-infra | 15:25 | |
pabelanger | slagle: need to wait, I'll refresh our centos-7 image too today | 15:25 |
*** mtanino has joined #openstack-infra | 15:26 | |
*** weshay_afk is now known as weshay | 15:26 | |
*** rhallisey has quit IRC | 15:27 | |
therve | Does any other project test booting qcow images? | 15:27 |
*** Kiall has joined #openstack-infra | 15:28 | |
slagle | pabelanger: ack, thx | 15:28 |
*** andreas_s has quit IRC | 15:30 | |
*** nmagnezi has quit IRC | 15:31 | |
sileht | dansmith, dtroyer , Hi, can I get your though about grenade stuffs ? https://review.openstack.org/#/c/335363/ | 15:31 |
openstackgerrit | Tim Buckley proposed openstack-infra/project-config: Ignore errors during stackviz build https://review.openstack.org/338288 | 15:33 |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Add hyperconverged Ceph to the HA job https://review.openstack.org/338088 | 15:33 |
clarkb | therve: the nodepool tests do, not sure if tempest is using qcow2 cirroa | 15:34 |
greghaynes | therve: theres a handful of projects which do | 15:34 |
*** salv-orlando has joined #openstack-infra | 15:34 | |
*** Daisy has quit IRC | 15:34 | |
therve | clarkb, greghaynes: OK, thanks. Weird that we're the only ones seeing that, I'm not sure what's specific about the Heat test | 15:35 |
therve | Maybe a slightly bigger image | 15:35 |
clarkb | or format mismatches somehow | 15:35 |
pabelanger | fungi: AJaeger: I restarted the ubuntu-xenial builds | 15:35 |
clarkb | since qcow2 has multiple incompatible versions | 15:36 |
greghaynes | haha, I really hope that is gone | 15:36 |
therve | clarkb, Which would depend on what? qemu tools version? | 15:36 |
*** watersoul_ has quit IRC | 15:36 | |
therve | It's not a systematic error, unfortunately or not | 15:36 |
*** watersoul has joined #openstack-infra | 15:37 | |
clarkb | therve: qemu-img iirc | 15:37 |
pabelanger | fungi: AJaeger: So, I am thinking for stackviz, we ignore errors in the elements and continue regardless if stackviz installs. | 15:37 |
*** mriedem1 has joined #openstack-infra | 15:37 | |
pabelanger | fungi: AJaeger: Then, more the build process outside of DIBs into a periodic job where we can download the bits from tarballs.o.o | 15:37 |
*** makowals has quit IRC | 15:38 | |
openstackgerrit | Merged openstack-infra/puppet-iptables: Ensure service logic run regardless of using chroot https://review.openstack.org/337889 | 15:38 |
*** vhosakot has joined #openstack-infra | 15:39 | |
mtreinish | clarkb: http://logs.openstack.org/09/337809/5/check/gate-tempest-dsvm-neutron-full/bc63d52/logs/devstacklog.txt.gz#_2016-07-06_10_41_00_119 it's not qcow in the gate | 15:39 |
*** mriedem has quit IRC | 15:39 | |
*** mriedem1 is now known as mriedem | 15:39 | |
*** Daisy has joined #openstack-infra | 15:41 | |
clarkb | mtreinish: that is sadness | 15:41 |
*** Goneri has joined #openstack-infra | 15:41 | |
* clarkb is not aware of any clouds that use that image format | 15:41 | |
mtreinish | clarkb: amazon does... | 15:41 |
*** rhallisey has joined #openstack-infra | 15:41 | |
clarkb | mtreinish: openstack clouds :P | 15:41 |
clarkb | we use a bunch of clouds and its all raw, vhd, or qcow2 | 15:41 |
mtreinish | I didn't realize that we used it either. I knew we had a bunch of legacy stuff in tempest for uploading images in that format (which I think I removed all of) | 15:42 |
*** watersoul_ has joined #openstack-infra | 15:42 | |
*** watersoul has quit IRC | 15:42 | |
clarkb | pabelanger: AJaeger timothyb89 what can I do to help get new xenial images built? | 15:43 |
*** amitgandhinz has quit IRC | 15:43 | |
*** adrian_otto has joined #openstack-infra | 15:43 | |
*** amitgandhinz has joined #openstack-infra | 15:43 | |
*** jogo has quit IRC | 15:43 | |
mtreinish | clarkb: if there are published qcow or raw cirros images it should be pretty straightforward to pivot devstack to use those instead | 15:44 |
pabelanger | clarkb: AJaeger: I'm working on the uploads now | 15:44 |
*** mriedem1 has joined #openstack-infra | 15:44 | |
*** mikelk has quit IRC | 15:44 | |
clarkb | pabelanger: doesn't look like we have disabled stackviz in the builds. Does this mean you got an image to build with stackviz? | 15:44 |
jeblair | pabelanger: agree. this makes us ignore stackviz failures: https://review.openstack.org/338288 | 15:45 |
therve | clarkb, I meant qcow2 btw, sorry | 15:45 |
jeblair | pabelanger, clarkb: this has merged and should disable stackviz: https://review.openstack.org/338276 | 15:45 |
*** jogo has joined #openstack-infra | 15:45 | |
pabelanger | jeblair: ah, great. I was just working on that too | 15:45 |
*** Daisy has quit IRC | 15:46 | |
clarkb | therve: yes, we definitely have jobs that boot qcow2's. Nodepools integration testing, dibs image build testing and so on. I thought that tempest might also use qcow2 but was wrong about that | 15:46 |
*** Sukhdev has joined #openstack-infra | 15:46 | |
clarkb | jeblair: thanks | 15:46 |
therve | clarkb, Do you build image on the fly for those tests? | 15:47 |
clarkb | therve: yes | 15:47 |
therve | We're using a pre built image, that may be where the issue resides | 15:47 |
*** mriedem has quit IRC | 15:47 | |
therve | If there is some kind of version mismatch | 15:47 |
clarkb | therve: is it a consistent 100% of the time fail or less consistent? | 15:47 |
therve | clarkb, No much less than that | 15:48 |
therve | About 40 times in the 2 days, no idea how many tests run we have, but more than that | 15:48 |
clarkb | looks like it is happening on multiple clouds so not a cloud specific issue | 15:49 |
therve | Yeah. More on ovh though | 15:49 |
*** sambetts is now known as sambetts|afk | 15:49 | |
*** rcernin has joined #openstack-infra | 15:49 | |
*** dane-fichter has quit IRC | 15:49 | |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Tasks api https://review.openstack.org/337879 | 15:49 |
*** asettle has quit IRC | 15:51 | |
*** Daisy has joined #openstack-infra | 15:52 | |
*** dizquierdo has quit IRC | 15:52 | |
greghaynes | therve: octavia is another one who I know does this | 15:53 |
openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add check-requirement to watcher-dashboard project https://review.openstack.org/338366 | 15:53 |
openstackgerrit | Arie Bregman proposed openstack-infra/shade: Allow to register nodes from file https://review.openstack.org/338216 | 15:53 |
*** mriedem1 is now known as mriedem | 15:54 | |
clarkb | hrm no world dump on that failure? | 15:54 |
clarkb | therve: http://logs.openstack.org/11/338211/2/check/gate-heat-dsvm-functional-orig-mysql-lbaasv2/2f90ffe/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-07-06_13_52_17_000 is the error from nova compute | 15:54 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Timeline api https://review.openstack.org/337854 | 15:55 |
openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add openstack/fuel-plugin-murano-tests project https://review.openstack.org/332151 | 15:55 |
clarkb | its definitely an io error of some sort | 15:55 |
clarkb | possibly run out of disk space? | 15:55 |
*** roxanagh_ has joined #openstack-infra | 15:56 | |
*** Daisy has quit IRC | 15:56 | |
*** trown is now known as trown|lunch | 15:56 | |
therve | The df output looks normal... | 15:57 |
clarkb | therve: where is the df output? | 15:57 |
therve | clarkb, http://logs.openstack.org/98/338198/2/check/gate-heat-dsvm-functional-convg-mysql-lbaasv2/5fbda19/logs/df.txt.gz | 15:57 |
*** Rockyg has joined #openstack-infra | 15:57 | |
clarkb | oh its got its own file | 15:58 |
clarkb | I was looking for the world dump log | 15:58 |
*** Daisy has joined #openstack-infra | 15:58 | |
clarkb | therve: I think that df may be from before everything runs not after | 15:58 |
therve | Right | 15:58 |
greghaynes | or, is it writing out to tmpfs? | 15:58 |
clarkb | therve: nope it is at the end but thats after things stop | 15:58 |
*** ddieterly is now known as ddieterly[away] | 15:59 | |
*** abregman has quit IRC | 16:00 | |
*** ayoung has quit IRC | 16:00 | |
pleia2 | good morning | 16:01 |
*** yamahata has quit IRC | 16:02 | |
clarkb | greghaynes: maybe? | 16:02 |
*** Daisy has quit IRC | 16:02 | |
clarkb | I think qemu-img by default writes to current dir | 16:02 |
clarkb | even for its temp file stuff | 16:03 |
greghaynes | yes | 16:03 |
*** Daisy has joined #openstack-infra | 16:03 | |
*** jamesmcarthur has quit IRC | 16:04 | |
clarkb | therve: you might try reproducing that conversion locally to see if you can reproduce | 16:04 |
clarkb | its not cloud or region specific so in theory it should be reproduceable | 16:04 |
greghaynes | where does the image build happen in those logs? | 16:05 |
clarkb | greghaynes: it doesn't, they grab an image from elsewhere | 16:05 |
*** esikachev has joined #openstack-infra | 16:05 | |
greghaynes | oh | 16:05 |
clarkb | and nova converts it to raw to boot | 16:05 |
greghaynes | ah | 16:05 |
*** eliqiao has quit IRC | 16:05 | |
*** ddieterly[away] is now known as ddieterly | 16:05 | |
greghaynes | 2016-07-06 13:47:41.213 4563 ERROR nova.compute.manager [instance: 17e7569c-53bc-41f2-8be9-89e6483f25eb] Stderr: u'qemu-img: error while reading sector 1073024: Input/output error\n' | 16:06 |
greghaynes | so yea, that really sounds like disk full | 16:06 |
*** maishsk has joined #openstack-infra | 16:06 | |
clarkb | jeblair: pabelanger note that the builder daemon will need to be restarted to pick up that change iirc | 16:06 |
greghaynes | actually, 2016-07-06 13:47:41.213 4563 ERROR nova.compute.manager [instance: 17e7569c-53bc-41f2-8be9-89e6483f25eb] ImageUnacceptable: Image eacca1fb-87bd-4184-a454-0727624ef544 is unacceptable: Unable to convert image to raw: Image /opt/stack/data/nova/instances/_base/f6259c6d83681935fb73c3811e68cdc527bb5381.part | 16:06 |
therve | clarkb, Yep, will do | 16:06 |
greghaynes | .part? | 16:06 |
therve | Thanks for the hints | 16:06 |
*** yamamoto has quit IRC | 16:06 | |
clarkb | greghaynes: I think thats a qemu-img temp file | 16:07 |
*** eliqiao has joined #openstack-infra | 16:07 | |
*** Daisy has quit IRC | 16:08 | |
*** zeih has joined #openstack-infra | 16:08 | |
clarkb | xenial dib build is calculating image size so I think we may be getting a good image this time around | 16:08 |
cinerama | cool | 16:09 |
pabelanger | clarkb: you are correct, however in this case stackviz actually built correct | 16:09 |
clarkb | pabelanger: yup | 16:09 |
pabelanger | clarkb: I'll restart it before we do uploads | 16:09 |
clarkb | pabelanger: keep in mind that will kill all the other uploads for today | 16:10 |
pabelanger | clarkb: ya, I think that already happen actually | 16:10 |
*** jamesmcarthur has joined #openstack-infra | 16:10 | |
pabelanger | I am not sure why | 16:10 |
*** matbu is now known as matbu|brb | 16:10 | |
*** cbader has joined #openstack-infra | 16:10 | |
mtreinish | clarkb: err, I hadn't followed through with the removal from tempest yet, just deprecated them: https://review.openstack.org/#/c/338377/1 | 16:10 |
greghaynes | clarkb: nope, thats the input to qemu-img | 16:10 |
mtreinish | clarkb: still doesn't fix the devstack side, that's next | 16:10 |
clarkb | greghaynes: so maybe a nova/glance issue? | 16:11 |
clarkb | mtreinish: cool | 16:12 |
*** ddieterly is now known as ddieterly[away] | 16:12 | |
greghaynes | clarkb: yea, it reads to me like nova didnt pull down the full image - if you note that i/o error its failing on a read too, not a write | 16:12 |
openstackgerrit | Merged openstack-infra/project-config: Ignore errors during stackviz build https://review.openstack.org/338288 | 16:12 |
clarkb | therve: ^ thats a theory | 16:12 |
greghaynes | clarkb: http://logs.openstack.org/98/338198/2/check/gate-heat-dsvm-functional-convg-mysql-lbaasv2/5fbda19/logs/screen-n-cpu.txt.gz#_2016-07-06_13_47_41_213 | 16:12 |
clarkb | greghaynes: I wonder if glance logs show anything funny | 16:12 |
*** ifarkas has quit IRC | 16:13 | |
greghaynes | a lot of image not founds, that could just be a red herring though | 16:13 |
clarkb | ya though thats odd, why would the tests be requesting a bunch of images that don't exist | 16:13 |
clarkb | therve: ^ | 16:13 |
clarkb | greghaynes: http://logs.openstack.org/98/338198/2/check/gate-heat-dsvm-functional-convg-mysql-lbaasv2/5fbda19/logs/screen-g-api.txt.gz?level=INFO#_2016-07-06_13_48_23_107 is where it gets the actual image that is failing I think | 16:14 |
clarkb | greghaynes: therve 192824414 is the byte count reported by wsgi, I wonder how that compares against the actual image | 16:14 |
clarkb | therve: where is the source image? | 16:15 |
therve | clarkb, http://tarballs.openstack.org/heat-test-image/fedora-heat-test-image.qcow2 | 16:15 |
*** alex_xu has quit IRC | 16:15 | |
*** ayoung has joined #openstack-infra | 16:15 | |
clarkb | 580737024 is the byte count reported by wget | 16:16 |
clarkb | therve: ^ I think that may give you your answer, now you need to figure out if the image put into glance was short or if glance returned less data for some reason | 16:16 |
therve | clarkb, I can reproduce on a local devstack \o/ | 16:17 |
therve | So that should give me some help | 16:17 |
clarkb | therve: not sure how much stuff you are putting in that image but I think my local dib builds of fedora are ~250MB if I don't add anything in | 16:18 |
therve | The image source seems shorter | 16:18 |
therve | clarkb, Probably too much stuff... | 16:18 |
clarkb | its been a while since I built one though | 16:18 |
*** mrmartin has quit IRC | 16:18 | |
therve | We have a good chunk of tools installed though, but I don't know the details | 16:19 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow editing and deletion of comments to be disabled https://review.openstack.org/338165 | 16:19 |
*** Julien-zte has quit IRC | 16:19 | |
therve | So it looks like the upload in glance is wrong | 16:19 |
greghaynes | yea, I bet youre uploading a .part | 16:19 |
*** ianychoi has joined #openstack-infra | 16:19 | |
*** Daisy has joined #openstack-infra | 16:20 | |
therve | greghaynes, We're uploading on the fly the curl output? | 16:20 |
therve | Not even sure how that works in fact | 16:20 |
greghaynes | I dunno, just a theory | 16:20 |
* greghaynes applies occams razor | 16:21 | |
*** gyee has joined #openstack-infra | 16:21 | |
clarkb | found the issue | 16:21 |
clarkb | http://logs.openstack.org/11/338211/2/check/gate-heat-dsvm-functional-orig-mysql-lbaasv2/2f90ffe/console.html#_2016-07-06_13_40_28_035386 | 16:21 |
clarkb | you should fail at that point if the image is required | 16:21 |
*** psachin has quit IRC | 16:22 | |
clarkb | curl is saying "I failed to get all the bytes" then the image is uploaded anyways | 16:22 |
therve | Aahah | 16:23 |
therve | clarkb, Was on it myself :) | 16:23 |
*** bryan_att has quit IRC | 16:23 | |
clarkb | I think that is devstack that needs updating to better catch the error | 16:23 |
clarkb | as for ixing the issue, you are going to have much more reliable tests if they don't try to download 554MB images across the atlantic ocean | 16:24 |
therve | Yeah not sure devstack can do much, it's in our test hooks script | 16:24 |
*** tphummel has quit IRC | 16:24 | |
* therve nodes | 16:24 | |
*** Daisy has quit IRC | 16:24 | |
clarkb | identifying what you actually need in your image and potentially using the common image may help. (I don't know what the requirments for this test are) | 16:24 |
therve | clarkb, greghaynes: thanks a ton. I have a bunch of things to try now. | 16:24 |
*** yamahata has joined #openstack-infra | 16:25 | |
clarkb | pabelanger: ya I don't see any other builder activity, gonna look at its logs now | 16:25 |
clarkb | pabelanger: a whole lot of 'DIB failed creating' errors, maybe they ran into the same npm issues? | 16:28 |
*** DaiDV has quit IRC | 16:28 | |
clarkb | ah no was new git repo causing fails | 16:29 |
pabelanger | clarkb: possible, I can look more into it after some food | 16:29 |
clarkb | so ya we should be fine to restart the builder once this xenial image is built | 16:29 |
pabelanger | Yup, we are compressing images now | 16:29 |
clarkb | I need to upload the new centos-7 image to one region that failed last night too, otherwise we should have mostly working images later today | 16:29 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Tasks api https://review.openstack.org/337879 | 16:30 |
*** david-lyle_ has joined #openstack-infra | 16:30 | |
*** Daisy has joined #openstack-infra | 16:31 | |
*** david-lyle_ is now known as david-lyle | 16:32 | |
*** dprince has joined #openstack-infra | 16:32 | |
*** PollyZ has quit IRC | 16:32 | |
*** vhosakot has quit IRC | 16:35 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Log stderr when creating and destroying envs https://review.openstack.org/337775 | 16:35 |
*** ddieterly[away] is now known as ddieterly | 16:35 | |
*** Daisy has quit IRC | 16:36 | |
*** vhosakot has joined #openstack-infra | 16:36 | |
*** kzaitsev_mb has quit IRC | 16:37 | |
*** yamamoto has joined #openstack-infra | 16:37 | |
*** david-lyle has quit IRC | 16:39 | |
*** jamesmcarthur has quit IRC | 16:40 | |
*** Apoorva has joined #openstack-infra | 16:40 | |
*** hashar has quit IRC | 16:42 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove sleeps if testenv create/destroy fails https://review.openstack.org/338394 | 16:42 |
*** Swami__ has quit IRC | 16:42 | |
*** Swami_ has quit IRC | 16:43 | |
*** jamesmcarthur has joined #openstack-infra | 16:43 | |
*** nmagnezi has joined #openstack-infra | 16:44 | |
*** trown|lunch is now known as trown | 16:44 | |
*** gyee has quit IRC | 16:45 | |
*** kzaitsev_mb has joined #openstack-infra | 16:45 | |
*** Daisy has joined #openstack-infra | 16:48 | |
*** vhosakot has quit IRC | 16:48 | |
*** vhosakot has joined #openstack-infra | 16:48 | |
*** yamamoto has quit IRC | 16:48 | |
*** amoralej is now known as amoralej|off | 16:49 | |
*** tesseract- has quit IRC | 16:49 | |
*** yamahata has quit IRC | 16:49 | |
*** markusry has quit IRC | 16:49 | |
*** markusry has joined #openstack-infra | 16:50 | |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Branches api https://review.openstack.org/338396 | 16:50 |
*** PollyZ has joined #openstack-infra | 16:50 | |
*** yamahata has joined #openstack-infra | 16:51 | |
*** tphummel has joined #openstack-infra | 16:51 | |
*** rdx_matt has quit IRC | 16:51 | |
*** matbu|brb is now known as matbu | 16:51 | |
*** rdx_matt has joined #openstack-infra | 16:52 | |
fungi | woah! confirmed this fan actually _is_ on the market. now just to find it somewhere not quite so overpriced... http://www.newegg.com/Product/Product.aspx?Item=9SIA6252GS2664 | 16:52 |
fungi | looks like it was also used in some lenovo systems | 16:53 |
clarkb | fungi: thats the refurb price too :) | 16:53 |
*** Daisy has quit IRC | 16:53 | |
fungi | tell me about it | 16:53 |
*** matt-borland has joined #openstack-infra | 16:53 | |
pleia2 | yeesh | 16:53 |
fungi | found it on pchub for us$26 new | 16:54 |
fungi | think i'll get a few | 16:54 |
anteaya | fungi: that is better than 76 | 16:54 |
fungi | indeed | 16:54 |
timothyb89 | fungi: I'd bet you can find those on ebay for $5-$15 | 16:54 |
fungi | good call | 16:55 |
*** lucasagomes is now known as lucas|afk | 16:55 | |
fungi | indeed i can | 16:55 |
* fungi forgets ebay exists sometimes | 16:55 | |
*** PollyZ has quit IRC | 16:55 | |
timothyb89 | :) | 16:55 |
*** inc0 has quit IRC | 16:56 | |
*** rdx_matt has quit IRC | 16:57 | |
*** inc0 has joined #openstack-infra | 16:57 | |
clarkb | mtreinish: https://review.openstack.org/338399 is a start | 16:57 |
pabelanger | clarkb: ubuntu-xenial build finished, starting uploads now | 16:57 |
*** karthikp_ has quit IRC | 16:57 | |
clarkb | pabelanger: ok | 16:57 |
*** Swami has joined #openstack-infra | 16:57 | |
clarkb | pabelanger: were you going to restart hte builder first? | 16:57 |
*** exploreshaifali has quit IRC | 16:57 | |
clarkb | pabelanger: I have one centos-7 straggler to upload too, but can wiat for when xenial is done | 16:58 |
mtreinish | clarkb: lgtm, heh but lets see if it passes the gate :) | 16:58 |
anteaya | ummm it appears that for some reason my python 34-db job couldn't find pretty-tox.sh, would I be reading this log correctly? http://logs.openstack.org/79/337879/3/check/gate-storyboard-python34-db/538cd37/console.html#_2016-07-06_16_47_10_077911 | 16:58 |
clarkb | mtreinish: yes, I admit to no tknowing if all 3 keys in that file are required | 16:58 |
openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Add non voting python34/35 checks for vmware-nsx https://review.openstack.org/338402 | 16:59 |
*** shashank_hegde has joined #openstack-infra | 16:59 | |
mtreinish | mriedem: ^^^ who would be good to review clarkb's config drive checking patch? mikal? | 16:59 |
*** gyee has joined #openstack-infra | 17:00 | |
*** derekh has quit IRC | 17:00 | |
*** chem has quit IRC | 17:00 | |
mriedem | mtreinish: yeah | 17:01 |
pabelanger | clarkb: ugh, I forgot | 17:01 |
*** piet has joined #openstack-infra | 17:01 | |
pabelanger | clarkb: lets do it, I can restart uploads | 17:01 |
clarkb | pabelanger: its fine iether way | 17:01 |
clarkb | we can get it when xenial is done too | 17:01 |
mriedem | mtreinish: probably artom also since he just wrote code for that in tempest | 17:01 |
pabelanger | clarkb: okay, restarted | 17:01 |
*** karthikp_ has joined #openstack-infra | 17:01 | |
*** Sukhdev has quit IRC | 17:01 | |
*** DaiDV has joined #openstack-infra | 17:01 | |
pabelanger | and uploads restarted | 17:02 |
clarkb | pabelanger: cool, can you queue up an upload for rax-dfw centos7 too? | 17:02 |
clarkb | pabelanger: that one didn't succeed last night and is the last centos-7 image with the weird virtualenv devstack situation going on | 17:03 |
*** adrian_otto has quit IRC | 17:04 | |
*** PollyZ has joined #openstack-infra | 17:04 | |
fungi | timothyb89: thanks for the ebay suggestion. for us$40 i got 5 of them from a domestic source with free shipping | 17:04 |
timothyb89 | fungi: nice! glad to have helped :) | 17:04 |
*** rdxnoam has joined #openstack-infra | 17:06 | |
rdxnoam | smcginnis: still here? | 17:06 |
*** ayoung has quit IRC | 17:06 | |
mtreinish | fungi: heh, I like that newegg advertises that as "First from ASIA" | 17:07 |
anteaya | fungi: wow | 17:08 |
*** BobBall is now known as BobBall_AWOL | 17:08 | |
*** adrian_otto has joined #openstack-infra | 17:08 | |
*** PollyZ has quit IRC | 17:08 | |
jeblair | fungi: or possibly 5 bobcats | 17:09 |
jeblair | let us know | 17:09 |
mtreinish | fungi: I still thinking dunking your computer is your best option for heat mgt :) | 17:10 |
mtreinish | s/thinking/think/g | 17:10 |
*** timrc has quit IRC | 17:10 | |
fungi | jeblair: ooh, i could use a few bobcats to keep the seagulls in check | 17:11 |
clarkb | I have a fanless amd apu. Pretty sure the heat kills it when running freebsd due to poor thermal management | 17:11 |
*** jlk has quit IRC | 17:11 | |
fungi | clarkb: interesting. i have a couple of those as well and no heat issues under openbsd, though i also don't heavily load them | 17:11 |
*** timrc has joined #openstack-infra | 17:11 | |
*** shashank_hegde has quit IRC | 17:12 | |
clarkb | fungi: it runs fine with linux. But it would crash and die about once a day during hot summer days with freebsd | 17:12 |
*** jlk has joined #openstack-infra | 17:12 | |
*** jlk has quit IRC | 17:12 | |
*** jlk has joined #openstack-infra | 17:12 | |
fungi | apu1d4 with the metal case acting as an extension of the heat sunk | 17:12 |
*** ajmiller has joined #openstack-infra | 17:12 | |
clarkb | no kernel panics or anything logged by the operating system so pretty sure the hardware was saving itself | 17:12 |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/glean: Add coverage generated files to .gitignore https://review.openstack.org/338409 | 17:12 |
fungi | clarkb: yeah, that sounds like thermally-induced shutoff. you should have support for the on-chip thermocouple in kernel and could stream readings from it to somewhere | 17:13 |
*** ddieterly is now known as ddieterly[away] | 17:13 | |
bkero | I wonder if FreeBSD has proper p/c state support for downclocking it | 17:13 |
clarkb | alsoit was consistently during the hottest part of the day ~4pm ish | 17:14 |
SpamapS | greghaynes: hey, am I crazy or does glean not actually record that it has run successfully anywhere? | 17:14 |
greghaynes | SpamapS: it doesnt | 17:14 |
*** acoles is now known as acoles_ | 17:14 | |
SpamapS | doh! | 17:14 |
SpamapS | greghaynes: we need to fix that | 17:14 |
SpamapS | things reboot | 17:14 |
greghaynes | SpamapS: I think it doesn't overwrite existing interface config, though | 17:14 |
SpamapS | configs change | 17:14 |
fungi | i wonder if there's a good place it could write a flagfile | 17:14 |
*** karthikp_ has quit IRC | 17:15 | |
greghaynes | SpamapS: which is not ideal but is a stopgap for that reason | 17:15 |
SpamapS | it needs it's own home | 17:15 |
clarkb | greghaynes: ya it is supposed to leave any interface files alone and ssh authorized keys as is if they exist iirc | 17:15 |
SpamapS | /var/lib/glean is the proper place | 17:15 |
SpamapS | what about hostname? | 17:15 |
clarkb | not sure about hostname | 17:15 |
clarkb | I wasn't digging in that code yesterday | 17:15 |
greghaynes | yes, theres also the larger issue of 'what if the config files dont match what config drive says' | 17:15 |
fungi | agreed, /var/lib or /var/log would be sane options as long as /var can be assumed to be mounted when glean runs | 17:15 |
greghaynes | really it needs to hash the config drive data it ran with and save that on success | 17:15 |
clarkb | fungi: can't be if /var is network mounted, can be otherwise | 17:16 |
SpamapS | looks like it's bullish on hostname | 17:16 |
anteaya | the storyboard tox file calls pretty_tox: http://git.openstack.org/cgit/openstack-infra/storyboard/tree/tox.ini#n13 which exists in the storyboard repo: http://git.openstack.org/cgit/openstack-infra/storyboard/tree/tools/pretty_tox.sh | 17:16 |
SpamapS | greghaynes: nooo | 17:16 |
SpamapS | it should do it's job | 17:16 |
clarkb | (network mounting /var is probably a bad idea but hey we had nfs ounted /usr/local at one place) | 17:16 |
SpamapS | and get the heck out of the way | 17:16 |
anteaya | SpamapS: can we ease back on the swearing please? | 17:16 |
SpamapS | anteaya: bullish is a swear word? | 17:16 |
clarkb | nibalizer: were you around for network mounted /usr/local? its good stuff | 17:16 |
nibalizer | clarkb: ah yes | 17:17 |
anteaya | has anything changed in the python24-db job that would affect its ability to process the tox file | 17:17 |
nibalizer | solairs boxes, high efficiency | 17:17 |
greghaynes | SpamapS: Yea, I'd be fine with that actually - just a 'dont run again' flag | 17:17 |
fungi | anteaya: python27-db? | 17:17 |
*** gnuoy is now known as jamespage_shadow | 17:17 | |
fungi | anteaya: have an example failure? | 17:17 |
anteaya | fungi: sorry python34-db | 17:17 |
AJaeger | pabelanger: thanks for building the xenial images | 17:17 |
SpamapS | greghaynes: the flag should be the instance ID | 17:17 |
anteaya | http://logs.openstack.org/79/337879/3/check/gate-storyboard-python34-db/538cd37/console.html#_2016-07-06_16_47_10_077911 | 17:17 |
*** ddieterly[away] is now known as ddieterly | 17:17 | |
*** xenogear has joined #openstack-infra | 17:18 | |
*** PollyZ has joined #openstack-infra | 17:18 | |
greghaynes | SpamapS: is that in config-drive? | 17:18 |
*** daemontool has quit IRC | 17:18 | |
clarkb | SpamapS: so I disagree a little bit on that because that is config drives behavior nad it totally breaks in some cases | 17:18 |
clarkb | er cloud init | 17:18 |
clarkb | like when all my ssh host keys were removed | 17:18 |
greghaynes | clarkb: you mean the dont re-run even if config-drive changes? | 17:18 |
clarkb | and cloud init lolled at me wanting them to be recreated | 17:18 |
anteaya | SpamapS: yes | 17:18 |
SpamapS | clarkb: well I still think it shouldn't overwrite stuff. | 17:18 |
clarkb | greghaynes: no I mean rerun if necessary files are non existant | 17:18 |
*** jamespage_shadow is now known as gnuoy | 17:18 | |
SpamapS | anteaya: It's a stock market term. | 17:18 |
pabelanger | AJaeger: uploading now which re-up any failures too | 17:18 |
clarkb | SpamapS: yes not overwriting is fine, but cloud inits behavior is to do absolutely nothing when that host id matches | 17:18 |
anteaya | it is a conveyance of agression | 17:18 |
anteaya | and I don't feel comfortable around it | 17:19 |
*** mhickey has quit IRC | 17:19 | |
clarkb | SpamapS: but there are important cases where you want it to do the right thing which it can safely do eg with ssh host keys | 17:19 |
pabelanger | clarkb: sure, let me do a rebuilt of centos-7 so we pickup our iptables fixes too | 17:19 |
pabelanger | clarkb: if you don't mind | 17:19 |
*** ayoung has joined #openstack-infra | 17:19 | |
clarkb | +1 to not overwriting, -1 to ignoring everything if a single flag matches | 17:19 |
clarkb | pabelanger: thats fine | 17:19 |
*** sarob has joined #openstack-infra | 17:19 | |
fungi | anteaya: that failure message is secondary. 8 tests failed | 17:19 |
anteaya | fungi: okay thank you | 17:20 |
fungi | anteaya: scroll up to where the tests are running and you can see output from them | 17:20 |
SpamapS | anteaya: Apologies, I was not aware that it was offensive to anyone. I won't use it anymore. | 17:20 |
*** jpich has quit IRC | 17:20 | |
fungi | anteaya: there are captured logging and tracebacks from each test failure | 17:20 |
pabelanger | centos-7 image-build started | 17:20 |
anteaya | SpamapS: I appreciate your understanding, thank you | 17:21 |
anteaya | fungi: I see fixtures._fixtures.timeout.TimeoutException | 17:21 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Revert "Disable stackviz on xenial for now" https://review.openstack.org/338412 | 17:21 |
anteaya | fungi: at the end of all the tracebacks I see | 17:21 |
AJaeger | timothyb89's change merged quickly - so we can revert the stackviz disabling again ^ | 17:22 |
fungi | anteaya: yep, that's what i'm seeing too. those tests may take too long for testr's default test timeout | 17:22 |
*** kzaitsev_mb has quit IRC | 17:22 | |
clarkb | fungi: I don't think testr hasa default timeout, we build timeouts into our test frameworksthough | 17:22 |
anteaya | I see a lot of INFO storyboard.plugin.scheduler [-] Scheduler is not enabled. too | 17:22 |
fungi | clarkb: oh, right, that's in ostestr | 17:22 |
greghaynes | clarkb: does that just apply to missing interface config files and ssh host keys or are there other cases? For the hostname it seems like we only ever should set that once | 17:23 |
fungi | anteaya: yeah, probably best to compare against a working job log since i have no idea whether that's expected/benign | 17:23 |
*** gnuoy is now known as jamespage_shadow | 17:23 | |
SpamapS | clarkb: so, I'm not sure I have a good response to the cloud-init situation you had. cloud-init's behavior was at least predictable. | 17:23 |
anteaya | fungi: patchset 2 passed 30 minutes prior: https://review.openstack.org/#/c/337879/3 | 17:23 |
*** PollyZ has quit IRC | 17:24 | |
SpamapS | clarkb: what I worry about is that glean has no way to know if my config-management renamed the config files it wrote out, and replaced them with better ones / different netconfig methods/etc. | 17:24 |
fungi | anteaya: entirely possible you hit an under-performing node | 17:24 |
anteaya | I'll try again then I guess, thanks for looking at it with me | 17:25 |
*** jamespage_shadow is now known as gnuoy | 17:25 | |
mriedem | mtreinish: clarkb: the network metadata change seems fine | 17:25 |
clarkb | greghaynes: if you have no hostname set in /etc/hosts /etc/hostname shouldn't it reset it? | 17:25 |
clarkb | greghaynes: SpamapS the problem is predictable isn't always useful and cloud inits behavior very much was not useful | 17:25 |
clarkb | if we are going to go through the trouble of reinventing the wheel we should at least make it more useful | 17:26 |
clarkb | otherwise just use cloud init | 17:26 |
greghaynes | clarkb: SpamapS Maybe the way forward is - only do networking once ever based on machine id, the other things always assert they exist (but only assert contents first boot)? | 17:26 |
SpamapS | well a wheel with no python dependencies is still better than cloud-init ;) | 17:26 |
greghaynes | since the other things are less disruptive | 17:26 |
AJaeger | clarkb: question for you on https://review.openstack.org/337946 - do we remove python34 testing from old branches or keep it? | 17:26 |
SpamapS | greghaynes: hostname could be _super_ disruptive | 17:27 |
clarkb | SpamapS: the specific case I had was my ssh host keys were removed by a bad dib patch. glean and cloud init both generate those on boot if they do their things because the ssh service on debuntu does not generate those if they are missing | 17:27 |
clarkb | SpamapS: yes because nova is silly :) | 17:27 |
greghaynes | SpamapS: hrm, youre thinking someone changes it post-first-boot and then wants it to stick? | 17:27 |
greghaynes | SpamapS: actually though, thats what I mean by dont assert contents | 17:27 |
greghaynes | SpamapS: only re-assert if its unset | 17:27 |
SpamapS | If I've reset the box's hostname, and reboot it later, and it comes back as the old one, and suddenly my logs all have the wrong hostname and my quorum system is mad because there are duplicates or missing hosts.... I'm very annoyed. | 17:27 |
clarkb | greghaynes: ya I think that is the situation, like if you repurpose a host | 17:27 |
*** tqtran has joined #openstack-infra | 17:27 | |
clarkb | I am not suggestin we change any hostnames though | 17:28 |
AJaeger | mtreinish: is my WIP on https://review.openstack.org/333461 correct? | 17:28 |
clarkb | only set it if it isn't set | 17:28 |
clarkb | which is different | 17:28 |
fungi | anteaya: compare the job runtimes too. on that last patchset the job went 20 minutes | 17:28 |
*** berendt has quit IRC | 17:28 | |
anteaya | fungi: ah thank you, I will look | 17:28 |
greghaynes | the downside there is you cant intentionally have an unset hostname | 17:28 |
greghaynes | not sure thats a thing we need to support? | 17:28 |
SpamapS | greghaynes: that's a good mode actually | 17:28 |
*** berendt has joined #openstack-infra | 17:29 | |
*** gnuoy is now known as jamespage_shadow | 17:29 | |
clarkb | greghaynes: but you can unintentionally unset it | 17:29 |
clarkb | its trivial to rm hostname and remove lines from /etc/hosts | 17:29 |
greghaynes | clarkb: oh, so use empty file = unset | 17:29 |
greghaynes | yea, that works | 17:29 |
notmorgan | jeblair, clarkb, pabelanger: are our images using mariadb or mysql-server for tests? | 17:29 |
notmorgan | subtle differences, but I'm curious which one we are testing with. | 17:30 |
clarkb | notmorgan: mariadb on red hat things and mysql on ubuntu. Not sure about debian | 17:30 |
notmorgan | clarkb: wfm. | 17:30 |
*** Goneri has quit IRC | 17:30 | |
notmorgan | clarkb: i'll still with mysql-server on my ubuntu env then. | 17:30 |
notmorgan | stick* | 17:30 |
AJaeger | clarkb: mysql on dpkg in general | 17:30 |
*** jamespage_shadow is now known as gnuoy | 17:30 | |
notmorgan | i was having issues getting mariadb to play nice in ubuntu for some reason. | 17:30 |
notmorgan | which is why i was asking | 17:31 |
clarkb | notmorgan: are there mariadb packages for ubuntu now? | 17:31 |
greghaynes | clarkb: SpamapS So were fine with assert contents on first boot, later boots only set if there is nothing set for hostname, ssh host keys, root ssh key. For networking only re-assert if machine-id doesnt match or hasnt been written out? | 17:31 |
notmorgan | clarkb: have been for a while. i'm on xenial | 17:31 |
notmorgan | so yes. | 17:31 |
notmorgan | but it ... gets cranky in some cases. | 17:32 |
notmorgan | mostly it's because i've been trying to do super cheap (effort wise) installs. since it's just for local unit tests. | 17:32 |
notmorgan | though I guess i could docker-compose this now. | 17:32 |
pabelanger | AJaeger: osic-cloud1 uploaded first | 17:32 |
pabelanger | AJaeger: followed by ovh-gra1 | 17:33 |
notmorgan | and get isolation from my local system. | 17:33 |
clarkb | notmorgan: I have a mysql docker instance for this | 17:33 |
AJaeger | pabelanger: great! Let's see once first python35 jobs succeed again... | 17:33 |
*** berendt has quit IRC | 17:34 | |
notmorgan | clarkb: yeah. i think i'm going to use docker-compose and build a simple "make tests" which spins it up/run tests and dumps out results. | 17:34 |
notmorgan | (fwiw, i did docker for building dpkgs recently, was amazing) | 17:34 |
clarkb | notmorgan: because as running kde once taught me running mysql as a part of your actual desktop install is insanity | 17:34 |
notmorgan | LOL | 17:34 |
notmorgan | god. i am using KDE on my laptop... and realize, it isn't stable enough =/ | 17:35 |
greghaynes | notmorgan: haha | 17:35 |
SpamapS | greghaynes: yeah, I'm still a little fuzzy on the contents vs. empty vs. missing though. | 17:35 |
fungi | clarkb: notmorgan: mariadb-server packages were present on trusty for that matter | 17:35 |
greghaynes | notmorgan: so there was supposed to be an ORM layer to allow !mysql | 17:35 |
notmorgan | fungi: the mariadb on trusty just didn't work for me when i tried i. | 17:35 |
notmorgan | greghaynes: LOL right. | 17:35 |
*** gnuoy is now known as jamespage_shadow | 17:35 | |
greghaynes | notmorgan: then by the time someone tried writing another backend it was realized that making a !mysql driver was going to be impossible | 17:35 |
greghaynes | so no one ever did it | 17:35 |
notmorgan | greghaynes: well plasma5 is better | 17:35 |
clarkb | notmorgan: kde 4 I think it was intsalled mysql for indexing stuff or something. It made everything sadness | 17:36 |
notmorgan | greghaynes: but i have to send my laptop to lenovo to get repaired... annnnnnnd that means i have to basically re-image it since they want access. | 17:36 |
*** jamespage_shadow is now known as gnuoy | 17:36 | |
*** Rockyg has quit IRC | 17:36 | |
AJaeger | clarkb: used mainly for kmail - and everything related to it. akonadi wsa the component. | 17:36 |
notmorgan | clarkb: latest kde4 thing didn't have myql on it until i installed it directly. but i purged kmail. | 17:36 |
greghaynes | SpamapS: thatll be for hostname, ssh host keys, and root pubkey - for those its if no_prev_run: assert_file elif not file_exists: assert_file | 17:36 |
AJaeger | clarkb: and it was for me also one of the reasons to switch to gnome | 17:37 |
notmorgan | AJaeger: what, no enlightenment? :P | 17:37 |
* notmorgan ducks. | 17:37 | |
greghaynes | clarkb: it was for the personal information manager | 17:37 |
greghaynes | clarkb: basically there was a big push from kde to make a shared information manager that both kde and gnome would use, then it really fizzled out and gnome said ew | 17:37 |
* notmorgan might go back to ubuntu or debian on the personal laptop. | 17:37 | |
greghaynes | the idea being you could boot gnome and kde and have a lot of the same settings/info automagically there | 17:38 |
notmorgan | i like tumbleweed, but KDE isn't stable enough and i'm annoyed by gnome3/mate/xfce right now. | 17:38 |
*** eezhova has quit IRC | 17:38 | |
greghaynes | heh | 17:38 |
greghaynes | Yea, I dont use it anymore | 17:39 |
*** Jeffrey4l_ has quit IRC | 17:39 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 17:39 |
*** savihou has quit IRC | 17:40 | |
*** jamesmcarthur has quit IRC | 17:40 | |
clarkb | AJaeger: I am glad I wasnt the only one :) | 17:41 |
mtreinish | AJaeger: yes it is. Sry I missed your earlier comment asking for that | 17:41 |
*** sree_ has joined #openstack-infra | 17:41 | |
*** sree_ is now known as Guest32558 | 17:42 | |
AJaeger | mtreinish: do you want to WIP yourself? Then I can remove mine and you tell us once it's ready to merge... | 17:42 |
mtreinish | AJaeger: we install subunit2sql from pip not git there, so until the depends on is included in the next release nodepool won't have access to it | 17:42 |
mtreinish | AJaeger: meh, doesn't bug me one way or the other, I can always rebase it to remove yours :) | 17:42 |
*** Goneri has joined #openstack-infra | 17:42 | |
AJaeger | mtreinish: ok, then I'll leave mine. Just comment and ping me or rebase ;) | 17:43 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: [WIP] Update to use quintupleo https://review.openstack.org/336309 | 17:43 |
*** Jeffrey4l_ has joined #openstack-infra | 17:44 | |
AJaeger | we have two openstack-ansible jobs at the top of the check queue - one for nearly 7h, the other for over 4h - is there a problem? | 17:44 |
*** Qiming has quit IRC | 17:45 | |
*** PollyZ has joined #openstack-infra | 17:45 | |
*** gnuoy is now known as jamespage_shadow | 17:45 | |
*** sarob has quit IRC | 17:46 | |
*** Guest32558 has quit IRC | 17:46 | |
*** makowals has joined #openstack-infra | 17:46 | |
krot_vaca_jul19 | What's going on with the npm jobs? | 17:46 |
jeblair | AJaeger: maybe they are stuck in a loop? | 17:47 |
AJaeger | might be - didn't watch them long enough for that ;) | 17:47 |
jeblair | the top running job is telnet://172.99.106.217:8088 | 17:47 |
jeblair | for 330994,6 | 17:47 |
pabelanger | AJaeger: only rax-ord, rax-iad and ovh-bhs1 left for uploads | 17:47 |
jeblair | let's check back in 30 mins and see if it has re-launched | 17:48 |
*** jamespage_shadow is now known as gnuoy | 17:48 | |
AJaeger | good idea | 17:48 |
AJaeger | pabelanger: cool... | 17:48 |
*** Qiming has joined #openstack-infra | 17:49 | |
*** ddieterly is now known as ddieterly[away] | 17:49 | |
*** sarob has joined #openstack-infra | 17:50 | |
*** PollyZ has quit IRC | 17:50 | |
*** mikelk has joined #openstack-infra | 17:54 | |
*** rossella_s has quit IRC | 17:54 | |
fungi | krot_vaca_jul19: not the npm jobs specifically, but 504 errors from npm building stackviz for our images | 17:54 |
fungi | krot_vaca_jul19: but only on xenial it seems | 17:55 |
*** shashank_hegde has joined #openstack-infra | 17:55 | |
*** sdake has quit IRC | 17:55 | |
*** sdake has joined #openstack-infra | 17:56 | |
AJaeger | fungi: 502 | 17:57 |
AJaeger | see http://paste.openstack.org/show/526524/ | 17:57 |
fungi | ahh, yes sorry, 502 | 17:57 |
*** gouthamr_ has joined #openstack-infra | 17:57 | |
AJaeger | and that was on xenial | 17:57 |
*** shardy has quit IRC | 17:58 | |
*** john-davidge has quit IRC | 17:58 | |
*** pvaneck has joined #openstack-infra | 17:59 | |
*** gouthamr has quit IRC | 18:00 | |
pabelanger | actually, we can revert the stackviz patch AJaeger did. We should no longer fail DIBs if stackviz errors | 18:01 |
fungi | though devstack will still try to complete the stackviz build, right? or just ignore the incomplete stackviz installation? | 18:01 |
timothyb89 | fungi: it will ignore it | 18:02 |
*** PollyZ has joined #openstack-infra | 18:02 | |
timothyb89 | fungi, pabelanger: also, AJaeger already put up a patch to revert: https://review.openstack.org/338412 | 18:02 |
*** sdake has quit IRC | 18:02 | |
*** M-docaedo_vector has quit IRC | 18:03 | |
pabelanger | timothyb89: great, thanks! | 18:03 |
AJaeger | currently py35 running on ubuntu-xenial-internap-nyj01-2289461 - bindep passed ;) | 18:04 |
pabelanger | missed that | 18:04 |
pabelanger | \o/ | 18:04 |
pabelanger | only 2 uploads left | 18:04 |
clarkb | AJaeger: did the change for groups other-requirements merge? | 18:06 |
clarkb | since they will need that now I think | 18:07 |
*** jamesmcarthur has joined #openstack-infra | 18:07 | |
*** sdake has joined #openstack-infra | 18:08 | |
*** sdake has quit IRC | 18:08 | |
*** sdake has joined #openstack-infra | 18:08 | |
*** notnownikki has quit IRC | 18:09 | |
AJaeger | clarkb: yes, it did | 18:09 |
*** jamesmcarthur has quit IRC | 18:09 | |
AJaeger | clarkb: change Ic175744997ac01b3c89793c78d501d43044507e8 | 18:09 |
*** jamesmcarthur has joined #openstack-infra | 18:09 | |
*** permalac has quit IRC | 18:09 | |
AJaeger | So, py35 job for ironic finished - failed the testsuite but that looks unrelated to our setup. | 18:09 |
sshnaidm | clarkb, hi, can you please re-review in your time https://review.openstack.org/#/c/334452/ ? thank you | 18:11 |
openstackgerrit | Merged openstack-infra/project-config: Revert "Disable stackviz on xenial for now" https://review.openstack.org/338412 | 18:11 |
*** salv-orlando has quit IRC | 18:12 | |
*** deadnull is now known as _deadnull | 18:13 | |
AJaeger | jeblair: the top-most ansible job failed finally... | 18:13 |
AJaeger | jeblair: so, looks fine now | 18:14 |
pabelanger | EmilienM: Hows the UCA mirrors working? Have you switched? | 18:15 |
EmilienM | let me check | 18:15 |
EmilienM | we had a blocker and I think it was solved | 18:15 |
AJaeger | yeah, first python35 success: http://logs.openstack.org/30/308930/51/check/gate-manila-python35-db-nv/f9437c4/ | 18:16 |
EmilienM | pabelanger: rechecking your patch | 18:16 |
EmilienM | pabelanger: I'll let you know | 18:16 |
EmilienM | but +2 it | 18:16 |
pabelanger | EmilienM: nice, thanks | 18:16 |
EmilienM | pabelanger: no gpg issue? | 18:17 |
*** jamesmcarthur has quit IRC | 18:17 | |
pabelanger | EmilienM: not sure. I think they should work | 18:17 |
*** jamesmcarthur has joined #openstack-infra | 18:18 | |
EmilienM | pabelanger: it should be good | 18:18 |
*** inc0 has quit IRC | 18:18 | |
pabelanger | ya, I think so too | 18:18 |
EmilienM | pabelanger: the extras patch is about to merge | 18:18 |
*** karthikp_ has joined #openstack-infra | 18:18 | |
clarkb | sshnaidm: ok looks good. The only thing I wonder is if we should allow each of those to be individually configureable? I think as is you must provide all 3 values since None isn't a valid setsockopt param value? | 18:18 |
EmilienM | pabelanger: can you backport it to stable/mitaka & liberty? so we can use it in our stable CI too | 18:18 |
*** inc0 has joined #openstack-infra | 18:18 | |
pabelanger | EmilienM: sure | 18:18 |
*** M-docaedo_vector has joined #openstack-infra | 18:19 | |
*** pgadiya has joined #openstack-infra | 18:19 | |
sshnaidm | clarkb, yes, I've added defaults in cli - I'm not sure we should duplicate them in function also | 18:19 |
*** Jeffrey4l_ has quit IRC | 18:19 | |
*** Nikolay_St has joined #openstack-infra | 18:19 | |
*** pgadiya has quit IRC | 18:19 | |
clarkb | sshnaidm: well gear is both a command line tool and a library | 18:19 |
EmilienM | pabelanger: also please do https://review.openstack.org/#/c/335106/ for master | 18:20 |
sshnaidm | clarkb, ok, so duplicate them in function as well? | 18:20 |
*** _sarob has joined #openstack-infra | 18:20 | |
EmilienM | pabelanger: I think we can use the mirror on master, we're using updates repo | 18:20 |
clarkb | sshnaidm: ya I think we probably should that way people running a gearman server via python and not the command can individually select those | 18:20 |
sshnaidm | clarkb, ok, will do | 18:21 |
clarkb | sshnaidm: sorry I didn't think of that until now. | 18:21 |
sshnaidm | clarkb, np, I didn't know either it's used as a library :) | 18:21 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/gear: Support TCP keepalives in geard https://review.openstack.org/334452 | 18:23 |
*** sarob has quit IRC | 18:23 | |
*** yonglihe has quit IRC | 18:24 | |
*** aorourke has joined #openstack-infra | 18:25 | |
*** jed56 has quit IRC | 18:25 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Revert "Revert "Make py35 jobs voting on tempest"" https://review.openstack.org/338466 | 18:26 |
AJaeger | mtreinish, gmann, we should be fine to merge the change above - do you want this now or wait a day? ^ | 18:26 |
*** piet has quit IRC | 18:26 | |
*** markusry has quit IRC | 18:27 | |
jeblair | sshnaidm: lgtm, but can you add docstrings for the new valus? i left an anline comment pointing to the location | 18:28 |
jeblair | 'inline' | 18:29 |
*** Goneri has quit IRC | 18:30 | |
sshnaidm | jeblair, sure, will add | 18:32 |
*** ddieterly[away] is now known as ddieterly | 18:34 | |
*** ociuhandu has quit IRC | 18:34 | |
*** adrian_otto has quit IRC | 18:34 | |
*** javeriak has joined #openstack-infra | 18:35 | |
*** ayoung has quit IRC | 18:35 | |
*** Guest_94857 has joined #openstack-infra | 18:38 | |
Guest_94857 | Allah is doing | 18:38 |
Guest_94857 | sun is not doing Allah is doing | 18:39 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/gear: Support TCP keepalives in geard https://review.openstack.org/334452 | 18:40 |
anteaya | can an infra root help our Guest find the door? | 18:40 |
*** sshnaidm is now known as sshnaidm|afk | 18:42 | |
Guest_94857 | moon is doing Allah is doing | 18:42 |
anteaya | infra-root ^^ | 18:42 |
*** Guest_94857 has left #openstack-infra | 18:42 | |
*** Goneri has joined #openstack-infra | 18:43 | |
fungi | i' | 18:44 |
fungi | er | 18:44 |
fungi | i've added that nick to the akick list for this channel in case it returns | 18:45 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 18:45 |
notmorgan | oh joy... looks like on xenial NO_AUTO_CREATE_USER is automagically set... somewhere... | 18:46 |
anteaya | fungi: thanks | 18:47 |
anteaya | notmorgan: what command is failing for you? | 18:48 |
*** trown is now known as trown|brb | 18:49 | |
notmorgan | anteaya: uhm... creating a new user in unit tests | 18:51 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Upgrade Laravel and ORM https://review.openstack.org/322307 | 18:52 |
AJaeger | notmorgan: do you have a log file? | 18:52 |
notmorgan | AJaeger: it's that the server has NO_AUTOCREATE enabled, this is a local mysql install | 18:52 |
notmorgan | trying to find it because it might hit us in the gate as well. | 18:53 |
notmorgan | AJaeger: i'm getting "no user row matched" error. | 18:53 |
*** piet has joined #openstack-infra | 18:53 | |
*** esumerfd has joined #openstack-infra | 18:53 | |
mtreinish | AJaeger: I'm fine whenever you think things are ready | 18:53 |
pabelanger | clarkb: centos-7 uploads started | 18:54 |
AJaeger | mtreinish: ok, thanks. We should be ready. Let's see when others review... | 18:54 |
anteaya | notmorgan: :( | 18:54 |
openstackgerrit | Jens Rosenboom proposed openstack-infra/project-config: Fix ceilometer testing https://review.openstack.org/338492 | 18:54 |
notmorgan | anteaya: yeah it's ... annoying | 18:55 |
AJaeger | notmorgan: thanks for looking into it. | 18:55 |
anteaya | yeah | 18:55 |
mat128 | hey guys, anyone has time to look at this change? https://review.openstack.org/#/c/336278/ | 18:55 |
mat128 | we (Ironic) are ready to merge it, Jim +1d | 18:55 |
notmorgan | AJaeger: i think it's something we might need to just include in /etc/mysql/mysql.conf.d or some such | 18:56 |
notmorgan | AJaeger: i'll report as soon as i find it. [this matters for nodepool and other such things that are doing opertunistic testing] | 18:56 |
notmorgan | it might also just be something wrong in my setup [ which i hope ] | 18:56 |
*** ddieterly is now known as ddieterly[away] | 18:57 | |
fungi | notmorgan: in our jobs we have macros which do basic account setup in mysql. would that help? | 18:58 |
*** mikelk has quit IRC | 18:58 | |
notmorgan | fungi: it's a server level issue | 18:58 |
*** doffm has joined #openstack-infra | 18:58 | |
notmorgan | fungi: the account is fine locally (checked), some option is being globally set that prevents the opportunistic dynamic users from working | 18:58 |
asselin__ | rcarrillocruz, how is the 'ansible master' vm setup? | 18:59 |
*** Sukhdev has joined #openstack-infra | 18:59 | |
fungi | notmorgan: oh, got it. i think most jobs just use the admin account we create, and then if necessary use it to create other accounts directly | 19:00 |
notmorgan | fungi: but i just lost my local scratch volume soooo will get back to you when that is fixed. | 19:00 |
*** asettle has joined #openstack-infra | 19:00 | |
notmorgan | fungi: nodepool dynamically creates users. | 19:00 |
notmorgan | fungi: and databases. | 19:00 |
notmorgan | fungi: and it looks like these dynamic users are sans password, which is broken by this option. | 19:00 |
fungi | i honestly didn't even know mysql had the ability to autocreate users for you | 19:00 |
fungi | but yeah, behavior of passwordless accounts seems to have changed on xenial's packaged version | 19:01 |
notmorgan | fungi: "grant <options> on db.tables" etc | 19:01 |
notmorgan | that creates the user. | 19:01 |
fungi | ahh. we do rely on grants adding accounts, yes | 19:01 |
notmorgan | with this option "passwordless" isn't autocreated. | 19:01 |
fungi | i was misunderstanding what you were saying was disabled | 19:01 |
notmorgan | so you mus use 'identified by "XXXX"' syntax | 19:02 |
fungi | for the accounts we create in our job macros, we set passwords. there was some complication on xenial using the built-in root account while passwordless | 19:02 |
notmorgan | yep. that too. | 19:02 |
*** ddieterly[away] is now known as ddieterly | 19:02 | |
notmorgan | the root account is... "special" | 19:02 |
*** _deadnull is now known as deadnull | 19:02 | |
notmorgan | but this is looking like something they ... compiled in? | 19:03 |
notmorgan | as a default... maybe. | 19:03 |
notmorgan | because i'm not seeing the option in any files. | 19:03 |
notmorgan | but i might just be missing it :P | 19:03 |
fungi | this is the mechanism we at least try to make sure works in our jobs on all platforms: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n694 | 19:04 |
fungi | and that's supposedly working for us on xenial now | 19:05 |
slagle | pabelanger: did the centos7 image uploads finish? | 19:05 |
clarkb | slagle: no they are still all in progress | 19:06 |
*** kien-ha has joined #openstack-infra | 19:06 | |
*** savihou has joined #openstack-infra | 19:06 | |
EmilienM | pabelanger: https://review.openstack.org/335101 merged, you can backport it now | 19:07 |
*** DaiDV has quit IRC | 19:07 | |
*** inc0 has quit IRC | 19:07 | |
*** thorst has quit IRC | 19:08 | |
pabelanger | slagle: they are coming online now | 19:08 |
pabelanger | EmilienM: great | 19:08 |
slagle | k | 19:08 |
*** ociuhandu has joined #openstack-infra | 19:09 | |
*** thorst has joined #openstack-infra | 19:10 | |
*** rockyg has joined #openstack-infra | 19:10 | |
pabelanger | EmilienM: do you usually use the web interface for puppet modules or command lne? | 19:10 |
*** esumerfd has left #openstack-infra | 19:10 | |
pabelanger | line* | 19:10 |
*** _ari_ has left #openstack-infra | 19:10 | |
pabelanger | happy to do either, what ever makes things easier | 19:10 |
EmilienM | pabelanger: what web interface? | 19:10 |
pabelanger | EmilienM: gerrit | 19:11 |
EmilienM | pabelanger: I use gertty | 19:11 |
pabelanger | great | 19:11 |
EmilienM | but webapp works too | 19:11 |
*** deadnull has quit IRC | 19:13 | |
*** thorst has quit IRC | 19:14 | |
krot_vaca_jul19 | AJaeger: Hrm. | 19:14 |
krot_vaca_jul19 | AJaeger: Ok, so, I personally think the issue is that the xenial npm package is not staying up to date with LTS backports. | 19:15 |
krot_vaca_jul19 | AJaeger: There was a big issue a few weeks ago where the xenial package threw up once npm switched their hosting to gzip-by-default | 19:16 |
krot_vaca_jul19 | Anyway | 19:16 |
*** trown|brb is now known as trown | 19:16 | |
krot_vaca_jul19 | We may just want to switch back to using the nodesource repo | 19:16 |
fungi | krot_vaca_jul19: yeah, i have a feeling we should continuously consume language-ecosystem-specific package managers | 19:16 |
*** dtardivel has quit IRC | 19:17 | |
sridhar_ram | infra-team: a general question, related to which is the correct way to pull in a project's python client library - should we use requirements.txt vs test-requirements.txt ? | 19:17 |
fungi | krot_vaca_jul19: so maybe not distro packages but just unpack into /usr/local or whatever the distro-agnostic installation mechanism is for npm | 19:17 |
sridhar_ram | This is in the context of https://review.openstack.org/336305 where we added python-tackerclient to tacker's test-requirements instead of requirements.txt. But I see many projects pulling in their client using requirements.txt. Perhaps this is for devstack install purpose ? In general is there a suggested guideline or convention ? | 19:17 |
openstackgerrit | Merged openstack-infra/project-config: Bump VM memory for latest stable CoreOS IPA https://review.openstack.org/336278 | 19:17 |
pabelanger | EmilienM: odd, gertty doesn't list stable/mitaka as an available branch to propose change too | 19:18 |
AJaeger | krot_vaca_jul19: please check https://review.openstack.org/#/c/337481/ | 19:18 |
pabelanger | need to check my configs | 19:18 |
krot_vaca_jul19 | AJaeger: That... is now how I expected him to do that. | 19:19 |
krot_vaca_jul19 | *not | 19:19 |
AJaeger | sridhar_ram: do you need the lib for testing - or for general running? Answer that and you know what to do... | 19:19 |
rcarrillocruz | sridhar_ram: requirements are the libraries neeeded to run your project, test is for test | 19:19 |
rcarrillocruz | when you run tox | 19:19 |
rcarrillocruz | it installs both | 19:19 |
rcarrillocruz | requirements and test-requirements | 19:19 |
sridhar_ram | AJaeger: we need it only for test | 19:19 |
rcarrillocruz | fungi: i got an invite for tomorrow to have a call about infra-cloud | 19:19 |
rcarrillocruz | sridhar_ram: then just put it on test-requirements | 19:19 |
AJaeger | sridhar_ram: then add it to test-requirements. | 19:20 |
rcarrillocruz | fungi: i'll fwd shortly | 19:20 |
AJaeger | krot_vaca_jul19: could you comment, please? | 19:20 |
*** asettle has quit IRC | 19:20 | |
krot_vaca_jul19 | AJaeger: Willdo | 19:20 |
sridhar_ram | rcarrillocruz: fair enough, but we might pre-create few things as part of devstack install in the future.. then we need to move it to requirements.txt (seems logical) ? | 19:21 |
sridhar_ram | similar to neutron pre-creating few initial networks | 19:21 |
mtreinish | clarkb: heh, looks like my first crack at it didn't quite work: https://review.openstack.org/338435 | 19:21 |
openstackgerrit | Merged openstack-infra/project-config: Introduce experimental job to test TinyIPA with less RAM https://review.openstack.org/327994 | 19:22 |
AJaeger | clarkb: could you comment on https://review.openstack.org/337946, please? do we remove python34 testing from old branches or keep it? | 19:22 |
krot_vaca_jul19 | AJaeger, fungi: To use shell variable replacements in a jjb macro, I have to double escape it somehow, right? | 19:22 |
* AJaeger waves good bye for today | 19:22 | |
mtreinish | oh there is also gonna be a race with nodepool precaching the images and the gate jobs using them | 19:23 |
sridhar_ram | AJaeger: rcarrillocruz: thanks for the clarification! | 19:23 |
pabelanger | EmilienM: can you confirm, in gertty using 335101, if I CTRL-X (propose change to branch) I don't see stable/mitaka | 19:23 |
AJaeger | krot_vaca_jul19: for a template, you have to do it - use {{ instead of {, same for }} | 19:23 |
EmilienM | pabelanger: weird | 19:24 |
*** PollyZ_ has joined #openstack-infra | 19:25 | |
pabelanger | jeblair: do you have a moment to review my comment about gertty^ and offer a suggestion on how to fix my branch issues? | 19:27 |
*** thorst has joined #openstack-infra | 19:27 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Always install nodejs from nodesource https://review.openstack.org/338508 | 19:27 |
krot_vaca_jul19 | fungi: Note, I haven't tested this manually. On vacation. ^^ | 19:28 |
*** PollyZ has quit IRC | 19:28 | |
anteaya | krot_vaca_jul19: would you be willing to field a question on the storyboard branches api, specifically the feature to create a new branch? | 19:28 |
krot_vaca_jul19 | anteaya: I'm not contributing directly to storyboard right now. | 19:29 |
anteaya | krot_vaca_jul19: I'll take that as no, thanks anyway | 19:29 |
*** asettle has joined #openstack-infra | 19:29 | |
*** PollyZ has joined #openstack-infra | 19:30 | |
*** vhosakot has quit IRC | 19:31 | |
jeblair | pabelanger: are you subscribed to the job? | 19:31 |
jeblair | er | 19:31 |
jeblair | pabelanger: are you subscribed to the project? | 19:31 |
*** PollyZ_ has quit IRC | 19:32 | |
pabelanger | jeblair: I am not. I used the search feature to find the review | 19:32 |
jeblair | pabelanger: i think gertty may only know about branches for subscribed projects | 19:32 |
pabelanger | okay, let me try that | 19:32 |
jeblair | perhaps project branches are light-weight enough that we could sync all of them | 19:33 |
*** xenogear has quit IRC | 19:35 | |
*** asettle has quit IRC | 19:36 | |
krot_vaca_jul19 | AJaeger: Commented | 19:36 |
*** vhosakot has joined #openstack-infra | 19:44 | |
*** ddieterly is now known as ddieterly[away] | 19:44 | |
rcarrillocruz | pabelanger , clarkb : have the centos dibs been uploaded? | 19:45 |
rcarrillocruz | i believe greghaynes pushed a new release of dib with the revert from yesterday | 19:45 |
openstackgerrit | greghaynes proposed openstack-infra/glean: Use blkid to grab config drive fs type https://review.openstack.org/335559 | 19:45 |
clarkb | rcarrillocruz: yes all cloud regions should have that fix now | 19:45 |
clarkb | rcarrillocruz: but there may be a few straggler nodes that nodepool needs to cycle out | 19:46 |
pabelanger | rcarrillocruz: doing that now | 19:46 |
rcarrillocruz | excellent, let me recheck my change then | 19:46 |
rcarrillocruz | also, should I +A https://review.openstack.org/#/c/337692/ | 19:46 |
rcarrillocruz | ? | 19:46 |
clarkb | pabelanger: ya but the fix rcarrillocruz needs was everywhere last night except for rax-dfw | 19:46 |
*** jesusaur has quit IRC | 19:46 | |
clarkb | and rax-dfw just finished today's upload so should be good | 19:46 |
pabelanger | only rax-ord and ovh-bhs1 left to upload | 19:46 |
pabelanger | clarkb: ah, perfect | 19:46 |
frickler | could another core take a look at https://review.openstack.org/338492 and help fix ceilometer gate, pls? | 19:46 |
clarkb | rcarrillocruz: should be fine, maybe double check with fungi if worried about it | 19:47 |
rcarrillocruz | fungi: ^, the change to add myself as root | 19:47 |
clarkb | frickler: ya one sec | 19:48 |
clarkb | frickler: done | 19:48 |
frickler | clarkb: thx | 19:48 |
*** jesusaur has joined #openstack-infra | 19:49 | |
*** zul has quit IRC | 19:51 | |
*** ramishra has quit IRC | 19:51 | |
pabelanger | rcarrillocruz: +2, again | 19:52 |
*** ramishra has joined #openstack-infra | 19:52 | |
*** esikachev has quit IRC | 19:53 | |
pabelanger | clarkb: slagle: centos-7-2-node looks to be online: telnet://104.239.167.66:8088 | 19:54 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Milestones api https://review.openstack.org/338522 | 19:54 |
*** njohnston has joined #openstack-infra | 19:54 | |
fungi | rcarrillocruz: approvinated | 19:55 |
openstackgerrit | Merged openstack-infra/project-config: Fix ceilometer testing https://review.openstack.org/338492 | 19:56 |
rcarrillocruz | thx | 19:56 |
*** ayoung has joined #openstack-infra | 19:56 | |
slagle | pabelanger: cool, will keep an eye on it | 19:57 |
*** alex_xu has joined #openstack-infra | 19:58 | |
*** asettle has joined #openstack-infra | 19:59 | |
*** piet has quit IRC | 20:01 | |
*** julim has quit IRC | 20:01 | |
*** jamesmcarthur has quit IRC | 20:01 | |
notmorgan | AJaeger: turns out it's a built-in now, the way to allow "passwordless" users is to change sql_mode - which would also impact root | 20:03 |
notmorgan | AJaeger: it's a change (default change) in mysql 5.7 and later | 20:03 |
*** Hal has joined #openstack-infra | 20:03 | |
notmorgan | which.. xenial i think was the upgrade that pushed me over that version. | 20:04 |
*** Hal is now known as Guest75437 | 20:04 | |
therve | clarkb, So you mentioned earlier that downloading from tarballs.openstack.org was crossing the ocean | 20:04 |
therve | clarkb, Would it be possible to have dc specific locations for download? | 20:04 |
clarkb | therve: for ovh it does | 20:04 |
therve | I guess like the pypi mirror | 20:04 |
*** julim has joined #openstack-infra | 20:05 | |
clarkb | therve: we could possibly put that stuff into the afs system and potentially serve it that way | 20:05 |
mordred | yah. we've talked about doing that before | 20:05 |
jeblair | ++ | 20:05 |
clarkb | I do still think it would be good to understand what the actual requirements are reather than just download a 550MB image every job | 20:05 |
mordred | ++ | 20:05 |
therve | clarkb, If we make the effort to make it smaller? :) | 20:05 |
openstackgerrit | Merged openstack-infra/system-config: Add rcarrillocruz as infra-root https://review.openstack.org/337692 | 20:05 |
*** piet has joined #openstack-infra | 20:05 | |
*** rcernin_ has joined #openstack-infra | 20:06 | |
*** hashar has joined #openstack-infra | 20:06 | |
openstackgerrit | Merged openstack/diskimage-builder: Clear up "already provided" message https://review.openstack.org/290968 | 20:06 |
therve | clarkb, Yeah from what I gathered we're in the middle of the road for no great reasons. The image still doesn't have everything we need to test everything that we wants, and it's still to big to be reliably fetched | 20:06 |
therve | So for the short term we'll try to get back to a simple fedora image I think | 20:07 |
therve | Fedora 24 has the good taste to be under 200M, so that'd be better than the 500 that we fetch right now | 20:07 |
*** ddieterly[away] is now known as ddieterly | 20:08 | |
*** Apoorva has quit IRC | 20:09 | |
*** Apoorva has joined #openstack-infra | 20:10 | |
*** jamesmcarthur has joined #openstack-infra | 20:10 | |
*** rcernin_ has quit IRC | 20:10 | |
pabelanger | speaking of fedora-24, should see if I nodepool can build it | 20:12 |
*** sdake has quit IRC | 20:12 | |
*** pvaneck has quit IRC | 20:13 | |
*** pvaneck has joined #openstack-infra | 20:13 | |
*** Apoorva has quit IRC | 20:14 | |
*** bryan_att has joined #openstack-infra | 20:15 | |
*** rcernin_ has joined #openstack-infra | 20:15 | |
*** javeriak has quit IRC | 20:16 | |
*** kzaitsev_mb has joined #openstack-infra | 20:17 | |
*** makowals has quit IRC | 20:18 | |
openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Adds ironic v3 only job https://review.openstack.org/304306 | 20:18 |
*** rcernin_ has quit IRC | 20:19 | |
*** sdake has joined #openstack-infra | 20:19 | |
*** rcernin_ has joined #openstack-infra | 20:19 | |
*** rcernin_ has quit IRC | 20:20 | |
*** Nikolay_St has quit IRC | 20:22 | |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Tags api https://review.openstack.org/338532 | 20:22 |
nibalizer | rcarrillocruz: welcome ! | 20:22 |
openstackgerrit | gordon chung proposed openstack-infra/project-config: re-enable voting on ceilometer+mongodb tempest tests https://review.openstack.org/338533 | 20:22 |
timrc | rcarrillocruz: Woohoo! | 20:22 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist https://review.openstack.org/319337 | 20:24 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 20:24 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Stop piping yes to Heat https://review.openstack.org/317730 | 20:24 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 20:24 |
*** rfolco_ has joined #openstack-infra | 20:24 | |
notmorgan | AJaeger: ok i have a fix that will allow auto user creation, it's just dropping a config into my.cnf under [mysqld] | 20:24 |
*** rcernin has quit IRC | 20:24 | |
*** rcernin has joined #openstack-infra | 20:25 | |
*** eharney has quit IRC | 20:25 | |
*** adrian_otto has joined #openstack-infra | 20:25 | |
*** rcernin has quit IRC | 20:25 | |
*** rcernin has joined #openstack-infra | 20:25 | |
*** vhosakot has quit IRC | 20:26 | |
*** rfolco has quit IRC | 20:26 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Run undercloud idempotency test on all jobs https://review.openstack.org/336112 | 20:26 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add undercloud idempotency test https://review.openstack.org/279218 | 20:26 |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: Reenable mongodb gate job https://review.openstack.org/338538 | 20:26 |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: make correct mongodb job non-voting https://review.openstack.org/338538 | 20:27 |
*** vhosakot has joined #openstack-infra | 20:27 | |
fungi | notmorgan: how much additional hassle is it to have the test fixture for the user also track a password? | 20:28 |
fungi | that way the implementation would be portable across default configs of older and newer mysql | 20:28 |
notmorgan | fungi: not sure. just trying to determine what changed first locally so i know why | 20:28 |
notmorgan | fungi: ideally it should be easy. | 20:28 |
notmorgan | fungi: but... i'll need to go poke at it | 20:28 |
notmorgan | i just greatly dislike when things magically change | 20:29 |
fungi | i'm just hesitant to end up with "and if you're running jobs on xenial make sure you use this non-default database configuration" | 20:29 |
*** cody-somerville has joined #openstack-infra | 20:29 | |
notmorgan | sure. | 20:29 |
* notmorgan goes off down another rabbit hole for a moment | 20:30 | |
*** Apoorva has joined #openstack-infra | 20:31 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Record Heat resource deployment times to Graphite https://review.openstack.org/314308 | 20:33 |
*** ddieterly is now known as ddieterly[away] | 20:33 | |
slagle | pabelanger: looks like it might be stuck where it should be doing a pip install. wonder if the right mirror is configured | 20:34 |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Clean up import helpers in publishers https://review.openstack.org/338544 | 20:35 |
*** esikachev has joined #openstack-infra | 20:35 | |
*** ddieterly[away] is now known as ddieterly | 20:36 | |
*** piet has quit IRC | 20:37 | |
*** piet has joined #openstack-infra | 20:38 | |
openstackgerrit | Christian Fetzer proposed openstack-infra/jenkins-job-builder: Update Gitlab to >=1.2.4 https://review.openstack.org/333113 | 20:38 |
*** Guest_84847 has joined #openstack-infra | 20:38 | |
*** rcernin has quit IRC | 20:38 | |
*** rdxnoam_ has joined #openstack-infra | 20:38 | |
*** rcernin has joined #openstack-infra | 20:39 | |
*** _sarob is now known as sarob | 20:39 | |
*** Guest_84847 has quit IRC | 20:39 | |
*** PollyZ has quit IRC | 20:39 | |
*** PollyZ has joined #openstack-infra | 20:39 | |
rdxnoam_ | Hello. I've setup CI and want to push to ci-sandbox to see if my gerrit-zuul-jenkins configuration is correct, but encounter a permissions error. Can anyone assist? | 20:40 |
pabelanger | slagle: not sure, looks like delorean hung trying to setup the virtualenv | 20:40 |
pabelanger | wonder if this is the issue rcarrillocruz was reporting | 20:40 |
rcarrillocruz | pabelanger: i doubt it, i rechecked change that was failing consistently on running virtualenv and passed | 20:41 |
rdxnoam_ | Or please point me in the right direction if this is not the correct channel... | 20:41 |
*** njohnston has left #openstack-infra | 20:41 | |
rcarrillocruz | can i see the error slagle ? | 20:41 |
slagle | rcarrillocruz: we don't have one yet...just watching a running job | 20:42 |
pabelanger | slagle: it is rax-iad, maybe a network issue too | 20:42 |
*** Guest_84755 has joined #openstack-infra | 20:42 | |
slagle | it appears hung creating a virtualenv, or on the next step, which is a pip install in the venv | 20:42 |
rcarrillocruz | the issue that happened yesterday was about centos nodes not being able to run virtualenv, i.e. command not found | 20:42 |
rcarrillocruz | so doesn't look like your issue (hung virtualenv) | 20:42 |
slagle | ok, i think we're past that | 20:42 |
Guest_84755 | Allah is doing | 20:42 |
Guest_84755 | sun is not doing Allah is doing | 20:42 |
Guest_84755 | moon is not doing Allah is doing | 20:43 |
Guest_84755 | stars are not doing Allah is doing | 20:43 |
*** ChanServ sets mode: +b Guest_84755!*@* | 20:43 | |
*** Guest_84755 was kicked by ChanServ (Banned: spamming is off-topic) | 20:43 | |
mordred | I honestly wonder what the person who runs that bot thinks they are accomplishing | 20:44 |
fungi | the will of their deity, no doubt | 20:44 |
nibalizer | i have somewhat memorized it, so its almost effective | 20:44 |
mgagne | "bots are not doing Allah is doing" ? =) | 20:44 |
bkero | again? | 20:44 |
mtreinish | nibalizer: well, not until you start preaching the good word | 20:45 |
mordred | nibalizer: yah - but that's only effective if the intent is for you to memorize a set of words :) | 20:45 |
slagle | pabelanger: ok, i see the error now. i think it's trying to use the mirror server we use in the tripleo cloud. i thought i had unconfigured that, but will double check | 20:45 |
slagle | oh, it's $http_proxy rather. i'll need to unset that for the multinode job | 20:46 |
mordred | nibalizer: wow, it goes on a long time before it repeats: https://openstack.nimeyo.com/78412/openstack-dev-somebody-posted-this-on-%23openstack-meetng-4 | 20:47 |
mordred | nibalizer: if you have that entire thing memorized, i'm _very_ impressed | 20:47 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 20:48 |
nibalizer | but it always starts with sun and moon | 20:48 |
nibalizer | also lol, nimeyo :( | 20:48 |
rdxnoam_ | can anyone help? | 20:48 |
nibalizer | fungi: pleased you were able to get them to stop using the infringing logo | 20:48 |
fungi | nibalizer: they also set the service to no longer post to our mailing lists. it's just a read-only archive now | 20:49 |
fungi | though that took unsubscribing them before they'd pay attention to my hails and actually get back to me | 20:49 |
*** dprince has quit IRC | 20:49 | |
*** mtanin___ has joined #openstack-infra | 20:50 | |
*** mtanino has quit IRC | 20:51 | |
pabelanger | slagle: okay | 20:51 |
*** raildo is now known as raildo-afk | 20:51 | |
*** kgiusti has left #openstack-infra | 20:52 | |
*** sdake has quit IRC | 20:53 | |
*** mtanin___ has quit IRC | 20:54 | |
*** dfflanders has joined #openstack-infra | 20:54 | |
pabelanger | slagle: also, now that tripleo-test-cloud-rh2 is running AFS, you should be able to drop your proxies and start to rely more on AFS | 20:54 |
*** esikachev has quit IRC | 20:54 | |
*** Nikolay_St has joined #openstack-infra | 20:55 | |
EmilienM | pabelanger: I guess we'll need to sed jenkins/zuul in puppet CI ? https://review.openstack.org/#/c/337821/ | 20:57 |
*** Goneri has quit IRC | 20:57 | |
EmilienM | pabelanger: nevermind, we don't use hardcode the user | 20:58 |
*** acoles_ is now known as acoles | 20:58 | |
*** dfflanders has quit IRC | 20:58 | |
*** dfflanders has joined #openstack-infra | 20:59 | |
*** jamesmcarthur has quit IRC | 21:01 | |
*** rockyg has quit IRC | 21:01 | |
EmilienM | pabelanger: btw, it works fine: https://review.openstack.org/#/c/335106/ - thanks for this work! | 21:01 |
*** matt-borland has quit IRC | 21:02 | |
EmilienM | pabelanger: could you submit to master and liberty? | 21:02 |
*** sdake has joined #openstack-infra | 21:03 | |
*** ajmiller_ has joined #openstack-infra | 21:03 | |
*** rcernin has quit IRC | 21:03 | |
*** rcernin has joined #openstack-infra | 21:04 | |
fungi | rcarrillocruz: what's the timezone on that conference call invite? | 21:04 |
*** trown is now known as trown|outtypewww | 21:04 | |
*** lucas|afk has quit IRC | 21:05 | |
rcarrillocruz | fungi: that got 'translated' by outlook to my timezone, cest | 21:05 |
fungi | rcarrillocruz: thanks, so utc+2 right now? | 21:06 |
*** karthikp_ has quit IRC | 21:06 | |
rcarrillocruz | fungi: yep | 21:06 |
*** ajmiller has quit IRC | 21:07 | |
*** jcoufal has quit IRC | 21:07 | |
fungi | awesome. so call is for 14:30-15:00 utc i guess | 21:07 |
*** julim has quit IRC | 21:07 | |
*** rcernin has quit IRC | 21:07 | |
*** rcernin has joined #openstack-infra | 21:07 | |
fungi | doesn't conflict with anything on my schedule for tomorrow | 21:07 |
*** derekh has joined #openstack-infra | 21:08 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/111011 | 21:08 |
*** jamesmcarthur has joined #openstack-infra | 21:10 | |
rcarrillocruz | ++ | 21:10 |
*** Nikolay_St has quit IRC | 21:10 | |
*** lucasagomes has joined #openstack-infra | 21:12 | |
*** asettle has quit IRC | 21:13 | |
*** aysyd has quit IRC | 21:14 | |
*** ldnunes_ has quit IRC | 21:15 | |
*** dmsimard is now known as dmsimard|afk | 21:16 | |
*** rhallisey has quit IRC | 21:16 | |
*** aeng has quit IRC | 21:17 | |
*** gouthamr_ has quit IRC | 21:20 | |
*** dingyichen has joined #openstack-infra | 21:20 | |
*** gouthamr has joined #openstack-infra | 21:21 | |
rdxnoam_ | Help needed! I am trying to fill out contact information at https://review.openstack.org/#/settings/contact and receive a 'Server Error' message | 21:21 |
rdxnoam_ | can anyone help? | 21:21 |
*** aeng has joined #openstack-infra | 21:22 | |
mordred | fungi: I will be on a plane to asia, so I will not be able to make the call | 21:22 |
mordred | fungi: although I can make occasional snarky comments in IRC if it's helpful | 21:23 |
*** karthikp_ has joined #openstack-infra | 21:23 | |
fungi | rdxnoam_: were you following the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup ? | 21:24 |
rdxnoam_ | fungi: I have a launchpad account and ssh keys added and my zuul installation is connected properly. when i try to 'git review' it says that i need to fill out the contact information. Does this answer the question? | 21:25 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-log_processor: Give each job's console log its own crm classifier https://review.openstack.org/338558 | 21:26 |
*** priteau has quit IRC | 21:27 | |
fungi | rdxnoam_: it sounds like you're trying to test against the openstack-dev/sandbox repo, which requires a contributor agreement with contact information. if you're testing a ci system you should likely instead test against the openstack-dev/ci-sandbox repo which does not have those requirements | 21:29 |
rdxnoam_ | fungi: you are correct. I will try testing with ci-sandbox. thanks! | 21:29 |
pabelanger | EmilienM: sure, I'll do that in a bit | 21:30 |
* fungi grumbles about new server he's trying to launch not puppeting far enough to create his account so that he can log in and find the remaining puppet errors in syslog | 21:30 | |
*** rfolco_ has quit IRC | 21:34 | |
fungi | oh, i think this is the "our groups aren't getting expanded" bug again | 21:34 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Subscriptions api https://review.openstack.org/338561 | 21:35 |
mordred | fungi: gah | 21:36 |
fungi | aha, nope, i see why! | 21:36 |
mordred | fungi: sorry - I was afk for _way_ more of today than I was originally hoping to be - but I'm fairly captive all of tomorrow | 21:36 |
*** acoles is now known as acoles_ | 21:37 | |
*** rcernin has quit IRC | 21:37 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Put signing01.ci in the signing group https://review.openstack.org/338562 | 21:38 |
fungi | mordred: 'twas MY fault! ^ | 21:38 |
mordred | fungi: oh good | 21:38 |
*** larainema has quit IRC | 21:39 | |
fungi | already had it in modules/openstack_project/files/puppetmaster/groups.txt but didn't also set the group in manifests/site.pp' | 21:39 |
mordred | fungi: that actually shouldn't matter | 21:40 |
mordred | fungi: oh - wait | 21:40 |
mordred | no, you're right | 21:40 |
mordred | it's still important | 21:40 |
*** ddieterly is now known as ddieterly[away] | 21:40 | |
fungi | at least i assume that's why the errors i'm seeing are about it not finding hiera keys i've defined in its group-specific hiera file | 21:41 |
mordred | fungi: I'm about to send out the release naming polls. this time I added "you are receiving this because you are a foundation member" up at the top so that maybe I won't get quite as many "unsubscribe" emails :) | 21:41 |
fungi | mordred: heh, g'luck! | 21:41 |
mordred | fungi: your supposition makes sense to me | 21:41 |
*** esberglu has quit IRC | 21:42 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove the rewrite of TOCI_JOBTYPE https://review.openstack.org/338566 | 21:42 |
*** derekh has quit IRC | 21:43 | |
fungi | this workstation feels like a brand new system now that i've breathed life back into its cpu fan so it's not downclocking itself by an order of magnitude | 21:44 |
*** EricGonczer_ has quit IRC | 21:44 | |
*** yamahata has quit IRC | 21:44 | |
*** jamesmcarthur has quit IRC | 21:44 | |
*** gordc has quit IRC | 21:44 | |
stevebaker | hey, heat's integration tests use this custom built image http://tarballs.openstack.org/heat-test-image/ but we'd like to switch to a vanilla centos or fedora image instead. I'd like to know if we should just use upstream download URLs or some infra cached url | 21:44 |
*** piet has quit IRC | 21:45 | |
fungi | stevebaker: it's possible we bake one into our images already? i know for a while we were downloading a fedora image and stashing it on all our devstack images (back when we had separate images for devstack jobs) | 21:45 |
*** yamahata has joined #openstack-infra | 21:46 | |
dstufft | mordred: https://s.caremad.io/Hh9QXtE5cL/ | 21:46 |
fungi | clarkb: pabelanger: ^ do you know if that's still the case with our base images? | 21:46 |
clarkb | I dont think it is | 21:46 |
*** ajmiller_ has quit IRC | 21:46 | |
mordred | dstufft: never | 21:46 |
*** ajmiller_ has joined #openstack-infra | 21:46 | |
fungi | stevebaker: if memory serves, it was painful for _us_ because fedora's download site was unreliable and it would bomb our image updates when we couldn't get that file | 21:47 |
fungi | stevebaker: so i can only imagine how terrible it would be to try to retrieve it from them in a frequently-run job | 21:48 |
*** rvba has quit IRC | 21:48 | |
anteaya | fungi: congratulations | 21:48 |
anteaya | so that's what electronics need, fungi to breath on them | 21:48 |
anteaya | if I get some new hard drives can I get them shipped to you so you can breath on them? | 21:49 |
stevebaker | fungi: yes, thats right. we'd probably prefer centos anyway. I'll check but I think the RDO jobs rely on centos infra anyway so maybe we should just rely on http://cloud.centos.org/centos/7/images/ | 21:49 |
fungi | stevebaker: we were discussing earlier with therve that it might make sense to start providing some larger files like that on our per-provider mirrors so that you don't end up having to retrieve them over the broader internet | 21:49 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Upgrade Laravel and ORM https://review.openstack.org/322307 | 21:50 |
*** nmagnezi has quit IRC | 21:50 | |
stevebaker | fungi: how about I start by trying IMAGE_URLS+=http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2 and see how that goes? | 21:50 |
fungi | stevebaker: it's a self-testing change i think so worth seeing what happens | 21:51 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Users api https://review.openstack.org/338570 | 21:51 |
*** savihou has quit IRC | 21:51 | |
*** Guest75437 has quit IRC | 21:51 | |
*** sigmavirus is now known as sigmavirus_away | 21:52 | |
anteaya | fungi: correct me if I am wrong the only one that can create a modify a storyboard user is a storyboard admin, correct? | 21:52 |
anteaya | create and modify* | 21:53 |
*** vhosakot has quit IRC | 21:53 | |
fungi | anteaya: i think storyboard users are auto-created on first login | 21:53 |
anteaya | oh yes, that is true, hmmmm, okay thanks | 21:54 |
fungi | anteaya: i don't know of any other way to do it, but it's possible admin features have been added to allow creating/modifying users | 21:54 |
*** gyee has quit IRC | 21:54 | |
anteaya | I've made comments in the patch, hopefully I can get some direction | 21:55 |
anteaya | thank you | 21:55 |
anteaya | if anyone feels like reviewing some storyboard api documentation example commands, I'd be grateful for the reviews: https://review.openstack.org/#/q/topic:expand-api-docs | 21:57 |
anteaya | thank you | 21:57 |
*** larainema has joined #openstack-infra | 21:57 | |
*** salv-orlando has joined #openstack-infra | 21:57 | |
*** mriedem is now known as mriedem_afk | 21:58 | |
*** ddieterly[away] is now known as ddieterly | 22:03 | |
openstackgerrit | Merged openstack-infra/system-config: Put signing01.ci in the signing group https://review.openstack.org/338562 | 22:04 |
*** cardeois_ has joined #openstack-infra | 22:05 | |
*** tphummel has quit IRC | 22:05 | |
*** tphummel has joined #openstack-infra | 22:07 | |
*** cardeois has quit IRC | 22:09 | |
*** cardeois_ has quit IRC | 22:09 | |
*** thiagop has quit IRC | 22:10 | |
openstackgerrit | Sumit Naiksatam proposed openstack-infra/project-config: Add experimental testing job for GBP https://review.openstack.org/338577 | 22:10 |
clarkb | jhesketh: any chance you can review https://review.openstack.org/#/c/336311/ as it will help us do the xenial job registrations | 22:11 |
*** mdrabe has quit IRC | 22:12 | |
clarkb | greghaynes: hrm the glean sort cleanup seems to have tripped over something gentoo related | 22:13 |
clarkb | greghaynes: oh I think I see the issue, gentoo has other side effecting calls there | 22:14 |
*** Goneri has joined #openstack-infra | 22:15 | |
*** kzaitsev_mb has quit IRC | 22:19 | |
*** burgerk has quit IRC | 22:19 | |
*** xyang1 has quit IRC | 22:19 | |
*** kzaitsev_mb has joined #openstack-infra | 22:20 | |
*** david-lyle_ has joined #openstack-infra | 22:21 | |
*** cody-somerville has quit IRC | 22:21 | |
*** dkehn__ has joined #openstack-infra | 22:21 | |
*** dkehn_ has quit IRC | 22:24 | |
*** Julien-zte has joined #openstack-infra | 22:25 | |
*** david-lyle__ has joined #openstack-infra | 22:26 | |
jhesketh | Morning | 22:26 |
jhesketh | clarkb: looking | 22:26 |
jhesketh | fungi: was the npm issue resolved? | 22:27 |
fungi | jhesketh: resolved by making stackviz ignore npm errors | 22:27 |
jhesketh | fungi: is that package missing on the slaves then?? | 22:27 |
jhesketh | (woops, didn't mean the anxious double '?') | 22:27 |
*** kzaitsev_mb has quit IRC | 22:28 | |
fungi | jhesketh: stackviz is probably broken on xenial slaves that build from this point forward, at least until npm gets better on xenial | 22:28 |
fungi | but incomplete stackviz installation should no longer impact our ability to create those images | 22:29 |
jhesketh | okay that's fair enough | 22:29 |
*** kzaitsev_mb has joined #openstack-infra | 22:30 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Grails plugin to use convert xml https://review.openstack.org/338583 | 22:30 |
*** amitgandhinz has quit IRC | 22:30 | |
jhesketh | clarkb: with that change how will jobs that need a specific slave get the right node type | 22:30 |
clarkb | jhesketh: you will create a job per node type | 22:31 |
jesusaur | infra-core: when you get a chance can you take a look at https://review.openstack.org/320728 and https://review.openstack.org/320729? I'd like to get some rudimentary testing in place on the logstash-filters project | 22:31 |
clarkb | jhesketh: https://review.openstack.org/337905 is the rough idea | 22:31 |
clarkb | prometheanfire: any idea why removing the sorts from https://review.openstack.org/#/c/337932/3/glean/cmd.py line 277 causes the tests to fail? we are editing a dict there which is not sorted information | 22:32 |
timothyb89 | fungi, jhesketh: stackviz was actually building properly again as of the last xenial build | 22:32 |
timothyb89 | it looks like the bad npm mirror fixed itself | 22:33 |
prometheanfire | looking | 22:33 |
*** amitgandhinz has joined #openstack-infra | 22:33 | |
prometheanfire | clarkb: tests expect an order, since dict's are unordered that needs to be 'fixed' on way is to sort on the actual code side | 22:34 |
prometheanfire | the real fix would be to have the tests not expect an order | 22:34 |
clarkb | prometheanfire: ya you'll see at the end of that diff we have a single sort on the output side | 22:35 |
*** david-lyle_ is now known as david-lyle | 22:35 | |
clarkb | prometheanfire: whcich seems to work for red hat and debuntu tests but not gentoo | 22:35 |
clarkb | prometheanfire: trying to simplify the glean code a little as it can be hard to follow right now | 22:36 |
*** Apoorva_ has joined #openstack-infra | 22:36 | |
prometheanfire | ah | 22:36 |
prometheanfire | ya, it can be | 22:36 |
*** david-lyle__ has quit IRC | 22:36 | |
prometheanfire | the ordering in the file counts for gentoo | 22:36 |
clarkb | it does look like gentoo functions may write as it goes which is fine I can add the sorts back to it there, but line 277 is before that and only modifies that dict | 22:37 |
clarkb | so I am confused | 22:37 |
prometheanfire | cant have config eth0_42 without eth0 being set up iirc | 22:37 |
clarkb | and sorting iteration on a dict that only modifies a dict should be a noop sort | 22:37 |
clarkb | becaues it doesn't matter if I add foo to dict then bar or bar to dict then foo because dicts are unordred | 22:37 |
prometheanfire | I'm not totally sure | 22:38 |
clarkb | maybe I should rebase and change the order of those cahnges and figure out the sorts later | 22:38 |
clarkb | (but this sort (hahaha) of confusion is what I am trying to remove from glean | 22:39 |
*** Apoorva has quit IRC | 22:39 | |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain vlan setup with interface names https://review.openstack.org/337934 | 22:40 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Explain difference between config drive files https://review.openstack.org/337933 | 22:40 |
openstackgerrit | Clark Boylan proposed openstack-infra/glean: Sort output data once before we write it https://review.openstack.org/337932 | 22:40 |
prometheanfire | ya, I think I coppied redhat's setup | 22:40 |
prometheanfire | so, blame them | 22:40 |
clarkb | yes debian does it too, but for red hat and debian it doesn't appear to be necessary there which is what I expect. They fall through to the sort at the end of that diff and work fine | 22:40 |
prometheanfire | the tests are the same? | 22:41 |
clarkb | no they all assert different files and contents | 22:41 |
prometheanfire | ya | 22:43 |
prometheanfire | it's been a while | 22:43 |
*** salv-orl_ has joined #openstack-infra | 22:43 | |
*** dimtruck is now known as zz_dimtruck | 22:43 | |
*** hashar has quit IRC | 22:45 | |
*** salv-orlando has quit IRC | 22:46 | |
*** tpsilva has quit IRC | 22:48 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Grails plugin to use convert xml https://review.openstack.org/338583 | 22:48 |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Grails plugin to use convert xml https://review.openstack.org/338583 | 22:50 |
jhesketh | clarkb: (sorry was on a call). so okay, you're not going to turn this new option on until all the jobs are renamed appropriately? | 22:50 |
clarkb | jhesketh: well it will work today as is if we turn it one becuase none of our jobs use ZUUL_NODE parameter | 22:50 |
clarkb | jhesketh: but yes plan is to bifurcate things to handle trusty and xenial at the same time using job per image/label | 22:51 |
jhesketh | clarkb: what about nodepool demand calculations... don't they use the node label ? | 22:51 |
*** ddieterly is now known as ddieterly[away] | 22:52 | |
*** ddieterly[away] is now known as ddieterly | 22:52 | |
*** ddieterly has quit IRC | 22:52 | |
clarkb | oh hrm good question | 22:52 |
*** Sukhdev has quit IRC | 22:53 | |
*** rbrndt has quit IRC | 22:55 | |
clarkb | jhesketh: it does seem to accomodate it, not sure if it is necessary yet | 22:56 |
clarkb | ya if I am reading getNeededWorkers() properly we will stop satisfying demand if we go this route :( | 22:58 |
jeblair | if we register no ":label" jobs, then demand for those jobs will be ignored | 22:58 |
jeblair | (so it will fall back on min-ready) | 22:58 |
clarkb | jeblair: ya | 22:58 |
*** tlian2 has joined #openstack-infra | 22:59 | |
clarkb | so things will "work" just not as dynamically | 22:59 |
fungi | oh, er yeah that wasn't a side effect i considered previously | 22:59 |
clarkb | something to chew on :/ | 23:00 |
jeblair | clarkb: nodepool does have the information to map job names to workers though | 23:00 |
clarkb | jeblair: even if the jobs don't register with the labels? | 23:00 |
jeblair | clarkb: geard will tell it "ubuntu-trusty-1234" can run "build:foo", and nodepool knows than "ubuntu-trusty-1234" is an ubuntu-trusty node type (since nodepool built it and has a current node table record for it) | 23:01 |
jeblair | clarkb: so we should be able to have it make the connection that "build:foo" is demand for "ubuntu-trusty" | 23:01 |
*** tlian has quit IRC | 23:02 | |
clarkb | gotcha | 23:02 |
fungi | good point | 23:02 |
jeblair | a fix like that is kind of nice in that it works regardless of whether you use the new switch in zuul-launcher | 23:02 |
clarkb | ya | 23:02 |
* clarkb pokes at getNeededNodes() | 23:03 | |
*** ociuhandu has quit IRC | 23:03 | |
jeblair | clarkb: i *think* that will mean also issuing a geard 'workers' admin request | 23:03 |
clarkb | oh wait maybe it already infers that? | 23:03 |
clarkb | there is handling for 'unspecified_jobs' | 23:04 |
jeblair | clarkb: that's to map demand for "build:foo" to a node, but it requires having previously seen "build:foo:trusty" | 23:04 |
jeblair | s/node/image/ | 23:04 |
jeblair | clarkb: otherwise, it will hit the "if not workers: continue" path | 23:05 |
clarkb | ya Isee that now, need to populate the job_workers_map dict | 23:05 |
*** hongbin has quit IRC | 23:05 | |
clarkb | I think I can see how to add this though | 23:06 |
jeblair | cool | 23:06 |
openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add openstack/fuel-plugin-murano-tests project https://review.openstack.org/332151 | 23:06 |
*** Apoorva has joined #openstack-infra | 23:06 | |
*** Apoorva_ has quit IRC | 23:07 | |
*** kien-ha has quit IRC | 23:11 | |
*** rdxnoam_ has quit IRC | 23:11 | |
*** thorst has quit IRC | 23:16 | |
*** thorst has joined #openstack-infra | 23:16 | |
openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Infer node demand from workers listing https://review.openstack.org/338598 | 23:20 |
clarkb | jeblair: ^ something like that. Still very much WIP and needs test(s) but I think thats the general shape of it | 23:20 |
clarkb | jeblair: for the names coming back do the workers register themselves with their label or their hostname or their fqdn? | 23:21 |
*** rlandy has quit IRC | 23:21 | |
clarkb | I think zuul-launcher sets that value when it registers as a worker | 23:21 |
jeblair | clarkb: 272 104.130.136.141 ubuntu-xenial-rax-dfw-2296650 : build:gate-puppet-oslo-puppet-beaker-rspec-ubuntu-xenial | 23:22 |
jeblair | easiest way to be sure :) | 23:22 |
*** HeOS has quit IRC | 23:23 | |
*** HeOS has joined #openstack-infra | 23:23 | |
*** thorst_ has joined #openstack-infra | 23:23 | |
*** zul has joined #openstack-infra | 23:24 | |
*** arosen12 has joined #openstack-infra | 23:24 | |
*** thorst has quit IRC | 23:25 | |
*** tphummel has quit IRC | 23:25 | |
arosen12 | Hi, I'm wondering why I'm getting this error: Job gate-vmware-nsx-python35-nv not defined here: https://review.openstack.org/#/c/338402/1 ? Would someone mind pointing out what I'm missing? | 23:25 |
*** asselin__ has quit IRC | 23:26 | |
arosen12 | It seems like gate-networking-ovn-python35-nv is defined the same way. | 23:26 |
clarkb | jeblair: ok so its the hostname, which Ican map to a label type | 23:26 |
jeblair | clarkb: yeah, i think it's intended to be the node name | 23:27 |
clarkb | arosen12: you have to define it in jenkins/jobs/projects.yaml should be plenty of examples there if you grep for 35-nv | 23:27 |
*** roxanagh_ has quit IRC | 23:27 | |
jeblair | clarkb: as in, i think it's this value: | 23:27 |
jeblair | def assignViaGearman(self): | 23:27 |
jeblair | args = dict(name=self.node.nodename, | 23:27 |
*** thorst_ has quit IRC | 23:28 | |
clarkb | jeblair: oh good that value is all nodepoo lmanaged so should be 1:1 in all the places we pass it around | 23:28 |
arosen12 | clarkb: ah i see. Thanks. | 23:29 |
jeblair | clarkb: left a suggestion on the change | 23:29 |
openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Add non voting python34/35 checks for vmware-nsx https://review.openstack.org/338402 | 23:29 |
clarkb | jeblair: good point | 23:30 |
jeblair | clarkb: i double checked zuul-launcher -- that is the value that's passed down and used as the gearman worker name, so we should be gtg | 23:30 |
openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Update gitignore .swp -> .sw? https://review.openstack.org/338602 | 23:31 |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add job configuration for unit testing against neutron-lib source https://review.openstack.org/338603 | 23:31 |
clarkb | jeblair: I need to map ubuntu-xenial-rax-dfw-2296650 to ubuntu-xenial though right? | 23:31 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 23:31 |
clarkb | jeblair: and actually record foo-job: ubuntu-xenial | 23:31 |
pabelanger | fungi: stevebaker: We do have some images mirrored to AFS: http://mirror.dfw.rax.openstack.org/centos/7/os/x86_64/ I am not sure if that works for you | 23:31 |
pabelanger | fungi: stevebaker: otherwise, I am sure we add things to our rsync mirror script if needed | 23:32 |
jhesketh | clarkb: I don't think your nodepool change is correct... I've lfet a comment | 23:32 |
clarkb | jhesketh: ya thats what we were just dicsussing | 23:33 |
docaedo | Are any of the infra servers using a swift store for anything? We're going to need swift in the not distant future for the app catalog... | 23:33 |
clarkb | jhesketh: and what my todo comment is for | 23:33 |
jhesketh | ah, sorry | 23:33 |
jeblair | clarkb, jhesketh: yep, sorry i glossed over that. | 23:33 |
*** PollyZ has quit IRC | 23:33 | |
clarkb | jhesketh: np glad that people are catching the issues :) | 23:34 |
jhesketh | so I'm not sure if geard knows anything about a noode type... it can map a job to a node, but that's the individual node... further that individual node is a zuul-launcher so depending on which slaves zuul-launcher has connected it could be managing multiple node types | 23:34 |
jeblair | so it will need a db connection so it can query each of the nodes to find out its type. alternatively, it could be ugly and parse the name. | 23:34 |
clarkb | jeblair: I think I can also drop the unspecified handling entirely | 23:35 |
clarkb | since everythin will be either directly specified or infered | 23:35 |
clarkb | jhesketh: ^ | 23:35 |
jeblair | jhesketh: zuul-launcher behaves like jenkins gearman plugin in that it has a connection per attached node -- the gearman identifier used by that connection is the nodepool node name | 23:36 |
*** pt_15 has quit IRC | 23:36 | |
jhesketh | jeblair: ah, of course | 23:36 |
*** adrian_otto has quit IRC | 23:36 | |
stevebaker | pabelanger: ok, thanks. Looks like we could add some qcow images to the rsync if what I'm doing works out | 23:36 |
jeblair | clarkb: i think so too | 23:36 |
*** rfolco_ has joined #openstack-infra | 23:36 | |
jhesketh | jeblair: that'll still require parsing the node name most likely | 23:36 |
pabelanger | stevebaker: yup, shouldn't be to hard to do just that | 23:37 |
jhesketh | or now I see what you mean by querying the db | 23:37 |
jeblair | jhesketh: the *right* way would be to do a db lookup by node name to get the node record which also has the image type for the node | 23:37 |
*** karthikp_ has quit IRC | 23:37 | |
jhesketh | that doesn't seem too bad surely? | 23:37 |
jhesketh | or difficult etc | 23:37 |
jeblair | jhesketh: no... the thing i'm worried about is whether we would have lock contention... | 23:38 |
jeblair | we might be okay though | 23:38 |
jhesketh | what would the contention be on? | 23:39 |
jeblair | (i mean, it's read only, so it's no worse than issuing a 'nodepool list', which usually succeeds) | 23:39 |
jeblair | jhesketh: probably nothing, now that i've talked myself through that :) | 23:39 |
jhesketh | :-) | 23:39 |
jeblair | so yeah, i lean toward that and against parsing the field :) | 23:40 |
*** itisha has quit IRC | 23:40 | |
*** binbincong has quit IRC | 23:41 | |
fungi | docaedo: technically gerrit does. we have a script in jeepyb that updates an rss feed of reviews for some projects and publishes it to a swift container (no idea if it still works or if anyone uses it). however for the app store case i think puppet can just be made to put some swift credentials in a file on disk and the app store backend could just know to use those? we'd create the container by hand | 23:41 |
*** binbincong has joined #openstack-infra | 23:41 | |
fungi | and put the dedicated account for it in hiera so puppet would have it | 23:41 |
*** Julien-zte has quit IRC | 23:41 | |
openstackgerrit | Matt Mulsow proposed openstack-infra/glean: Added support for setting bond-lacp-rate and bond-xmit_hash_policy https://review.openstack.org/338607 | 23:42 |
*** sdake has quit IRC | 23:43 | |
docaedo | fungi: sounds like a good plan - part of using glare for the backend will require it to have a place to put the binaries | 23:43 |
docaedo | fungi: and just dumping them on disk of that VM would not be smart, but it handles access to swift nicely and because of the magic of replication and so on, that seems a better choice | 23:44 |
fungi | docaedo: cool, so presumably we make the glare config an erb template with variable expansion for the swift details/creds | 23:44 |
fungi | docaedo: or... how do you configure glare to access swift if not in a config file? | 23:45 |
docaedo | fungi: it would be a config file that puppet would handle, so we are on the same page | 23:45 |
docaedo | fungi: we'll also need a database, but I hear that's pretty easy and it'll just be a trove thing, so we'll coordinate those creds as well | 23:45 |
fungi | yeah, that's what i meant by "put some swift credentials in a file on disk" | 23:45 |
fungi | and yes, we can trove that | 23:46 |
docaedo | fungi: I'm vaguely hopeful that this will not be terribly difficult to add the the server, and I'll be doing it all through an update to the puppet-apps_site repo | 23:46 |
fungi | docaedo: well, all except for a minor patch to system-config to plumb the hiera bits through | 23:47 |
fungi | just a few lines added to manifests/site.pp there | 23:47 |
docaedo | fungi: ah yes - don't worry I'll be pestering you fine folks for feedback and details pretty soon | 23:48 |
fungi | we're here! | 23:48 |
docaedo | thank goodness for that! | 23:48 |
openstackgerrit | Merged openstack/diskimage-builder: Make ubuntu-core support releases https://review.openstack.org/294149 | 23:49 |
jeblair | doesn't ubuntu already support their releases? for a few years anyway? | 23:49 |
* jeblair likes the idea of landing patches that make people support things | 23:50 | |
fungi | i support that | 23:51 |
cinerama | hee hee | 23:51 |
openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Infer node demand from workers listing https://review.openstack.org/338598 | 23:52 |
clarkb | jeblair: jhesketh ^ I think that is much much closer now | 23:52 |
clarkb | jeblair: jhesketh still cimpletely untested but I got so much good feedback I figured I would push early :) | 23:52 |
*** roxanagh_ has joined #openstack-infra | 23:54 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 23:55 |
*** xarses has quit IRC | 23:56 | |
clarkb | jeblair: jhesketh but also its getting late in the date and I just had 3 trees get trimmed so should get utside and see what they did (protip fruit trees are apparently terribleness) | 23:57 |
jeblair | clarkb: i just planted 3! (or 13 depending on how you count). what kind? | 23:58 |
fungi | we have fig trees. not too terrible | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!