| mordred | fungi: that said- bug reports with reproduction cases would be nice | 00:00 |
|---|---|---|
| *** netsin has joined #openstack-infra | 00:00 | |
| fungi | yep, i'm prompting them now | 00:00 |
| mordred | fungi: I just tried adding the tag "1.7.elephant" into the history of one of my repos | 00:00 |
| mordred | and pbr worked fine | 00:00 |
| mordred | fungi: I also tried putting that tag on the tip commit - so in the history but after the latest tag | 00:01 |
| mordred | fungi: also fine | 00:01 |
| clarkb | we stopped running largeops jobs right? | 00:01 |
| clarkb | and said epople should use rally instead? | 00:01 |
| *** Rockyg has quit IRC | 00:02 | |
| masayukig_ | fungi: Thanks for your information about the coverage thing! rbradfor: do you have any plan or progress for a dashboard solution for coverage trending across and within projects? | 00:02 |
| *** masayukig_ is now known as masayukig | 00:03 | |
| clarkb | yup found the change | 00:03 |
| StevenK | fungi: pbr 1.8 and earlier ignores non-semver tags, pbr 1.9 should work fine with them, since I fixed it | 00:03 |
| *** amotoki has quit IRC | 00:03 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/irc-meetings: TESTING https://review.openstack.org/305530 | 00:03 |
| *** ddieterly[away] is now known as ddieterly | 00:04 | |
| jlvillal | tonyb: ^^ Patch depending on the change, to see if it fixes issue | 00:04 |
| fungi | mordred: yeah, i'm trying to get some more details on what the actual situation is with it | 00:04 |
| Nakato | mordred: fungi: I'll take a look, but yea, details on reproduction would be great. | 00:05 |
| bkero | zaro: ping. I did sprint triage for jjb, got the story count down to below 50. At this point someone more familiar with the project should handle the rest. | 00:05 |
| bkero | I hear you're familiar with it. :) | 00:06 |
| *** _amrith_ is now known as amrith | 00:06 | |
| *** baoli has quit IRC | 00:06 | |
| zaro | bkero: ugh, i completely forgot about the sprint. thanks for doing that. anyways, at this point i think zxiiro or waynr might know more than I. | 00:08 |
| bkero | zaro: I just heard that about you ;) | 00:08 |
| bkero | zxiiro, waynr: ^ | 00:08 |
| lifeless | fungi: mordred: its meant to ignore tags it can't parse | 00:10 |
| *** rfolco__ has joined #openstack-infra | 00:10 | |
| tonyb | jlvillal: Depends-On doesn't work for uaml2ical / irc-meetings | 00:10 |
| jlvillal | tonyb: Yeah, I figured that out just now :( | 00:11 |
| *** tosky__ has quit IRC | 00:11 | |
| tonyb | jlvillal: so local testing is the only test :( | 00:11 |
| lifeless | fungi: mordred: someone put a patch up to mangle the parser, but I don't recall a bug report, backtrace etc. I -1'd because we're meant to already handle such things | 00:11 |
| *** flwang1 has quit IRC | 00:12 | |
| *** achanda has joined #openstack-infra | 00:12 | |
| *** fawadkhaliq has joined #openstack-infra | 00:13 | |
| *** Qiming has quit IRC | 00:14 | |
| *** ybathia has quit IRC | 00:14 | |
| zaro | clarkb: just updated https://storyboard.openstack.org/#!/story/1397481 | 00:15 |
| Nakato | Ah, that projects gate is indeed wedged. http://logs.openstack.org/59/305159/1/check/gate-networking-midonet-docs/9608ab6/console.html#_2016-04-13_16_06_49_325 | 00:16 |
| fungi | lifeless: this is apparently a regression between 1.8.1 and 1.9.0, trying to get him to let me at least know the commit he bisected to when he gets done pinning pbr all over his openstack cd regression suite | 00:16 |
| *** amrith is now known as _amrith_ | 00:16 | |
| *** thorst has joined #openstack-infra | 00:16 | |
| fungi | mordred: Nakato: ^ | 00:16 |
| *** stewie925 has joined #openstack-infra | 00:17 | |
| *** achanda has quit IRC | 00:17 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document how mirrors are contstructed in AFS https://review.openstack.org/305539 | 00:18 |
| jeblair | clarkb, mordred, nibalizer, pabelanger: ^ i think that covers all the things we've learned and been doing recently | 00:19 |
| morgan | mordred: ping - back now still need me to dig into the weird error? | 00:19 |
| jlvillal | tonyb: For what it is worth. I tested it locally and it worked :) | 00:20 |
| tonyb | jlvillal: :) I'll also test it locally when these meetings stop ;P | 00:20 |
| lifeless | fungi: I guess | 00:21 |
| jlvillal | tonyb: http://blog.sodarock.com/calendar/ Here is output I get | 00:21 |
| jlvillal | I see Zaqar | 00:21 |
| lifeless | fungi: I don't really care about bisected commits - just a test case is much more useful | 00:21 |
| tonyb | jlvillal: LGTM | 00:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/zmq-event-publisher: Add node description to event data https://review.openstack.org/301237 | 00:22 |
| fungi | lifeless: agreed. getting what info i can. seems to be a regression stemming from https://review.openstack.org/263748 "Split changelog on nulls instead of (refs" | 00:22 |
| fungi | s/refs// | 00:22 |
| *** mtanino has quit IRC | 00:23 | |
| lifeless | fungi: well, thats mordred's fault, StevenK was worried that he'd broken it | 00:24 |
| *** jaypipes has quit IRC | 00:24 | |
| fungi | hah | 00:25 |
| *** hongbin has joined #openstack-infra | 00:25 | |
| jeblair | that change explicitly tests non-semver tags | 00:25 |
| fungi | i've gotten an example traceback and am starting a bug report. he's not narrowed it down to what tag is tickling it yet | 00:25 |
| hongbin | Hi folks. Could I ask for reviews for this patch: https://review.openstack.org/#/c/305475/ (Magnum needs it to fix the gate) | 00:26 |
| clarkb | wow gerrit is broken on firefox mobile | 00:29 |
| *** dalgaaf has quit IRC | 00:29 | |
| clarkb | hongbin: you will need to include neutron-lbaas in the projects list too I think | 00:29 |
| hongbin | clarkb: I see. Looking into it | 00:30 |
| *** Jeffrey4l__ has quit IRC | 00:30 | |
| *** sshnaidm has joined #openstack-infra | 00:30 | |
| *** roxanaghe has quit IRC | 00:31 | |
| *** mylu has quit IRC | 00:32 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Magnum: switch to neutron-lbaas devstack plugin https://review.openstack.org/305475 | 00:33 |
| hongbin | clarkb: thanks. done | 00:33 |
| *** mylu has joined #openstack-infra | 00:33 | |
| *** tiswanso has quit IRC | 00:35 | |
| *** erlon has quit IRC | 00:35 | |
| *** tiswanso has joined #openstack-infra | 00:35 | |
| fungi | mordred: Nakato: lifeless: StevenK: the bug report is started at https://launchpad.net/bugs/1570145 now. he doesn't know what tags are triggering it yet (their repos are full of all manner of crazy garbage tags it sounds like) so i think he's planning to try appending suspect patterns to pbr's parsing tests and see what he can narrow it down to | 00:37 |
| openstack | Launchpad bug 1570145 in PBR ""IndexError: string index out of range" in version.from_pip_string" [Undecided,New] | 00:37 |
| lifeless | fungi: thats not actually a useful thing to do | 00:38 |
| lifeless | fungi: the parser is not meant to cope with crap | 00:38 |
| lifeless | fungi: code that calls the parser is meant to catch failures, if its from a context where catching a failure makes sense | 00:39 |
| *** lakshmiS has quit IRC | 00:39 | |
| jlvillal | flwang: This https://review.openstack.org/305528 seems to fix the issue you were seeing. My test here: http://blog.sodarock.com/calendar/ | 00:40 |
| lifeless | fungi: commented on the bug | 00:40 |
| lifeless | fungi: with a suggestion | 00:40 |
| *** sputnik13 has quit IRC | 00:40 | |
| *** vilobhmm111 has quit IRC | 00:41 | |
| *** Goneri has joined #openstack-infra | 00:41 | |
| fungi | he's narrowed it down to a tag of 1_foo.1 reproducing this | 00:42 |
| fungi | he's updating the bug now | 00:42 |
| *** Goneri has quit IRC | 00:43 | |
| *** tonyb has quit IRC | 00:44 | |
| *** salv-orlando has joined #openstack-infra | 00:44 | |
| *** tonyb has joined #openstack-infra | 00:44 | |
| *** Sukhdev has joined #openstack-infra | 00:48 | |
| *** Goneri has joined #openstack-infra | 00:49 | |
| *** salv-orlando has quit IRC | 00:49 | |
| *** Goneri has quit IRC | 00:49 | |
| fungi | i think i've convinced him to submit the fix to gerrit | 00:50 |
| *** gyee has quit IRC | 00:59 | |
| *** FallenPegasus has quit IRC | 01:00 | |
| *** zhurong has joined #openstack-infra | 01:00 | |
| *** stewie925 has quit IRC | 01:02 | |
| *** rossella_s has quit IRC | 01:03 | |
| *** ajmiller_ has quit IRC | 01:05 | |
| *** rossella_s has joined #openstack-infra | 01:05 | |
| openstackgerrit | Merged openstack-infra/shade: Honor default_network for interface_ip https://review.openstack.org/304569 | 01:07 |
| openstackgerrit | Merged openstack-infra/shade: Consume floating_ip_source config value https://review.openstack.org/304577 | 01:07 |
| *** shashank_hegde has quit IRC | 01:07 | |
| *** Sukhdev has quit IRC | 01:09 | |
| *** tphummel has quit IRC | 01:11 | |
| *** bpokorny has quit IRC | 01:11 | |
| *** Rajen has joined #openstack-infra | 01:12 | |
| Rajen | hi, all I want to consult a openstack-ci question about nodepool. i set up a openstack-ci env, using common community method, after ci-master accomplished and then starting ci-slave node, the ci-slave vm cann't get the floating ip. nodepool.yaml is setting up like: (a snippet in providers section) networks: -name:admin_floating_net public:true. is there any problems for the configure in the above "networks" section? | 01:13 |
| *** zz_dimtruck is now known as dimtruck | 01:13 | |
| *** achanda has joined #openstack-infra | 01:13 | |
| clarkb | Rajen: are there errors in your nodepool logs? | 01:14 |
| *** tphummel has joined #openstack-infra | 01:15 | |
| *** FallenPegasus has joined #openstack-infra | 01:15 | |
| Rajen | in nodepool logs, it circulates to create and delete ci-slave vm | 01:16 |
| Rajen | clarkb: in nodepool logs, it circulates to create and delete ci-slave vm | 01:16 |
| *** pvaneck_ has quit IRC | 01:17 | |
| clarkb | ya but there should be some traceback and error associated with the reason for that | 01:17 |
| *** asettle has quit IRC | 01:18 | |
| Rajen | clarkb: logs: OpenStackCloudException: ('Error in creating the server: No valid host was found. There are not enough hosts available.', ... | 01:19 |
| *** achanda has quit IRC | 01:19 | |
| clarkb | ok I think that means it isnt floating ip related and instead your cloud is telling nodepool it cant boot instances | 01:19 |
| Rajen | it's meaning, my nodepool.yaml configure is error? | 01:21 |
| *** mtanino has joined #openstack-infra | 01:22 | |
| flwang | jlvillal: coool, thanks | 01:22 |
| *** mylu has quit IRC | 01:22 | |
| clarkb | Rajen: no that implies the cloud you are talking to is unhappy. it cannot launch VMs | 01:22 |
| *** fitoduarte has quit IRC | 01:24 | |
| *** mylu has joined #openstack-infra | 01:24 | |
| Rajen | so could you give me some guide to solve the problem? for this problem, i have no idea, thank you very much :) | 01:25 |
| openstackgerrit | Randall Nortman proposed openstack-dev/pbr: Handle IndexError during version string parsing https://review.openstack.org/305550 | 01:26 |
| *** jamesmcarthur has joined #openstack-infra | 01:26 | |
| Rajen | does the reason is there is some errors in my openstack cloud? | 01:27 |
| clarkb | yes | 01:27 |
| Rajen | ok, thank you, i will check the cloud :) | 01:28 |
| *** flwang1 has joined #openstack-infra | 01:29 | |
| *** asettle has joined #openstack-infra | 01:30 | |
| *** HeOS__ has quit IRC | 01:32 | |
| *** HeOS_ has joined #openstack-infra | 01:33 | |
| *** jamesmcarthur has quit IRC | 01:36 | |
| Rajen | clarkb: hi :) now, there is another error when creating ci-slave | 01:39 |
| Rajen | the ci-slave cant get the floating ip | 01:39 |
| *** Qiming has joined #openstack-infra | 01:39 | |
| Rajen | nodepool logs:　Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/nodepool/nodeutils.py", line 55, in ssh_connect client = SSHClient(ip, username, **connect_kwargs) File "/usr/local/lib/python2.7/dist-packages/nodepool/sshclient.py", line 30, in __init__ key_filename=key_filename) File "/usr/local/lib/python2.7/dist-packages/paramiko/client.py", line 292, in connect retry_on_s | 01:39 |
| Rajen | logs: error: [Errno 110] Connection timed out | 01:40 |
| clarkb | that is saying ssh failed, check your security groups to make sure ssh is allowed | 01:40 |
| clarkb | it uses tcp port 22 | 01:40 |
| *** sridhar_ram has quit IRC | 01:41 | |
| Rajen | ok, thank you, i try it :) | 01:41 |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Allow maintaining extras from project https://review.openstack.org/303271 | 01:43 |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Update requirements ordering https://review.openstack.org/305552 | 01:43 |
| ianw | clarkb: you know how we were talking about how you could split up all the languages into packages, well -> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/message/K56XYH5AK4SBFQD36IFS2KDWUN2NY44E/ | 01:44 |
| *** jcoufal_ has quit IRC | 01:44 | |
| clarkb | awesome | 01:45 |
| ianw | sort of, we still have to clean it out manually for centos7 & f23 ... so we'll have a branch in there when we get to f24 | 01:46 |
| openstackgerrit | Tan Lin proposed openstack/requirements: Bump ironic-lib to 1.3.0 https://review.openstack.org/305553 | 01:46 |
| *** vilobhmm11 has joined #openstack-infra | 01:46 | |
| *** jcoufal has joined #openstack-infra | 01:46 | |
| *** flwang1 has quit IRC | 01:47 | |
| clarkb | ya but it is progress | 01:47 |
| *** thorst has quit IRC | 01:50 | |
| *** yamahata has quit IRC | 01:50 | |
| *** thorst has joined #openstack-infra | 01:50 | |
| *** hongbin has quit IRC | 01:52 | |
| openstackgerrit | Randall Nortman proposed openstack-dev/pbr: Handle IndexError during version string parsing https://review.openstack.org/305550 | 01:52 |
| *** shashank_hegde has joined #openstack-infra | 01:53 | |
| *** tqtran has quit IRC | 01:53 | |
| *** akshai has joined #openstack-infra | 01:54 | |
| *** sdake has quit IRC | 01:55 | |
| *** flwang1 has joined #openstack-infra | 01:55 | |
| *** akshai_ has joined #openstack-infra | 01:55 | |
| *** sdake has joined #openstack-infra | 01:56 | |
| *** thorst has quit IRC | 01:58 | |
| *** akshai has quit IRC | 01:59 | |
| *** ajmiller has joined #openstack-infra | 01:59 | |
| *** amotoki has joined #openstack-infra | 01:59 | |
| *** kengo_sakai has joined #openstack-infra | 02:02 | |
| openstackgerrit | Yushiro FURUKAWA proposed openstack/os-testr: Fix coverage option and execution https://review.openstack.org/305559 | 02:02 |
| Rajen | clarkb: i have add ssh and all icmp rule to security group, but in logs, there is still "error: [Errno 110] Connection timed out". | 02:04 |
| *** amotoki has quit IRC | 02:04 | |
| clarkb | Rajen: my suggestion to you eould be to test ot manually | 02:04 |
| *** armax_ has joined #openstack-infra | 02:04 | |
| *** fedexo has joined #openstack-infra | 02:04 | |
| *** apoorvad has quit IRC | 02:05 | |
| Rajen | in my env, if the ci-master can ping to ci-slave, ci-slave must have a floating ip, but now the ci-slave cann't get floating ip. | 02:05 |
| *** tphummel has quit IRC | 02:05 | |
| Rajen | in my cloud, i create a vm manually, and it can be ssh to the vm | 02:06 |
| clarkb | the ip address used should be logged you can find out from the logs what is getting attached | 02:06 |
| *** masahito has joined #openstack-infra | 02:06 | |
| *** armax has quit IRC | 02:07 | |
| *** armax_ is now known as armax | 02:07 | |
| *** julim has joined #openstack-infra | 02:07 | |
| masahito | hi. | 02:07 |
| *** mkwiek has quit IRC | 02:07 | |
| masahito | I have a question about a release note. | 02:08 |
| *** mkwiek has joined #openstack-infra | 02:08 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive to en_* locales https://review.openstack.org/304399 | 02:08 |
| *** fawadkhaliq has quit IRC | 02:08 | |
| clarkb | masahito: ok | 02:08 |
| masahito | Congress team didn't write the release note for mitaka release. | 02:09 |
| masahito | http://releases.openstack.org/mitaka/index.html | 02:09 |
| *** tphummel has joined #openstack-infra | 02:09 | |
| masahito | so can I write up the release note after now? | 02:09 |
| Rajen | sorry, now the logs have no info about ip, only reminder: error: [Errno 110] Connection timed out | 02:10 |
| masahito | and how do we write the note? | 02:10 |
| clarkb | you can but they wont be published until the next release | 02:10 |
| clarkb | masahito: you write them using a tool called reno. I would check its docs | 02:10 |
| clarkb | Rajen: prior to that it should say node 1234 ip address x.y.z.a | 02:11 |
| masahito | clarkb: oh, I see. | 02:11 |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Magnum: switch to neutron-lbaas devstack plugin https://review.openstack.org/305475 | 02:11 |
| *** sdake has quit IRC | 02:12 | |
| masahito | clarkb: if possible, could you point me out the manual for reno? | 02:12 |
| Rajen | in nodepool.log, there is no info like: node 1234 ip address x.y.z.a | 02:12 |
| clarkb | http://docs.openstack.org/developer/reno/ | 02:12 |
| clarkb | Rajen: there should be, grep on the node id number | 02:12 |
| *** akshai_ has quit IRC | 02:13 | |
| Rajen | yes, it only show the node id, like: nodepool.NodePool: Deleted jenkins node id: 28247 2016-04-14 12:29:12,274 INFO nodepool.NodePool: Deleted node id: 28247 | 02:13 |
| clarkb | Rajen: before that | 02:13 |
| clarkb | there should be something like 10 lines logged per instance | 02:14 |
| clarkb | are you looking at the debug log? | 02:14 |
| Rajen | oh? i'm looking at nodepool.log | 02:15 |
| *** achanda has joined #openstack-infra | 02:15 | |
| clarkb | is there a debug.log? | 02:15 |
| Rajen | yes, but i grep it, there is also no info about ip address of node | 02:16 |
| *** baoli has joined #openstack-infra | 02:16 | |
| clarkb | can you show me the output of grep 28247 debug.log ? | 02:16 |
| masahito | clarkb: thanks! | 02:17 |
| *** darvon has quit IRC | 02:18 | |
| Rajen | 2016-04-14 12:25:02,166 DEBUG nodepool.NodeLauncher: Launching node id: 28247 2016-04-14 12:25:02,179 INFO nodepool.NodeLauncher: Creating server with hostname d-p-c-local_01-28247 in local_01 from image dpc for node id: 28247 2016-04-14 12:25:02,180 DEBUG nodepool.ProviderManager: Manager local_01 running task ServerCreate (queue: 0) 2016-04-14 12:25:02,936 DEBUG nodepool.ProviderManager: Manager local_01 ran task ServerCre | 02:19 |
| clarkb | Rajen: that was cut off, you should use a paste service like paste.openstack.org | 02:19 |
| clarkb | also preserve the newlines | 02:19 |
| *** achanda has quit IRC | 02:21 | |
| *** Kiall has quit IRC | 02:21 | |
| *** Kiall has joined #openstack-infra | 02:21 | |
| *** ddieterly is now known as ddieterly[away] | 02:22 | |
| *** ddieterly[away] has quit IRC | 02:23 | |
| *** larainema has quit IRC | 02:24 | |
| *** jamesmcarthur has joined #openstack-infra | 02:25 | |
| Rajen | clarkb: i save the debug.log and nodepool.log in github, please open it: https://github.com/JaniceLee567/JaniceBase/blob/master/debug.log | 02:28 |
| *** jamesmcarthur has quit IRC | 02:28 | |
| Rajen | https://github.com/JaniceLee567/JaniceBase/blob/master/nodepool.log | 02:28 |
| *** yamahata has joined #openstack-infra | 02:29 | |
| openstackgerrit | Merged openstack/requirements: Bump neutronclient to 4.2.0 https://review.openstack.org/304691 | 02:30 |
| clarkb | Rajen: grep for 28249 it tells you what the ip is | 02:30 |
| openstackgerrit | Merged openstack/requirements: Bump django-openstack-auth to 2.2.0 https://review.openstack.org/304361 | 02:30 |
| openstackgerrit | Merged openstack/requirements: bump aodhclient upper-constraints https://review.openstack.org/299054 | 02:31 |
| clarkb | 192.168.111.57 | 02:31 |
| *** jamesmcarthur has joined #openstack-infra | 02:31 | |
| clarkb | I do not know if that is a floating ip or not | 02:31 |
| Rajen | yes, in dashboard, i can see that the vm have got internal ip, but there is no floating ip | 02:32 |
| Rajen | the nodepool.yaml config is in https://github.com/JaniceLee567/JaniceBase/blob/master/nodepool.yaml | 02:33 |
| clarkb | is that IP a floating IP or no? | 02:33 |
| Rajen | 192.168.111.57 is a internal ip | 02:33 |
| Rajen | no a floating ip | 02:33 |
| clarkb | ok | 02:34 |
| clarkb | so admin_internal_net is nit public? | 02:35 |
| clarkb | I would remove the public: true from that if it isnt actually public | 02:35 |
| Rajen | yes | 02:35 |
| Rajen | like this: https://github.com/JaniceLee567/JaniceBase/blob/master/nodepool.yaml | 02:37 |
| Rajen | ? | 02:37 |
| clarkb | yes that should work | 02:37 |
| Nakato | lifeless: Re SemVer on PBR. What's expected of PBR when it finds build metadata? Such as '3.2.1+001'? And by extension, '3.2+001'? | 02:38 |
| *** fawadkhaliq has joined #openstack-infra | 02:38 | |
| *** salv-orlando has joined #openstack-infra | 02:40 | |
| *** edmondsw has quit IRC | 02:40 | |
| *** yamamoto_ has joined #openstack-infra | 02:42 | |
| *** jamesmcarthur has quit IRC | 02:43 | |
| *** salv-orlando has quit IRC | 02:44 | |
| *** flwang1 has quit IRC | 02:44 | |
| *** fawadkhaliq has quit IRC | 02:45 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 02:46 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add common bash functions to help track metrics. https://review.openstack.org/291392 | 02:46 |
| *** fawadkhaliq has joined #openstack-infra | 02:46 | |
| *** fawadkhaliq has quit IRC | 02:47 | |
| Rajen | clarkb: i try it, but it still can not get the floating ip | 02:48 |
| openstackgerrit | Yushiro FURUKAWA proposed openstack/os-testr: Fix coverage option and execution https://review.openstack.org/305559 | 02:48 |
| *** flwang1 has joined #openstack-infra | 02:49 | |
| clarkb | Rajen: I am not sure then, you have a pool configured and the internal net is no longer public | 02:49 |
| Rajen | ok, thank you, i will check if there is any other errors in the config or cloud :) | 02:51 |
| *** dkehn has quit IRC | 02:51 | |
| *** dkehn has joined #openstack-infra | 02:53 | |
| *** cody-somerville has quit IRC | 02:53 | |
| *** jamesmcarthur has joined #openstack-infra | 02:54 | |
| *** thorst has joined #openstack-infra | 02:56 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Magnum: switch to neutron-lbaas devstack plugin https://review.openstack.org/305475 | 02:59 |
| *** amotoki has joined #openstack-infra | 03:00 | |
| *** pcrews has quit IRC | 03:01 | |
| *** jamesmcarthur has quit IRC | 03:03 | |
| *** pcrews has joined #openstack-infra | 03:03 | |
| *** thorst has quit IRC | 03:03 | |
| *** amotoki has quit IRC | 03:05 | |
| *** cody-somerville has joined #openstack-infra | 03:07 | |
| *** asselin_ has joined #openstack-infra | 03:08 | |
| *** ramishra has joined #openstack-infra | 03:11 | |
| *** larainema has joined #openstack-infra | 03:14 | |
| *** FallenPegasus has quit IRC | 03:14 | |
| *** achanda has joined #openstack-infra | 03:17 | |
| *** FallenPegasus has joined #openstack-infra | 03:18 | |
| *** baoli has quit IRC | 03:19 | |
| *** yamamoto_ has quit IRC | 03:20 | |
| *** achanda has quit IRC | 03:22 | |
| *** zhurong has quit IRC | 03:24 | |
| *** fedexo has quit IRC | 03:24 | |
| *** tphummel has quit IRC | 03:24 | |
| *** zhurong has joined #openstack-infra | 03:25 | |
| *** masahito has quit IRC | 03:25 | |
| openstackgerrit | Sachi King proposed openstack-dev/pbr: Update Preversioning explanation to avoid double that https://review.openstack.org/305595 | 03:27 |
| *** rfolco__ has quit IRC | 03:33 | |
| *** ajmiller has quit IRC | 03:33 | |
| *** gildub has joined #openstack-infra | 03:33 | |
| *** sflanigan has quit IRC | 03:33 | |
| *** rfolco__ has joined #openstack-infra | 03:36 | |
| *** rfolco__ has quit IRC | 03:36 | |
| *** mylu has quit IRC | 03:39 | |
| *** tiswanso has quit IRC | 03:39 | |
| *** flepied has joined #openstack-infra | 03:40 | |
| *** nelsnels_ has joined #openstack-infra | 03:44 | |
| *** nelsnelson has quit IRC | 03:46 | |
| lifeless | Nakato: we don't handle that today IIRC | 03:49 |
| Nakato | lifeless: Yea, just found https://bugs.launchpad.net/pbr/+bug/1452515 | 03:50 |
| openstack | Launchpad bug 1452515 in PBR "PEP-440 local versions not accepted" [Wishlist,Triaged] - Assigned to Greg Hellings (greg-hellings) | 03:50 |
| lifeless | Nakato: but, there's a quirk, because an older pbr did a hack in that area, and then the PEP happened, and then we had to mangle stuff | 03:50 |
| *** maishsk has quit IRC | 03:50 | |
| lifeless | Nakato: all that said - I'm keen for us to support it, but per the bug - AFAICT we only have one shot to integrate with the nova local version stuff | 03:51 |
| *** dimtruck is now known as zz_dimtruck | 03:52 | |
| *** claudiub has joined #openstack-infra | 03:53 | |
| Nakato | lifeless: What would support look like in PBR for that? I'd be keen to write something up to start fixing that, as it seems that we might be doing the wrong thing when we see the +. The bug earlier was somewhat related it seems. | 03:55 |
| lifeless | Nakato: ish | 03:56 |
| lifeless | Nakato: corner case in bad-version handling - a thrown IndexError was bubbling up but the contract of the fn is for ValueError | 03:56 |
| lifeless | Nakato: there's a pbr patch to +2A on it | 03:57 |
| *** nelsnelson has joined #openstack-infra | 03:58 | |
| Nakato | lifeless: gcb grabbed the +2A. It's on the way in. | 03:58 |
| lifeless | cool | 03:59 |
| Nakato | As soon as it lands, I'll push up 1.9.1 request to openstack/releases | 03:59 |
| lifeless | excellent | 03:59 |
| *** nelsnels_ has quit IRC | 04:00 | |
| lifeless | Nakato: anyhow - look at nova/version.py in the nova tree | 04:00 |
| lifeless | Nakato: version_string_with_package | 04:00 |
| lifeless | Nakato: AIUI if you unpack e.g. the Ubuntu deb's for Nova and look at the supplied config file | 04:00 |
| lifeless | Nakato: you'll file a package_string() set | 04:00 |
| *** shashank_hegde has quit IRC | 04:01 | |
| lifeless | Nakato: minimally it seems to me we need to decide if package_string should <=> a local build identifier | 04:01 |
| lifeless | Nakato: (which, with the constraint against pypi publication seems fine) | 04:01 |
| lifeless | Nakato: or whether they are separate | 04:02 |
| lifeless | Nakato: a broader spec might look at offering all three of the relevant fields via .dist-info metadata | 04:02 |
| *** achanda has joined #openstack-infra | 04:02 | |
| *** thorst has joined #openstack-infra | 04:02 | |
| *** achanda_ has joined #openstack-infra | 04:05 | |
| *** achanda has quit IRC | 04:06 | |
| *** mylu has joined #openstack-infra | 04:07 | |
| *** thorst has quit IRC | 04:09 | |
| waynr | bkero: link me up scotty | 04:16 |
| *** yamamoto_ has joined #openstack-infra | 04:18 | |
| *** asettle has quit IRC | 04:19 | |
| *** achanda_ has quit IRC | 04:22 | |
| openstackgerrit | Merged openstack-dev/pbr: Handle IndexError during version string parsing https://review.openstack.org/305550 | 04:24 |
| Nakato | lifeless: Release is up: https://review.openstack.org/#/c/305604/ | 04:27 |
| lifeless | \o/ | 04:27 |
| *** jswarren_ has joined #openstack-infra | 04:28 | |
| *** watersoul_ has joined #openstack-infra | 04:28 | |
| *** bdemers_ has joined #openstack-infra | 04:29 | |
| *** claudiub|2 has joined #openstack-infra | 04:29 | |
| *** Qiming_ has joined #openstack-infra | 04:29 | |
| *** ramishra_ has joined #openstack-infra | 04:29 | |
| *** NikitaKonovalov2 has joined #openstack-infra | 04:30 | |
| *** ruhe2 has joined #openstack-infra | 04:30 | |
| *** timburke has quit IRC | 04:30 | |
| *** ruhe has quit IRC | 04:30 | |
| *** NikitaKonovalov has quit IRC | 04:30 | |
| *** armax has quit IRC | 04:30 | |
| *** pabelanger has quit IRC | 04:30 | |
| *** masayukig has quit IRC | 04:30 | |
| *** stevebaker has quit IRC | 04:30 | |
| *** ruhe2 is now known as ruhe | 04:30 | |
| *** NikitaKonovalov2 is now known as NikitaKonovalov | 04:31 | |
| *** watersoul has quit IRC | 04:31 | |
| *** rvba has quit IRC | 04:31 | |
| *** ggillies has quit IRC | 04:31 | |
| *** antonym has quit IRC | 04:31 | |
| *** waynr has quit IRC | 04:31 | |
| *** j_king has quit IRC | 04:31 | |
| *** timfreund has quit IRC | 04:31 | |
| *** dougshelley66 has quit IRC | 04:31 | |
| *** SamYaple has quit IRC | 04:31 | |
| *** SamYaple has joined #openstack-infra | 04:31 | |
| *** markmcd1 has joined #openstack-infra | 04:31 | |
| *** armax has joined #openstack-infra | 04:31 | |
| *** rvba has joined #openstack-infra | 04:31 | |
| *** ggillies has joined #openstack-infra | 04:31 | |
| *** rvba has quit IRC | 04:31 | |
| *** rvba has joined #openstack-infra | 04:31 | |
| *** ansiwen_ has joined #openstack-infra | 04:31 | |
| *** claudiub has quit IRC | 04:32 | |
| *** zhurong has quit IRC | 04:32 | |
| *** ramishra has quit IRC | 04:32 | |
| *** Qiming has quit IRC | 04:32 | |
| *** bdemers has quit IRC | 04:32 | |
| *** cfarquhar has quit IRC | 04:32 | |
| *** arif-ali has quit IRC | 04:32 | |
| *** markmcd has quit IRC | 04:32 | |
| *** jlvillal has quit IRC | 04:32 | |
| *** jswarren has quit IRC | 04:32 | |
| *** ansiwen has quit IRC | 04:32 | |
| *** masayukig has joined #openstack-infra | 04:32 | |
| *** timfreund has joined #openstack-infra | 04:32 | |
| *** j_king has joined #openstack-infra | 04:32 | |
| *** jlvillal has joined #openstack-infra | 04:32 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-dev/pbr: Make from_pip_string a little more robust https://review.openstack.org/305080 | 04:32 |
| *** dougshelley66 has joined #openstack-infra | 04:32 | |
| *** stevebaker has joined #openstack-infra | 04:32 | |
| *** Kiall has quit IRC | 04:32 | |
| *** antonym has joined #openstack-infra | 04:32 | |
| *** arif-ali has joined #openstack-infra | 04:33 | |
| *** zhurong has joined #openstack-infra | 04:33 | |
| *** timburke has joined #openstack-infra | 04:34 | |
| *** cfarquhar has joined #openstack-infra | 04:34 | |
| *** cfarquhar has quit IRC | 04:34 | |
| *** cfarquhar has joined #openstack-infra | 04:34 | |
| *** pabelanger has joined #openstack-infra | 04:34 | |
| *** waynr has joined #openstack-infra | 04:35 | |
| *** flepied has quit IRC | 04:36 | |
| *** Kiall has joined #openstack-infra | 04:36 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-dev/pbr: Make from_pip_string a little more robust https://review.openstack.org/305080 | 04:37 |
| *** amotoki has joined #openstack-infra | 04:39 | |
| *** fawadkhaliq has joined #openstack-infra | 04:42 | |
| *** shashank_hegde has joined #openstack-infra | 04:43 | |
| *** maishsk has joined #openstack-infra | 04:48 | |
| *** maishsk has quit IRC | 04:49 | |
| *** rcernin has joined #openstack-infra | 04:50 | |
| *** denisra has joined #openstack-infra | 04:52 | |
| *** achanda has joined #openstack-infra | 04:53 | |
| *** shashank_hegde has quit IRC | 04:53 | |
| *** migi has quit IRC | 04:54 | |
| *** denisra_ has quit IRC | 04:54 | |
| *** migi has joined #openstack-infra | 04:54 | |
| *** mylu has quit IRC | 04:56 | |
| *** Rajen has quit IRC | 04:58 | |
| *** johnsom_ has joined #openstack-infra | 05:00 | |
| *** flwang1 has quit IRC | 05:01 | |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Allow maintaining extras from project https://review.openstack.org/303271 | 05:01 |
| *** johnsom has quit IRC | 05:01 | |
| *** markvoelker has quit IRC | 05:06 | |
| *** thorst has joined #openstack-infra | 05:06 | |
| *** salv-orlando has joined #openstack-infra | 05:11 | |
| *** roxanaghe has joined #openstack-infra | 05:12 | |
| *** flepied has joined #openstack-infra | 05:12 | |
| *** roxanaghe has quit IRC | 05:12 | |
| *** roxanaghe has joined #openstack-infra | 05:13 | |
| *** thorst has quit IRC | 05:14 | |
| *** abregman has joined #openstack-infra | 05:16 | |
| openstackgerrit | Merged openstack-infra/project-config: update tag ACLs for all official projects https://review.openstack.org/298866 | 05:18 |
| *** oanson has joined #openstack-infra | 05:19 | |
| *** zhurong has quit IRC | 05:20 | |
| *** jaosorior has joined #openstack-infra | 05:20 | |
| *** zhurong has joined #openstack-infra | 05:21 | |
| *** roxanagh_ has joined #openstack-infra | 05:22 | |
| *** roxanaghe has quit IRC | 05:24 | |
| *** maishsk has joined #openstack-infra | 05:24 | |
| *** claudiub|2 has quit IRC | 05:26 | |
| *** roxanagh_ has quit IRC | 05:26 | |
| *** asettle has joined #openstack-infra | 05:29 | |
| *** asettle has quit IRC | 05:29 | |
| *** asettle has joined #openstack-infra | 05:29 | |
| *** pcrews has quit IRC | 05:31 | |
| *** achanda has quit IRC | 05:31 | |
| *** pcrews has joined #openstack-infra | 05:31 | |
| *** maishsk_ has joined #openstack-infra | 05:34 | |
| *** shashank_hegde has joined #openstack-infra | 05:35 | |
| *** maishsk has quit IRC | 05:35 | |
| *** maishsk_ is now known as maishsk | 05:35 | |
| *** johnsom_ is now known as johnsom | 05:37 | |
| *** hdd has joined #openstack-infra | 05:38 | |
| *** maishsk_ has joined #openstack-infra | 05:40 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Run the additional-pkg-repos devstack-plugin as self-test https://review.openstack.org/304968 | 05:42 |
| *** maishsk has quit IRC | 05:43 | |
| *** maishsk_ is now known as maishsk | 05:43 | |
| *** sflanigan has joined #openstack-infra | 05:47 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Change Tap as a service meeting time https://review.openstack.org/304383 | 05:49 |
| *** hdd has quit IRC | 05:56 | |
| *** denisra_ has joined #openstack-infra | 05:58 | |
| *** kshort_away has joined #openstack-infra | 06:00 | |
| *** markvoelker has joined #openstack-infra | 06:00 | |
| *** dims_ has joined #openstack-infra | 06:00 | |
| *** hdd has joined #openstack-infra | 06:00 | |
| *** phschwartz_ has joined #openstack-infra | 06:02 | |
| *** furlongm has joined #openstack-infra | 06:02 | |
| *** mikelk has joined #openstack-infra | 06:02 | |
| *** darrenc_ has joined #openstack-infra | 06:03 | |
| *** rossella_ has joined #openstack-infra | 06:03 | |
| *** davidlenwell has joined #openstack-infra | 06:03 | |
| *** bradm_ has joined #openstack-infra | 06:03 | |
| *** [HeOS] has joined #openstack-infra | 06:03 | |
| *** sigmavirus24b has joined #openstack-infra | 06:04 | |
| *** achanda has joined #openstack-infra | 06:04 | |
| *** Kiall_ has joined #openstack-infra | 06:04 | |
| *** tobiash_ has joined #openstack-infra | 06:04 | |
| *** tristanC_ has joined #openstack-infra | 06:04 | |
| *** khappone has joined #openstack-infra | 06:04 | |
| *** sheeprine_ has joined #openstack-infra | 06:04 | |
| *** onovy_ has joined #openstack-infra | 06:05 | |
| *** roaet_ has joined #openstack-infra | 06:05 | |
| *** elmiko_ has joined #openstack-infra | 06:05 | |
| *** aviau_ has joined #openstack-infra | 06:05 | |
| *** mcarden_ has joined #openstack-infra | 06:05 | |
| *** craige_ has joined #openstack-infra | 06:05 | |
| *** alex_xu_ has joined #openstack-infra | 06:05 | |
| *** penguinolog__ has joined #openstack-infra | 06:06 | |
| *** markvoelker has quit IRC | 06:06 | |
| *** maishsk has quit IRC | 06:06 | |
| *** dimtruckl has joined #openstack-infra | 06:06 | |
| *** sileht_ has joined #openstack-infra | 06:06 | |
| *** dimtruckl is now known as dimtruck | 06:06 | |
| *** charz_ has joined #openstack-infra | 06:07 | |
| *** zeus- has joined #openstack-infra | 06:07 | |
| *** haleyb_ has joined #openstack-infra | 06:07 | |
| *** Nakato_ has joined #openstack-infra | 06:08 | |
| *** woodster_ has quit IRC | 06:08 | |
| *** eliqiao_ has joined #openstack-infra | 06:08 | |
| *** rvba` has joined #openstack-infra | 06:08 | |
| *** jlvillal_ has joined #openstack-infra | 06:08 | |
| *** lyz has joined #openstack-infra | 06:08 | |
| *** gsilvis_ has joined #openstack-infra | 06:08 | |
| *** denisra has quit IRC | 06:08 | |
| *** fawadkhaliq has quit IRC | 06:08 | |
| *** amotoki has quit IRC | 06:08 | |
| *** Kiall has quit IRC | 06:08 | |
| *** jlvillal has quit IRC | 06:08 | |
| *** j_king has quit IRC | 06:08 | |
| *** armax has quit IRC | 06:08 | |
| *** rvba has quit IRC | 06:08 | |
| *** rossella_s has quit IRC | 06:08 | |
| *** tonyb has quit IRC | 06:08 | |
| *** rakhmerov has quit IRC | 06:08 | |
| *** penguinolog has quit IRC | 06:08 | |
| *** tobiash has quit IRC | 06:08 | |
| *** sileht has quit IRC | 06:08 | |
| *** ianychoi has quit IRC | 06:08 | |
| *** SergK_ has quit IRC | 06:08 | |
| *** zul has quit IRC | 06:08 | |
| *** lyz_ has quit IRC | 06:08 | |
| *** furlongm_ has quit IRC | 06:08 | |
| *** charz has quit IRC | 06:08 | |
| *** bexelbie has quit IRC | 06:08 | |
| *** afazekas has quit IRC | 06:08 | |
| *** vaidy has quit IRC | 06:08 | |
| *** flwang has quit IRC | 06:08 | |
| *** lewo has quit IRC | 06:08 | |
| *** dtroyer has quit IRC | 06:08 | |
| *** davidlenwell_ has quit IRC | 06:08 | |
| *** alex_xu has quit IRC | 06:08 | |
| *** dims has quit IRC | 06:08 | |
| *** gsilvis has quit IRC | 06:08 | |
| *** rlandy has quit IRC | 06:08 | |
| *** HeOS has quit IRC | 06:08 | |
| *** sheeprine has quit IRC | 06:08 | |
| *** hrubi has quit IRC | 06:08 | |
| *** SpamapS has quit IRC | 06:08 | |
| *** skraynev has quit IRC | 06:08 | |
| *** tristanC has quit IRC | 06:08 | |
| *** roaet- has quit IRC | 06:08 | |
| *** mattymo has quit IRC | 06:08 | |
| *** markus_z has quit IRC | 06:08 | |
| *** krtaylor has quit IRC | 06:08 | |
| *** med_ has quit IRC | 06:08 | |
| *** eliqiao has quit IRC | 06:08 | |
| *** bradm has quit IRC | 06:08 | |
| *** zeus has quit IRC | 06:08 | |
| *** sweston has quit IRC | 06:08 | |
| *** haleyb has quit IRC | 06:08 | |
| *** monester has quit IRC | 06:08 | |
| *** cloudnull has quit IRC | 06:08 | |
| *** zz_dimtruck has quit IRC | 06:08 | |
| *** darrenc has quit IRC | 06:08 | |
| *** xgerman has quit IRC | 06:08 | |
| *** kevinshort has quit IRC | 06:08 | |
| *** verdurin has quit IRC | 06:08 | |
| *** onovy has quit IRC | 06:08 | |
| *** rpodolyaka has quit IRC | 06:08 | |
| *** krotscheck_dcm has quit IRC | 06:08 | |
| *** warpc has quit IRC | 06:08 | |
| *** simonmcc has quit IRC | 06:08 | |
| *** gibi has quit IRC | 06:08 | |
| *** docaedo has quit IRC | 06:08 | |
| *** bastelfreak has quit IRC | 06:08 | |
| *** vkramskikh has quit IRC | 06:08 | |
| *** craige has quit IRC | 06:08 | |
| *** adam_g has quit IRC | 06:08 | |
| *** phschwartz has quit IRC | 06:08 | |
| *** ryanpetrello has quit IRC | 06:08 | |
| *** sigmavirus24_awa has quit IRC | 06:08 | |
| *** mcarden has quit IRC | 06:08 | |
| *** Nakato has quit IRC | 06:08 | |
| *** khappone_ has quit IRC | 06:08 | |
| *** anthonyper has quit IRC | 06:08 | |
| *** aviau has quit IRC | 06:08 | |
| *** michaelxin has quit IRC | 06:08 | |
| *** elmiko has quit IRC | 06:08 | |
| *** iremizov has quit IRC | 06:08 | |
| *** kaisers has quit IRC | 06:08 | |
| *** onovy_ is now known as onovy | 06:08 | |
| *** craige_ is now known as craige | 06:08 | |
| *** kshort_away is now known as kevinshort | 06:08 | |
| *** zeus- is now known as zeus | 06:09 | |
| *** asettle has quit IRC | 06:09 | |
| *** michaelxin has joined #openstack-infra | 06:09 | |
| *** SergK has joined #openstack-infra | 06:09 | |
| *** mcarden_ is now known as mcarden | 06:09 | |
| *** asettle has joined #openstack-infra | 06:09 | |
| *** krotscheck has joined #openstack-infra | 06:09 | |
| *** zeus is now known as Guest36812 | 06:09 | |
| *** ryanpetrello has joined #openstack-infra | 06:09 | |
| *** zul has joined #openstack-infra | 06:10 | |
| *** j_king has joined #openstack-infra | 06:10 | |
| *** darrenc_ is now known as darrenc | 06:10 | |
| *** jlvillal_ is now known as jlvillal | 06:10 | |
| *** tqtran has joined #openstack-infra | 06:10 | |
| *** mattymo has joined #openstack-infra | 06:10 | |
| *** markusz has joined #openstack-infra | 06:10 | |
| *** flepied has quit IRC | 06:10 | |
| *** jlvillal is now known as Guest83485 | 06:10 | |
| *** amotoki has joined #openstack-infra | 06:11 | |
| *** thorst has joined #openstack-infra | 06:12 | |
| *** armax has joined #openstack-infra | 06:12 | |
| *** med_ has joined #openstack-infra | 06:12 | |
| *** med_ is now known as Guest46337 | 06:12 | |
| *** hrubi has joined #openstack-infra | 06:13 | |
| *** skraynev has joined #openstack-infra | 06:13 | |
| *** rakhmerov has joined #openstack-infra | 06:13 | |
| *** tonyb has joined #openstack-infra | 06:14 | |
| *** ryanpetrello has quit IRC | 06:14 | |
| *** asettle has quit IRC | 06:14 | |
| *** gibi has joined #openstack-infra | 06:14 | |
| *** SpamapS has joined #openstack-infra | 06:14 | |
| *** asettle has joined #openstack-infra | 06:15 | |
| *** sileht_ is now known as sileht | 06:15 | |
| *** rlandy has joined #openstack-infra | 06:15 | |
| *** bexelbie has joined #openstack-infra | 06:16 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/305619 | 06:16 |
| *** krtaylor has joined #openstack-infra | 06:16 | |
| *** flwang has joined #openstack-infra | 06:16 | |
| *** ryanpetrello has joined #openstack-infra | 06:16 | |
| *** iremizov has joined #openstack-infra | 06:17 | |
| *** ianychoi has joined #openstack-infra | 06:18 | |
| *** vkramskikh has joined #openstack-infra | 06:19 | |
| *** thorst has quit IRC | 06:19 | |
| *** ramishra_ has quit IRC | 06:20 | |
| *** asettle has quit IRC | 06:20 | |
| *** asettle has joined #openstack-infra | 06:20 | |
| *** kaisers has joined #openstack-infra | 06:22 | |
| *** cloudnull has joined #openstack-infra | 06:23 | |
| *** rpodolyaka has joined #openstack-infra | 06:24 | |
| *** nmagnezi has joined #openstack-infra | 06:24 | |
| *** darrenc has quit IRC | 06:25 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 06:26 |
| *** asettle has quit IRC | 06:27 | |
| *** roxanaghe has joined #openstack-infra | 06:27 | |
| *** asettle has joined #openstack-infra | 06:27 | |
| *** flepied has joined #openstack-infra | 06:30 | |
| *** exploreshaifali has joined #openstack-infra | 06:31 | |
| *** roxanaghe has quit IRC | 06:32 | |
| *** verdurin has joined #openstack-infra | 06:32 | |
| *** monester has joined #openstack-infra | 06:34 | |
| *** shashank_hegde has quit IRC | 06:34 | |
| *** asettle has quit IRC | 06:34 | |
| *** asettle has joined #openstack-infra | 06:35 | |
| *** ramishra has joined #openstack-infra | 06:36 | |
| *** achanda has quit IRC | 06:36 | |
| *** nadya has joined #openstack-infra | 06:38 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Only use mirrored cache for git repos that exist https://review.openstack.org/305354 | 06:41 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Update the list of mirrored git repositories https://review.openstack.org/305355 | 06:42 |
| *** ryanpetrello has quit IRC | 06:45 | |
| *** tesseract- has joined #openstack-infra | 06:45 | |
| *** e0ne has joined #openstack-infra | 06:46 | |
| *** tqtran has quit IRC | 06:47 | |
| *** mrmartin has joined #openstack-infra | 06:48 | |
| *** fawadkhaliq has joined #openstack-infra | 06:49 | |
| *** dhellmann has quit IRC | 06:49 | |
| *** jaosorior has quit IRC | 06:50 | |
| *** jaosorior has joined #openstack-infra | 06:50 | |
| *** xgerman has joined #openstack-infra | 06:50 | |
| *** bradm_ is now known as bradm | 06:51 | |
| *** sweston has joined #openstack-infra | 06:51 | |
| *** aeng_ has quit IRC | 06:52 | |
| *** ryanpetrello has joined #openstack-infra | 06:52 | |
| *** vaidy has joined #openstack-infra | 06:54 | |
| *** larainema has quit IRC | 06:56 | |
| *** dhellmann has joined #openstack-infra | 06:56 | |
| *** anthonyper has joined #openstack-infra | 06:56 | |
| *** adam_g has joined #openstack-infra | 06:58 | |
| *** adam_g has quit IRC | 06:58 | |
| *** adam_g has joined #openstack-infra | 06:58 | |
| *** mpaolino has joined #openstack-infra | 06:59 | |
| *** afazekas has joined #openstack-infra | 07:00 | |
| *** rlandy has quit IRC | 07:01 | |
| *** scheuran has joined #openstack-infra | 07:02 | |
| *** bexelbie has quit IRC | 07:04 | |
| *** bexelbie has joined #openstack-infra | 07:04 | |
| *** simonmcc has joined #openstack-infra | 07:04 | |
| *** warpc has joined #openstack-infra | 07:04 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with periodic jobs https://review.openstack.org/297038 | 07:04 |
| *** rajinir has quit IRC | 07:05 | |
| *** bastelfreak has joined #openstack-infra | 07:06 | |
| *** darrenc has joined #openstack-infra | 07:10 | |
| *** markusz is now known as markus_z | 07:10 | |
| *** jcoufal has quit IRC | 07:12 | |
| *** docaedo has joined #openstack-infra | 07:12 | |
| *** sdake has joined #openstack-infra | 07:12 | |
| *** flepied has quit IRC | 07:13 | |
| *** jaosorior has quit IRC | 07:13 | |
| *** vincentll has joined #openstack-infra | 07:14 | |
| *** sweston has quit IRC | 07:14 | |
| *** e0ne has quit IRC | 07:15 | |
| *** daemontool has joined #openstack-infra | 07:15 | |
| yolanda | good morning | 07:15 |
| *** sweston has joined #openstack-infra | 07:17 | |
| *** thorst has joined #openstack-infra | 07:17 | |
| *** asettle has quit IRC | 07:17 | |
| *** daemontool_ has quit IRC | 07:17 | |
| *** asettle has joined #openstack-infra | 07:17 | |
| *** e0ne has joined #openstack-infra | 07:18 | |
| *** achanda has joined #openstack-infra | 07:19 | |
| *** Hal has joined #openstack-infra | 07:20 | |
| *** Hal is now known as Guest23895 | 07:20 | |
| *** e0ne has quit IRC | 07:21 | |
| *** ryanpetrello has quit IRC | 07:21 | |
| AJaeger_ | good morning, yolanda ! | 07:22 |
| *** ryanpetrello has joined #openstack-infra | 07:23 | |
| *** asettle has quit IRC | 07:23 | |
| *** asettle has joined #openstack-infra | 07:23 | |
| *** thorst has quit IRC | 07:24 | |
| *** rfolco__ has joined #openstack-infra | 07:25 | |
| *** rfolco__ has quit IRC | 07:25 | |
| *** arxcruz has joined #openstack-infra | 07:25 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Add experimental job for shade and magnum https://review.openstack.org/305434 | 07:26 |
| *** jlanoux has joined #openstack-infra | 07:26 | |
| *** asettle has quit IRC | 07:29 | |
| *** asettle has joined #openstack-infra | 07:29 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 07:29 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option https://review.openstack.org/304560 | 07:30 |
| *** ifarkas has joined #openstack-infra | 07:30 | |
| *** esikachev has joined #openstack-infra | 07:31 | |
| *** sdake has quit IRC | 07:31 | |
| *** sheeprine_ is now known as sheeprine | 07:33 | |
| *** sheeprine has quit IRC | 07:33 | |
| *** sheeprine has joined #openstack-infra | 07:33 | |
| *** fawadkhaliq has quit IRC | 07:34 | |
| *** jaosorior has joined #openstack-infra | 07:35 | |
| *** esikachev has quit IRC | 07:36 | |
| *** dizquierdo has joined #openstack-infra | 07:37 | |
| *** matrohon has joined #openstack-infra | 07:39 | |
| yolanda | i see puppet not running again... | 07:40 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix gate stable jobs https://review.openstack.org/305645 | 07:41 |
| openstackgerrit | Merged openstack-infra/puppet-kerberos: Add an @ sign because puppet says to https://review.openstack.org/305518 | 07:42 |
| openstackgerrit | Merged openstack-infra/puppet-jeepyb: Protect gcc package from duplicate declaration https://review.openstack.org/305519 | 07:42 |
| openstackgerrit | Merged openstack-infra/project-config: Add experimental job for shade and magnum https://review.openstack.org/305434 | 07:43 |
| AJaeger_ | yolanda: please put https://review.openstack.org/304952 on your review queue as well... | 07:43 |
| yolanda | ok | 07:43 |
| *** asettle has quit IRC | 07:44 | |
| AJaeger_ | thanks | 07:45 |
| openstackgerrit | Merged openstack-infra/project-config: Run the additional-pkg-repos devstack-plugin as self-test https://review.openstack.org/304968 | 07:47 |
| yolanda | np | 07:47 |
| yolanda | running puppet manually, it wasn't running since yesterday, my change to fix reviewday landed yesterday and it hadn't been applied | 07:47 |
| openstackgerrit | Merged openstack-infra/project-config: Adds post job for nova-api-ref https://review.openstack.org/305485 | 07:47 |
| *** jaosorior has quit IRC | 07:48 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 07:48 |
| *** jaosorior has joined #openstack-infra | 07:48 | |
| *** exploreshaifali has quit IRC | 07:49 | |
| *** daemontool has quit IRC | 07:49 | |
| *** jaosorior has quit IRC | 07:49 | |
| *** jaosorior has joined #openstack-infra | 07:49 | |
| *** dtroyer has joined #openstack-infra | 07:49 | |
| *** flepied has joined #openstack-infra | 07:51 | |
| *** daemontool has joined #openstack-infra | 07:51 | |
| *** flepied1 has joined #openstack-infra | 07:52 | |
| *** zeih_ has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack-infra/project-config: Delete more empty pot files https://review.openstack.org/304952 | 07:54 |
| *** mattoliverau has quit IRC | 07:54 | |
| *** jordanP has joined #openstack-infra | 07:55 | |
| *** flepied has quit IRC | 07:56 | |
| *** matt6434 has joined #openstack-infra | 08:00 | |
| *** sshnaidm has quit IRC | 08:00 | |
| *** johnsom_ has joined #openstack-infra | 08:00 | |
| *** achanda has quit IRC | 08:01 | |
| *** ihrachys has joined #openstack-infra | 08:02 | |
| *** markvoelker has joined #openstack-infra | 08:02 | |
| *** johnsom has quit IRC | 08:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable gate-grenade-dsvm-multinode for Swift https://review.openstack.org/304505 | 08:03 |
| *** lewo has joined #openstack-infra | 08:05 | |
| *** sshnaidm has joined #openstack-infra | 08:05 | |
| *** markvoelker has quit IRC | 08:08 | |
| *** achanda has joined #openstack-infra | 08:10 | |
| *** Nikolay_St has joined #openstack-infra | 08:10 | |
| *** achanda has quit IRC | 08:11 | |
| *** roxanaghe has joined #openstack-infra | 08:12 | |
| *** nt has quit IRC | 08:12 | |
| *** vincentll has quit IRC | 08:16 | |
| *** sshnaidm has quit IRC | 08:16 | |
| *** vincentll has joined #openstack-infra | 08:16 | |
| *** roxanaghe has quit IRC | 08:16 | |
| *** jistr has joined #openstack-infra | 08:18 | |
| *** sflanigan has quit IRC | 08:18 | |
| *** gildub has quit IRC | 08:19 | |
| *** thorst has joined #openstack-infra | 08:21 | |
| *** vilobhmm11 has quit IRC | 08:22 | |
| *** exploreshaifali has joined #openstack-infra | 08:23 | |
| *** asettle has joined #openstack-infra | 08:24 | |
| *** openstackstatus has joined #openstack-infra | 08:25 | |
| *** ChanServ sets mode: +v openstackstatus | 08:25 | |
| *** placko_ has joined #openstack-infra | 08:28 | |
| *** thorst has quit IRC | 08:29 | |
| *** asettle has quit IRC | 08:29 | |
| *** adam_g has quit IRC | 08:30 | |
| *** calebb1 has quit IRC | 08:31 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 08:31 |
| *** electrical has quit IRC | 08:31 | |
| *** electrical has joined #openstack-infra | 08:31 | |
| *** electrical has quit IRC | 08:31 | |
| *** electrical has joined #openstack-infra | 08:31 | |
| *** jlanoux_ has joined #openstack-infra | 08:32 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:32 | |
| *** jogo has joined #openstack-infra | 08:33 | |
| *** jogo has joined #openstack-infra | 08:33 | |
| *** calebb1 has joined #openstack-infra | 08:34 | |
| *** e0ne has joined #openstack-infra | 08:34 | |
| *** jlanoux has quit IRC | 08:35 | |
| *** adam_g has joined #openstack-infra | 08:36 | |
| *** adam_g has quit IRC | 08:36 | |
| *** adam_g has joined #openstack-infra | 08:36 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade https://review.openstack.org/243239 | 08:37 |
| *** andymaier has joined #openstack-infra | 08:40 | |
| *** nt has joined #openstack-infra | 08:41 | |
| *** kzaitsev_mb has quit IRC | 08:41 | |
| *** jcoufal has joined #openstack-infra | 08:42 | |
| yolanda | again memory problems with puppet | 08:43 |
| yolanda | ERROR! Unexpected Exception: [Errno 12] Cannot allocate memory | 08:43 |
| yolanda | to see the full traceback, use -vvv | 08:43 |
| yolanda | there is a patch from nibalizer to reduce parallelism, but hasn't landed yet | 08:43 |
| *** e0ne has quit IRC | 08:44 | |
| vincentll | hi, is there a way to trigger a Jenkins pass without doing a "git review"? | 08:48 |
| yolanda | vincentll, you can add a "recheck" comment to the change in gerrit | 08:50 |
| vincentll | yolanda: nice! thank you | 08:50 |
| *** romcheg has left #openstack-infra | 08:51 | |
| *** Nisha has joined #openstack-infra | 08:51 | |
| Nisha | Hi, i need help on how to archive console logs from the actual server | 08:52 |
| Nisha | in my thirdparty Ci | 08:52 |
| *** ivc_ has joined #openstack-infra | 08:52 | |
| *** permalac has joined #openstack-infra | 08:53 | |
| *** e0ne has joined #openstack-infra | 08:53 | |
| *** dingyichen has quit IRC | 08:54 | |
| SpamapS | hm | 08:54 |
| SpamapS | new pip may have borken dib | 08:54 |
| *** dalgaaf has joined #openstack-infra | 08:55 | |
| SpamapS | http://paste.openstack.org/show/494024/ | 08:55 |
| *** exploreshaifali has quit IRC | 08:56 | |
| *** electrofelix has joined #openstack-infra | 08:56 | |
| *** daemontool_ has joined #openstack-infra | 08:57 | |
| *** lezbar__ has quit IRC | 08:57 | |
| *** zhurong has quit IRC | 08:57 | |
| *** lezbar has joined #openstack-infra | 08:58 | |
| *** exploreshaifali has joined #openstack-infra | 08:59 | |
| *** gildub has joined #openstack-infra | 09:00 | |
| *** roxanaghe has joined #openstack-infra | 09:00 | |
| *** daemontool has quit IRC | 09:01 | |
| *** zhurong has joined #openstack-infra | 09:02 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Add missing python-magnumclient to shade-magnum job https://review.openstack.org/305674 | 09:02 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 09:02 |
| *** zhurong has quit IRC | 09:03 | |
| *** roxanaghe has quit IRC | 09:05 | |
| *** odyssey4me_ is now known as odyssey4me | 09:05 | |
| *** gildub has quit IRC | 09:07 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 09:07 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 09:08 |
| *** zeih_ has quit IRC | 09:08 | |
| *** bunting has joined #openstack-infra | 09:08 | |
| *** dtantsur is now known as dtantsur|mgt | 09:09 | |
| *** nt has quit IRC | 09:10 | |
| *** nt has joined #openstack-infra | 09:10 | |
| *** chlong has quit IRC | 09:11 | |
| *** zeih_ has joined #openstack-infra | 09:11 | |
| yolanda | AJaeger, care reviewing https://review.openstack.org/305674 ? need to fix shade-magnum job | 09:13 |
| *** zeih_ has quit IRC | 09:14 | |
| *** amotoki has quit IRC | 09:14 | |
| *** zeih_ has joined #openstack-infra | 09:14 | |
| *** esikachev has joined #openstack-infra | 09:14 | |
| *** yamahata has quit IRC | 09:16 | |
| *** eliqiao_ is now known as eliqiao | 09:17 | |
| *** sshnaidm has joined #openstack-infra | 09:17 | |
| openstackgerrit | Niall Bunting proposed openstack-infra/project-config: Glance fix glance_store functional tests https://review.openstack.org/305694 | 09:19 |
| *** mrmartin has quit IRC | 09:21 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 09:22 |
| *** exploreshaifali has quit IRC | 09:28 | |
| *** thorst has joined #openstack-infra | 09:28 | |
| *** sweston has quit IRC | 09:29 | |
| *** akscram has quit IRC | 09:30 | |
| *** dalgaaf has quit IRC | 09:30 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 09:30 |
| *** mrmartin has joined #openstack-infra | 09:30 | |
| *** david-lyle_ has joined #openstack-infra | 09:30 | |
| openstackgerrit | Quan Zhou proposed openstack-infra/activity-board: Update JS library 16.01-16-g017aeb2 https://review.openstack.org/305701 | 09:30 |
| *** sambetts|afk is now known as sambetts | 09:31 | |
| *** Guest23895 has quit IRC | 09:31 | |
| *** sheeprine has quit IRC | 09:32 | |
| *** fzhadaev has quit IRC | 09:32 | |
| *** pcm_ has quit IRC | 09:32 | |
| *** warpc has quit IRC | 09:32 | |
| *** samyewell has quit IRC | 09:32 | |
| *** jaranovich has quit IRC | 09:32 | |
| *** jswarren__ has joined #openstack-infra | 09:32 | |
| *** furlongm_ has joined #openstack-infra | 09:32 | |
| *** j_king has quit IRC | 09:33 | |
| *** david-lyle has quit IRC | 09:33 | |
| *** dhellmann has quit IRC | 09:33 | |
| *** lyz has quit IRC | 09:33 | |
| *** aviau_ has quit IRC | 09:33 | |
| *** furlongm has quit IRC | 09:33 | |
| *** ansiwen_ has quit IRC | 09:33 | |
| *** cody-somerville has quit IRC | 09:33 | |
| *** julim has quit IRC | 09:33 | |
| *** HeOS_ has quit IRC | 09:33 | |
| *** whoops has quit IRC | 09:33 | |
| *** trey has quit IRC | 09:33 | |
| *** tsufiev has quit IRC | 09:33 | |
| *** bradjones has quit IRC | 09:33 | |
| *** thingee has quit IRC | 09:33 | |
| *** jswarren_ has quit IRC | 09:34 | |
| *** whoops has joined #openstack-infra | 09:34 | |
| *** aspiers_ has joined #openstack-infra | 09:34 | |
| *** ansiwen has joined #openstack-infra | 09:34 | |
| *** j_king has joined #openstack-infra | 09:34 | |
| *** thorst has quit IRC | 09:34 | |
| *** lyz has joined #openstack-infra | 09:35 | |
| *** akscram has joined #openstack-infra | 09:35 | |
| *** aviau has joined #openstack-infra | 09:35 | |
| *** HeOS_ has joined #openstack-infra | 09:35 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 09:35 |
| nibalizer | yolanda: i think we should land the change to decrease parallelism | 09:36 |
| yolanda | nibalizer, i +2 that, but i think it misses another right? | 09:36 |
| *** sheeprine has joined #openstack-infra | 09:37 | |
| nibalizer | yolanda: https://review.openstack.org/#/c/304318/ | 09:38 |
| *** jistr has quit IRC | 09:38 | |
| *** tesseract- has quit IRC | 09:38 | |
| *** samyewell has joined #openstack-infra | 09:38 | |
| yolanda | ah it was reviewed, nice. Do you want to approve? | 09:38 |
| yolanda | i'll be around to babysit | 09:38 |
| openstackgerrit | Merged openstack-infra/activity-board: Update JS library 16.01-16-g017aeb2 https://review.openstack.org/305701 | 09:39 |
| *** pc_m has joined #openstack-infra | 09:39 | |
| *** dalgaaf has joined #openstack-infra | 09:40 | |
| *** trey has joined #openstack-infra | 09:41 | |
| *** dhellmann has joined #openstack-infra | 09:41 | |
| *** _degorenko|afk is now known as degorenko | 09:41 | |
| *** jaranovich has joined #openstack-infra | 09:42 | |
| *** bradjones has joined #openstack-infra | 09:43 | |
| *** bradjones has quit IRC | 09:43 | |
| *** bradjones has joined #openstack-infra | 09:43 | |
| *** sweston has joined #openstack-infra | 09:44 | |
| *** warpc has joined #openstack-infra | 09:46 | |
| *** aspiers_ has quit IRC | 09:46 | |
| *** Nisha has quit IRC | 09:46 | |
| *** lezbar has quit IRC | 09:46 | |
| *** salv-orl_ has joined #openstack-infra | 09:47 | |
| *** Hal has joined #openstack-infra | 09:48 | |
| *** Hal is now known as Guest73410 | 09:48 | |
| *** tsufiev has joined #openstack-infra | 09:48 | |
| *** fzhadaev has joined #openstack-infra | 09:49 | |
| *** mrmartin has quit IRC | 09:49 | |
| *** salv-orlando has quit IRC | 09:50 | |
| *** cody-somerville has joined #openstack-infra | 09:50 | |
| *** tesseract- has joined #openstack-infra | 09:51 | |
| nibalizer | yolanda: no i am headed to bed | 09:51 |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 09:51 |
| *** julim has joined #openstack-infra | 09:51 | |
| *** tosky has joined #openstack-infra | 09:51 | |
| yolanda | ok going to push the button | 09:52 |
| *** lucasagomes is now known as lucas-hungry | 09:55 | |
| *** lezbar has joined #openstack-infra | 09:55 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: [Manila] Fix grenade job settings https://review.openstack.org/305710 | 09:55 |
| *** aspiers_ has joined #openstack-infra | 09:56 | |
| openstackgerrit | Merged openstack-infra/system-config: Run less parallelism in ansible https://review.openstack.org/304318 | 09:59 |
| *** e0ne has quit IRC | 10:01 | |
| *** e0ne has joined #openstack-infra | 10:01 | |
| *** jtomasek_ has joined #openstack-infra | 10:01 | |
| dims_ | Nakato_ : pushed out 1.9.1 pbr release | 10:01 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 10:02 |
| *** amotoki has joined #openstack-infra | 10:04 | |
| *** markvoelker has joined #openstack-infra | 10:04 | |
| *** amotoki has quit IRC | 10:04 | |
| *** alex_xu_ has quit IRC | 10:04 | |
| openstackgerrit | Daniel Izquierdo proposed openstack-infra/activity-board: Add Mitaka release https://review.openstack.org/305713 | 10:05 |
| *** exploreshaifali has joined #openstack-infra | 10:07 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:07 | |
| *** aspiers_ has quit IRC | 10:08 | |
| *** alex_xu has joined #openstack-infra | 10:08 | |
| *** [HeOS] is now known as HeOS | 10:09 | |
| *** amotoki has joined #openstack-infra | 10:09 | |
| *** markvoelker has quit IRC | 10:09 | |
| *** lezbar has quit IRC | 10:09 | |
| *** lezbar has joined #openstack-infra | 10:09 | |
| *** daemontool__ has joined #openstack-infra | 10:10 | |
| openstackgerrit | Merged openstack-infra/activity-board: Add Mitaka release https://review.openstack.org/305713 | 10:10 |
| *** aspiers_ has joined #openstack-infra | 10:10 | |
| *** jtomasek_ has quit IRC | 10:11 | |
| *** amotoki_ has joined #openstack-infra | 10:11 | |
| *** uberjay_ has quit IRC | 10:11 | |
| *** infra-red has joined #openstack-infra | 10:13 | |
| *** amotoki has quit IRC | 10:13 | |
| *** daemontool_ has quit IRC | 10:14 | |
| *** Qiming_ has quit IRC | 10:14 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test for list flavors based on betamax https://review.openstack.org/305718 | 10:16 |
| *** uberjay has joined #openstack-infra | 10:17 | |
| *** esikachev has quit IRC | 10:20 | |
| *** larainema has joined #openstack-infra | 10:21 | |
| *** jistr has joined #openstack-infra | 10:22 | |
| *** exploreshaifali has quit IRC | 10:24 | |
| *** sdague has joined #openstack-infra | 10:24 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: make api-guide and api-ref targets voting https://review.openstack.org/305464 | 10:25 |
| *** nmagnezi has quit IRC | 10:26 | |
| sambetts | Hey Infra, I'm just wondering how a project goes about getting a build of its docs published on docs.openstack.org, is it automated like the other release processes? | 10:28 |
| *** flwang1 has joined #openstack-infra | 10:30 | |
| rcarrillocruz | sambetts: you may want to check the publish-jobs macro | 10:30 |
| rcarrillocruz | ermerm | 10:31 |
| rcarrillocruz | the upload-docs | 10:31 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 10:31 |
| rcarrillocruz | sec | 10:31 |
| rcarrillocruz | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n1032 | 10:31 |
| *** thorst has joined #openstack-infra | 10:32 | |
| sambetts | rcarrillocruz: thanks :D | 10:33 |
| *** nmagnezi has joined #openstack-infra | 10:35 | |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 10:35 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 10:35 |
| *** thingee has joined #openstack-infra | 10:36 | |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 10:37 |
| *** thorst has quit IRC | 10:39 | |
| sambetts | rcarrillocruz: I see the openstack-server-publish-jobs job, which runs the post job '{name}-docs' to publish to docs.openstack.org/developer I assume that I could manually add the '{name}-docs' job to my projects post/release queue to make it publish to there too | 10:40 |
| *** aspiers_ has quit IRC | 10:41 | |
| *** achanda has joined #openstack-infra | 10:44 | |
| rcarrillocruz | i believe you want '{name]-tox-doc-publishdocs' on post | 10:44 |
| rcarrillocruz | AJaeger_: can you confirm ^ | 10:44 |
| *** lezbar has quit IRC | 10:45 | |
| *** lezbar has joined #openstack-infra | 10:45 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add new experimental job for manila-image-elements project https://review.openstack.org/305745 | 10:46 |
| *** ramishra has quit IRC | 10:48 | |
| *** dosaboy_ is now known as dosaboy | 10:48 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job https://review.openstack.org/229789 | 10:49 |
| *** nmagnezi has quit IRC | 10:51 | |
| *** itxaka has joined #openstack-infra | 10:53 | |
| *** Nisha has joined #openstack-infra | 10:55 | |
| *** nmagnezi has joined #openstack-infra | 10:56 | |
| *** daemontool__ has quit IRC | 10:57 | |
| *** asettle has joined #openstack-infra | 10:59 | |
| *** asettle has quit IRC | 10:59 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 11:00 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 11:00 |
| *** edmondsw has joined #openstack-infra | 11:03 | |
| *** davideagnello has quit IRC | 11:04 | |
| *** tpsilva has joined #openstack-infra | 11:06 | |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/project-config: Finalize designate tempest jobs https://review.openstack.org/305758 | 11:06 |
| *** mikelk has quit IRC | 11:07 | |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/project-config: Finalize designate tempest jobs https://review.openstack.org/305758 | 11:07 |
| *** alex_xu has quit IRC | 11:08 | |
| *** ramishra has joined #openstack-infra | 11:09 | |
| AJaeger_ | sambetts: why not use openstack-server-publish-jobs? | 11:10 |
| *** alex_xu has joined #openstack-infra | 11:10 | |
| *** mikelk has joined #openstack-infra | 11:10 | |
| AJaeger_ | rcarrillocruz: tox-doc-publishdocs is the wrong one - that is only for documentaion projects | 11:10 |
| rcarrillocruz | AJaeger_: oh, i see trove using it? | 11:11 |
| sambetts | AJaeger_: only that its called openstack-server-publish-jobs, so it seem like that was intended for services like neutron, but that seems to be the right one | 11:11 |
| AJaeger_ | rcarrillocruz: trove is the exception ;) | 11:12 |
| rcarrillocruz | lol | 11:12 |
| AJaeger_ | sambetts: which repo? | 11:12 |
| rcarrillocruz | ok | 11:12 |
| *** doug-fish has joined #openstack-infra | 11:13 | |
| AJaeger_ | rcarrillocruz: trove is publishing docbook xml - and that cannot done by the normal jobs | 11:13 |
| sambetts | AJaeger_: openstack/ironic-ui | 11:13 |
| AJaeger_ | sambetts: server-publish-jobs means: Publish after each merge. client-publish-job: Publish only at relesae | 11:13 |
| AJaeger_ | If your repo is in the big tent, choose either of these templates | 11:14 |
| sambetts | AJaeger_: ok great :) | 11:14 |
| *** fhubik has joined #openstack-infra | 11:15 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 11:15 |
| *** mnaser has quit IRC | 11:16 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pybabel instead of python setup.py https://review.openstack.org/305043 | 11:17 |
| AJaeger_ | sambetts: send a change and let's discuss there ;) | 11:17 |
| *** masayukig has quit IRC | 11:17 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/305619 | 11:17 |
| AJaeger_ | sambetts: once that change is in, update openstack-manuals repo, directory www/developer/ to add ironic-ui to the index file | 11:17 |
| sambetts | AJaeger_: this is what spawned my curiosity: https://review.openstack.org/#/c/305661/ | 11:18 |
| sambetts | AJaeger_: I've suggested to them they need to add the publish job | 11:18 |
| *** yamamoto_ has quit IRC | 11:18 | |
| *** masayukig has joined #openstack-infra | 11:19 | |
| *** johnsom__ has joined #openstack-infra | 11:19 | |
| AJaeger_ | sambetts: yeah... | 11:19 |
| *** Qiming has joined #openstack-infra | 11:20 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 11:21 |
| *** ldnunes has joined #openstack-infra | 11:21 | |
| *** gildub has joined #openstack-infra | 11:21 | |
| *** johnsom_ has quit IRC | 11:21 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 11:21 |
| *** zz_zz_ja has quit IRC | 11:23 | |
| *** esikachev has joined #openstack-infra | 11:24 | |
| *** zz_ja has joined #openstack-infra | 11:24 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test for deleting non-existing flavors https://review.openstack.org/303515 | 11:24 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update test for setting flavor specs to use betamax https://review.openstack.org/304064 | 11:24 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add test for delete flavor exception with betamax https://review.openstack.org/303529 | 11:25 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update test_unset_flavor_specs to use betamax https://review.openstack.org/304073 | 11:25 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list https://review.openstack.org/304171 | 11:25 |
| *** mnaser has joined #openstack-infra | 11:25 | |
| *** derekh has joined #openstack-infra | 11:25 | |
| *** dizquierdo has quit IRC | 11:27 | |
| *** jbernard_ has quit IRC | 11:27 | |
| *** bkeller` has quit IRC | 11:27 | |
| *** ramishra has quit IRC | 11:28 | |
| *** ramishra has joined #openstack-infra | 11:28 | |
| *** exploreshaifali has joined #openstack-infra | 11:29 | |
| *** bkeller` has joined #openstack-infra | 11:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Add missing python-magnumclient to shade-magnum job https://review.openstack.org/305674 | 11:29 |
| *** ivc_ has quit IRC | 11:31 | |
| *** flaper87 has quit IRC | 11:33 | |
| *** flaper87 has joined #openstack-infra | 11:33 | |
| *** lucas-hungry is now known as lucasagomes | 11:34 | |
| *** ivc_ has joined #openstack-infra | 11:34 | |
| *** salv-orl_ has quit IRC | 11:35 | |
| *** mrmartin has joined #openstack-infra | 11:36 | |
| *** gabriel-bezerra has quit IRC | 11:36 | |
| *** _amrith_ is now known as amrith | 11:39 | |
| *** jbernard_ has joined #openstack-infra | 11:40 | |
| *** gordc has joined #openstack-infra | 11:40 | |
| *** zhurong has joined #openstack-infra | 11:40 | |
| *** thorst has joined #openstack-infra | 11:41 | |
| *** baoli has joined #openstack-infra | 11:42 | |
| *** flwang1 has quit IRC | 11:42 | |
| *** baoli_ has joined #openstack-infra | 11:43 | |
| *** rfolco has joined #openstack-infra | 11:43 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 11:45 |
| *** mikelk has quit IRC | 11:45 | |
| *** achanda has quit IRC | 11:46 | |
| *** baoli has quit IRC | 11:47 | |
| *** jtomasek_ has joined #openstack-infra | 11:49 | |
| *** Kiall_ is now known as Kiall | 11:50 | |
| *** gabriel-bezerra has joined #openstack-infra | 11:51 | |
| *** rfolco has quit IRC | 11:52 | |
| *** asettle has joined #openstack-infra | 11:53 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add new test with betamax for create flavors https://review.openstack.org/302192 | 11:53 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 11:54 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 11:54 |
| *** kengo_sakai has quit IRC | 11:54 | |
| *** Guest46337 is now known as med_ | 11:55 | |
| *** med_ has quit IRC | 11:55 | |
| *** med_ has joined #openstack-infra | 11:55 | |
| *** ddieterly has joined #openstack-infra | 11:55 | |
| *** ramishra has quit IRC | 11:57 | |
| *** ams_ has joined #openstack-infra | 11:57 | |
| openstackgerrit | Merged openstack-infra/release-tools: Pick last SHA for PREVIOUS_VERSION https://review.openstack.org/305272 | 11:58 |
| *** rfolco has joined #openstack-infra | 12:00 | |
| *** aspiers_ has joined #openstack-infra | 12:01 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: [Manila] Fix grenade job settings https://review.openstack.org/305710 | 12:01 |
| *** doug-fish has quit IRC | 12:01 | |
| *** asettle has quit IRC | 12:01 | |
| *** baoli has joined #openstack-infra | 12:02 | |
| *** watersoul_ has quit IRC | 12:02 | |
| *** doug-fish has joined #openstack-infra | 12:02 | |
| *** johnsom_ has joined #openstack-infra | 12:02 | |
| *** bradjones has quit IRC | 12:02 | |
| *** arif-ali has quit IRC | 12:02 | |
| *** yamamoto has joined #openstack-infra | 12:03 | |
| *** lezbar has quit IRC | 12:03 | |
| vponomaryov | AJaeger: thanks for review of https://review.openstack.org/#/c/305710/ commit, change in second patch-set is a must, please, revisit it | 12:03 |
| *** pblaho_ has quit IRC | 12:03 | |
| *** dtantsur|mgt is now known as dtantsur|mtg | 12:04 | |
| *** pblaho has joined #openstack-infra | 12:04 | |
| *** exploreshaifali has quit IRC | 12:04 | |
| *** jogo has quit IRC | 12:04 | |
| *** bdemers has joined #openstack-infra | 12:04 | |
| *** flaper87 has quit IRC | 12:04 | |
| *** markvoelker has joined #openstack-infra | 12:05 | |
| *** Guest83485 has quit IRC | 12:05 | |
| *** bdemers_ has quit IRC | 12:05 | |
| *** nelsnelson has quit IRC | 12:05 | |
| *** ajo_ has quit IRC | 12:05 | |
| *** achanda has joined #openstack-infra | 12:05 | |
| *** doug-fish has quit IRC | 12:06 | |
| *** ddieterly is now known as ddieterly[away] | 12:06 | |
| *** mpaolino has quit IRC | 12:06 | |
| AJaeger_ | vponomaryov: done | 12:07 |
| *** arif-ali has joined #openstack-infra | 12:07 | |
| *** mat128 has quit IRC | 12:07 | |
| AJaeger_ | yolanda: can you review 305710 to unblock manila, please? | 12:07 |
| vponomaryov | AJaeger_: thank you | 12:07 |
| *** watersoul has joined #openstack-infra | 12:08 | |
| *** zz_ja has quit IRC | 12:08 | |
| *** hamzy has quit IRC | 12:09 | |
| *** bradjones has joined #openstack-infra | 12:09 | |
| *** bradjones has quit IRC | 12:09 | |
| *** bradjones has joined #openstack-infra | 12:09 | |
| *** markvoelker has quit IRC | 12:09 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** lezbar has joined #openstack-infra | 12:10 | |
| mordred | fungi, lifeless, Nakato_: that's an awesome bug/patch | 12:10 |
| *** baoli_ has quit IRC | 12:10 | |
| *** gildub has quit IRC | 12:10 | |
| *** johnsom__ has quit IRC | 12:10 | |
| *** masayukig has quit IRC | 12:10 | |
| *** mkwiek has quit IRC | 12:10 | |
| mordred | fungi: please thank the human for tracking it down | 12:11 |
| Shrews | yolanda: any chance you can poke https://review.openstack.org/304137 for us? | 12:11 |
| *** placko_ has quit IRC | 12:11 | |
| *** flaper87 has joined #openstack-infra | 12:11 | |
| *** flaper87 has quit IRC | 12:11 | |
| *** flaper87 has joined #openstack-infra | 12:11 | |
| *** placko_ has joined #openstack-infra | 12:12 | |
| *** jlvillal has joined #openstack-infra | 12:13 | |
| *** tristanC_ is now known as tristanC | 12:13 | |
| *** abregman has quit IRC | 12:13 | |
| *** zz_ja has joined #openstack-infra | 12:14 | |
| *** mrmartin has quit IRC | 12:14 | |
| *** ajo has joined #openstack-infra | 12:14 | |
| *** markvoelker has joined #openstack-infra | 12:14 | |
| openstackgerrit | Niall Bunting proposed openstack-infra/project-config: Glance fix glance_store functional tests https://review.openstack.org/305694 | 12:14 |
| *** markvoelker has quit IRC | 12:14 | |
| *** hrubi has quit IRC | 12:14 | |
| *** mat128 has joined #openstack-infra | 12:15 | |
| *** hrubi has joined #openstack-infra | 12:15 | |
| *** yamamoto has quit IRC | 12:15 | |
| *** tesseract- has quit IRC | 12:15 | |
| *** Nisha has quit IRC | 12:15 | |
| *** aysyd has joined #openstack-infra | 12:15 | |
| *** masayukig has joined #openstack-infra | 12:16 | |
| *** yamamoto has joined #openstack-infra | 12:16 | |
| *** tesseract- has joined #openstack-infra | 12:16 | |
| *** weshay has joined #openstack-infra | 12:17 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Pass extended network information in to occ/shade https://review.openstack.org/299679 | 12:17 |
| *** gildub has joined #openstack-infra | 12:17 | |
| *** exploreshaifali has joined #openstack-infra | 12:17 | |
| mescanef_ | hello. openstack infras folks please review some puppet code | 12:18 |
| mescanef_ | https://review.openstack.org/#/c/299661/ | 12:18 |
| mescanef_ | https://review.openstack.org/#/c/303306/ | 12:19 |
| *** salv-orlando has joined #openstack-infra | 12:19 | |
| *** yamamoto has quit IRC | 12:19 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: DO NOT MERGE - Trying to track down race bug https://review.openstack.org/305793 | 12:20 |
| *** asettle has joined #openstack-infra | 12:20 | |
| *** nelsnelson has joined #openstack-infra | 12:21 | |
| *** markus_z has quit IRC | 12:21 | |
| *** hamzy has joined #openstack-infra | 12:21 | |
| *** mpaolino has joined #openstack-infra | 12:21 | |
| *** xyang1 has joined #openstack-infra | 12:23 | |
| *** thiagop has joined #openstack-infra | 12:24 | |
| *** asettle has quit IRC | 12:25 | |
| yolanda | sorry, i was at lunch, looking | 12:26 |
| *** kgiusti has joined #openstack-infra | 12:26 | |
| *** amotoki_ has quit IRC | 12:27 | |
| *** markvoelker has joined #openstack-infra | 12:27 | |
| mordred | yolanda: no worries, I got it already | 12:28 |
| *** ifarkas has quit IRC | 12:28 | |
| *** pradk has joined #openstack-infra | 12:28 | |
| *** ifarkas has joined #openstack-infra | 12:29 | |
| *** jcoufal has quit IRC | 12:29 | |
| *** nt has quit IRC | 12:30 | |
| *** dprince has joined #openstack-infra | 12:31 | |
| *** markusz has joined #openstack-infra | 12:31 | |
| *** zynzel has joined #openstack-infra | 12:31 | |
| *** nt has joined #openstack-infra | 12:32 | |
| *** markusz is now known as markus_z | 12:32 | |
| zynzel | hi guys! Can anybody take a look at https://review.openstack.org/#/c/302962/ ? It was not merged even with +2 code-review, +1 workflow | 12:32 |
| *** yamamoto has joined #openstack-infra | 12:32 | |
| *** ddieterly[away] has quit IRC | 12:32 | |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 12:33 |
| openstackgerrit | Niall Bunting proposed openstack-infra/project-config: Glance fix glance_store functional tests https://review.openstack.org/305694 | 12:33 |
| zynzel | looks like this change stuck somewhere in queues | 12:33 |
| *** esikachev has quit IRC | 12:34 | |
| openstackgerrit | Merged openstack-infra/project-config: [Manila] Fix grenade job settings https://review.openstack.org/305710 | 12:35 |
| AJaeger_ | yolanda: is reviewday now working fine? I still don't see rossella_ 's change - or do I look at the wrong place? | 12:36 |
| yolanda | AJaeger, it passed without errors today | 12:36 |
| vponomaryov | AJaeger_, yolanda: thank you for such fast help! | 12:36 |
| *** rlandy has joined #openstack-infra | 12:36 | |
| yolanda | my change from pip and install dependencies worked | 12:36 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 12:37 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Add common bash functions to help track metrics. https://review.openstack.org/291392 | 12:37 |
| rossella_ | AJaeger_, thanks for asking...I see that https://review.openstack.org/#/c/298779/ hasn't merged yet | 12:37 |
| *** lindsayk_ has quit IRC | 12:37 | |
| openstackgerrit | Merged openstack-infra/shade: Return boolean from delete_project https://review.openstack.org/304155 | 12:38 |
| *** lindsayk_ has joined #openstack-infra | 12:38 | |
| AJaeger_ | rossella_: ah, that one was approved but has a depends-on and thus did not merge before. | 12:39 |
| rossella_ | yolanda, thanks for the fix for reviewday | 12:39 |
| AJaeger_ | yolanda: could you add an +A to 298779 so that it merges, please? | 12:39 |
| openstackgerrit | Rob Cresswell proposed openstack/requirements: Add horizon-cisco-ui to projects.txt https://review.openstack.org/300062 | 12:40 |
| AJaeger_ | yolanda: great to hear that your fixes work, thanks! | 12:40 |
| rossella_ | yolanda, AJaeger_ thanks a lot to both of you, can't wait to see the dashboard finally online! | 12:40 |
| *** newjersey has joined #openstack-infra | 12:41 | |
| mordred | yolanda, Shrews: when you get a sec - easy one: https://review.openstack.org/#/c/303853/8 | 12:41 |
| *** AJaeger_ is now known as AJaeger | 12:41 | |
| *** ramishra has joined #openstack-infra | 12:41 | |
| Shrews | mordred: failed test | 12:41 |
| Shrews | oh, you just rechecked | 12:41 |
| yolanda | rossella_, glad to help | 12:41 |
| *** jheroux has joined #openstack-infra | 12:42 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add common bash functions to help track metrics. https://review.openstack.org/291392 | 12:42 |
| mordred | Shrews: yah - it was a delete server timeout - which ona devstack box I think is, you knmow | 12:42 |
| AJaeger | yolanda or mordred, could you +A https://review.openstack.org/#/c/298779? jeblair has already +A but it didn't merge to a depends-on at that point - now it's fine... | 12:43 |
| AJaeger | yolanda, mordred, please ;) | 12:43 |
| Kiall | Anyone (project-config-core) got a min for a review? https://review.openstack.org/#/c/305758/ - much appreciated :) | 12:44 |
| openstackgerrit | Merged openstack-infra/shade: Correct error message when domain is required https://review.openstack.org/304137 | 12:44 |
| *** nt has quit IRC | 12:44 | |
| *** rvba` has quit IRC | 12:45 | |
| *** rvba has joined #openstack-infra | 12:45 | |
| mordred | AJaeger: done | 12:45 |
| *** rvba has quit IRC | 12:45 | |
| *** rvba has joined #openstack-infra | 12:45 | |
| AJaeger | Kiall: done | 12:45 |
| *** Guest36812 is now known as zeus | 12:45 | |
| *** zeus has quit IRC | 12:46 | |
| *** zeus has joined #openstack-infra | 12:46 | |
| AJaeger | thanks, mordred. rossella_ tell us whether it works, please ;) Change should be active in an hour or two. | 12:46 |
| *** jaosorior has quit IRC | 12:46 | |
| rossella_ | mordred, thanks a lot! | 12:47 |
| *** exploreshaifali has quit IRC | 12:47 | |
| rossella_ | AJaeger, ok I wll check in 2 hours and report back, again thanks a lot for all your help | 12:47 |
| *** tosky has quit IRC | 12:47 | |
| *** burgerk has joined #openstack-infra | 12:47 | |
| *** achanda has quit IRC | 12:49 | |
| openstackgerrit | Merged openstack-infra/reviewday: Add a link for Neutron Gerrit dashboard https://review.openstack.org/298779 | 12:49 |
| *** tosky has joined #openstack-infra | 12:49 | |
| *** Goneri has joined #openstack-infra | 12:51 | |
| *** keedya has joined #openstack-infra | 12:52 | |
| *** keedya has quit IRC | 12:52 | |
| *** doug-fish has joined #openstack-infra | 12:52 | |
| *** keedya has joined #openstack-infra | 12:52 | |
| *** doug-fish has quit IRC | 12:53 | |
| openstackgerrit | Merged openstack-infra/project-config: Finalize designate tempest jobs https://review.openstack.org/305758 | 12:53 |
| *** mkwiek has joined #openstack-infra | 12:54 | |
| *** doug-fish has joined #openstack-infra | 12:54 | |
| *** achanda has joined #openstack-infra | 12:56 | |
| *** nt has joined #openstack-infra | 12:56 | |
| *** nmagnezi has quit IRC | 12:56 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 12:56 |
| Kiall | Thanks AJaeger ! | 12:58 |
| *** placko_ has quit IRC | 12:59 | |
| openstackgerrit | Aparna proposed openstack/diskimage-builder: Support to add certificate in ironic-agent https://review.openstack.org/295203 | 13:01 |
| *** lezbar has quit IRC | 13:01 | |
| *** lezbar has joined #openstack-infra | 13:01 | |
| *** resker has quit IRC | 13:02 | |
| *** rossella_ has quit IRC | 13:03 | |
| *** rossella_ has joined #openstack-infra | 13:03 | |
| *** denisra_ has quit IRC | 13:04 | |
| *** amrith is now known as _amrith_ | 13:04 | |
| *** esikachev has joined #openstack-infra | 13:06 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on data updates https://review.openstack.org/305842 | 13:06 |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on data updates https://review.openstack.org/305842 | 13:07 |
| *** ddieterly has joined #openstack-infra | 13:07 | |
| *** rcrit has quit IRC | 13:08 | |
| *** nmagnezi has joined #openstack-infra | 13:08 | |
| *** gildub has quit IRC | 13:08 | |
| *** abregman has joined #openstack-infra | 13:08 | |
| mugsie | is there an issue with connectivity to freenode from nodepool slaves? I have seen a patch keep failing, trying to open a connection | 13:09 |
| mugsie | https://review.openstack.org/305160 | 13:09 |
| *** jcoufal has joined #openstack-infra | 13:09 | |
| mugsie | http://logs.openstack.org/60/305160/3/check/gate-project-config-irc-access/b8f8f3c/console.html#_2016-04-14_12_43_13_402 | 13:09 |
| mugsie | it has been rechecked a few times now, and the same failure keeps happening | 13:10 |
| mugsie | tox -e irc seems to be working fine locally | 13:11 |
| *** lezbar__ has joined #openstack-infra | 13:11 | |
| clarkb | mugsie: I have heard people complaining about freenode connectivity over the last day or two | 13:12 |
| *** jsavak has joined #openstack-infra | 13:12 | |
| clarkb | and there have been netsplits | 13:12 |
| mugsie | yeah, there seems to be a lot of netsplits happening at the moment | 13:12 |
| rcarrillocruz | i've had disconnects the past few days, yeah | 13:12 |
| *** lezbar has quit IRC | 13:13 | |
| *** mriedem has joined #openstack-infra | 13:13 | |
| mugsie | I will just keep rechecking then - thanks | 13:13 |
| *** Nakato_ is now known as Nakato | 13:14 | |
| *** permalac_ has joined #openstack-infra | 13:14 | |
| *** johnsom__ has joined #openstack-infra | 13:14 | |
| *** nelsnels_ has joined #openstack-infra | 13:14 | |
| *** baoli_ has joined #openstack-infra | 13:14 | |
| *** david-lyle has joined #openstack-infra | 13:15 | |
| Nakato | Thanks dims_ | 13:15 |
| *** Volundr has joined #openstack-infra | 13:15 | |
| *** markvoelker_ has joined #openstack-infra | 13:15 | |
| *** bkeller^ has joined #openstack-infra | 13:16 | |
| *** roxanaghe has joined #openstack-infra | 13:16 | |
| *** xyang1_ has joined #openstack-infra | 13:16 | |
| *** mat128_ has joined #openstack-infra | 13:16 | |
| *** bkeller` has quit IRC | 13:17 | |
| *** michaelxin has quit IRC | 13:17 | |
| *** swat30 has quit IRC | 13:17 | |
| *** cburgess has quit IRC | 13:17 | |
| *** mat128 has quit IRC | 13:17 | |
| *** zz_ja has quit IRC | 13:17 | |
| *** fzhadaev has quit IRC | 13:17 | |
| *** swat30 has joined #openstack-infra | 13:17 | |
| *** bkeller^ is now known as bkeller` | 13:17 | |
| *** jab has joined #openstack-infra | 13:17 | |
| *** rvba has quit IRC | 13:17 | |
| *** whoops has quit IRC | 13:17 | |
| *** bunting has quit IRC | 13:17 | |
| *** pleia2 has quit IRC | 13:17 | |
| *** bauzas has quit IRC | 13:17 | |
| *** zaro has quit IRC | 13:17 | |
| *** lmiccini has quit IRC | 13:17 | |
| *** bunting has joined #openstack-infra | 13:17 | |
| *** akshai has joined #openstack-infra | 13:17 | |
| *** fhubik has quit IRC | 13:17 | |
| *** matt6434 has quit IRC | 13:17 | |
| *** markvoelker has quit IRC | 13:17 | |
| *** xyang1 has quit IRC | 13:17 | |
| *** nelsnelson has quit IRC | 13:17 | |
| *** hrubi has quit IRC | 13:17 | |
| *** jlvillal has quit IRC | 13:17 | |
| *** johnsom_ has quit IRC | 13:17 | |
| *** baoli has quit IRC | 13:17 | |
| *** ivc_ has quit IRC | 13:17 | |
| *** david-lyle_ has quit IRC | 13:17 | |
| *** permalac has quit IRC | 13:17 | |
| *** vincentll has quit IRC | 13:17 | |
| *** jordanP has quit IRC | 13:17 | |
| *** hdd has quit IRC | 13:17 | |
| *** oanson has quit IRC | 13:17 | |
| *** zynzel has quit IRC | 13:17 | |
| *** pabelanger has quit IRC | 13:17 | |
| *** dougshelley66 has quit IRC | 13:17 | |
| *** timfreund has quit IRC | 13:17 | |
| *** jpeeler has quit IRC | 13:17 | |
| *** LinuxJedi has quit IRC | 13:17 | |
| *** eharney has quit IRC | 13:17 | |
| *** mestery has quit IRC | 13:17 | |
| *** xnox has quit IRC | 13:17 | |
| *** xyang1_ is now known as xyang1 | 13:17 | |
| *** rvba has joined #openstack-infra | 13:17 | |
| *** matt6434 has joined #openstack-infra | 13:18 | |
| *** mestery has joined #openstack-infra | 13:18 | |
| *** rvba has quit IRC | 13:18 | |
| *** rvba has joined #openstack-infra | 13:18 | |
| *** jordanP has joined #openstack-infra | 13:18 | |
| *** hdd has joined #openstack-infra | 13:18 | |
| *** rfolco has quit IRC | 13:18 | |
| *** dougshelley66 has joined #openstack-infra | 13:18 | |
| *** vincentll has joined #openstack-infra | 13:18 | |
| *** pleia2 has joined #openstack-infra | 13:18 | |
| *** LinuxJedi has joined #openstack-infra | 13:18 | |
| *** jlvillal has joined #openstack-infra | 13:18 | |
| *** timfreund has joined #openstack-infra | 13:18 | |
| *** tiswanso has joined #openstack-infra | 13:18 | |
| *** xnox has joined #openstack-infra | 13:19 | |
| *** jpeeler has joined #openstack-infra | 13:19 | |
| *** bauzas has joined #openstack-infra | 13:19 | |
| *** zaro has joined #openstack-infra | 13:19 | |
| *** lmiccini has joined #openstack-infra | 13:20 | |
| *** fzhadaev has joined #openstack-infra | 13:20 | |
| *** oanson has joined #openstack-infra | 13:20 | |
| *** zhurong has quit IRC | 13:20 | |
| *** mtanino has quit IRC | 13:20 | |
| *** eharney has joined #openstack-infra | 13:20 | |
| *** roxanaghe has quit IRC | 13:21 | |
| AJaeger | clarkb: are you fully awake already to discuss translation scripts? | 13:21 |
| *** pabelanger has joined #openstack-infra | 13:21 | |
| *** ddieterly is now known as ddieterly[away] | 13:22 | |
| *** cburgess has joined #openstack-infra | 13:22 | |
| *** yamamoto has quit IRC | 13:22 | |
| *** zynzel has joined #openstack-infra | 13:22 | |
| *** zhurong has joined #openstack-infra | 13:22 | |
| *** yamamoto has joined #openstack-infra | 13:22 | |
| *** yamamoto has quit IRC | 13:22 | |
| *** FallenPegasus has quit IRC | 13:22 | |
| clarkb | AJaeger: not really awake but happy to discuss as I can | 13:24 |
| openstackgerrit | Merged openstack-infra/project-config: Add new experimental job for manila-image-elements project https://review.openstack.org/305745 | 13:24 |
| *** _ari_ has joined #openstack-infra | 13:25 | |
| pabelanger | did my post about ansible-playbook make it to channel? I suspect I was on the wrong side of a netsplit | 13:26 |
| *** tlbr has quit IRC | 13:26 | |
| AJaeger | clarkb: we currently use "python setup.py extract_messages" for python projects and "pybabel extract" for django projects. Do you remember any specific reason for the "setup.py" usage? Otherwise I would go with "pybabel" everywhere as proposed in https://review.openstack.org/305043 | 13:26 |
| *** tlbr has joined #openstack-infra | 13:26 | |
| AJaeger | clarkb: That allows us to specify the babel version and work in a venv... | 13:27 |
| AJaeger | clarkb: http://lists.openstack.org/pipermail/openstack-i18n/2016-April/002116.html gives some background | 13:28 |
| *** hrubi has joined #openstack-infra | 13:29 | |
| clarkb | AJaeger: extract_messages is from babel too and can run in a venv. I think it was done that way because it is how babel documents using babel | 13:29 |
| clarkb | It definitely wasnt done for a specific reason other than it was what the docs said and worked | 13:29 |
| *** ddieterly[away] is now known as ddieterly | 13:30 | |
| pabelanger | just checked eavesdrop, looks like it was missed | 13:30 |
| pabelanger | reposting | 13:31 |
| *** achanda has quit IRC | 13:31 | |
| AJaeger | clarkb: looking at https://github.com/python-babel/babel/issues/388, I think going with pybabel might be better. But I especially prefer to have one tool for both cases. | 13:31 |
| pabelanger | has anybody been manually killing the ansible-playbook process on puppetmaster.o.o? It looks to be blocked for 4+ hours again | 13:31 |
| AJaeger | clarkb: This time first pybabel was broken and the fix broke extract_messages ;( | 13:31 |
| *** kengo_sakai_mba has joined #openstack-infra | 13:31 | |
| clarkb | AJaeger: ++ to using a common tool. if pybabel works I would use it | 13:32 |
| yolanda | pabelanger, i did this morning, it was not running since yesterday, and crashing with memory problems | 13:32 |
| *** amitgandhinz has joined #openstack-infra | 13:32 | |
| AJaeger | clarkb: pybabel works... | 13:32 |
| yolanda | so i stopped and ran again this morning, blocked again? | 13:32 |
| pabelanger | Yup, so we should look into why. It is happening pretty frequent now | 13:33 |
| *** esikachev has quit IRC | 13:33 | |
| pabelanger | I'll kill the process | 13:33 |
| AJaeger | clarkb: so, a review of https://review.openstack.org/#/c/305043/ is welcome. Once that is in, we can start syncing again... | 13:33 |
| clarkb | AJaeger: ok | 13:34 |
| krotscheck | jeblair: Thanks for lifting the quota. | 13:34 |
| yolanda | pabelanger, i landed today nibalizer's change to reduce the parallelism | 13:34 |
| openstackgerrit | Merged openstack-infra/project-config: make api-guide and api-ref targets voting https://review.openstack.org/305464 | 13:34 |
| pabelanger | yolanda: ack | 13:35 |
| openstackgerrit | Merged openstack-dev/pbr: Correct server test https://review.openstack.org/305377 | 13:35 |
| yolanda | i hope that this helps but yes, too much problems with memory recently | 13:36 |
| *** daemontool has joined #openstack-infra | 13:36 | |
| *** michaelxin has joined #openstack-infra | 13:37 | |
| *** kengo_sakai_mba has quit IRC | 13:37 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Update Designate repos tags and ACLs https://review.openstack.org/305160 | 13:37 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add os/designate-tempest-plugin notifications to IRC https://review.openstack.org/305857 | 13:37 |
| *** kengo_sakai has joined #openstack-infra | 13:38 | |
| Kiall | yolanda - Near as I remember, our HLM team had ansible issues related to what looked like random stalls re SSH. You could reach out to them and see if it's the same thing? I believe they did some workaround.. | 13:38 |
| AJaeger | mugsie: good idea to split this up | 13:38 |
| sdague | does anyone have any idea why: https://wiki.openstack.org/w/index.php?search=Newton&fulltext=Search | 13:38 |
| sdague | returns 0 results | 13:38 |
| openstackgerrit | Joakim Söderberg proposed openstack-infra/jenkins-job-builder: Add user/password command line argument https://review.openstack.org/305858 | 13:38 |
| *** achanda has joined #openstack-infra | 13:38 | |
| yolanda | Kiall, thx. Who shall i better contact? | 13:38 |
| mugsie | AJaeger: yeah - looks like the -irc check is failing across all the providers | 13:39 |
| *** mylu has joined #openstack-infra | 13:39 | |
| Kiall | yolanda: Ehh - I can't remember, but Michael Kerrin would probably know + remember who | 13:39 |
| yolanda | thanks, i'll ping him | 13:39 |
| AJaeger | mugsie: I approved it the first change, based on prior approvals | 13:40 |
| mugsie | AJaeger: thanks :) | 13:40 |
| *** salv-orlando has quit IRC | 13:40 | |
| *** pfallenop has quit IRC | 13:40 | |
| *** regXboi has joined #openstack-infra | 13:40 | |
| *** hongbin has joined #openstack-infra | 13:41 | |
| *** newjersey has quit IRC | 13:44 | |
| *** achanda has quit IRC | 13:44 | |
| *** asettle has joined #openstack-infra | 13:44 | |
| openstackgerrit | Merged openstack-infra/shade: Start stamping the has_service debug messages https://review.openstack.org/303853 | 13:44 |
| sdague | pabelanger: did you ever create an experimental xenial job on devstack? | 13:44 |
| sdague | pabelanger: or how much more is needed to do such a thing | 13:45 |
| *** tonytan4ever has joined #openstack-infra | 13:45 | |
| *** yamamoto has joined #openstack-infra | 13:45 | |
| *** mriedem1 has joined #openstack-infra | 13:46 | |
| *** darvon has joined #openstack-infra | 13:46 | |
| *** rfolco has joined #openstack-infra | 13:46 | |
| *** armax_ has joined #openstack-infra | 13:46 | |
| *** larainema has quit IRC | 13:47 | |
| *** jaranovich has quit IRC | 13:47 | |
| pabelanger | sdague: Yup, we added experimental jobs to devstack-gate. They are online, but haven't debugged the APT failures just yet, since we don't have valid -backports / -updates ATM (they are empty) | 13:47 |
| pabelanger | sdague: I've been testing with 303032 | 13:47 |
| *** mat128_ has quit IRC | 13:47 | |
| *** Guest73410 has quit IRC | 13:47 | |
| *** med_ has quit IRC | 13:47 | |
| *** mestery has quit IRC | 13:48 | |
| *** jab has quit IRC | 13:48 | |
| *** sweston has quit IRC | 13:48 | |
| *** dhellmann has quit IRC | 13:48 | |
| *** ansiwen has quit IRC | 13:48 | |
| *** itxaka has quit IRC | 13:48 | |
| *** monester has quit IRC | 13:48 | |
| *** tonyb has quit IRC | 13:48 | |
| *** armax has quit IRC | 13:48 | |
| *** waynr has quit IRC | 13:48 | |
| *** stevebaker has quit IRC | 13:48 | |
| *** SamYaple has quit IRC | 13:48 | |
| *** armax_ is now known as armax | 13:48 | |
| sdague | pabelanger: which job is it? | 13:48 |
| *** ansiwen has joined #openstack-infra | 13:48 | |
| *** daemontool has quit IRC | 13:49 | |
| *** _ari_ has quit IRC | 13:49 | |
| *** oanson has quit IRC | 13:49 | |
| *** nelsnels_ has quit IRC | 13:49 | |
| *** mriedem has quit IRC | 13:49 | |
| *** dprince has quit IRC | 13:49 | |
| *** ifarkas has quit IRC | 13:49 | |
| *** pblaho has quit IRC | 13:49 | |
| *** edmondsw has quit IRC | 13:49 | |
| *** cody-somerville has quit IRC | 13:49 | |
| *** tsufiev has quit IRC | 13:49 | |
| *** jlanoux_ has quit IRC | 13:49 | |
| *** docaedo has quit IRC | 13:49 | |
| *** mattymo has quit IRC | 13:49 | |
| *** zul has quit IRC | 13:49 | |
| *** SergK has quit IRC | 13:49 | |
| *** pcrews has quit IRC | 13:49 | |
| *** dkehn has quit IRC | 13:49 | |
| *** kengo_sakai has quit IRC | 13:49 | |
| *** tosky_ has joined #openstack-infra | 13:49 | |
| *** newjersey has joined #openstack-infra | 13:49 | |
| *** asettle has quit IRC | 13:49 | |
| *** larainema has joined #openstack-infra | 13:49 | |
| *** daemontool has joined #openstack-infra | 13:49 | |
| *** dizquierdo has joined #openstack-infra | 13:49 | |
| *** tonyb has joined #openstack-infra | 13:49 | |
| *** tosky has quit IRC | 13:49 | |
| *** dprince has joined #openstack-infra | 13:50 | |
| *** pblaho has joined #openstack-infra | 13:50 | |
| *** mriedem1 is now known as mriedem | 13:50 | |
| sdague | pabelanger: the apt failure is just that those repos are listed, but don't exist. I assume that's a dib issue? | 13:50 |
| pabelanger | sdague: experimental-tempest-dsvm-full, experimental-tempest-dsvm-neutron-full, experimental-tempest-dsvm-postgress-full and experimental-grenade-dsvm all ran on 303032. And failed on apt-get update | 13:50 |
| pabelanger | sdague: right, our mirrors don't have them, because they don't contain any packages yet. And looks like reporepro will not mirror empty repos | 13:51 |
| pabelanger | I've been reading up on reprepro, but cannot see how to enabled it. Aside from manually adding a dummy package or something | 13:51 |
| *** hongbin has left #openstack-infra | 13:52 | |
| openstackgerrit | Aparna proposed openstack/diskimage-builder: Support to add certificate in ironic-agent https://review.openstack.org/295203 | 13:52 |
| *** med_ has joined #openstack-infra | 13:52 | |
| *** oanson has joined #openstack-infra | 13:53 | |
| sdague | pabelanger: can I get onto a node in question? We could hack around it in devstack-gate for now so that we could unblock actually seeing if devstack itself runs | 13:53 |
| *** med_ is now known as Guest90748 | 13:53 | |
| *** sweston has joined #openstack-infra | 13:53 | |
| *** nelsnelson has joined #openstack-infra | 13:53 | |
| *** stevebaker has joined #openstack-infra | 13:53 | |
| *** mat128 has joined #openstack-infra | 13:53 | |
| *** monester has joined #openstack-infra | 13:53 | |
| *** sigmavirus24b is now known as sigmavirus24 | 13:53 | |
| *** sigmavirus24 has quit IRC | 13:53 | |
| *** sigmavirus24 has joined #openstack-infra | 13:53 | |
| *** zz_ja has joined #openstack-infra | 13:53 | |
| *** fbo_ is now known as fbo | 13:54 | |
| *** dkaigarodsev has quit IRC | 13:54 | |
| pabelanger | sdague: should be fine, let me check experimental and hold a node. Last I tested devstack (2 weeks ago) locally on xenial, it actually tempest. | 13:54 |
| *** jaranovich has joined #openstack-infra | 13:54 | |
| sdague | pabelanger: thanks | 13:54 |
| *** tsufiev has joined #openstack-infra | 13:54 | |
| *** mestery has joined #openstack-infra | 13:55 | |
| pabelanger | sdague: need a public SSH key please | 13:55 |
| *** burgerk has quit IRC | 13:55 | |
| *** mattymo has joined #openstack-infra | 13:56 | |
| *** dhellmann has joined #openstack-infra | 13:56 | |
| sdague | pabelanger: what's in gerrit is good, let me grab the link | 13:56 |
| *** SergK has joined #openstack-infra | 13:57 | |
| sdague | oh, I have a bunch up there, let me clean that up | 13:57 |
| *** zeih_ has quit IRC | 13:57 | |
| *** ayoung has quit IRC | 13:57 | |
| *** jlanoux has joined #openstack-infra | 13:57 | |
| *** dhellmann has quit IRC | 13:57 | |
| *** achanda has joined #openstack-infra | 13:57 | |
| *** dhellmann has joined #openstack-infra | 13:58 | |
| sdague | pabelanger: I just sent you a PM with it | 13:58 |
| pabelanger | sdague: ack | 13:58 |
| pabelanger | replied back with SSH info | 13:59 |
| AJaeger | pabelanger, yolanda : Did puppet run successfully this time? | 13:59 |
| *** HeOS has quit IRC | 13:59 | |
| *** dkaigarodsev has joined #openstack-infra | 13:59 | |
| clarkb | pabelanger: maybe we can just mkdir on the afs volume? | 13:59 |
| *** esikachev has joined #openstack-infra | 13:59 | |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Enable Neutron-LBaaS plugin for some jobs https://review.openstack.org/305709 | 14:00 |
| *** HeOS has joined #openstack-infra | 14:00 | |
| *** pcrews has joined #openstack-infra | 14:00 | |
| *** itxaka has joined #openstack-infra | 14:00 | |
| *** dhellmann has quit IRC | 14:01 | |
| *** ifarkas has joined #openstack-infra | 14:01 | |
| *** _amrith_ is now known as amrith | 14:02 | |
| *** edmondsw has joined #openstack-infra | 14:02 | |
| *** cody-somerville has joined #openstack-infra | 14:02 | |
| pabelanger | clarkb: I think we need repodata too | 14:02 |
| *** docaedo has joined #openstack-infra | 14:02 | |
| pabelanger | AJaeger: it is running now | 14:03 |
| *** avarner has joined #openstack-infra | 14:03 | |
| *** esker has joined #openstack-infra | 14:03 | |
| *** dhellmann has joined #openstack-infra | 14:03 | |
| sdague | clarkb: for now I was just going to hack the sources.list in d-g | 14:04 |
| *** dmellado_ is now known as dmellado | 14:04 | |
| *** oanson has quit IRC | 14:04 | |
| *** zul has joined #openstack-infra | 14:04 | |
| *** _ari_ has joined #openstack-infra | 14:04 | |
| *** achanda has quit IRC | 14:04 | |
| *** Hal has joined #openstack-infra | 14:05 | |
| pabelanger | another option is to add logic around configure_mirror.sh any only use the xenial mirror from: http://mirror.dfw.rax.openstack.org/ubuntu/dists/ | 14:05 |
| mordred | pabelanger, clarkb: what's the afs volume issue? | 14:06 |
| *** Hal is now known as Guest40737 | 14:06 | |
| pabelanger | not AFS, reprepro is not mirroring empty xenial repositories | 14:06 |
| pabelanger | see link above | 14:06 |
| clarkb | which means no backports which means apt-get update fails | 14:06 |
| mordred | ah. | 14:06 |
| pabelanger | we are missing xenial-security / -updates / -backports because they are empty upstream | 14:06 |
| mordred | yeah - I honestly think putting an if xenial in configure_mirror is going to be less work than hacking in fake empty repos in reprepro | 14:07 |
| *** waynr has joined #openstack-infra | 14:07 | |
| clarkb | or maybe reprepri should properly mirror... | 14:07 |
| mordred | well, there's that | 14:07 |
| *** eharney has quit IRC | 14:07 | |
| mordred | but we probably won't fix that today | 14:08 |
| clarkb | ya | 14:08 |
| mordred | we should ACTUALLY probably figure out how to mirror with rsync instead of with reprepro | 14:08 |
| clarkb | its just annoying that you cant get it to do what is theoretically one of its tasks | 14:08 |
| mordred | because that way we'd continue to carry the upstream signatures, which is appropriate, since it's the same content | 14:09 |
| mordred | the biggest blocker there is that there is not a tool (that I found) that we can run to verify that we have a consistent repo state before running vos release | 14:09 |
| mordred | so maybe it's time to write one | 14:09 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Test commit https://review.openstack.org/303032 | 14:10 |
| sdague | honestly, it's fine to brutal hack around it pre release | 14:10 |
| *** Guest90748 is now known as medberry | 14:10 | |
| mordred | yah | 14:10 |
| clarkb | sdague: it will be an issue post release too, basically until they add content to those repos | 14:10 |
| *** medberry has quit IRC | 14:10 | |
| *** medberry has joined #openstack-infra | 14:10 | |
| mordred | I think the brutal hack is the right choice today | 14:10 |
| mordred | and then in the meantime we write the repo consistency check tool | 14:10 |
| sdague | clarkb: I assume those go live release day | 14:10 |
| *** SamYaple has joined #openstack-infra | 14:11 | |
| mordred | and move to rsync | 14:11 |
| clarkb | sdague: I dont think so, there is nothing to backport on release day | 14:11 |
| sdague | a canonical person might know more | 14:11 |
| mordred | yah. it's not that the repos don't exist - it's that they are empty | 14:11 |
| clarkb | right | 14:11 |
| sdague | ok | 14:11 |
| mordred | and the way reprepro mirrors is not to mirror upstream repo state | 14:11 |
| mordred | it's to download all of the contents and then build its own indexes | 14:11 |
| mordred | clarkb: I'll start hacking on repo-consistency-check script | 14:12 |
| pabelanger | if we move to rsync, we don't need to regen indexes anymore? | 14:12 |
| openstackgerrit | Puneeth proposed openstack/python-jenkins: add authorization to HTTP headers in get_version method https://review.openstack.org/305882 | 14:12 |
| clarkb | mordred: can apt* do it? since they already tell us when other repos are broken | 14:13 |
| *** oshykhkerimov has joined #openstack-infra | 14:13 | |
| sdague | pabelanger: that gets us back to the index consistency problem | 14:13 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 14:13 |
| sdague | which is one of the reasons to have our own mirrors | 14:13 |
| mordred | pabelanger: yes | 14:13 |
| *** ddieterly is now known as ddieterly[away] | 14:13 | |
| mordred | sdague: well, that's why we need a consistency check script | 14:13 |
| *** markvan has quit IRC | 14:13 | |
| sdague | mordred: ok | 14:14 |
| mordred | as a precondition to moving to rsync | 14:14 |
| mordred | so that we do not vos release when we have inconsistent repo state | 14:14 |
| *** haleyb_ is now known as haleyb | 14:14 | |
| pabelanger | mordred: Oh, in that case I can remove that step from centos rpms. I'm using rsync for it | 14:14 |
| mordred | pabelanger: which step? | 14:14 |
| mordred | generating our own index? | 14:14 |
| pabelanger | right | 14:14 |
| mordred | yah. not needed | 14:15 |
| mordred | however ... | 14:15 |
| pabelanger | neat, TIL | 14:15 |
| *** kengo_sakai has joined #openstack-infra | 14:15 | |
| mordred | are there any yum tools that will tell you if the index you have matches the files you have? | 14:15 |
| mordred | as in - make sure we have all of the files that we have in the index? | 14:15 |
| *** woodster_ has joined #openstack-infra | 14:15 | |
| pabelanger | I believe so, I was talking to the centos project leader yesteday, and he gave me some suggestions. I haven't tested them yet | 14:15 |
| mordred | cool | 14:15 |
| mordred | clarkb: I was not able to find any existing tools for this in apt world | 14:16 |
| pabelanger | so, let me simplify my rsync code, and add the mirror check | 14:16 |
| oshykhkerimov | hello! Is there already an issue why stackanalytics isn't updated for two days? F.E. http://stackalytics.com/?user_id=oshykhkerimov | 14:16 |
| *** cody-somerville has quit IRC | 14:16 | |
| mordred | pabelanger: woot! | 14:16 |
| mordred | pabelanger: I think debian repo check should be fairly easy-ish ... I just need to read the Packages file, and then make sure every mentioned Filename: entry actually has that file | 14:17 |
| *** mylu has quit IRC | 14:17 | |
| *** claudiub|2 has joined #openstack-infra | 14:17 | |
| *** ddieterly[away] is now known as ddieterly | 14:17 | |
| clarkb | mordred you do somethi g like apt-get --simulate $all_packages | 14:17 |
| clarkb | er apt-get install | 14:17 |
| clarkb | if that works index is good. if that doesnt work it isnt | 14:18 |
| clarkb | the problem is it willaccount for localpaclages too | 14:18 |
| *** rbrndt has joined #openstack-infra | 14:18 | |
| clarkb | so need to tidy that up somehow | 14:18 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix archiving worklists https://review.openstack.org/304694 | 14:18 |
| *** dkehn has joined #openstack-infra | 14:19 | |
| clarkb | mordred: you also need to confirm the hashes | 14:19 |
| *** jamesmcarthur has joined #openstack-infra | 14:21 | |
| mordred | clarkb: I don't think it's possible to install the entire repo -so I dont think apt-get --simulate will work | 14:22 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix gate stable jobs https://review.openstack.org/305645 | 14:22 |
| *** sshnaidm has quit IRC | 14:22 | |
| *** mylu has joined #openstack-infra | 14:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Only use AFS mirrors for ubuntu-trusty https://review.openstack.org/305884 | 14:22 |
| pabelanger | clarkb: mordred: sdague: our hack of the day ^ | 14:22 |
| pabelanger | will retest centos RPMs this afternoon | 14:22 |
| mordred | however, digging in to the file, writing a tool that will actually validate the packages file will not take long | 14:23 |
| sdague | pabelanger: ok, though I've got a d-g hack to just delete lines from sources.list | 14:23 |
| *** kengo_sakai has quit IRC | 14:23 | |
| sdague | which is fine, because we can use it to stack up devstack fixes needed | 14:23 |
| mordred | pabelanger: suggestion on change | 14:24 |
| fungi | yeah, i agree that tweaking our nodepool ready script to leave out nonexistent xenial repos is fine until it's officially released (and maybe even slightly longer than that depending on how long it takes them to put things in those repos), but should take care since changes to the ready scripts are not self-testing and have caused us to break adding nodes to nodepool in the past | 14:25 |
| *** ajmiller has joined #openstack-infra | 14:26 | |
| *** eharney has joined #openstack-infra | 14:26 | |
| fungi | and i agree it would be nice to switch from reprepro to the recommended tools at https://www.debian.org/mirror/ftpmirror#how | 14:27 |
| pabelanger | mordred: ack | 14:27 |
| fungi | i too am hunting for possible consistency check scripts, though i don't think it would be hard to write one | 14:28 |
| openstackgerrit | Merged openstack-infra/project-config: Update Designate repos tags and ACLs https://review.openstack.org/305160 | 14:28 |
| *** markvan has joined #openstack-infra | 14:28 | |
| fungi | especially if we leave out the (entirely optional) differential indices | 14:28 |
| mordred | fungi: yah. I think the script itself will be about a 10 minute job | 14:29 |
| mordred | fungi: however, I think we need to do 2 fancier things than the 10 minute script | 14:29 |
| fungi | writing the script may, though running it is a different story | 14:29 |
| jeblair | mordred: it looks like npm sync is still running; last vos release is complete after 362m | 14:30 |
| fungi | the real issue is that to validate a checksum, you need to do a full file scan of every file | 14:30 |
| openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 14:30 |
| mordred | fungi: one is keeping a cache of checksums | 14:30 |
| mordred | fungi: yah | 14:30 |
| mordred | fungi: the other is that rsync --delete is not what we want | 14:30 |
| mordred | we need to collect the list of things to delete, and then delete them _later_ | 14:30 |
| fungi | mordred: --delete is what we want, but not right away | 14:30 |
| mordred | exactly | 14:30 |
| fungi | we need a delay pass like we have now for deletes | 14:31 |
| mordred | yup | 14:31 |
| *** zhurong has quit IRC | 14:31 | |
| mordred | so we need to grab the list of things to delete, and then action those deletes after a delay. also not hard - just slightly more than 10 minutes of work | 14:31 |
| jeblair | mordred: does my summary of npm state jive with what you think it is? | 14:31 |
| jeblair | mordred: if so, i'll kick off another vos release | 14:32 |
| mordred | jeblair: yes | 14:32 |
| openstackgerrit | Joakim Söderberg proposed openstack/python-jenkins: Add support for passing SSL context to urllib https://review.openstack.org/305888 | 14:32 |
| jeblair | mordred: for the cache -- i would recommend don't even go out to the filesystem -- just if the index says you should have a file and your cache says you have it, don't even double check it exists. basically, only verify existence and the hash when you first notice a new file. | 14:33 |
| mordred | jeblair: yes. I agree | 14:34 |
| fungi | sdague: on the wiki search, i suspect the last time someone upgraded the elasticsearch extension they neglected to remove and regenerate the search indices. quite possibly my fault. i'll give that a try here shortly | 14:34 |
| jeblair | mordred: (because lots of stats are slow) | 14:34 |
| mordred | jeblair: yup. I think the first run will be very slow | 14:34 |
| jeblair | mordred: can you detect file removals the same way? index mentions a file that's not in the cache? | 14:34 |
| jeblair | er | 14:34 |
| mordred | jeblair: I was just about to say that | 14:34 |
| jeblair | mordred: other way around :) | 14:34 |
| jeblair | mordred: cache has a file not in the index | 14:34 |
| mordred | yup | 14:34 |
| jeblair | good | 14:34 |
| jeblair | i'm releasing mirror.npm again | 14:35 |
| *** permalac_ has quit IRC | 14:36 | |
| fungi | mordred: jeblair: maybe for consistency checking that's a good best-effort solution actually. verifying checksums protects us against file corruption/truncation but that's probably relatively rare compared to simple index mismatches on what files are present | 14:36 |
| fungi | we could just confirm the filenames in the index correspond to (perhaps non-zero-length) files on the volume and call it a day | 14:37 |
| jeblair | fungi: yeah, i think it achieves the immediate goals. i'm pretty sure apt will tell us if something untoward happens afterwords. we could always add a --slow option. :) | 14:37 |
| mordred | agree | 14:37 |
| jeblair | fungi: i'm suggesting full hash checks the first time we download a file, but no filesystem checks afterwords | 14:37 |
| mordred | however, the cache thing is likely the easiest way to deal with deletes | 14:37 |
| fungi | jeblair: wfm | 14:37 |
| fungi | and way faster for sure | 14:38 |
| *** yamahata has joined #openstack-infra | 14:38 | |
| *** phschwartz_ is now known as phschwartz | 14:38 | |
| fungi | at least after the initial run | 14:38 |
| mordred | so I think it's the easiest thing to do both in a single pass | 14:38 |
| *** salv-orlando has joined #openstack-infra | 14:41 | |
| AJaeger | team, there's a change by crinkle to "Make Infra's puppet beaker jobs voting" - https://review.openstack.org/305416 . Change looks fine on technical level, but all you puppet experts should weight in whether you want it. It has already two +2s... | 14:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add logic check for xenial APT mirrors https://review.openstack.org/305884 | 14:42 |
| *** achanda has joined #openstack-infra | 14:42 | |
| AJaeger | pabelanger: yes, puppet has updated more systems - still no udpate for http://puppetboard.openstack.org/node/status.openstack.org . how long is a full run normally? | 14:42 |
| openstackgerrit | Puneeth proposed openstack/python-jenkins: optionally disable ssl verification https://review.openstack.org/305899 | 14:43 |
| pabelanger | AJaeger: Ugh, ansible-playbook appears to be hung again | 14:44 |
| pabelanger | something is happening during our post fact task | 14:44 |
| AJaeger | ;( | 14:44 |
| *** andymaier has quit IRC | 14:45 | |
| *** andymaier has joined #openstack-infra | 14:45 | |
| pabelanger | okay, this time we'll pickup the patch from 304318 | 14:46 |
| pabelanger | Run less parallelism in ansible | 14:46 |
| *** ddieterly is now known as ddieterly[away] | 14:46 | |
| AJaeger | hope that works... | 14:47 |
| *** burgerk has joined #openstack-infra | 14:48 | |
| *** infra-red has quit IRC | 14:48 | |
| fungi | i have a feeling it's whatever's hung that's eventually consuming enough memory to get oom-killed | 14:48 |
| fungi | so reducing parallelism may only extend the duration of the hangs | 14:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document how mirrors are contstructed in AFS https://review.openstack.org/305539 | 14:48 |
| fungi | but i guess we'll find out | 14:48 |
| fungi | i don't suppose anyone's looked at what child processes have been running for how long before manually killing stuff off? | 14:49 |
| *** HeOS has quit IRC | 14:50 | |
| *** salv-orlando has quit IRC | 14:50 | |
| pabelanger | I have not, next block I can try and get an strace | 14:50 |
| *** shardy has quit IRC | 14:50 | |
| fungi | also inspecting stuff in /proc/<pid> may yield insights as to what it is, if the extended commandline details from ps are insufficient | 14:51 |
| fungi | and if it's a remote action, logging into the other end and following the trail from there with similar methods | 14:51 |
| *** tosky has joined #openstack-infra | 14:53 | |
| *** ayoung has joined #openstack-infra | 14:53 | |
| fungi | jpmaxman: jamesmcarthur: i don't see smarcet around, but it's been over a week on the new trusty-based openstackid.org. any objections to me deleting the old precise-based one now or is there still some chance you might need to roll back to it? | 14:54 |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Add more db api tests part 3 https://review.openstack.org/305030 | 14:54 |
| *** tosky_ has quit IRC | 14:54 | |
| *** ddieterly[away] is now known as ddieterly | 14:55 | |
| jamesmcarthur | fungi: thanks for the follow up. We won’t be rolling back :) | 14:55 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on data updates * refactoring * fixed insert condition https://review.openstack.org/305907 | 14:56 |
| *** mylu has quit IRC | 14:57 | |
| *** tesseract- has quit IRC | 14:58 | |
| *** mylu has joined #openstack-infra | 14:58 | |
| openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 14:58 |
| sdague | out of curiosity, is there any way to annotate known good users in the wiki so that you don't have to captcha on every edit? | 14:58 |
| clarkb | AJaeger: +2 on the pybabel change but left some ocmments that you might want to read | 14:59 |
| pabelanger | fungi: This last run I didn't see any SSH connections open, so my thoughts are it is a local process | 14:59 |
| pabelanger | we'll know more in 15mins | 14:59 |
| *** matt-borland has joined #openstack-infra | 14:59 | |
| mugsie | can I get one more review on https://review.openstack.org/305857 while the IRC gate check seems to work ? | 15:00 |
| *** lakshmiS has joined #openstack-infra | 15:00 | |
| fungi | jamesmcarthur: awesome! in that case i'll free up 15gb of ram quota and stop testing our openstackid puppet manifest on precise so it's only tested against trusty now | 15:00 |
| fungi | thanks! | 15:00 |
| pabelanger | sdague: it would require moving know good users into a different group and disabling the captcha for that group | 15:00 |
| jpmaxman | Fungi yeah trusty all the way! | 15:00 |
| fungi | sdague: i think the verdict was we need a different more flexible extension for that which isn't going to work out well before upgrading | 15:01 |
| AJaeger | clarkb: thanks, will read carefully... | 15:01 |
| *** HeOS has joined #openstack-infra | 15:01 | |
| sdague | fungi: ok | 15:02 |
| *** nadya has quit IRC | 15:02 | |
| AJaeger | clarkb: and then discuss later - will be offline a bit now... | 15:02 |
| *** tosky has quit IRC | 15:02 | |
| fungi | sdague: we've got a summit session (as soon as i'm done fleshing out the description and putting it on the schedule) to plan out completing the deployment automation which was never done when it was originally built, and working through the upgrade transition | 15:03 |
| *** nmagnezi has quit IRC | 15:03 | |
| thiagop | guys, morning! With the change on gerrit's ip, should we have to change our ssh host key on zuul? | 15:06 |
| thiagop | I thought the DNS would take care of it for me... | 15:06 |
| fungi | thiagop: no, the ssh host key remained the same | 15:07 |
| fungi | for the gerrit ssh api on 29418/tcp anyway | 15:07 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Capture periodic integration test logs https://review.openstack.org/305914 | 15:08 |
| *** tosky has joined #openstack-infra | 15:08 | |
| thiagop | fungi: I'm getting a "Host key verification failed" on my merger-debug.log | 15:09 |
| *** amitgandhinz has quit IRC | 15:10 | |
| *** amitgandhinz has joined #openstack-infra | 15:10 | |
| *** flepied1 is now known as flepied | 15:11 | |
| openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 15:11 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on data updates * refactoring * fixed insert condition https://review.openstack.org/305907 | 15:13 |
| *** ddieterly is now known as ddieterly[away] | 15:13 | |
| pabelanger | thiagop: you should be able to compare the new and original. What are you seeing? | 15:14 |
| *** amitgandhinz has quit IRC | 15:14 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on data updates * refactoring * fixed insert condition https://review.openstack.org/305907 | 15:14 |
| mugsie | can some one add me to the designate-tempest-plugin-core | 15:15 |
| mugsie | * gerrit group? | 15:15 |
| mugsie | (graham.hayes@hpe.com) - I am the designate PTL | 15:15 |
| clarkb | mugsie: sure, give me a minute | 15:15 |
| mugsie | clarkb: thanks :) | 15:16 |
| clarkb | mugsie: done | 15:16 |
| clarkb | * half a minute :) | 15:16 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option https://review.openstack.org/304560 | 15:16 |
| Kiall | clarkb: should designate-ptl also be set as the group owner? (can't remember if that's the norm) | 15:18 |
| mugsie | clarkb: great - thanks :) | 15:18 |
| *** angdraug has joined #openstack-infra | 15:18 | |
| *** gsilvis_ is now known as gsilvis | 15:18 | |
| clarkb | Kiall: the preference is to make it self owned | 15:18 |
| clarkb | Kiall: if yo ucan't trust your core reviewers then remove them >_> | 15:18 |
| clarkb | Kiall: mostly because it makes the automation easy | 15:19 |
| Kiall | clarkb: lol | 15:19 |
| Kiall | (at the trust thing ;)) | 15:19 |
| mugsie | clarkb: yeah, I am not sure I trust that Kiall person... :D | 15:19 |
| *** ddieterly[away] is now known as ddieterly | 15:19 | |
| thiagop | pabelanger: the key returned by the server seems to have something appended | 15:20 |
| clarkb | gerrit update. our daily memory avg use is 15GB (well above the old 12GB number) with peaks to 24GB) | 15:20 |
| *** kengo_sakai has joined #openstack-infra | 15:20 | |
| *** andreww has quit IRC | 15:20 | |
| pabelanger | yolanda: any thoughts about the key for new review.o.o ?^ | 15:23 |
| *** jsavak has quit IRC | 15:23 | |
| clarkb | pabelanger: yolanda thiagop it is because the ip address changed | 15:23 |
| clarkb | I think | 15:24 |
| rcarrillocruz | 24GB peaks | 15:24 |
| yolanda | sorry, reading backlog now | 15:24 |
| rcarrillocruz | o_O | 15:24 |
| *** kengo_sakai has quit IRC | 15:24 | |
| pabelanger | clarkb: Right, I would expect our key to be different too. But confused since we _may_ have copied it from the old server? | 15:24 |
| sdague | pabelanger: https://jenkins06.openstack.org/job/experimental-tempest-dsvm-full/1/consoleFull looks pretty promissing | 15:24 |
| sdague | that just included my sources.list hack | 15:25 |
| clarkb | pabelanger: the key is the same because we preserved the gerrit install | 15:25 |
| yolanda | pabelanger yes, keys didn't change from our side | 15:25 |
| clarkb | pabelanger: we just moved the volume from one VM to the other | 15:25 |
| pabelanger | sdague: Yup, that's what I got too. I think I had a single failure | 15:25 |
| pabelanger | yolanda: clarkb: Right, the volume | 15:25 |
| *** Nikolay_St has quit IRC | 15:25 | |
| *** jsavak has joined #openstack-infra | 15:26 | |
| yolanda | clarkb, pabelanger, we didn't need to reverify gerrit key on zuul right? | 15:26 |
| pabelanger | I am not sure | 15:27 |
| clarkb | yolanda: I don't think so | 15:27 |
| yolanda | i didn't do that on the migration, but not sure if any others did | 15:27 |
| *** stewie925 has joined #openstack-infra | 15:27 | |
| thiagop | pabelanger fungi clarkb yolanda changing the ip's on my common.yaml worked | 15:27 |
| yolanda | i also have been connected to gerrit by ssh, for several admin tasks on port 29418, and didn't need to reverify | 15:27 |
| pabelanger | sdague: should workaround your APT hack too: https://review.openstack.org/#/c/305884/ | 15:27 |
| pabelanger | clarkb: mordred: ^ for xenial mirror | 15:27 |
| yolanda | thiagop ah great | 15:27 |
| pabelanger | thiagop: ack | 15:27 |
| clarkb | yolanda: ya I think thiagop's config just used the wrong ip | 15:28 |
| clarkb | which seems to be confirmed | 15:28 |
| sdague | pabelanger: though, why put the other repos in there at all? | 15:28 |
| *** Swami has joined #openstack-infra | 15:28 | |
| thiagop | clarkb: it was using the old ones, but I thought the dns on the first entry would take care of it | 15:28 |
| pabelanger | well neat, glad we didn't break anything | 15:28 |
| pabelanger | sdague: paranoid I guess? | 15:29 |
| thiagop | clarkb: it appears that every entry should be correct (dns, ipv4 and ipv6) | 15:29 |
| sdague | pabelanger: paranoid of? | 15:29 |
| *** ddieterly is now known as ddieterly[away] | 15:29 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 15:29 |
| *** jordanP has quit IRC | 15:30 | |
| *** asettle has joined #openstack-infra | 15:32 | |
| *** amitgandhinz has joined #openstack-infra | 15:33 | |
| pabelanger | sdague: we forget to update it after xenial is released | 15:33 |
| pabelanger | I don't have an issue remove that code | 15:34 |
| openstackgerrit | Joakim Söderberg proposed openstack-infra/jenkins-job-builder: Add user/password command line argument https://review.openstack.org/305858 | 15:34 |
| bkero | waynr: https://storyboard.openstack.org/#!/project/723 | 15:34 |
| sdague | pabelanger: yeh, I'm just concerned that it means we'll hit all the old fails that the mirrors were built to avoid | 15:34 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add logic check for xenial APT mirrors https://review.openstack.org/305884 | 15:35 |
| pabelanger | sdague: fair enough^ | 15:35 |
| mordred | pabelanger: +A | 15:36 |
| pabelanger | neat | 15:36 |
| pabelanger | now I lunch | 15:36 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Make django 1.9 horizon job voting https://review.openstack.org/305940 | 15:36 |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Fix the typo of docstring https://review.openstack.org/305941 | 15:36 |
| fungi | thiagop: what common.yaml are you referring to? something in your nodepool config? | 15:36 |
| fungi | i don't think we hard-code our gerrit server ip addresses in any configuration on our end | 15:36 |
| sdague | is precise still a thing? could that precise line be fully removed in a different patch? | 15:36 |
| thiagop | fungi: puppet-openstackci's | 15:36 |
| fungi | thiagop: oh, interesting | 15:37 |
| *** asettle has quit IRC | 15:37 | |
| clarkb | sdague: it is still a thing for infra, we are slowly migrating away from it | 15:37 |
| sdague | clarkb: ok | 15:37 |
| fungi | sdague: we basically have two jobs still using bare-precise workers because we're still running a lot of production servers on ubuntu precise and need to verify that we don't break them | 15:38 |
| sdague | fungi: gotcha | 15:38 |
| *** pfallenop has joined #openstack-infra | 15:39 | |
| fungi | as we move the rest of them to trusty we'll eventually be able to drop those | 15:39 |
| *** salv-orlando has joined #openstack-infra | 15:39 | |
| sdague | right, because there's only like a year left on support there, right? | 15:39 |
| clarkb | yup exactly 53 weeks left I think | 15:40 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Magnum: remove some projects and configs https://review.openstack.org/305475 | 15:41 |
| *** tiswanso has quit IRC | 15:41 | |
| pabelanger | The good news, is only -infra jobs are using bare-precise now | 15:42 |
| pabelanger | everything else was migrated to ubuntu-trusty last week | 15:42 |
| *** tiswanso has joined #openstack-infra | 15:42 | |
| waynr | bkero: i'm not sure what the sprint triage process is | 15:44 |
| anteaya | pabelanger: sorry about yesterday | 15:45 |
| anteaya | pabelanger: you were talking about the wiki and I needed to go offline | 15:45 |
| anteaya | pabelanger: so I was a big short, sorry about that | 15:45 |
| pabelanger | np | 15:46 |
| bkero | waynr: at the top of https://etherpad.openstack.org/p/cibugreview-april2016 | 15:46 |
| anteaya | pabelanger: I have to run errands today but when I get back I'll read the backscroll from the sprint channel and try to catch up | 15:46 |
| anteaya | pabelanger: my basic stance is if someone wants to monitor spam then I'm fine if new accounts are open again, I don't feel I am a good choice as a monitor right now | 15:46 |
| clarkb | sdague: pabelanger looks like devstack took over 20 minutes on those experimental jobs because we don't have a wheel mirror for xenial yet | 15:47 |
| anteaya | and my personal focus is figuring out what we have to do to be able to purge deleted pages | 15:47 |
| anteaya | but I can go into more detail once I'm back from errands | 15:47 |
| clarkb | sdague: pabelanger so thats another piece of infrastructure we will need to add before using xenial in "production" | 15:47 |
| anteaya | pabelanger: thanks for understanding | 15:47 |
| pabelanger | anteaya: I am in the same boat, if somebody want to help monitor, I think we can enable it again | 15:47 |
| anteaya | great | 15:47 |
| pabelanger | anteaya: don't worry, it is all good | 15:47 |
| anteaya | now we just have to find someone willing to monitor | 15:47 |
| anteaya | thank you | 15:47 |
| anteaya | I appreciate it | 15:48 |
| pabelanger | clarkb: https://review.openstack.org/#/c/304782/ for wheel mirror | 15:48 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Make django 1.9 horizon job voting https://review.openstack.org/305940 | 15:48 |
| pabelanger | clarkb: just depends on when we want to roll a xenial server for it | 15:48 |
| anteaya | I have to finish my taxes and walk uptown and put them in the mail, so back later today | 15:48 |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/puppet-ciwatch: Add initial implementation to deploy ciwatch https://review.openstack.org/238606 | 15:49 |
| clarkb | pabelanger: after it releases for sure. Has anyone tested that afs works on xenial yet? | 15:49 |
| pabelanger | clarkb: I haven't tested that step yet. But can quickly do it later today | 15:49 |
| fungi | 221429 drops one more puppet module from being tested on precise, btw | 15:49 |
| pabelanger | AJaeger: ansible-playbook ran fine this time around | 15:49 |
| *** ddieterly[away] is now known as ddieterly | 15:50 | |
| *** amaretskiy has joined #openstack-infra | 15:50 | |
| *** vincentll has quit IRC | 15:50 | |
| pabelanger | fungi: nice | 15:50 |
| pabelanger | we should be able to migrate puppetboard.o.o now too | 15:50 |
| pabelanger | assuming we can launch a server | 15:50 |
| fungi | i'm deleting the old precise one we replaced a week+ ago from nova now | 15:51 |
| amaretskiy | AJaeger: hi! Can you help me with enabling neutron-lbaas for some rally jobs? We have issues recently after devstack has removed q-lbaas from it sservices | 15:51 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/yaml2ical: Fix off by 1 error in batch_messages & add unit tests https://review.openstack.org/305528 | 15:51 |
| amaretskiy | AJaeger: I have a patch submitted https://review.openstack.org/#/c/305709/ | 15:52 |
| amaretskiy | AJaeger: I'm trying to check it on our gates (jobs are queued) but previous patch sets has failed | 15:52 |
| *** scheuran has quit IRC | 15:53 | |
| *** tphummel has joined #openstack-infra | 15:54 | |
| *** andreww has joined #openstack-infra | 15:54 | |
| *** markus_z has quit IRC | 15:54 | |
| *** andreww is now known as xarses | 15:54 | |
| amaretskiy | fungi: hi! Can you help me please with enabling neutron-lbaas for some rally jobs? ^^^ | 15:56 |
| *** amotoki has joined #openstack-infra | 15:57 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add domain_id param to project operations https://review.openstack.org/291701 | 15:58 |
| clarkb | amaretskiy: if you look at the tests run for that change it says "XML output is unchanged" this means that change will not do anything | 15:58 |
| clarkb | amaretskiy: the problem is you are passing new lbaas flags to the jobs but they aren't consumed on the job template side | 15:58 |
| clarkb | amaretskiy: you actually need to update your job templates to add the lbaas repo to the PROJECTS list and enable the plugin | 15:58 |
| pabelanger | fungi: sounds good, let me know when it is safe to launch a new server | 15:59 |
| clarkb | (I am putting that on gerrit too) | 15:59 |
| *** lakshmiS has quit IRC | 15:59 | |
| amaretskiy | clarkb: Thank you for help! Please take a look at patch set https://review.openstack.org/#/c/305709/4 | 16:00 |
| amaretskiy | clarkb: what I'm doing wrong at patch set 4 ? | 16:00 |
| amaretskiy | clarkb: It actually does not work | 16:00 |
| clarkb | amaretskiy: ps4 looks reasonably fine to me. How does it not work? | 16:00 |
| amaretskiy | clarkb: I've submitted a patch that checks jobs https://review.openstack.org/#/c/305715/ | 16:01 |
| openstackgerrit | Sergey Nechaev proposed openstack/requirements: Adding scapy as dependency https://review.openstack.org/305959 | 16:01 |
| fungi | pabelanger: you should be good to go. i just freed up 15gb of memory quota in dfw now | 16:01 |
| amaretskiy | clarkb: and it has failed with proper messages that lbaas is not available | 16:02 |
| clarkb | amaretskiy: depends on does not work with updating jenkins jobs | 16:02 |
| clarkb | amaretskiy: this is because jenkins jobs are "privileged" and have to be reviewed before allowing them to run | 16:02 |
| fungi | yolanda: do you happen to know if the groups.openstack.org replacement has completed successfully, and whether the old server is still needed if it has? | 16:02 |
| *** mylu has quit IRC | 16:02 | |
| yolanda | fungi it deployed successfully. I left groups.openstack.org for a while, but i can check with mrmatin if he still needs it | 16:03 |
| amaretskiy | clarkb: how can I check the patch set? Or the only way is "blind" merge? | 16:03 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add api to get recent failed runs by run_metadata https://review.openstack.org/305495 | 16:03 |
| clarkb | amaretskiy: you run the changes locally | 16:03 |
| clarkb | amaretskiy: its just shell in that job you can copy and paste and run | 16:03 |
| amaretskiy | clarkb: sounds reasonable | 16:04 |
| amaretskiy | clarkb: Thanks a lot!!! | 16:04 |
| *** bpokorny has joined #openstack-infra | 16:04 | |
| *** derekh has quit IRC | 16:04 | |
| amaretskiy | clarkb: will do | 16:04 |
| clarkb | amaretskiy: zuulv3 will address this by separating privileged jobs from unprivileged jobs allowing us to test unprivileged job proposals without review | 16:04 |
| *** sdake has joined #openstack-infra | 16:05 | |
| *** mylu has joined #openstack-infra | 16:06 | |
| *** ifarkas has quit IRC | 16:06 | |
| *** slagle_ is now known as slagle | 16:07 | |
| *** bpokorny has quit IRC | 16:07 | |
| openstackgerrit | Alexander Maretskiy proposed openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 16:08 |
| *** mylu has quit IRC | 16:08 | |
| *** bpokorny has joined #openstack-infra | 16:08 | |
| clarkb | amaretskiy: also each of the jobs that run should write out a reproduce.sh script | 16:08 |
| clarkb | amaretskiy: you could update that script with your two changes and have it work | 16:09 |
| *** jlanoux has quit IRC | 16:10 | |
| *** mylu has joined #openstack-infra | 16:11 | |
| *** kzaitsev_mb has quit IRC | 16:12 | |
| amaretskiy | clarkb: cool! Thank you for help! | 16:12 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/yaml2ical: Fix off by 1 error in batch_messages & add unit tests https://review.openstack.org/305528 | 16:13 |
| *** tosky has quit IRC | 16:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-kerberos: Don't have the server install the client https://review.openstack.org/305968 | 16:14 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Install afs on all servers https://review.openstack.org/305477 | 16:14 |
| *** nadya has joined #openstack-infra | 16:15 | |
| fungi | yolanda: thanks, i think we're not too tight on quota now that i've been able to remove the old openstackid.org, but we probably want to keep the old review.openstack.org around for a little longer i'm guessing | 16:16 |
| fungi | though i guess we could archive a snapshot of it and then delete the instance | 16:16 |
| *** dtantsur|mtg is now known as dtantsur|afk | 16:16 | |
| jeblair | especially since we deleted the init links | 16:16 |
| *** flepied1 has joined #openstack-infra | 16:17 | |
| *** nmagnezi has joined #openstack-infra | 16:17 | |
| *** mtanino has joined #openstack-infra | 16:18 | |
| *** mylu has quit IRC | 16:18 | |
| *** flepied has quit IRC | 16:19 | |
| *** ddieterly is now known as ddieterly[away] | 16:19 | |
| *** claudiub|2 has quit IRC | 16:21 | |
| pabelanger | fungi: ack | 16:21 |
| *** kzaitsev_mb has joined #openstack-infra | 16:23 | |
| *** markusz has joined #openstack-infra | 16:24 | |
| *** sshnaidm has joined #openstack-infra | 16:24 | |
| openstackgerrit | Merged openstack-infra/zmq-event-publisher: Add node description to event data https://review.openstack.org/301237 | 16:24 |
| zaro | morning | 16:24 |
| clarkb | zaro: good morning | 16:24 |
| zaro | clarkb: you ever get storyboard email to work? | 16:26 |
| zaro | i'm still not recieving anything | 16:26 |
| pabelanger | sdague: let me know when you are done with the ubuntu-xenial node so I can remove the hold | 16:26 |
| clarkb | zaro: yup, you have to go in your profile settings and check the box sayin gsend emails | 16:27 |
| *** ddieterly[away] is now known as ddieterly | 16:27 | |
| clarkb | zaro: then navigate away and go back to the profile and double check it stuck | 16:27 |
| sdague | pabelanger: yeh, I'm done | 16:27 |
| *** brucet has joined #openstack-infra | 16:27 | |
| sdague | https://jenkins06.openstack.org/job/experimental-tempest-dsvm-full/1/ passed | 16:27 |
| sdague | so devstack is ready to go | 16:27 |
| sdague | that's good to know | 16:27 |
| *** achanda has quit IRC | 16:27 | |
| *** jistr has quit IRC | 16:28 | |
| sdague | so now we just need a real release, and we can flip devstack over to the new distro | 16:28 |
| pabelanger | nice | 16:28 |
| clarkb | zaro: when I did it the first time it didn't stick and I never thought to recheck the profile settings | 16:29 |
| clarkb | zaro: but the second time I set it it worked | 16:29 |
| zaro | clarkb: yeah, i think i had same problem. anyways, verified that it's checked now. | 16:29 |
| zaro | although storyboard keeps crashing on my chromium browser now | 16:29 |
| *** trown is now known as trown|lunch | 16:30 | |
| *** matrohon has quit IRC | 16:31 | |
| *** fitoduarte has joined #openstack-infra | 16:33 | |
| *** angdraug has quit IRC | 16:34 | |
| *** dizquierdo has quit IRC | 16:34 | |
| openstackgerrit | amrith proposed openstack/requirements: Adding xmltodict to global-requirements.txt https://review.openstack.org/305975 | 16:36 |
| *** rcernin has quit IRC | 16:36 | |
| clarkb | fungi: re https://bugs.launchpad.net/networking-midonet/+bug/1569797 how do you want to handle that? deleting those tags won't fix pbr for anyone that already has that repo cloned | 16:38 |
| openstack | Launchpad bug 1569797 in networking-midonet "remove non standard tags" [High,Confirmed] - Assigned to YAMAMOTO Takashi (yamamoto) | 16:38 |
| *** apoorvad has joined #openstack-infra | 16:39 | |
| fungi | clarkb: i think pbr 1.9.1 solved that anyway? | 16:39 |
| fungi | clarkb: it was a regression in 1.9.0 | 16:40 |
| clarkb | maybe I don't actually see the 1_foo.1 tag on that list | 16:40 |
| fungi | clarkb: that was an example, but other tags (like with + in them) were also known to trigger the same exception in that function | 16:40 |
| fungi | 1_foo.1 was just one known problem pattern | 16:41 |
| clarkb | gotcha | 16:41 |
| clarkb | I will respond to the ml thread | 16:41 |
| fungi | yeah, have them see if 1.9.1 is solving this, since tag deletion isn't really something we support anyway | 16:42 |
| jeblair | clarkb: how should we go about upgrading the zmq jenkins plugin? | 16:43 |
| jeblair | clarkb: maybe install a build on a master to double check it's good | 16:43 |
| jeblair | clarkb: then make a release? | 16:43 |
| jeblair | clarkb: (i landed the include node description change) | 16:43 |
| pabelanger | freeing up some leaked FIP on bluebox now | 16:43 |
| clarkb | jeblair: yup that seems like a good way to do it | 16:44 |
| *** nadya has quit IRC | 16:44 | |
| jeblair | clarkb: after tagging, any steps we need to do? | 16:44 |
| *** jamesmcarthur has quit IRC | 16:45 | |
| jeblair | i put jenkins07 in shutdown | 16:45 |
| clarkb | jeblair: to make a release? no that should go up to the jenkins maven repo and be installable via the ui | 16:45 |
| *** nadya has joined #openstack-infra | 16:46 | |
| jeblair | cool | 16:46 |
| *** dizquierdo has joined #openstack-infra | 16:47 | |
| *** ociuhandu has joined #openstack-infra | 16:50 | |
| *** jcoufal has quit IRC | 16:50 | |
| *** harlowja has quit IRC | 16:51 | |
| *** tonytan4ever has quit IRC | 16:51 | |
| *** mpaolino has quit IRC | 16:53 | |
| *** fawadkhaliq has joined #openstack-infra | 16:53 | |
| *** tonytan4ever has joined #openstack-infra | 16:53 | |
| *** lakshmiS has joined #openstack-infra | 16:54 | |
| *** ihrachys has quit IRC | 16:54 | |
| *** abregman has quit IRC | 16:55 | |
| *** fawadkhaliq has quit IRC | 16:56 | |
| *** yamahata has quit IRC | 16:57 | |
| *** ramishra has quit IRC | 16:58 | |
| *** fawadkhaliq has joined #openstack-infra | 16:58 | |
| *** yamahata has joined #openstack-infra | 16:58 | |
| *** dprince has quit IRC | 16:58 | |
| *** fawadkhaliq has quit IRC | 16:59 | |
| *** e0ne has quit IRC | 16:59 | |
| *** Nisha has joined #openstack-infra | 17:01 | |
| *** fawadkhaliq has joined #openstack-infra | 17:01 | |
| *** tosky has joined #openstack-infra | 17:01 | |
| *** dprince has joined #openstack-infra | 17:02 | |
| *** trown|lunch is now known as trown | 17:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Make django 1.9 horizon job voting https://review.openstack.org/305940 | 17:04 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Update Gerrit ACLs for vendor specific networking-* projects https://review.openstack.org/303039 | 17:04 |
| *** Sukhdev has joined #openstack-infra | 17:05 | |
| *** dizquierdo has quit IRC | 17:05 | |
| *** Qiming has quit IRC | 17:06 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Switch gate-neutron-dsvm-api to be invoked via tempest plugin framework https://review.openstack.org/304321 | 17:06 |
| *** sputnik13 has joined #openstack-infra | 17:07 | |
| *** esker has quit IRC | 17:08 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Revert "Make gate-neutron-dsvm-api job non-voting" https://review.openstack.org/303621 | 17:09 |
| openstackgerrit | Merged openstack-infra/storyboard: Resolve worklist filters in boards https://review.openstack.org/304622 | 17:10 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Make it possible to remove filters when creating a new worklist https://review.openstack.org/304700 | 17:10 |
| pabelanger | have we got any updates to vexxhost since it was disabled last week? | 17:11 |
| *** nadya has quit IRC | 17:11 | |
| clarkb | pabelanger: I haven't seen any, but we can ask mnaser directly | 17:13 |
| clarkb | mnaser: was your testing able to narrow down some better options for us? | 17:13 |
| *** jsavak has quit IRC | 17:13 | |
| *** jsavak has joined #openstack-infra | 17:14 | |
| *** gmurphy has joined #openstack-infra | 17:14 | |
| pabelanger | clarkb: thanks | 17:14 |
| pabelanger | EmilienM: have you tested your tarball job today? | 17:14 |
| EmilienM | no ! | 17:15 |
| *** stewie925 has quit IRC | 17:15 | |
| gmurphy | any chance on getting some eyes on https://review.openstack.org/#/c/301847 there is a bug in the current bandit version that is preventing the octavia bandit gate job from working correctly.. | 17:15 |
| *** sridhar_ram has joined #openstack-infra | 17:15 | |
| clarkb | pabelanger: we also need to figure out what we wnat to do with rax-ord | 17:16 |
| openstackgerrit | Merged openstack-infra/zuul: Split pipeline description by double newlines on status page https://review.openstack.org/239943 | 17:16 |
| clarkb | pabelanger: I can probably put together some info on where rax-ord jobs failed and what their traceroutes were | 17:17 |
| pabelanger | Ah, I thought we already sent that off | 17:17 |
| openstackgerrit | Merged openstack-infra/zuul: Cloner: Don't fall back on infrastructure failure https://review.openstack.org/288409 | 17:17 |
| *** stewie925 has joined #openstack-infra | 17:17 | |
| *** fawadk has joined #openstack-infra | 17:17 | |
| clarkb | pabelanger: oh maybe we did, the last week has been a bit of a blur for me | 17:17 |
| *** markvoelker has joined #openstack-infra | 17:18 | |
| pabelanger | clarkb: don't quote me, I think fungi should know more | 17:18 |
| *** lakshmiS_ has joined #openstack-infra | 17:18 | |
| *** apoorvad_ has joined #openstack-infra | 17:18 | |
| *** armax_ has joined #openstack-infra | 17:18 | |
| *** avarner_ has joined #openstack-infra | 17:18 | |
| *** tonytan_brb has joined #openstack-infra | 17:18 | |
| *** amotoki_ has joined #openstack-infra | 17:18 | |
| *** dizquierdo has joined #openstack-infra | 17:18 | |
| fungi | jeblair: you copied logs off the old nodepool.o.o right? or were you just reviewing them? i have a few node ids from right around that timeframe i for which i need to look up the corresponding instance uuids | 17:19 |
| *** cburgess has quit IRC | 17:19 | |
| *** xyang1 has quit IRC | 17:19 | |
| fungi | pabelanger: clarkb: hah, was just following up on that rax ticket | 17:19 |
| *** lezbar has joined #openstack-infra | 17:19 | |
| *** fawadkhaliq has quit IRC | 17:19 | |
| *** tonytan4ever has quit IRC | 17:19 | |
| *** lezbar__ has quit IRC | 17:19 | |
| *** kgiusti has quit IRC | 17:19 | |
| *** thiagop has quit IRC | 17:19 | |
| *** masayukig has quit IRC | 17:19 | |
| *** xyang1 has joined #openstack-infra | 17:20 | |
| fungi | unfortunately the examples i collected and linked in the ticket were right around where we replaced the nodepool server so logs are incomplete | 17:20 |
| jeblair | fungi: i just processed them and saven the results; did not save logs. want me to ressurect it again? | 17:20 |
| clarkb | gmurphy: >=0.17.3 overlaps with >=1.0.1 and since pip installs the highest version by default I don't understand how this will fix octavia | 17:20 |
| *** lakshmiS has quit IRC | 17:20 | |
| *** apoorvad has quit IRC | 17:20 | |
| *** zz_ja has quit IRC | 17:20 | |
| *** zaro has quit IRC | 17:20 | |
| *** hamzy has quit IRC | 17:20 | |
| *** gordc has quit IRC | 17:20 | |
| clarkb | gmurphy: I have no problem with moving up requirements like that, but don't understand how it will fix any jobs | 17:20 |
| *** mriedem1 has joined #openstack-infra | 17:20 | |
| *** MarkAtwood has joined #openstack-infra | 17:20 | |
| fungi | jeblair: is it possible what you processed has the info i'm looking for? | 17:21 |
| *** kushal has joined #openstack-infra | 17:21 | |
| *** tosky has quit IRC | 17:21 | |
| *** amotoki has quit IRC | 17:21 | |
| *** ayoung has quit IRC | 17:21 | |
| *** andymaier has quit IRC | 17:21 | |
| *** waynr has quit IRC | 17:21 | |
| *** _ari_ has quit IRC | 17:21 | |
| *** avarner has quit IRC | 17:21 | |
| *** itxaka has quit IRC | 17:21 | |
| *** armax has quit IRC | 17:21 | |
| *** mriedem has quit IRC | 17:21 | |
| *** timfreund has quit IRC | 17:21 | |
| *** dougshelley66 has quit IRC | 17:21 | |
| *** markvoelker_ has quit IRC | 17:21 | |
| *** rossella_ has quit IRC | 17:21 | |
| *** keedya has quit IRC | 17:21 | |
| *** pradk has quit IRC | 17:21 | |
| *** armax_ is now known as armax | 17:21 | |
| *** thorst has quit IRC | 17:21 | |
| *** mnaser has quit IRC | 17:21 | |
| *** thingee has quit IRC | 17:21 | |
| *** tosky__ has joined #openstack-infra | 17:21 | |
| jeblair | fungi: nope | 17:21 |
| *** asettle has joined #openstack-infra | 17:21 | |
| *** kengo_sakai has joined #openstack-infra | 17:21 | |
| fungi | darn | 17:21 |
| *** tosky__ is now known as tosky | 17:21 | |
| *** keedya has joined #openstack-infra | 17:21 | |
| jeblair | i was counting events and times and just kept the summaries. no uuids. | 17:21 |
| *** baoli_ has quit IRC | 17:21 | |
| fungi | if you have a moment to spare, you can likely repeat the stand-up you did faster than i could figure it out myself | 17:21 |
| jeblair | fungi: yep, that's what i was thinking. have it for you in a jiffy. | 17:21 |
| fungi | but i'm happy to just do it instead. i'm sure you're as busy as the rest of us | 17:22 |
| fungi | thanks! | 17:22 |
| clarkb | sdague: pabelanger the neutron job on xenial passed as well | 17:22 |
| gmurphy | clarkb: i was told that when the test requirements was updated the new bandit would be pulled in during gate checks.. | 17:22 |
| *** pvaneck has joined #openstack-infra | 17:22 | |
| clarkb | gmurphy: new bandit should already be pulled in | 17:22 |
| jeblair | fungi: i'm so busy, i'm waiting on 4 things to finish. :) | 17:22 |
| gmurphy | oh.. | 17:22 |
| gmurphy | ok... | 17:23 |
| clarkb | gmurphy: I think what is happening is we are conflating account with fixing | 17:23 |
| jeblair | fungi: so perfect timing | 17:23 |
| clarkb | gmurphy: the requirements change is just to make sure that the old version isn't considered valid anymore but won't necassarily fix the running jobs | 17:23 |
| yolanda | infra-root, i'm talking with Venu about infra cloud. We have a ipv6 /64 range for public subnet, on vlan2551. Is that ok ? | 17:23 |
| *** sdake has quit IRC | 17:23 | |
| yolanda | we also have /19 ipv4 range on public vlan | 17:23 |
| clarkb | gmurphy: anyways +2 | 17:23 |
| pabelanger | EmilienM: ack: I added https://review.openstack.org/305989 as a way to possible test | 17:23 |
| sdague | clarkb: great | 17:23 |
| gmurphy | clarkb: ok cool. thanks! | 17:24 |
| pabelanger | clarkb: sdague: one step closer | 17:24 |
| EmilienM | pabelanger: do you have a script to find typos? lol | 17:24 |
| AJaeger | pabelanger: great to hear that the playbook run, but status.openstack.org is not updated, according to http://puppetboard.openstack.org/node/status.openstack.org last successfull run was 7h ago. Could anybody check, please? | 17:24 |
| *** gordc has joined #openstack-infra | 17:24 | |
| pabelanger | EmilienM: I started hacking something a while back, I found that by hand | 17:24 |
| pabelanger | AJaeger: sure, let me check | 17:25 |
| *** fawadk has quit IRC | 17:25 | |
| fungi | yolanda: yeah, the initial public net having a /64 is fine as long as we're not planning to route anything behind that for now | 17:25 |
| *** fawadkhaliq has joined #openstack-infra | 17:25 | |
| pabelanger | AJaeger: looks like puppet failed to run on the server | 17:25 |
| yolanda | fungi ok | 17:25 |
| *** masayukig has joined #openstack-infra | 17:26 | |
| pabelanger | AJaeger: let me login | 17:26 |
| *** dougshelley66 has joined #openstack-infra | 17:26 | |
| yolanda | seems they are nearly completing the setup | 17:26 |
| clarkb | fungi: yolanda should just be direct attaching the VMs on that subnet right? | 17:26 |
| *** kengo_sakai has quit IRC | 17:26 | |
| *** Nisha_away has joined #openstack-infra | 17:26 | |
| *** cburgess has joined #openstack-infra | 17:26 | |
| *** sdake has joined #openstack-infra | 17:26 | |
| *** ericksonsantos has quit IRC | 17:26 | |
| *** asettle has quit IRC | 17:26 | |
| fungi | clarkb: yeah, my concern is that we might have wanted the physical systems on a different network than the virtual machines, so a different /64 | 17:26 |
| yolanda | we are still at time to ask for different requirements | 17:27 |
| pabelanger | AJaeger: http://paste.openstack.org/show/494112/ | 17:27 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pybabel instead of python setup.py, enable sync https://review.openstack.org/305043 | 17:27 |
| pabelanger | AJaeger: that was the last error | 17:27 |
| fungi | yolanda: is vlan2551 just where we attach virtual machines? | 17:27 |
| fungi | yolanda: host interfaces are on a different vlan/broadcast domain? | 17:28 |
| yolanda | infra-root, they are also asking us, about the ACL requirements for IPv6. Right now they are only permitting ICMP, and they want us to provide the security rules we need | 17:28 |
| fungi | yolanda: security rules are we don't want any filtering at all | 17:28 |
| *** zz_ja has joined #openstack-infra | 17:28 | |
| fungi | yolanda: and preferably no state tracking either | 17:28 |
| yolanda | fungi yes,we will need to attach vms to vlan2551 | 17:28 |
| *** hdd has quit IRC | 17:28 | |
| *** Nisha has quit IRC | 17:29 | |
| AJaeger | pabelanger: thanks! | 17:29 |
| pabelanger | AJaeger: looks like we are missing git | 17:30 |
| Nisha_away | Hi, I am trying to archive console logs also in my thirdparty CI... Need help on this | 17:30 |
| pabelanger | AJaeger: the path to it | 17:30 |
| *** kzaitsev_mb has quit IRC | 17:30 | |
| nibalizer | yolanda: yea what fungi said, we will use host level firewalls | 17:30 |
| yolanda | ok, they will update the setup then | 17:31 |
| *** sambetts is now known as sambetts|afk | 17:31 | |
| AJaeger | pabelanger: yeah. Do you know how to do this in puppet? | 17:31 |
| Nisha_away | does anyone know how can we archive the console logs also along with build logs. Build logs are getting archived, but i need the console logs also to be archived | 17:32 |
| *** vgridnev has joined #openstack-infra | 17:32 | |
| pabelanger | AJaeger: Yup, let me get a patch | 17:32 |
| clarkb | Nisha_away: are you using jenkins? | 17:32 |
| Nisha_away | clarkb, yes | 17:32 |
| AJaeger | thanks a lot, pabelanger ! | 17:33 |
| clarkb | Nisha_away: we use the jenkins scp plugin to do this, unfortunately I think the specific feature may still be unreleased, so we install some source build | 17:33 |
| clarkb | let me find a link | 17:33 |
| *** hamzy has joined #openstack-infra | 17:33 | |
| Nisha_away | clarkb, ok | 17:33 |
| clarkb | Nisha_away: http://tarballs.openstack.org/ci/scp.jpi that one I think | 17:33 |
| *** waynr has joined #openstack-infra | 17:33 | |
| *** jaosorior has joined #openstack-infra | 17:33 | |
| *** timfreund has joined #openstack-infra | 17:34 | |
| *** jsavak has quit IRC | 17:34 | |
| *** dprince has quit IRC | 17:34 | |
| *** thorst_ has joined #openstack-infra | 17:34 | |
| Nisha_away | After installing this, do i need to do any specific steps? | 17:34 |
| *** zaro has joined #openstack-infra | 17:34 | |
| *** dprince has joined #openstack-infra | 17:34 | |
| Nisha_away | in jenkinsmaster to archive the console logs | 17:34 |
| AJaeger | clarkb: regarding the translation scripts (change 305043 ), I have sent updates for the projects to blacklist the known broken Babel versions. | 17:35 |
| *** rossella_ has joined #openstack-infra | 17:35 | |
| clarkb | Nisha_away: yes you need to update your job configs to copy the console log, it is an option in each job config | 17:35 |
| *** jsavak has joined #openstack-infra | 17:35 | |
| *** mriedem1 is now known as mriedem | 17:35 | |
| clarkb | AJaeger: great, is that via the requirements repo? | 17:35 |
| AJaeger | clarkb: But just using the project requirements adds many more dependencies and not all projects will have the change merged | 17:35 |
| *** dizquierdo has quit IRC | 17:35 | |
| AJaeger | clarkb: yes, via requiremetns repo | 17:35 |
| *** ayoung has joined #openstack-infra | 17:35 | |
| asselin | Nisha_away, if you're using the common ci solution, that plugin should be installed already: http://docs.openstack.org/infra/openstackci/ | 17:36 |
| *** kgiusti has joined #openstack-infra | 17:36 | |
| AJaeger | clarkb: I was considering hardcoding a known working version - beaten twice a week with broken BAbel is enough ;( | 17:36 |
| AJaeger | and then update manually once we have a working version... | 17:36 |
| AJaeger | clarkb: but I'm open to suggestions. | 17:36 |
| Nisha_away | asselin, we have jenkins setup here... | 17:36 |
| clarkb | AJaeger: could possibly use contraints for that | 17:36 |
| *** yolanda has quit IRC | 17:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-reviewday: Add /usr/bin to pip install https://review.openstack.org/305996 | 17:37 |
| pabelanger | AJaeger: ^ | 17:37 |
| *** degorenko is now known as _degorenko|afk | 17:37 | |
| clarkb | AJaeger: add a babel test to the requirements updates that makes sure constraints + babel works, then in the translation jobs we install using contraints | 17:37 |
| AJaeger | clarkb: Yes, that would be one way... | 17:37 |
| Nisha_away | clarkb, actually in my jenkins configure window i dont see an option of copy console logs at all...so asked. Let me see | 17:37 |
| AJaeger | pabelanger: thanks! | 17:37 |
| pabelanger | AJaeger: ^ | 17:37 |
| pabelanger | oop | 17:37 |
| AJaeger | ;) | 17:38 |
| clarkb | Nisha_away: you need that version of the scp plugin which includes the feature | 17:38 |
| *** ddieterly is now known as ddieterly[away] | 17:38 | |
| AJaeger | pabelanger: good spotting. | 17:38 |
| Nisha_away | clarkb, ok. | 17:38 |
| *** itxaka has joined #openstack-infra | 17:38 | |
| Nisha_away | asselin, yeah we use openstackci.... | 17:38 |
| AJaeger | clarkb: could you review my change again, please? I updated based on your comments - and enable syncing as well. | 17:39 |
| pabelanger | AJaeger: Ya, not sure why we need to update the path honestly. But that is the safer patch | 17:39 |
| AJaeger | I'll put your suggestion for constraints and requirements test on my todo list for later... | 17:39 |
| *** ddieterly[away] is now known as ddieterly | 17:39 | |
| *** mnaser has joined #openstack-infra | 17:40 | |
| *** davideagnello has joined #openstack-infra | 17:40 | |
| *** tiswanso has quit IRC | 17:40 | |
| *** jtomasek_ has quit IRC | 17:40 | |
| *** tiswanso has joined #openstack-infra | 17:41 | |
| pabelanger | AJaeger: jeblair: this is the reason for the failure: https://git.openstack.org/cgit/openstack-infra/reviewday/tree/requirements.txt#n5 | 17:42 |
| AJaeger | jeblair: there was no release of gerrit-dash-creator yet | 17:43 |
| pabelanger | https://review.openstack.org/#/c/298779/ | 17:43 |
| jeblair | yeah, i'm saying maybe there ought to be if other programs are going to depend on it? | 17:43 |
| *** bpokorny has quit IRC | 17:43 | |
| *** tqtran has joined #openstack-infra | 17:44 | |
| AJaeger | rax-iad run into a timeout git fechting from zm05.openstack.org - see http://logs.openstack.org/84/305884/3/gate/gate-project-config-layout/2640c0e/console.html | 17:44 |
| *** salv-orlando has quit IRC | 17:44 | |
| *** nt has quit IRC | 17:45 | |
| AJaeger | jeblair: I can work with the dash-creator team and ask them for it - and let's get the fix in now. Ok? | 17:45 |
| *** calebb1 is now known as calebb | 17:45 | |
| *** esikachev has quit IRC | 17:45 | |
| jeblair | sure, i didn't -1 it. :) | 17:45 |
| jeblair | (but i'm not going to +2 it) | 17:46 |
| AJaeger | jeblair: you +2A the previous one at least ;) | 17:46 |
| *** ddieterly is now known as ddieterly[away] | 17:46 | |
| *** bpokorny has joined #openstack-infra | 17:46 | |
| jeblair | AJaeger: yeah, and i would +2A a revert of it | 17:46 |
| *** nt has joined #openstack-infra | 17:46 | |
| AJaeger | understood, jeblair | 17:46 |
| jeblair | i don't want to add tech debt that i'm not going to pay off, but if others want to, that's fine | 17:47 |
| *** Nisha_brb has joined #openstack-infra | 17:47 | |
| *** esikachev has joined #openstack-infra | 17:47 | |
| jeblair | (i don't have time to track the correct fix and make sure it gets in) | 17:47 |
| AJaeger | jeblair: I put it on my todo list... | 17:47 |
| *** aysyd has quit IRC | 17:47 | |
| AJaeger | sdague: what do you think of a release of gerrit-dash-creator? | 17:48 |
| *** sputnik13_ has joined #openstack-infra | 17:48 | |
| *** sdake_ has joined #openstack-infra | 17:48 | |
| *** davideag_ has joined #openstack-infra | 17:48 | |
| *** dprince has quit IRC | 17:49 | |
| *** ociuhandu_ has joined #openstack-infra | 17:49 | |
| sdague | AJaeger: it's not in a hugely releasable state, if someone wanted to help with some package cleanup to get there, that would be fine. | 17:49 |
| *** bpokorny has quit IRC | 17:49 | |
| sdague | I guess I'm not sure what the dependency here is | 17:49 |
| fungi | sdague: neutron and possibly other teams want to integrate it into reviewday | 17:50 |
| AJaeger | sdague: we install it on status.openstack.org now from git and jeblair was suggesting to install it from packages | 17:50 |
| *** gmurphy_ has joined #openstack-infra | 17:50 | |
| fungi | or rather, integrate support for it into reviewday | 17:50 |
| *** yolanda has joined #openstack-infra | 17:50 | |
| *** mkoderer__ has joined #openstack-infra | 17:50 | |
| *** mkoderer___ has quit IRC | 17:50 | |
| *** ociuhandu has quit IRC | 17:50 | |
| *** Guest40737 has quit IRC | 17:50 | |
| *** gmurphy has quit IRC | 17:50 | |
| pabelanger | clarkb: how does your schedule look for the ceph AFS mirror? Know your busy this week | 17:50 |
| *** ociuhandu_ is now known as ociuhandu | 17:50 | |
| *** zynzel_ has joined #openstack-infra | 17:50 | |
| *** jsavak has quit IRC | 17:50 | |
| sdague | fungi: ok, I'm not sure what that means :) | 17:50 |
| fungi | autogenerate links to prioritized change lists as gerrit dashboards | 17:50 |
| sdague | ah | 17:51 |
| *** fawadkhaliq has quit IRC | 17:51 | |
| fungi | generating those dashboards by taking bug priorities and blueprints into account | 17:51 |
| clarkb | pabelanger: I am still trying to dig out of yesterday :) uh I mightbe able to look at the afs stuff this afternoon. I saw jeblair pushed more docs | 17:51 |
| *** davideagnello has quit IRC | 17:51 | |
| *** sdake has quit IRC | 17:51 | |
| *** Nisha_away has quit IRC | 17:51 | |
| *** sputnik13 has quit IRC | 17:51 | |
| *** eharney has quit IRC | 17:51 | |
| *** regXboi has quit IRC | 17:51 | |
| *** zynzel has quit IRC | 17:51 | |
| *** fawadkhaliq has joined #openstack-infra | 17:51 | |
| sdague | so, I am not opposed to it, but I'm also not convinced it's in a great place for landing on pypi | 17:51 |
| AJaeger | sdague: rossella_ sent some patches and mails for that, see also https://review.openstack.org/#/c/301255/ | 17:51 |
| *** eharney has joined #openstack-infra | 17:52 | |
| AJaeger | make it a 0.1.0 release ;) | 17:52 |
| *** jsavak has joined #openstack-infra | 17:52 | |
| pabelanger | clarkb: Ya, no problems. Was just pinged my some internal RH people looking for an update. Told them just that, on the plate, when time opens up it will happen | 17:52 |
| *** brucet has quit IRC | 17:52 | |
| clarkb | pabelanger: they should feel free to deal with the puppet | 17:52 |
| AJaeger | sdague: do you want to setup pypi or shall I do it for you? | 17:52 |
| *** regXboi has joined #openstack-infra | 17:52 | |
| *** Hal has joined #openstack-infra | 17:53 | |
| clarkb | pabelanger: I sort of got strong armed into it and don't personally have an interest in it beyond "this is a thing openstack wants" | 17:53 |
| fungi | though reviewday is also just an implementation detail in this case. the point is that they want to integrate the dashboard creator into some automation and continuously autopublish dashboards to gerrit | 17:53 |
| *** Hal is now known as Guest63537 | 17:53 | |
| clarkb | pabelanger: I think its 95% there, needs a rebase and some comments addressed? then afs volume created | 17:53 |
| sdague | AJaeger: if you want to set up for it, that's would be great | 17:53 |
| pabelanger | clarkb: understood. Let me know if I can help | 17:53 |
| sdague | fungi: to gerrit? | 17:53 |
| clarkb | but last time Itried tocreate an afs volume I spent a couple hours figuring out kerberos first (turns out I either never had or no longer had a principal and had to make a new one) | 17:53 |
| *** ramishra has joined #openstack-infra | 17:53 | |
| pabelanger | clarkb: and agree, think we are there too | 17:53 |
| AJaeger | sdague: then let me prepare infrastructure for it... | 17:54 |
| jeblair | clarkb: yes, you need to make your own principal | 17:54 |
| clarkb | pabelanger: so not reall willing to commit to anything given it could be a time sink that turns into spend a week fixing nodepool and dib :) | 17:54 |
| clarkb | jeblair: ya I did, but I swear I did like a year ago | 17:54 |
| clarkb | jeblair: and that principal was no longer there so I made a new one | 17:55 |
| clarkb | it just took far too much time to figure that out | 17:55 |
| *** nadya has joined #openstack-infra | 17:55 | |
| *** gyee has joined #openstack-infra | 17:55 | |
| *** ybathia has joined #openstack-infra | 17:55 | |
| clarkb | maybe server got rebuilt or maybe I am just bad at memory | 17:55 |
| pabelanger | okay, I don't mind doing AFS again if you get bogged down. | 17:56 |
| pabelanger | was an interesting learning experience | 17:56 |
| pabelanger | oldschool tech in the new school tech | 17:56 |
| *** _ari_ has joined #openstack-infra | 17:56 | |
| jeblair | clarkb: i don't think anything got rebuilt. anyway -- i don't want to stand in the way of you learning by doing, but also, i (and i'm sure mordred) are very happy to help if you have questions. | 17:57 |
| jeblair | fungi: 162.209.78.20 | 17:57 |
| dansmith | clarkb: I don't really want to suggest this, but maybe we just make it voting without the mirror and deal with it if something happens between now and mirror setup? | 17:57 |
| *** johnsom__ is now known as johnsom | 17:57 | |
| *** Sukhdev has quit IRC | 17:57 | |
| clarkb | dansmith: I think that is up to qa/nova/ceph. Until very recently and on fedora still this is basically how we do things | 17:57 |
| *** ddieterly[away] is now known as ddieterly | 17:58 | |
| *** bpokorny has joined #openstack-infra | 17:58 | |
| clarkb | mordred: jeblair btw, is it time to revert that nodepool patch yet? | 17:58 |
| clarkb | mordred: jeblair I am not sure what the current state of fixing FIPs is but seems like you hav ebeen running into some unfun bugs? | 17:58 |
| dansmith | clarkb: I think mriedem had previously asked if that was an option.. who else do you want sign-offs from? | 17:58 |
| * clarkb remembers that was the other thing he needed to review but was busy with doctor yesterday instead | 17:59 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: PUblish gerrit-dash-creator to PyPI https://review.openstack.org/306004 | 17:59 |
| AJaeger | jeblair, sdague ^ | 17:59 |
| *** ramishra has quit IRC | 17:59 | |
| clarkb | dansmith: the idea is to make it default right? | 17:59 |
| *** ybathia has quit IRC | 17:59 | |
| clarkb | dansmith: probably qa if that is the case since they are aksed to debug stuff | 17:59 |
| fungi | jeblair: thanks! grabbing now | 17:59 |
| dansmith | clarkb: the old method of testing ceph is gone, this is the only one and it's not gating | 17:59 |
| *** electrofelix has quit IRC | 18:00 | |
| dansmith | clarkb: okay I'll talk to oomichi and mriedem and see if they're cool with turning it on pre-mirror-setup | 18:00 |
| jeblair | [i'm pretty sure people come here first when things like "can't download ceph package" happen] | 18:00 |
| *** ddieterly is now known as ddieterly[away] | 18:00 | |
| *** ddieterly[away] is now known as ddieterly | 18:00 | |
| dansmith | jeblair: yeah, which is why we're trying to get the mirror up so we can do it right, but.. :) | 18:00 |
| *** gmurphy_ has left #openstack-infra | 18:00 | |
| jeblair | who's driving it? what patches do i need to approve? :) | 18:00 |
| *** ddieterly is now known as ddieterly[away] | 18:00 | |
| fungi | sdague: i don't recall which side it came down on. the two suggestions were either to have a job push custom dashboards to gerrit or have it publish them as query urls on status.o.o | 18:00 |
| jeblair | fungi: status.o.o | 18:01 |
| dansmith | jeblair: apparently we need clarkb's patch fixed and landed and an AFS volume created and the latter is most of the hangup | 18:01 |
| *** flepied1 has quit IRC | 18:01 | |
| sdague | fungi: right, so the reason I asked the question was the first thing, doesn't need it. Because it's core format is exactly the same as gerrit's (by design) | 18:01 |
| *** Nisha_brb is now known as Nisha | 18:01 | |
| fungi | jeblair: ahh, thanks, so not pushing them into gerrit | 18:01 |
| *** salv-orlando has joined #openstack-infra | 18:01 | |
| *** ddieterly[away] is now known as ddieterly | 18:01 | |
| *** fawadkhaliq has quit IRC | 18:02 | |
| sdague | this makes more sense now though if it's for publishing links | 18:02 |
| *** ddieterly is now known as ddieterly[away] | 18:02 | |
| AJaeger | fungi, and now we have a missing /usr/bin in the path for git - so need https://review.openstack.org/#/c/305996/1 | 18:02 |
| *** fawadkhaliq has joined #openstack-infra | 18:02 | |
| sdague | just didn't have any context that any of this was a thing | 18:02 |
| dansmith | jeblair: https://review.openstack.org/#/c/293155/ | 18:02 |
| *** nobodycam_ has joined #openstack-infra | 18:02 | |
| fungi | sdague: there were several threads which started up on the ml in parallel between different teams trying to work out a way to coordinate review priorities | 18:03 |
| AJaeger | fungi: And jeblair suggested to make a release instead. I would love to get in 305996 in - and then do the right thing once sdague has done a release on pypi | 18:03 |
| sdague | AJaeger: ok, do you have the time to figure out if the package is even making valid pypi artifacts at this point? That's the thing I'm 100% unsure of. And unlikely to really dig into before summit. | 18:04 |
| *** sdake_ is now known as sdake | 18:04 | |
| *** NobodyCam has quit IRC | 18:04 | |
| *** nobodycam_ is now known as nobodycam | 18:04 | |
| AJaeger | sdague: I'm not a pypi artifact expert, let me do some basic testing. | 18:04 |
| *** kushal has quit IRC | 18:05 | |
| *** aysyd has joined #openstack-infra | 18:05 | |
| sdague | AJaeger: ok, I made you core on it as well if you need to land fixes | 18:05 |
| krotscheck | infra-core: Anyone available to check on the npm mirroring script? | 18:05 |
| *** matrohon has joined #openstack-infra | 18:05 | |
| AJaeger | sdague: ok | 18:06 |
| *** vilobhmm11 has joined #openstack-infra | 18:06 | |
| *** dprince has joined #openstack-infra | 18:06 | |
| *** itxaka has quit IRC | 18:06 | |
| nibalizer | krotscheck: i am here! | 18:06 |
| nibalizer | lets derp with some mirrors | 18:06 |
| krotscheck | nibalizer: OMG | 18:06 |
| krotscheck | nibalizer: Go forth and look at mirrors! | 18:06 |
| *** fawadkhaliq has quit IRC | 18:09 | |
| *** harlowja has joined #openstack-infra | 18:09 | |
| nibalizer | krotscheck: it is in fact 'chugging' | 18:09 |
| krotscheck | nibalizer: chuggachugga | 18:09 |
| *** fawadkhaliq has joined #openstack-infra | 18:09 | |
| jeblair | clarkb: re nodepool, i think it's mostly ready to go except one patch to nodepool. it was sporadically failing tests, but we don't think it's related to the patch. mordred and Shrews are looking into it. | 18:09 |
| krotscheck | nibalizer: How much disk is it using? | 18:09 |
| *** ddieterly[away] is now known as ddieterly | 18:09 | |
| mordred | jeblair: I agree with what you said | 18:10 |
| jeblair | clarkb: https://review.openstack.org/299679 this patch | 18:10 |
| nibalizer | krotscheck: checking that now | 18:10 |
| clarkb | jeblair: ok, so best plan is to review the patches as is and let mordred and shrews debug that separately | 18:10 |
| mordred | I'm 99% certain the fail has nothing to do with the patch | 18:10 |
| mordred | yeah | 18:10 |
| jeblair | i feel it's probably okay to merge that patch and restart nodepool | 18:10 |
| AJaeger | sdague: I can create wheel and sdist, install the wheel and run it... | 18:10 |
| mordred | jeblair: agree | 18:11 |
| fungi | amrith: you seem to have three active accounts in review.openstack.org. do you have a moment to help me figure out which one you're using so i can mark the others inactive? | 18:11 |
| clarkb | I will review that change shortly | 18:11 |
| AJaeger | sdague: but only from git directory, yeah, patches are needed | 18:11 |
| *** ddieterly is now known as ddieterly[away] | 18:11 | |
| sdague | AJaeger: ok, cool, well if you want to sling patches for that, or ask rossella to, that would be cool | 18:11 |
| jeblair | clarkb: i believe all of its shade dependencies have merged, but if you want to catch up, they were under the shade-nodepool topic, and that patch links to them with a depends-on | 18:11 |
| *** ericksonsantos has joined #openstack-infra | 18:12 | |
| *** nobodycam is now known as NobodyCam | 18:12 | |
| clarkb | jeblair: mordred has shade been released since?I think we needed an occ release too | 18:12 |
| nibalizer | from peering at the root screen on afs1.dfw it looks like vos release is still running from the last time jeblair kicked it off | 18:13 |
| nibalizer | krotscheck: du -sh is still running | 18:13 |
| krotscheck | nibalizer: Is du-sh the correct way to check disk usage on an AFS directory? | 18:14 |
| krotscheck | jeblair: ^^ | 18:14 |
| * krotscheck is unfamiliar with such things. | 18:14 | |
| pabelanger | will be stepping out in about 15mins for an appointment and likely won't be back until later tonight | 18:14 |
| *** maishsk has joined #openstack-infra | 18:15 | |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph devstack-plugin-based job gating on Nova https://review.openstack.org/306009 | 18:15 |
| lakshmiS_ | is there a job to check for valid creativecommons license on top of the rst file for spec projects? | 18:15 |
| openstackgerrit | Merged openstack-infra/project-config: Capture periodic integration test logs https://review.openstack.org/305914 | 18:16 |
| mordred | clarkb: we have not released shade. we're fine on occ | 18:16 |
| jeblair | krotscheck, nibalizer: easier in this case to run 'fs lq /path/to/mirror' since the mirror is on its own volume | 18:16 |
| mordred | clarkb: jeblair and I talked yesterday about installing shade from source on nodepool.o.o for this test, and then releasing if it's all good | 18:16 |
| openstackgerrit | Merged openstack-infra/project-config: zuul/layout: run intergation jobs on puppet-mistral https://review.openstack.org/303772 | 18:17 |
| *** tonytan_brb has quit IRC | 18:17 | |
| mordred | clarkb: just so we don't have to keep playing the release dance if we do find something else | 18:17 |
| mordred | I'm not expecting to - the previous patches worked pretty well except for corner cases, and we've tested corner cases now | 18:17 |
| jeblair | krotscheck, nibalizer: (it's like using 'df' instead of 'du' when you know the think you're interested in is the only thing on a disk) | 18:17 |
| *** sdake_ has joined #openstack-infra | 18:17 | |
| nibalizer | jeblair: ok | 18:18 |
| jeblair | krotscheck, nibalizer: du will work, of course, but the millions of stat calls are going to be way slow | 18:18 |
| clarkb | mordred: jeblair one config bookkeeping item on https://review.openstack.org/#/c/299679/6 | 18:18 |
| dansmith | pabelanger: oh, is that what -nv means? :P | 18:18 |
| clarkb | mordred: jeblair otherwise that change seems fine to me | 18:18 |
| *** tonytan4ever has joined #openstack-infra | 18:18 | |
| *** sdake has quit IRC | 18:19 | |
| nibalizer | ok we are at 268238217 of our 400000000 quota | 18:19 |
| jeblair | clarkb: good catch | 18:19 |
| jeblair | nibalizer, krotscheck: that's getting close to the expected size of the mirror, right? | 18:19 |
| pabelanger | dansmith: yup, see our regex: https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n872 | 18:20 |
| *** jsavak has quit IRC | 18:20 | |
| nibalizer | 255.9G out of 400G | 18:20 |
| krotscheck | jeblair: Yes. Let me ping yahoo real quick to see what their size-on-disk is right now | 18:20 |
| nibalizer | in human usability | 18:20 |
| *** fawadkhaliq has quit IRC | 18:20 | |
| *** jsavak has joined #openstack-infra | 18:20 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Pass extended network information in to occ/shade https://review.openstack.org/299679 | 18:20 |
| mordred | clarkb: thanks! | 18:21 |
| clarkb | mordred: oh you need to add nat_desitnation in too | 18:21 |
| clarkb | mordred: I was super clear on that second part, sorry | 18:21 |
| clarkb | or whatever the non tyoped string is :) | 18:21 |
| dansmith | pabelanger: got it, thanks | 18:22 |
| jeblair | mordred, clarkb: assume a +2 from me on that; gotta run for a bit; back after lunch. | 18:22 |
| pabelanger | dansmith: np | 18:22 |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph devstack-plugin-based job gating on Nova https://review.openstack.org/306009 | 18:22 |
| *** fawadkhaliq has joined #openstack-infra | 18:22 | |
| *** kengo_sakai has joined #openstack-infra | 18:22 | |
| *** ddieterly[away] is now known as ddieterly | 18:22 | |
| krotscheck | jeblair, nibalizer: The yahoo team reports that`df` is reporting around 650GB | 18:23 |
| *** jogo has joined #openstack-infra | 18:23 | |
| krotscheck | In tarballed JavaScript. | 18:23 |
| clarkb | mordred: hopeflly the comment on ps7 is better | 18:23 |
| nibalizer | okay so our current size is 400GB | 18:23 |
| *** ddieterly is now known as ddieterly[away] | 18:23 | |
| *** davidlenwell has quit IRC | 18:23 | |
| krotscheck | That's a lot of isArray | 18:23 |
| *** thingee has joined #openstack-infra | 18:23 | |
| *** fawadkhaliq has quit IRC | 18:24 | |
| clarkb | mordred: let me know if you have more questions | 18:24 |
| fungi | krotscheck: isDisarray | 18:24 |
| fungi | also maybe some isDatarray | 18:24 |
| amrith | fungi, am in a meeting. sure, will ping you after. | 18:24 |
| fungi | amrith: there's no hurry, thanks | 18:24 |
| clarkb | krotscheck: thats amazing because that is mor ethan pypi and ubuntu trusty combined | 18:25 |
| krotscheck | fungi: If you think leftpad was bad... https://github.com/juliangruber/isarray/blob/master/index.js | 18:25 |
| *** tqtran has quit IRC | 18:25 | |
| krotscheck | clarkb: I... have no good explanation. | 18:25 |
| krotscheck | I mean, yeah, we're talking 260K packages. | 18:25 |
| krotscheck | clarkb: http://www.modulecounts.com/ | 18:26 |
| clarkb | krotscheck: is this transitively pulling externally hosted packages too or just pointing to them? | 18:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Pass extended network information in to occ/shade https://review.openstack.org/299679 | 18:27 |
| mordred | clarkb: how's that? | 18:27 |
| *** hdd has joined #openstack-infra | 18:27 | |
| *** kengo_sakai has quit IRC | 18:27 | |
| krotscheck | clarkb: No externally hosted packages, only the ones on NPM. | 18:27 |
| clarkb | mordred: ya that'll do it, I think we can do some cleanup in the part where you set up the data for occ but for now this is fine | 18:28 |
| *** jamesmcarthur has joined #openstack-infra | 18:28 | |
| clarkb | mordred: basically would be nice to use the parsed config instead of the raw yaml results | 18:28 |
| krotscheck | jeblair: I guess we need to bump the quota to 1 TB for now, and then I'll talk with the registry-static guys about version deprecation. | 18:28 |
| *** tiswanso has quit IRC | 18:28 | |
| clarkb | krotscheck: are npm packages compressed? | 18:28 |
| krotscheck | clarkb: tgz | 18:28 |
| clarkb | ok, so we won't win anything by compressing on our end | 18:29 |
| mordred | clarkb: I'm not sure what you mean? | 18:29 |
| clarkb | mordred: https://review.openstack.org/#/c/299679/8/nodepool/config.py line 315 | 18:29 |
| krotscheck | clarkb: Yep. There is inconsistent usage of external dependencies. Some packages still vendor. | 18:29 |
| clarkb | mordred: that is taking the raw yaml parsed data and not the nodepool config parsed data | 18:29 |
| openstackgerrit | Merged openstack/diskimage-builder: Support to add certificate in ironic-agent https://review.openstack.org/295203 | 18:30 |
| mordred | clarkb: oh, yeah | 18:30 |
| krotscheck | clarkb: And, as scope: the NPM mirror was 400GB last June | 18:30 |
| krotscheck | According to yahoo. | 18:30 |
| clarkb | mordred: but that function hsa been doing that already so I won't suggset we fix it in this change | 18:30 |
| mordred | yah. agree | 18:30 |
| *** kzaitsev_mb has joined #openstack-infra | 18:30 | |
| *** tiswanso has joined #openstack-infra | 18:30 | |
| *** davidlenwell has joined #openstack-infra | 18:31 | |
| *** daemontool has quit IRC | 18:31 | |
| nibalizer | jeblair: so fs setquota /afs/.openstack/mirror/npm 1000000000 ? | 18:31 |
| *** sdake_ is now known as sdake | 18:32 | |
| clarkb | nibalizer: krotscheck make sure we have that much disk backing afs first | 18:32 |
| clarkb | iirc it is a single 1TB volume currently | 18:32 |
| nibalizer | right | 18:32 |
| nibalizer | so where is afs backed right now? | 18:32 |
| nibalizer | afs1? | 18:32 |
| nibalizer | afs01 rather? | 18:32 |
| *** achanda has joined #openstack-infra | 18:33 | |
| openstackgerrit | Merged openstack-infra/zuul: Log 'Received unrecognized event type' as warning https://review.openstack.org/266998 | 18:33 |
| clarkb | nibalizer: there are two afs01s, one in dfw and one in ord iirc | 18:33 |
| clarkb | nibalizer: dfw is acting as rw "master" and ord and ro "slave" | 18:33 |
| clarkb | nibalizer: I think you want to add a second 1TB volume to each, do lvm magic to add to the vg and extend the fs | 18:33 |
| clarkb | but I will defer to jeblair and mordred on that | 18:33 |
| nibalizer | /dev/mapper/main-vicepa 985G 685G 300G 70% /vicepa | 18:34 |
| *** _ari_ has quit IRC | 18:34 | |
| *** pradk has joined #openstack-infra | 18:34 | |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: Add release notes jobs for trove-dashboard https://review.openstack.org/306018 | 18:34 |
| *** _ari_ has joined #openstack-infra | 18:35 | |
| *** baoli has joined #openstack-infra | 18:35 | |
| mordred | clarkb, nibalizer: yes. that is correct | 18:35 |
| mordred | although we can also just add a second partition to afs | 18:35 |
| mordred | so let's wait for jeblair to chime in | 18:35 |
| nibalizer | mordred: im having a hard time associating cinder volumes to afs backing store | 18:35 |
| clarkb | mordred: in both cases we need a second volume right? that would just change whether we extend existing fs or make new fs? | 18:36 |
| *** thiagop has joined #openstack-infra | 18:36 | |
| mordred | yes. | 18:36 |
| nibalizer | oh im seeing it now | 18:36 |
| nibalizer | cinder gives us /dev/xvdb1 whcih we lvm on and put in a vg called 'main' | 18:36 |
| *** austin81 has joined #openstack-infra | 18:36 | |
| clarkb | nibalizer: yes we have decent docs for our lvm stuff | 18:36 |
| nibalizer | then we make one lv called vicepa | 18:36 |
| *** nadya has quit IRC | 18:37 | |
| nibalizer | then we just mount as /dev/main/vicepa /vicepa ext4 errors=remount-ro,barrier=0 0 2 | 18:37 |
| *** achanda has quit IRC | 18:37 | |
| fungi | nibalizer: http://docs.openstack.org/infra/system-config/sysadmin.html#cinder-volume-management | 18:37 |
| fungi | mostly covers the details of what we're doing | 18:38 |
| *** matrohon has quit IRC | 18:38 | |
| fungi | minus the afs-specific pieces | 18:38 |
| *** jsavak has quit IRC | 18:39 | |
| fungi | but since afs is just referring to the local filesystem, it doesn't really care about the cinser/lvm layers anyway | 18:39 |
| *** matrohon has joined #openstack-infra | 18:39 | |
| fungi | s/cinser/censor/ | 18:39 |
| clarkb | not to throw a wrench in the works but would it be owrthwhile considering using something like pypi-mirror that only mirrors the packages that are used? | 18:39 |
| clarkb | (I am generally not a fan of this appraoch because it makes snycing more of a pain | 18:40 |
| nibalizer | so i think clarkb is basically correct | 18:40 |
| nibalizer | we can attach more cinder, add that to lvm | 18:40 |
| nibalizer | ]then grow the ext4 in /vicepa | 18:40 |
| nibalizer | then does afs just figure it out? | 18:40 |
| fungi | afs has specific quotas | 18:40 |
| nibalizer | looks like we added /vicepa with vos create $FILESERVER a $VOLUMENAME | 18:40 |
| nibalizer | so we didn't inform afs of the size of /vicepa | 18:41 |
| mordred | that is correct | 18:41 |
| fungi | but afaik you have to match teh quotas to your expectations for the backing filesystem(s) | 18:41 |
| nibalizer | fungi: i'm wondering about the backing storage | 18:41 |
| mordred | this is one of the reasons afs works so well on top of an RBD device | 18:41 |
| openstackgerrit | Merged openstack-infra/zuul: Update merge status after merge:merge is submitted https://review.openstack.org/128921 | 18:41 |
| mordred | it will happily consider the underlying data storage capabilities to be pretty much infinite | 18:41 |
| *** vilobhmm11 has quit IRC | 18:41 | |
| *** vilobhmm11 has joined #openstack-infra | 18:42 | |
| clarkb | nibalizer: basically afs will let you over or under subscribe quota and doesn't directly map to real storage | 18:42 |
| clarkb | nibalizer: so you have to make sure that you are managing that with enough storage underneath | 18:42 |
| nibalizer | ok | 18:42 |
| mordred | yup | 18:42 |
| nibalizer | so now that I know /how/ to increase AFS backed storage | 18:43 |
| nibalizer | do we want to go that route? | 18:43 |
| *** ociuhandu has quit IRC | 18:43 | |
| *** flwang1 has joined #openstack-infra | 18:43 | |
| *** tosky has quit IRC | 18:45 | |
| *** tosky has joined #openstack-infra | 18:45 | |
| fungi | well, the main downside (as we've witnessed from logs.o.o) is that more cinder volumes means higher risk of one of them getting disconnected | 18:47 |
| fungi | multiple single points of failure | 18:47 |
| fungi | we do still have 24gb unused on /dev/xvdb1 which we could vgextend into, though that's not much | 18:49 |
| jeblair | heh, rounding error? :) | 18:49 |
| *** jsavak has joined #openstack-infra | 18:49 | |
| AJaeger | clarkb, project-config cores, could you review https://review.openstack.org/305043, please? that's my change for using pybabel and reenabling sync of translations | 18:49 |
| fungi | er, lvextend into | 18:49 |
| fungi | yeah, 1024gb partition for the pv, but the lv was created as 1000g | 18:50 |
| *** thingee has quit IRC | 18:50 | |
| nibalizer | fungi: jeblair if we lose a cinder volume under afs on afs01.dfw what happens? | 18:50 |
| nibalizer | does afs freak out or fail over to the clone in the other region? | 18:50 |
| *** baoli has quit IRC | 18:51 | |
| *** hdd has quit IRC | 18:51 | |
| clarkb | nibalizer: for reads it should read off other host | 18:51 |
| fungi | nibalizer: for afs we're actually in slightly better shape than logs/static because we have a hot standby replica | 18:51 |
| clarkb | nibalizer: for writes they will fail until we promote the ro one iirc | 18:51 |
| fungi | which we can also turn into the primary if we need to rebuild | 18:51 |
| fungi | yeah | 18:51 |
| jeblair | but yeah, fungi has nailed the trade-off -- we can add a new afs partition which will make us less suceptible to a cinder hiccup but more finicky to manage (distributing volumes amongst partitions of fixed sizes); or we can grow the existing partition (opposite trade-off) | 18:51 |
| fungi | so i really don't think adding a second 1tb cinder volume to each of them is particularly terrible in this case | 18:51 |
| fungi | given there is a non-read-downtime fallback scenario | 18:52 |
| nibalizer | adding more space to the existing afs partition sounds simpler from an afs management perspective | 18:52 |
| nibalizer | which is what I think we should optimise for since so many of the admins are not experienced with afs | 18:52 |
| jeblair | (you can move partitions amongst volumes with vos move, so we can move them around to optimize space as they change, if we're into that sort of thing) | 18:52 |
| jeblair | (and there are actually programs to do that automatically if you're into *that* sort of thing) | 18:53 |
| *** esikachev has quit IRC | 18:53 | |
| *** pvaneck_ has joined #openstack-infra | 18:53 | |
| openstackgerrit | Merged openstack-infra/project-config: Add logic check for xenial APT mirrors https://review.openstack.org/305884 | 18:53 |
| jeblair | but yeah, if we're willing to double our chances of getting hit by a cinder bullet, growing the partition is simpler | 18:53 |
| *** baoli has joined #openstack-infra | 18:53 | |
| fungi | are there programs to manage those programs for people into <<that>> sort of thing? | 18:53 |
| *** esker has joined #openstack-infra | 18:54 | |
| fungi | we cater to all types of geeky obsession after all | 18:54 |
| jeblair | fungi: yes, it's called "bos" -- the "basic overseer" | 18:54 |
| jeblair | and we're running it | 18:54 |
| fungi | hah | 18:54 |
| mordred | jeblair: one of those programs is written in fortran | 18:54 |
| Shrews | mordred: jeblair: that nodepool failure is sufficiently hard to reproduce :( | 18:54 |
| mordred | Shrews: booo | 18:54 |
| jeblair | (it's what runs the fileserver processes) | 18:54 |
| Shrews | mordred: has this been seen anywhere outside that one patchset? | 18:55 |
| nibalizer | i can't help feeling like our distributed-ish filesystem needs more zookeeper | 18:55 |
| fungi | making a compressed tarball of the nodepool debug logs from the old server (now that i've researched what i needed and updated the rax ticket again) but it's taking a _while) | 18:55 |
| nibalizer | one thing im seeing is that if we lost a cinder volume on the rw afs server, reads would just hit the ro server, and we probably wouldn't even know we lost the disk until someone showed up to complain that the mirrors are out of sync | 18:56 |
| fungi | going to stick it in my homedir on the new nodepool server once done, in case anyone needs it | 18:56 |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306031 | 18:56 |
| nibalizer | fungi: thanks | 18:56 |
| *** yamahata has quit IRC | 18:56 | |
| AJaeger | sdague, rossella_ this is what I needed to have gerrit-dash-creator run standalone: https://review.openstack.org/306027 | 18:57 |
| jeblair | nibalizer: yeah, we could use some nagios up in this. | 18:57 |
| *** pvaneck has quit IRC | 18:57 | |
| nibalizer | jeblair: that wasn't actually a call for monitoring, just pointing out the pitfalls of HA | 18:58 |
| nibalizer | i know monitoring and alerting is a divisive conversation with this group | 18:58 |
| sdague | AJaeger: looks reasonable to me | 18:58 |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306031 | 18:58 |
| AJaeger | sdague: then you can release ;) | 18:59 |
| *** tqtran has joined #openstack-infra | 18:59 | |
| sdague | ok, well i'm going for a walk right now to get some outside time. Lets talk in the morning. | 18:59 |
| AJaeger | sdague: after the zuul change is in: https://review.openstack.org/306004 | 18:59 |
| AJaeger | sdague: enjoy! | 18:59 |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306034 | 19:00 |
| *** e0ne has joined #openstack-infra | 19:01 | |
| *** jaosorior has quit IRC | 19:01 | |
| *** sdake has quit IRC | 19:02 | |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306034 | 19:02 |
| *** ociuhandu has joined #openstack-infra | 19:02 | |
| jeblair | nibalizer: monitoring: not divisive -- alerting: warrants conversation :) | 19:02 |
| jeblair | nibalizer, fungi, mordred, clarkb: so are we comfortable with/decided on 'expand vicepa partition to 2TB'? | 19:04 |
| jeblair | pabelanger: ^ | 19:04 |
| fungi | jeblair: wfm | 19:04 |
| clarkb | jeblair: yup sounds good | 19:04 |
| nibalizer | i like it | 19:04 |
| nibalizer | i am happy to do the work too | 19:04 |
| jeblair | nibalizer: all yours; i'm going to grab some food now, but will be back in a bit | 19:05 |
| *** sdake has joined #openstack-infra | 19:05 | |
| nibalizer | ok | 19:05 |
| nibalizer | jeblair: one thing before you run off | 19:06 |
| clarkb | fungi: you have rax-ord under control? I too will be lunching in a few if so | 19:06 |
| nibalizer | is there a command i can type to see all the servers that the afs partition is synced to? | 19:06 |
| nibalizer | since i'll need to expand every readonly as well as the readwrites | 19:06 |
| *** flepied has joined #openstack-infra | 19:06 | |
| clarkb | nibalizer: I remember finding one in command history on one of the servers | 19:07 |
| clarkb | something like listpart | 19:07 |
| jeblair | nibalizer: 'vos listvldb' will show you the whole database | 19:07 |
| nibalizer | thanks | 19:07 |
| fungi | clarkb: yeah, i updated our ticket with rax giving them the corresponding uuids for the example logs i'd linked earlier showing obvious packet loss in traceroutes to git.o.o from ord | 19:08 |
| *** trown is now known as trown|afk | 19:08 | |
| fungi | clarkb: picked four especially nasty looking failed traceroutes to better get their attention | 19:08 |
| jeblair | nibalizer: and 'vos -help' may show some similar commands (like listpart) | 19:08 |
| clarkb | fungi: oh did we hvae traceroutes that showed packet loss? the only ones I saw seemed to traceroute fine then fail on git later | 19:08 |
| clarkb | fungi: nice | 19:08 |
| *** Nisha has quit IRC | 19:09 | |
| fungi | clarkb: yeah, there are a number of them where traceroute never even reached git.o.o after 30 hops, or showed intermittent packet loss at some hops | 19:09 |
| fungi | and the jobs running on them all failed fairly early on reaching git.o.o (often the first attempt) | 19:09 |
| jeblair | nibalizer: ('vldb' == 'volume location database' if that helps make sense of things) | 19:09 |
| fungi | clarkb: i also let them know we're seeing similar (but less frequent) examples of the same between hosts in dfw even | 19:10 |
| *** esker has quit IRC | 19:10 | |
| vilobhmm11 | clarkb, fungi : not clear with the instructions [http://docs.openstack.org/infra/system-config/irc.html#access] to register newly created group chat with a channel ..need help | 19:10 |
| *** mylu has joined #openstack-infra | 19:10 | |
| *** esker has joined #openstack-infra | 19:10 | |
| *** maishsk has quit IRC | 19:10 | |
| *** maishsk has joined #openstack-infra | 19:11 | |
| *** maishsk has quit IRC | 19:11 | |
| fungi | vilobhmm11: it doesn't help that freenode's documentation is all gone now | 19:11 |
| *** maishsk has joined #openstack-infra | 19:11 | |
| *** maishsk has quit IRC | 19:11 | |
| *** maishsk has joined #openstack-infra | 19:11 | |
| vilobhmm11 | fungi : how do i register newly created group https://review.openstack.org/#/c/304882/ | 19:11 |
| fungi | vilobhmm11: ahh, here we are, they merely shuffled it around https://freenode.net/news/registering-a-channel-on-freenode | 19:12 |
| *** andymaier has joined #openstack-infra | 19:12 | |
| vilobhmm11 | fungi : let me give it a try…as i am getting http://logs.openstack.org/82/304882/1/check/gate-project-config-irc-access/614f80b/console.html#_2016-04-12_21_55_48_223 | 19:12 |
| fungi | vilobhmm11: we mostly avoid documenting other people's systems (such as freenode) as long as they document them, but i agree our documentation could benefit from a link to that | 19:13 |
| *** e0ne has quit IRC | 19:13 | |
| * fungi proposes | 19:13 | |
| *** ddieterly[away] is now known as ddieterly | 19:14 | |
| vilobhmm11 | fungi : is there a specific place from where this command should be executed "/msg ChanServ info ##channelname" | 19:14 |
| fungi | vilobhmm11: in your irc client while connected to the freenode irc network. if your irc client is configured to connect to multiple irc networks, make sure you do it within the context of your the freenode connection | 19:15 |
| *** tosky has quit IRC | 19:15 | |
| fungi | vilobhmm11: i probably can't help much on explaining whichever irc client you're using though. there are lots of them | 19:15 |
| *** ddieterly is now known as ddieterly[away] | 19:16 | |
| vilobhmm11 | fungi : that helps | 19:16 |
| vilobhmm11 | thanks! | 19:16 |
| *** amrith is now known as _amrith_ | 19:16 | |
| fungi | vilobhmm11: also note that you can just use #openstack-dev if nobody on your team is well-versed in running your own channel. it's certainly not a requirement | 19:16 |
| *** tosky has joined #openstack-infra | 19:16 | |
| AJaeger | vilobhmm11: and then later setup your own channel if needed... | 19:17 |
| vilobhmm11 | fungii, AJaeger : ok | 19:18 |
| vilobhmm11 | thanks! | 19:18 |
| *** nadya has joined #openstack-infra | 19:19 | |
| *** ddieterly[away] is now known as ddieterly | 19:20 | |
| *** matrohon has quit IRC | 19:20 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Correct link to Freenode channel guidelines https://review.openstack.org/306042 | 19:22 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Link to Freenode's channel registration FAQ https://review.openstack.org/306043 | 19:22 |
| *** baoli has quit IRC | 19:22 | |
| fungi | vilobhmm11: ^ | 19:22 |
| *** fitoduarte has quit IRC | 19:22 | |
| *** e0ne has joined #openstack-infra | 19:22 | |
| *** baoli has joined #openstack-infra | 19:22 | |
| *** esker has quit IRC | 19:23 | |
| vilobhmm11 | fungi : cool that was quick ! :) | 19:23 |
| *** flwang1 has quit IRC | 19:23 | |
| fungi | vilobhmm11: benefits of documentation as code ;) | 19:23 |
| vilobhmm11 | fungi : ha ! :) | 19:23 |
| *** fitoduarte has joined #openstack-infra | 19:23 | |
| *** matrohon has joined #openstack-infra | 19:23 | |
| vilobhmm11 | fungi : you have my +1 :P | 19:23 |
| fungi | team: i'm going to rebuild the cirrussearch index for the wiki. it's supposed to be doable without taking the wiki offline, but it will cause the search to cease working entirely rather than simply returning stale/incomplete results. any objections? | 19:23 |
| *** dloi has joined #openstack-infra | 19:24 | |
| *** ramishra has joined #openstack-infra | 19:24 | |
| fungi | i should say, it should _temporarily_ cause the search to cease working | 19:24 |
| fungi | if it cases it to indefinitely stop working, we have larger problems | 19:24 |
| *** yamahata has joined #openstack-infra | 19:24 | |
| clarkb | fungi: cirrus or elasticsearch? | 19:24 |
| clarkb | fungi: I thought wiki used es now | 19:24 |
| fungi | clarkb: cirrus uses elasticsearch | 19:24 |
| clarkb | ah | 19:24 |
| fungi | this https://git.wikimedia.org/blob/mediawiki%2Fextensions%2FCirrusSearch.git/HEAD/README | 19:25 |
| fungi | linked from http://docs.openstack.org/infra/system-config/wiki.html#mediawiki-upgrades | 19:25 |
| fungi | we're normally supposed to do it when updating the cirrussearch extension in the inactive slot, but based on my reading it's just going to break searches until it finishes if i run it in the live slot | 19:26 |
| *** ddieterly has quit IRC | 19:27 | |
| *** LaT0rtue has joined #openstack-infra | 19:28 | |
| *** fitoduarte has quit IRC | 19:28 | |
| fungi | jeblair: okay, i've archived the old nodepool server's debug logs to the new server in ~fungi/old_debug_logs.tar.xz so you can delete that copy of the old server you booted at your convenience (or i can if you prefer) | 19:28 |
| fungi | took forever to compress, but xz squeezed it down to 190mb | 19:29 |
| *** ramishra has quit IRC | 19:29 | |
| *** harlowja has quit IRC | 19:31 | |
| fungi | okay, starting wiki search reindexing now | 19:32 |
| *** HeOS has quit IRC | 19:33 | |
| *** vgridnev has quit IRC | 19:33 | |
| fungi | still going... don't recall how long it takes but will let you know once it's done and ready for testing | 19:34 |
| fungi | seems to be indexing 26-27 pages a second | 19:34 |
| mriedem | dansmith: was in a meeting, i see you've been a busy beaver https://review.openstack.org/#/c/306009/ | 19:34 |
| mordred | jeblair: https://review.openstack.org/#/c/299679/ wanna knock this over the edge so that we can give a nodepool restart a try? | 19:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/grafyaml: Add support for influxdb datasource https://review.openstack.org/306050 | 19:35 |
| mordred | Shrews: nope. haven't seen it in the wild anywhere | 19:35 |
| *** e0ne has quit IRC | 19:35 | |
| *** harlowja has joined #openstack-infra | 19:36 | |
| *** HeOS has joined #openstack-infra | 19:37 | |
| *** jsavak has quit IRC | 19:37 | |
| mriedem | dansmith: what about voting for cinder and glance, that was kind of the original deal | 19:39 |
| mriedem | with making it gating | 19:39 |
| smcginnis | mriedem: We have ceph non-voting for cinder. | 19:40 |
| mriedem | smcginnis: yeah, and dansmith has a patch up to make it voting again for nova | 19:41 |
| smcginnis | I haven't looked at the stability lately. | 19:41 |
| smcginnis | The long term goal was to make it voting. | 19:41 |
| *** esker has joined #openstack-infra | 19:41 | |
| mriedem | smcginnis: my understanding from dansmith is it's stable, except for when we've regressed it the last two times b/c we didn't notice since it was non-voting | 19:42 |
| fungi | wiki search reindex completed. sdague: want to retry your searches and see if that fixed them? | 19:42 |
| fungi | whenever you return from your walk that is | 19:42 |
| smcginnis | mriedem: Definitely the risk in having it non-voting. Gets too easy to ignore the red. | 19:42 |
| fungi | sdague: found your example in scrollback, it now returns 57 hits: https://wiki.openstack.org/w/index.php?search=Newton&fulltext=Search | 19:44 |
| *** Nikolay_St has joined #openstack-infra | 19:44 | |
| nibalizer | woot cinder attach works | 19:44 |
| nibalizer | weird that nothing shows up in dmesg | 19:44 |
| nibalizer | i would have excpected some excited messages | 19:45 |
| fungi | nibalizer: that is indeed weird | 19:45 |
| fungi | it normally does | 19:45 |
| *** tosky has quit IRC | 19:45 | |
| fungi | nibalizer: afs01.dfw.openstack.org? | 19:45 |
| *** e0ne has joined #openstack-infra | 19:45 | |
| nibalizer | "I FOUND A DISK!" | 19:45 |
| *** e0ne has quit IRC | 19:45 | |
| nibalizer | fungi: yes | 19:45 |
| fungi | [Thu Apr 14 19:44:30 2016] xvdc: unknown partition table | 19:45 |
| *** tosky has joined #openstack-infra | 19:45 | |
| nibalizer | ya thats more recent | 19:45 |
| smcginnis | nibalizer: What kind of backend? iSCSI or FC you should get all kinds of SCSI device messages. | 19:45 |
| nibalizer | smcginnis: $rackspace | 19:46 |
| smcginnis | Ah... | 19:46 |
| *** _amrith_ is now known as amrith | 19:46 | |
| nibalizer | fungi: but nothing thats like 'i found a disk, it was attached, etc' | 19:46 |
| fungi | smcginnis: this is in rackspace public cloud. no idea but we normally get more details in dmesg | 19:46 |
| nibalizer | and lsblk showed me xvdc before those two messages appeard | 19:46 |
| fungi | nibalizer: oh, i'm thinking of what we see when we reattach an already partitioned volume, since we get the partition scan triggered in the kernel | 19:46 |
| nibalizer | oh sure | 19:47 |
| smcginnis | fungi: Yeah, not sure what they have now, but I would think there would be something. | 19:47 |
| mriedem | smcginnis: http://tinyurl.com/j7d7555 | 19:47 |
| nibalizer | well this isn't a problem, just something I am noticing | 19:47 |
| *** sdake_ has joined #openstack-infra | 19:47 | |
| fungi | nibalizer: could also just be the events are below the klog threshold for dmesg | 19:47 |
| smcginnis | mriedem: Hmm, not as good as I'd like to see it to make it voting. | 19:47 |
| mriedem | smcginnis: it tracks the normal gate job | 19:47 |
| mriedem | except for an obvious regression on 4/11 | 19:48 |
| smcginnis | But then again, yeah... | 19:48 |
| smcginnis | So probably safe I suppose. | 19:48 |
| smcginnis | And if/when it does break, it will be a whole lot more obvious. | 19:48 |
| *** Nikolay_St has quit IRC | 19:48 | |
| *** sdake has quit IRC | 19:49 | |
| *** aeng has joined #openstack-infra | 19:50 | |
| *** matrohon has quit IRC | 19:50 | |
| openstackgerrit | Merged openstack-infra/project-config: Gnocchi: Fix gate stable jobs https://review.openstack.org/305645 | 19:53 |
| *** matrohon has joined #openstack-infra | 19:53 | |
| *** thingee has joined #openstack-infra | 19:53 | |
| *** mylu has quit IRC | 19:54 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add more lvm commands to cinder documentation https://review.openstack.org/306059 | 19:55 |
| *** akscram has quit IRC | 19:58 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/yaml2ical: Fix off by 1 error in batch_messages & add unit tests https://review.openstack.org/305528 | 19:58 |
| *** akscram has joined #openstack-infra | 19:59 | |
| dansmith | mriedem: sorry was on a call | 19:59 |
| *** mylu has joined #openstack-infra | 19:59 | |
| dansmith | mriedem: the one regression was a fix for a CVE that broke any non-lvm imagebackend | 20:00 |
| dansmith | mriedem: er, non-fs I mean | 20:00 |
| dansmith | mriedem: so I broke lvm, ceph, any any other like it | 20:00 |
| dansmith | mriedem: and it was just a miss accounting for that kind of storage in the patch, developer tested on a laptop with a filesystem back | 20:01 |
| nibalizer | nice | 20:01 |
| nibalizer | cinder list doesn't work in ORD | 20:01 |
| nibalizer | ERROR: publicURL endpoint for volumev2 service in ORD region not found | 20:01 |
| mriedem | dansmith: this was in nova or cinder or downstream? | 20:02 |
| dansmith | mriedem: no, nova upstream | 20:02 |
| mriedem | within the last week? | 20:03 |
| mriedem | i remember the other cve thing from awhile ago | 20:03 |
| mriedem | dansmith: was specifically wondering about the spike around 4/11 here http://tinyurl.com/j7d7555 | 20:04 |
| dansmith | oh, 4/11 | 20:04 |
| dansmith | mriedem: yeah, not sure about that one | 20:05 |
| dansmith | mriedem: oh, that was monday morning | 20:05 |
| mriedem | i didn't see anything that looked ceph related in cinder/glance/nova in the last week | 20:05 |
| *** baoli has quit IRC | 20:05 | |
| dansmith | mriedem: lots of times we get like one job over the weekend that fails because we're check only and that looks like a terrible fail rate for a few hours | 20:05 |
| *** baoli has joined #openstack-infra | 20:05 | |
| mriedem | ah ok | 20:05 |
| dansmith | mriedem: if I push up a bad patch and recheck it three times when nothing else is passing that will look worse, | 20:06 |
| dansmith | but there is always enough volume on the base job to have a decent pass rate | 20:06 |
| mriedem | dansmith: ok, so i think we should make it voting for cinder also | 20:06 |
| dansmith | mriedem: that's cool, I just didn't want to force it on them | 20:06 |
| mordred | nibalizer: export OS_VOLUME_API_VERSION=1 | 20:06 |
| dansmith | I want it on nova | 20:06 |
| dansmith | mriedem: if smcginnis is cool with it, I'm on board of course :) | 20:06 |
| nibalizer | mordred: i figured it out | 20:06 |
| mordred | nibalizer: which is in the cinder.sh script in ci-launch | 20:06 |
| mriedem | dansmith: yeah, but they can land something that can break nova's gate | 20:06 |
| nibalizer | there are some hints in the cinder.sh script | 20:06 |
| mordred | yah | 20:07 |
| mordred | but also, I recommend osc | 20:07 |
| smcginnis | Reading scrollback... | 20:07 |
| mordred | and clouds.yaml | 20:07 |
| dansmith | mriedem: I know | 20:07 |
| nibalizer | mordred: and that works? | 20:07 |
| smcginnis | dansmith: Yeah, that sounds good to me. | 20:07 |
| dansmith | smcginnis: cool, I'll change it | 20:07 |
| smcginnis | dansmith: Thanks! | 20:07 |
| mriedem | dansmith: i'm less sure about making it voting for glance though since it's really glance-store that does the rbd work | 20:07 |
| nibalizer | mordred: im happy to use it, but I don't know the invocation | 20:07 |
| mriedem | and we don't have a -src job for the ceph plugin config to use on glance-store | 20:07 |
| mriedem | unless glance were to do something that broke the driver... | 20:08 |
| *** ayoung has quit IRC | 20:08 | |
| mriedem | we're already running the job on glance, so i'd say hell, just enable that one too | 20:08 |
| mordred | nibalizer: openstack --os-cloud=openstackci-rax --os-region-name=IAD volume list | 20:08 |
| mordred | nibalizer: fwiw | 20:08 |
| fungi | nibalizer: it's mostly the same except replace "nova" with "openstack server" and "cinder" with "openstack volume" | 20:09 |
| mordred | nibalizer: you can also set OS_CLOUD and OS_REGION_NAME | 20:09 |
| nibalizer | mordred: sweet | 20:09 |
| fungi | i want to say clarkb ran into a minor discrepancy with attach though | 20:10 |
| mordred | probably | 20:10 |
| fungi | i don't recall the details atm | 20:10 |
| mordred | I usually just open a python repl and use shade function calls :) | 20:10 |
| clarkb | attach worked, the things that I tripped on are no listing of volume type ssd/spinning/whatever by default | 20:10 |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph devstack-plugin-based job gating on Nova https://review.openstack.org/306009 | 20:10 |
| fungi | oh, right | 20:10 |
| dansmith | mriedem: that look right? ^ | 20:10 |
| *** _ari_ has quit IRC | 20:11 | |
| clarkb | and on other clouds collisions with /dev/name as reported by nova and what was on the host with config drive | 20:11 |
| *** chem has quit IRC | 20:12 | |
| *** amrith is now known as _amrith_ | 20:12 | |
| jeblair | mordred: yeah, i was trying to tell you to go ahead and +3 it for me while i was at lunch :) but +3d | 20:12 |
| *** flepied has quit IRC | 20:12 | |
| mordred | jeblair: whoops | 20:13 |
| fungi | wow... if you want an example of being bad at ansible... http://www.independent.co.uk/life-style/gadgets-and-tech/news/man-accidentally-deletes-his-entire-company-with-one-line-of-bad-code-a6984256.html | 20:14 |
| krotscheck | fungi: I call that being AWESOME at ansible. | 20:15 |
| fungi | used ansible to `rm -rf {foo}/{bar}` across all servers with {foo} and {bar} empty | 20:15 |
| *** tosky has quit IRC | 20:15 | |
| krotscheck | For a very broad defenition of awesome. | 20:15 |
| mordred | wow | 20:15 |
| fungi | awe inspiring, to be sure | 20:15 |
| *** tosky has joined #openstack-infra | 20:15 | |
| mriedem | can anyone explain why gate-tempest-dsvm-full-ceph-src-glance_store is voting on https://review.openstack.org/#/c/301047/ when the job should be non-voting given https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2330 ? | 20:15 |
| *** denisra has joined #openstack-infra | 20:16 | |
| fungi | also a great explanation of why you should not config-manage your backup servers | 20:16 |
| *** yamamoto has quit IRC | 20:16 | |
| jeblair | do folks believe that? | 20:17 |
| openstackgerrit | Merged openstack-infra/nodepool: Pass extended network information in to occ/shade https://review.openstack.org/299679 | 20:17 |
| krotscheck | It's terrific. i.e. capable of inspiring Terror. | 20:18 |
| fungi | jeblair: i'm skeptical as i've had to clean up after customers in the past who did rm -rf / as root and it only got as far as deleting /bin/rm before it stopped | 20:18 |
| *** tonytan4ever has quit IRC | 20:18 | |
| jeblair | krotscheck: that it is :) | 20:18 |
| jeblair | (true or not) | 20:19 |
| rcarrillocruz | when i read that post, it really sounded as a troll post | 20:19 |
| *** tonytan4ever has joined #openstack-infra | 20:19 | |
| rcarrillocruz | dunno | 20:19 |
| *** mylu_ has joined #openstack-infra | 20:19 | |
| *** sileht has quit IRC | 20:19 | |
| fungi | it very well may be | 20:19 |
| *** sileht has joined #openstack-infra | 20:19 | |
| rcarrillocruz | i mean, why would someone post that in SO to ruin his IT career | 20:19 |
| jeblair | i guess it's truthy enough that it doesn't actually matter whether it's objectively true :) | 20:19 |
| fungi | but i appreciate any story which serves as a reminder to be very, very careful before hitting enter with admin privs | 20:19 |
| jeblair | fungi: my keyboard has TWO enter keys! it's way too easy! | 20:20 |
| fungi | well, you have two hands, so it makes sense? | 20:20 |
| jeblair | 2% of the keys on my keyboard are "enter" | 20:20 |
| *** cody-somerville has joined #openstack-infra | 20:20 | |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: Add release notes jobs for trove-dashboard https://review.openstack.org/306018 | 20:21 |
| *** mylu has quit IRC | 20:22 | |
| *** thingee has quit IRC | 20:22 | |
| *** tosky has quit IRC | 20:22 | |
| *** vgridnev has joined #openstack-infra | 20:23 | |
| *** maishsk has quit IRC | 20:23 | |
| *** mylu_ has quit IRC | 20:24 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/yaml2ical: Fix off by 1 error in batch_messages & add unit tests https://review.openstack.org/305528 | 20:24 |
| *** maishsk has joined #openstack-infra | 20:24 | |
| *** Sukhdev has joined #openstack-infra | 20:25 | |
| *** ramishra has joined #openstack-infra | 20:25 | |
| *** mylu has joined #openstack-infra | 20:25 | |
| *** esker has quit IRC | 20:26 | |
| *** mylu has quit IRC | 20:26 | |
| *** mylu has joined #openstack-infra | 20:27 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Update cinder mgmt docs to use openstackclient https://review.openstack.org/306067 | 20:27 |
| nibalizer | mordred: just for you ^ | 20:27 |
| mordred | nibalizer: woot! | 20:27 |
| jamesmcarthur | I’m sure this is the wrong channel, but someone reported on twitter a broken page on devstack docs (http://docs.openstack.org/developer/devstack/stack.sh.html). Can anyone point me in the right direction? Or should I bring this to the main openstack-dev channel? | 20:28 |
| *** vgridnev has quit IRC | 20:28 | |
| clarkb | jamesmcarthur: devstack has a bug tracker I will get you a link | 20:28 |
| jamesmcarthur | danke! | 20:29 |
| clarkb | jamesmcarthur: https://bugs.launchpad.net/devstack | 20:29 |
| *** vgridnev has joined #openstack-infra | 20:29 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/grafyaml: Add support for influxdb datasource https://review.openstack.org/306050 | 20:29 |
| *** ramishra has quit IRC | 20:29 | |
| jamesmcarthur | https://launchpad.net/~devstack | 20:30 |
| jamesmcarthur | ? | 20:30 |
| jamesmcarthur | ha sorry clarkb: | 20:30 |
| *** ramishra has joined #openstack-infra | 20:30 | |
| jamesmcarthur | thanks for link :) | 20:30 |
| *** esikachev has joined #openstack-infra | 20:30 | |
| mordred | jamesmcarthur: I agree - that page looks very ungood | 20:32 |
| jamesmcarthur | lol | 20:32 |
| *** andymaier has quit IRC | 20:33 | |
| nibalizer | ok our mirror is grown! | 20:34 |
| *** dprince has quit IRC | 20:34 | |
| nibalizer | er afs partition | 20:34 |
| nibalizer | /dev/mapper/main-vicepa 2.0T 697G 1.3T 35% /vicepa | 20:35 |
| nibalizer | mad datas! | 20:35 |
| mordred | nibalizer: SO MUCH DATAS!!!! | 20:35 |
| mordred | nibalizer: look, you're an AFS admin now! | 20:35 |
| *** ramishra has quit IRC | 20:36 | |
| nibalizer | yay | 20:36 |
| jeblair | Volume Name Quota Used %Used Partition | 20:36 |
| jeblair | mirror.npm.readonly 400000000 219699539 55% 35% | 20:36 |
| *** kgiusti has left #openstack-infra | 20:37 | |
| jeblair | and afs partition % == df filesystem % | 20:37 |
| jeblair | so yay | 20:37 |
| fungi | jamesmcarthur: ooh, indeed, that looks pretty terrible. i expect someone meant to wrap that in <pre></pre> or something | 20:38 |
| nibalizer | jeblair: we're closer to 70% on the writeable one | 20:39 |
| nibalizer | ok im gonna jump the npm quota to 1T | 20:39 |
| *** jkeen has joined #openstack-infra | 20:39 | |
| jeblair | nibalizer: i didn't follow the comment about the 'writeable one' | 20:39 |
| nibalizer | jeblair: mirror.npm 400000000 281641042 70% 35% | 20:39 |
| nibalizer | if you look at /afs/.openstack.org/mirror/npm | 20:40 |
| nibalizer | which i think just means we have pulled a lot of data that vos release is slowly getting copied over to our mirror | 20:40 |
| jkeen | I'm trying to push a new tag to gerrit so I can get a new build up on PyPI for monasca-notification and I'm getting an error saying that my push is prohibited by Gerrit. Has the tagging process changed recently? | 20:40 |
| jeblair | nibalizer: oh, yeah, sorry i was just noting the partition size (second number). though i suppose it was a crapshoot whether that was coming from dfw or ord, so your command is better. :) | 20:40 |
| nibalizer | ya | 20:41 |
| nibalizer | i was watting pretty hard because at first it looked like we lost data | 20:41 |
| fungi | jkeen: it's possible you've delegated tagging control to the release team. i'm checking to see if that was part of the acl change which merged yesterday | 20:42 |
| *** r-mibu_ has quit IRC | 20:42 | |
| *** baoli has quit IRC | 20:42 | |
| *** baoli has joined #openstack-infra | 20:43 | |
| nibalizer | krotscheck: jeblair im not sure the mirror is doing what we expect | 20:44 |
| krotscheck | nibalizer: ? | 20:44 |
| krotscheck | nibalizer: You're referring to the @ packages? | 20:44 |
| nibalizer | http://paste.openstack.org/show/494128/ | 20:44 |
| nibalizer | ya | 20:44 |
| nibalizer | that suprised me | 20:44 |
| krotscheck | Those are organizational groupings of packages. | 20:45 |
| fungi | jkeen: dhellmann: it looks like openstack/monasca-notification shares a gerrit acl with openstack/monasca. did you mean to cover both with https://review.openstack.org/298866 ? | 20:45 |
| krotscheck | I didn't realize that they were sorted into their own directories. | 20:45 |
| *** esker has joined #openstack-infra | 20:46 | |
| *** tiswanso has quit IRC | 20:46 | |
| krotscheck | nibalizer, jeblair: The blob store I implemented only sorts [A-Za-z] packages. I'm not certain that we need to change anything though, except maybe verify that the mod_rewrite can handle those. | 20:46 |
| *** r-mibu has joined #openstack-infra | 20:47 | |
| *** baoli has quit IRC | 20:48 | |
| jeblair | i love typing "cd -- -/" | 20:48 |
| fungi | jkeen: dhellmann: the commit message indicates it's for all "official projects" (i guess official projects with release:something other than release:independent?) which would include openstack/monasca-notification (it's release:cycle-with-intermediary) | 20:48 |
| nibalizer | Volume Name Quota Used %Used Partition | 20:49 |
| nibalizer | mirror.npm 1000000000 282962625 28% 35% | 20:49 |
| nibalizer | wooo more quota | 20:49 |
| jeblair | i'm gonna trust you on the zeros there | 20:49 |
| *** ihrachys has joined #openstack-infra | 20:49 | |
| jeblair | omg | 20:49 |
| nibalizer | "in nibz we trust" ? | 20:50 |
| jeblair | i was exploring an \@ | 20:50 |
| jeblair | directory | 20:50 |
| jeblair | picked one at random | 20:50 |
| jeblair | found one package | 20:50 |
| fungi | with a browser? | 20:50 |
| fungi | oh, command line | 20:50 |
| jeblair | fungi: no, with a shell! (AFS!) | 20:50 |
| fungi | indeed | 20:50 |
| jeblair | here is what i found: | 20:50 |
| jeblair | module.exports = function (file) { return file.startsWith('_'); | 20:50 |
| jeblair | }; | 20:50 |
| jeblair | <END OF PACKAGE> | 20:50 |
| *** infra-red has joined #openstack-infra | 20:51 | |
| jeblair | there's another 7k of boilerplate include EXTENSIVE documentation | 20:51 |
| jeblair | this is the "has-private-filename" package | 20:51 |
| fungi | well, clearly that }; needed its own line. otherwise that would have been just another terrible one-liner library | 20:51 |
| *** esker has quit IRC | 20:52 | |
| lifeless | mordred: the ValueError one? | 20:52 |
| jeblair | fungi: oh, sorry, it's really 3 lines (plus 'use strict'). formatting copypasta. | 20:52 |
| fungi | ohhh | 20:52 |
| jeblair | the whitespace use in the module is impeccable. | 20:53 |
| jeblair | anyway, i'm just amused that i picked a package at random and found another isArray. :) | 20:53 |
| *** baoli has joined #openstack-infra | 20:53 | |
| fungi | mordred: lifeless: he also found another regression in 1.9.0 (bug 1570458) he's trying to hack up a solution for now... earlier git annotated lags differently in the log output | 20:54 |
| openstack | bug 1570458 in PBR "pbr 1.9 tag parsing incompatible with older git versions" [Undecided,In progress] https://launchpad.net/bugs/1570458 - Assigned to R. Nortman (r-nortman) | 20:54 |
| *** tosky has joined #openstack-infra | 20:55 | |
| *** harlowja has quit IRC | 20:55 | |
| clarkb | dtroyer: https://bugs.launchpad.net/python-openstackclient/+bug/1570592 submitted | 20:55 |
| openstack | Launchpad bug 1570592 in python-openstackclient "image list pages even when output is not a tty" [Undecided,New] | 20:55 |
| fungi | er, s/lags/tags/ | 20:56 |
| jeblair | clarkb: how sensitive are we to aborted image uploads? are there any critical ones i should make sure get uploaded, or can i restart nodepool? | 20:56 |
| fungi | no idea how i typed lag instead of tag. muscle memory resurfacing from my mud days maybe | 20:56 |
| jeblair | fungi: *took you a while* to notice too | 20:57 |
| clarkb | jeblair: we aren't super sensitive right now, uplaods in build start are currently cleaned up on restart and we don't need new images right now | 20:57 |
| clarkb | jeblair: however | 20:57 |
| jeblair | k. so no critical xenial work or anything... | 20:57 |
| clarkb | if you can get my image fixes in that might be nice | 20:57 |
| clarkb | https://review.openstack.org/300678 and https://review.openstack.org/301401 | 20:57 |
| clarkb | not super urgent I guess, the first one is an on restart problem so can go in before next restart that needs it an the other is a command line client update so will update at any time without a restart | 20:58 |
| clarkb | so ya should be safe | 20:58 |
| fungi | jeblair: indeed | 20:58 |
| fungi | ironic, that | 20:58 |
| jeblair | clarkb: no dib builds happening right now, so 678 won't hit us, but +3d for next time | 20:58 |
| * krotscheck feels personally responsible for the _ package. | 20:59 | |
| jeblair | clarkb: i need to think about 401 -- should i do that now or later? | 20:59 |
| clarkb | jeblair: you can do it later, its an easy enough issue to deal with | 21:00 |
| clarkb | (without the fix) | 21:00 |
| *** rfolco has quit IRC | 21:00 | |
| *** kzaitsev_mb has quit IRC | 21:01 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 21:01 |
| *** jamesmcarthur has quit IRC | 21:01 | |
| clarkb | pabelanger: dansmith sdague ^ thats the reabse and comment addressed | 21:01 |
| clarkb | I am going to go read afs docs now | 21:01 |
| *** weshay has quit IRC | 21:01 | |
| jeblair | clarkb: 401 wfm | 21:01 |
| openstackgerrit | Peter Stachowski proposed openstack-infra/project-config: Add release notes jobs for python-troveclient https://review.openstack.org/301899 | 21:02 |
| jeblair | mordred: i'm going to restart nodepool now | 21:02 |
| jeblair | i have installed shade master | 21:03 |
| *** aysyd has quit IRC | 21:03 | |
| openstackgerrit | Merged openstack-infra/nodepool: Cleanup building dib images on startup https://review.openstack.org/300678 | 21:03 |
| *** piet_ has joined #openstack-infra | 21:04 | |
| jeblair | mordred, Shrews: http://paste.openstack.org/show/494130/ | 21:04 |
| esikachev | hey guys. who can help with nodepool? | 21:05 |
| openstackgerrit | Merged openstack-infra/nodepool: Synchronize image delete with handle completion https://review.openstack.org/301401 | 21:06 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config: Add pylint job to cinderclient experimental https://review.openstack.org/306080 | 21:06 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add domain_id param to project operations https://review.openstack.org/291701 | 21:07 |
| *** bdemers_ has joined #openstack-infra | 21:07 | |
| *** maishsk has quit IRC | 21:07 | |
| *** claudiub|2 has joined #openstack-infra | 21:08 | |
| *** denisra has quit IRC | 21:08 | |
| *** denisra has joined #openstack-infra | 21:09 | |
| nibalizer | btw looks https://rubygems.org/gems/google-api-client released and broke some or all of our beakering | 21:09 |
| nibalizer | pabelanger: want to brush up on fixing beaker ? :P | 21:09 |
| *** bdemers has quit IRC | 21:09 | |
| *** denisra has quit IRC | 21:10 | |
| *** denisra has joined #openstack-infra | 21:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Revert the switch to shade https://review.openstack.org/306081 | 21:11 |
| jeblair | clarkb, mordred: i created a feature/shade branch from master and then i think that ^ will take us back to pre-shade (but with other recent fixes) | 21:11 |
| clarkb | jeblair: did the restart not work? | 21:12 |
| *** denisra has quit IRC | 21:12 | |
| jeblair | clarkb: http://paste.openstack.org/show/494130/ | 21:12 |
| *** denisra has joined #openstack-infra | 21:12 | |
| clarkb | huh | 21:12 |
| openstackgerrit | Randall Nortman proposed openstack-dev/pbr: Fix handling of old git log output https://review.openstack.org/306082 | 21:12 |
| fungi | ouchies | 21:12 |
| *** vilobhmm11 has quit IRC | 21:13 | |
| clarkb | jeblair: when you have a moment, I have read the AFS docs and have a question. The last vos release in the doc says using -localauth is important, shoudl all of the earlier vos releases also use localauth? | 21:13 |
| *** vilobhmm11 has joined #openstack-infra | 21:13 | |
| jeblair | clarkb: any large one should; the small ones where it's empty or mostly empty, not important. | 21:13 |
| clarkb | and large is gigabytes? | 21:14 |
| *** hdd has joined #openstack-infra | 21:14 | |
| *** vilobhmm11 has quit IRC | 21:14 | |
| *** maishsk has joined #openstack-infra | 21:14 | |
| mordred | jeblair: sigh | 21:14 |
| jeblair | clarkb: yeah | 21:14 |
| *** vilobhmm11 has joined #openstack-infra | 21:14 | |
| mordred | jeblair: k. I agree with the feature branch | 21:14 |
| clarkb | ok, going to give these directions a go | 21:15 |
| *** vilobhmm11 has quit IRC | 21:15 | |
| clarkb | I am making mirror/deb-hammer | 21:15 |
| *** vilobhmm11 has joined #openstack-infra | 21:15 | |
| fungi | when you have a deb-hammer, every mirror looks like a nail? | 21:16 |
| mordred | jeblair: next time I will test with ALL of our providers. I spent most of my testing effort this time on "tripleo cloud" and "make sure it works on a non-tripleo cloud" | 21:16 |
| *** yamamoto has joined #openstack-infra | 21:16 | |
| *** ldnunes has quit IRC | 21:17 | |
| jeblair | clarkb: 63GB will take long enough to run past the 10 hour token expiration, so that's the hard limit. but also there's also the softer, earlier limit of "long enough that something might happen to my shell". | 21:17 |
| *** salv-orl_ has joined #openstack-infra | 21:17 | |
| *** infra-red has quit IRC | 21:18 | |
| clarkb | gotcha | 21:19 |
| lifeless | fungi: ack | 21:19 |
| jeblair | i've restarted nodepool pre-shade (not using my revert patch, just manually installed older commit; i want to make sure the revert passes tests) | 21:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstackci: Pin google-api-client https://review.openstack.org/306086 | 21:20 |
| dloi | Hello I was hoping someone can help me figure out why my trove-dashboard patches are not automatically updating the corresponding launchpad bug? | 21:20 |
| *** salv-orlando has quit IRC | 21:20 | |
| dloi | I believe I have added the Closes-Bug: # properly in the commit message. | 21:20 |
| dloi | Here is an example of a patch https://review.openstack.org/#/c/289564/ and the corresponding launchpad bug https://bugs.launchpad.net/trove-dashboard/+bug/1548514 | 21:20 |
| openstack | Launchpad bug 1548514 in trove-dashboard "Add support for logging functions" [Undecided,In progress] - Assigned to Duk Loi (duktesora) | 21:20 |
| dloi | Any help would be appreciated. Thanks. | 21:20 |
| jeblair | dloi: hrm, the bug group looks set up correctly... | 21:21 |
| *** flwang1 has joined #openstack-infra | 21:23 | |
| jeblair | dloi: oh, that patch was uploaded a long time ago, we may not have logs for it | 21:23 |
| *** jamesmcarthur has joined #openstack-infra | 21:23 | |
| dloi | jeblair: let me find you something more recent | 21:23 |
| *** jamesmcarthur has quit IRC | 21:23 | |
| *** yamamoto has quit IRC | 21:24 | |
| *** |-paul-| has joined #openstack-infra | 21:24 | |
| *** jamesmcarthur has joined #openstack-infra | 21:24 | |
| dloi | jeblair: There is this patch https://review.openstack.org/#/c/306040/ and the launchpad bug https://bugs.launchpad.net/trove-dashboard/+bug/1566506 | 21:24 |
| openstack | Launchpad bug 1566506 in trove-dashboard "Wrong font and size for Cancel button in few places" [Undecided,Confirmed] - Assigned to Duk Loi (duktesora) | 21:24 |
| *** hdd has quit IRC | 21:24 | |
| *** thingee has joined #openstack-infra | 21:25 | |
| clarkb | jeblair: I ran kinit clarkb/admin@OPENSTACK.ORG then vos create and got vsu_ClientInit: Could not get afs tokens, running unauthenticated. | 21:25 |
| mordred | clarkb: you need to aklog | 21:25 |
| clarkb | jeblair: kadmin listprincs shows my principal and on afsdb01 I double checked tat I ran the make clarkb.admin an admin commonds | 21:25 |
| *** eharney has quit IRC | 21:25 | |
| mordred | clarkb: after kinit-ing | 21:26 |
| clarkb | aha | 21:26 |
| clarkb | and that is in the docs I am just trying to be too smart | 21:26 |
| * mordred usually likes it when clarkb is smart | 21:26 | |
| jeblair | clarkb: what mordred said -- with kerberos, kinit gets you a ticket-granting-ticket (TGT). then you use that to get a service ticket (or token). aklog does that for afs. klist will show you both afterwords. | 21:26 |
| jeblair | (and if you used kerberized ssh, you'd see service tickets for hosts in the list, etc) | 21:27 |
| clarkb | woo volume created | 21:28 |
| clarkb | (we are going to be reusing the single reprepro service principal I hope that is ok, as far as seuciry goes I think it should be fine) | 21:28 |
| jeblair | dloi: hrm. this is a mystery. there are no errors in the log from that time. | 21:29 |
| clarkb | jeblair: in the addsite command is that implicitly say make ro volume? | 21:30 |
| clarkb | and create is implicitly make rw? | 21:30 |
| jeblair | clarkb: yeah -- since you can only have one rw volume, any additional site you add is implicitly ro | 21:30 |
| dloi | jeblair: other than adding the bug number in the commit message is there something else I need to do or be part of some group or configure some launchpad setting? | 21:30 |
| *** ramishra has joined #openstack-infra | 21:31 | |
| *** Goneri has quit IRC | 21:31 | |
| *** maishsk has quit IRC | 21:32 | |
| craige | o/ | 21:32 |
| dloi | jeblair: I found some old bugs in other repos that had similar symptoms like this https://bugs.launchpad.net/openstack-ci/+bug/1081186. Would something similar need to be done for trove-dashboard? | 21:33 |
| openstack | Launchpad bug 1081186 in OpenStack Core Infrastructure "devstack gerrit commits not updated launchpad bugs" [High,Fix released] - Assigned to James E. Blair (corvus) | 21:33 |
| *** jamesmcarthur has quit IRC | 21:33 | |
| jeblair | dloi: that's the first thing i checked | 21:34 |
| *** IlyaG has quit IRC | 21:34 | |
| *** bdemers has joined #openstack-infra | 21:34 | |
| clarkb | jeblair: pts listentries and listentries -group show me what users and groups are available, but how do I confirm the reprepro service user is a member of the apt-mirror group? | 21:34 |
| jeblair | clarkb: pts membership <group> | 21:35 |
| *** maishsk has joined #openstack-infra | 21:35 | |
| clarkb | oh thats the next line in the doc, so much information in such a little amount of space | 21:37 |
| jeblair | clarkb: was that a whitespace joke? ;) | 21:37 |
| *** ramishra has quit IRC | 21:37 | |
| *** bdemers_ has quit IRC | 21:38 | |
| clarkb | I am going to set quota to 1GB, I don't think the ceph packages will need that much space | 21:38 |
| *** dahoo has joined #openstack-infra | 21:38 | |
| jeblair | dloi: i'm still debugging; will take a few mins | 21:39 |
| dloi | jeblair: thx for your help it's much appreciated | 21:39 |
| *** matrohon has quit IRC | 21:41 | |
| *** thorst_ has quit IRC | 21:41 | |
| *** vilobhmm11 has quit IRC | 21:42 | |
| *** vilobhmm11 has joined #openstack-infra | 21:42 | |
| *** thorst_ has joined #openstack-infra | 21:42 | |
| clarkb | anyone know what is going on with http://logs.openstack.org/55/293155/10/check/gate-openstackci-beaker-ubuntu-trusty/bc37594/console.html#_2016-04-14_21_06_02_278 ? looks like our ruby is too old for one of our gem deps? | 21:42 |
| clarkb | pabelanger: nibalizer crinkle ^ | 21:42 |
| jeblair | clarkb: https://review.openstack.org/306086 | 21:43 |
| openstackgerrit | Brad Pokorny proposed openstack/requirements: Pin the Django OpenStack Auth version https://review.openstack.org/306089 | 21:43 |
| *** dimtruck is now known as zz_dimtruck | 21:43 | |
| clarkb | okthat did pass openstackci beaker testing so I am approving | 21:44 |
| nibalizer | clarkb: yep | 21:44 |
| Shrews | jeblair: mordred: ugh. why we no find? | 21:45 |
| *** vilobhmm11 has quit IRC | 21:45 | |
| nibalizer | clarkb: well its bad | 21:45 |
| nibalizer | we have to do another patch-every puppet module | 21:45 |
| *** vilobhmm11 has joined #openstack-infra | 21:45 | |
| openstackgerrit | Brad Pokorny proposed openstack/requirements: Pin the Django OpenStack Auth version https://review.openstack.org/306089 | 21:45 |
| nibalizer | so apologies in advance for the spam on that | 21:45 |
| clarkb | nibalizer: any idea why we need a google api client? | 21:46 |
| jlvillal | tonyb: I think https://review.openstack.org/#/c/305528/ is ready. Added the docstring and I think the unit tests look better too. | 21:46 |
| crinkle | i asked in #puppet-dev for the beaker team to fix it on their end | 21:46 |
| nibalizer | transitive dependency | 21:46 |
| crinkle | no response yet | 21:46 |
| nibalizer | clarkb: beaker requires fog which requires this i think | 21:46 |
| nibalizer | crinkle: can confirm or expose my lies | 21:46 |
| tonyb | jlvillal: Thanks I saw you'd uploaded a few revisions | 21:46 |
| jlvillal | :) Kept improving while you were sleeping tonyb | 21:46 |
| crinkle | nibalizer: that's my guess | 21:46 |
| clarkb | nibalizer: are you saying that because my change is on system-config I need to approve this change made for system-config? | 21:46 |
| tonyb | jlvillal: that's the way to do it | 21:47 |
| nibalizer | clarkb: i don't parse | 21:47 |
| *** thorst_ has quit IRC | 21:47 | |
| tonyb | jlvillal: I make a mess and you get cranky and fix it :) | 21:47 |
| *** doug-fis_ has joined #openstack-infra | 21:47 | |
| *** doug-fis_ has quit IRC | 21:47 | |
| clarkb | nibalizer: nibalizer | we have to do another patch-every puppet module <- does that mean the change I just approved won't help my failing tests on system-config? | 21:47 |
| jlvillal | tonby: heh. Not much of a mess. I enjoyed troubleshooting it. | 21:47 |
| *** doug-fis_ has joined #openstack-infra | 21:48 | |
| nibalizer | clarkb: well that one will fix system-config | 21:48 |
| *** trown|afk is now known as trown|outtypewww | 21:48 | |
| nibalizer | i think | 21:48 |
| nibalizer | but i have to patch the other 70+ gemfiles | 21:48 |
| *** avarner_ has quit IRC | 21:48 | |
| nibalizer | system-config (and everything else) runs openstackci's tests | 21:48 |
| nibalizer | so fixing openstackci solves part of the problem | 21:48 |
| tonyb | jlvillal: Thanks I'm being flippant but I'm glad you did | 21:48 |
| *** johnsom_ has joined #openstack-infra | 21:50 | |
| *** claudiub has joined #openstack-infra | 21:50 | |
| *** gmurphy_ has joined #openstack-infra | 21:50 | |
| *** doug-fish has quit IRC | 21:50 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Pin google-api-client https://review.openstack.org/306086 | 21:51 |
| *** armax has quit IRC | 21:51 | |
| clarkb | nibalizer: gotcha | 21:52 |
| *** doug-fis_ has quit IRC | 21:52 | |
| *** aeng has quit IRC | 21:52 | |
| *** gyee has quit IRC | 21:52 | |
| *** bexelbie has quit IRC | 21:53 | |
| *** gyee has joined #openstack-infra | 21:53 | |
| nibalizer | ugh our gemfiles have wandered | 21:53 |
| *** dkehn has quit IRC | 21:53 | |
| *** edmondsw has quit IRC | 21:53 | |
| *** jlvillal has quit IRC | 21:53 | |
| *** johnsom has quit IRC | 21:53 | |
| *** claudiub|2 has quit IRC | 21:53 | |
| *** jogo has quit IRC | 21:53 | |
| *** pfallenop has quit IRC | 21:54 | |
| *** mat128 has quit IRC | 21:54 | |
| *** pblaho has quit IRC | 21:54 | |
| *** pfallenop has joined #openstack-infra | 21:54 | |
| *** pblaho has joined #openstack-infra | 21:54 | |
| *** vgridnev has quit IRC | 21:55 | |
| *** dkehn has joined #openstack-infra | 21:55 | |
| boris-42 | jeblair: could you help https://review.openstack.org/#/c/305709/6 to get this in, we have blocked rally gates | 21:55 |
| *** akshai_ has joined #openstack-infra | 21:55 | |
| *** mat128 has joined #openstack-infra | 21:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Remove trove-dashboard from trove group https://review.openstack.org/306097 | 21:55 |
| jeblair | dloi: ^ there's the fix | 21:55 |
| *** armax has joined #openstack-infra | 21:56 | |
| morgan | nibalizer: how do gemfiles wander? do we need to put a leash on them? maybe one of those electric fences? :P | 21:56 |
| nibalizer | morgan: i was thinking I could send some gemfiles to live with you for the summer | 21:56 |
| nibalizer | maybe they'd learn | 21:56 |
| morgan | lol | 21:56 |
| *** tqtran has quit IRC | 21:56 | |
| *** xyang1 has quit IRC | 21:56 | |
| dloi | jeblair: great thx! | 21:57 |
| jeblair | camp morgan | 21:57 |
| *** akshai has quit IRC | 21:57 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:57 | |
| *** jlvillal has joined #openstack-infra | 21:58 | |
| morgan | jeblair: i think my lease specifically prohibits gemfiles living with me. | 21:58 |
| boris-42 | jeblair: somebody removed lbaas extenstion from default option | 21:58 |
| morgan | nibalizer: ^ | 21:58 |
| crinkle | nibalizer: wander how? i know some of them don't have the empty string linter but otherwise i thought they were saneish? | 21:58 |
| *** bexelbie has joined #openstack-infra | 21:58 | |
| *** jheroux has quit IRC | 21:58 | |
| *** johnsom_ is now known as johnsom | 21:59 | |
| *** aeng has joined #openstack-infra | 21:59 | |
| *** zz_ja has quit IRC | 21:59 | |
| *** esikachev has quit IRC | 22:00 | |
| nibalizer | crinkle: they are very close | 22:00 |
| nibalizer | but yea some have empty string checks some have beaker requirements in a different section | 22:00 |
| *** thorst has joined #openstack-infra | 22:01 | |
| nibalizer | i think i've got this, its just not as easy as i'd like | 22:01 |
| *** zz_ja has joined #openstack-infra | 22:01 | |
| *** doug-fish has joined #openstack-infra | 22:01 | |
| *** dangers_away has quit IRC | 22:02 | |
| jeblair | boris-42: i can take a look in a bit; i'm in the middle of something right now | 22:02 |
| boris-42 | jeblair: no worries, thanks! | 22:02 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 22:02 |
| *** dougwig has joined #openstack-infra | 22:03 | |
| clarkb | pabelanger: nibalizer jeblair mordred I am holding the lock on mirror-update for https://review.openstack.org/#/c/293155/10 it looks like it will pass testing with the gemfile update in, so that should be ready for approval at any time | 22:03 |
| *** edmondsw has joined #openstack-infra | 22:04 | |
| *** burgerk has quit IRC | 22:04 | |
| nibalizer | clarkb: looks like it failed on you | 22:04 |
| clarkb | nibalizer: no it just succeeded | 22:04 |
| clarkb | hasnt posted to gerrit yet | 22:05 |
| nibalizer | oh cool | 22:05 |
| *** mriedem has quit IRC | 22:05 | |
| jeblair | resatrting jenkins07 with new zmq | 22:06 |
| jeblair | "node_description":"Dynamic single use ubuntu-trusty node" | 22:06 |
| jeblair | clarkb: woot ^ | 22:07 |
| jeblair | (once the nodepool change lands, that will be useful) | 22:07 |
| *** jogo has joined #openstack-infra | 22:07 | |
| *** vilobhmm11 has quit IRC | 22:08 | |
| *** amitgandhinz has quit IRC | 22:08 | |
| *** vilobhmm11 has joined #openstack-infra | 22:08 | |
| *** harlowja has joined #openstack-infra | 22:09 | |
| *** esker has joined #openstack-infra | 22:09 | |
| jeblair | clarkb: seems good; shall i tag 0.0.5? | 22:10 |
| clarkb | jeblair: sure | 22:10 |
| *** tqtran has joined #openstack-infra | 22:10 | |
| jeblair | pushed | 22:11 |
| *** matt-borland has quit IRC | 22:12 | |
| openstackgerrit | Merged openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 22:12 |
| *** baoli has quit IRC | 22:13 | |
| *** esker has quit IRC | 22:13 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:14 | |
| *** jogo has quit IRC | 22:14 | |
| nibalizer | ok here goes | 22:15 |
| nibalizer | apologies in advance | 22:15 |
| jeblair | i'm excited | 22:15 |
| clarkb | my irc client is ready | 22:15 |
| nibalizer | hrm | 22:15 |
| jeblair | i get to batch review :) | 22:15 |
| nibalizer | i may want a nonconfirm ssh agent for this | 22:15 |
| nibalizer | eh | 22:15 |
| nibalizer | ill just spam enter | 22:15 |
| jeblair | hehe | 22:15 |
| nibalizer | so some of these have a bit more text than just the gem pinning | 22:16 |
| nibalizer | because there are some differences | 22:16 |
| nibalizer | some i have manually resolved the othres I have let 'come in to conformance' | 22:16 |
| nibalizer | juft fyi | 22:16 |
| jeblair | okay i'll read them | 22:16 |
| clarkb | so actually review them? | 22:16 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-accessbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306098 | 22:16 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ansible: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306099 | 22:16 |
| jeblair | nibalizer can't answer now because he has to keep hitting enter | 22:16 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apparmor: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306100 | 22:16 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apps_site: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306101 | 22:16 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-askbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306102 | 22:16 |
| *** dingyichen has joined #openstack-infra | 22:17 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-asterisk: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306103 | 22:17 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bandersnatch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306104 | 22:17 |
| *** tpsilva has quit IRC | 22:17 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bugdaystats: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306105 | 22:17 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306106 | 22:17 |
| jeblair | a topic would be nice... i'll fix it. | 22:17 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-cgit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306107 | 22:17 |
| fungi | jeblair: he might need to borrow your keyboard for double throughput | 22:17 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ciwatch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306108 | 22:17 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-diskimage_builder: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306109 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-drupal: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306110 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elastic_recheck: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306111 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elasticsearch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306112 | 22:18 |
| fungi | (twice the enter keys!) | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-etherpad_lite: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306113 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-exim: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306114 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerrit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306115 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerritbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306116 | 22:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-github: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306117 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-grafyaml: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306118 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-graphite: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306119 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-haveged: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306120 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-hound: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306121 | 22:19 |
| openstackgerrit | Merged openstack-infra/project-config: [Rally] Load Neutron-LBaaS extension as devstack plugin https://review.openstack.org/305709 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306122 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-infracloud: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306123 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-iptables: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306124 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-jeepyb: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306125 | 22:19 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-jenkins: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306126 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kerberos: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306127 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kibana: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306128 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-lodgeit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306129 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-log_processor: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306130 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logrotate: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306131 | 22:20 |
| *** nmagnezi has left #openstack-infra | 22:20 | |
| mordred | oh. my | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logstash: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306132 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mailman: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306133 | 22:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mediawiki: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306134 | 22:20 |
| jeblair | mordred: we're stackalyticsing | 22:20 |
| *** gordc has quit IRC | 22:21 | |
| mordred | yah | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-meetbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306135 | 22:21 |
| mordred | don't approve til I get some numbers ... what's the topic? | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mysql_backup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306136 | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-nodepool: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306137 | 22:21 |
| jeblair | mordred: i'm going to set them all to 'gemfile' when nibalizer is done | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-odsreg: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306138 | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openafs: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306139 | 22:21 |
| fungi | you're never going to catch up with senlin. there's one reviewer with something like 750 commits in senlin last cycle | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_health: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306140 | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstackid: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306141 | 22:21 |
| jeblair | though until then message:"Pin google-api-client; sanitize Gemfile" works | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-os_client_config: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306142 | 22:21 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-packagekit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306143 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pgsql_backup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306144 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-phabricator: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306145 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pip: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306146 | 22:22 |
| *** johnsom has quit IRC | 22:22 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-planet: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306147 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-project_config: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306148 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-puppet: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306149 | 22:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-redis: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306150 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-refstack: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306151 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-releasestatus: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306152 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-reviewday: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306153 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-simpleproxy: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306154 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-snmpd: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306155 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssh: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306156 | 22:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssl_cert_check: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306157 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-stackalytics: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306158 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-statusbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306159 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-storyboard: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306160 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-subunit2sql: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306161 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-sudoers: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306162 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-tmpreaper: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306163 | 22:24 |
| clarkb | jeblair: obtaining reprepro keys says Error: unknown key | 22:24 |
| *** akshai_ has quit IRC | 22:24 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ulimit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306164 | 22:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unattended_upgrades: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306165 | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unbound: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306166 | 22:25 |
| jeblair | clarkb: what's the command? | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-user: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306167 | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vcsrepo: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306168 | 22:25 |
| clarkb | uh let me read the reprepro script | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vinz: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306169 | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-yum: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306170 | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-zanata: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306171 | 22:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-zuul: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306172 | 22:26 |
| mtreinish | nibalizer: you're gonna win stackalytics | 22:26 |
| nibalizer | ugh yea | 22:26 |
| nibalizer | next time ill topic | 22:26 |
| nibalizer | and use a non-confirm agent | 22:26 |
| clarkb | jeblair: k5start -t -f /etc/reprepro.keytab service/reprepro -- timeout -k 2m 30m reprepro --confdir $REPREPRO_CONFIG update | 22:26 |
| nibalizer | so much enter button] | 22:26 |
| *** vilobhmm11 has quit IRC | 22:26 | |
| mordred | jeblair: bless you for writing gertty | 22:26 |
| clarkb | jeblair: I ran this as root because puppe tinstalls it as a root cron for normal operations | 22:27 |
| *** regXboi has quit IRC | 22:27 | |
| jeblair | okay, all topic'd to 'gemfile' | 22:27 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-infra-cookiecutter: Pin google-api-client https://review.openstack.org/306173 | 22:27 |
| *** maishsk has quit IRC | 22:27 | |
| clarkb | jeblair: oh! I think it is reprepro complaining | 22:28 |
| clarkb | jeblair: part of the puppet update is to trust the key | 22:28 |
| clarkb | and maybe that isn't working correctly :( | 22:28 |
| jeblair | ah | 22:28 |
| clarkb | I may have just raced puppet | 22:28 |
| *** bpokorny_ has joined #openstack-infra | 22:29 | |
| clarkb | no puppet is definitely done and claims to have added the key but I still get the error | 22:29 |
| clarkb | the key hash matches what I have in the manifest too | 22:29 |
| clarkb | mordred: ^ ideas? | 22:30 |
| *** bpokorny_ has quit IRC | 22:30 | |
| clarkb | I suppose it is possible puppet didn't add the key properly | 22:30 |
| jeblair | https://review.openstack.org/306107 is an interesting one | 22:30 |
| *** apoorvad_ has quit IRC | 22:30 | |
| *** bpokorny_ has joined #openstack-infra | 22:30 | |
| nibalizer | jeblair: ya that is the most interesting | 22:31 |
| nibalizer | for some reason its tests arent named the normal thing | 22:31 |
| nibalizer | and its puppetversion inspection is in a different place in the file | 22:32 |
| nibalizer | crinkle: can you confirm that 306107 is ok? | 22:32 |
| *** ramishra has joined #openstack-infra | 22:32 | |
| clarkb | well thats weird | 22:32 |
| *** bpokorny has quit IRC | 22:33 | |
| crinkle | o.0 | 22:33 |
| clarkb | gpg --fingerprint Ceph.com doesn't match what is in puppet or what reprepro is getting. reprepro and puppet do seem to agree | 22:33 |
| clarkb | fungi: ^ any chacne you are around and can help untangle that? | 22:33 |
| clarkb | 1) why would puppet allow the key to be added if the fingerprints don't match 2) why is the fingerprint different at all? | 22:33 |
| *** maishsk has joined #openstack-infra | 22:33 | |
| fungi | clarkb: sure, can take a break and look at it | 22:33 |
| crinkle | nibalizer: the group names don't really matter so its fine | 22:34 |
| fungi | clarkb: this is on afs01.dfw? | 22:34 |
| clarkb | fungi: compare gpg --fingerprint Ceph.com to key at end of mirror_update.pp | 22:34 |
| clarkb | fungi: no mirror-update.openstack.org | 22:34 |
| fungi | oh, duh | 22:34 |
| clarkb | and the reprepro error is Error: unknown key 'ECF8427E'! | 22:34 |
| clarkb | that hash matches what we have in puppet implying reprepro talking to the repo is getting that key | 22:34 |
| SotK | is there anyone around who can get me an up-to-date dump of the db from storyboard.o.o (with private tokens etc. removed of course) by any chance? | 22:35 |
| jeblair | SotK: yes | 22:35 |
| crinkle | nibalizer: the puppet-openstack modules have a master gemfile now so we don't have to do this anymore, maybe the infra modules should do that too? | 22:35 |
| crinkle | nibalizer: i mean in the future | 22:36 |
| nibalizer | ya | 22:36 |
| jeblair | crinkle: "one last time"? :) | 22:36 |
| nibalizer | we should sync up with their tooling | 22:36 |
| jeblair | SotK: https://storyboard.openstack.org/db-dump/ | 22:36 |
| jeblair | SotK: you have until puppet removes it to fetch it :) | 22:36 |
| jeblair | all of nibalizer's changes have 2x+2s now; anyone else want to jump on the stackalytics bandwagon before i +3 them all? | 22:37 |
| *** ramishra has quit IRC | 22:37 | |
| SotK | jeblair: thanks! | 22:37 |
| *** ayoung has joined #openstack-infra | 22:39 | |
| openstackgerrit | Stephanie Miller proposed openstack/diskimage-builder: Need to check for /etc/ssh in $TARGET_ROOT https://review.openstack.org/306177 | 22:40 |
| *** |-paul-| has quit IRC | 22:41 | |
| fungi | clarkb: when i gpg2 --import that key i get the same three keys as gpg --list-keys returns on mirror-update.o.o http://paste.openstack.org/show/494139/ | 22:41 |
| fungi | clarkb: er, same key | 22:42 |
| fungi | clarkb: 0xE84AC2C0460F3994 from my --import matches the 4096R/460F3994 i see in mirror-update | 22:42 |
| jeblair | and away they go | 22:43 |
| openstackgerrit | Merged openstack-infra/puppet-vcsrepo: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306168 | 22:43 |
| clarkb | fungi: did I cross the streams on what the key asc file is? I don't think so because that key belongs to the ceph release team | 22:43 |
| clarkb | maybe they crossed the streams on me? | 22:43 |
| *** tqtran has quit IRC | 22:44 | |
| jeblair | puppet-vcsrepo has noop jobs, btw | 22:44 |
| fungi | clarkb: gpg2 --fingerprint 0xE84AC2C0460F3994 says Key fingerprint = 08B7 3419 AC32 B4E9 66C1 A330 E84A C2C0 460F 3994 | 22:44 |
| *** tqtran has joined #openstack-infra | 22:44 | |
| clarkb | fungi: https://git.ceph.com/release.asc is the key file we should be using I am double checking that that matche what is in puppet | 22:44 |
| clarkb | fungi: the thing that has me confused is key_id => 'E9800998ECF8427E', is the id in puppet and Error: unknown key 'ECF8427E'! is the error those two match up implying what puppet attempts to do is correct | 22:45 |
| jhesketh | Morning | 22:45 |
| clarkb | ya the two files match so maybe that isn't the correct key and somehow I found the correct key but then got confused later and didn't provide the right onctent to puppet? | 22:46 |
| fungi | clarkb: yeah, that file also gets me the same key id, so must be the same | 22:46 |
| *** gmurphy_ has left #openstack-infra | 22:48 | |
| *** thiagop has quit IRC | 22:48 | |
| clarkb | fungi: http://download.ceph.com/debian-hammer/dists/trusty/ is what we are trying to mirror | 22:48 |
| clarkb | fungi: how do I see what signed the .gpg file? | 22:48 |
| clarkb | (I want to confirm that file was signed by ECF8427E leading to the error | 22:49 |
| *** Sukhdev has quit IRC | 22:49 | |
| fungi | Signature made 2016-03-04T19:45:09 UTC using RSA key 0xE84AC2C0460F3994 | 22:49 |
| fungi | Primary key fingerprint: 08B7 3419 AC32 B4E9 66C1 A330 E84A C2C0 460F 3994 | 22:49 |
| clarkb | I guess just verify the signature | 22:50 |
| fungi | clarkb: gpg --verify Release.gpg Release | 22:50 |
| fungi | yep[ | 22:50 |
| fungi | gpg: Good signature from "Ceph.com (release key) <security@ceph.com>" [unknown] | 22:50 |
| openstackgerrit | Merged openstack-infra/puppet-accessbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306098 | 22:50 |
| fungi | clarkb: is it maybe just not getting added to reprepro correctly? looks like it's in root's trust.db but maybe reprepro has special needs? | 22:51 |
| *** mylu has quit IRC | 22:51 | |
| clarkb | maybe? I am mostly confused by the differing IDs | 22:51 |
| *** vilobhmm11 has joined #openstack-infra | 22:52 | |
| openstackgerrit | Merged openstack-infra/puppet-vinz: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306169 | 22:52 |
| clarkb | and reprepro complains the id in puppet is the one it doesn't know implying the puppet isn't completely wrong | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-ansible: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306099 | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-apparmor: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306100 | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-apps_site: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306101 | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-askbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306102 | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-asterisk: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306103 | 22:52 |
| openstackgerrit | Merged openstack-infra/puppet-bandersnatch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306104 | 22:53 |
| openstackgerrit | Merged openstack-infra/puppet-bugdaystats: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306105 | 22:53 |
| openstackgerrit | Merged openstack-infra/puppet-bup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306106 | 22:53 |
| openstackgerrit | Merged openstack-infra/puppet-cgit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306107 | 22:53 |
| openstackgerrit | Merged openstack-infra/puppet-diskimage_builder: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306109 | 22:53 |
| *** maishsk has quit IRC | 22:53 | |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306110 | 22:53 |
| *** vilobhmm111 has joined #openstack-infra | 22:53 | |
| openstackgerrit | Merged openstack-infra/puppet-elastic_recheck: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306111 | 22:53 |
| openstackgerrit | Merged openstack-infra/puppet-elasticsearch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306112 | 22:54 |
| *** mylu has joined #openstack-infra | 22:54 | |
| openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306113 | 22:54 |
| openstackgerrit | Merged openstack-infra/puppet-exim: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306114 | 22:54 |
| clarkb | fungi: basically the key added properly and does match what was used to sign the package repo, so now its just a matter of figuring out where ECF8427E comes from | 22:55 |
| *** vilobhmm11 has quit IRC | 22:56 | |
| fungi | clarkb: that seems to be the key_id you've set at http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/mirror_update.pp#n191 | 22:56 |
| fungi | maybe that's just wrong? | 22:57 |
| fungi | you likely want E84AC2C0460F3994 there instead? | 22:57 |
| *** jamielennox is now known as jamielennox|away | 22:58 | |
| clarkb | fungi: maybe, but that doens't explain why reprepro says Error: unknown key 'ECF8427E' | 22:58 |
| clarkb | fungi: this was the key you helped my fingerprint a while back :) | 22:58 |
| clarkb | but reprepro saying unknown key makes me think there was something to ECF8427E | 22:58 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Set debian hammer repo afs path correctly https://review.openstack.org/306178 | 22:58 |
| clarkb | this ^ will need to be fixed either way | 22:58 |
| *** dalgaaf has quit IRC | 22:59 | |
| fungi | clarkb: /etc/reprepro/debian-ceph-hammer/updates has VerifyRelease: ecf8427e | 22:59 |
| *** vilobhmm11 has joined #openstack-infra | 22:59 | |
| clarkb | oh my grep needed to be case insensitive | 23:00 |
| clarkb | ok I think you are right, the puppet gpg module just doesn't fail on that when it should | 23:00 |
| clarkb | (why bother with the id if you aren't going to fail on it) | 23:00 |
| nibalizer | clarkb: im now gonna read 'omg' as 'oh my grep' | 23:00 |
| fungi | clarkb: stated previously, but i'm quite unimpressed^Wscared by that module | 23:00 |
| nibalizer | which module now? | 23:01 |
| *** vilobhmm111 has quit IRC | 23:01 | |
| anteaya | jhesketh: morning | 23:01 |
| fungi | nibalizer: https://github.com/n1tr0g/golja-gnupg | 23:01 |
| *** maishsk has joined #openstack-infra | 23:02 | |
| nibalizer | oh it does keychain management? | 23:02 |
| fungi | at least clarkb seems to have figured out how to pass it a raw local key rather than having it unceremoniously grab something from a keyserver while only supporting dangerously short key ids | 23:02 |
| *** bpokorny_ has quit IRC | 23:02 | |
| jeblair | i have installed the new zmq plugin on jenkins0* and i have a root-owned screen on puppetmaster running the restart masters script | 23:02 |
| *** arxcruz has quit IRC | 23:03 | |
| anteaya | pleia2: nice wrap up on yesterday's work on the mailing list | 23:03 |
| nibalizer | oh gross it doesn't take full keyids | 23:03 |
| nibalizer | or does it? | 23:03 |
| fungi | clarkb: i would not be surprised if their "validation" of the key_id string was the assumption that they were going to call gpg --recv-keys $key_id | 23:03 |
| clarkb | nibalizer: it doesn't | 23:03 |
| jeblair | fungi: i assume it forks out to nodejs to use the isString npm module | 23:03 |
| nibalizer | it says "Also accepted the long more accurate 16 char key id" | 23:04 |
| fungi | isKey | 23:04 |
| fungi | nibalizer: yeah, 16 characters is still short | 23:04 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Set the debian ceph key id to proper value https://review.openstack.org/306179 | 23:04 |
| fungi | nibalizer: but at least it's not 8 | 23:04 |
| *** vilobhmm11 has quit IRC | 23:04 | |
| jeblair | i'll go aheand and upgrade zmq on jenkins.o.o as well, just for completeness | 23:04 |
| clarkb | fungi: nibalizer jeblair ^ those two changes should make things work I hope | 23:04 |
| *** vilobhmm11 has joined #openstack-infra | 23:05 | |
| fungi | though i am curious why we're only getting a 7-digit key id in the reprepro config | 23:05 |
| nibalizer | fungi: i bet we can just fix this | 23:05 |
| clarkb | fungi: that is me cargo culting | 23:05 |
| clarkb | I have no idea if reprepro will do more | 23:05 |
| fungi | clarkb: oh, heh. seemed very git-ish | 23:05 |
| clarkb | but mordred's reprepro config used that and it worked | 23:05 |
| fungi | i expect reprepro would take a full fingerprint | 23:05 |
| fungi | but i don't know this for sure | 23:06 |
| *** jogo has joined #openstack-infra | 23:06 | |
| jeblair | clarkb: are you sure you don't want to make the path /mirror/ceph/deb-hammer ? | 23:07 |
| jeblair | (or otherwise have ceph in the name?) | 23:07 |
| clarkb | jeblair: thats not what the change did :/ or where I made the afs volume | 23:07 |
| fungi | anyway, since we're not importing arbitrary additional keys on that server, this seems safe enough for now | 23:07 |
| clarkb | jeblair: I thought you said there were limits on those name legnths which is why we ended up with mirror/deb-hammer | 23:07 |
| jeblair | clarkb: no, only volume name lengths. long pathnames are great. | 23:08 |
| fungi | jeblair: apparently ceph has multiple repos for their versions rather than using multiple suites or just a pool | 23:08 |
| fungi | so didn't know whether we wanted to keep a common directory hierarchy depth for all our deb repo mirrors | 23:09 |
| clarkb | jeblair: ok, I can move the volume to mount under mirror/ceph I guess | 23:09 |
| jeblair | fungi, clarkb: yeah, if we want to keep it at the same depth, then mirror/debian-ceph-hammer sounds good. if we don't care about the depth, then mirror/ceph/debian-hammer sounds good. | 23:09 |
| jeblair | but i have a slight preference for anything with ceph in the name because otherwise ... deb-hammer :) | 23:10 |
| fungi | or mirror/ceph-debian-hammer | 23:10 |
| fungi | or mirror/ceph-deb-hammer | 23:10 |
| fungi | something | 23:10 |
| *** IlyaG has joined #openstack-infra | 23:10 | |
| fungi | pink | 23:10 |
| openstackgerrit | Merged openstack-infra/zuul: Detect dependency cycles introduced with new patchsets https://review.openstack.org/301844 | 23:10 |
| clarkb | jeblair: how about mirror/ceph-deb-hammer so it is ceph and one level? | 23:10 |
| jeblair | wfm | 23:11 |
| *** mylu has quit IRC | 23:11 | |
| *** kengo_sakai has joined #openstack-infra | 23:11 | |
| jeblair | (if you can't tell, i'm frightened of a mirror directory full of ceph codenames :) | 23:11 |
| *** mylu has joined #openstack-infra | 23:11 | |
| jeblair | dumpling sounds cute. infernalis not so much. | 23:12 |
| nibalizer | fungi: https://github.com/n1tr0g/golja-gnupg/pull/21 | 23:12 |
| clarkb | jeblair: how dow I remove the current mount and remove the old acls/quotas? | 23:13 |
| fungi | agreed, having "ceph-" in there reduces the WAT factor a bit | 23:13 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Change afs path for ceph mirror for readability https://review.openstack.org/306181 | 23:13 |
| jeblair | clarkb: acls/quotas are attached to the volume so no changes necessary | 23:13 |
| clarkb | jeblair: ^ that is the change to move the path | 23:13 |
| *** akshai has joined #openstack-infra | 23:13 | |
| jeblair | clarkb: 'fs rmmount' removes the mountpoint; then 'fs mkmount' to make the new one | 23:13 |
| jeblair | clarkb: any order will do, you can mount a volume multiple places :) | 23:13 |
| clarkb | jeblair: then rerun vos release mirror.deb-hammer? | 23:13 |
| JayF | mordred: what's the name of your thing that uses network json to write out networking configs, that's like 100x lighter than cloud-init? | 23:13 |
| jeblair | clarkb: only need to rerun 'vos rlease mirror' since that's where the mountpoints are | 23:14 |
| *** rbrndt has quit IRC | 23:14 | |
| clarkb | ah right | 23:14 |
| jeblair | JayF: glean ? | 23:14 |
| fungi | JayF: glean | 23:14 |
| *** akshai_ has joined #openstack-infra | 23:14 | |
| JayF | Thanks, I'll toss that into my nearest search engine | 23:14 |
| jeblair | JayF: http://git.openstack.org/cgit/openstack-infra/glean | 23:14 |
| JayF | jeblair: fungi o/ ty | 23:14 |
| fungi | JayF: http://git.openstack.org/cgit/openstack-infra/glean https://pypi.python.org/pypi/glean | 23:15 |
| * fungi doubles as a beer-powered search engine | 23:15 | |
| anteaya | pabelanger: I took a look at https://storyboard.openstack.org/#!/story/2000513 | 23:15 |
| JayF | Perfect; thanks. | 23:15 |
| fungi | JayF: i should have also included http://docs.openstack.org/infra/glean/ | 23:15 |
| fungi | which is probably the most useful one | 23:16 |
| jeblair | fungi: and some images and advertising referral links | 23:16 |
| JayF | the code link is what I was looking for, we have a customer looking to enable solaris networking in an image | 23:16 |
| anteaya | pabelanger: the hard thing with opening wiki account creation before the summit is if we get spammed again during the summit, we might all be too busy to notice | 23:16 |
| *** asettle has joined #openstack-infra | 23:16 | |
| JayF | and I figured glean was a better starting point than cloud-init, even if both don't support solaris | 23:16 |
| anteaya | pabelanger: then we have to close down account creation | 23:16 |
| nibalizer | hahaha what | 23:16 |
| nibalizer | solaris support in glean | 23:16 |
| clarkb | jeblair: man page says fs rmmount -dir /afs/.openstack.org/mirror/deb-hammer that look right ot you? | 23:16 |
| jeblair | clarkb: yep | 23:17 |
| anteaya | pabelanger: so as we agreed this morning if someone wants to take that on fine, if not then talking about a timeline at a session during the summit | 23:17 |
| jeblair | clarkb: (unrelated to this, feel free to proceed); i think i left something out of the docs | 23:17 |
| *** akshai has quit IRC | 23:18 | |
| *** mylu has quit IRC | 23:18 | |
| jeblair | clarkb: but do please pause before running reprepro | 23:18 |
| clarkb | jeblair: ok, and to confirm I don't see this when I ls /afs/openstack.org/mirror locally because I have to vos release before it takes effect | 23:18 |
| jeblair | clarkb: correct | 23:18 |
| clarkb | er I don't see my changes yet | 23:18 |
| clarkb | ok I am going to release the mount changes then pause | 23:19 |
| *** austin81 has left #openstack-infra | 23:20 | |
| clarkb | and that looks good | 23:20 |
| *** bpokorny has joined #openstack-infra | 23:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document how mirrors are contstructed in AFS https://review.openstack.org/305539 | 23:20 |
| *** IlyaG has quit IRC | 23:20 | |
| jeblair | clarkb: the diff is: | 23:20 |
| jeblair | +* Grant anonymous users read access:: | 23:20 |
| jeblair | + fs setacl /afs/.openstack.org/mirror/foo system:anyuser read | 23:20 |
| jeblair | :) | 23:20 |
| *** mylu has joined #openstack-infra | 23:21 | |
| *** jkeen has quit IRC | 23:21 | |
| *** akshai_ has quit IRC | 23:21 | |
| clarkb | jeblair: ok running that now | 23:21 |
| *** Swami has quit IRC | 23:21 | |
| clarkb | jeblair: do setacls need to be released? | 23:21 |
| *** akshai has joined #openstack-infra | 23:22 | |
| jeblair | clarkb: afs copies acls when creating directories, so unfortunately that will now only take effect on the top level dir (and anything we subsequently create). we need to also run that on any subdirs | 23:22 |
| jeblair | (to correct my mistake) | 23:22 |
| *** mriedem has joined #openstack-infra | 23:22 | |
| clarkb | ok, there are no subdirs yet because reprepro hasn't run (why you said don't run it I guess) | 23:22 |
| jeblair | clarkb: usually folks use a 'find type -d' sort of thing. though it looks like there are only a couple, so could probably do by hand | 23:23 |
| jeblair | clarkb: i see db/ and lists/ | 23:23 |
| clarkb | jeblair: ls /afs/openstack.org/mirror/ceph-deb-hammer shows me nothing | 23:23 |
| *** ayoung has quit IRC | 23:23 | |
| jeblair | clarkb: and yes, acls are like content so you'll need to vos release to update the ro volume | 23:23 |
| *** tosky has quit IRC | 23:24 | |
| jeblair | clarkb: that's the ro volume | 23:24 |
| clarkb | gotcha | 23:24 |
| jeblair | (so presumably reprepro made them after the most recent vos release of mirror.deb-hammer | 23:24 |
| *** mylu has quit IRC | 23:24 | |
| clarkb | jeblair: ya I haven't run a release on deb-hammer since reprepro ran | 23:24 |
| clarkb | jeblair: does the acl on mirror/ceph-deb-hammer require release on mirror or release on mirror.deb-hammer? | 23:25 |
| jeblair | clarkb: mirror.deb-hammer? | 23:25 |
| jeblair | clarkb: mirror.deb-hammer | 23:25 |
| *** mylu has joined #openstack-infra | 23:25 | |
| jeblair | clarkb: you're done with the mirror volume once you finish creating/updating the mountpoint | 23:26 |
| pleia2 | akshai: thanks | 23:26 |
| pleia2 | err | 23:26 |
| pleia2 | anteaya: thanks | 23:26 |
| clarkb | jeblair: ok so acls apply to the thing under mount points and mounst apply to the thing above | 23:26 |
| clarkb | jeblair: were you going to fix the db and lists or should I? | 23:26 |
| jeblair | clarkb: acls apply to directories (think of them like extended directory attributes) | 23:27 |
| jeblair | clarkb: why don't you | 23:27 |
| *** IlyaG has joined #openstack-infra | 23:27 | |
| clarkb | oh bah I mixed up my changes in gerrit too :(, I will be rebasing those | 23:27 |
| jeblair | clarkb: (but yeah, the acl you changed is really the acl of the root directory of the deb-hammer volume, so not actually related to the mountpoint) | 23:28 |
| *** maishsk has quit IRC | 23:28 | |
| jeblair | clarkb: (if you mounted the volume again somewhere else, that directory would still have the same acls even in the new mountpoint) | 23:28 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Change afs path for ceph mirror for readability https://review.openstack.org/306181 | 23:30 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Set the debian ceph key id to proper value https://review.openstack.org/306179 | 23:30 |
| *** mylu has quit IRC | 23:30 | |
| clarkb | jeblair: fungi nibalizer ^ ok those two things together should be correct now. Time to abandon my third change | 23:30 |
| *** apoorvad has joined #openstack-infra | 23:31 | |
| jeblair | clarkb: abandon https://review.openstack.org/306178 ? | 23:31 |
| *** maishsk has joined #openstack-infra | 23:31 | |
| clarkb | yup all done | 23:31 |
| *** keedya has quit IRC | 23:32 | |
| *** Sukhdev has joined #openstack-infra | 23:33 | |
| *** bpokorny has quit IRC | 23:33 | |
| *** ramishra has joined #openstack-infra | 23:33 | |
| *** bpokorny has joined #openstack-infra | 23:33 | |
| clarkb | jeblair: there are files in ceph-deb-hammer/db/ do I need to set acls on them too or do they inherit from parent dir? | 23:33 |
| *** bpokorny has quit IRC | 23:33 | |
| *** dahoo has quit IRC | 23:34 | |
| jeblair | clarkb: acls are only on dirs, so you're set | 23:34 |
| *** bpokorny has joined #openstack-infra | 23:34 | |
| clarkb | ok going to vos release mirror.deb-hammer now | 23:34 |
| clarkb | and then everything should be ready for reprepro to run once those changes merge | 23:34 |
| jeblair | ++ | 23:35 |
| Shrews | jeblair: the infra internap account is allowed to create networks, i assume? | 23:35 |
| pabelanger | just catching up on backscroll now | 23:35 |
| *** apoorvad has quit IRC | 23:36 | |
| openstackgerrit | Roland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-analytics project https://review.openstack.org/306185 | 23:36 |
| pabelanger | nibalizer: Nice, did we flip voting yet for beaker? Also, will check patch shortly | 23:36 |
| mgagne | Shrews: it's not, we don't have SDN. you will need to go through the portal IIRC and even there, I'm not sure. Will only be able to create private networks | 23:36 |
| Shrews | mgagne: ah. i wondered why i couldn't do that with my account. let me try the portal | 23:37 |
| fungi | if you go through the portal, you may never come back | 23:38 |
| *** ramishra has quit IRC | 23:38 | |
| pabelanger | anteaya: Right, we can prep the change for summit, and if people complain during the summit maybe we land the revert so people and register. I don't have a strong opinion which way we go. | 23:38 |
| pabelanger | and caught up | 23:38 |
| clarkb | jeblair: I notice that this reprepro wrapper script does a vos release in it, what happens if that vos release times out? | 23:38 |
| clarkb | jeblair: should I be running the commands in this script by hand to avoid that non localauth vos release? | 23:39 |
| *** kengo_sakai has quit IRC | 23:39 | |
| jeblair | clarkb: yes | 23:39 |
| pabelanger | nibalizer: okay, looks like all +A | 23:40 |
| mgagne | Shrews: hmm looks to not be there at first glance | 23:40 |
| *** alex_xu has quit IRC | 23:40 | |
| *** kengo_sakai has joined #openstack-infra | 23:40 | |
| clarkb | I am actually just going to make a copy of the script without the vos release | 23:40 |
| clarkb | and run that | 23:40 |
| pabelanger | ianw: around? | 23:40 |
| jeblair | that should work | 23:40 |
| Shrews | mgagne: nope :( | 23:40 |
| mgagne | Shrews: need a new private network? I can look into it | 23:40 |
| ianw | pabelanger: hey | 23:41 |
| Shrews | mgagne: trying to investigate an issue with shade finding the external network on internap that jeblair pointed out earlier | 23:41 |
| mgagne | Shrews: oh, didn't read backlog | 23:41 |
| *** zhurong has joined #openstack-infra | 23:42 | |
| pabelanger | ianw: so, we've had some requests from the RDO team to see about reverting https://review.openstack.org/#/c/227646/ for system-config. Mostly because of some brokenness for packstack / puppet jobs. Now that we have landed bindep, I wonder if it makes more sense to move adding the repo dependencies into JJB | 23:42 |
| *** alex_xu has joined #openstack-infra | 23:42 | |
| pabelanger | ianw: and if projects need the RDO repo, to explicitly enable it | 23:42 |
| ianw | pabelanger: it seems quite reasonable to have base nodes *not* having RDO on them. this was for clarkb and multinode stuff IIRC ... which is all devsatck-gate-ish | 23:44 |
| clarkb | https://jenkins07.openstack.org/job/gate-openstackci-beaker-centos-7/41/console is holding up all the other puppet changes :( | 23:45 |
| ianw | on a slightly related note, i have an outstanding change to put epel into the minimal images too, since they actually depend on it. i guess i've just never build centos-minimal without our puppet stuff before, but i hit it yesterday | 23:45 |
| clarkb | ianw: pabelanger: its two things, 1) we need ovs sorry 2) we need to cache whatever else is in rdo that devstack depends on | 23:45 |
| clarkb | pabelanger: ianw: my feeling on that is that ovs does not belong in rdo and if it moved I would be happy. But until then the repo isn't going away sorry | 23:46 |
| clarkb | I suppose we could try going back to linux bridge but I don't know what the state of its vxlan support is and we need vxlan because gre doesn't work in some clouds :( | 23:47 |
| *** piet_ has quit IRC | 23:47 | |
| ianw | clarkb: sorry, my memory is hazy. ovs is for multi-node, right? | 23:48 |
| *** akshai has quit IRC | 23:48 | |
| clarkb | ianw: not anymore we use it on single node tests so that there is network consistency across the single and multi node envs | 23:48 |
| clarkb | vxlan is only multinode though | 23:48 |
| *** akshai has joined #openstack-infra | 23:49 | |
| ianw | ok, maybe that's where i was getting confused | 23:49 |
| clarkb | basically the "switch" always exists for nova net and neutron + dvr (it doesn't exist for neutron without dvr because neutron is weird) | 23:50 |
| pabelanger | clarkb: ianw: So, the issue I think is, rdo trunk right now is broken, because newton is open. So, what if we did something like yum install <foo> --enablerepo=rdo for caching, which will only download RDO for that specific transaction, but keep it disabled the rest of the time. Then, a project could do yum-config-manager --enable rdo if they wanted to install dependencies? | 23:50 |
| clarkb | pabelanger: no | 23:50 |
| clarkb | mostly because I am lazy and tis is the one little lever I get over broken package repos | 23:51 |
| clarkb | we need a package that is only in rdo on the majority of our tets | 23:51 |
| clarkb | therefore it should be enabled | 23:51 |
| *** zhurong has quit IRC | 23:51 | |
| *** IlyaG has quit IRC | 23:51 | |
| clarkb | if peple need to disable rdo they can do that | 23:51 |
| clarkb | but they are the special case | 23:51 |
| *** sdague has quit IRC | 23:51 | |
| *** maishsk has quit IRC | 23:52 | |
| pabelanger | is OVS the only thing? I'd have to check to see what else we pull in | 23:52 |
| clarkb | (I would be so happy if ovs wasn't in a special repo) | 23:52 |
| clarkb | pabelanger: ovs and anything it depends on | 23:52 |
| ianw | why could we not do it in devstack-gate? | 23:53 |
| clarkb | ianw: bceause devstack-gate is the majority of our tests | 23:53 |
| clarkb | ianw: I am solving for the majority | 23:53 |
| clarkb | if there are special cases elsewhere they should be treated as special cases | 23:53 |
| fungi | the majority of our jobs on rh platforms anyway (most non-devstack-gate jobs are on ubuntu-trusty) | 23:54 |
| clarkb | I will happily use linux bridge if vxlan is viable on it (I want to say it is not but someone correct me if I am wrong) | 23:55 |
| openstackgerrit | Merged openstack-infra/puppet-graphite: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306119 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-haveged: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306120 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-httpd: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306122 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-iptables: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306124 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-jenkins: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306126 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-lodgeit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306129 | 23:56 |
| fungi | i have to agree, devstack-gate depending on one package (directly) from an otherwise broken package suite is a little bonkers and not something i would want to inflict on others trying to reuse it downstream | 23:56 |
| *** akshai has quit IRC | 23:56 | |
| openstackgerrit | Merged openstack-infra/puppet-log_processor: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306130 | 23:56 |
| openstackgerrit | Merged openstack-infra/puppet-logrotate: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306131 | 23:57 |
| *** Sukhdev has quit IRC | 23:57 | |
| fungi | so fixing that by either not using it any longer (if there are viable alternatives) or moving it to a different suite/channel/whatever rhn calls them seem like the most ideal solutions at least | 23:58 |
| pabelanger | fungi: this was specific to puppet / packstack integration testing if I understand. They spend most of the day trying to track down why their liberty branches were using mitaka packages. Which is a result of us using rdo-release from trunk in system-config | 23:58 |
| *** piet has joined #openstack-infra | 23:58 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add api to get recent failed runs by run_metadata https://review.openstack.org/305495 | 23:58 |
| *** jamielennox|away is now known as jamielennox | 23:59 | |
| ianw | OTOH, it decreases reproducability of devstack-gate because there's "magic" baked in the nodes we use. for the most part, we just ship a plain node with a lot of caching | 23:59 |
| openstackgerrit | Merged openstack-infra/puppet-meetbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306135 | 23:59 |
| fungi | pabelanger: yep, it certainly sounds like we should _not_ trust rdo | 23:59 |
| pabelanger | I'll have to differ to ianw to see how to address ovs dependencies | 23:59 |
| clarkb | really ovs doesn't belong in the openstack package repo IMO because its not an openstack thing | 23:59 |
| clarkb | there are valid use cases for it outside of openstack (like this one) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!