*** bobh has joined #openstack-infra | 00:03 | |
*** rcernin has joined #openstack-infra | 00:03 | |
*** bobh has quit IRC | 00:08 | |
*** mist27 has joined #openstack-infra | 00:08 | |
mist27 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 00:08 |
---|---|---|
*** mist27 has quit IRC | 00:08 | |
pabelanger | clarkb: I'm around now | 00:10 |
clarkb | pabelanger: do we want to go ahead with the restarts without corvus? I'm reasonably confident in the changes but have not reviewed all of them since the last restart | 00:10 |
pabelanger | clarkb: which git sha are we running now? | 00:11 |
*** shrircha has quit IRC | 00:11 | |
pabelanger | looking at git log now | 00:11 |
clarkb | I'm not sure of the exact sha | 00:11 |
*** shrircha has joined #openstack-infra | 00:12 | |
clarkb | but it included tobiash change to configs | 00:12 |
pabelanger | clarkb: I propose we land https://review.openstack.org/583639/ then wait until morning, so we don't ask ourself it again :) | 00:12 |
clarkb | I like this idea | 00:13 |
*** bobh has joined #openstack-infra | 00:14 | |
pabelanger | clarkb: I wouldn't mind maybe upgrading the kernel on ze01.o.o, and see if we see the same improvement that we see on ze11.o.o | 00:15 |
*** zhangfei has joined #openstack-infra | 00:15 | |
pabelanger | but that means we a reboot of zuul | 00:15 |
pabelanger | okay, I'll wait until we tag the next release then schedule a reboot | 00:16 |
*** wolverineav has joined #openstack-infra | 00:17 | |
clarkb | why do we have to reboot zuul? | 00:17 |
clarkb | would just be the executor | 00:17 |
pabelanger | yah, sorry zuul-executor | 00:17 |
*** bobh has quit IRC | 00:18 | |
*** zhangfei has quit IRC | 00:19 | |
*** wolverineav has quit IRC | 00:21 | |
*** bobh has joined #openstack-infra | 00:23 | |
clarkb | pabelanger: mordred I left a comment on 583639 but approvd it as its functional as is and I think a good improvement for this sort of thing | 00:23 |
*** theaetetus16 has joined #openstack-infra | 00:23 | |
theaetetus16 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 00:24 |
*** theaetetus16 has quit IRC | 00:24 | |
*** dingyichen has joined #openstack-infra | 00:24 | |
pabelanger | clarkb: re nodepool.yaml I'll check, but thought now builder always reloaded clouds.yaml | 00:25 |
*** austin-sun has quit IRC | 00:25 | |
*** dtruong2 has joined #openstack-infra | 00:25 | |
clarkb | pabelanger: I ran into it not doing that recently and have to restart launchers (that is what precipitated the failed upgrade with the zk schema change recently) | 00:25 |
pabelanger | Isee | 00:26 |
*** bobh has quit IRC | 00:27 | |
*** jamesmcarthur has joined #openstack-infra | 00:28 | |
*** owalsh_ is now known as owalsh | 00:32 | |
*** akhilaki has quit IRC | 00:33 | |
*** bobh has joined #openstack-infra | 00:34 | |
*** dtruong2 has quit IRC | 00:36 | |
*** rpioso is now known as rpioso|afk | 00:37 | |
*** hamzy has joined #openstack-infra | 00:38 | |
*** bobh has quit IRC | 00:39 | |
*** yamamoto has quit IRC | 00:39 | |
*** bobh has joined #openstack-infra | 00:45 | |
*** jamesmcarthur has quit IRC | 00:46 | |
*** bobh has quit IRC | 00:50 | |
*** jamesmcarthur has joined #openstack-infra | 00:52 | |
*** Guest87659 has joined #openstack-infra | 00:53 | |
Guest87659 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 00:53 |
*** Guest87659 has quit IRC | 00:53 | |
*** jamesmcarthur has quit IRC | 00:54 | |
*** bdodd has joined #openstack-infra | 00:56 | |
*** jamesmcarthur has joined #openstack-infra | 00:56 | |
*** bobh has joined #openstack-infra | 00:58 | |
*** iDanoo16 has joined #openstack-infra | 00:59 | |
iDanoo16 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 00:59 |
*** iDanoo16 has quit IRC | 00:59 | |
*** bobh has quit IRC | 01:02 | |
*** yamamoto has joined #openstack-infra | 01:03 | |
*** gyee has quit IRC | 01:08 | |
*** bobh has joined #openstack-infra | 01:09 | |
*** ddurst has quit IRC | 01:09 | |
*** ddurst has joined #openstack-infra | 01:09 | |
*** jamesmcarthur has quit IRC | 01:10 | |
*** jamesmcarthur has joined #openstack-infra | 01:10 | |
*** annp has quit IRC | 01:13 | |
*** bobh has quit IRC | 01:13 | |
*** annp has joined #openstack-infra | 01:14 | |
*** bobh has joined #openstack-infra | 01:15 | |
*** hongbin has joined #openstack-infra | 01:16 | |
*** edmondsw has joined #openstack-infra | 01:17 | |
*** jamesmcarthur has quit IRC | 01:18 | |
*** bobh has quit IRC | 01:20 | |
*** dtruong_ has quit IRC | 01:20 | |
*** yamahata has quit IRC | 01:20 | |
*** edmondsw has quit IRC | 01:21 | |
*** yamamoto has quit IRC | 01:22 | |
*** jamesmcarthur has joined #openstack-infra | 01:22 | |
*** bobh has joined #openstack-infra | 01:26 | |
*** bobh has quit IRC | 01:31 | |
*** wolverineav has joined #openstack-infra | 01:31 | |
*** wolverineav has quit IRC | 01:35 | |
openstackgerrit | Austin Sun proposed openstack-infra/project-config master: Add Starlingx (openstack/stx-*) projects to #starlingx IRC channel https://review.openstack.org/585919 | 01:35 |
*** bobh has joined #openstack-infra | 01:38 | |
*** bobh has quit IRC | 01:42 | |
*** bobh has joined #openstack-infra | 01:43 | |
*** markvoelker has joined #openstack-infra | 01:43 | |
*** felipemonteiro has joined #openstack-infra | 01:43 | |
*** jamesmcarthur has quit IRC | 01:44 | |
*** markvoelker_ has quit IRC | 01:44 | |
*** zhangfei has joined #openstack-infra | 01:45 | |
*** markvoelker_ has joined #openstack-infra | 01:46 | |
*** bobh has quit IRC | 01:47 | |
*** markvoelker has quit IRC | 01:48 | |
*** jamesmcarthur has joined #openstack-infra | 01:48 | |
*** yamamoto has joined #openstack-infra | 01:50 | |
*** jamesmcarthur has quit IRC | 01:53 | |
*** bobh has joined #openstack-infra | 01:54 | |
*** zhangfei has quit IRC | 01:57 | |
openstackgerrit | Austin Sun proposed openstack-infra/project-config master: Add gerritbot for StarlingX (openstack/stx-*) projects to #starlingx IRC channel https://review.openstack.org/585919 | 01:58 |
*** bobh has quit IRC | 01:58 | |
*** graphene has quit IRC | 02:01 | |
*** graphene has joined #openstack-infra | 02:02 | |
*** bobh has joined #openstack-infra | 02:02 | |
*** wolverineav has joined #openstack-infra | 02:06 | |
*** zhangfei has joined #openstack-infra | 02:10 | |
*** wolverineav has quit IRC | 02:11 | |
*** graphene has quit IRC | 02:12 | |
*** graphene has joined #openstack-infra | 02:13 | |
*** armaan has quit IRC | 02:13 | |
openstackgerrit | Merged openstack-infra/system-config master: Add #starlingx channel to meetbot. https://review.openstack.org/581897 | 02:16 |
*** yamamoto has quit IRC | 02:26 | |
*** gongysh has joined #openstack-infra | 02:27 | |
*** jelly15 has joined #openstack-infra | 02:33 | |
jelly15 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 02:33 |
jelly15 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 02:33 |
jelly15 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 02:33 |
*** jelly15 has quit IRC | 02:33 | |
*** pixdamix18 has joined #openstack-infra | 02:33 | |
pixdamix18 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 02:33 |
pixdamix18 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 02:33 |
pixdamix18 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 02:33 |
*** pixdamix18 has quit IRC | 02:33 | |
*** felipemonteiro has quit IRC | 02:38 | |
*** yamamoto has joined #openstack-infra | 02:39 | |
*** roman_g has quit IRC | 02:43 | |
*** bobh has quit IRC | 02:43 | |
*** openstack has joined #openstack-infra | 02:48 | |
*** ChanServ sets mode: +o openstack | 02:48 | |
*** jamesmcarthur has quit IRC | 02:50 | |
*** hongbin has quit IRC | 02:56 | |
*** zhangfei has quit IRC | 03:01 | |
*** dave-mcc_ has quit IRC | 03:02 | |
*** edmondsw has joined #openstack-infra | 03:05 | |
*** yamamoto has quit IRC | 03:07 | |
*** yamahata has joined #openstack-infra | 03:08 | |
gongysh | hi, I am setup a multi node ci job | 03:09 |
*** edmondsw has quit IRC | 03:09 | |
gongysh | need a two nic two node env. | 03:10 |
gongysh | how I can get second nic's name and nic's ip address? | 03:10 |
gongysh | the job is here: https://review.openstack.org/#/c/578170/ | 03:11 |
*** yamamoto has joined #openstack-infra | 03:13 | |
*** zhangfei has joined #openstack-infra | 03:14 | |
*** ramishra has joined #openstack-infra | 03:15 | |
*** Fusl21 has joined #openstack-infra | 03:16 | |
Fusl21 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 03:16 |
*** Fusl21 has quit IRC | 03:16 | |
clarkb | gongysh: you can use the multinode bridge role to set up additonal interfaces for multinode jobs http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/multi-node-bridge | 03:16 |
clarkb | but default you should already get one if using the base devstack multinode job | 03:16 |
clarkb | *by default | 03:16 |
gongysh | br-infra | 03:20 |
gongysh | yes, I got the one. | 03:20 |
*** mriedem_afk has quit IRC | 03:20 | |
clarkb | you should be able to run it again with different values to set up another interfave (and bridge) | 03:21 |
clarkb | gongysh: why do you need multiple interfaces? | 03:22 |
gongysh | clarkb, I need to set up a flat provider network and another for tenant network. | 03:22 |
openstackgerrit | Merged openstack-infra/zuul master: Emit a log line containing version info around startup https://review.openstack.org/583639 | 03:23 |
clarkb | gongysh: neutron should manage the tenant network though right? | 03:23 |
gongysh | clarkb, right | 03:23 |
clarkb | it may work on the one interface in that case | 03:24 |
clarkb | either way you should be able to add a new bridge by running that role again with different args | 03:24 |
gongysh | clarkb, how to do that? | 03:27 |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: doc: Move zuul variable references to a section https://review.openstack.org/584779 | 03:27 |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: Add variables to project https://review.openstack.org/584230 | 03:27 |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: Use definition list for job status https://review.openstack.org/584780 | 03:27 |
*** Sukhdev has joined #openstack-infra | 03:27 | |
gongysh | http://logs.openstack.org/70/578170/46/check/tacker-functional-devstack-multinode/0b5ddfc/controller/confs/devstack/ovsvsctl.txt | 03:29 |
clarkb | gongysh: https://docs.ansible.com/ansible/2.5/user_guide/playbooks_reuse_roles.html#using-roles you use include_role I think | 03:29 |
gongysh | clarkb, I can see that the br-infra is using second card's ip address as sub vxlan port. | 03:29 |
*** armax has quit IRC | 03:29 | |
clarkb | that depends on the cloud but it will use the in cloud private address if that exists to avoid nat | 03:31 |
clarkb | gongysh: if you use br-infra for provider network then bridge br-ex and br-infra for tenant networking will that work? | 03:34 |
clarkb | basically neutron sharing the provider network to run the overlays | 03:34 |
*** dtruong2 has joined #openstack-infra | 03:34 | |
gongysh | clarkb, br-infra for provider network flat., br-tun for tenant vxlan network | 03:35 |
clarkb | sure, could you run them both over br-infra though | 03:35 |
clarkb | the tenant networks are another layer of vxlan so should be isolated frkm the provider flat networking | 03:36 |
clarkb | but could share the l2 to make sure packets go between the two nodes | 03:37 |
*** dtruong2 has quit IRC | 03:38 | |
*** dtruong2 has joined #openstack-infra | 03:38 | |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: Rename didAnyJobFail() to hasAnyJobFailed() https://review.openstack.org/585134 | 03:39 |
*** dtruong2 has quit IRC | 03:40 | |
*** sins- has joined #openstack-infra | 03:43 | |
sins- | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 03:43 |
*** sins- has quit IRC | 03:43 | |
*** graphene has quit IRC | 03:47 | |
*** graphene has joined #openstack-infra | 03:48 | |
*** udesale has joined #openstack-infra | 03:48 | |
*** slaweq has quit IRC | 03:50 | |
*** lpetrut has joined #openstack-infra | 03:53 | |
gongysh | clarkb, {{ hostvars[groups['switch'][0]]['nodepool']['private_ipv4'] }} | 03:56 |
gongysh | so {{ hostvars[groups['switch'][0]]['nodepool']['public_ipv4'] }} is referring to the eth0's ipv4 address, right? | 03:56 |
clarkb | gongysh: not necessarily. If that cloud uses floating IPs for public IPs it will the be floating IP address not the one on the interface | 03:57 |
clarkb | gongysh: if you use the multinode node bridge role it should figure out which IP to use for you iirc | 03:58 |
*** slaweq has joined #openstack-infra | 03:58 | |
clarkb | gongysh: all you have to worry about is providing the overlay's ip address range | 03:58 |
*** eernst has joined #openstack-infra | 03:59 | |
*** lpetrut has quit IRC | 04:03 | |
gongysh | clarkb, now the br-infra has Ip address. is there a way to let zuul not asign the IP address? | 04:05 |
gongysh | I know, If I set up the br-infra, I can call the role with: bridge_configure_address == false. | 04:05 |
*** mschuppert has joined #openstack-infra | 04:05 | |
clarkb | https://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/multi-node-bridge/README.rst#n49 yes that is what you would do. If you are inheriting from the existing multinode job I don't think you can override that | 04:06 |
*** dtruong_ has joined #openstack-infra | 04:06 | |
clarkb | you may be able to override it by setting it at the job level though. I am not sure | 04:06 |
*** wolverineav has joined #openstack-infra | 04:07 | |
clarkb | gongysh: one reason to set the IPs is that neutron by default sets up the floating IP range in that /23 so that instances are pingable from tempest | 04:07 |
clarkb | (this makes all the nova VMs reachable from tempest without setting up routing (since it is all direct attached, a bit of a hack but simple) | 04:08 |
*** felipemonteiro has joined #openstack-infra | 04:09 | |
gongysh | clarkb, the default br-infra ip is 172.24.4.1/23 for switch node. | 04:11 |
*** janki has joined #openstack-infra | 04:11 | |
clarkb | yup and then fip range is 172.24.5.0/24 | 04:11 |
clarkb | which allows the switch node (where tempest is running) to talk to VMs via floating IPs even if they are on the other nodes | 04:12 |
*** wolverineav has quit IRC | 04:12 | |
clarkb | (beacuse linux adds routes for direct attached networks) | 04:12 |
*** rosmaita has quit IRC | 04:12 | |
*** yamamoto has quit IRC | 04:13 | |
clarkb | you should be able to run another l3 subnet range across that l2 if you need to (but not sure) for the flat network | 04:14 |
*** psachin`` has joined #openstack-infra | 04:14 | |
gongysh | 172.24.5.1/24 on br-ex at switch node. | 04:16 |
gongysh | no ip assigned at peer node's br-ex. | 04:16 |
*** jamesmcarthur has joined #openstack-infra | 04:17 | |
clarkb | gongysh: correct since the fips are all terminated on the swift node if that is the networking node | 04:17 |
clarkb | I think this changes if you use dvr but by default this is how it is set up | 04:18 |
gongysh | got it. now I think I am clear about the multinode stuff. | 04:18 |
gongysh | thanks | 04:19 |
clarkb | s/swift/switch/ | 04:19 |
gongysh | clarkb, if you are interested, you can help me to review https://review.openstack.org/#/c/578170/ | 04:20 |
clarkb | gongysh: it is getting late here now, I'll try to take a look in the morning | 04:20 |
gongysh | clarkb, ok | 04:21 |
*** jamesmcarthur has quit IRC | 04:21 | |
gongysh | many thanks | 04:21 |
*** kjackal has joined #openstack-infra | 04:28 | |
*** gongysh has quit IRC | 04:38 | |
*** yamamoto has joined #openstack-infra | 04:38 | |
*** felipemonteiro has quit IRC | 04:39 | |
*** Sukhdev has quit IRC | 04:44 | |
*** gongysh has joined #openstack-infra | 04:46 | |
*** Sukhdev has joined #openstack-infra | 04:47 | |
*** ykarel|away has joined #openstack-infra | 04:47 | |
*** spsurya_ has quit IRC | 04:48 | |
*** spsurya_ has joined #openstack-infra | 04:49 | |
*** edmondsw has joined #openstack-infra | 04:53 | |
*** gongysh has quit IRC | 04:54 | |
*** armaan has joined #openstack-infra | 04:57 | |
*** dtruong2 has joined #openstack-infra | 04:57 | |
*** edmondsw has quit IRC | 04:58 | |
*** armaan has quit IRC | 05:01 | |
*** Whiskey27 has joined #openstack-infra | 05:03 | |
Whiskey27 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:03 |
*** Whiskey27 has quit IRC | 05:03 | |
*** eernst has quit IRC | 05:05 | |
*** e0ne has joined #openstack-infra | 05:06 | |
*** Tahvok has quit IRC | 05:06 | |
*** spsurya_ is now known as spsurya | 05:07 | |
*** quiquell has joined #openstack-infra | 05:08 | |
*** Tahvok has joined #openstack-infra | 05:10 | |
*** yamamoto has quit IRC | 05:13 | |
*** yamamoto has joined #openstack-infra | 05:15 | |
*** dtruong2 has quit IRC | 05:21 | |
*** rwsu has quit IRC | 05:23 | |
*** felipemonteiro has joined #openstack-infra | 05:24 | |
*** dtruong2 has joined #openstack-infra | 05:24 | |
*** gongysh has joined #openstack-infra | 05:24 | |
*** dtruong2 has quit IRC | 05:28 | |
*** dtruong2 has joined #openstack-infra | 05:30 | |
*** dtruong2 has quit IRC | 05:30 | |
*** Sukhdev has quit IRC | 05:31 | |
*** yamamoto has quit IRC | 05:31 | |
*** dtruong2 has joined #openstack-infra | 05:31 | |
*** dtruong2 has quit IRC | 05:32 | |
*** dtruong2 has joined #openstack-infra | 05:33 | |
*** dtruong2 has quit IRC | 05:33 | |
*** zhangfei has quit IRC | 05:33 | |
*** bambams24 has joined #openstack-infra | 05:34 | |
bambams24 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:34 |
*** bambams24 has quit IRC | 05:34 | |
*** pgadiya has joined #openstack-infra | 05:35 | |
*** pgadiya has quit IRC | 05:35 | |
*** yamamoto has joined #openstack-infra | 05:36 | |
*** agopi has quit IRC | 05:38 | |
*** gongysh has quit IRC | 05:38 | |
*** FiendKing04 has joined #openstack-infra | 05:44 | |
FiendKing04 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:44 |
FiendKing04 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 05:44 |
FiendKing04 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 05:44 |
*** FiendKing04 has quit IRC | 05:44 | |
*** zhangfei has joined #openstack-infra | 05:47 | |
*** yaymuffins2 has joined #openstack-infra | 05:48 | |
yaymuffins2 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:48 |
*** yaymuffins2 has quit IRC | 05:48 | |
*** links has joined #openstack-infra | 05:48 | |
*** cshastri has joined #openstack-infra | 05:50 | |
*** dklyle has quit IRC | 05:52 | |
*** dklyle has joined #openstack-infra | 05:53 | |
*** Guest46157 has joined #openstack-infra | 05:58 | |
*** wook_10 has joined #openstack-infra | 05:58 | |
wook_10 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:58 |
*** wook_10 has quit IRC | 05:58 | |
*** e0ne has quit IRC | 06:00 | |
*** yamamoto has quit IRC | 06:01 | |
*** yamamoto has joined #openstack-infra | 06:03 | |
*** udesale has quit IRC | 06:04 | |
*** udesale has joined #openstack-infra | 06:04 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Tolerate missing project https://review.openstack.org/579872 | 06:04 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Restore zuul_swift_upload.py script https://review.openstack.org/585814 | 06:07 |
*** wolverineav has joined #openstack-infra | 06:08 | |
*** wolverineav has quit IRC | 06:12 | |
*** yamamoto has quit IRC | 06:19 | |
*** kjackal has quit IRC | 06:20 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Restore zuul_swift_upload.py script https://review.openstack.org/585814 | 06:20 |
openstackgerrit | Zhao Chao proposed openstack-infra/project-config master: Aslo apply the py35 job for trove-dashboard queens https://review.openstack.org/585966 | 06:22 |
*** dhajare has joined #openstack-infra | 06:23 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/585969 | 06:24 |
*** Douhet has quit IRC | 06:29 | |
*** Douhet has joined #openstack-infra | 06:31 | |
*** edmondsw has joined #openstack-infra | 06:41 | |
*** pguimaraes has joined #openstack-infra | 06:42 | |
*** Douhet has quit IRC | 06:43 | |
*** Douhet has joined #openstack-infra | 06:44 | |
*** edmondsw has quit IRC | 06:47 | |
openstackgerrit | Merged openstack-infra/zuul master: doc: Move zuul variable references to a section https://review.openstack.org/584779 | 06:51 |
*** mcspud21 has joined #openstack-infra | 06:53 | |
mcspud21 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 06:53 |
mcspud21 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 06:53 |
*** mcspud21 has quit IRC | 06:53 | |
*** jpich has joined #openstack-infra | 06:58 | |
*** florianf has joined #openstack-infra | 07:01 | |
*** Douhet has quit IRC | 07:08 | |
*** Douhet has joined #openstack-infra | 07:08 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Remove unecessary shebang and exec bit https://review.openstack.org/583563 | 07:12 |
*** gongysh has joined #openstack-infra | 07:12 | |
*** kjackal has joined #openstack-infra | 07:14 | |
openstackgerrit | Sampath Priyankara (samP) proposed openstack-infra/project-config master: Add publish-to-pypi-horizon job to masakari-dashboard https://review.openstack.org/585975 | 07:22 |
*** slaweq has quit IRC | 07:23 | |
*** slaweq has joined #openstack-infra | 07:23 | |
*** felipemonteiro has quit IRC | 07:23 | |
*** pcaruana has joined #openstack-infra | 07:25 | |
*** ccamacho has joined #openstack-infra | 07:27 | |
*** gfidente has joined #openstack-infra | 07:28 | |
*** gfidente has joined #openstack-infra | 07:28 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Restructure return values section in docs https://review.openstack.org/585981 | 07:32 |
*** zoli|gone is now known as zoli | 07:35 | |
*** tosky has joined #openstack-infra | 07:38 | |
*** zhangfei has quit IRC | 07:42 | |
*** quiquell is now known as quiquell|bbl | 07:42 | |
*** dtantsur|afk is now known as dtantsur | 07:46 | |
*** alexchadin has joined #openstack-infra | 07:48 | |
*** quiquell|bbl has quit IRC | 07:49 | |
*** zhangfei has joined #openstack-infra | 07:55 | |
*** quiquell has joined #openstack-infra | 08:02 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Restructure return values section in docs https://review.openstack.org/585981 | 08:03 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 08:03 |
*** quiquell has quit IRC | 08:03 | |
*** alexchad_ has joined #openstack-infra | 08:05 | |
*** alexchadin has quit IRC | 08:07 | |
*** wolverineav has joined #openstack-infra | 08:09 | |
*** shardy has joined #openstack-infra | 08:10 | |
*** AJaeger has quit IRC | 08:12 | |
*** jiapei has joined #openstack-infra | 08:13 | |
*** Sagan27 has joined #openstack-infra | 08:13 | |
Sagan27 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 08:13 |
*** Sagan27 has quit IRC | 08:13 | |
*** wolverineav has quit IRC | 08:13 | |
*** Bhujay has joined #openstack-infra | 08:14 | |
*** yamamoto has joined #openstack-infra | 08:15 | |
*** kjackal has quit IRC | 08:15 | |
*** e0ne has joined #openstack-infra | 08:17 | |
*** Guest72310 has joined #openstack-infra | 08:18 | |
Guest72310 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 08:18 |
Guest72310 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 08:18 |
*** Guest72310 has quit IRC | 08:18 | |
*** yamamoto has quit IRC | 08:18 | |
*** armaan has joined #openstack-infra | 08:19 | |
*** AJaeger has joined #openstack-infra | 08:19 | |
openstackgerrit | Merged openstack/diskimage-builder master: modprobe DIB_MODPROBE_BLACKLIST should be optional https://review.openstack.org/585784 | 08:25 |
openstackgerrit | Merged openstack/diskimage-builder master: Add DIB element to blacklist nouveau https://review.openstack.org/571777 | 08:25 |
*** zoli is now known as zoli|dentist | 08:25 | |
openstackgerrit | Merged openstack-infra/zuul master: Remove unecessary shebang and exec bit https://review.openstack.org/583563 | 08:29 |
*** edmondsw has joined #openstack-infra | 08:30 | |
*** kashyap has joined #openstack-infra | 08:32 | |
kashyap | Morning folks | 08:32 |
kashyap | Seems like git.openstack.org isn't staler compared to GitHub? | 08:32 |
kashyap | E.g. | 08:32 |
kashyap | Compare these two: | 08:33 |
kashyap | http://git.openstack.org/cgit/openstack/nova/tree/nova/conf/libvirt.py?id=6b601b7#n642 | 08:33 |
kashyap | https://github.com/openstack/nova/blob/master/nova/conf/libvirt.py#L662 | 08:33 |
kashyap | The GitHub edition is correct (& up2date). | 08:33 |
*** edmondsw has quit IRC | 08:34 | |
*** Bhujay has quit IRC | 08:37 | |
*** Bhujay has joined #openstack-infra | 08:37 | |
*** ykarel|away has quit IRC | 08:38 | |
*** ykarel| has joined #openstack-infra | 08:38 | |
*** pbourke has quit IRC | 08:39 | |
*** pbourke has joined #openstack-infra | 08:41 | |
*** tesseract has joined #openstack-infra | 08:42 | |
*** KindOne1423 has joined #openstack-infra | 08:43 | |
KindOne1423 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 08:43 |
*** KindOne1423 has quit IRC | 08:43 | |
*** derekh has joined #openstack-infra | 08:43 | |
*** udesale_ has joined #openstack-infra | 08:44 | |
*** janki has quit IRC | 08:45 | |
*** udesale has quit IRC | 08:46 | |
openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/585969 | 08:48 |
*** sshnaidm|afk is now known as sshnaidm | 08:51 | |
*** dingyichen has quit IRC | 08:54 | |
AJaeger | kashyap: git.openstack.org is our *master*, github is only a mirror. | 08:55 |
AJaeger | kashyap: why do you have ?id=... in the URL | 08:56 |
kashyap | AJaeger: Then, surely "master" is out of date? | 08:56 |
AJaeger | http://git.openstack.org/cgit/openstack/nova/tree/nova/conf/libvirt.py#n662 looks correct | 08:56 |
kashyap | Or is it a PEBKAC? | 08:56 |
kashyap | AJaeger: Err | 08:56 |
kashyap | AJaeger: Sorry, I was looking at a stale commit! | 08:56 |
AJaeger | that explains it ;) | 08:57 |
*** sambetts|afk has quit IRC | 08:57 | |
kashyap | AJaeger: Yeah, sorry for the noise. | 08:58 |
*** alexchadin has joined #openstack-infra | 08:59 | |
*** sambetts_ has joined #openstack-infra | 08:59 | |
*** aOssed- has joined #openstack-infra | 09:00 | |
aOssed- | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 09:00 |
aOssed- | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 09:00 |
*** aOssed- has quit IRC | 09:00 | |
*** alexchad_ has quit IRC | 09:01 | |
*** dtruong_ has quit IRC | 09:02 | |
*** florianf has quit IRC | 09:06 | |
AJaeger | kashyap: no worries | 09:08 |
kashyap | Nod | 09:09 |
*** zhangfei has quit IRC | 09:19 | |
*** d0ugal has joined #openstack-infra | 09:21 | |
*** armaan has quit IRC | 09:22 | |
*** armaan has joined #openstack-infra | 09:23 | |
*** ginopc has joined #openstack-infra | 09:29 | |
*** Bhujay has quit IRC | 09:30 | |
*** Bhujay has joined #openstack-infra | 09:30 | |
*** zhangfei has joined #openstack-infra | 09:31 | |
*** icywiz24 has joined #openstack-infra | 09:33 | |
icywiz24 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 09:33 |
*** icywiz24 has quit IRC | 09:33 | |
*** stakeda has quit IRC | 09:46 | |
*** Bhujay has quit IRC | 09:48 | |
*** Bhujay has joined #openstack-infra | 09:48 | |
*** zoli|dentist is now known as zoli | 09:50 | |
*** armaan has quit IRC | 09:50 | |
*** armaan has joined #openstack-infra | 09:51 | |
*** Bhujay has quit IRC | 09:51 | |
*** d0ugal has quit IRC | 09:52 | |
*** Bhujay has joined #openstack-infra | 09:52 | |
*** Bhujay has quit IRC | 09:54 | |
*** Bhujay has joined #openstack-infra | 09:55 | |
*** Bhujay has quit IRC | 09:57 | |
*** Bhujay has joined #openstack-infra | 09:58 | |
*** armaan has quit IRC | 10:01 | |
*** armaan has joined #openstack-infra | 10:02 | |
*** quiquell has joined #openstack-infra | 10:03 | |
*** janki has joined #openstack-infra | 10:06 | |
*** udesale__ has joined #openstack-infra | 10:08 | |
*** alexchadin has quit IRC | 10:08 | |
*** apetrich has quit IRC | 10:09 | |
*** wolverineav has joined #openstack-infra | 10:10 | |
*** dtruong_ has joined #openstack-infra | 10:10 | |
*** udesale_ has quit IRC | 10:10 | |
*** sshnaidm is now known as sshnaidm|afk | 10:13 | |
*** wolverineav has quit IRC | 10:14 | |
*** jamesmcarthur has joined #openstack-infra | 10:18 | |
*** edmondsw has joined #openstack-infra | 10:18 | |
*** alexchadin has joined #openstack-infra | 10:18 | |
*** Techman29 has joined #openstack-infra | 10:21 | |
Techman29 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 10:21 |
*** Techman29 has quit IRC | 10:21 | |
*** Bhujay has quit IRC | 10:22 | |
*** jamesmcarthur has quit IRC | 10:22 | |
*** Bhujay has joined #openstack-infra | 10:23 | |
*** dx18 has joined #openstack-infra | 10:23 | |
dx18 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 10:23 |
dx18 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 10:23 |
*** dx18 has quit IRC | 10:23 | |
*** edmondsw has quit IRC | 10:23 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Add opensuse-leap support https://review.openstack.org/586038 | 10:25 |
evrardjp | AJaeger: could you have a look at this ^ and give me your opinion? | 10:25 |
openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Add opensuse-leap support https://review.openstack.org/586038 | 10:27 |
*** pelegreno______ has joined #openstack-infra | 10:28 | |
pelegreno______ | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 10:28 |
pelegreno______ | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 10:28 |
*** pelegreno______ has quit IRC | 10:28 | |
*** alexchadin has quit IRC | 10:29 | |
*** yamamoto has joined #openstack-infra | 10:32 | |
*** d0ugal has joined #openstack-infra | 10:32 | |
*** d0ugal has quit IRC | 10:34 | |
*** alexchadin has joined #openstack-infra | 10:38 | |
AJaeger | evrardjp: let's ask dirk as well | 10:40 |
*** dhajare has quit IRC | 10:40 | |
evrardjp | ok -- for the tests I expected this -- it was for the idea I was looking for, but you didn't say anything against it, so I am good :) | 10:42 |
evrardjp | will add the fixtures and the rest. | 10:42 |
evrardjp | will add dirk on this too. | 10:42 |
AJaeger | evrardjp: yes, change looks fine - just missing tests. | 10:42 |
AJaeger | evrardjp: thanks! | 10:42 |
evrardjp | ok | 10:42 |
*** yamamoto has quit IRC | 10:45 | |
*** edmondsw has joined #openstack-infra | 10:49 | |
*** alexchad_ has joined #openstack-infra | 10:49 | |
*** dhajare has joined #openstack-infra | 10:50 | |
*** armaan has quit IRC | 10:50 | |
*** armaan has joined #openstack-infra | 10:50 | |
*** alexchadin has quit IRC | 10:51 | |
*** Bhujay has quit IRC | 10:56 | |
*** Bhujay has joined #openstack-infra | 10:57 | |
*** Bhujay has quit IRC | 10:57 | |
*** sdx2324 has joined #openstack-infra | 10:58 | |
sdx2324 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 10:58 |
*** sdx2324 has quit IRC | 10:58 | |
*** Bhujay has joined #openstack-infra | 10:58 | |
*** linkmark has joined #openstack-infra | 10:58 | |
*** Bhujay has quit IRC | 10:59 | |
*** Bhujay has joined #openstack-infra | 10:59 | |
*** pguimaraes has quit IRC | 11:01 | |
*** rcernin has quit IRC | 11:04 | |
*** quiquell is now known as quiquell|bbl | 11:05 | |
*** dave-mccowan has joined #openstack-infra | 11:07 | |
*** Bhujay has quit IRC | 11:11 | |
*** Bhujay has joined #openstack-infra | 11:11 | |
*** shardy is now known as shardy_lunch | 11:13 | |
*** larainema has quit IRC | 11:14 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support complex data structures as secrets https://review.openstack.org/585892 | 11:24 |
*** udesale__ has quit IRC | 11:25 | |
*** rosmaita has joined #openstack-infra | 11:26 | |
*** Bhujay has quit IRC | 11:27 | |
*** Bhujay has joined #openstack-infra | 11:27 | |
*** 07IADFUJ8 has joined #openstack-infra | 11:28 | |
*** tomaw12 has joined #openstack-infra | 11:28 | |
07IADFUJ8 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 11:28 |
*** 07IADFUJ8 has quit IRC | 11:28 | |
tomaw12 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 11:28 |
*** tomaw12 has quit IRC | 11:28 | |
*** quiquell|bbl is now known as quiquell | 11:32 | |
*** Bhujay has quit IRC | 11:33 | |
*** graphene has quit IRC | 11:33 | |
*** kjackal has joined #openstack-infra | 11:34 | |
*** graphene has joined #openstack-infra | 11:35 | |
*** zhangfei has quit IRC | 11:35 | |
*** panda|rover|off is now known as panda|rover | 11:37 | |
*** zoli is now known as zoli|lunch | 11:38 | |
*** Bhujay has joined #openstack-infra | 11:38 | |
*** gongysh has quit IRC | 11:44 | |
*** agopi has joined #openstack-infra | 11:45 | |
*** tpsilva has joined #openstack-infra | 11:46 | |
*** boden has joined #openstack-infra | 11:49 | |
*** graphene has quit IRC | 11:53 | |
*** graphene has joined #openstack-infra | 11:54 | |
*** graphene has quit IRC | 11:57 | |
*** ccamacho1 has joined #openstack-infra | 11:58 | |
*** ccamacho has quit IRC | 11:58 | |
*** graphene has joined #openstack-infra | 11:58 | |
*** gongysh has joined #openstack-infra | 11:59 | |
*** Bhujay has quit IRC | 12:00 | |
*** armaan has quit IRC | 12:03 | |
*** armaan has joined #openstack-infra | 12:04 | |
*** rfolco|ruck|off is now known as rfolco|ruck | 12:05 | |
*** armaan has quit IRC | 12:07 | |
*** armaan has joined #openstack-infra | 12:08 | |
*** shardy_lunch is now known as shardy | 12:10 | |
*** zoli|lunch is now known as zoli | 12:11 | |
*** armaan has quit IRC | 12:11 | |
*** tharkun22 has joined #openstack-infra | 12:11 | |
tharkun22 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 12:11 |
*** tharkun22 has quit IRC | 12:11 | |
*** armaan has joined #openstack-infra | 12:12 | |
*** hamzy has quit IRC | 12:14 | |
*** shardy has quit IRC | 12:16 | |
*** jamesde__ has joined #openstack-infra | 12:16 | |
*** rh-jelabarre has joined #openstack-infra | 12:18 | |
*** wolverineav has joined #openstack-infra | 12:18 | |
*** hamzy has joined #openstack-infra | 12:19 | |
*** jamesden_ has quit IRC | 12:19 | |
*** wolverineav has quit IRC | 12:20 | |
*** wolverineav has joined #openstack-infra | 12:20 | |
*** shardy has joined #openstack-infra | 12:20 | |
*** pguimaraes has joined #openstack-infra | 12:26 | |
*** psachin`` has quit IRC | 12:26 | |
*** armaan has quit IRC | 12:27 | |
*** armaan has joined #openstack-infra | 12:27 | |
*** rlandy has joined #openstack-infra | 12:28 | |
*** jcoufal has joined #openstack-infra | 12:33 | |
*** jiapei has quit IRC | 12:33 | |
*** yamamoto has joined #openstack-infra | 12:34 | |
*** armaan has quit IRC | 12:35 | |
*** armaan has joined #openstack-infra | 12:36 | |
*** graphene has quit IRC | 12:36 | |
*** openstackgerrit has quit IRC | 12:36 | |
*** mriedem has joined #openstack-infra | 12:36 | |
*** quiquell is now known as quiquell|lunch | 12:37 | |
*** yamamoto has quit IRC | 12:38 | |
*** yamamoto has joined #openstack-infra | 12:39 | |
mordred | infra-root: openstackgerrit got killed by Sigyn just now in #openstack-sdks ... | 12:43 |
mordred | "12:36:45 <-- | openstackgerrit (~openstack@review01.openstack.org) has quit (Killed (Sigyn (Spam is off topic on freenode.)))" | 12:43 |
*** gongysh has quit IRC | 12:43 | |
mordred | didn't we have it registered somewhere as official? | 12:44 |
mordred | oh - I guess it got killed everywhere - I just saw it in openstack-sdks :) | 12:44 |
*** cshastri has quit IRC | 12:46 | |
*** bobh has joined #openstack-infra | 12:46 | |
*** armaan has quit IRC | 12:46 | |
*** links has quit IRC | 12:46 | |
*** armaan has joined #openstack-infra | 12:46 | |
rcarrillocruz | \o/ | 12:47 |
rcarrillocruz | that spam is plaguing freenode lately | 12:47 |
*** sshnaidm|afk is now known as sshnaidm | 12:48 | |
*** vivsoni_ has quit IRC | 12:51 | |
*** bobh has quit IRC | 12:51 | |
*** quiquell|lunch is now known as quiquell | 12:51 | |
*** bobh has joined #openstack-infra | 12:54 | |
*** Sukhdev has joined #openstack-infra | 12:56 | |
*** bobh has quit IRC | 12:58 | |
*** armaan has quit IRC | 13:00 | |
*** kgiusti has joined #openstack-infra | 13:00 | |
*** Sukhdev has quit IRC | 13:01 | |
*** ykarel| has quit IRC | 13:01 | |
*** ykarel| has joined #openstack-infra | 13:03 | |
*** vivsoni has joined #openstack-infra | 13:03 | |
*** bdodd has quit IRC | 13:05 | |
*** bobh has joined #openstack-infra | 13:05 | |
*** armaan has joined #openstack-infra | 13:05 | |
*** armaan has quit IRC | 13:08 | |
*** alexchad_ has quit IRC | 13:09 | |
*** bobh has quit IRC | 13:09 | |
*** ykarel| has quit IRC | 13:12 | |
*** bobh has joined #openstack-infra | 13:15 | |
*** neiloy has joined #openstack-infra | 13:17 | |
*** dhajare has quit IRC | 13:17 | |
*** shardy has quit IRC | 13:18 | |
*** bobh has quit IRC | 13:19 | |
*** shardy has joined #openstack-infra | 13:20 | |
*** eharney has joined #openstack-infra | 13:21 | |
*** yamamoto has quit IRC | 13:22 | |
*** bdodd has joined #openstack-infra | 13:24 | |
*** mriedem is now known as mriedem_afk | 13:25 | |
evrardjp | rcarrillocruz: yeah it's so pleasant! | 13:25 |
evrardjp | :p | 13:25 |
EmilienM | I guess you probably know but in case: it seems like the bot isn't alive anymore | 13:29 |
*** jistr is now known as jistr|mtg | 13:29 | |
*** kiennt26 has joined #openstack-infra | 13:34 | |
*** gongysh has joined #openstack-infra | 13:35 | |
AJaeger | EmilienM: scroll up 3 lines, please | 13:38 |
EmilienM | oops ok sorry | 13:38 |
AJaeger | you're welcome | 13:38 |
*** r-daneel has joined #openstack-infra | 13:40 | |
*** alexchadin has joined #openstack-infra | 13:44 | |
*** rook-- is now known as rook | 13:45 | |
*** yamamoto has joined #openstack-infra | 13:45 | |
*** Bhujay has joined #openstack-infra | 13:47 | |
*** Bhujay has quit IRC | 13:47 | |
*** annp_ has joined #openstack-infra | 13:50 | |
*** hongbin has joined #openstack-infra | 13:52 | |
*** mriedem_afk is now known as mriedem | 13:53 | |
*** roman_g has joined #openstack-infra | 13:57 | |
*** eharney has quit IRC | 14:00 | |
*** Guest14217 is now known as zeus | 14:05 | |
*** zeus has quit IRC | 14:06 | |
*** zeus has joined #openstack-infra | 14:06 | |
*** _ari_ has quit IRC | 14:07 | |
*** rnoriega has quit IRC | 14:07 | |
*** haleyb has quit IRC | 14:07 | |
*** myoung has quit IRC | 14:07 | |
*** pabelanger has quit IRC | 14:07 | |
*** weshay_PTO has quit IRC | 14:07 | |
*** kashyap has quit IRC | 14:07 | |
*** kashyap has joined #openstack-infra | 14:07 | |
*** _ari_ has joined #openstack-infra | 14:07 | |
*** pabelanger has joined #openstack-infra | 14:07 | |
*** rnoriega has joined #openstack-infra | 14:07 | |
*** weshay has joined #openstack-infra | 14:08 | |
*** haleyb has joined #openstack-infra | 14:08 | |
*** armaan has joined #openstack-infra | 14:09 | |
*** myoung has joined #openstack-infra | 14:12 | |
Shrews | pabelanger: clarkb: mordred: please check my puppeting, but i think https://review.openstack.org/586231 with https://review.openstack.org/586236 should fix logging file mixup | 14:13 |
Shrews | tl;dr launchers are getting logging config from puppet-nodepool, builders from system-config | 14:14 |
*** gongysh has quit IRC | 14:14 | |
*** eharney has joined #openstack-infra | 14:14 | |
*** armaan has quit IRC | 14:20 | |
*** eernst has joined #openstack-infra | 14:24 | |
*** jamesmcarthur has joined #openstack-infra | 14:24 | |
*** gongysh has joined #openstack-infra | 14:26 | |
*** psachin`` has joined #openstack-infra | 14:26 | |
*** rpioso|afk is now known as rpioso | 14:27 | |
*** gongysh has quit IRC | 14:33 | |
*** florianf has joined #openstack-infra | 14:38 | |
roman_g | Hello. Please, review/+2/merge: minor thing - adding statusbot to the #airshipit channel - https://review.openstack.org/#/c/581704/ | 14:39 |
roman_g | Pending since July, 11th | 14:39 |
*** L23515 has joined #openstack-infra | 14:41 | |
L23515 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 14:41 |
*** L23515 has quit IRC | 14:41 | |
*** yamamoto has quit IRC | 14:43 | |
*** gema has quit IRC | 14:44 | |
*** yamamoto has joined #openstack-infra | 14:45 | |
*** hongbin has quit IRC | 14:46 | |
*** yamamoto has quit IRC | 14:49 | |
*** Sukhdev has joined #openstack-infra | 14:50 | |
*** greghaynes has quit IRC | 14:52 | |
*** psachin`` has quit IRC | 14:54 | |
*** jistr|mtg is now known as jistr | 14:56 | |
*** gongysh has joined #openstack-infra | 14:57 | |
*** tbarron has quit IRC | 15:01 | |
*** gongysh has quit IRC | 15:01 | |
*** kiennt26 has quit IRC | 15:08 | |
*** tbarron has joined #openstack-infra | 15:08 | |
*** alexchadin has quit IRC | 15:08 | |
gouthamr | hey folks, we have a problem on #openstack-meeting-alt - tbarron just got banned from freenode; and we were midway a meeting he started | 15:09 |
gouthamr | how does one of us gain control? | 15:09 |
tosky | gouthamr: tbarron is back, it seems | 15:10 |
gouthamr | yep, no one panic :) he's back. | 15:11 |
pabelanger | looking | 15:11 |
mordred | \o/ | 15:11 |
pabelanger | cool | 15:11 |
pabelanger | I invited Sigyn there to help with spam, so maybe I should undo that | 15:12 |
tosky | pabelanger: spam is still ongoing | 15:12 |
tosky | tbarron: suggestion: use #chair <nickname> to also set someone else as chair | 15:12 |
pabelanger | tosky: yah, Sigyn will watch and kick potential spammer | 15:12 |
pabelanger | guess it didn't like the massive ping | 15:13 |
*** Guest19794 is now known as kklimonda | 15:13 | |
*** mgoddard has joined #openstack-infra | 15:13 | |
*** kklimonda has quit IRC | 15:14 | |
*** kklimonda has joined #openstack-infra | 15:14 | |
*** janki has quit IRC | 15:15 | |
*** greghaynes has joined #openstack-infra | 15:16 | |
*** gema has joined #openstack-infra | 15:16 | |
*** gema has quit IRC | 15:16 | |
*** gema has joined #openstack-infra | 15:16 | |
mgoddard | hi mordred, any chance you could take a look at https://github.com/ansible/ansible/pull/34472? | 15:17 |
*** Sukhdev has quit IRC | 15:17 | |
mordred | mgoddard: yes - it's now open in my browser | 15:19 |
*** greghaynes has quit IRC | 15:19 | |
mgoddard | mordred: great, thanks | 15:19 |
*** jpeeler[m] has joined #openstack-infra | 15:19 | |
*** annp_ has quit IRC | 15:27 | |
tbarron | tosky: yup | 15:28 |
*** pblaho has quit IRC | 15:35 | |
*** greghaynes has joined #openstack-infra | 15:35 | |
*** pcaruana has quit IRC | 15:38 | |
*** jpeeler[m] has left #openstack-infra | 15:39 | |
*** hamzy has quit IRC | 15:41 | |
*** hamzy has joined #openstack-infra | 15:41 | |
*** zoli is now known as zoli|gone | 15:46 | |
*** hongbin has joined #openstack-infra | 15:49 | |
*** psachin`` has joined #openstack-infra | 15:49 | |
roman_g | Actually where is bot who reports on gerrit submissions? | 15:52 |
roman_g | openstackgerrit is gone | 15:53 |
clarkb | roman_g: it got kicked by Sigyn. I think we may leave it in that state until the spam problem decreases then we can remove Sigyn and add our bots back? | 15:53 |
clarkb | pabelanger: corvus can we whitelist users with Sigyn or is it all or nothing? | 15:53 |
roman_g | clarkb: I don't mind if it would not be reporting here for every patch set. At max - only for merges. | 15:54 |
*** armax has joined #openstack-infra | 15:54 | |
*** yamamoto has joined #openstack-infra | 15:55 | |
*** hamerins has joined #openstack-infra | 15:55 | |
pabelanger | clarkb: not sure, docs say we can unkline after a few minutes | 15:55 |
clarkb | roman_g: the problem (I think) is that sigyn sees repeated messages with little differentiation as spam particularly if they happen often across many channels | 15:55 |
clarkb | roman_g: so even merge reports would fall victim to that | 15:55 |
*** erlon_ has joined #openstack-infra | 15:55 | |
*** ykarel| has joined #openstack-infra | 15:57 | |
roman_g | aah. I see. | 15:57 |
AJaeger | so, people should not resubmit the same changes so often? ;) | 15:57 |
*** edmondsw has quit IRC | 15:57 | |
*** edmondsw has joined #openstack-infra | 15:57 | |
clarkb | roman_g: but we really only need sigyn around while the spam attack is happening. Hopefully that goes away soon and we can bring back openstackgerrit and it will be happy | 15:58 |
*** gfidente has quit IRC | 15:58 | |
*** edmondsw has quit IRC | 15:59 | |
*** rkukura has quit IRC | 15:59 | |
*** gyee has joined #openstack-infra | 15:59 | |
*** myoung is now known as myoung|lunch | 16:00 | |
*** sshnaidm is now known as sshnaidm|afk | 16:00 | |
roman_g | thank you for the explanation, clarkb | 16:00 |
*** yamamoto has quit IRC | 16:01 | |
tbarron | Yeah, Sigyn doesn't like courtesy pings for meetings :) | 16:01 |
tbarron | jungleboyj: ^^^ | 16:01 |
*** e0ne has quit IRC | 16:02 | |
jungleboyj | tbarron: What's up? | 16:02 |
tbarron | jungleboyj: just be careful with courtesy pings | 16:03 |
tbarron | jungleboyj: Sigyn (bot that helps with that annoyming spam) doesn't like them and may ban you as you start your next meeting | 16:03 |
jungleboyj | Oh, ok. Good to know. | 16:04 |
jungleboyj | tbarron: Thanks! | 16:04 |
*** adriant has quit IRC | 16:05 | |
* fungi isn't personally a fan of "courtesy pings" either, uses a reminder application to let him know when meetings and other events are about to start anyway | 16:05 | |
*** adriant has joined #openstack-infra | 16:06 | |
*** yamahata has quit IRC | 16:06 | |
jungleboyj | fungi: You are so organized. ;-) | 16:06 |
tbarron | fungi: yeah, I don't have to ping myself, but we ring a cowbell for the community | 16:07 |
clarkb | sigyn catches it because it is a common spammer behavior too | 16:07 |
tbarron | clarkb: makes sense | 16:07 |
*** ginopc has quit IRC | 16:07 | |
clarkb | "everyone look at my spam!" | 16:07 |
clarkb | :) | 16:08 |
fungi | right, my point was it's annoying in both cases ;) | 16:08 |
tbarron | I'm happy to have an excuse not to do the courtesy ping. | 16:08 |
clarkb | hrm elastic-recheck hasn't regenerated graphs in a while. /me will check on that after caffeine | 16:08 |
clarkb | (this has become the morning ritual, what is broken with the gate during feature freeze) | 16:08 |
tbarron | But it was requested by the meeting attendees. | 16:09 |
pabelanger | clarkb: I've asked in #freenode-sigyn for a whitelist, but unsure since it is a lot of channels | 16:09 |
*** jpich has quit IRC | 16:09 | |
clarkb | pabelanger: ya I don't think its the worst thing to ride it out for another day, I'm assuming the spam attack won't last much longer | 16:09 |
*** florianf has quit IRC | 16:10 | |
jungleboyj | tbarron: ++ | 16:10 |
jungleboyj | I do use them sometimes but for myself but I can set better reminders. :-) | 16:10 |
hamerins | zuul is failing to create the environment correctly for openstack-helm. where/who can i reach out to double check zuul environment | 16:12 |
clarkb | hamerins: this is a good place. Can you provide logs and more specific details on what is wrong with the environment? | 16:12 |
hamerins | the pods for the job are in initializing status. | 16:14 |
hamerins | logs : | 16:15 |
hamerins | 1. http://logs.openstack.org/70/585570/4/check/openstack-helm-dev-deploy-ceph-radosgw-ovs/9bfa295/job-output.txt.gz, | 16:15 |
hamerins | 2. http://logs.openstack.org/70/585570/4/check/openstack-helm-dev-deploy-nfs-lb/e1c4bb0/job-output.txt.gz | 16:15 |
hamerins | 3. http://logs.openstack.org/70/585570/4/check/openstack-helm-ironic-ubuntu/91b82b4/job-output.txt.gz | 16:15 |
hamerins | same check was successful yesterday morning. | 16:15 |
*** quiquell has quit IRC | 16:16 | |
clarkb | hamerins: where can we see the logs for the initializing pods? http://logs.openstack.org/70/585570/4/check/openstack-helm-dev-deploy-ceph-radosgw-ovs/9bfa295/primary/pod-logs/ceph/ceph-cephfs-provisioner-784c6f9d59-9vnx5/ ended up running and has same log data as the one that didn't | 16:18 |
*** pguimaraes has quit IRC | 16:18 | |
clarkb | http://logs.openstack.org/70/585570/4/check/openstack-helm-dev-deploy-ceph-radosgw-ovs/9bfa295/primary/pod-logs/ceph/ceph-cephfs-provisioner-784c6f9d59-44bdz/ | 16:18 |
*** ykarel| has quit IRC | 16:18 | |
*** openstackgerrit has joined #openstack-infra | 16:19 | |
openstackgerrit | Merged openstack-infra/zuul master: Fix delegate_to for ansible synchronize https://review.openstack.org/584656 | 16:19 |
*** verdurin has quit IRC | 16:21 | |
hamerins | clarkb: in the job-output.txt.gz ceph-cephfs-provisioner is in PodInitializing. the playbook is exiting with container failed to start | 16:23 |
clarkb | hamerins: yes, and the logs for the started cephfs provisioner are identical to the failed cephfs provisioner. So we don't really have much info to go off of on why it failed to start. Are there other logs that show why it failed to start or can we add logging for that? | 16:24 |
*** verdurin has joined #openstack-infra | 16:24 | |
pabelanger | clarkb: openstackgerrit is back | 16:26 |
pabelanger | should be protected now | 16:26 |
clarkb | pabelanger: thank you | 16:26 |
hamerins | clarkb: i suspect this have to do some thing with error on job openstack-helm-dev-deploy-nfs-lb. its failing to complete the TASK [build-images : Kubeadm-AIO image build path with proxy] ****************** | 16:27 |
clarkb | hamerins: I thinkthe errors are independent, in the one it looks like a network failure downloading a tarball from github (not super surprising considering that cloud has to NAT for ipv4 and github is ipv4 only), and the other job is a failure to start a container which already has an image (based on the fact that another copy of that container did start) | 16:29 |
*** andymccr_ has joined #openstack-infra | 16:29 | |
clarkb | logan-: ^ fyi there may be ipv4 NAT sadness in limestone (I can help look at that more directly soon) | 16:29 |
*** ykarel| has joined #openstack-infra | 16:30 | |
clarkb | oh wait sorry this is packethost not limestone, not sure why I read it as limestone | 16:30 |
clarkb | now I feel like a derp | 16:30 |
clarkb | in any case internet reliability (particularly github) has never been stellar | 16:31 |
clarkb | I really need that cup of tea | 16:31 |
hamerins | :) | 16:31 |
*** andymccr_ has quit IRC | 16:33 | |
*** andymccr_ has joined #openstack-infra | 16:33 | |
*** andymccr_ has quit IRC | 16:34 | |
*** andymccr_ has joined #openstack-infra | 16:34 | |
clarkb | hamerins: but still, I think those failures are separate, one is relying on internet resource which tend to be flaky and the other is we don't know what container image failing to start but another copy of it did start | 16:34 |
clarkb | hamerins: I think we need more logging for the failure to start of the container image | 16:34 |
*** adriant has quit IRC | 16:34 | |
*** adriant has joined #openstack-infra | 16:35 | |
*** psachin`` has quit IRC | 16:35 | |
clarkb | and for the third it appear to be a multinode job using 172.24.6.0/24 for floating Ips but I think we may only have routes set up for 172.24.4.0/23 (that is our default setup I would have to check job logs more closely to see if you are expanding that network range at all) | 16:36 |
hamerins | clarkb: i have not changed anything regarding to network in the code commit. | 16:37 |
*** dtantsur is now known as dtantsur|afk | 16:38 | |
*** andymccr_ has quit IRC | 16:38 | |
*** andymccr_ has joined #openstack-infra | 16:38 | |
clarkb | hamerins: http://logs.openstack.org/70/585570/4/check/openstack-helm-ironic-ubuntu/91b82b4/job-output.txt.gz#_2018-07-26_01_09_00_975182 you can see there that the firewall rules are only added for 172.24.4.0/23 | 16:38 |
clarkb | so unless you are configuring 172.24.6.0/24 somewhere else I don't expect that to work on multinode | 16:38 |
*** tesseract has quit IRC | 16:39 | |
*** andymccr_ has quit IRC | 16:39 | |
hamerins | clarkb: seems like 172.24.6.0/24 is part of the ironic setup | 16:41 |
hamerins | openstack-helm/tools/deployment/baremetal/005-setup-nodes.sh:83:OSH_IRONIC_PXE_ADDR="${OSH_IRONIC_PXE_ADDR:="172.24.6.1/24"}" | 16:41 |
*** yamahata has joined #openstack-infra | 16:41 | |
clarkb | hamerins: but what makes that routable (and valid for the firewall) from the primary node to whatever other node is running the "baremetal" host | 16:42 |
*** ykarel| has quit IRC | 16:42 | |
clarkb | hamerins: looks like you may be bootstrapping that yourselves and not using our multinode node bridge role | 16:44 |
clarkb | osh-infra-deploy-docker.yaml is what updates the firewall rules above (but using that /23 | 16:44 |
*** andymccr_ has joined #openstack-infra | 16:44 | |
clarkb | fwiw I think this is a third distinct failure case likely related to lack of ip routing from primary node (where ssh runs) to where the ironic fake baremetal instance is running either due to no route at all or firewall blocking the traffic | 16:45 |
clarkb | the connection refused message probably implies it is the firewall | 16:46 |
hamerins | clarkb: hmm, i have not done anything on the ironic code. | 16:46 |
*** bobh has joined #openstack-infra | 16:46 | |
clarkb | I don't think it is ironic, this is a level above that | 16:47 |
clarkb | you need ip connectivity between the nodes | 16:47 |
*** chandankumar is now known as chkumar|trekk | 16:47 | |
clarkb | my hunch is that if the ip was 172.24.5.6 it would work | 16:48 |
clarkb | because we allow that in the firewall | 16:48 |
clarkb | but we don't allow 172.24.6.6 | 16:48 |
*** rkukura has joined #openstack-infra | 16:50 | |
hamerins | seems like the same check is working now for other code commit logs: http://logs.openstack.org/52/581152/15/check/openstack-helm-ironic-ubuntu/ad6d4a7/job-output.txt.gz | 16:52 |
*** andymccr_ has quit IRC | 16:53 | |
*** andymccr_ has joined #openstack-infra | 16:54 | |
clarkb | hamerins: I think that could happen if the ironic baremetal instance was on the primary node, but if it doesn't schedule there it wouldn't work? | 16:54 |
clarkb | (multinode makes this complicated particularly for networking because you get away with a lot more on localhost) | 16:55 |
*** andymccr_ has quit IRC | 16:55 | |
clarkb | hamerins: can we check where that baremetal instance booted in the logs for each of those jobs? | 16:55 |
*** andymccr_ has joined #openstack-infra | 16:55 | |
*** d0ugal has joined #openstack-infra | 16:55 | |
*** d0ugal has quit IRC | 16:55 | |
*** d0ugal has joined #openstack-infra | 16:55 | |
hamerins | hmm. i have re-trigged the zuul review and its in queue. | 16:56 |
clarkb | hamerins: http://logs.openstack.org/70/585570/4/check/openstack-helm-ironic-ubuntu/91b82b4/primary/helm/libvirt.txt is there something else that would tell us where each of those pods was scheduled? | 16:59 |
clarkb | oh the libvirt logs themselves capture the hostname it is running on | 17:00 |
clarkb | each pod runs on a different host in the 3 node node job | 17:00 |
clarkb | so I think it may be 1/3 chance of working if yo uhappen to shcedule to the primary node | 17:00 |
*** derekh has quit IRC | 17:00 | |
clarkb | (still tryin gto figure out what the floating IP to libvirt pod mapping is) | 17:00 |
*** shardy has quit IRC | 17:01 | |
hamerins | hmm. i think this can help you identify the correct node http://logs.openstack.org/70/585570/4/check/openstack-helm-ironic-ubuntu/91b82b4/primary/system/ip-addr.txt | 17:02 |
clarkb | hamerins: one thing I'm noticing is that you allocate 4GB of memory to the "baremetal" instances that is quite significant when the host only has 8GB of memory (could be something to tune down for general reliability) | 17:06 |
*** jamesmcarthur has quit IRC | 17:10 | |
*** r-daneel_ has joined #openstack-infra | 17:10 | |
*** r-daneel has quit IRC | 17:10 | |
*** r-daneel_ is now known as r-daneel | 17:10 | |
clarkb | heat isn't recording where it got its stack resources from only if they failed or succeeded | 17:11 |
clarkb | lets see if the other services record this info | 17:11 |
*** Sukhdev has joined #openstack-infra | 17:13 | |
clarkb | hamerins: ya I'm not sure I can debug tis further without debug logs from services | 17:14 |
*** r-daneel has quit IRC | 17:14 | |
clarkb | hamerins: I can't find what "actual" resources are mapped to the openstack resources with the current level of debugging | 17:15 |
clarkb | *level of logging | 17:15 |
clarkb | also we should probably compress the log files | 17:15 |
*** e0ne has joined #openstack-infra | 17:20 | |
*** d0ugal has quit IRC | 17:21 | |
*** r-daneel has joined #openstack-infra | 17:22 | |
*** felipemonteiro has joined #openstack-infra | 17:22 | |
*** felipemonteiro has quit IRC | 17:24 | |
clarkb | e-r graphing is running again, a process was holding the lock for ~16 hours so I killed it and that freed up everything queued up behind | 17:24 |
*** kjackal has quit IRC | 17:27 | |
*** bobh_ has joined #openstack-infra | 17:28 | |
*** jtomasek has quit IRC | 17:29 | |
*** trown is now known as trown|lunch | 17:29 | |
hamerins | clarkb: this completed just now. http://logs.openstack.org/52/581152/15/check/openstack-helm-ironic-ubuntu/ad6d4a7/ | 17:30 |
clarkb | hamerins: I think thats the one from before? | 17:30 |
hamerins | yes. the job is almost complete for this patch set. | 17:30 |
hamerins | clarkb: how many jobs are run parallely for zuul validation? | 17:31 |
*** bobh has quit IRC | 17:32 | |
clarkb | hamerins: anywhere from none to ~1k (depends on demand and available resources) | 17:32 |
chkumar|trekk | pabelanger: we are seeing mirror timed out http://logs.openstack.org/13/586213/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/85287a1/job-output.txt.gz#_2018-07-26_17_14_28_700362 | 17:33 |
chkumar|trekk | mirror.us-west-1.packethost.openstack.org:8080; No route to host | 17:34 |
clarkb | hrm did that mirror die again | 17:34 |
clarkb | yes seems so ugh | 17:34 |
pabelanger | looking | 17:34 |
clarkb | pabelanger: I think it may need a reboot again? I'm tempted to build a new one so that nova stops trying to be smart with it | 17:34 |
clarkb | its like once a day nova checks and goes I don't know about you (yes you do silly nova) and it shelves it | 17:35 |
pabelanger | clarkb: sure, lets reboot and I can help build the replacement | 17:35 |
pabelanger | then change dns | 17:35 |
clarkb | ok I'm rebooting it now | 17:35 |
*** kjackal has joined #openstack-infra | 17:35 | |
pabelanger | k, let me get coffee and I'll build mirror02 | 17:35 |
*** myoung|lunch is now known as myoung | 17:35 | |
*** felipemonteiro has joined #openstack-infra | 17:36 | |
*** e0ne has quit IRC | 17:37 | |
clarkb | hamerins: as a first step I would try to add logging around the ceph pods so that we can see why they are failing and increasing the logging level for openstack services to debug and compress the log files | 17:37 |
clarkb | hamerins: that should make all of this much more debuggable | 17:37 |
clarkb | chkumar|trekk: it should be working again now | 17:38 |
chkumar|trekk | clarkb: thanks :-) | 17:38 |
clarkb | pabelanger: and maybe don't delete mirror01 so that john can try and debug why nova was confused about it | 17:39 |
pabelanger | clarkb: wfm | 17:40 |
*** felipemonteiro has quit IRC | 17:41 | |
*** jamesmcarthur has joined #openstack-infra | 17:45 | |
*** edmondsw has joined #openstack-infra | 17:48 | |
*** jamesmcarthur has quit IRC | 17:52 | |
*** baoli has joined #openstack-infra | 17:52 | |
*** jamesmcarthur has joined #openstack-infra | 17:56 | |
*** DuncanT_ has left #openstack-infra | 17:58 | |
*** jamesmcarthur has quit IRC | 18:00 | |
*** dklyle has quit IRC | 18:01 | |
clarkb | pabelanger: looks like we are also mostly just building and failing to build instances in packethost again | 18:01 |
pabelanger | clarkb: yah, having issues getting new mirror online | 18:01 |
pabelanger | out of space again? | 18:01 |
clarkb | timeout waiting for server to come up again | 18:01 |
clarkb | maybe? | 18:01 |
pabelanger | yah, I get timeout out mirror too | 18:02 |
pabelanger | seems to have just started | 18:02 |
pabelanger | 45mins ago | 18:02 |
clarkb | pabelanger: the new centos image there is raw fwiw | 18:03 |
clarkb | so your change took effect | 18:03 |
clarkb | and it was uploaded 6 hours ago | 18:03 |
clarkb | pabelanger: image list doesn't show us leaking images so its got to be on the converted cache side if it is image leaks | 18:05 |
clarkb | pabelanger: doyou want to email john with this info and the update that we've switched to raw uploads? (I think you have his email address) | 18:05 |
pabelanger | sure | 18:06 |
clarkb | pabelanger: looks like at least some of the in use nodes are centos. It is possible that maybe the raw image has it working for those? I dunno | 18:07 |
*** kgiusti has quit IRC | 18:08 | |
clarkb | but there are new in use xenial nodes too and I don't think those are raw yet (image is ~20 hours old) | 18:09 |
clarkb | ya confirmed it is still qcow2 | 18:11 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Restructure return values section in docs https://review.openstack.org/585981 | 18:18 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 18:18 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 18:19 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Restructure return values section in docs https://review.openstack.org/585981 | 18:20 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support job pause https://review.openstack.org/585389 | 18:21 |
*** e0ne has joined #openstack-infra | 18:22 | |
*** kjackal has quit IRC | 18:26 | |
*** kgiusti has joined #openstack-infra | 18:27 | |
clarkb | mgagne: hey, what was that thing where IPs were being reused or arp was not in agreement over what nova/neutron were assigning to VMs in the inap cloud? I think maybe that is happening again | 18:40 |
clarkb | mgagne: http://logs.openstack.org/40/568940/9/check/ironic-tempest-dsvm-functional-python3/9e5bf50/job-output.txt.gz#_2018-07-26_18_32_21_369151 after jobs has started it starts complaining that the ssh host key has changed out from under it and it appears that inap is doing this more than other clouds. Could be explained by arp not pointing to proper VM | 18:41 |
*** baoli has quit IRC | 18:41 | |
*** mgoddard has quit IRC | 18:45 | |
mgagne | clarkb: could be a rogue instance | 18:53 |
mgagne | let me check, I have a couple of free minutes right now | 18:55 |
clarkb | thank you | 18:55 |
*** tosky has quit IRC | 18:57 | |
openstackgerrit | Merged openstack-infra/zuul master: Support complex data structures as secrets https://review.openstack.org/585892 | 18:57 |
*** anteaya has joined #openstack-infra | 18:57 | |
openstackgerrit | Merged openstack-infra/nodepool master: Use pipelines for stats keys https://review.openstack.org/585577 | 18:57 |
pabelanger | clarkb: sorry, stepped away, but also looks to be recovering | 18:59 |
pabelanger | trying mirror again now | 18:59 |
mgagne | clarkb: I could only find the IP address on one compute node and the associated instance still exist. So I'm not sure what to do. Maybe the rogue instance got deleted? | 19:00 |
clarkb | mgagne: that is possible | 19:01 |
clarkb | mgagne: let me check a couple other logs really quickly to see if they have different IPs | 19:01 |
*** hamzy has quit IRC | 19:02 | |
mriedem | i've noticed that 564440 keeps getting re-queued into the check queue, | 19:02 |
*** hamzy_ has joined #openstack-infra | 19:02 | |
mriedem | even though it's been in the gate queue twice today | 19:02 |
mriedem | i'm assuming b/c of rechecks? | 19:02 |
clarkb | mgagne: what is the hostname of the instance that has the IP now? | 19:03 |
clarkb | mgagne: 198.72.124.171 was the issue IP in a couple cases according to logstsah | 19:03 |
mgagne | ubuntu-xenial-inap-mtl01-0000994667 | 19:04 |
clarkb | mriedem: yes it failed in the gate multiple times so when rechecked it has to go through check to get the +1 before it can go back to the gate | 19:04 |
mgagne | now it's on ubuntu-xenial-inap-mtl01-0000995070 | 19:06 |
mriedem | yeah it's just weird to see it in both | 19:06 |
clarkb | mgagne: ok that is currently a valid instnace | 19:06 |
clarkb | mriedem: hrm ya that is odd | 19:07 |
mgagne | I think I found other rogue instances | 19:07 |
mgagne | let me check those | 19:07 |
clarkb | mriedem: I wonder if the recheck caught it at a specific time where it could enqueue to both | 19:07 |
*** ihar has quit IRC | 19:08 | |
*** agopi is now known as agopi|brb | 19:11 | |
mgagne | clarkb: I deleted ~10 rogue instances | 19:12 |
clarkb | mgagne: thank you for looking | 19:12 |
clarkb | and for cleaning those up | 19:13 |
mgagne | yw | 19:13 |
pabelanger | clarkb: hmm, I think we might only have a single FIP in mirror tenant | 19:14 |
clarkb | pabelanger: is that a quota thing? | 19:14 |
pabelanger | no, just not attaching a pubic ip | 19:14 |
pabelanger | checking to see how many we have how | 19:14 |
*** ianychoi_ has joined #openstack-infra | 19:15 | |
clarkb | looks like quota is 10 and it doens't thin kwe are using any of them | 19:15 |
clarkb | you cna try to manually make an fip (just delete it when done) to check if it works by hand | 19:15 |
*** pcaruana has joined #openstack-infra | 19:17 | |
*** mdrabe has joined #openstack-infra | 19:18 | |
*** ianychoi has quit IRC | 19:18 | |
pabelanger | $ openstack floating ip create openstackci-net | 19:18 |
pabelanger | I get back | 19:18 |
pabelanger | 400 Bad floatingip request: Network 02f9b052-12d9-48a7-82cb-0c520b8bf894 is not a valid external network | 19:19 |
pabelanger | checking why | 19:19 |
clarkb | pabelanger: that is the private ip network that you attach the fips to, I think external is where fips are sources | 19:19 |
pabelanger | clarkb: that is the network that mirror01 is using now | 19:19 |
pabelanger | let me check where its FIPs is | 19:20 |
clarkb | pabelanger: yes for its private ip | 19:20 |
openstackgerrit | Nate Johnston proposed openstack/gertty master: Add zuul v3 style job to run pyflakes https://review.openstack.org/581872 | 19:20 |
clarkb | the fip is from external (I just confirmed by subnet showing its subnet and that is where the fip allocation range is) | 19:20 |
pabelanger | openstackci-net=192.168.1.11, 147.75.38.158 | 19:20 |
pabelanger | looks confusing | 19:20 |
*** bobh_ has quit IRC | 19:21 | |
*** r-daneel has quit IRC | 19:21 | |
openstackgerrit | Nate Johnston proposed openstack/gertty master: Add zuul v3 style job to run pyflakes https://review.openstack.org/581872 | 19:21 |
*** r-daneel has joined #openstack-infra | 19:22 | |
clarkb | pabelanger: network show external shows that this is the subnet subnet show 64fd0d1f-61a9-47e6-9211-940b161bebe9 and if you show that subnet you will see the fip allocation range | 19:22 |
*** jamesmcarthur has joined #openstack-infra | 19:28 | |
pabelanger | k, testing again | 19:29 |
clarkb | ok I'm going to step out a bit for lunch now, back in a bit | 19:31 |
clarkb | things look mostly under control | 19:31 |
pabelanger | clarkb: oh, launch-node.py worked this time | 19:33 |
pabelanger | not sure what changed | 19:33 |
*** kgiusti has quit IRC | 19:35 | |
mriedem | if i'm looking at https://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana/ceph.yaml#n19 and stats_counts.zuul.pipeline.check.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.FAILURE compared to http://graphite.openstack.org/ that's broken because stats_counts.zuul.pipeline.check.job no longer exists in the tree, | 19:39 |
mriedem | did something replace that? | 19:39 |
clarkb | mriedem: things moved with zuulv3 I dont know if that moved | 19:40 |
clarkb | check the neutron graphs as I believe they were updated to work | 19:41 |
mriedem | ok, i'm not sure how else to find and compare legacy-tempest-dsvm-full-devstack-plugin-ceph to tempest-full failure rates to see if we can make the former voting now | 19:41 |
corvus | mriedem: yeah, a few things changed... what project does this run on? | 19:41 |
mriedem | at least cinder/glance/nova/tempest in check queue non-voting | 19:42 |
mriedem | oh i see https://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana/neutron.yaml | 19:42 |
mriedem | maybe i can model after that | 19:42 |
*** kgiusti has joined #openstack-infra | 19:42 | |
corvus | stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_nova.master.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.SUCCESS | 19:43 |
mriedem | yup | 19:43 |
corvus | mriedem: there's one :) | 19:43 |
mriedem | thanks, was just getting there | 19:43 |
*** trown|lunch is now known as trown | 19:43 | |
*** ccamacho1 has quit IRC | 19:43 | |
corvus | mriedem: the biggest thing is that all the stats are in context of a project (admittedly, makes less sense for this, but more sense for "tox-py36"). second biggest thing is adding the tenant. | 19:43 |
*** bobh has joined #openstack-infra | 19:44 | |
corvus | mriedem: graphite will let you combine them, so you can replace nova with {nova,glance,...} | 19:44 |
corvus | or even *, though that may be slow at that point in the hierarchy | 19:45 |
*** pcaruana has quit IRC | 19:45 | |
corvus | oh, also the branch is in there now. | 19:45 |
mriedem | http://graphite.openstack.org/render/?width=1531&height=592&_salt=1532634445.928&from=00%3A00_20180428&until=23%3A59_20180726&target=stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_nova.master.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.FAILURE&target=stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_nova.master.job.tempest-full.FAILURE&title=cep | 19:47 |
mriedem | vs%20tempest-full%20fail%20rates%20over%203%20months | 19:47 |
mriedem | that's what i needed, thanks | 19:47 |
*** felipemonteiro has joined #openstack-infra | 19:48 | |
mriedem | corvus: so i can do stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_{nova,cinder,glance,tempest}.master.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.FAILURE ? | 19:50 |
pabelanger | clarkb: okay, mirror came up | 19:51 |
corvus | i expect something like that to work, yeah, though my graphite may be a little rusty. that may give you 4 lines, but if you put it in a function (like sumseries) it should add them up i think | 19:51 |
pabelanger | clarkb: which virtualenv should I use for rackdns | 19:51 |
pabelanger | to ensure it works via CLI again | 19:51 |
*** dklyle has joined #openstack-infra | 19:51 | |
corvus | mriedem: yeah, i guess my graphite isn't rusty. that's exactly what happens. sumSeries is the function to use if you want to combine them. | 19:52 |
corvus | mriedem: eg: http://graphite.openstack.org/render/?width=586&height=308&_salt=1532634806.158&target=sumSeries(stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_%7Bnova%2Ccinder%2Cglance%2Ctempest%7D.master.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.FAILURE)&from=-3months | 19:53 |
corvus | mriedem: vs: http://graphite.openstack.org/render/?width=586&height=308&_salt=1532634806.158&target=stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_{nova%2Ccinder%2Cglance%2Ctempest}.master.job.legacy-tempest-dsvm-full-devstack-plugin-ceph.FAILURE&from=-3months | 19:54 |
*** anteaya has quit IRC | 19:54 | |
mriedem | yup i was able to use the graphite UI to apply the sumseries to the 3 | 19:54 |
clarkb | pabelanger: /home/clarkb/rackdns-venv | 19:55 |
clarkb | on puppetmaster | 19:55 |
pabelanger | kk | 19:55 |
clarkb | if that works I think its only a cert issue | 19:55 |
corvus | mriedem: should be able to do similar things with the branch if that's an issue | 19:55 |
mriedem | yeah, just care about master right now | 19:55 |
pabelanger | clarkb: worked | 19:56 |
mriedem | and i need to fix https://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana/ceph.yaml#n19 | 19:56 |
pabelanger | mirror02.us-west-1.packethost.openstack.org online | 19:56 |
pabelanger | clarkb: but no rdns | 19:56 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Replace mirror01.us-west-1.packethost.openstack.org https://review.openstack.org/586337 | 19:58 |
*** yamamoto has joined #openstack-infra | 19:59 | |
*** agopi|brb is now known as agopi | 20:00 | |
*** chinna100 has joined #openstack-infra | 20:01 | |
openstackgerrit | Merged openstack-infra/zuul master: Restructure return values section in docs https://review.openstack.org/585981 | 20:01 |
*** hashar has joined #openstack-infra | 20:02 | |
*** yamamoto has quit IRC | 20:03 | |
clarkb | pabelanger: but forward worked? | 20:04 |
*** jamesmcarthur has quit IRC | 20:05 | |
*** eharney has quit IRC | 20:05 | |
pabelanger | clarkb: yup! | 20:06 |
pabelanger | clarkb: how did we setup rdns for mirror01? email john I guess | 20:09 |
hamerins | clarkb: zuul run completed without any issues this time. | 20:10 |
*** Swimingly has quit IRC | 20:13 | |
*** e0ne has quit IRC | 20:13 | |
pabelanger | clarkb: okay, email sent. Are we ready to update dns for mirror.us-west-1.packethost.openstack.org to mirror02? | 20:13 |
pabelanger | clarkb: I'll grab some food now, but will be back in a few hours to follow up on new mirror | 20:17 |
clarkb | pabelanger: we havent set up rdns for all nodes outside rax, just fir vexxhost I think | 20:20 |
clarkb | pabelanger: I'm ready to update dns cname when you are | 20:21 |
clarkb | hamerins: ok, as I said, without more logging its really hard to dig into the failures. Can we add more logging so that it is there if/when it fails again? | 20:29 |
*** kgiusti has left #openstack-infra | 20:32 | |
*** felipemonteiro has quit IRC | 20:33 | |
*** felipemonteiro has joined #openstack-infra | 20:33 | |
*** diablo_rojo has joined #openstack-infra | 20:34 | |
*** mdrabe has quit IRC | 20:36 | |
corvus | clarkb: do you happen to recall the blockers for enabling the opendaylight connection? | 20:38 |
corvus | https://review.openstack.org/570087 | 20:38 |
clarkb | corvus: the ssh host key verification doesn't work for the ed525119 key iirc | 20:38 |
clarkb | so we had to hard set an rsa key or something | 20:39 |
clarkb | basically their gerrit advertises a host key that they don't handle properly so we have to have zuul check for a different key and I think it will do that if we set a known hosts entry for it as rsa | 20:39 |
clarkb | I think we thought we needed to change zuuls use of paramiko but paramiko does the right thing if we give it the right hints | 20:42 |
clarkb | iirc | 20:42 |
corvus | i'm re-reading http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-06-07.log.html to refresh my memory | 20:42 |
*** kjackal has joined #openstack-infra | 20:47 | |
corvus | clarkb: yep, i think you got it. your change https://review.openstack.org/573397 added known_hosts to the scheduler, so once we add odls rsa key to that (and all other places), it should work this time. | 20:48 |
clarkb | ++ | 20:49 |
corvus | i'm working on a revised change to add that | 20:49 |
*** mdrabe has joined #openstack-infra | 20:54 | |
*** rh-jelabarre has quit IRC | 20:56 | |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add opendaylight connection to zuul https://review.openstack.org/586349 | 20:56 |
*** hamerins has quit IRC | 20:57 | |
*** hamerins has joined #openstack-infra | 20:58 | |
*** chinna100 has quit IRC | 20:58 | |
*** r-daneel_ has joined #openstack-infra | 20:59 | |
*** e0ne has joined #openstack-infra | 20:59 | |
*** e0ne has quit IRC | 21:00 | |
*** r-daneel has quit IRC | 21:00 | |
*** r-daneel_ is now known as r-daneel | 21:00 | |
clarkb | corvus: that looks right to me | 21:01 |
*** trown is now known as trown|outtypewww | 21:03 | |
*** erlon_ has quit IRC | 21:05 | |
mordred | corvus, clarkb: also lgtm - should I wait to +A? | 21:11 |
*** rfolco|ruck is now known as rfolco|off | 21:11 | |
clarkb | I don't think we need to wait, it requires a zuul restart to pick that change up right? | 21:12 |
corvus | yeah. lets go ahead and +A it so it'll be there for the next restart | 21:12 |
corvus | which... hopefully... soon. :) | 21:12 |
mordred | the next restart is going to be exciting | 21:13 |
corvus | yeah, not restarting during crunch time is kind of a two-edged sword, eh? | 21:13 |
mordred | yah | 21:13 |
*** chinna100 has joined #openstack-infra | 21:14 | |
*** jcoufal has quit IRC | 21:15 | |
*** r-daneel has quit IRC | 21:17 | |
mordred | heck - at the rate we're going, we're going to have project-vars, extra-vars, pause and complex-secrets | 21:18 |
*** mdrabe has quit IRC | 21:19 | |
*** kjackal has quit IRC | 21:23 | |
*** hashar has quit IRC | 21:23 | |
bkero | Might as well get some -e @more-vars.yml -e even_more=vars | 21:31 |
*** hamerins has left #openstack-infra | 21:33 | |
*** hamerins has joined #openstack-infra | 21:34 | |
*** hamerins has left #openstack-infra | 21:34 | |
openstackgerrit | Merged openstack-infra/zuul master: Add support for Ansible extra-vars flag https://review.openstack.org/546474 | 21:34 |
openstackgerrit | Merged openstack-infra/zuul master: Rename didAnyJobFail() to hasAnyJobFailed() https://review.openstack.org/585134 | 21:34 |
clarkb | we appear on the tail end of the daily demand though | 21:35 |
clarkb | might be able to do a restart soonish depending on smcginnis' plans | 21:35 |
smcginnis | What is the change? | 21:39 |
clarkb | smcginnis: restarting zuul to pick up the weeks worth of changes we've put off sothat feature freeze can happen :) | 21:39 |
smcginnis | Can we wait until tomorrow for that? There's still R3 and client release patches trickling in. | 21:40 |
clarkb | smcginnis: you expect that will happen through the end of pacific caost day? ( I guess tonyb will shepherd?) | 21:41 |
*** wolverineav has quit IRC | 21:42 | |
smcginnis | clarkb: Yeah, there always seems to be a few stragglers that have to get those last one or two patches in before they can release. | 21:43 |
*** edmondsw has quit IRC | 21:43 | |
mordred | smcginnis: I feel like you're talking about me | 21:43 |
*** wolverineav has joined #openstack-infra | 21:43 | |
smcginnis | I'm not naming any names! :D | 21:43 |
tonyb | clarkb: Yeah I'll be watching it today | 21:43 |
mordred | smcginnis: like, maybe you're suggesting that I don't wait until the last day to start trying to land essential patches or something crazy like that ... | 21:43 |
smcginnis | I know, I know... crazy talk. | 21:44 |
*** edmondsw has joined #openstack-infra | 21:45 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add variables to project https://review.openstack.org/584230 | 21:47 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Use definition list for job status https://review.openstack.org/584780 | 21:47 |
*** wolverineav has quit IRC | 21:48 | |
*** bandini has quit IRC | 21:48 | |
*** bandini has joined #openstack-infra | 21:48 | |
mordred | clarkb: feel like reviewing a random patch? https://review.openstack.org/#/c/585411/ | 21:48 |
*** edmondsw has quit IRC | 21:49 | |
clarkb | mordred: for the test in that the 'missing' service type is going to check the permissive code path ya? | 21:51 |
*** slaweq has quit IRC | 21:52 | |
mordred | clarkb: yah | 21:52 |
clarkb | ok approved | 21:52 |
mordred | clarkb: there's a sort of silly matrix of testscenarios in there | 21:52 |
mordred | clarkb: thanks! | 21:52 |
mordred | clarkb: that repo is low-traffic enough that it doesn't get much in the way of drive-by reviews | 21:53 |
clarkb | ya after I asked you I found that official was set in the scenario too | 21:53 |
*** bobh has quit IRC | 21:58 | |
openstackgerrit | Merged openstack-infra/system-config master: Add opendaylight connection to zuul https://review.openstack.org/586349 | 22:01 |
tonyb | I notice that the post pipeline is pretty long (132) ATM and the election publish-static job is been queued fro 8+ hours. Is that an issue or do I just need to be more patient ;P | 22:04 |
*** benj_ has quit IRC | 22:06 | |
*** benj_ has joined #openstack-infra | 22:06 | |
clarkb | tonyb: I think you just need to be patient :) queues were really long earlier in the day and we are just getting to the point where post is processing | 22:06 |
tonyb | clarkb: okay | 22:07 |
*** Sukhdev has quit IRC | 22:08 | |
clarkb | tonyb: http://grafana.openstack.org/d/T6vSHcSik/zuul-status?orgId=1 the node requests graph gives you a sense of the backlog | 22:09 |
tonyb | clarkb: Ahh cool. I'll bookmark that for next time | 22:11 |
*** wolverineav has joined #openstack-infra | 22:13 | |
*** mriedem is now known as mriedem_afk | 22:14 | |
*** wolverineav has quit IRC | 22:16 | |
*** wolverineav has joined #openstack-infra | 22:16 | |
*** wolverineav has quit IRC | 22:16 | |
*** rcernin has joined #openstack-infra | 22:19 | |
*** shrircha_ has joined #openstack-infra | 22:19 | |
*** shrircha has quit IRC | 22:23 | |
pabelanger | clarkb: back | 22:27 |
clarkb | pabelanger: I've not udpated DNS in case there was anything else you wanted to do prior to that, but responded to John's questions and checked that the new server loads things over http | 22:27 |
pabelanger | clarkb: ack, I'll do dns update now | 22:28 |
pabelanger | clarkb: cname updated | 22:30 |
clarkb | pabelanger: I'm seeing traffic to the ubuntu mirror on it now | 22:31 |
pabelanger | clarkb: and some traffic already hitting server | 22:31 |
pabelanger | ++ | 22:31 |
pabelanger | clarkb: https://review.openstack.org/586337/ | 22:31 |
pabelanger | cacti.o.o update | 22:32 |
openstackgerrit | Merged openstack-infra/zuul master: Docs: add a cross-ref in secrets https://review.openstack.org/583301 | 22:32 |
clarkb | pabelanger: most images should be transitioned to raw now too. Looks like just waiting on fedoras and bionic? | 22:33 |
*** wolverineav has joined #openstack-infra | 22:35 | |
pabelanger | cool | 22:35 |
pabelanger | #status log mirror.us-west-1.packethost.openstack.org cname updated to mirror02.us-west-1.packethost.openstack.org | 22:45 |
*** pabelanger has quit IRC | 22:46 | |
*** pabelanger has joined #openstack-infra | 22:46 | |
pabelanger | #status log mirror.us-west-1.packethost.openstack.org cname updated to mirror02.us-west-1.packethost.openstack.org | 22:46 |
openstackstatus | pabelanger: finished logging | 22:46 |
*** mriedem_afk is now known as mriedem | 22:47 | |
*** rpioso is now known as rpioso|afk | 22:48 | |
*** caphrim007 has joined #openstack-infra | 22:48 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report to gerrit over HTTP https://review.openstack.org/577027 | 22:51 |
openstackgerrit | Merged openstack-infra/zuul master: Add variables to project https://review.openstack.org/584230 | 22:54 |
*** bdodd has quit IRC | 22:56 | |
*** caphrim007_ has joined #openstack-infra | 22:56 | |
*** bdodd has joined #openstack-infra | 22:57 | |
*** caphrim007 has quit IRC | 22:58 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report to gerrit over HTTP https://review.openstack.org/577027 | 23:00 |
*** hongbin has quit IRC | 23:00 | |
*** lbragstad_ has joined #openstack-infra | 23:01 | |
openstackgerrit | Merged openstack-infra/zuul master: Use definition list for job status https://review.openstack.org/584780 | 23:01 |
*** lbragstad has quit IRC | 23:01 | |
*** knikolla has quit IRC | 23:01 | |
*** boden has quit IRC | 23:02 | |
clarkb | tonyb: we seem to have largely caught up now | 23:03 |
tonyb | clarkb: Oh cool that was quicker then I'd expected. | 23:04 |
*** mschuppert has quit IRC | 23:04 | |
tonyb | clarkb: Hmm the election site hasn't updated I'll check the post jobs for errors after I've dismantled my daughters bed | 23:05 |
clarkb | tonyb: let me know if I can help | 23:05 |
clarkb | with the zuul stuff, the bed is on wrong side of planet | 23:06 |
corvus | 20:04 <@mst> we're getting hit by a substantial botnet that isn't re-using IPs noticeably, so while we're playing whack-a-troll as fast as we can, it's imperfect at best | 23:07 |
corvus | in case anyone was wondering ^ | 23:07 |
tonyb | clarkb: :) | 23:09 |
clarkb | corvus: ya the number of IPs is impressive | 23:09 |
*** jamesmcarthur has joined #openstack-infra | 23:12 | |
*** jamesmcarthur has quit IRC | 23:16 | |
*** tpsilva has quit IRC | 23:19 | |
*** wolverineav has quit IRC | 23:23 | |
*** david-lyle has joined #openstack-infra | 23:24 | |
*** dklyle has quit IRC | 23:26 | |
*** knikolla has joined #openstack-infra | 23:37 | |
tonyb | clarkb: ... no problem just more tonyb checks too soon and the things haven't actually finished :/ | 23:42 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Report to gerrit over HTTP https://review.openstack.org/577027 | 23:43 |
*** codenix has joined #openstack-infra | 23:48 | |
*** felipemonteiro has quit IRC | 23:50 | |
*** stakeda has joined #openstack-infra | 23:50 | |
*** david-lyle has quit IRC | 23:51 | |
*** dklyle has joined #openstack-infra | 23:52 | |
clarkb | I thin kwe are fully on new mirror now | 23:53 |
clarkb | on packethost | 23:53 |
*** bobh has joined #openstack-infra | 23:57 | |
*** felipemonteiro has joined #openstack-infra | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!